WO2016048034A1 - Dispositif électronique et procédé de traitement d'informations du dispositif électronique - Google Patents

Dispositif électronique et procédé de traitement d'informations du dispositif électronique Download PDF

Info

Publication number
WO2016048034A1
WO2016048034A1 PCT/KR2015/010018 KR2015010018W WO2016048034A1 WO 2016048034 A1 WO2016048034 A1 WO 2016048034A1 KR 2015010018 W KR2015010018 W KR 2015010018W WO 2016048034 A1 WO2016048034 A1 WO 2016048034A1
Authority
WO
WIPO (PCT)
Prior art keywords
application
information
user
content
electronic device
Prior art date
Application number
PCT/KR2015/010018
Other languages
English (en)
Korean (ko)
Inventor
리우양
리우지앙후아
왕종슈에
티안준후
타오빈준
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201510323119.7A external-priority patent/CN106201161B/zh
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Priority to US15/513,754 priority Critical patent/US20170286913A1/en
Priority to EP15844278.0A priority patent/EP3200145A4/fr
Publication of WO2016048034A1 publication Critical patent/WO2016048034A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/10—Office automation; Time management
    • G06Q10/109—Time management, e.g. calendars, reminders, meetings or time accounting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • H04B1/3827—Portable transceivers
    • H04B1/3833—Hand-held transceivers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/12—Messaging; Mailboxes; Announcements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04804—Transparency, e.g. transparent or translucent windows

Definitions

  • the disclosed embodiments relate to an electronic device technology, and more particularly, to a display method of an electronic device, and more particularly, to a display method of an application in an electronic device.
  • the background view of the application usually displays a static picture or is transparent. Background views do not support displaying complex dynamic media information.
  • the layout related to the control of the application, the display position of the layout and the contents contained therein are usually fixedly displayed. They are displayed statically without being dynamically displayed, hidden, updated or changed in coordinates.
  • a user may construct a still picture only with the background view of the application, or configure the background of the application to be transparent in order to display the dynamic view of the application in a lower layer.
  • the layout and position coordinates of the control of the application are generally static. It is not possible to dynamically interact with the user to implement dynamic display, hidden or coordinate changes.
  • the view content and the control effect presented by the application of the electronic device are the same for all objects (targets) without distinction.
  • the user sees the same effect.
  • the electronic device displays the Mother's Day wallpaper (wall paper) on the background of the short message application.
  • the mother's day wallpapers appear in the background view of the short message application only when the user sends a short message to her mother or an elderly woman.
  • an application-specific control is desired for the user to use moving images or animations as the background view of the application, to flexibly update and replace the layout, manage the display and hiding, or to change the coordinate position of the control. You may want to interact with. If the target audience of the application is different, the user may also want other content to be provided to meet the actual scenario requirements of the user.
  • the disclosed embodiments provide a display method and system that can be applied to an electronic device.
  • An information processing method of an electronic device may include determining a target object of an application; Determining service content based on the target object and a current user schedule; and controlling an operation of the application on the target object based on the service content.
  • the determining of service content based on the target object and the current user schedule may include selecting at least one current user schedule based on a time of the electronic device from at least one user schedule stored in the electronic device; Determining a current user schedule associated with the target object from among the at least one current user schedule according to information on a relationship between a user schedule and a target object; And determining content related to a current user schedule related to the target object as the service content.
  • Determining service content based on the target object and the current user schedule comprises: selecting a target content from a user schedule determined based on interaction content between a user of the electronic device and a communication peer side user of the electronic device. Selecting a current user schedule associated with the target object according to information about a relationship between an object and the electronic device user; And determining content related to a current user schedule related to the target object as the service content.
  • the service content may be determined as different content for a target object having different attributes, or different content for different user schedules.
  • At least one service content is determined individually for the current user schedule, and controlling an operation of the application on the target object based on the service content may include: Determining a user schedule context based on interaction content between a user of the electronic device and a communication peer side user of the electronic device; and a current corresponding to the user schedule context of the plurality of current user schedules; And controlling an operation of the application with respect to the target object based on service content of a user schedule.
  • operations of the plurality of applications may be controlled based on the service content.
  • Controlling the operation of the application with respect to the target object based on the service content comprises: displaying service content determined according to the current user schedule and a target object of a first application in relation to the first application; And when the data regarding the second application is received, displaying a notification of the second application, wherein displaying the notification of the second application comprises: presenting the current user schedule and a target object of the second application. And displaying the determined service content.
  • the target object may be a receiver of content generated by the application or an object of an application to which the content generated by the application is applied.
  • the controlling of the operation of the application may include: detecting, by the electronic device, an event for the target object according to the current user schedule; Determining whether an operation of the application is performed on the event; and displaying information on the existence of the event if the operation of the application on the event is not performed.
  • An information processing method of an electronic device may include receiving a plurality of information through at least one application; Displaying the received information; Selecting at least two of the displayed information based on a user input; And performing information processing on the selected information by using an application corresponding to the selected information according to a single input of a user indicating processing of information on the selected information.
  • the processing of the information on the selected information may include: obtaining a plurality of caller information corresponding to each information; Generating response content using the response interface; And transmitting the response content based on the caller information, wherein the response interface includes a template button corresponding to preset content.
  • the template content corresponding to the template button may be included in the response content according to a user selection input to the template button.
  • the template content may be disposed in the response content based on placement information, and the template content may be generated based on the selected information.
  • an electronic device may include a memory in which data of an application is stored; And a processor that determines a target object of an application, determines service content based on the target object and a current user schedule, and controls an operation of the application on the target object based on the service content.
  • an electronic device may include a memory in which data of an application is stored; And receiving information through at least one application, displaying the received information according to at least one classification of an application, a sender of the information, and an execution state of the information, and displaying at least one of the displayed information.
  • a processor that selects based on an input and performs processing of the information on the selected information by using an application corresponding to the selected information according to a single input of the user indicating the processing of the information on the at least one information. do.
  • the recording medium may be a recording medium having a computer readable program recorded thereon for executing the above-described information processing method.
  • An information processing method of an electronic device may include obtaining content; And providing the content in association with the object of the application based on the association information.
  • the association information may indicate an association of the content with an object of the application.
  • the association may include a time of the electronic device, a location where the electronic device is located, a device state of the electronic device, user data stored in the electronic device, a message received by the electronic device, a user input input to the electronic device, and another application. It may be determined based on at least one of the operating state of.
  • the association is determined based on the time of the electronic device, the association is determined based on at least one of a season, a festival, and a user-defined anniversary determined based on the time of the electronic device, wherein the association is determined by the electronic device.
  • the association is determined based on at least one of a charging state of the electronic device and a connection state between the electronic device and an external device, and the association is based on user data stored in the electronic device.
  • association is determined based on at least one of the user's attribute data and movement data, and when the association is determined based on a user input input to the electronic device, the association is based on a user sliding gesture, long Push operation and user movement data acquired by a sensor of the electronic device; It may be determined based on at least one.
  • the content is at least one of a message received from an external device, a control object of another application, and the application is at least one of a lock screen application, a wallpaper application, and an unlock control application, and provides the content in association with an object of the application.
  • the performing may include displaying the content on the electronic device together with the object provided by the application.
  • the application is a lock screen application
  • the object is an unlock control of the lock screen application
  • the step of providing the content in association with the object of the application may include presenting the content in the vicinity of the object if there is user input to the object. It may include the step of displaying.
  • an information processing method of an electronic device may include determining a target object of an application; Determining a current festival associated with the target object; And performing a service of the application based on the target object and the current festival.
  • the target object may be a receiver of content generated by the application or an object of an application to which the content generated by the application is applied.
  • the current festival is a current festival related to the target object determined according to the information about the relationship between the target object and the user of the electronic device among at least one festival determined according to the time of the electronic device
  • a communication peer side with the user may include at least one of the current festivals related to the target object determined according to the information about the relationship between the target object and the electronic device user among the festivals determined based on the interaction content between the user.
  • the application may provide the target object with content determined based on the property of the target object and the current festival, and different content may be provided to the target object having different properties.
  • the application may provide content determined based on a current festival to the target object, and different content may be provided for different festivals.
  • respective contents according to the plurality of current festivals may be provided for the target object.
  • Outputting information about the existence of the event comprises: determining whether a service of the application for the event has been performed; And if the service of the application for the event has not been performed, outputting information on the existence of the event.
  • an electronic device may include a memory in which content is stored; And a processor that provides the content in association with an object of the application based on the association information.
  • the association information may indicate an association of the content with an object of the application.
  • an electronic device may include a memory in which data of an application is stored; And a processor that determines a target object of an application, determines a current festival related to the target object, and performs a service of the application based on the target object and the current festival.
  • the recording medium may be a recording medium having a computer readable program recorded thereon for executing the above-described information processing method.
  • a display method applicable to an electronic device includes the steps of obtaining a display resource; And associating the presentation resource with the first application.
  • the associating step includes managing the presence of an element of the first application based on a presentation resource according to a preconfigured association scheme.
  • the associating scheme comprises: associating with a time of the electronic device; Association with where the electronic device is located; Association with the state of the electronic device; Associating with user data of the electronic device; Associating with a message received by the electronic device; Association with user action behavior of the electronic device; And associating with a target object of an application of the electronic device.
  • the time of the electronic device includes a season, a public festival or a custom festival;
  • the state of the electronic device includes a charge state, an on / off state and a connection state of an external device or preconfigured hardware;
  • User data of the electronic device includes attribute data and / or behavioral data of the user;
  • User action behavior of the electronic device includes user sliding gesture, long-press action, or other user action coupled with a sensor of the electronic device;
  • the target object of the application includes at least one of people's social relationships, scenarios, people's attributes, and content of the application.
  • managing the presence of an element of the first application based on a display resource according to an association method with the target object of the application may include detecting a target object of the current application; Determining a current festival associated with the object; And managing the presence of an element of a first application according to an object and a display resource associated with the current festival, wherein the first application includes a current application.
  • the detecting of the target object of the current application may include: recognizing a social relationship between a target target of a module or an interface of the current application and a user of the electronic device; Recognizing a scenario of a module or interface of a current application; Recognizing the characteristics of the subject of the module or interface of the current application; And recognizing interaction content between the user and the communication peer side via the current application.
  • the social relationship includes at least one of a father-son relationship, a mom-son relationship, a marriage relationship, a sibling relationship, a friend relationship, a fellowship, alumni relationship, a teacher-student relationship do.
  • the person's attributes include at least one of gender, age, country, ethnicity, occupation and habit.
  • recognizing a social relationship between the target target of the module or the interface of the current application and the user of the electronic device may include: recognizing the social relationship according to the association information previously configured by the user; And recognizing a social relationship according to a record of an application having a data recording function in the electronic device.
  • the application having the data recording function includes at least one of a phone book application, a memo application, a calendar application, a social application, and a war game application.
  • the determining of the current festival associated with the object may include obtaining current festival information according to a time of the electronic device, and presenting a current festival related to a person according to a social relationship between the recognized person and the user. Determining a target audience of the festival; Obtaining current festival information from interaction content between a user and a communication peer side, and determining a current festival related to an object and / or security authentication information according to a social relationship between the recognized person and the user; And determining a current festival associated with a person according to a preset policy, wherein the preset policy is a system default festival display priority, a custom festival display priority, display at different time periods, display in another application. , Display based on text content recognition, nested display, or display according to the user's choice when triggered.
  • managing the presence of the element of the first application according to the display resource associated with the object and the current festival is at the interaction content and / or interaction time between the user and the communication peer side via the first application. And displaying festival re-notification information of the first application.
  • the festival re-notification information includes festival curse text information, greeting card information, and festival action re-notification information related to the current festival obtained according to the attribute of the communication object.
  • the first application includes a lock screen application, a main screen application, a notification bar (notification bar) application, a phonebook application, a music playback application, an album application, a calendar application, a calling application, a short message application, an e-mail. At least one of an application and a social application.
  • the associating step includes associating a presentation resource with one or more elements of the one or more first applications.
  • managing the presence of an element of the first application includes managing at least one of a display manner and display content of the element of the first application.
  • managing the presence of an element of the first application includes managing at least one of a static view and a dynamic view of the element of the first application.
  • the element of the first application includes at least one of the application layer and the control of the application.
  • the first application is a system appearance application, and elements of the first application include at least one of a background view, animation effect, control view, control style and layout, control animation and control content.
  • the system appearance application includes a lock screen application, a subject application, a wallpaper (wall paper) application, a main screen application, or a notification bar application;
  • An element of the lock screen application includes at least one of a background view of the lock screen, an unlock control, an unlock animation, a charge control, a charge animation, a blessing wall control, and application association controls;
  • An element of the subject application includes at least one of a background view, a window style, and a screen save animation;
  • An element of said wallpaper application comprises at least one of a wallpaper and a quick panel of wallpapers;
  • An element of the main screen application includes at least one of a style and widget content views in the main screen;
  • An element of the notification bar application includes at least one of a background view quick panel and animations associated with a preset location.
  • the widget of the main screen may include at least one of a calendar widget, a greeting card sending widget, a history information collector, a festival encyclopedia widget, a scenario shortcut widget, and an information sharing widget.
  • the first application is a text communication application, wherein the elements of the first application include at least one of a background view, text content, font, text effect, candidate text input and animation effects associated with emotion.
  • the text communication application includes an instant messaging application, an email application or a social networking application.
  • the first application is an external device application
  • the elements of the first application include an event triggered by the operation of the external device.
  • the external device application is an S-pen application.
  • the display resource includes at least one of data, a download photo resource, and a configuration file associated with the photo resource from a second application of the electronic device.
  • the configuration file is generated using an extensible markup language with preconfigured labels.
  • associating the display resource with the first application includes establishing a single level or multilevel association between the first application and one or more second applications, wherein the single level association is performed by the single application. It means establishing an association with a single module or interface of the second application, and the multi-level association means establishing an association with a plurality of modules or interfaces of the second application.
  • the method includes receiving information via one or more applications; And performing the centralized display of the information received during the festival period of the electronic device on the system interface among the information.
  • performing the centralized display of information received during the festival period of the electronic device on the system interface may include determining an application from which information is to be collected, collecting information from the determined application; And displaying the collected information on the system interface.
  • displaying the collected information on the system interface may include displaying a statistical result of the collected information on the system interface; And displaying details of the information collected on the system interface in response to a user's quick browse (browsing) command, wherein the statistical result receives a plurality of information, types of information, sender information of the information, and information. It includes at least one of the information of the application.
  • the method further comprises performing at least one action on the collected information in response to a user's quick action command, wherein the at least one action comprises a response, transmission, deletion, collection, clip Copy to board, include any of the transfer to social applications.
  • the system interface includes any one of a locked screen interface, a main screen interface, and a notification bar interface.
  • the method further comprises removing an association between the presentation resource and one or more components of the one or more first applications.
  • an information processing method applicable to an electronic device includes receiving information through one or more applications; And performing a centralized display of information related to a subject preconfigured on the system interface among the information.
  • performing a centralized display of information related to a preconfigured subject on the system interface comprises: determining an application from which information is to be collected, collecting information from the determined application; And displaying the collected information on the system interface.
  • the application for which information is to be collected includes: how often a user uses the application; An application selected by the user; System default applications; And any one of the applications that can receive the information.
  • the gathering information from the determined application includes collecting all information or information of a specified information type, wherein the information type includes content of the information; Processing status of information; Social relationships between the parties to the information; And a priority of collecting information, wherein the content of the information includes at least one of a festival blessing, a festival event, a festival bonus, a greeting card, and a red envelope (gift). At least one of unread (unread), read (read), reply, send, and collect, wherein the social relationship includes any of family, friends, and colleagues.
  • displaying the collected information on the system interface may include displaying a statistical result of the collected information on the system interface; And displaying details of the information collected on the system interface in response to a user's quick browse (browsing) command, wherein the statistical result receives a plurality of information, types of information, sender information of the information, and information. It includes at least one of the information of the application.
  • the method further includes hiding information collected on the system interface in response to a user's quick search end operation command.
  • the quick search command and the quick search end command are each triggered to be generated via at least one of a voice, a button, a user gesture, an augmented reality human-machine interaction interface, and an external controller.
  • displaying the details of the information collected on the system interface includes displaying the details of the information collected on the system interface in a preset order, wherein the preset order is information.
  • the method further comprises performing at least one action on the collected information in response to a user's quick action command, wherein the action is a response, a transfer, a deletion, a collection, a copy to the clipboard. , Any one of transmission to social applications.
  • the performing of at least one operation on the collected information may include performing an operation on an application corresponding to the information; And performing an operation on an operation interface provided by the system interface.
  • the method further comprises returning to the system interface and updating the system interface in response to completion of at least one operation on the collected information.
  • the system interface includes any one of a locked screen interface, a main screen interface, and a notification bar interface.
  • the preset theme includes any one or any combination of a preset festival, a preset theme, a preset purpose, and a non-limiting theme.
  • a display system applicable to an electronic device includes an apparatus capable of executing the method described in the first or second aspect.
  • a display system applicable to an electronic device includes a frame layer manager suitable for managing an association between a display resource and an application; And a frame layer display suitable for displaying the resource display in the corresponding application under the control of the frame layer manager.
  • the presentation system comprises a resource package manager suitable for managing presentation resources in the form of resource packages; A data store suitable for recording resource packages of the current application and for notifying the frame layer manager; And an analyzer suitable for parsing the resource package of the current application under the control of the frame layer manager.
  • the frame layer manager comprises a configuration module suitable for configuring an associated display resource and application and triggering a presentation scheme; A control management module suitable for monitoring a trigger indication event corresponding to the control of the application according to the configuration in the configuration module; And a view management module suitable for monitoring a trigger display event corresponding to the view of the application according to the configuration of the configuration module, wherein the frame layer display is configured to display a corresponding control when the control management module detects a trigger display event.
  • a suitable control display module ; And a view display module suitable for displaying the corresponding view content when the view management module detects a display trigger event.
  • an electronic device includes one screen and one display system as described in the above-described embodiments, and the screen is displayed under the control of the display system.
  • display resources are associated with an application that provides a new application visual experience to users.
  • the view and control of the application is associated with various factors such as time, spot, event, message of the application to provide a dynamic effect to the user and improve the user's experience.
  • the user can download a resource package to flexibly replace the view and control layout of the application.
  • An electronic device for controlling an operation of the application with respect to the target object based on content is provided.
  • FIG. 1A is a flowchart illustrating a display method according to the disclosed embodiments.
  • FIG. 1B is a conceptual diagram illustrating an example in which elements of an application are represented on a display unit of an electronic device and an association between elements of an application and a display resource.
  • 1C is a conceptual diagram illustrating an association between a first application and a second application.
  • 1D is a conceptual diagram illustrating an association of an application with a display resource according to the association information.
  • 1E is a conceptual diagram illustrating related information.
  • 1F is a conceptual diagram illustrating association information associated with time of an electronic device.
  • FIG. 2 shows an example of an animation associated with a preset position.
  • 3A-3B show examples of association with time of an electronic device.
  • FIG. 4 illustrates an example of association with a state of an electronic device.
  • FIG. 5 illustrates an association between a display resource and a lock screen application according to an embodiment.
  • FIG. 6 is a diagram illustrating an association between a display resource and a lock screen application according to another embodiment.
  • FIG. 7A to 7C illustrate multi-level association according to an embodiment.
  • 8A and 8B illustrate multi-level association according to another embodiment.
  • FIG. 9 is a flowchart illustrating a method of managing the presence of an element of a first application based on a display resource according to an association method with a target object of an application according to an exemplary embodiment.
  • FIG. 10 illustrates another view content displayed according to a social relationship with other people according to an embodiment.
  • FIG. 11 illustrates another view content displayed according to a social relationship with other people according to another embodiment.
  • 12A to 12D illustrate management of a festival effect resource according to an embodiment.
  • FIG 13 illustrates another view content displayed according to other scenarios according to an embodiment.
  • FIG. 14 illustrates another view content displayed according to various scenarios according to another exemplary embodiment.
  • 15A and 15B illustrate different view contents displayed according to people's attributes according to an embodiment.
  • 16A and 16B illustrate different view contents displayed according to people's attributes according to an embodiment.
  • 17 illustrates a change in series application view content triggered by recognizing a person and content according to one embodiment.
  • FIG. 18 illustrates text reminding and / or action reminding related to content triggered by recognition of content, according to an embodiment.
  • 20 illustrates different festival effects displayed at different time periods, according to an embodiment.
  • 21A is a flowchart illustrating an information processing method applied to an electronic device according to an embodiment of the present disclosure.
  • 21B is a diagram illustrating a type value assigned to each piece of information according to the type of information according to one embodiment.
  • 22A-22C are schematic diagrams illustrating a system interface of collected information according to one embodiment.
  • 23A to 23D are schematic views illustrating information collected after being classified in three manners according to an embodiment.
  • 24A and 24B are schematic diagrams illustrating a system interface representing information according to an embodiment.
  • 25A-25D are schematic diagrams illustrating a quick action on collected information in one embodiment.
  • 26 is a schematic diagram illustrating a system structure for establishing an association between a display resource and an application according to an embodiment.
  • FIG. 27 is a schematic diagram illustrating management of an association between a display resource and an application according to an embodiment.
  • FIG. 28 is a schematic diagram illustrating a structure of a display system according to an exemplary embodiment.
  • 29 is a schematic diagram illustrating an electronic device for implementing method embodiments, according to an embodiment.
  • FIG. 30 is a schematic diagram illustrating a configuration of the electronic device shown in FIG. 29 according to an embodiment of the present disclosure.
  • 31 is a block diagram of an electronic device according to an embodiment of the present disclosure.
  • 32 is a detailed block diagram of an electronic device according to an embodiment of the present disclosure.
  • An information processing method of an electronic device may include determining a target object of an application; Determining service content based on the target object and a current user schedule; and controlling an operation of the application on the target object based on the service content.
  • the determining of service content based on the target object and the current user schedule may include selecting at least one current user schedule based on a time of the electronic device from at least one user schedule stored in the electronic device; Determining a current user schedule associated with the target object from among the at least one current user schedule according to information on a relationship between a user schedule and a target object; And determining content related to a current user schedule related to the target object as the service content.
  • FIG. 1A is a flowchart of a display method of an electronic device according to an embodiment of the present disclosure.
  • an electronic device having a screen or a display screen is taken as an example.
  • the electronic device may include, but is not limited to, a mobile terminal device such as a smart phone, an intelligent television, a tablet computer, a personal mobile terminal, an electronic reader.
  • the electronic device may also support audio or tactile output.
  • An operation description of an electronic device that provides content such as a display resource, an auditory resource, and a tactile resource will be described below with an example of a display resource. The following description of the display resource can be applied to the content.
  • an indication resource is obtained at block 101.
  • the display resource may include various resources to be displayed by the application, including but not limited to static view, dynamic view, content view, style and layout, and the like.
  • the display resource may be various multimedia resources such as animation and video.
  • the display resource is a kind of content.
  • the display resource may be provided through various methods.
  • the presentation resource may be data of an application of the electronic device, for example, data received by various applications of the electronic device such as a short message application, a WeChat application, a social networking application, and an email application. have.
  • the data may include various text information, animation information, and multimedia information.
  • the data can also be various interface information of the application, eg, instant interface information, shopping interface information, game interface information, collection interface information in the WeChat application.
  • the presentation resource may be obtained from the network by an application via a network interface, for example by various client applications of the electronic device via a direct corresponding server visit. Clients may include shopping website clients, restaurant clients, game clients, and the like.
  • the display resource may be provided in the form of a resource package or the like and may be downloaded from a network, for example.
  • the resource package is an application installation package, and may be developed by a user using a corresponding resource package development tool.
  • the developed resource package can be distributed to various application stores for download and use by other users.
  • the resource package in addition to the code file, the resource package further includes an image resource and a configuration file associated with the image resource. The resource package will be described in more detail below.
  • FIG. 1B is a conceptual diagram illustrating an example in which the elements 130 of the application are represented on the display 121 of the electronic device 120 and the association of the elements 130 and the display resource 110 of the application.
  • the layers 131 and 132 may be stacked on the display unit 121 of the electronic device 120. Some regions of the upper layer 131 may be transparently expressed, such that the background layer 132 disposed on the bottom surface of the upper layer 131 may be represented through the upper layer 131.
  • Each layer can contain controls.
  • the upper layer 131 may include three controls 131a, 131b, and 131c. Each layer and controls may be associated with the display resource 110, respectively.
  • the association of the presentation resource with the elements of the application may be managed with association information.
  • An element represents an object of an application.
  • the association may include managing to show and / or hide elements of the first application based on the display resource acquired in advance according to the association scheme.
  • the managing step may include managing at least one of the display manner and the display content of the first application.
  • the display method may be an appearance of elements of an application (eg, a view, a control, etc.), for example, a layout of a control, an appearance of a control, and the like.
  • the display content may be detailed content related to elements of the application (eg, views, controls, etc.), for example, visible content displayed by the control.
  • the managing step may include managing at least one of a static view and a dynamic view of the elements of the first application.
  • the static view refers to a view that does not change over time. Dynamic views mean views that change over time.
  • the application generally includes one layer (or referred to as a view) and controls, which form a window view.
  • elements of the application may include at least one of a layer / view and a control of the application.
  • the layer may include a background layer 132 or a back layer 132.
  • the background layer is the bottom set of layers of the application and is used to decorate and display additional information about the application.
  • the background layer can be flexibly associated with various display resources, such as other styles of animation resources, so that they can be displayed and / or hidden dynamically and provide good interaction with the user. have.
  • the layer may also include an upper layer 131.
  • the top layer 131 is on top of the layer set of the application.
  • the top layer can also be associated with various kinds of presentation resources, for example only one animated view, to enhance the user experience.
  • the controls 131a, 131b, and 131c are objects on the screen of a graphical user interface (GUI).
  • An object can be operated by the user for the purpose of executing the action.
  • controls are objects that a user can interact with to input or operate data.
  • the application may include various kinds of controls. Some simple controls can include check boxes, combo boxes, edit boxes, list boxes, option buttons, general buttons, scrollbar controls, and static controls. Some complex controls may include user interactive (interactive) games, news windows, message aggregators, multimedia players, application quick start, and the like.
  • the display method and the content view of the control may be associated with different display resources according to one embodiment.
  • a lock screen application may have an unlock control and a charge control, where the unlock control is used to receive a user's unlock task, and the charge control is used to indicate charging progress to the user.
  • the lock screen application may have some self-defined controls, such as electronic device, such as a curse wall control that is used to display some predefined information on the locked screen.
  • the various public festivals or user-defined festivals received by may further include messages related to the festival (eg, various special dates, user's birthdays, various anniversary).
  • the lock screen application may further include one or more second application association controls or may be referred to as application association controls.
  • FIG. 1C illustrates the association of a first application with a second application.
  • the layer 151 of the first application includes a first control 151a, a second control 151b, and a third control 151c of the first application.
  • the layer 152 of the second application includes a first control 152a, a second control 152b, and a third control 152c of the second application.
  • the third control 151c may be associated with the second application.
  • the third control 151c may be a control for controlling the execution of the second application.
  • any one of the first control 152a, the second control 152b, and the third control 152c of the second application included in the layer 152 of the second application may be the third control of the first application. It may be included as (151c).
  • the lock screen application when the lock screen application is associated with a WeChat application, a news application, and a video application, the lock screen application may include a WeChat association control, a news association control, and a video association control.
  • the association may include associating a presentation resource with one or more elements of the one or more first applications.
  • a particular festival related display resource may be associated with one or more of a lock screen application, a main screen application, and a notification bar application.
  • the displaying resource may be associated with one or more elements of the application.
  • the display resource may be associated with one or more of a background view, an unlock animation, an unlock control, a charge control, and a charge animation. The user can select the objects (objects) that are associated when establishing an association.
  • the display resource 110 may be associated with at least one application 170 according to the association information 160.
  • the first application associated with the presentation resource 110 may be a system appearance application 171.
  • Elements of this kind of application may include at least one of a background view, animation effect, control view, control style and layout, control animation and control content.
  • system appearance application 171 can include, but is not limited to, a lock screen application, a subject application, a wallpaper background application, a main screen application, or a notification bar application.
  • elements of the lock screen application may include background views, unlock controls, unlock animations, charge controls, charge animations, and blessing wall controls when the screen is locked.
  • Elements of the subject application can include background views, window styles, and screen saver animations.
  • Elements of a wall paper application can include wallpapers and a quick panel of wallpapers.
  • Elements of the main screen application may include a style and content view of the widget of the main screen.
  • the widget of the main screen may include at least one of a calendar widget, a greeting card sending widget, a history information collector, a festival encyclopedia widget, a scenario shortcut widget, and an information sharing widget.
  • the historical information collector may provide information about today in history.
  • the scenario shortcut widget may include a quick entrance related to various scenarios, for example, a restaurant entrance, a movie entrance, a shopping entrance, a travel entrance, and the like.
  • the information sharing widget may collect data of some applications of the electronic device, for example, information received by the WeChat application, a message of a short message application, and the like.
  • Elements of the notification bar application may include a background view, a shortcut panel and animation associated with a given location.
  • FIG. 2 shows an example of animation associated with a predetermined position. It is determined whether the display and hiding of the animation view is triggered according to the up-down sliding operation and the sliding distance of the user in the application.
  • the background view of the notification bar displays the animation 203.
  • the background view of the notification bar hides the animation 203.
  • the first application associated with the presentation resource may be a text communication application 172.
  • Elements of such an application may include at least one of a background view, animation effects associated with text content, fonts, text effects, candidate text inputs and emotions.
  • text communication applications include, but are not limited to, various instant messaging applications, email applications, or social networking applications.
  • the first application associated with the presentation resource may be an external device application 173. Elements of such an application may include an event triggered by the operation of an external device.
  • external device applications include, but are not limited to, S-pen applications.
  • the element of the S-pen application includes events triggered by various actions of the S-pen.
  • Operations of the S-Pen include, but are not limited to, pressing a button of the S-Pen, clicking the screen for a while, drawing a particular graphic on the screen, and the like.
  • These actions can trigger other events, that is, events associated with elements of various applications, so as to associate elements of the application with presentation resources. For example, when a user enters other characters in a short message application using the S-Pen, an association is established between the display resource associated with the character content and the short message application.
  • the prompt may be displayed adjacent to the text, indicating whether the Happy New Year animation will be bound and delivered to the opponent (peer) side. Will be asked. If yes, when the other side receives the short message and clicks the view, the other side sees the new year animation as well as the bound text.
  • the association may include managing the appearance of the first application element based on the obtained presentation resource, according to a preset association scheme.
  • the association scheme may be referred to as trigger indication scheme.
  • the association information 160 may be managed as a table indicating an association scheme.
  • the association information includes information on association (161) indicating a condition for association to be triggered, information on an application 162 to be provided with a display resource according to the association, and a display resource 163 to be provided to the application.
  • application A may be provided with a display resource R1 (turtle) in an associative manner called time X
  • application B may be provided with an indication resource R2 (star) in an associative manner called Place Y
  • application C Can be provided with an indication resource R3 (solution) in an associative manner called state Z.
  • the association method may have a plurality of different types.
  • the associative method may include an association with time of the electronic device, an association with a spot (place) of the electronic device, an association with a state of the electronic device, an association with user data of the electronic device, and received by the electronic device. At least one of an association with a message, an association with a user manipulation behavior of the electronic device, and an association with a target object of an application of the electronic device. It should be noted that the association scheme can be arbitrarily combined. One application or elements of one application may use various associations.
  • the association scheme may include an association with a time of the electronic device. For example, it may be associated with a user's schedule through association with a time of the electronic device.
  • User schedules can include seasons, public festivals, and custom festivals.
  • the custom festival may be various special dates, such as a user's birthday and various anniversaries.
  • the user can define a special festival and specify an application in which a special festival can be displayed. For example, a user may add a wedding anniversary or a birthday to a festival database, and select and display a favorite animation effect in an application frequently used by the user.
  • the association information associated with the time of the electronic device may be configured as shown in FIG. 1F. If the date of the electronic device is XX, the electronic device may determine that the current festival corresponds to YY and, according to FIG. 1F, should provide an EE festival effect to the SMS application.
  • the self-defined festival time may be displayed preferably or the user may be prompted to construct a priority for the festivals.
  • the appearance of the elements of the application can be dynamically changed. For example, when a related date (public festival, user's birthday, wedding anniversary, etc.) is reached, a display resource associated with the date may be associated with an application of the electronic device.
  • a related date public festival, user's birthday, wedding anniversary, etc.
  • a display resource associated with the date may be associated with an application of the electronic device.
  • it is possible to realize interaction with the user by reminding the user that the relevant date has been reached and providing display resources related to the date, such as sending a festive greeting card, searching for recommended restaurants, gifts, and the like. have.
  • the time associated with each application eg, festival date
  • the displayed effect eg animation effect
  • a time-based association scheme associates presentation resources with elements of the main screen application.
  • the time may be a special festival, an anniversary, or the like.
  • Elements of the main screen application may include a widget of the main screen including a background view and a style of the main screen and a content view of the widget.
  • the widget of the main screen may include at least one of a calendar widget, a greeting card sending widget, a history information collector, a festival encyclopedia widget, a scenario shortcut widget, and an information sharing widget.
  • other elements of the main screen application may be updated.
  • a greeting card selection list for the current festival is opened, and the user may perform an operation of editing and transmitting the greeting card using the greeting card.
  • a scenario shortcut widget such as a restaurant, shopping, or movie is clicked, recommendation information related to the current festival may be displayed for the user's search and selection.
  • FIG. 3A and 3B illustrate an example of association with time of an electronic device.
  • the association application in FIG. 3A is a lock screen application.
  • the application associated with FIG. 3B is a notification bar application.
  • FIG. 3A based on a pre-established association scheme based on time, when a predetermined condition is met, for example when today is a Lantern Festival, the background view of the lock screen application is a back festival. Show related views.
  • the lock screen application background layer 301 displays an animated view 311 of the back festival.
  • FIG. 3A illustrates an example of association with time of an electronic device.
  • the background view of the notification bar application is also a Valentine's Day related view. Is displayed.
  • the background view 302 of the notification bar application of FIG. 3B displays an animated view 312 of Valentine's Day.
  • An association method may include an association with a place where an electronic device is located. Places where electronic devices are located may have different scales. According to different scale locations, the association may be established for other presentation resources. Different areas have different festivals and customs. For example, when the user of the electronic device travels to another country, the background view of the lock screen application may be replaced with a view related to that country. The display style and / or content view of the widget in the main screen application may also be replaced with content related to that country. The widget may include a restaurant, a shopping place, and the like.
  • the location of the electronic device may be determined by the electronic device itself. For example, the position of the electronic device may be determined through the positioning device of the electronic device.
  • the current location of the electronic device may be determined by photographing or scanning an external system, for example, a landmark object (landmark building, two-dimensional code of a particular location, etc.), or may be determined by a mobile network or the like.
  • a landmark object for example, a landmark building, two-dimensional code of a particular location, etc.
  • the method of determining the location of the electronic device is exemplary and is not limited to the description herein.
  • An association scheme may include an association with a state of an electronic device.
  • the state of the electronic device may indicate various attributes of the electronic device.
  • the state of the electronic device may include a charging state.
  • the state of the electronic device may include a connection state with an external device, for example, connected or not connected.
  • the external device may be an external input device such as a stylus pen S-pen.
  • the state of the electronic device may include an on / off state of specific hardware.
  • the specific hardware may be an internal special data communication chip supported by the electronic device. When the electronic device is close to an external trigger source of the chip, the communication chip is triggered and initiated.
  • the indication resource may be associated with the first application based on the on / off state of the communication chip.
  • the associated application is a lock screen application.
  • the state of the electronic device includes a state of charge.
  • the lock screen application is related to the time of the electronic device as well as the state of the electronic device.
  • FIG. 4 if today corresponds to a lantern festival, the background view of the lock screen application is replaced with a view associated with the lantern festival according to a preset association method.
  • the background layer of the lock screen application of FIG. 4 displays an animated view about the back festival.
  • the unlock animation associated with the display style of the unlock control 402 of the lock screen application is also adjusted according to the current festival, for example, the unlock animation may be a festival related animation view.
  • the lock screen application displays the charging control 401, and the display style of the charging control 401 is displayed instead of the normal horizontal progress bar.
  • Lantern As shown in FIG. 4, the color of each lattice of the lantern representing the charge control 401 changes as the charging progresses.
  • An association method may include an association with user data of an electronic device.
  • User data of the electronic device may include attribute data of the user and / or behavior data of the user.
  • the attribute data of the user may include, but is not limited to, the age, gender, occupation, and usage habit of the user.
  • the behavioral data of the user may include, but is not limited to, the current usage behavior of the user.
  • User data may be stored locally on the electronic device or may be stored on a remote storage such as a cloud data server.
  • the association scheme based on user data includes associating a display resource with a widget of the main screen application.
  • scenario shortcut widgets such as restaurants, shopping, and movies on the main screen may display and recommend different navigational content based on other user attributes, such as age, behavior, occupation, and the like.
  • shopping locations for men and clothing recommendations are different from recommendations for women.
  • Recommended content for movies, travel and restaurants for teens is different from recommended content for seniors.
  • the association scheme may include an association with a message received by the electronic device.
  • messages with different meanings can trigger the association of different display resources with the application.
  • an association between the application and another presentation resource is triggered.
  • the short message application is described as an example.
  • analysis is performed on text entered by the user or text sent by the peer side. If the text includes a predefined meaning, for example if it contains information of a festival wish, the short message background view displays an animated view of the festival wish. For example, when the user inputs a New Year's greeting such as Happy New Year, the short message background view may display an animation of swinging a firecracker. In another implementation, animations such as fireworks that are played once may be displayed in the upper layer of the chat interface of the short message application.
  • An association method may include an association with an operation action of a user of an electronic device.
  • the user manipulation behavior of the electronic device refers to various operations in which the user operates the electronic device, and may include, but is not limited to, a user sliding gesture, a long pressing operation on the screen, or another user operation combined with a sensor of the electronic device.
  • Sliding gesture is the sliding path of the user's finger on the screen. Another sliding path may associate different display resources with the first application. For example, if a lock screen application is associated with several second applications, controls associated with multiple second applications may be displayed in the lock screen view of the lock screen application. At this point, the user may trigger the display of different associated second application controls.
  • the "V" shape gesture corresponds to WeChat application control
  • the "S" shape gesture corresponds to today's headline application control
  • the "L" shape gesture corresponds to LeTV application control.
  • the user's motion associated with the sensor of the electronic device refers to a user's operation on the electronic device detected using the sensor (eg, a gyroscope, etc.), for example, a user's vibration on the electronic device.
  • the association between the display resource and the first application can be quickly triggered using the characteristics of the sensor. For example, in an example where the lock screen application is associated with several second applications, while the screen is locked, the user may shake the electronic device to trigger the display of the associated music player application control. This associative approach makes it easy to quickly use the function when the user wants to listen to music.
  • An association method may include an association with a target object of the electronic device.
  • the effect of the view content and the control provided by the application of the mobile terminal device according to the association condition is the same for all objects without distinction. For all objects of the same scenario and time, the user sees the same effect. Accordingly, the present invention provides an association method based on a target object of the electronic device.
  • the mobile terminal device intelligently associates and triggers the corresponding view content according to the target object of the current application.
  • the target object of the application may include any one of human social relations, human attributes, scenarios, and content.
  • Applications of this kind are applications that do not distinguish objects such as screen applications, main screen applications, notification bar applications, music playback applications, browser applications, and phone book applications, album applications, calendars that reside on mobile terminal devices and interact with the user.
  • At least one of an application that distinguishes an object such as an application, a calling application, a short message application, an email application, and another social application.
  • Changes in application view content may include changes in background views and / or control views of each sub-interface of the application.
  • the association scheme based on the target object of the application can be combined with the association scheme described above based on the time of the electronic device (eg festival, etc.) to intelligently trigger the festival related display resource and also the festival effect.
  • the festival effect resource package may include a series of festival related animations or static wallpapers.
  • the designated application can replace the original background view with the festival's animation or static wallpapers. After the holiday, the application restores the original view interface.
  • the application may load different festival effect resource packages for different objects to provide a corresponding content view.
  • the other object may be an attribute of people such as gender, country, age, habit, occupation, ethnicity, cultural degree, or the like, or the relationship between the rich, the relationship between the mother and child, marriage relationship, friend relationship, peer relationship, alumni relationship It can also be a social relationship such as a child's relationship, a dependency relationship, a teacher- student relationship, and a family relationship.
  • the target object of the application is the object contained in the application triggered by the current user.
  • the target object may be a receiver of content generated by the current application or an object of an application to which content generated by the current application is applied.
  • the target object of the application may include at least one of social relations between humans, human attributes, scenarios, content, and the like. Examples of target objects are not limited thereto.
  • a target object of an application is determined according to a social relationship between people. If the current festival is a wedding anniversary, the target object is determined to be the spouse of the user.
  • the application triggered by the current user is a short message application, and the recipient of the short message is the user's spouse that matches the target object of the anniversary, then the festive effect of the anniversary is a short message that can send a short message to the spouse. It may be presented in the message interface, for example, the short message background may be set as the background picture of the wedding anniversary.
  • the receiver of the content generated by the current application is determined as the target object will be described.
  • the communication peer side is regarded as a target object of the currently triggered application.
  • Communication applications include text communication (eg short messages, Wechat, email, etc.) and calling applications (all voice, video calls, etc.).
  • the communication peer side may be the called party or text sender or caller who has received or called the text.
  • the target object of the current festival includes at least one target object of the application
  • the target object of the application is related to the festival.
  • the target object of the current festival may include information such as how to determine the target object of the festival effect set by the user for the current festival as the target object of the current festival, or mentioning each contact's name and relationship in the phone book. It may be determined through any one of the method for determining the target object of the current festival according to.
  • the user can select an object corresponding to the festival effect. For example, after the user selects to display the festive effect on the anniversary, the phone book may be provided to the user, and the user may select a target object of the festive effect on the anniversary in the phone book.
  • the target object of the current festival may be automatically determined according to the name of the contact. For example, if the current festival is Mother's Day, a contact stored in the name of the mother, mother, and mother-in-law in the contact may be determined as the target object of Mother's Day.
  • an association method will be described in detail with reference to the accompanying drawings based on the application target object of the electronic device.
  • the association scheme can be combined randomly.
  • the same application or elements of that application may have different associations.
  • presentation resources may come from a variety of sources.
  • the display resource may come from data of an application of the electronic device.
  • the data may include various information received by the application, for example, various kinds of text information, animation information, and multimedia information.
  • the data may be various application interface information, for example, moment interface information of the WeChat application, shopping interface information, game interface information, my collection interface information, and the like.
  • the display resource includes the second application data, and the first application is a lock screen application.
  • the second application may include, but is not limited to, a WeChat application, a QQ application, a video application, a news application, a music playback application, and the like.
  • the display resource may be various messages received by the electronic device. Received messages may come from a variety of applications, including but not limited to short message applications, WeChat applications, e-mail applications, and the like.
  • the display resource is associated with the curse wall control 502 in the lock screen application 501.
  • the multiple association scheme may be applied simultaneously, for example, with the time of the electronic device and with the message received by the electronic device. For example, if the system time of the electronic device indicates that the user's birthday has reached, the lock screen application 501 automatically loads the curse wall control 502. In response to messages received by various applications, information such as $9 information 503 received in such applications is displayed on the wall of curse.
  • FIG. 6 is a diagram illustrating an association between a display resource and a lock screen application according to another embodiment.
  • the presentation resource is still various messages received by the electronic device.
  • the received message may come from various applications including a short message application, a WeChat application, an email application, and the like, but is not limited thereto.
  • the display resource is associated with the background view of the lock screen application 601. Multiple association schemes may be applied at the same time, for example, association with time of an electronic device, association with a message received by the electronic device.
  • the background view of the lock screen application 601 will automatically load the application data, that is, the festival-related share at the moment of WeChat, and the small Display the share in the background view of the lock screen application in the form of a window control 602.
  • single level association and even multilevel association may be established between the first application and one or more second applications when the presentation resource is data from the second application.
  • Single layer association refers to an association established between a single module or an interface of a first application and a second application.
  • Multi-level association refers to an association established between a first application and a plurality of modules or interfaces of a second application.
  • FIG. 7A-7C illustrate examples of multilevel associations.
  • the user establishes a multi-level association between the background view when the screen is locked to the lock screen application (ie, the first application) and the WeChat application (ie, the second application).
  • FIG. 7A is a schematic diagram illustrating a screen when the screen is locked, and the WeChat related control 710 is displayed.
  • FIG. 7B is a schematic diagram illustrating a screen when a user's finger hoveres over the WeChat associated control 710 or when the WeChat associated control 710 is touched.
  • Three small windows 711-713 are shown in FIG. Protruding around, each of the small windows 711-713 is associated with WeChat's independent interface.
  • small window 711 is associated with WeChat's game interface
  • small window 712 is associated with WeChat's shopping WeChat interface
  • small window 713 is associated with WeChat's instant interface.
  • the background view of the screen may display an interface associated with the small window.
  • 7C is a schematic diagram illustrating a screen displaying a background view of an electronic device when a user clicks the small window 713.
  • the background view displays WeChat's associated instantaneous interface.
  • a corresponding small window can automatically pop out on the WeChat association control 710 to facilitate the user's quick confirmation of the message. That is, in these implementations, the small window of the WeChat association control 710 is shown based on an association with an event that receives a message through that interface.
  • the user can configure the attributes of the associated second application displayed in the background or rear view of the first application according to his usage habits.
  • the attribute may include a trigger display scheme (ie, the association scheme described above) such as when such a control is displayed in which the associated second application control is displayed at a particular time, and the location of the control displayed in the first application.
  • the trigger display method or the association method may be related to time of the electronic device, association with a place where the electronic device is located, association with a state of the electronic device, association with user data of the electronic device, or by the electronic device. Association with the received message, association with the behavior of the user's action of the electronic device, and association with the target object of the application.
  • the above association method can be combined randomly.
  • the lock screen application may trigger the addition and display of different applications according to the current time of the electronic device. For example, working hours (eg, 9 am to 6 pm), control of the news application and education application can be automatically added to the locked interface. During the rest of the time (eg, 6 pm to 10 pm), the controls of the WeChat application and the game application can be automatically added to the lock interface.
  • the lock screen application may trigger the addition and display of different application controls according to the user's current geographic location. For example, when the user is at home, the controls of the online movie application may be automatically added to the lock interface. When the user is outside, the controls of the WeChat application can be automatically added to the locking interface.
  • the state of the electronic device may include an on / off state of specific hardware, or is referred to as a hardware detection event.
  • the specific hardware may be an internal data communication chip supported by the electronic device.
  • the communication chip is triggered and initiated.
  • the second application may be associated with the lock screen application according to the initiation state of the communication chip, that is, in response to a hardware detection event.
  • a control corresponding to the payment application may be displayed on a locked view of the lock screen application.
  • the electronic device detects that the NFC communication chip starts, that is, when it detects that it is close to an external trigger source of the NFC chip, a control window corresponding to the payment program may be displayed on the lock screen of the electronic device, Promote the user to perform a payment operation.
  • the start and indication of the second application association control on the first application may be triggered by the message of the second program associated with the first application, It is referred to as a message event trigger.
  • the lock screen application is associated with the WeChat application.
  • the WeChat associated control can be automatically triggered to be started and added to the lock interface.
  • the user manipulation behavior of the electronic device may include a sliding gesture of the user, a long pressing action of the screen, or a user action related to a sensor of the electronic device.
  • 8A and 8B show an example of a multi-level association.
  • the association is based on the user's manipulation behavior.
  • the lock screen application is the first application and the Tencent QQ application is the second application.
  • the lock screen application and four sub-interfaces are selected, and each of the four sub-interfaces is Tencent friend dynamics, Tencent micro blogs, Tencent friend messages and Tencent emails of the Tencent QQ application.
  • Association is established between the four sub-interfaces of the lock screen application and the QQ application. As shown in FIG.
  • a user when a user wants to trigger the display of a second application association control (ie, a QQ association control), the user moves a gesture on the screen, such as a “V” shaped gesture ( 810 can be drawn to trigger the display of the QQ associated control.
  • a gesture on the screen such as a “V” shaped gesture ( 810 can be drawn to trigger the display of the QQ associated control.
  • the indication of the second application association control can be triggered using a sensor, for example, by shaking the electronic device.
  • the second application association control may be automatically displayed on the lock screen, ie the association is based on the message received by the electronic device as described above.
  • 8B illustrates a second application association control 820 displayed on the lock screen.
  • the user's finger points over the second application association control and four small windows each pop out around the control associated with the corresponding selected sub-interface of the QQ application.
  • four small windows around the control may be displayed from beginning to end. For example, if the associated second application has a new message, the second application association control and small window around the message can be automatically displayed on the lock screen, and the new message is displayed in the corresponding small window. For example, in the Tencent Friend Message Rectangle small window, if there are two messages from other friends, the rectangle may alternatively display the friend's avatar in a scrolling manner.
  • the content of the sub-interface associated with the small window can be highlighted. For example, if a user is interested in friend dynamics, he can move his finger on the friend dynamics rectangle. The rectangular area can be expanded at a certain rate to display more content of the sub-interface. When the user clicks on the small window, the entire contents of the sub-interface are displayed on the background view of the lock screen.
  • different slide paths can associate different presentation resources with the first application.
  • the "V" shape gesture corresponds to WeChat application control
  • the "S" shape gesture corresponds to today's headline application control
  • the "L” shape gesture corresponds to LeTV application control.
  • the trigger representation or association scheme has no trigger and is always displayed.
  • the position displayed in the first application with which the second application control is associated can be dynamically adjusted according to a user's habit or user's gesture.
  • a quick start control or icon of an application associated with a screen lock application is generally located at a fixed position of the lock screen or at the bottom of the interface as an example.
  • the position range for displaying the application control according to the range of the trajectory of the user's finger may be determined.
  • the dynamic adjustment of the position according to the gesture includes determining according to the coordinate value corresponding to the long press of the user on the screen.
  • FIG. 9 is a flowchart illustrating a method of managing the presence of an element of a first application based on a display resource using an association method based on an object of the application, according to some embodiments.
  • the mobile terminal device intelligently associates and triggers the corresponding content view according to the target object of the current application in order to provide a more user friendly experience for the user.
  • the target object may be a receiver of content generated by the current application or an object of an application to which content generated by the current application is applied.
  • the target object of the application may include at least one of social relations between humans, human attributes, scenarios, content, and the like. Examples of target objects are not limited thereto.
  • An application may be classified as an application that does not distinguish between objects or an application that distinguishes between objects.
  • the application that does not distinguish between objects may be at least one of a lock screen application, a main screen application, a notification bar application, a music playback application, a search (browser) application, and the like.
  • the application for classifying the object may be at least one of a content application, an album application, a calendar application, a telephone application, a short message application, an email application, and other applications that interact with a user in the mobile terminal device.
  • a change in the view content of the application includes a change in the background view and / or the control view of each sub-interface of the application.
  • the presentation resource may be a resource package primarily for effects on user schedules.
  • the display resource for the festival in the user schedule may be a festival effect resource package. That is, the use of the festival effect resource package is triggered according to the target object of the application.
  • Festivals mentioned in these embodiments may include public festivals and user-defined festivals.
  • Public festivals include, but are not limited to, spring festivals, New Year's Day, Mother's Day, etc.
  • Custom festivals include, but are not limited to, wedding anniversary, birthday, love 100th anniversary, establishment date, and other customer desired dates.
  • Intelligent association and triggering of the view content corresponding by the mobile terminal device according to the target object of the current application may be activated by the system by default or configured by the user in an initial configuration. If the festival effect function is activated but the association of application view content based on the object is deactivated, all festivals do not differentiate and are displayed the same on the mobile terminal device and other applications in other objects. If the festival effect function is activated, and the association of the application view content based on the object is also activated, the mobile terminal device reads the current festival time information, recognizes the target object of the current application, and the target object of the current festival is selected from the current application. If it matches the target object, change the existence effect of the application according to the festival effect.
  • the user can choose to activate the festival effect function based on object recognition. As a result, a more humanized user experience can be obtained.
  • the function When the function is activated, the user can also download more effect resource packages to further enrich the humanized effect presentation.
  • Such applications may include lock screen applications, main screen applications and notification bar applications.
  • Self-defined festivals and public festivals that classify objects are often displayed in applications that classify objects.
  • Such applications may include short message applications, email applications, phone applications, social applications, and the like. The user may maintain the system default configuration or configure the association information by themselves, which will be described in detail with reference to the accompanying drawings.
  • the festive effect can be displayed in various ways. In some implementations, the festive effect can only be displayed in the triggered application. After the user exits the application, other applications do not display the festive effect. In other embodiments, the festive effect is displayed in this application as well as other applications.
  • target objects of the current application are detected.
  • the target object of the application may include at least one of a person's social relationship, a person's attributes, a scenario, and the content of the application.
  • determining the target object of the current application comprises: recognizing a social relationship between the target target of the module or interface of the current application and the user of the electronic device; Recognizing a scenario of a module or interface of a current application; Recognizing a property of a target target of a module or interface of the current application;
  • the current application may include at least one of the steps of recognizing the interacted content between the user and the communication peer side.
  • Social relationships between people and users may include, but are not limited to, father and son, mother and son, marriage, siblings, friends, peers, alumni relationships, teacher-student relationships, and family relationships. . This property includes, but is not limited to, gender, age, country, ethnicity, work and habits.
  • the social relationship between the target target of the module or interface of the current application and the user of the electronic device may be recognized through various methods.
  • social relationships may be recognized according to association information previously configured by the user.
  • the association information refers to the associated person indicated by the user when configuring the association between the presentation resource and the application.
  • the social relationship may be recognized according to a record of an application having a data recording function of the electronic device. For example, recognition may be performed based on name, alias, telephone number, device name, relationship, and / or remarks information of a contact in the user's phone book. Recognition may be understood that an application having a data recording function is not limited to the phone book. Recognition can also be calendars, notes, various social applications, and the like.
  • a current festival related to the target object detected at block 902 is determined.
  • determining the current festival related to the detected object may include acquiring current festival information according to time of the electronic device, and Determining a current festival related to the target person according to the target person of the current festival and a recognized social relationship between the recognized person and the user.
  • current festival information may be obtained from the interacted content between the user and the communication peer side.
  • the current festival associated with the object may then be determined according to social relationships and / or security credentials between the recognized person and the user.
  • the current festivals associated with the recognized person may be determined according to a predefined policy.
  • the predefined policy may include any of the following.
  • the service of the application may be performed based on the target object and the current festival.
  • the presence of the element of the first application is managed according to the present festival and the display resource associated with the detected object.
  • managing the existence of the application element may include managing at least one of the display method and the display content of the element.
  • managing the presence of an element of the application can include managing at least one of a static view and a dynamic view of the element.
  • managing the presence of an element of the application may include displaying festive reminding information in the first application according to the interaction content and / or interaction time between the user and the communication peer side via the first application. It may include a step.
  • the festival reminding information can include festival curse text information, greeting card information, festival action reminding information related to the current festival obtained according to an attribute of the communication peer side.
  • the festival effect resource package is still a display resource.
  • Embodiment 1 Example of displaying content having different views according to people's social relations
  • Users of mobile terminal devices may have different social relationships with different people.
  • the user may have different requirements for different social relations with others.
  • the social relationship may include at least one of a father-son relationship, a mother-son relationship, a marriage relationship, a friend relationship, a fellowship, alumni relationship, a dependency relationship, a teacher-student relationship, and a family relationship, It is not limited.
  • a method of recognizing social relations between people, conditions under which a set effect is displayed, and a method of existence of the effect will be described in detail.
  • the mobile terminal device can recognize a social relationship of a person through at least one of the following methods.
  • the mobile terminal device may, depending on the name, alias, phone number, device name and / or the personal remarks information of the application, Recognize relationships
  • the application may be an application that can identify people, such as phone books, notes, calendars, social applications, and / or war game programs.
  • Performing communication may include, but is not limited to, establishing a data communication connection via a communication operator network, wireless (WiFi), and / or Bluetooth.
  • WiFi wireless
  • the interaction may include, but is not limited to, making phone calls, sending short messages, instant messaging and / or online games, and the like.
  • the recognition operation may be basically performed automatically by the system or automatically after the user activates the recognition function.
  • the social relationship can be recognized according to the association information preconfigured in the configuration of the mobile terminal device.
  • the association information may be person + date + application information + replacement effect resource package.
  • the person can be the user himself or another person.
  • the application may be any application suitable for presenting effects.
  • the replacement effect resource package may be, but is not limited to, a festival effect resource package.
  • the configuration may include at least one of a person, a date, a time, an application, an address, an effect resource package, and a frequency.
  • the user can add me + birthday + lock screen + birthday animation resource package; Alternatively, it can be preconfigured as a resource package for mom (from phone book) + mother's day + short message + mother's day.
  • the mobile terminal device determines a person corresponding to the current application. For example, when a user opens a short message application and selects mom as the recipient, the person corresponding to the short message application is determined as mom.
  • the mobile terminal device loads the current festival information according to a date recognized by the current mobile terminal device. If the person corresponding to the current festival and the person corresponding to the currently running application match, the effect provided by the application may change accordingly. If the current date is not a festive day or the person corresponding to the current festival is not the same as the person corresponding to the currently running application, the effect basically provided by the application is retained. Reading of the date includes, but is not limited to, acquisition from time into the system time, calendar application, and / or network.
  • the current festival is Mother's Day.
  • the festive effect function in the menu is configured to be activated by the mobile terminal device.
  • Target objects for Mother's Day are mothers, mother-in-law, and / or aunts who are older women.
  • the background view 1010 of the short message is It may be automatically changed to the mother's day effect picture 1011.
  • the short message application is opened and the recipient selected from the phone book is a friend of the user and does not belong to the object of Mother's Day, the background 1020 of the short message is not changed and the festive effect is not displayed.
  • FIG. 11 illustrates another embodiment of displaying view content according to a social relationship between people.
  • the current festival is Mother's Day
  • the festival effect function of the menu is activated by the mobile terminal device.
  • FIG. 11 when today is detected as Mother's Day, when a phone application is opened and Mom is selected through the phone book (a), phone background 1110 according to the festive effect 1111 of Mother's Day. This can be replaced.
  • the phone application is executed and the contact selected from the phone book is the user's friend (b), since the friend does not belong to the object of Mother's Day, the phone background 1120 is not changed and the festive effect is not displayed.
  • the effects provided by the application may include at least one of static pictures, dynamic pictures, background music, audio, video, and shaking of the mobile terminal device, or any combination thereof.
  • the dynamic picture may be an animation that is played once and / or an animation that is played cyclically.
  • An animation that plays only once is referred to earlier as an animation that plays once when an animation is triggered.
  • the notification bar application triggers to play an animation when the user pushes down the notification bar. After the animation plays once, the animation disappears. When the notification bar is lowered down again, the animation plays again.
  • the effects presented by the application can be managed without limitation in the form of effect resource packages.
  • the management scheme includes, but is not limited to, at least one of downloading, deleting, applying, and modifying. Different resource packages provide different effects.
  • the configuration menu provided by the mobile terminal device may include an option for receiving input from a user to select an application for which the effect is presented. The user may set whether the festival effect is applied to all applications or only some applications using the configuration menu. For example, the user may choose to display the effect only in the trigger application or to display the festive effect in this application as well as other applications. If the downloaded festival effect resource package does not support the application selected by the user, a message may be displayed to the user instructing to download the corresponding application resource package supporting the application selected by the user from the network.
  • 12A to 12D illustrate a management step of a festival effect resource according to an embodiment.
  • 12A shows the background view template 1201 downloaded from the resource center.
  • 12B shows original background view template 1202.
  • 12C shows editing of a background view template by a user.
  • 12D shows an edited background view 1203 that is automatically displayed in the application interface when the user sends a short message to the mother on a festival (Mother's Day).
  • a user downloads a festival effect template, such as a background view and / or a greeting card, from a festival effect resource center, and displays a festival effect template, such as photo colors, background music, and / or animation. Edit the configuration, and then select the application to apply. It is assumed that the festival effect function is set to be activated in the configuration menu of the mobile terminal device. The system detects the festival information of the day. If the current application matches the user's settings and the person corresponding to the current festival matches the person corresponding to the currently running application, the effect provided by the application is automatically changed to a custom festival effect.
  • a festival effect template such as a background view and / or a greeting card
  • Embodiment 2 Display of Different View Contents According to Different Scenarios
  • a phone application when a user makes a phone call to one object, the user may receive a phone call from another object. Both objects can have an associated festive effect.
  • a call scenario and an incoming scenario exist at the same time, different view contents need to be displayed according to various scenarios.
  • the mobile terminal device provides an effect by associating and triggering the corresponding view content through object detection of the application.
  • the specific view content is subject to the object in each scenario and the festival of the object.
  • the mobile terminal device determines the application associated with the festival according to the system default configuration or the user's initial settings. For public festivals that distinguish objects from custom festivals, any application that can present a festival effect, or any application that distinguishes objects (for example, a short message application, an email application, and / or a calling application). Associations can be constructed.
  • the festive effect can be displayed in a variety of ways. For example, in a first way, the festive effect is simply displayed when the application is triggered. After the user exits the application, other applications do not display the festive effect. Or, in a second way, the effect of the festival is displayed in other associated applications as well as in the triggered application. Those of ordinary skill can design other ways not described herein.
  • the manner of displaying the effects of the festival corresponding to different objects is recognized based on the application module.
  • the sub-module of the calling application includes at least one of a receiving telephone interface and a calling interface.
  • the sub-module of the short message application includes at least one of a short message background view and a message text item view.
  • Different modules may display different content for different objects.
  • the mobile terminal device reads the current first festival time information and recognizes the first target object of the current first application. If the object of the first festival and the target object of the first application match, the effect provided by the first application is changed to the first festival effect.
  • the mobile terminal device reads the current second festival time information and recognizes the second target object of the second application. If the target object of the second festival and the second application target object match, the effect provided by the second application is changed to the second festival effect.
  • the number of festivals, objects and / or applications is not limited to two. These may be three or more.
  • the mobile terminal device detects that it has received an incoming call 1311 from his wife and responds to the call.
  • the mobile terminal device detects that today is the wedding anniversary, and displays the effect 1312 of the wedding anniversary on the calling background 1310 (a).
  • the mobile terminal device detects an incoming call 1321 from the user's mother.
  • the mobile terminal detects that today is also the mother's birthday. Accordingly, the mobile terminal device displays the mother's birthday effect 1322 of the received call message information 1320 to receive the mother's incoming call (b).
  • FIG. 14 illustrates another implementation of displaying different view content according to different scenarios according to an embodiment.
  • the mobile terminal device detects that the user sends a message to his wife.
  • Short message background 1410 indicates wedding anniversary effect 1411 (a).
  • the call background 1420 displays a birthday effect 1421 (b).
  • the user continues to send a message to his wife, and the short message background displays the anniversary effect.
  • Each of the above embodiments describes a scenario when an incoming call is received during a certain telephone call and an incoming call is received when a short message is transmitted.
  • the present invention is not limited to the above-described scenario, and may include a scenario in which switching is performed between multiple applications or between different modules of the same application, or may include a scenario in which interconnecting devices switch devices. have.
  • Interconnect devices mean that a number of mobile terminal devices establish a data communication connection via a communication operator network, wireless and / or Bluetooth.
  • the festival mentioned in the above embodiment is not limited to a wedding anniversary or a birthday. It may be another public festival and / or a self-defined festival.
  • the change of the festival effect described in the above embodiment is not limited to replacement.
  • the festive effect may be displayed in an overlapping manner.
  • the mobile terminal device reads the first festival time information and recognizes the first target object of the first application. If the target object of the first festival matches the first target object of the first application, the effect provided by the first application is changed to the first festival effect.
  • the mobile terminal device reads the second festival time information and recognizes the second target object of the second application. If the second target object of the second festival matches the second target object of the second application, the effect provided by the second application is the corresponding second festival effect, and the effect provided by the first application is still the first festival. Effect.
  • the call background displays the wedding anniversary festive effect.
  • the incoming message information 1302 shows the effect of the mother's avatar and contact name and the mother's birthday
  • the rest of the phone call background shows the effect of the wedding anniversary do.
  • Example 3 Display of Different View Contents According to People's Attributes
  • Different people can have different properties. Other attributes may be reflected in the view content and controls of the application of the mobile terminal device. In everyday life scenarios, if the person corresponding to the application has different characteristics, the content displayed for the user is changed to meet the user's requirements in the other scenario.
  • the attribute of the person may include at least one of sex, age, country, nation, action, habit.
  • the application may include, but is not limited to, an application that distinguishes object attributes such as calling application, short message application, e-mail application, and / or social application.
  • the mobile terminal device can recognize a property of a person through various methods.
  • the mobile terminal device recognizes the attribute according to the relevant item note information of the contact in the telephone directory of the user.
  • the mobile terminal device may recognize an attribute according to the person's name, alias, telephone number, device name and / or remarks information.
  • the application can be an application that can identify people's attributes, such as phone books, notes, instant messaging applications, and / or war game applications.
  • the communication includes, but is not limited to, establishing a data communication connection via a carrier network, wireless and / or Bluetooth.
  • the above interactions may include, but are not limited to, making phone calls, sending short messages, instant messaging and / or online games, and the like.
  • the recognition operation may be basically performed automatically by the system or automatically after the user activates the recognition function.
  • User-related data includes, but is not limited to, the user's usage habits, the location of the user as detected by the electronic device or mobile terminal device. Usage habits can be detected through the use of browser applications and various game applications by the user. The user's location can be detected through the use of a navigator, map and location determination application.
  • the recognition may be implemented according to the association information previously set by the user.
  • Association information refers to a configuration that is performed when associating an application with a display resource, for example, the association information includes a related person, a related date (such as a festival), a related application, and a related display resource package (such as a festival effect resource package). can do.
  • the association information can be represented as person + date + application + resource package. For example, a user may configure Me + Birthday + Lock Screen + Camera Resource Package, or Mom (in Phonebook) + Mother's Day + Short Message + Teacher Resource Package.
  • the mobile terminal device determines the attribute of the individual corresponding to the current application, and obtains the current festival information by reading the current date. If a person corresponding to the current festival matches a person corresponding to a currently open application and there is a festival effect presentation resource that matches the person's attributes, the effect shown by the application may have a corresponding change. If the current date is not a festival day or the person corresponding to the current festival does not match the person corresponding to the currently open application, the effect shown by the application is retained. If the person corresponding to the current festival matches the person corresponding to the currently open application, but there are no festival effect display resources that match the attributes of the individual corresponding to the application, the effect shown by the application does not change or The effects of festivals that do not distinguish characteristics can be displayed. The date can be read from the system time, calendar application and / or network time without limitation.
  • 15A and 15B illustrate display of different view content according to an individual's attributes according to one embodiment.
  • the electronic device detects the festival date information and triggers to show the festival effect.
  • the incoming call 1501 from the grandson is displayed on the receiving telephone interface of the grandmother's mobile terminal device.
  • the property (eg, age) of the person (ie, grandson) corresponding to the incoming telephone interface is recognized.
  • an incoming call 1511 from the grandmother is shown on the incoming call interface of the grandchild's mobile terminal device.
  • the attributes (age, etc.) of the person (ie, grandmother) corresponding to the incoming interface are recognized to display the traditional style animation 1512 corresponding to the age of the grandmother.
  • 16A is a view illustrating display of different view contents according to an attribute of an individual, according to another exemplary embodiment.
  • Fig. 16A when it is detected that the current festival is a mid autumn festival (mid-autumn festival), the call 1601 from Mr. Chen is displayed on the incoming telephone interface of Mr. Kim's mobile terminal device.
  • the attributes of the person (ie, Mr. Chen) corresponding to the incoming telephone interface (ie, country, etc.) are recognized to display a Chinese-style animation 1602 corresponding to Mr. Chen's country.
  • Fig. 16B when it is detected that the current festival is a mid autumn festival (mid-autumn festival), a call 1611 from Mr. Kim is displayed on the receiving telephone interface of Chen's mobile terminal device.
  • the attributes of the person (ie, Mr. Kim) corresponding to the incoming telephone interface to display the animation 1612 in the Korean style corresponding to Mr. Kim's country are recognized.
  • the user can also select a complete set of resource packages in specific fields. Once the complete set of resource packages is applied, the view contents of various applications can be replaced with view contents in the field of the festival day. For example, a user can download a complete set of package resources, including the resources of nine traditional festivals. For example, the theme of these resources could be the world's famous cars.
  • Different applications have matching resources to implement the replacement.
  • this matching resource may be a keyboard background of an input method application, a background animation of a lock screen application, or a background animation of a notification bar application. Different application display styles and view content styles may be different. For example, the background view of the lock screen application represents an animation that is rotated.
  • the animation plays in response to the user's gesture.
  • the animation plays only once.
  • the animation disappears after it plays. Only when the user pushes down the notification bar again, the animation plays again.
  • the gesture action may include at least one of a long press, in particular a slide along an orbit, an S-pen hovering, a sensor, or the like.
  • Example 4 Triggering Changes in View Content of a Series of Applications According to Recognition of People and Content
  • the view content and control of multiple applications can be changed simultaneously in accordance with the recognition of the person and content corresponding to the current application.
  • perception of a person refers to recognizing a social relationship between a communication peer side and a user. Recognition may be implemented according to various methods described with reference to the first embodiment.
  • the recognition of social relationships is also a kind of security certification.
  • this security certificate only remote objects that have passed the local user's security certificate can trigger changes to the local view content. As such, triggering of local view content is protected by the remote object. Not all remote objects can trigger changes in local view content. For example, the local user and the remote object have a marriage relationship, and the contact characteristic relationship information of the spouse of the local user is stored in the phone book. Alternatively or additionally, the local user may choose to use the contact remote auto trigger feature to enhance the level of security.
  • Current applications may be any application capable of receiving information sent by a communication peer side, including but not limited to short message applications, email applications, various social applications, and the like.
  • the text recognition task may be performed on the content of the information to determine whether a particular content characteristic exists.
  • the characteristic content may be stored in the database in advance.
  • the characteristic content may be various kinds of festival-related information, for example, festival curses and festival notifications.
  • the characteristic content of the information can be captured through text matching.
  • the user schedule context in the content may be determined based on the interaction content between the users. For example, the electronic device may determine a festival context corresponding to the interactive content among the plurality of current festivals based on the interactive content.
  • the user schedule context refers to a user schedule determined to correspond to the corresponding content according to analysis of specific content.
  • text recognition can be used to capture the content (short message, email, multimedia greeting card, etc.) sent by the remote object to capture the relevant characteristic content (such as festival-related information). Including but not limited to), triggering a change in the view content of the corresponding application. For example, if the short message sent by the remote object includes information related to “the wedding anniversary”, then the mobile terminal device responds to the detected social relationship and security authentication information between the remote object and the local user, and the current application. After reading the short message using the short message application (in this embodiment, the current context) is determined. The mobile terminal device notifies the user first of whether to change the view content of the application that is triggered to change the view content according to the determined context, or to change the view content of the application according to the security level set by the local user. Let it pop out.
  • the application triggered to change the content of the view may be various applications that interact with the user, including the current application.
  • applications include calling applications, phone book applications, lock screen applications, short message applications, notification bar applications, main screen applications, music player applications, album applications, calendar applications, social applications, input method applications, and email applications. It may include, but is not limited to.
  • the application triggered to change the view content can be determined in various ways.
  • the application triggered to change the view content may be determined according to the application usage frequency. For example, only the Nth application that the user uses most often is triggered.
  • the application triggered to change the view content can be determined at the user's choice. For example, a list of applications can be provided to the user, who selects an application to be triggered from the list to change the view content.
  • the application triggered to change the view content may be determined according to the default configuration of the system.
  • the default configuration of the system includes a short message application, a WeChat application, and a calling application.
  • the application triggered to change the view content can be any application that interacts with the user.
  • An application whose view content can be changed is installed in the mobile terminal device, and the application supports a free change of the view content through the download of a resource package.
  • the background view of the application may change, and the related controls may also change. For example, if a date of the mobile terminal device corresponds to a festival day, the mobile terminal device may automatically add a festival control to the main screen.
  • the festival control may include at least one of a quick preview information item, a festival encyclopedia, a festival gift recommendation, a festival card, and a shortcut key (shopping, restaurant, packet order).
  • the user can quickly enter the corresponding living service pages such as shopping, restaurants, cinemas, online greeting cards through festival controls.
  • the festival effect function is activated.
  • the current festival is a wedding anniversary, but the user did not store the wedding anniversary date in advance in the mobile terminal device. Therefore, the festival effect does not appear in the background of the short message of the mobile terminal device (1710).
  • the user's lover wants to surprise the user.
  • the short message information received by the user's mobile terminal device transmitted by the user's lover includes "Happy Anniversary" (1721).
  • the mobile terminal device obtains current festival information from this content. Accordingly, the festive context according to the current short message is determined as the wedding anniversary. For example, the present festival is determined by the wedding anniversary. Next, according to the social relationship between the sender and the user (marriage relationship) and the security credentials (passing the local user's security certificate), a series of applications will be triggered to load and use the festive effect resource package associated with the anniversary. I think you can. For example, in this example, as shown in FIG. 17, after the mobile terminal device executes the short message application, the short message background 1720, the dial interface 1730, the lock screen 1740, and the main screen ( 1750 shows the corresponding festival effect.
  • the change in the view content of the application is triggered by sending a short message to the user.
  • the triggering scheme is not limited to short messages, but may also include triggering by transmission of email and / or multimedia greeting cards.
  • the trigger condition includes recognition of a relationship, security authentication, recognition and determination of detailed text content (festive keyword). Recognition of the relationship and security authentication are as described above.
  • the user's mobile terminal device may automatically store the festival day and festival information in an application such as a phone book, a memo, and / or a calendar, so that in this embodiment Can save the date of the.
  • the application showing the festival effect includes a short message application, a dial interface application, a lock screen, and a main screen application.
  • the application triggered to change the view content may be another application that interacts with the user on the mobile terminal device (eg, an application selected in the settings menu to show the festive effect).
  • the festive effect appears in all or some applications depending on the parameters set.
  • the trigger condition when the trigger condition is satisfied, it is possible to set a parameter related to the configuration menu to determine whether the festival effect is triggered immediately or after the user's approval.
  • an automatic trigger is employed.
  • a parameter with a high security level can be selected in the configuration menu. After the parameter with the high security level is set, the festive effect is not shown immediately after the relevant conditions are met. For example, the notification bar may pop up to allow the user to decide whether to apply the effect in the application.
  • the mobile terminal device can close the festival effect triggered by the user's action.
  • the user action may include at least one of remote triggering to close all or some applications of the festival menu, remote triggering to close one or more festivals in the festival menu, and gestures to close one or more festival controls on the main screen. .
  • Embodiment 5 Triggering of Text Notification and Task Notification Related to Content in Recognition of Content
  • the mobile terminal device can change the view content of the application according to the social relationship between the user and the person corresponding to the application. In real life scenarios, simply changing the view content of the application may not be sufficient for the needs of the user. In addition, it is also required that certain effective actions (events) be performed on the person corresponding to the application on a particular date (such as the date of the festival). For example, actions (events) that send festival curse information and purchase festival gifts may be performed. This is because some users may forget to do this.
  • the festival reminding information may be displayed in the application according to the interaction content and / or the interaction time between the user and the communication peer side through the application.
  • the festival reminding information is displayed on the display interface of the application.
  • the festival related behavior may be different.
  • the festival related action of the calling application may be to make a call
  • the festival related action of the short message application may be to send a festival curse short message.
  • the reminding information may no longer be shown to the application for that object.
  • the reminding information may be displayed.
  • the reminding information may be displayed when the user sends a short message to the mother or when calling the mother.
  • the reminding information may be displayed in the user's short message interface and the user's call interface.
  • the reminding information is not shown in the display interface of the application.
  • the festive effect function is activated after the initial setting of the mobile terminal device. If the current festival is Mother's Day and the user detects that she did not send a festive blessing to her on that day, the user opens a short message interface and reminds her of Mother's Day information if the recipient is a mother. Information can be displayed. Otherwise, the reminding information is not shown.
  • the festival reminding information may include text reminding information and / or behavior reminding information.
  • the text reminding information may be various text reminding including "blessing XXX", but is not limited thereto.
  • the action reminding information may be various festive action items including various shopping items such as jewelry, flowers, birthday cakes, and theater tickets, but is not limited thereto, or other types of operations such as distributing electronic red envelopes. May be an item.
  • the content and format of the festival reminding information may be different.
  • today is Mother's Day.
  • the text reminding information is today for Mother's Day and may be calling the mother.
  • the text reminding information is today for Mother's Day and may be sending a short message to the mother.
  • the reminding information may be automatically learned. For example, on the day of the festival, the recommendation information may be obtained through network search based on the object's attributes (age, habit, gender, occupation, etc.). For example, today is Mother's Day. Recommendations representing the blessings and most popular gifts sent by most people are obtained based on the interests and habits of the user's mother.
  • the operation reminding information is not limited to the above-described shopping, ticket ordering and red envelope distribution.
  • the reminding of the operation may be changed according to the object of the current application and the current festival. For example, for Mother's Day, gift recommendations for mom, mother-in-law, and aunt may be different. Differentiation of an object may be based on other attributes of the object such as age, gender, habits, occupation, and the like.
  • the associated application includes, but is not limited to, at least one of a phone book application, a short message application, a calling application, a calendar application.
  • the festival reminding information may express the effect through various methods.
  • the objects when multiple objects participate in an application, the objects can be sorted, and the objects associated with the current festival are ranked first to remind the user. For example, in a phone book application when a user opens an application, a contact in the phone book that matches the target object of the current festival is ranked first in the phone book.
  • the style and format of the entry of related contacts is distinguished from the style and format of non-festive objects.
  • Objects associated with the festival can be displayed next to the entry in the contact. For example, on Mother's Day, a carnation may be displayed next to an entry in every contact associated with Mother's Day.
  • the birthday cake can be displayed next to the entry of all contacts on the birthday day.
  • the reminder may be marked primarily as a self-defined festival.
  • two symbol objects can be shown adjacent to items of contacts, carnations and birthday cakes.
  • the festival effect function is activated.
  • Today is Mother's Day.
  • the mobile terminal device may detect that the current festival is Mother's Day and apply a festive effect in an application (eg, a lock screen application).
  • the background view 1811 of the lock screen 1810 may be changed to a picture related to Mother's Day. If the mobile terminal device further detects that the user has not yet sent a festive blessing to the mother that day, the user's entry may be displayed in the first row 1821 when the user opens the phonebook application 1820. have.
  • the user may directly call 1822 or send a short message 1823.
  • the reminding sentence “Give a Mom a Greeting” 1831 may be displayed in the call interface 1830 when the user calls the mother for the first time that day. If the user sends a short message including "Mother's Day” and "congratulations” to the mother, the user may be reminded to present a gift, flower, etc. to the mother via the gift content 1882.
  • Embodiment 6 provides a solution for resolving conflicts based on flexible policies. That is, the festival related to the object may be determined according to a preset policy.
  • the flexible policy or the preset policy according to an embodiment may include any one of the following, but is not limited thereto.
  • the festival effect function is activated.
  • the mobile terminal apparatus detects that the current day is a mother's day and a mother's birthday.
  • the mobile terminal device displays the festive effect 1911 of mother's day on the lock screen application 1910 and the festive effect 1921 of the mother's birthday on the mother's incoming call interface 1920.
  • the mobile terminal device detects that the current festival is Valentine's Day and is the birthday of the user's wife.
  • the first short message is sent to the wife
  • the festive effect 2011 of Valentine's Day is displayed on the short message sending screen 2010.
  • the effect 2012 of the festival of the birthday is displayed on the short message sending screen 2010.
  • Flexible policies may include custom festival display priorities.
  • the priority of the self-defined festivals can basically be determined higher.
  • the user can change the setting.
  • the mobile terminal device can exhibit the effect on the festival with higher priority according to the flexible policy in the same application.
  • the flexible policy may include an indication based on textual content recognition.
  • a short message content such as Happy Mother's Day
  • the short message background is replaced by the festive effect of Mother's Day.
  • a birthday short message content such as Happy Birthday is sent to the mother
  • the short message background is replaced by the festive effect of the birthday.
  • Flexible policies can include nested indications.
  • the background of the short message can be the festive effect of Mother's Day.
  • the festive effect of the birthday can be applied.
  • Flexible policies can also be flexibly chosen by the user when the application is triggered.
  • today's Mother's Day, and also Mother's Birthday when a user sends a short message to the mother, one window tells the user whether the effect of Mother's Day's festive effect or Mother's birthday is to be applied. You can have it pop up to select.
  • the display policy of the short message application is mainly described as displaying at different times.
  • the display policy of the application can be modified in the configuration menu.
  • the display policy of an application may be changed to display based on textual content recognition or superimposed display rather than displaying at different times.
  • the association between the presentation resource and the first application is removed.
  • This step 103 may be omitted as an optional step.
  • the association between each application and / or each element and the display resource may be removed respectively. It is to be understood that the process of removing associations is the inverse of the process of establishing associations. Therefore, description thereof is omitted.
  • a user In everyday life, a user generally receives a lot of information related to the festival, such as blessing information, festival event information or festival greeting card on the day of the festival. If the user wants to confirm the information, he must open the corresponding application. If the user wishes to operate the information (if he / she wants to respond), the user must act on each piece of information that provides an inappropriate festive effect experience for the user.
  • information related to the festival such as blessing information, festival event information or festival greeting card on the day of the festival.
  • the preset theme may be a preset festival, a preset topic, a preset person, or some topic or no topic.
  • a quick search and quick action on information is described taking the festive scenario as an example. That is, the preset theme is information related to the festival received on the day of the festival.
  • the description of the embodiment is not intended to limit the present invention to the festival scenario.
  • the present invention is also applicable to scenarios in which various subject information should be collected.
  • 21A illustrates a method for an electronic device to process information according to an exemplary embodiment.
  • the electronic device receives information via one or more applications.
  • Applications used to interact with an external device may be installed in the electronic device.
  • Applications can include short message applications, e-mail applications, and various social applications.
  • the electronic device may receive various information through such an application. On the day of the festival, the user may receive a lot of festival related information. The information is distributed to that application.
  • the preset theme is the current festival.
  • the mobile terminal device may collect information received through various applications and display the information on the system interface.
  • the user can quickly retrieve the received festival information without opening the corresponding application, thereby improving the user's festival effect experience.
  • displaying the information related to the preset subject matter on the system interface may include block 2103 for determining the application for which the information is to be collected.
  • the mobile terminal device can determine the applications for which the information is to be collected according to any one of the frequency with which the user uses the application, the application selected by the user, the system default application, and all the applications that can receive the information.
  • the mobile terminal device can collect all received information.
  • the mobile terminal device can collect information received by the system default application. For example, if the default application includes a short message application, a WeChat application, and a QQ application, the mobile terminal device collects information received by these applications.
  • the mobile terminal device can also collect information received by the application at a relatively high frequency of use. For example, the first and second applications with relatively high frequency of use are short message applications and WeChat applications. Thus, the mobile terminal device collects information received by these two applications.
  • the mobile terminal device can provide a list of applications to the user, and the user selects the application of information to be collected from the list. The mobile terminal device then collects the information according to the application selected by the user.
  • the collected information is festival-related information received on the day of the festival and is suitable for a preset theme.
  • the mobile terminal device can collect all information of this type. Alternatively or additionally, the type of information may also be indicated when only information in this display form is collected.
  • the information may be classified into different types according to various factors. A description will be given with reference to FIG. 21B.
  • the information type may include at least one of festival $9 information, festival event information, festival discount information, greeting card, and red envelope information (gift information).
  • the information type may include at least one of unread information, read information, already returned information, transmitted information, and already collected information.
  • the type of information is defined by information sent by the family, information sent by a friend, or by a colleague. Transmitted information and the like.
  • classification may be performed based on the gathering priority 2114 of the information.
  • the information type may include at least one of a high priority, a medium priority, a low priority, and the like.
  • the priority may be configured by the user.
  • the mobile terminal device can collect all received information.
  • the mobile terminal device can provide the user with the type of information determined in accordance with the various different manners above, and the user can select the type of information to collect.
  • the mobile terminal device collects information according to the type of information selected by the user. For example, after receiving the information, the mobile terminal device determines whether the type of information matches the type of information selected by the user. If there is a match, that information is collected as information to be displayed on the system interface. If they do not match, no information is collected.
  • the type of information selected by the user is festival blessing information, unread information, information from family and friends, ie, the user will collect unread festival $9 information sent by family and friends.
  • the mobile terminal device determines whether the information includes festival $9 information according to the information content, whether the information is unread information, and whether the sender of the information is a family or friend of the user. If the determination result is all yes, the information is collected and displayed on the system interface.
  • the keyword can be searched in the information content, and it is determined whether the keyword is a festival blessing keyword. If the keyword is a festival blessing keyword, it is determined that the information is festival blessing information. For example, the current festival is a spring festival. Festival Blessing Keywords is a happy spring festival. If the received information includes the keyword happy spring festival, the mobile terminal determines whether the information is festival blessing information.
  • the determination may be performed based on the relationship established by the user for each contact in the phone book. For example, a user configures a relationship category for a contact in the phone book, such as family, friends, and colleagues. Upon receiving the information transmitted by the contact in the category of the family, the mobile terminal device determines that the information has been transmitted by the family.
  • the gathering priority of the information may be configured by the user. Information is collected in descending order of priority. For example, the mobile terminal device may first collect information of the highest priority. If there is no information with the highest priority, processing proceeds to the information with the next level of priority. For example, the collection priority set by the user is as follows in the order of unread-> unresponsive-> read. The mobile terminal device first collects unread information. If there is no current unread information, the mobile terminal device collects unresponsive information. If no information is returned, the mobile terminal device collects read information.
  • the information collected at block 2105 is displayed on the system interface.
  • system interface can include at least one of the following interfaces: a lock screen interface, a main screen interface, a notification bar interface.
  • the system interface is a lock screen interface
  • the user can browse the received festival information without unlocking the screen, further improving the user's festival effect experience.
  • the collected information can be displayed on the system interface in various ways. In some implementations, statistical results of the collected information can be displayed on the system interface. And, in response to the user's quick search instruction, a detailed description of the collected information is displayed on the system interface.
  • the statistical result may include, but is not limited to, at least one of the number of information, information type, caller information (name, avatar, etc.) of the information, and information (application icon, etc.) of the application receiving the information.
  • 22A to 22C are schematic diagrams illustrating a system interface of collected information, respectively, according to an embodiment.
  • 22A shows the background of a normal lock screen.
  • 22B shows statistical information of festival information collected from the lock screen.
  • the statistical information includes the number of information (10) and the type of information (festival blessing information).
  • the user can trigger a quick search command of the information.
  • the mobile terminal device After receiving the quick search command of the information, the mobile terminal device shows the information collected in the system interface, as shown in Fig. 22C.
  • Quick navigation commands can be triggered in a variety of ways, including at least one of voice, buttons, gestures, augmented reality human-machine interaction interfaces, and external controls (devices with remote control capabilities, such as stylus pens associated with terminal devices). have.
  • the mobile terminal device receives the voice command and determines that the voice command is the quick search command. In order to perform voice recognition for the voice command.
  • the mobile terminal device represents the information collected on the system interface.
  • the mobile terminal device can store the relationship between the voice command and the quick search command.
  • a voice command such as “start searching for festival information”, “start quick search” or a command in other Chinese or English or other language commands may correspond to a quick search command in the form of a table.
  • the voice command is not limited to the above example. If only the user and the mobile terminal know that the information is a voice command corresponding to the quick search command, it may be other information previously set by the user.
  • the button may be a hardware button of the mobile terminal device such as a home button, a voice control button, a power button, or a newly added button.
  • the button may also be a virtual button on the user interface, such as a virtual button configured adjacent to the statistical information or a virtual button corresponding to the statistical information item.
  • the mobile terminal device determines whether a quick search command has been received.
  • the preconfigured manner may be a short press, a long press, a short press for a specific time, a cross press of a short press and a long press.
  • the gesture may be one gesture performed by one or two hands.
  • the gesture may be a configured interface unlock gesture.
  • the gesture may be a hand shake, a circle drawing, a rectangle drawing, a triangle drawing, or the like.
  • the mobile terminal device can detect and recognize a gesture using an existing gesture detection device.
  • the connection may be a physical connection or a wireless connection through at least one of the following networks: Bluetooth, ultra-wideband, Zigbee, wireless Fidelity (WiFi), macro network, and the like.
  • the command may be an infrared command or a message sent by an external control.
  • a quick search end command of the information may be triggered. After receiving the quick search end command of information, the mobile terminal device does not display the collected information on the system interface.
  • the quick search end command may be triggered in a manner similar to the quick search command and is not described herein again.
  • the statistical information item when the user presses a virtual button corresponding to the statistical information item to trigger a quick search command, the statistical information item may be regarded as a festival information operation control that is a quick input of the festival information manager.
  • the festival information manager can perform general data tasks such as quick display and quick response to collected festival information.
  • the mobile terminal device can display only limited information each time.
  • the information may be displayed according to a preconfigured layout.
  • a layout including four rows and two columns corresponds to eight pieces of information.
  • a layout including nine rows and one column corresponds to nine pieces of information.
  • the mobile terminal device can provide various information layouts to the user.
  • the display area of the system interface is divided into a plurality of areas, each area displaying one or more pieces of information.
  • FIG. 22C is a schematic diagram illustrating what is displayed when a user selects a layout that includes four rows and two columns.
  • the user can view the information by turning the page or sliding up and down.
  • the collected information is 20 and the layout of the information selected by the user is 4 rows 2 columns, that is, the mobile terminal device may display 8 information at a time.
  • the mobile terminal device can display 20 collected information on 3 pages, first the first page displays the first 8 informations, the second page displays 9-16 informations, and the third page 17-20 Display information about the dog.
  • the mobile terminal device first displays information of the first page.
  • the mobile terminal device displays information about the second page.
  • a page down gesture is detected twice, information about the third page is displayed.
  • the mobile terminal device When the collected information is displayed, the mobile terminal device needs to display the information in a preset order.
  • the preset order may include at least one of an information reception time and an information type.
  • the information layout selected by the user includes four rows and two columns.
  • the mobile terminal apparatus displays the information having the earliest reception time in the first row and the first column, the information having the later reception time in the first row and the second column, and the information having the later reception time is then Can be displayed in a manner.
  • the mobile terminal device may classify the festival information by category, and then display the information of each category in turn.
  • the mobile terminal device can classify and display the collected information according to at least one of the following schemes without limitation.
  • the mobile terminal device may classify the information according to an application that receives the information. For example, the mobile terminal device classifies the information received by the short message application into one category, and classifies the information received by the WeChat application into another category.
  • the mobile terminal device may display information corresponding to each application according to the name of the application. For example, applications may be sorted according to the first letter of the name of the application, and application information may be displayed in the sorted order.
  • the mobile terminal device can also display information corresponding to each application in turn depending on the frequency with which each application is used by the user. For example, if the most frequently used application is WeChat, the mobile terminal device displays the information received by WeChat on top.
  • the mobile terminal device may sequentially display information corresponding to the application in the display order of the application configured by the user in advance. For example, the mobile terminal device first displays the information of the short message application and then displays the information of the WeChat application. Thus, the mobile terminal device can display the information received by the short message application at the top, and then display the information received by the WeChat application.
  • the mobile terminal device can classify information about the sender of the information. For example, the information sent by contact A may be classified into one category, and the information sent by contact B may be classified into another category.
  • the mobile terminal device can display information transmitted by each contact in accordance with the names of the contacts. For example, contacts may be sorted according to the first letter of their name, and each contact information is displayed in turn according to the classification result.
  • the mobile terminal device can display the information sent by each contact in accordance with the frequency of interaction between the user and the sender of the information. For example, if the interaction frequency between the user and the contact A is the highest, the information sent by the contact is displayed at the top.
  • the mobile terminal device may also display the information sent by each contact in accordance with the relationship between the user and the information sender and the priority of the relationship. For example, the relationship between user and contact A is a family and the relationship between user and contact B is a friend. Assuming that the family has the highest priority, the mobile terminal device displays the information sent by contact A at the top and the information sent by contact B next.
  • the mobile terminal device may display information corresponding to each contact in the order of displaying the contact configured by the user in advance.
  • the mobile terminal device is configured such that the information is displayed in the order of contacts A, B, C and D.
  • the mobile terminal device displays the information transmitted by the contact A on the top.
  • the mobile terminal device may classify the information according to the type of information.
  • the information type may be the type described above for the collected information.
  • the information type may include festival blessing information, festival event information, festival bonus information, greeting card, red envelope (gift) information, and the like.
  • the information type may include unread information, read information, information already answered, information sent, information already collected, and the like.
  • the type of information may include information sent by a family, information sent by a friend, information sent by a colleague.
  • the mobile terminal device may classify the information according to at least one of the information types.
  • the mobile terminal device can provide the user with an information type determined according to various methods. The user selects the type of information needed.
  • the mobile terminal device classifies the information according to the type of information selected by the user. For example, the type of information selected by the user is unread information and information already answered. The mobile terminal device may classify unread information into one category and classify the already answered information into another category.
  • the information type selected by the user is festival blessing information and festival event information. The mobile terminal device may classify the festival blessing information into one category and classify the festival event information into another category.
  • the mobile terminal device may display information of each type of information according to the display order of each type of information previously set by the user. For example, the mobile terminal device preconfigures the festival curse information and the festival event information in order. The mobile terminal displays the festival curse information on the top.
  • each category of information can be organized (framed) to distinguish it from other categories of information.
  • 23A to 23C illustrate display of information collected after being classified according to the above three methods, respectively, according to an embodiment.
  • Fig. 23A shows the classification and display of the collected information according to the application (first scheme) receiving the information.
  • the application is a short message application and a WeChat application. Therefore, the collected information can be divided into two categories. Each category is organized to distinguish it from other categories. In addition, the number of information in each category can be identified on the frame of the category. For example, as shown in FIG. 23A, the short message application category 2310 has six pieces of information 2311, and the WeChat application category 2320 has eight pieces of information 2321.
  • Fig. 23B shows the classification and display of the collected information according to the sender of the information (second manner).
  • the sender of the information includes Alice, Sam, Jam, and Bob. Therefore, the collected information can be classified into four categories. Each category can be organized to distinguish it from other categories.
  • various identifiers of the sender of the information may be used to distinguish the sender by an avatar, an alias, a telephone number, and the like.
  • the number of information in each category can be identified on the frame of the category. For example, as shown in FIG. 23B, the number of information 2331 sent by Alice is 6 2322, and the number of information 2333 sent by Sam is 3 2334.
  • the number of information 2335 transmitted by 1 is 1236, and the number of information 2357 transmitted by Bob is 5,2338.
  • Fig. 23C shows the classification and display of the collected information according to the type of information of the received information (third way).
  • the type is determined in accordance with the processing state and read state (eg, unread information, read information, and already answered information) of the information as shown in Fig. 23C.
  • Each category can be organized to distinguish it from other categories.
  • various identifiers corresponding to the information processing states may be used to read different information processing states (for example, unread information icon 2341, read information icon 2234, and response information icon 2343). have.
  • the number of information in each category can be identified on the frame of the category. For example, the number 2344 of unread information is 1 as shown in FIG. 23C.
  • the mobile terminal device when the collected information is classified according to one of the above schemes, and the category includes a variety of information, the mobile terminal device further sorts that information within that category. can do. In some implementations, the information can be sorted according to the time of receipt of the information. In another implementation, the mobile terminal device may secondaryly reclassify the information classified in each classification according to any one of the above methods within each classification. If the category still contains various information after the secondary classification, classifications with higher orders may be performed.
  • the mobile terminal device performs a first classification on the collected information according to the application receiving the information (first method).
  • Applications include short message applications and WeChat applications.
  • two categories are obtained after the first category classification.
  • two categories are created: the short message application category 2351 and the WeChat application category 2352.
  • the number of information corresponding to the short message application is 10, and the number of information corresponding to the WeChat application is 15.
  • the second classification is performed to classify the information into unread information (2354, 2356) and read information (2355, 2357), respectively. (Third system).
  • the number of unread information received by the short message application is six, and the number of read information received by the short message application is four.
  • the number of unread information received by the WeChat application is 10, and the number of read information received by the WeChat application is 5.
  • the mobile terminal device can sort the information according to the category according to the first classification (also called the first category), and then the category according to the second classification (also, the first). (Also known as 2 categories).
  • the sorted information may be stored in the memory 2353 in the sorted order.
  • the mobile terminal device may determine the display order of each category according to the sorting result of the categories for each classification.
  • the first categories of the first category of mobile terminal devices are the short message application category and the WeChat application category.
  • the sorting result of the mobile terminal device is in the order of the short message application category 2351-> WeChat application category 2352 as follows.
  • the second category of the second category of mobile terminal devices includes unread information 2354 and 2356 and read information 2355 and 2357.
  • the sorting result of the second category of the mobile terminal device is as follows, unread information-> read information.
  • the mobile terminal device receives the unread information 2354 received by the short message application-> the read information received by the short message application 2355-> the unread information received by the WeChat application 2356 in the system interface.
  • the mobile terminal device may display the information in this category according to the reception time of the information.
  • the content of the information received by the mobile terminal device can be different. When some information includes a lot of content, it cannot be displayed completely in the area allocated by the mobile terminal device.
  • the mobile terminal device may display part of the content of the corresponding area. The user can view the entire contents of the information through the global view command.
  • the mobile terminal device may adjust the font size of the information to be smaller so as to display the information completely in the corresponding area. The user may reduce (zoom out) the information through the zoom out view command.
  • the full view command and the zoom out view command may include at least one of a voice, a button, a gesture, a reality augmented man-machine interaction interface, and an external controller (eg, a device having a remote control function, such as a stylus pen connected to the device). It can be triggered and generated in a variety of ways, including.
  • the full view command and the zoom out view command may be triggered in a manner similar to the quick search command, and the process is not repeated here.
  • 24A-24B show system interfaces for displaying information, respectively, according to one embodiment.
  • 24A shows a schematic of a partial display of information.
  • the collected information is classified and displayed according to the category 2411 according to the sender 2412 of the information, and the sender includes Alice, Sam, Jam and Bob.
  • the number 2413 of information transmitted by Alice is three. Thus, only a part of the content can be displayed.
  • 24B is a schematic diagram showing a full display 2430 of information when the stylus pen 2420 points to information.
  • the stylus pen points to the category 2411 corresponding to the caller Alice, all three pieces of information sent by Alice may be displayed 2430 in list form.
  • an embodiment provides a quick operation function based on a quick search, enabling an operation on at least one collected information in response to a user's quick operation command.
  • the user can select one or more pieces of information to perform the task. That is, the mobile terminal device can perform a batch operation on information, for example, a batch response, a batch transmission, and the like.
  • the user's actions on the information may include at least one of a reply, transmission, deletion, collection and storage, copying to the clipboard, transmission to social software, and the like.
  • the user may select the information so that the quick operation is performed, and trigger the corresponding quick operation on the selected information.
  • the information on which the quick operation is performed may be selected according to at least one of the following manners without limitation.
  • the voice command spoken by the user includes relevant parameters for selecting the information.
  • the relevant parameter includes at least one of the location of the information about the system interface, the application receiving the information, the type of information (type determined in different ways), the information receiving, the information receiving time, and the like.
  • a user speaks a voice command, i.e., "response to information sent by a mother.”
  • the mobile terminal device receives the voice command and performs voice recognition on the voice command to determine whether the selected information is information transmitted by the contact of the mother's name.
  • the quick action commands may include voice, buttons, gestures, reality augmented human-machine interaction interfaces, and remote controls such as external controllers (e.g., a stylus pen connected to a terminal device). Having a device).
  • the voice command spoken by the user may include the type of quick action (response, transfer, etc.) as well as the relevant parameters of the selected information. For example, the user speaks the voice command "Reply to the information in the second row.”
  • the mobile terminal device receives the voice command and performs voice recognition on the voice command to determine whether the voice command is a quick response command and the target information is the information in the second row. Thus, the mobile terminal device displays the response interface of the information in the second row on the system interface.
  • the button When the quick operation command is triggered by the button, the button may be a hardware button of the mobile terminal device such as a home button, a voice control button, a power button, or a newly added button.
  • the button may also be a virtual button on the user interface, such as a quick action virtual button configured on the system interface.
  • the mobile terminal device determines that a quick operation command has been received.
  • the preconfigured scheme may include short presses, long presses, short presses for a predefined number of times, alternate presses of short presses and long presses, and the like.
  • the mobile terminal device determines that a quick response command has been received and responds quickly to the information selected by the user. And display the response interface on the system interface.
  • the gesture may be performed by one or two hands.
  • the gesture may be a preconfigured screen unlock gesture.
  • the content of the gesture may be a hand shake, a circle drawing, a rectangle drawing, a triangle drawing, or the like.
  • the mobile terminal device can detect and recognize the content of the gesture using a conventional gesture detection device. For example, if the user draws an unlock gesture on the screen after the user selects the information that requires a quick response, the mobile terminal device determines that a quick response command has been received and provides a quick response to the information selected by the user. And display the response interface in the system interface.
  • the external controller can be a stylus pen.
  • the mobile terminal device when the mobile terminal device is connected to the stylus pen and the mobile terminal device receives the quick response command sent by the stylus pen, the mobile terminal device displays the response interface on the system interface. The user can execute a quick action command by pressing a button on the stylus pen.
  • the stylus pen touches the area where the selected information is located, the mobile terminal device determines that the quick operation command is received, or when the stylus pen indicates the area where the selected information is located, the mobile terminal device determines that the quick operation command is received. do.
  • the button may be a hardware button on the mobile terminal device or a virtual button on the user interface.
  • a check box can be configured adjacent to each piece of information about the system interface. When the user selects the check box, the mobile terminal device determines to perform a quick action on the information. The user can select one or more pieces of information for quick response via the button.
  • the mobile terminal device can classify the information displayed on the system interface.
  • the information of each category is aggregated and displayed. For example, each category can be organized into frames, and check boxes can be organized into frames. If the user selects a check box inside the frame, the mobile terminal device determines that the user has selected to perform a quick operation on the information of this category.
  • the quick action command can be used to perform remote control functions such as voice, buttons, gestures, reality augmented human-machine interaction interface and external controllers (e.g., terminal devices and access stylus pens). Having a device).
  • remote control functions such as voice, buttons, gestures, reality augmented human-machine interaction interface and external controllers (e.g., terminal devices and access stylus pens). Having a device).
  • the voice command spoken by the user includes the type of action (answer, transfer, etc.). For example, when a user speaks a "response" with a voice command, the mobile terminal device receives the voice command and performs voice recognition for the voice command to determine that the voice recognition is this quick response command. Thus, the mobile terminal device displays a response interface to the information selected by the user in the system interface.
  • the button When a quick action is triggered by a button, the button may be a hardware button of the mobile terminal device or a virtual button in a user interface, such as a quick action virtual button configured in the system interface.
  • the mobile terminal device determines that a quick operation command is received. For example, after the user selects the information that requires a quick response, when the user briefly presses the quick response virtual button on the system interface, the mobile terminal device determines that a quick response command has been received and the quick response to the information selected by the user is received. Perform the response and display the response interface on the system interface.
  • the user can implement the selection of information and the triggering of a quick action through a single button press. For example, the user may press and hold the area corresponding to the information requiring quick response. Based on the input, the mobile terminal device determines that the user wants to perform a quick response to the information. In this case, the mobile terminal device may directly display the response interface on the system interface. Otherwise, the user clicks on an area corresponding to a category of information. The mobile terminal device determines that the user wants to perform a quick response to the information of the category. At this time, the mobile terminal device directly displays the response interface on the system interface.
  • the gesture may be performed by one or two hands.
  • the gesture may be a preconfigured screen unlock gesture. For example, if the user selects information requiring a quick response and then the user draws an unlock gesture on the screen, the mobile terminal device determines that a quick response command has been received to provide a quick response to the information selected by the user. Display the response interface on the performing system interface.
  • the external controller may be a stylus pen.
  • the mobile terminal device when the mobile terminal device is connected with the stylus pen and the mobile terminal device receives the quick response command sent by the stylus pen, the mobile terminal device displays the response interface on the system interface. The user can trigger a quick operation command by pressing a button on the stylus.
  • the stylus pen touches the area where the selected information is located, the mobile terminal device determines that the quick operation command has been received, or when the stylus pen indicates the area where the selected information is located, the mobile terminal device receives the determination quick operation command. I judge it.
  • Gestures can be implemented by one or two hands.
  • One or both hands include one or two fingers.
  • the mobile terminal device determines that the user wants to perform a quick operation on all the information displayed on the system interface.
  • a quick action command may be triggered through at least one of the following voice, buttons, gestures, reality augmented human-machine interaction interface and external controller.
  • the triggering of the quick action command is similar to that described above and does not repeat here.
  • the information is selected via an external controller.
  • the external controller may be a stylus pen.
  • the mobile terminal device determines to perform a quick operation on a piece or category of information. Or, if the stylus pen points to an area and category of information, the mobile terminal device determines to perform a quick operation on the information or category.
  • the quick arithmetic command may be triggered through at least one of a voice, a button, a gesture, a reality augmented human-machine interaction interface, and an external controller, as follows.
  • the triggering of the quick action command is similar to that described above and does not repeat here.
  • the user can implement information selection and trigger quick actions simultaneously via an external controller. For example, when the stylus touches an area or category of information for a predetermined time, the mobile terminal device may directly display the response interface on the system interface. Or, if the stylus has been pointing to an area or category of information for a preset period of time, then the mobile terminal device determines that the user wants a quick action on the information or category of information. In this case, the mobile terminal device may directly display the response interface on the system interface.
  • the operation on the collected information can include any of the operation of the information of the application corresponding to the information, the operation of the information on the operation interface provided by the system interface, as follows.
  • the mobile terminal device can open the corresponding application to perform the action in response. For example, the mobile terminal determines that it wants to perform a quick response operation to the short message A. Then, the mobile terminal device opens the response interface of the short message A in the short message application, that is, the mobile terminal device opens the short message application and automatically considers the sender of the short message A to receive the response message. If the user chooses to perform a batch response to a large number of information, for example, if the user wants to perform a quick response action for the short messages A, B and C, the mobile terminal device opens the short message application, Automatically consider the sender of the short message to be the response message.
  • the mobile terminal device may further provide a batch operation interface on the system interface, eg, the response interface. That is, the mobile terminal device does not need to open an application in order to perform a fast operation. If the user decides to reply to the information, the mobile terminal device can send the corresponding application a receipt of the content and response information that the user wants to respond to, and the application transmits the response information.
  • the response interface may include at least one of information reception, response information content, and response button.
  • the mobile terminal device displays the batch response interface on the system interface and automatically sends these short messages as receivers of the response information. Configure the sender of the message. After the user clicks the response button, the mobile terminal device transmits the reception of the response content and the response information to the short message application. The short message application sends the response content to the corresponding reception.
  • the mobile terminal device can implement the fast operation through the batch response interface.
  • the user chooses to perform a quick response action on the short messages A and B and the WeChat message C, and the mobile terminal device displays a batch response interface on the system interface and automatically sends the sender of the message to the recipient of the response information.
  • the mobile terminal device displays a batch response interface on the system interface and automatically sends the sender of the message to the recipient of the response information.
  • the mobile terminal device sends the response content and the short messages A and B to the short message application, so that the short message application sends the response content to the corresponding recipient.
  • the mobile terminal device provides a response content and a sender of the WeChat message C to the WeChat application, so that the WeChat application transmits the response content to the corresponding receiver.
  • the user's response content can include at least one of a short message, a greeting card, a photo, an audio file, an email, and the like.
  • mobile terminal device response content or greeting cards can be provided in the response template.
  • the mobile terminal device may add a template button on the batch response interface.
  • the mobile terminal device can provide the user with a list of various templates.
  • the mobile terminal device adds the content of the template to the response content on the answering machine interface.
  • the information template may be a complete template that does not require addition or modification, for example, "Happy New Year! Fulfill both you and your family!”
  • the start greeting, the body, and the end greeting of the information template can each be configured.
  • the response content may be the same, while the greeting may change depending on the recipient of the response information.
  • the mobile terminal device can provide a virtual button for automatically adding a greeting to the response interface.
  • the mobile terminal device receives the name of the recipient role contact of the response information and automatically imports it into the greeting, adds the greeting to the corresponding location, or adds the collective greeting to the preset location.
  • Arrangement information indicating a preset position in which the batch greeting is to be placed in the response content may be used.
  • the mobile terminal device can arrange the content corresponding to the virtual button at a preset position indicated by the placement information corresponding to the virtual button. For example, when the user responds to a short message sent by the user, the mobile terminal device configures a virtual button for automatically adding a greeting to the response interface.
  • the mobile terminal device When the user clicks the button, the mobile terminal device automatically adds the contact name of the user to the operation by bringing the contact name into the greeting.
  • the mobile terminal device may cause a window for asking the user whether to automatically add a greeting after the user clicks the reply button.
  • the mobile terminal device When the user clicks the OK button in the window, the mobile terminal device automatically adds the contact name of the user by importing the contact name into the greeting.
  • the mobile terminal device can also configure a virtual button at the location where the greeting is to be added to the template.
  • the mobile terminal device automatically adds the batch greeting or contact name of the recipient of the response information to this location.
  • the response information may have multiple greetings.
  • the mobile terminal device automatically imports the contact names of all recipients of the response information into the greeting and adds the greetings to the corresponding location.
  • the mobile terminal device can provide a virtual button in the response interface to automatically add a termination greeting.
  • the mobile terminal device automatically adds the user's name (which can be obtained from the phone book) to a location corresponding to the ending greeting or adds a preconfigured ending greeting to the preset location.
  • the mobile terminal device may cause a window for asking the user whether to automatically add a termination greeting after the user clicks the response button.
  • the user clicks the OK button in the window the mobile terminal device automatically adds the ending greeting.
  • the mobile terminal device may configure a virtual button at the position where the ending greeting needs to be added to the template.
  • the mobile terminal device automatically adds the pre-configured end greeting or the name of the user to the location.
  • the user's response content may include a greeting card.
  • a greeting card template may be provided. Greeting card templates are not limited to static text and / or photographs. The greeting card template may also include at least one of animation, audio and video content.
  • 25A-25D are schematic diagrams illustrating a quick action on the collected information.
  • 25A is a schematic diagram showing a click of a quick response.
  • a quick response virtual button 2501 is provided on a system interface showing the details of the collected information.
  • a quick response function for the selected plurality of information is triggered.
  • the user selects first, second, fourth and sixth information of the information.
  • the response interface includes an information receiving area 2511, a response information content area 2512, and an input area 2513.
  • the information receiving area is automatically configured as a sender of the processed plurality of information.
  • virtual buttons for attachment, template, voice input and emotion input are provided in the input area. In this example, the user chooses to enter using a template.
  • 25C is a schematic diagram illustrating an interface after a user selects a template and selects an input. As shown in FIG. 25C, the interface displays various templates provided for use by a user, such as text template 2521, greeting card template 2522, and photo template 2523. In this example, the user selects greeting card template 2522.
  • 25D is a schematic diagram illustrating an interface after the user selects the greeting card template 2522.
  • the response information area on the response interface loads and displays a greeting card template 2531 selected by the user, for example, a picture of a birthday cake, a birthday blessing, and the like.
  • the configuration may be performed for the start greeting, the body, and the end greeting, respectively.
  • the mobile terminal device may return to the system interface.
  • the information displayed in the system interface can have a corresponding update.
  • response information for each piece of information may also be displayed in the display area of the information.
  • the response identifier may be configured in the display area of the information.
  • a mobile terminal device may provide a user with the functionality described above on other topics. The description is not repeated here.
  • an association between the presentation resource and the application may be established first, and then the presentation resource is obtained. For example, a data tunnel can be established between the first application and the second application. Then, if a preset condition is met, for example, when a specific date is reached, data of the second application may be retrieved and provided to the first application performing the display. Additionally or alternatively, some operations may be omitted, some blocks may be combined into one block, and / or one block may be divided into multiple blocks.
  • the presentation resource can be provided in the form of a resource package.
  • the resource package may include a photo resource and a configuration file associated with the photo resource.
  • the configuration file can be generated using Extensible Markup Language (XML) with preset labels. Therefore, configuration files are also referred to as XML files.
  • Extensible markup language is a markup language used to mark electronic files for creating a specific structure.
  • the extended markup language is a source language that is used to mark up data and define data types, and to allow users to define their own markup language.
  • XML aims to transmit information.
  • the present invention provides an animation XML specification and a control XML specification to provide an application method for animation and control layout that can be transmitted or downloaded.
  • An animation application method mainly provides an animation attribute parameter interface that encapsulates an animation API of an electronic device according to a preset animation XML specification to facilitate XML definition and parsing (parsing).
  • an animation attribute parameter interface that encapsulates an animation API of an electronic device according to a preset animation XML specification to facilitate XML definition and parsing (parsing).
  • control application method mainly recapsulates the layout API interface of the electronic device according to the predefined control XML specification, so that the parameters of each label attribute of the XML file and the photo resource used by the XML can be added as elements of the application. You can switch to layout view.
  • the animated XML specification provides a special definition for the label.
  • ⁇ set /> represents the root label of the entire XML file
  • ⁇ view /> represents the view layer
  • its child labels are animation labels.
  • One view label can contain multiple animation labels, and the animation labels are parallel.
  • control XML specification provides a special definition for labels.
  • ⁇ set /> represents the root label of the entire XML file
  • ⁇ view /> represents the view layer
  • the parent label represents the parent label
  • its child labels are the style labels.
  • the style label may include a content label. Some content labels are shown below.
  • One style label can contain multiple content labels and the content labels are parallel.
  • Third-party developers can create predefined XML animation specifications and XML control specifications, package-specific XML animation configuration files, and XML control configuration files, as well as photo resources related to the configuration files that generate APK application installation packages for distribution. Can be compiled. The user may download various animation resource packages and control resource packages to a local electronic device for installation, and establish an association with an application of the electronic device.
  • FIG. 26 illustrates a system structure for associating a display application with a corresponding application according to an embodiment.
  • the presentation resource is a resource package.
  • the presentation resource is data from an application, the association between the presentation resource and the application can be similarly implemented.
  • the system 2600 includes a resource package 2610, a resource package manager 2620, a data repository 2630, an analyzer 2640, a frame layer manager 2650 and a frame layer indicator of the display resources.
  • Resource package 2610 is a variety of animation resources and control resources mentioned above that serve as application installation packages, eg, display resources.
  • the resource package may be downloaded and stored in the electronic device.
  • the resource package manager 2620 performs certain management of resource packages downloaded by the user and installed in the local electronic device. Management can include viewing, deleting, downloading, analyzing and applying. If the user chooses to apply another resource package, the data store 2630 can record the resource package selected by the user and notify the frame layer manager 2650 to update the resource package selected by the user.
  • the frame layer manager 2650 calls the analyzer 2640, for example, to analyze the resource package selected by the user according to the notification.
  • the frame layer manager 2650 sends the data obtained by the analyzer 2640 to the frame layer indicator 2660.
  • Frame layer indicator 2660 applies analyzed display resources, such as animation views or control layouts.
  • the frame layer manager 2650 also manages the association between the display resource and the application, ie, configures the correspondence between the display resource and the application, and the association scheme for associating the display resource with the application, and
  • the indicator 2660 is controlled to perform the corresponding indication according to the configured association scheme, such as monitoring time, various events and messages.
  • FIG. 27 is a diagram illustrating a system structure for managing a relationship between a display resource and an application, according to an embodiment.
  • the controls and views (such as background views) of the application are managed respectively.
  • the frame layer manager 2710 may further include a configuration module 2711, a control management module 2712, and a view management module 2713.
  • the frame layer indicator 2720 may include a control display module 2721 and a view display module 2722.
  • a user can associate an application with a selected display resource (such as a resource package) and also associate the method, i. You can also choose how it is displayed.
  • a selected display resource such as a resource package
  • Each application can provide its own resource package for users to download. The user can ensure that the views and / or controls of the associated application have the correct presentation and interaction through resource package selection.
  • the control management module 2712 and the view management module 2713 read the configuration data of the configuration module 2711, update the data, and enter the monitoring state.
  • the control management module 2712 and the view management module 2713 notify the corresponding display module. For example, after being notified, display module 2721 displays the correct associated application control of the main application.
  • the display module 2722 updates the content information displayed by itself.
  • the control acquires a new command through the interaction, for example, causing the background view to display updated content to display a new message of the application associated with the control.
  • the control sends a new command to view display module 2722.
  • the view display module 2722 then updates the content according to the command.
  • FIG. 28 illustrates a structure of a display system according to an exemplary embodiment.
  • the display system 2800 applicable to an electronic device may include an acquisition unit 2810 and an association unit 2820.
  • the display system 2800 can further include an association remover 2830.
  • the acquirer 2810 may obtain various display resources.
  • the acquirer 2810 may obtain display resources through various methods.
  • the acquirer 2810 may receive data from an application through a data tunnel with an application in the electronic device.
  • the acquirer 2810 may obtain a display resource from a network through a network interface.
  • the presentation resource may be provided in the form of a resource package.
  • the association unit 2820 may be used to associate the display resource with the first application of the electronic device.
  • the association unit 2820 may manage the display of the element of the first application based on the display resource according to a pre-configured association scheme.
  • the association unit 2820 may include an analyzer used to analyze the resource package to apply the resource package to the corresponding application.
  • the association unit 2820 may further associate the display resource with one or more elements of the one or more first applications.
  • the association remover 2830 may be used to remove an association between a display resource and one or more elements of the one or more first applications.
  • the display system 2800 may be configured in advance in the electronic device or may be loaded in the electronic device through a download or the like. Units of the display system 2800 may cooperate with a corresponding portion of the electronic device to obtain application data. The association 2820 may cooperate with the screen of the electronic device to display the element of the application on the screen.
  • 29 illustrates an electronic device 2900 on which a method provided by one embodiment may be implemented.
  • the electronic device 2900 may be a speaker or earphone 2902, a microphone 2906, a touch screen 2903, and optional virtual buttons 2904a, soft keys 2904b and 2904c, and a game bar 2905 or other type. It may include a series of buttons 2904 that may include a navigator input device.
  • FIG. 30 illustrates a configuration of an electronic device as shown in FIG. 29.
  • the electronic device 2900 includes a controller 3000 that is responsible for the overall operation of the electronic device and can be implemented using a commercially available CPU (central processing unit), DSP (digital signal processor) or other programmable logic device.
  • Controller 3000 includes an associated electronic memory 3002, such as RAM, ROM, EEPROM, flash memory, or any combination thereof.
  • the memory 3002 is controlled by the controller 3000 for various purposes. One of them is to store program instructions and data of software in an electronic device.
  • the software includes a real-time operating system 3020, human-machine interface (MMI) 3034, application processing system 3032, and drivers for various applications.
  • MMI human-machine interface
  • Applications include text editors 3050, handwriting recognition (HWR) applications 3060, and voice calling applications, short message applications, multimedia message services or email applications, web browsing applications, instant message receiving and sending applications, phonebook applications, calendars.
  • Various other applications 3070 such as applications, control panel applications, camera applications, one or more video game applications, notebook applications, and the like. Note that two or more of the above applications may be implemented as one application.
  • the MMI 3034 may include one or more hardware controllers, which together with the MMI driver, the first display 3036/2903, the small keyboard 3038/2904, and various other I / O devices 3040, 3042. ) (Microphones, speakers, vibrators, ringtone generators, LED indicators, etc.). It is also well known that a user can operate the electronic device via the human-machine interface formed as described above.
  • the software also includes various modules, protocol stacks, drivers, which are commonly identified as 3030, and communication services for the RF interface 3006 and optionally for the Bluetooth interface 3008 and / or the IrDA interface 3010.
  • Providing local connectivity by providing (such as transport, network and connectivity).
  • RF interface 3006 includes internal or external antennas and appropriate wireless circuitry used to establish and maintain a wireless link with a base station.
  • wireless circuitry includes a series of analog and digital electronic components that together form a wireless receiver and transmitter. These components may include band pass filters, amplifiers, frequency mixers, local oscillators, low pass filters, AD / DA converters, and the like.
  • the electronic device may include a SIM card 3004 and associated reader.
  • SIM card 3004 is known to include a processor and local data memory.
  • the electronic device 3110 may include a processor 3110 and a memory 3120, and may further include an input unit 3130, an output unit 3140, and a communication unit 3150.
  • the processor 3110 may include at least one of a memory 3120, an input unit 3130, an output unit 3140, and a communication unit 3150.
  • the electronic device 3110 may be connected to the processor 3110. It may also consist of only a housing that houses the processor 3110. Alternatively, the electronic device may further include a sensing unit and an A / V input unit as shown in FIG. 32.
  • the processor 3230 typically controls the overall operation of the electronic device 3200.
  • the processor 3230 may execute programs stored in the memory 3220 to output an output unit 3250, a user input unit 3240, a communication unit 3210, a sensing unit 3260, and an A / V input unit 3270. ) May be controlled overall to perform at least one of the above-described display method, a method of managing the presence of an element of an application, and an information processing method.
  • the processor 3230 performs an operation for the operation of the electronic device 3230 described above.
  • the processor 3230 may perform information processing for providing the content in association with the object of the application based on the association information.
  • the processor 3230 may determine a target object of the application.
  • Association information represents an association of the content with an object of the application.
  • the processor 3230 may determine a current festival related to the target object.
  • the processor 3230 may perform information processing to perform a service of an application based on the target object and the current festival.
  • the processor 3230 may receive information through at least one application.
  • the processor 3230 may receive information from a server or an external device using the communication unit 3210.
  • the processor 3230 may display the received information using the output unit 3250 according to a classification of at least one of an application, a sender of the information, and an execution state of the information.
  • the processor 3230 may select at least one of the displayed information based on a user input.
  • the user input may be obtained using the input unit 3240.
  • the processor 3230 may perform the processing of the information on the selected information by using an application corresponding to the selected information according to a single input of the user indicating the processing of the information on the at least one information.
  • the communication unit 3210 performs data communication with an external terminal.
  • the communication unit 3210 may receive data from an external terminal and transmit data to the external terminal.
  • the communication unit 3210 may include a short range communication unit 3211, a mobile communication unit 3212, and a broadcast receiving unit 3213.
  • the short-range wireless communication unit 3211 includes a Bluetooth communication unit, a Bluetooth low energy (BLE) communication unit, a near field communication unit, a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, an infrared ray ( IrDA (Infrared Data Association) communication unit, WFD (Wi-Fi Direct) communication unit, UWB (ultra wideband) communication unit, Ant + communication unit and the like, but may not be limited thereto.
  • the mobile communication unit 3212 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network.
  • the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.
  • the broadcast receiving unit 3213 receives a broadcast signal and / or broadcast related information from the outside through a broadcast channel.
  • the broadcast channel may include a satellite channel and a terrestrial channel.
  • the electronic device 3200 may not include the broadcast receiver 3213.
  • the memory 3220 may store content, application data, related information, and temporary information. Association information represents an association of the content with an object of the application.
  • the memory 3220 may include data for the operation of the above-described application, data received from an external device, data for the processing and control of the processor 3230, data used for the operation of the electronic device 3230, and the foregoing description. At least one of the referenced information may be stored.
  • the memory 3220 may store a program for processing and controlling the processor 3230, and may store input / output data.
  • the memory 3220 may include an application and multimedia content.
  • the memory 3220 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, Magnetic Disk It may include at least one type of storage medium of the optical disk.
  • the electronic device 3200 may operate a web storage or a cloud server that performs a storage function of the memory 3220 on the Internet.
  • Programs stored in the memory 3220 may be classified into a plurality of modules according to their functions, for example, the UI module 3221, the touch screen module 3222, the notification module 3223, and the STT (Speak to Text). ) Module 3224, and the like.
  • the UI module 3221 may provide a specialized UI, a GUI, and the like that are linked to the electronic device 3200 for each application.
  • the touch screen module 3222 may detect a touch gesture on a user's touch screen and transmit information about the touch gesture to the processor 3240.
  • the touch screen module 3322 according to an embodiment may recognize and analyze a touch code.
  • the touch screen module 3222 may be configured as separate hardware including a controller.
  • Various sensors may be provided inside or near the touch screen to detect a touch or proximity touch of the touch screen.
  • An example of a sensor for sensing a touch of a touch screen is a tactile sensor.
  • the tactile sensor refers to a sensor that senses the contact of a specific object to the extent that a person feels or more.
  • the tactile sensor may sense various information such as the roughness of the contact surface, the rigidity of the contact object, the temperature of the contact point, and the like.
  • an example of a sensor for sensing a touch of a touch screen is a proximity sensor.
  • the proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays.
  • Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.
  • the user's touch gesture may include tap, touch and hold, double tap, drag, pan, flick, drag and drop, and swipe.
  • the notification module 3223 may generate a signal for notifying occurrence of an event of the electronic device 3200. Examples of events occurring in the electronic device 3200 include call signal reception, message reception, key signal input, and schedule notification.
  • the notification module 3223 may output a notification signal in the form of a video signal through the display unit 3251, or may output the notification signal in the form of an audio signal through the sound output unit 3252, or the vibration motor 3253. Through the notification signal may be output in the form of a vibration signal.
  • Speech to Text (STT) module 3224 may generate a transcript corresponding to the multimedia content by converting the voice included in the multimedia content into text.
  • the transcript may be mapped to the play time information of the multimedia content.
  • the content storage module 3224 includes content that includes at least one type of various types of content.
  • the content storage module 3224 may store multimedia content.
  • the content storage module 3224 may store multimedia content for reproduction in the electronic device 3200.
  • the multimedia content may include text data, still image and / or moving image data, audio data, and the like.
  • the user input unit 3240 refers to a means for a user to input data for controlling the electronic device 3200.
  • the user input unit 3240 includes a key pad, a dome switch, a touch pad (contact capacitive type, pressure resistive layer type, infrared sensing type, surface ultrasonic conduction type, and integral type). Tension measurement method, piezo effect method, etc.), a jog wheel, a jog switch, and the like, but are not limited thereto.
  • the output unit 3250 is for outputting an audio signal, a video signal, or a vibration signal.
  • the output unit 3250 may include a display unit 3251, a sound output unit 3252, a vibration motor 3253, and the like.
  • the display 3325 displays and outputs information processed by the electronic device 3200.
  • the display unit 3251 and the touch pad form a layer structure to form a touch screen
  • the display unit 3251 may be used as an input device in addition to the output device.
  • the display unit 3251 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. 3D display, an electrophoretic display.
  • the electronic device 3200 may include two or more display units 3251 according to an implementation form of the electronic device 3200.
  • the sound output unit 3252 outputs audio data received from the communication unit 3210 or stored in the memory 3220. Also, the sound output unit 3252 outputs a sound signal related to a function (for example, a call signal reception sound, a message reception sound, and a notification sound) performed by the electronic device 3200.
  • the sound output unit 3252 may include a speaker, a buzzer, and the like.
  • the vibration motor 3253 may output a vibration signal.
  • the vibration motor 3253 may output a vibration signal corresponding to the output of audio data or video data (eg, a call signal reception sound, a message reception sound, and the like).
  • the vibration motor 3253 may output a vibration signal when a touch is input to the touch screen.
  • the sensing unit 3260 may detect a state of the electronic device 3200 or a state around the electronic device 3200 and transmit the detected information to the processor 3230.
  • the sensing unit 3260 may include a geomagnetic sensor 3221, an acceleration sensor 3262, a temperature / humidity sensor 3263, an infrared sensor 3264, a gyroscope sensor 3265, and a position sensor (Eg, GPS) 3266, barometric pressure sensor 3267, proximity sensor 3268, and RGB sensor (illuminance sensor) 3269, but are not limited thereto. Since functions of the respective sensors can be intuitively deduced by those skilled in the art from the names, detailed descriptions thereof will be omitted.
  • the A / V input unit 3270 is for inputting an audio signal or a video signal, and may include a camera 3331, a microphone 3332, and the like.
  • the camera 3331 may obtain an image frame such as a still image or a moving image through an image sensor in a video call mode or a photographing mode.
  • the image captured by the image sensor may be processed by the processor 3230 or a separate image processor (not shown).
  • the image frame processed by the camera 3331 may be stored in the memory 3220 or transmitted to the outside through the communication unit 3260. Two or more cameras 3331 may be provided according to a configuration aspect of the electronic device 3200.
  • the microphone 3332 receives an external sound signal and processes the external sound signal into electrical voice data.
  • the microphone 3332 may receive an acoustic signal from an external device or speaker.
  • the microphone 3332 may use various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.
  • one embodiment may be implemented through hardware, software, or a combination of hardware and software.
  • the hardware portion can be implemented through specific logic.
  • the software portion is stored in memory and can be executed by a suitable system such as a microprocessor or dedicated computer hardware.
  • a suitable system such as a microprocessor or dedicated computer hardware.
  • the devices and methods may be implemented via computer executable instructions and / or code, such as code for a CD, or DVD-ROM media, read-only memory (firmware), programmable memory, or optical or electronic signal carriers of a disc Can be understood.
  • the devices and modules provided by the present invention may be implemented by semiconductors such as hardware circuits of very large large scale integrated or gate arrays, logic chips, transistors or field programmable gate arrays, programmable logic devices and other programmable devices, or It may be implemented by software executed by various processors, or by a combination of the hardware circuitry and software.
  • the above description describes multiple devices or sub-devices of those devices, it should be understood that partitioning is not mandatory.
  • the characteristics and functions of the two or more devices may be implemented in a single device. Alternatively, the characteristics and functions of one device may be divided into multiple devices.

Abstract

La présente invention concerne un dispositif électronique et un procédé d'affichage ainsi qu'un système d'affichage applicables au dispositif électronique correspondant. Selon un mode de réalisation, le procédé d'affichage comprend les étapes suivantes : obtention d'une ressource d'affichage ; et liaison d'une première application avec la ressource d'affichage. Le mode de réalisation de l'invention enrichit un effet d'affichage du dispositif électronique et améliore la perception par un utilisateur.
PCT/KR2015/010018 2014-09-23 2015-09-23 Dispositif électronique et procédé de traitement d'informations du dispositif électronique WO2016048034A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US15/513,754 US20170286913A1 (en) 2014-09-23 2015-09-23 Electronic device and information processing method of electronic device
EP15844278.0A EP3200145A4 (fr) 2014-09-23 2015-09-23 Dispositif électronique et procédé de traitement d'informations du dispositif électronique

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201410490778 2014-09-23
CN201410490778.5 2014-09-23
CN201510323119.7A CN106201161B (zh) 2014-09-23 2015-06-12 电子设备的显示方法及系统
CN201510323119.7 2015-06-12

Publications (1)

Publication Number Publication Date
WO2016048034A1 true WO2016048034A1 (fr) 2016-03-31

Family

ID=55581468

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/010018 WO2016048034A1 (fr) 2014-09-23 2015-09-23 Dispositif électronique et procédé de traitement d'informations du dispositif électronique

Country Status (3)

Country Link
KR (1) KR102415869B1 (fr)
CN (1) CN113448468B (fr)
WO (1) WO2016048034A1 (fr)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106506807A (zh) * 2016-10-09 2017-03-15 乐视控股（北京）有限公司 一种终端信息分享的方法及装置
CN107276887A (zh) * 2017-07-06 2017-10-20 北京北信源软件股份有限公司 一种通过短信提醒即时通信消息未读的方法和装置
CN110333926A (zh) * 2016-05-18 2019-10-15 苹果公司 在图形消息传送用户界面中应用确认选项
CN111290823A (zh) * 2020-02-28 2020-06-16 北京百度网讯科技有限公司 一种信息交互方法、装置、电子设备和介质
CN112188001A (zh) * 2020-09-29 2021-01-05 维沃移动通信有限公司 快捷设置方法、快捷设置装置和电子设备
CN113157169A (zh) * 2020-01-22 2021-07-23 阿里巴巴集团控股有限公司 互动媒体内容的交互方法、装置和电子设备
US11121996B2 (en) 2016-09-08 2021-09-14 Alibaba Group Holding Limited Method and apparatus for displaying events related to peer communication party to local communication party
WO2023125692A1 (fr) * 2021-12-30 2023-07-06 华为技术有限公司 Procédé de recommandation de service et appareil associé

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106534526B (zh) * 2016-11-07 2020-03-13 珠海市魅族科技有限公司 一种悬浮通知的提示方法以及装置
CN114385298A (zh) * 2022-01-12 2022-04-22 北京字跳网络技术有限公司 信息交互方法、装置、设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20100037032A (ko) * 2007-06-28 2010-04-08 톰슨 라이센싱 피어-투-피어 라이브 스트리밍을 위한 큐-기반 적응성 청크 스케줄링
KR20120087242A (ko) * 2010-12-09 2012-08-07 주식회사 이너스커뮤니티 소셜 네트워크 서비스 장치 및 그 서비스 방법
JP2013020325A (ja) * 2011-07-08 2013-01-31 Canon Inc 情報処理装置、制御方法、プログラム
KR20130025775A (ko) * 2011-09-02 2013-03-12 손병호 가상통화 서비스의 시스템 및 방법과 이를 이용한 광고방법
KR20140017429A (ko) * 2012-08-01 2014-02-11 삼성전자주식회사 화면 동작 방법 및 그 전자 장치

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1901529B1 (fr) * 2005-07-05 2014-02-26 NEC Corporation Téléphone et procédé de signalement d'arrivée d'appel téléphonique
EP1835689B1 (fr) * 2006-03-13 2014-06-04 Alcatel Lucent Système et méthode de communication enrichis par contexte
CN101136089A (zh) * 2007-09-24 2008-03-05 腾讯科技（深圳）有限公司 一种更新电子邮件网页背景的方法、系统及设备
US8373742B2 (en) * 2008-03-27 2013-02-12 Motorola Mobility Llc Method and apparatus for enhancing and adding context to a video call image
CN101944019B (zh) * 2009-07-08 2014-03-12 华为技术有限公司 一种定制界面的方法与装置
US20110313846A1 (en) * 2010-06-16 2011-12-22 Microsoft Corporation Including personalized content in an advertisement
CN101986732B (zh) * 2010-11-05 2013-04-03 北京工业大学 一种在手机通话中添加背景场景的方法
CN103369483A (zh) * 2012-04-09 2013-10-23 腾讯科技（深圳）有限公司 短信生成方法、短信发送方法、移动终端和服务器
US9685160B2 (en) * 2012-04-16 2017-06-20 Htc Corporation Method for offering suggestion during conversation, electronic device using the same, and non-transitory storage medium
CN102945133B (zh) * 2012-10-18 2016-05-04 天津三星通信技术研究有限公司 屏幕局部显示系统及屏幕局部显示方法
CN102970364A (zh) * 2012-11-21 2013-03-13 北京奇虎科技有限公司 一种自动更换主题的方法及客户端
CN102970405A (zh) * 2012-11-28 2013-03-13 广东欧珀移动通信有限公司 区分不同联系人短信息的方法及装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20100037032A (ko) * 2007-06-28 2010-04-08 톰슨 라이센싱 피어-투-피어 라이브 스트리밍을 위한 큐-기반 적응성 청크 스케줄링
KR20120087242A (ko) * 2010-12-09 2012-08-07 주식회사 이너스커뮤니티 소셜 네트워크 서비스 장치 및 그 서비스 방법
JP2013020325A (ja) * 2011-07-08 2013-01-31 Canon Inc 情報処理装置、制御方法、プログラム
KR20130025775A (ko) * 2011-09-02 2013-03-12 손병호 가상통화 서비스의 시스템 및 방법과 이를 이용한 광고방법
KR20140017429A (ko) * 2012-08-01 2014-02-11 삼성전자주식회사 화면 동작 방법 및 그 전자 장치

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110333926A (zh) * 2016-05-18 2019-10-15 苹果公司 在图形消息传送用户界面中应用确认选项
US11121996B2 (en) 2016-09-08 2021-09-14 Alibaba Group Holding Limited Method and apparatus for displaying events related to peer communication party to local communication party
CN106506807A (zh) * 2016-10-09 2017-03-15 乐视控股（北京）有限公司 一种终端信息分享的方法及装置
CN107276887A (zh) * 2017-07-06 2017-10-20 北京北信源软件股份有限公司 一种通过短信提醒即时通信消息未读的方法和装置
CN113157169A (zh) * 2020-01-22 2021-07-23 阿里巴巴集团控股有限公司 互动媒体内容的交互方法、装置和电子设备
CN111290823A (zh) * 2020-02-28 2020-06-16 北京百度网讯科技有限公司 一种信息交互方法、装置、电子设备和介质
CN111290823B (zh) * 2020-02-28 2023-03-24 北京百度网讯科技有限公司 一种信息交互方法、装置、电子设备和介质
CN112188001A (zh) * 2020-09-29 2021-01-05 维沃移动通信有限公司 快捷设置方法、快捷设置装置和电子设备
WO2023125692A1 (fr) * 2021-12-30 2023-07-06 华为技术有限公司 Procédé de recommandation de service et appareil associé

Also Published As

Publication number Publication date
KR20160035564A (ko) 2016-03-31
CN113448468B (zh) 2024-04-09
KR102415869B1 (ko) 2022-07-01
CN113448468A (zh) 2021-09-28

Similar Documents

Publication Publication Date Title
WO2016048034A1 (fr) Dispositif électronique et procédé de traitement d'informations du dispositif électronique
WO2016018039A1 (fr) Appareil et procédé pour fournir des informations
WO2016018111A1 (fr) Dispositif de fourniture de service de messagerie et procédé de fourniture d'un contenu par l'intermédiaire de celui-ci
CN106201161B (zh) 电子设备的显示方法及系统
WO2016017978A1 (fr) Dispositif et procédé pour exécuter des fonctions
WO2015016622A1 (fr) Procédé et dispositif électronique pour partager une carte d'images
AU2016224180B2 (en) Method and apparatus for supporting communication in electronic device
WO2018182202A1 (fr) Dispositif électronique et procédé d'execution de fonctionnement de dispositif électronique
WO2015005734A1 (fr) Dispositif terminal d'utilisateur prenant en charge une interaction utilisateur, et procédés correspondants
WO2016017992A1 (fr) Procédé et dispositif de classement de contenu
US8819552B2 (en) Method of executing function on standby screen of mobile terminal
WO2017171377A1 (fr) Procédé et appareil de détermination de contenu pour dispositif intelligent
WO2016068581A1 (fr) Dispositif et procédé de gestion des informations d'utilisateur sur la base d'une image
WO2017135749A1 (fr) Dispositif électronique comprenant de multiples dispositifs d'affichage et procédé permettant de faire fonctionner ce dernier
WO2017135665A1 (fr) Procédé et appareil de fourniture de service d'image
WO2016003233A1 (fr) Procédé de gestion de calendrier, et support d'enregistrement pour l'enregistrement d'un programme pour la mise en oeuvre du procédé
WO2013187680A1 (fr) Dispositif terminal d'utilisateur, dispositif serveur, système les intégrant et procédé de service d'annonce publicitaire associé
WO2016167481A1 (fr) Procédé et appareil de recommandation de message de réponse
WO2017209564A1 (fr) Procédé de fourniture d'une liste d'applications et dispositif associé
WO2016208845A1 (fr) Terminal mobile et son procédé de commande
WO2015160180A1 (fr) Système pour fournir un service de journal de vie et procédé de fourniture du service
WO2020166995A1 (fr) Appareil et procédé de gestion de programme dans un dispositif électronique
WO2015182834A1 (fr) Terminal mobile et son procédé de commande
WO2017078500A1 (fr) Dispositif électronique et procédé de fourniture d'une recommandation pour un objet
EP3283942A1 (fr) Procédé et appareil de recommandation de message de réponse

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15844278

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 15513754

Country of ref document: US

REEP Request for entry into the european phase

Ref document number: 2015844278

Country of ref document: EP