KR20160055163A - Wireless communication device having deterministic control of foreground access of the user interface - Google Patents

Abstract

A wireless communication device having one or more applications resident on a computer platform, a wireless communication interface, a display, and at least a user interface appearing on the display. One or more applications and / or arbiters residing on the computer platform may be configured to determine which user interface of one or more applications resident on the computer platform based on predetermined criteria when the user interfaces compete for control of the display Lt; / RTI > controls the display. In yet another embodiment, an application that does not comply with a decision that an application controls the display may be terminated. The method may be performed to determine which application may control the display of the plurality of displays of the wireless communication device. The method may be performed to associate user input data with applications when there is a change in control of the display.

Description

[0001] WIRELESS COMMUNICATION DEVICE HAVING DETERMINISTIC CONTROL OF FORGUARD ACCESS OF THE USER INTERFACE [0002]

Related Applications

[0001] This application claims the benefit of U.S. Provisional Patent Application entitled " WIRELESS COMMUNICATION DEVICE HAVING DETERMINISTIC CONTROL OF FORGOING ACCESS OF THE USER INTERFACE " filed June 5, 2008, entitled " Wireless Communication Device with Deterministic Control of Foreground Access in a User Interface. &Quot; 12 / 134,129, the entire contents of which are incorporated herein by reference.

1. Field of the Invention

The present invention relates to portable wireless communication devices. More specifically, the present invention relates to a wireless communication device capable of deterministically controlling which user interface of resident applications controls the display of the device.

2. Description of Related Technology

In modern wireless communication networks, many of the wireless communication devices have resident computer platforms with operating systems and software applications that can be executed individually or in parallel on a computer platform. Software applications may compete for control of a resident user interface for a wireless communication device, which is often displayed on a resident display of a wireless communication device, and some problems may take control of the user interface From the collision of running applications trying to do so.

For example, in an operating system having a notification mechanism for sending events to other resident applications, the operating system typically provides an event, such as reception of incoming communications, execution of various applications, and status of resident hardware components, Lt; RTI ID = 0.0 > software applications. ≪ / RTI > Resident software applications may register for notifications using a conventional operating system application-programming interface (API). In addition, the resident software application may implement the "notification" class and may send notifications to other software applications as intended. Once the application receives the event, the resident software application typically runs freely and reaches the foreground on the API.

If there are multiple applications that can handle a particular event, and all of those applications want to reach the foreground of the UI, then one problem arises. This may lead to thrashing and undesirable user behavior, where each application tries to reach the foreground, so that the operating system will not allow any one application to stay on top of the UI You may. One prior art solution to this problem was to simply allow foreground thrashing as a result of the broadcasted event model. However, it is not desirable for applications to simply allow UI thrashing because they have any specific order in which they take control and display on the UI, and high priority applications are not content with low priority applications .

Therefore, it would be desirable to provide a system and method for a wireless communication device to control which of a plurality of resident applications may have control of the UI when multiple applications are simultaneously invoked and competing for control of the UI Would be advantageous. Such systems and methods should be able to prioritize which applications may have a UI, without using significant device resources in determining control. Accordingly, the present invention is primarily directed to such systems and methods of wireless communication devices that determine resident application control of the UI.

Briefly described, a wireless communication device having one or more applications residing on a local computer platform and including at least a wireless communication interface and a display is provided herein. Each application has a user interface that it uses to interact with the user. An arbiter application residing on a computer platform may be configured to perform a plurality of applications based on the nature of the event being invoked, based on predetermined criteria, such as prioritization schemes, most recently used algorithms, Control which application can take its user interface to the foreground.

In one embodiment, a method for determining which user interface of resident applications on a computer platform of a wireless communication device controls the display, said user interface appearing on at least a display of the wireless communication device, The method of interacting with resident applications of a user of a wireless communication device comprising the steps of: displaying a user interface on a display of a wireless communication device, wherein the display is in a user interface of one or more applications residing on a computer platform , And then, in an arbitrator resident on the computer platform, the display of the resident applications for controlling the display Receiving at least one request from one or more resident applications; and determining, at the arbiter, which application of user interfaces of the one or more resident applications controls the user interface based on predetermined criteria, When including priority data indicating the priority of control of the display, one or more resident applications may determine which user interface of which application controls the display.

In another embodiment, a method of assigning control of each of a plurality of displays to an application in a plurality of applications residing on a wireless communication device includes receiving a notification event simultaneously invoking more than one application Determining, via an arbiter, a first one of a plurality of applications controlling one of the plurality of displays, based on predetermined criteria, determining whether the first application controls one of the plurality of displays Determining, in response to the determining via the first application, whether an activity associated with a second application of the plurality of applications is detected; in response to detecting an activity associated with the second application, Possible displays Ordering the list of preferences for the second application in order of priority, determining whether the selected display is being used by the third application, and determining that the selected display is not being used by the third application In response, the method may include transmitting a flag to the second application to assign control of the foreground of the selected display.

In another embodiment, a method of associating user input data with a plurality of applications resident on a wireless communication device in response to a user's intention includes, in response to receiving a notification event simultaneously invoking more than one application, Determining, based on predetermined criteria, a first application of the plurality of applications controlling the display of the wireless communication device, in response to the determination through the arbiter that the first application controls the display, Detecting a change in the control of the display from the first application in the applications to the second application in the plurality of applications, detecting a first input received prior to the detected change in the control of the display, In control Determining whether a first input has been received within a first time threshold of a detected change in the control of the display, determining whether a second input is received in the control of the display Determining whether the first input has not been received within the first time threshold or that the second input has not been received within the second time threshold, , And associating a second input with a second application.

In another embodiment, a method for controlling a plurality of applications resident on a wireless communication device includes receiving, via an arbiter, such as an arbiter application having administrative privileges, a notification event invoking more than one application concurrently Determining a first one of the plurality of applications that controls the display of the wireless communication device based on predetermined criteria, determining whether a second one of the plurality of applications is a first application of the plurality of applications Determining whether the decision via the arbiter to control the display has not been complied with, and terminating the second application in response to determining that the second one of the plurality of applications is not compliant May.

Therefore, the present system and method may also have control of the display, either as a plurality of invoked or activity resident UI applications, as caused by an invoke event, to minimize thrashing in the control of the display The present invention is advantageous in that it provides a wireless communication device with the ability to control whether or not the wireless communication device is capable of operating. There are several embodiments for prioritizing application control of a display that allows implementation in various wireless environments. Thus, the determination of control of the display may be accomplished without having to resort to significant device processing resources when mediating control of the display.

Other objects, features, and advantages of the present invention may become apparent after review of the drawings, a detailed description of the invention, and the claims.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the invention and, together with the general description given above and the detailed description given below, serve to explain the features of the invention.
1 is an exemplary diagram of one embodiment of a wireless network in a typical cellular communication configuration having group communication server control communications between wireless communication devices of PTT group members.
2 is a block diagram illustrating a computer platform of a wireless communication device, shown here in conjunction with a push-to-talk (PTT) function.
3A is a block diagram of a wireless communication device resident application that sends an event notification to a plurality of other device-resident applications.
Figure 3b is a block diagram similar to Figure 3a, but the arbiter also receives the event notification and sends a flag to one of the other applications receiving the notification to indicate that the application has priority in controlling the UI do.
4 is a representative illustration of one embodiment of a display of a UI for a wireless communication device having a plurality of competing applications interfaces (APIs) that compete for control of a primary display.
5 is a process flow diagram of one embodiment of a method for an arbiter determining a priority for display control between a plurality of invoked wireless communication device-resident applications.
Figure 6 shows an embodiment of a method for determining a priority for display control between a plurality of invoked wireless communication device-resident applications based on priority data resident in applications seeking control of the display Fig.
Figures 7A-7B are process flow diagrams of methods of an embodiment for a wireless communication device to assign (or mediate) control of the foreground of multiple displays.
8 is a process flow diagram of a method of an embodiment for a wireless communication device to recalculate priorities of multiple displays.
9A is a representative illustration of a display of a user interface for a wireless communication device having a second application that reaches a foreground when the device receives a user input.
9B is a process flow diagram of a method of an embodiment for associating a received user input with a first or second application based on timing information;
10A is a representative illustration of a display of a user interface for a wireless communication device that renders a prompt dialog box in response to a second application reaching foreground when the device receives a user input.
10B is a process flow diagram of a method of an embodiment for associating a received user input with a first or second application based on selection inputs corresponding to a prompt dialog box.
11A is a representative illustration of a display of a user interface for a wireless communication device that renders a prompt dialog box in response to processing a received user input consistent with a second application reaching foreground.
11B is a process flow diagram of a method of an embodiment for associating a received user input with a first or second application based on evaluations of the content of the received user input.
12 is a process flow diagram of a method of an embodiment for associating a received user input with a first or second application based on locations of user interface elements of first and second applications.
13 is a process flow diagram of a method of an embodiment for terminating a non-compliant application in which the wireless communication device has obtained control of the foreground of the wireless communication device as opposed to prioritization by the arbiter.
14 is a system block diagram of a smartphone wireless communication device suitable for use with various embodiments.

Various embodiments may be described in detail with reference to the accompanying drawings. Wherever possible, the same reference numbers may be used throughout the drawings to refer to the same or like parts. References made to specific examples and implementations are for illustrative purposes only and are not intended to limit the scope of the invention or the claims.

In this description, the terms "communication device", "wireless device", "wireless communication device", "PTT communication device", "handheld device", "mobile device", and "handset" are used interchangeably . The terms "call" and "communication" are also used interchangeably. The term "application" as used herein includes both executable and non-executable software files, raw data, aggregated data, and other code segments, . The term "exemplary" means that the disclosed element or embodiment is exemplary only and does not indicate any preference of the user. All methods of interaction between applications are intended to be encompassed herein to include all forms of invoke, execution, invocation, and data exchange. Also, throughout the several figures, like numbers refer to like elements, and articles "a" and "the" include a plurality of references unless otherwise specified in the description.

Throughout the drawings, and with reference to the drawings in which like numerals represent like elements, FIG. 1 illustrates an embodiment in which communications have wireless networks in a conventional cellular communication configuration occurring between wireless communication devices 70, 72, 74, Is an exemplary illustration of one embodiment of the system 10. The system 10 also includes here a series of group communication computer devices (group communication servers) 32 that support a push-to-talk (PTT) system. A wireless network is merely exemplary and may include any system whereby remote modules may communicate with each other and between wireless networks and / or wireless networks including, without limitation, wireless network carriers and / Of-the-box among the components of the system 100, and over-the-air among these components. Although a series of group communication servers 32 are shown herein as being connected to a group communication server local area network (LAN) 50, other computer devices may be used to provide functionality to any component on the network And may be accessible by the LAN 50. [ The wireless communication devices 70, 72, 74, 76 may request packet data sessions from the group communication server (s) 32 using a data service option.

Back-office computer devices, such as group communication server (s) 32, are wireless service providers such as PDSN 52, shown here as residing on carrier network 54, And is connected to a packet data service node (PDSN). Each PDSN 52 may interface with the base station controller 64 of the base station 60 via a packet control function (PCF) The PCF 62 is typically located at the base station 60. The carrier network 54 controls messages sent (typically in the form of data packets) to a messaging service controller (MSC) 58. The carrier network 54 communicates with the MSC 58 by a network, the Internet, and / or a "plain ordinary telephone system " (POTS). Typically, the network or Internet connection between the carrier network 54 and the MSC 58 transmits data and the POTS transmits voice information. The MSC 58 may be connected to one or more base stations 60. In a manner similar to the carrier network, the MSC 58 is typically connected to a branch-to-source (BTS) network by both the network and / or the Internet for data transmission and POTS for voice information, (66). The BTS 66 may ultimately send messages to the wireless communication devices 70, 72, 74, 76 by means of a short messaging service (SMS), or other over-the- (E. G., Cellular phones), and wirelessly receives messages from such wireless devices. It should also be noted that carrier boundaries and / or PTT operator network boundaries do not suppress or inhibit sharing of data as described herein.

Cellular phones and mobile communication devices, such as wireless telephones (74 in FIG. 2), are being manufactured with increased computing capabilities and are becoming comparable to personal computers and hand-held PDAs. These "smart" cellular phones allow software developers to create downloadable and executable software applications on the processor of the wireless communication device. A wireless communication device, such as cellular telephone 74, may download many types of applications, such as web pages, applets, MIDlets, games, and data. In wireless communication devices that have designated a communication group, the wireless communication device may directly connect to other members of the set and may participate in voice and data communication. However, all of these direct communications may occur through the group communication server 32, or under the control of the group communication server 32. Although all data packets of the devices do not necessarily have to travel through the group communication server 32 itself, the group communication server 32 is typically able to ultimately control communication, which is typically the only carrier May be a network 54 component and / or may retrieve the identity of the members of the communication group or may send the identity of the members of the communication group 12 to another computer device . It should be appreciated that the number of computer components residing on the server-side LAN 50, or over a wireless network or generally the Internet, is not limited.

In addition to voice communications between wireless communication devices, other media may be transmitted, such as graphics media to include pictures of JPEG, TIF, etc., audio files such as MP3, MP4, WAV, The media may also be streaming media, such as multimedia applications (Powerpoint, MOV files, etc.). The group-directed media may also be a streaming media or private bulletin board on another computer device on the wireless communication network, such as a hosted game or a private bulletin board. have. Further, for PTT communications, the group-directed communication may be half-duplex audio and / or video conferencing between members of the communication group in substantially real-time or delayed state.

Figure 2 illustrates one of the wireless communication devices 74 that are mobile phones embodied with a push-to-talk (PTT) button 78 that opens devices, i. E., Direct communication to a target set of other members of the communication group. Fig. 2 is a block diagram illustrating an embodiment of the present invention. The wireless communication device 74 is also shown having a graphical display 80 for the user of the wireless communication device 74. The wireless communication device 74 includes a computer platform 82 that may process voice and data packets and may receive and execute software applications transmitted across the wireless network to include group-directed media. The computer platform 82 may include other components such as an application-specific integrated circuit (ASIC) 84 or other processor, microprocessor, logic circuit, programmable gate array, or other data processing Device. The ASIC 84 is installed at the time of manufacture of the wireless communication device 74 and is usually not up-gradeable. The ASIC 84 or other processor may execute an application programming interface ("API") layer 86 that includes a resident application environment and may include an operating system loaded on the ASIC 84. [ The resident application environment interfaces with any resident programs in the memory 88 of the wireless communication device 74. An example of a resident application environment is the QUALCOMM.RTM. &Quot; Binary Runtime Environment for Wireless "(BREW.RTM.) Software.

As shown herein, the wireless communication device 74 may be a mobile telephone 74 with a graphical display 80, but may also be a computer platform 82 as is known in the art, such as a mobile device 76 ), Or even a separate computer platform 82 with a wireless communication portal, or alternatively may have a wired connection to a network or the Internet. The memory 88 may also be comprised of read-only or random-access memory (RAM and ROM), EPROM, EEPROM, flash cards, or any memory common to computer platforms. The computer platform 82 may also include a local database 90 for storage of software applications that are not used as activities in the memory 88. The local database 90 typically comprises one or more flash memory cells, but may be any auxiliary or < RTI ID = 0.0 > device, as known in the art, such as magnetic media, EPROM, EEPROM, optical media, tape, 3 < / RTI > Graphics display 80 may also present information about group-directed media as well as information about outgoing group calls to include file previews as more fully described herein.

In this embodiment of the wireless communication device 74, the computer platform 82 also includes a direct or wireless communication interface 92 that may open a direct communication channel from the wireless communication device 74. The direct or wireless communication interface 92 is also a part of a standard communication interface for a wireless communication device 74 that transmits to the wireless communication device 74 and normally conveys the voice and data transmitted from the wireless communication device 74 It is possible. The direct or wireless communication interface 92 is typically configured with hardware as is known in the art.

The wireless communication device 74 has one or more applications resident on a computer platform 82 that also includes a wireless communication interface 92, a display 80, and a user interface, At least, a user of the wireless communication device 74 appears on the display 80 (with one example of the user interface 140 shown in Figure 4) through which the user of the wireless communication device 74 interacts with the computer platform 82 . Each of the applications has a user interface, and in one embodiment, the arbiter (128 in FIG. 3B) may reside on the computer platform 82 and may be based on predetermined criteria, May be configured to determine which application in the display 80 controls the display 80. Examples of predetermined criteria are: a priority list; Allowing the last application to control the user interface (the most recently used algorithm) to regain control of the user interface; Assigning the class to one or more applications so that determining the control is based on the class of the application; Allowing control of the user interface based on the specific type of data being processed in the user interface; And the type of data being received at the wireless communication interface 92. [ In other embodiments, the resident applications may determine their own priority, either alone or in conjunction with arbiter 128, using predetermined criteria in the same manner as arbiter 128.

3A shows event notifications for a wireless communication device resident application (e. G., A UI application B 102), a UI application C 104, and a UI application D 106 that transmit event notifications to a plurality of other device- Application A) < / RTI > Any of the UI applications 102, 104, 106 may arrive at the foreground of the display 80 (as in FIG. 4) depending on when they receive the event notification, since they are invoked concurrently, In this case, without intervention of control of the display, applications may continue to dismiss each other, causing UI thrashing. However, once the arbiter 128 is present as shown in FIG. 3B, the control of the UI associated with a number of simultaneous and potentially originating requests from a plurality of applications is preferred, at least in order to reduce UI thrashing. May be determined by the arbitrator 128 to prevent < / RTI >

3B is a block diagram similar to FIG. 3A, but the arbiter 128 also includes a UI application B 122, a UI application C 124, and a UI application D 126, It is embodied as receiving an event notification. Arbitrator 128 may determine which UI application should reach the foreground if given event notification based on predetermined criteria as further described herein or may make a decision upon receipt of an event notification have. Next, the arbiter 128 may send a flag to the UI application determined to have priority for controlling the display, shown here as application C 124, and the resident operating system may send the flag with the arbiter flag And may cause application C 124 to control the display until another application is received at the operating system. Alternatively, each application wishing to reach the foreground may query the arbiter 128 for permission to take the foreground of the display.

Figure 4 illustrates a plurality of resident UI applications competing for control of the UI (or UI application) 140 and one of the displays of the wireless communication device 74 having the primary display on the UI (or UI application) And Fig. Here, the primary UI 140 is the " incoming group communication "interface 146, and the other interfaces 142 and 144 remain in the background of the UI application. The interfaces shown here are in a "windowed" arrangement, a conventional graphical interface in user interfaces. The UI control methodology described herein is equally applicable to other UI systems and display schemes, and to control interfaces for a user to access the computer platform 82.

In one embodiment, arbiter 128 may use a provisioned "priority list" of applications, where application A 120 may list a list of class IDs, perhaps a network carrier or other entity Lt; RTI ID = 0.0 > and / or < / RTI > This list of class IDs is provisioned in the order of priority of applications that should be allowed to reach the foreground of the UI 140. For example, someone may choose to have application C 124 have a higher priority relative to applications B 122 or D 126 to reach the foreground, After the broadcast, the broadcast also lists the selected class ID for application C 124 in the event notification payload. When applications receive event notifications, they typically check whether the class ID matches that sent in the payload, and if they match, it should reach the foreground. The arbiter 128 may only validate the UI control in this embodiment and does not need to actually approve the control since the class ID may be obvious to each application. However, since each resident application may have to be configured to understand class IDs, this embodiment requires additional overhead.

Yet another embodiment for determining control of the UI 140 is to allow the last application to reach the foreground to accept events of a particular event class (alert, call, presence, etc.) And so on. In this embodiment, application A 120 may broadcast the last known foreground application class ID with the event, and the receiving application may associate its class ID with the class ID of the proposed last known foreground application It is recommended to reach the foreground of the UI 140 only if they compare and match two. However, this is not the case when there was no last known foreground application (fresh start-up), or because it was unclear which application was last under control, so that the initial Edge case "problems such as thrashing.

In another embodiment, the preferred control of the applications is set automatically. The application itself may register itself as a primary application to reach the foreground in order to process events of a particular event class (alert, call, presence, etc.). In this embodiment, the application may retrieve the class ID for the currently-registered application for a particular event class, and may make a determination as to whether to overwrite the stored class ID with its own. If none is stored, an application may set its own class ID as the primary foreground application for a particular event class. In a further embodiment, there may be a provisioned list based on the type of event and activity being invoked, such as the provision of a list of MIME-types in application A 120. This set of MIME-types may be provisioned in order, and application A 120 may broadcast events to all applications having the highest priority MIME-type included in the payload of the event notification. When applications receive this event, they typically check that the included MIME-type matches what was provisioned to them, and may only reach the foreground if they match. In essence, this embodiment uses MIME-types instead of class IDs. However, to implement this embodiment, applications typically cooperate and typically do not reach the foreground if their class IDs do not match what is sent in the event, which requires additional programming in each module .

5 is a flow chart of one embodiment of a method for an arbiter 128 for determining a priority for controlling display 80 between a plurality of invoked wireless communication device-resident applications. The arbiter 128 receives the notification of the event shown by the block 150 (or step 150) and then, as shown in the decision block 152, A determination is made as to whether or not it is large. If more than one application is not invoked at decision block 152, the arbitration process is terminated, as shown at termination block 154. [ Alternatively, if more than one application is invoked at decision block 152, then a determination is made as to whether there is a predetermined priority for the application, as shown at decision block 156, If there is a predetermined priority, the arbitration is terminated, as shown at the end block 162.

Alternatively, if there are no predetermined priority criteria at decision block 156, the priority of the application to have display 80 is determined, as shown at block 158 (or step 158) The flag is then sent to the priority application for controlling the display 80, as shown in block 160 (or step 160), and the intervention is initiated as shown in the end block 162 And is terminated again. The priorities may be determined at block 158 (or at step 158) with a methodology as described above, or a combination of any of the above methodologies.

6 illustrates one method for determining a priority for display control among a plurality of invoked wireless communication device-resident applications based on priority data resident in applications seeking control of display 80 Fig. The notification event occurs as shown by the predefined process block 170 and then a determination is made as to whether more than one application is invoked, as shown in decision block 172 All. If more than one application is not invoked at decision block 172, no arbitration process is required and the process is terminated, as shown at the end block 174. Alternatively, if more than one application is invoked in the decision block 172, then, as shown in decision block 176, the application that attempts to control the display 80 A determination is made as to whether there is a predetermined priority data, and if there is no predetermined priority data, the arbitration is terminated, as shown in the termination block 182. [ Alternatively, if there are predetermined priority criteria present at decision block 176, the highest priority application for having display 80, as shown at block 178 (or step 178) And then a flag is sent to the highest priority application for controlling the display 80, as shown in block 180 (or step 180), and as shown in the end block 182 Similarly, the process is terminated again. Alternatively, priorities may be determined at block 178 (or step 178) with a methodology as described above, or a combination of any of the above methodologies.

The wireless communication device 74 therefore provides a method of the invention for determining which resident application on the computer platform 82 of the wireless communication device 74 controls its display 80 and the user interface 140 A user of the wireless communication device 74 interacts with the computer platform 82 and the method of the invention is shown on the display 80 of the wireless communication device 74 via the user interface 140, And displaying the user interface 140 on the display 80 of the device 74 such that the user interface 140 is configured to be selectively controlled by one or more applications residing on the computer platform 82. [ do. In one embodiment, the method includes receiving at a mediator 128 residing on a computer platform 82 a request from one or more of the resident applications for controlling the display 80, In the arbiter 128, determining which of the one or more resident applications controls the display 80 based on predetermined criteria.

In one embodiment, if each of the one or more resident applications includes priority data that determines a priority for an application for controlling the display 80, the method further comprises, after display of the user interface 140, As shown at 3a, invoking a plurality of one or more resident applications and, based on the priority data in each invoked application, determining which application (s) of one or more resident applications control the display 80 . This determination may be based on the use of class identification to determine the priority for the application to control the display 80, or alternatively, one of the plurality of invoked applications may be prioritized And may be based on grasping the control of the display 80 based on the ranking data. In this embodiment, priority data ranking may preferably maintain display control for the highest priority application to reduce thrashing, or preferably to prevent thrashing.

Determining which application (s) of the one or more resident applications to control the display (80) based on predetermined criteria, when embodied to have the arbiter (128), attempt to control the display (80) It uses a priority list for applications. Alternatively, at the arbitrator 128, determining which application (s) of the one or more resident applications to control the display 80 based on predetermined criteria may be used to control the display 80 again, The display 80 may be controlled. Also, at the arbitrator 120, determining which application (s) of the one or more resident applications to control the display 80 based on predetermined criteria may be assigning the class to one or more applications, Is based on the class of the application. In addition, at the arbitrator 128, determining which application (s) of the one or more resident applications to control the display 80 is based on the control of the display 80 based on the type of data being processed in the user interface 140 , Or may be based on the type of data being received at the wireless communication interface 92. [

The method may further comprise displaying the data at a user interface 140 to a user of the wireless communication device 74 and the user interface 140 may display a display screen such as the interface 140 on the display 80 The method may include displaying graphical information to a user of the wireless communication device 74 at a display 80 such as APIs 142, 144, Alternatively, if the user interface is a control interface for accessing the computer platform 82, the method may display graphical information on the display screen 80 for controlling device functionality to the user of the wireless communication device 74 The method further comprising the steps of: Arbitrator 120 may include one or more user interfaces such as windowed APIs 142, 144, and 146 if user interface 140 includes one or more user interface applications configured to selectively control user interface 140. [ May be further configured to selectively allow control of the display 80 for applications.

As described above with reference to block 160 of FIG. 5 and block 180 of FIG. 6 described above, the wireless communication device may also be configured to send flags (or other messages) to priority applications have. In various embodiments, the wireless communication device may include messages, flags, or other signals that indicate that the applications may not control (or may not reach the foreground) Lt; RTI ID = 0.0 > applications. ≪ / RTI > In particular, the wireless communication device may send suspend messages, e.g., via an arbiter, indicating that the application should act as a non-activity or suspended application in the background of the wireless communication device. For example, after determining the priority application using operations in block 158 of FIG. 5 or block 178 of FIG. 6, the wireless communication device may send a flag to the priority application, Lt; RTI ID = 0.0 > applications running on a processor of the < / RTI > In this way, applications may receive the results of arbitration operations by the wireless communication device over these messages or signals, whether or not they are priority applications that may control (or arrive at foreground) the display have.

In various embodiments, the wireless communication device may perform operations to modify and / or support the arbitration operations described above. In particular, the wireless communication device may perform the methods 700, 750, 800, 950, 1050, 1150, 1200, and 1300 as described below. In various embodiments, the operations of the methods described below may be performed in combination with, or as part of, the arbitration operations described above. For example, the wireless communication device may perform operations in blocks 150 through 160 of FIG. 5 or blocks 170 through 180 of FIG. 6, for example, via an arbiter, May perform any or all of the operations of subsystems 950, 1050, 1150, 1200, or 1300.

Further, in various embodiments, the wireless communication device may be configured to perform the operations of the various methods described below, via an arbiter as described above. For example, the wireless communication device may communicate with the wireless communication device via an arbiter application (or an app) running on the processor of the wireless communication device, or alternatively, with arbiter processes, routines Perform any combination of the operations at any of the methods 700, 750, 800, 950, 1050, 1150, 1200, or 1300, It is possible. Thus, any of the operations of the wireless communication device described below may be considered to be performed via such an arbiter.

Figures 7A-8 illustrate embodiments of methods 700,750, and 800 for managing a plurality of displays in which a wireless communication device may be controlled by applications running on the processor of the wireless communication device. In various embodiments, a wireless communication device may include a plurality of displays for rendering information (e.g., images, pictures, and user interface elements) corresponding to applications running on the processor of the wireless communication device Or may be coupled to such a plurality of displays, or alternatively may be configured to use such a plurality of displays. For example, a wireless communication device may include a small display for rendering application information when elements of a clam shell-style mobile device (e.g., housing flaps, sides, halves, etc.) And a clamshell-style mobile device (e.g., a cell phone) that includes a plurality of screens, such as a larger display when the clamshell-style mobile device is opened. As another example, the wireless communication device may include a first touch screen display on the front side of the housing and a second touch screen display built into the back side of the housing. Figure 14, discussed in more detail below, illustrates an example of a wireless communication device that includes a plurality of displays.

In embodiments, wireless or wired connections also allow the wireless communication device to communicate with other displays (e.g., a portable laptop computer, a desktop computer, a plurality of LCD monitors used in combination to render a larger full image, etc.) , Or tethered to other wireless communication devices (e.g., another smartphone linked to a wireless communication device) having displays. In various embodiments, the plurality of displays may include different sections within a single display (e.g., a plurality of monitors used in combination to display a larger overall image such as a billboard), quadrants ), Or pixel ranges. For example, a wireless communication device may partition the real-estate of a single touch screen display to render a plurality of desktops, environments, or foreground applications.

The methods 700, 750, and 800 of the embodiments described below with reference to FIGS. 7A-8 are based on how applications resident on a computing platform of a wireless communication device can communicate with a plurality of displays For example, via an intermediary device, to manage whether or not it is allowed to control one of the wireless communication devices. For example, the wireless communication device may be configured to receive an arbiter application (or app) running on the processor to manage which other applications running on the wireless communication device may arrive at the foreground of the display, based on predetermined criteria, Lt; RTI ID = 0.0 > 700, < / RTI >

FIG. 7A illustrates an embodiment of a method 700 for a wireless communication device to assign (or intervene) control of the foreground of a plurality of displays. In other words, the wireless communication may determine which applications may reach the foreground for each of the plurality of displays by comparing the priorities of the applications registered with the device. In an embodiment, the priority of each application running on the wireless communication device may be registered in the device's operating system or arbiter. For example, when a higher priority application has control of the foreground of the primary display, the wireless communication device may assign a lower priority application to control the auxiliary device. As another example, a wireless communication device may pre-empt a low-priority application that controls a secondary display for medium-priority applications that are not important enough to control the primary display. (preempt).

At block 701, the wireless communication device may register applications, for example, by storing registration information that includes descriptive information of applications running on the wireless communication device. The registered applications may be considered as resident on the computer platform of the wireless communication device. The wireless communication device may be operable at the boot-up time of the wireless communication device in response to receiving registration requests from applications, or when applications are installed, launched, or otherwise activated (e.g., Time, or at application activation). In an embodiment, applications may be registered by a wireless communication device via an intermediary in response to receiving event notifications.

Upon registration of an application resident on the computer platform of the wireless communication device, the various registration information may be associated with the application, e.g., in a data table or database accessible by an arbiter application (or OS process) May be stored. In particular, each registered application may be configured to provide identification information (e.g., application ID), default priorities (e.g., high, low, critical, etc.), network requirements of the application , Any required quality of service (QoS), required broadcast or multicast, required global positioning system (GPS), etc.) (E.g., the arbiter may dynamically change its priority from high to low based on operating conditions, etc.), and whether the application is to be reprioritized to a secondary display (e.g., a supplemental touch screen ≪ / RTI > or the like).

Additionally, each registered application may indicate whether the registered application is capable of running in the background of the wireless communication device (i.e., "background-enabled" or "background- ) "). ≪ / RTI > (And arbiter) that the video calling application (e.g., QCHAT®) is "background-enabled", and the camera application controls (or runs in the foreground) the foreground for the display When a video call is received later, the wireless communication device may allow the camera application to continue to control the foreground via the arbiter while the video calling application continues to execute in the background. As another example, when the video calling application is registered without a background-enabled indication (i.e., the "background-disable" indicator is registered), the wireless communication device may pause the camera application, May allow the video calling application to take control of the foreground of the display when it is registered with a higher priority level than the camera application. In an embodiment, the wireless communication device may include tones that may display video call status and / or floor control, such as tones indicating that the video calling application is making a call as a process running in the background, , Or to emit or render other sounds.

The registration information of the various registered applications may be stored as data, bits, variables, descriptive strings in the data records, or any other data that the wireless communication device may access to evaluate applications have. In an embodiment, the registration information, such as an indication of whether the application is background-enabled, may be based on user preferences associated with the application, the wireless communication device, and / or the arbiter. For example, user preferences indicating that the application may only be rendered on the default / main screen, or that the application may (or may never) be run as a background process on the wireless communication device may be set for a particular application have.

Returning to Fig. 7a, at decision block 702, the wireless communication device may determine whether an activity associated with the first application is detected. For example, as described above, the wireless communication device may detect, via the arbiter, when notification events or other messages that may invoke applications registered with the arbiter are received. These detected activities may be predefined events for each individual registered application or may be universal for all applications. The detected activities, which may be related to the first application, may include encountered exceptions, detected changes in stored information associated with the registered applications (e.g., change of priority), and / or registration of a new application to the arbiter , Changes in the operating status (e.g., aborted, activity, etc.) of the application or in the registration information (e.g., priority class, etc.), control of foreground application requests of the display, loss of control of the display foreground by the application, And / or received events notifications / signals / interrupts / or other messages received in response to various states such as a change in activity status of the display (e.g., a primary display becomes available).

In an embodiment, the wireless communication device may determine that a received message is related to a first application based on bits or other indicators identifying the first application, and / or a class or priority of the first application . Alternatively, any received message may be associated with any launched and / or activity applications (e.g., applications running in the background / foreground of the wireless communication device). In various embodiments, the wireless communication device may evaluate all registered applications to determine the relevance to any such detected activity (e.g., a received message).

If the wireless communication device does not detect an activity associated with the first application (i.e., decision block 702 = "no"), the wireless communication device may continue operations for registering applications at block 701. [ For example, the wireless communication device may register applications continuously or periodically and may monitor for notification events. If the wireless communication device detects an activity associated with the first application (i.e., decision block 702 = "YES"), then at block 704, (Or order) a list of all executable displays. For example, the wireless communication device may be used to identify all the touch screens, LCD screens, and other display units that are functioning properly (i.e., not damaged, being repaired, etc.) It is possible. In other words, the identified list of executable displays may be a list of all possible displays from which the first application may reach the foreground.

In an embodiment, the wireless communication device may identify the list based on the registration information associated with the first application. For example, if the registration information of the first application indicates that the first application does not support multiple displays, the wireless communication device may identify the list that includes only the device's default or primary display. As another example, the wireless communication device may evaluate the registration information of the first application to obtain the desired display priority, thereby identifying the list accordingly. In another embodiment, the wireless communication device may identify a list of executable displays by evaluating the power required to use the display. In particular, for a first application to control, the wireless communication device may evaluate the available battery power of the device to determine whether the deactivated secondary display may be activated (or powered up). The wireless communication device may estimate the power consumption of this secondary display by the first application and may compare the estimated consumption to a threshold value to determine whether activating the secondary display is feasible.

The display order of the list of executable displays may include predefined stored information related to various displays (e.g., a database having information describing the priority classifications of the display units), user preferences, activities (e.g., , And availability for the first application. For example, the list of executable displays may be in order from the default (or main) touch screen to the secondary displays. As another example, a list of executable displays may be presented in descending order of resolution or render quality (e.g., HD, SD, black-and-white, etc.). As another example, the list may order the displays in an order that can best render the specific type of data (e.g., video, text, etc.) associated with the first application. In various embodiments, the identified list for the first application may be different from the identified list for other registered applications. For example, the wireless communication device may identify that the OLED or LED screen has the highest display priority for the first application (e.g., a video game) based on the registered information of the first application, May be identified as the highest display priority for the second application (e.g., picture editor).

At block 706, the wireless communication device may select the next display from the identified list of executable displays. Initially, the wireless communication device performs operations in block 706, and the next display is a first display (i.e., a display having the highest display priority for the first application) in the identified list of executable displays It is possible. For example, the wireless communication device may initially select a default (or main) display for evaluation for the first application. At decision block 708, the wireless communication device may determine whether the selected display is being used by the second application. If the selected display is not being used by the second application (i.e., decision block 708 = "NO"), then at block 716 the wireless communication device assigns control of the foreground of the selected display to the first application Flag (or other signal).

If the selected display is being used by the second application (i.e., decision block 708 = "YES"), then at decision block 710, the wireless communication device determines that the second application has a higher priority than the first application Or not. The wireless communication device may compare the properties of the first and second applications, for example, by comparing priority classes or other characteristics to identify applications having a higher priority. The wireless communication device may perform operations similar to those described above with reference to blocks 158 and / or 178 of FIGS. 5-6 to determine which applications have a higher priority.

If the second application does not have a higher priority (i.e., decision block 710 = "NO"), then at optional block 718, the wireless communication device determines that the second application is in the foreground The status of the second application may be changed by storing a bit indicating that it is being removed from the control. In an embodiment, the change of status is a method for transmitting a message or signal (e.g., an abort message) indicative of a status change of the second application and, if possible, reassigning the second application to another display 700, < / RTI > Next, the wireless communication device may continue operations at block 716. [

If the second application has a higher priority (i.e., decision block 710 = "YES"), then at decision block 712, the wireless communication device selects the next display in the identified list of executable displays for selection Or not. In other words, the wireless communication device may determine whether to perform the operations of block 706 with another iteration to assign the first application to the display having the next highest display priority in the identified list of executable displays have. If there is no next display in the identified list of executable displays for selection (i.e., decision block 712 = "NO"), then at block 714, the wireless communication device sends a first application to a wait queue wait queue. For example, the first application may be suspended until the primary display, or any display in the identified list of executable displays, becomes available. As described above, the wireless communication device may receive messages or signals when displays become available, and in response may perform operations of the method 700 to assign a first application to the display.

In an embodiment, a wireless communication device may perform a method 700 to sequentially assign an application to different displays in its associated list of ordered displays. In other words, in response to receiving a message or signal indicating that a certain display (e.g., default, main, high priority) has become available, the wireless communication device may determine that the application controlling the secondary display may be reassigned to which display May perform operations in the method 700 to determine whether or not there is a < / RTI > For example, when a second application of higher priority is terminated and handed over control of a front-facing display (i.e., a default or primary display), the wireless communication device is moved to the rear of the housing of the wireless communication device The first application of lower priority previously assigned to the secondary display on the display may be reassigned to the forward-facing display.

7B illustrates an embodiment of a method 750 for a wireless communication device to assign (or arbitrate) control of the foreground of a plurality of displays. Method 750 is described above, except that method 750 resides on the wireless communication device and includes operations to update (or recalculate) the priorities of various applications registered as being managed by the arbiter (700). At block 701, the wireless communication device may register applications, for example, by storing explanatory information of applications running on the wireless communication device.

At block 752, the wireless communication device may recalculate (or perform re-prioritization) the priorities of the registered applications for dynamic priority changes in response to predefined events . As described above, the registration information stored by the wireless communication device upon registration of the various applications may include indications of whether the applications may be dynamically re-prioritized. In other words, the registration information may indicate whether the application has agreed to be re-prioritized by the wireless communication device, e.g., via an arbiter application or an OS routine. Some applications, such as emergency calling applications, may have static priorities and may not be registered to allow dynamic reconnection by the wireless communication device.

In various embodiments, the predefined events may be stored in data generally accessible by the wireless communication device (e.g., in a memory associated with the arbiter application), or alternatively, the properties of the individual registered applications Lt; / RTI > The predefined events may include states, timers, messages (or received message types), or other situations that may trigger recalculation of priorities for particular applications. For example, the registration information for an application may indicate that the wireless communication device is capable of receiving a predetermined number of times (e.g., millisecond (s), second (s), minute (s) (Or signals) once to recalculate the priority of an application. As another example, a wireless communication device may perform re-ordering operations for an application based on detecting registration or launch of an application. In an embodiment, the wireless communication device may perform re-ordering operations on the application based on detected user input, such as tapes or text-typing inputs on the touch screen corresponding to the address book application.

In another embodiment, the wireless communication device may perform re-ordering operations on the application based on changes in operating parameters of the device. For example, the application may be configured to lose access to a wide area network (WAN), to obtain a connection to the WAN, to detect cellular network service activity changes, and / The wireless communication device may be re-prioritized in response to detecting a change in network connectivity. As another example, an application may be configured such that a wireless communication device receives a short-range wireless signal (e.g., Bluetooth), and / or receives available power (e.g., Lt; / RTI > battery life, etc.). In another embodiment, the wireless communication device may recalculate priorities of applications in response to detecting status changes (e.g., aborted, activated, removed from control of the display, etc.) in the registered applications. For example, a wireless communication device may lower the priority of a typically high-priority video calling application when the application has an idle screen.

As an example to illustrate an embodiment, a wireless communication device may execute two applications registered for dynamic priority enhancement on that processor: a video call application that requires a network connection and may be initially registered with a high priority , And a camera application that does not require a network connection and may be initially registered with a low priority. When the video calling application is launched, the wireless communication device may detect, via the arbiter, that there is no available cellular network connection (i.e., no coverage), so that the video calling application may be temporarily disabled. In such a situation, the wireless communication device may dynamically, via the arbiter, dynamically adjust the camera application to have a higher priority than the video calling application, in order to avoid situations in which the camera may lose control of the foreground of the display of the wireless communication device. It can also be prioritized.

As yet another example for illustrating an embodiment, a wireless communication device may execute two applications registered for dynamic priority enhancement on the processor: a video calling application that may be initially registered with a high priority; And an address book application that may be initially registered with a lower priority. The wireless communication device may detect user inputs while the address book application is controlling the foreground for the display so as to avoid interrupting the input even if the video calling application is launched or receiving an incoming call You can also increase the priority of the address book application.

The recalculation (or rerecording) operations for the applications include various weighting schemes, rule sets, balancing factors, models, mathematical equations, and new priority values for each application Other considerations may also be used to determine. In addition, the re-ordering of one application may trigger the wireless communication device to recalculate the priority of another application. For example, in response to the first application having recalculated as having the highest priority, the wireless communication device may recalculate the priority of the second application that previously had the highest priority (via the arbiter).

7B, at decision block 702, the wireless communication device may determine whether an activity associated with the first application is detected. In particular, the wireless communication device may determine whether a change in priority has occurred for registered applications. For example, if the first application is in a wait queue for display, the wireless communication device may determine whether any applications with a higher priority than the first application have been prioritized. As another example, if the first application is in a wait queue for a display, or if the first application is not currently under control of its preferred display, then the wireless communication device may determine, based on its registration information, And may determine whether any, in particular, the desired display for the first application has become available.

If the wireless communication device does not detect an activity associated with the first application (i.e., decision block 702 = "no"), the wireless communication device may continue operations for registering applications at block 701. [ If the wireless communication device detects an activity associated with the first application (i.e., decision block 702 = "YES"), then at block 704, And may identify a list of all executable displays. At block 706, the wireless communication device may select the next display from the identified list of all executable displays. At decision block 708, the wireless communication device may determine whether the selected display is being used by the second application. If the selected display is not being used by the second application (i.e., decision block 708 = "NO"), then at block 716 the wireless communication device assigns control of the foreground of the selected display to the first application The flag may also be transmitted. If the selected display is being used by the second application (i.e., decision block 708 = "YES"), then at decision block 710, the wireless communication device determines that the second application has a higher priority than the first application Or not. If the second application does not have a higher priority (i.e., decision block 710 = "NO"), then at optional block 718, the wireless communication device may change the status of the selected application, , Then the operations at block 716 may continue. If the second application has a higher priority (i.e., decision block 710 = "YES"), then at decision block 712, the wireless communication device determines whether there is a next display in the list of all executable displays for selection You can also decide if you want to. If there is no next display in the list of all executable displays for selection (i.e., decision block 712 = "NO"), then at block 714 the wireless communication device adds the first application to the wait queue for display You may.

Figure 8 illustrates a method 800 of an embodiment for a wireless communication device to recalculate the priorities of multiple displays. Similar to the recalculation of priorities for the registered applications described above with reference to Figure 7b, the wireless communication device may be configured to update the priority information of the various displays of the device, which may be controlled by the registered applications have. For example, if a child is using the default (or highest priority) screen on the left side of the device to view a cartoon and the dad is using camera data to indicate that he is using an auxiliary screen on the right side of the device to work Based on the face recognition data, the wireless communication device may reorder the secondary screen on the right side (via the arbiter) as being the new default (or highest priority) display. As another example, based on stored information indicating that the default screen is broken or malfunctioning, the wireless communication device may reorder the secondary screen to be the default screen until the previous default is repaired. By performing method 800, the wireless communication device may instruct applications to control more appropriate displays based on context and / or usage.

At block 802, the wireless communication device may store status information for all displays of the device. For example, the wireless communication device may be configured to store operating requirements (e.g., power consumption parameters, the type of data that may be rendered, the type of data that may be best rendered, etc.), the display priority (Or a viewable area) associated with each of the plurality of displays connected to the wireless communication device, or otherwise associated with the plurality of displays controlled by the wireless communication device, (E.g., broken, malfunctioning, nominal, etc.), or other descriptive information. In an embodiment, the status information may be ordered by display priority, for example ordered by ascending order of user preferences or ranks. In various embodiments, the wireless communication device may store status information for each of a plurality of displays for each of the registered applications. For example, the wireless communication device may store separate ranked lists for each of the displays associated with each of the plurality of applications resident on the computer platform of the wireless communication device.

At block 804, the wireless communication device may poll the sensors of the device for information about current conditions. The wireless communication device may include various sensors such as cameras, microphones, thermistors, accelerometers, gyroscopes, and touch-sensing surfaces. The wireless communication device may collect sensor data indicative of environments or conditions of use that may be utilized to assess the feasibility of the displays of the device and how the user of the device interacts with the device. For example, the wireless communication device may evaluate accelerometer sensor data to identify contextual information useful in prioritizing displays. Using the sensor data, the wireless communication device can determine the ambient temperature based on the thermistor sensor data, the ambient brightness based on the camera data, the current device movement or motion based on the accelerometer / gyroscope sensor data, the device tilt based on the gyroscope sensor data, (E. G., Recorded image data of the current user's face) or microphone data (e. G., Recorded audio data of the current user's voice) Such as the current user ' s identity based on < RTI ID = 0.0 > a < / RTI >

At block 806, the wireless communication device may evaluate the feasibility of displays based on stored status information and / or polled sensor data. For example, based on stored status information for an LCD screen, the wireless communication device determines whether the screen is power-low (or requires a significant amount of battery power), operating at a high temperature, (E.g., standard definition (SD), high definition (HD), etc.), touch-sensitive knowledge, and / or is currently functioning properly ). The wireless communication device may compare the stored status information of the various displays with current conditions such as time of day. The wireless communication device may also compare stored information indicative of the display's light output capabilities to ambient brightness, for example, to identify how well the user may see rendered applications on the display, May be compared with the sensor data. For example, the wireless communication device may be configured to communicate current motion data from the accelerometers to the viewable area of the screen in order to identify how useful the screen may be when the user is in walking / driving / .

At block 808, the wireless communication device may evaluate user interactions with displays based on the polled sensor data. For example, by evaluating detected touch inputs on a touch-sensitive screen, the wireless communication device may estimate the user's activity associated with the various screens. The wireless communication device may determine the current most-used or most popular display based on the detected user inputs. The wireless communication device may also perform eye tracking and / or head tracking using camera data to identify the specific screens the user is viewing more frequently. For example, the wireless communication device may determine whether the user is looking at any of the plurality of displays based on eye tracking, whether the user is looking at any of the plurality of displays based on head tracking, and / Or user interaction information indicating whether the user is touching any of the plurality of displays. In an embodiment, the wireless communication device may evaluate the gyroscope sensor data to identify how the device is being maintained in order to determine its current usage. For example, if the sensor data indicates that the device is being held up, the wireless communication device may assess the likelihood that the user is looking at the front-facing screen as opposed to the screen on the back of the device. In various embodiments, user interactions with the device may be decrypted during a period of time, such that the wireless communication device may use the stored sensor data to be collected or recorded at the device during that time.

At block 810, the wireless communication device may recalculate the priorities of the displays based on assessments such as the estimated feasibility of the displays and / or the evaluated user interaction with the displays. For example, based on an evaluation of increased user interactions with certain displays during a period of time, the wireless communication device may increase the priority of certain displays (e.g., if a display has a default or priority display . The recalculation (or re-prioritizing) operations for the displays may include various weighting schemes, rule sets, balancing factors, models, mathematical equations, and other methods for determining new priority values for each display Considerations may also be used. For example, based on irregular motion sensor data, the wireless communication device may re-prioritize the large screen as the default display so that applications rendered on the large screen are easier to see when the user is jogging. As another example, a wireless communication device may be configured to display a plurality of displays, based on status information indicating that the screen requires more power than the device can sustain, given the remaining charge on the device ' The default screen may be reordered to have the lowest priority.

In an embodiment, the one or more priorities of the display in the plurality of displays may be updated in response to a change in display priority, or may otherwise be changed. For example, in response to re-prioritizing the first display as the default (or most important) display, the wireless communication device may necessarily reduce (or prioritize) the plurality of secondary displays that were the default display. At block 812, the wireless communication device may store recalculated priorities of displays by updating data records, system variables, or other data that may be accessible by the arbiter, e.g., associated with displays in the database have. In an optional block 814, the wireless communication device may wait for a predefined number of seconds, minutes, and so on, and then repeat operations beginning at block 804. [

In an embodiment, method 800 may be performed by a wireless communication device during operations in block 704 described above with reference to Figures 7A-7B. For example, the wireless communication device may interpret the displays of a device for a particular registered application based on the properties described above (e.g., the type of data to be rendered for the application, etc.), as well as the assessments described above Or may be configured to be prioritized. In other words, each registered application may be associated with a display priority list for all displays of the wireless communication device that may be re-prioritized.

Figures 9A-12 illustrate embodiments for clarifying user inputs consistent with a plurality of applications in which a wireless communication device controls a display. Without the advantages of various embodiments, successor applications may block predecessor application operations when the wireless communication device allows successor applications to obtain control of the foreground of the display. In particular, when a wireless communication device is receiving user inputs (e.g., typed text, speech commands, visual gestures, etc.) associated with a first application and a second application is receiving pop- Quot;), the user inputs may be applied to the second application against the intention of the user if the various embodiments are not activities. For example, while receiving textual input from an email client, the wireless communication device may, in response to receiving unexpected text that moves the text input focus to a video calling application, It may be allowed to reach the foreground. As yet another example, a wireless communication device may launch a video application, and then, while the video application is loading, it may give control of the foreground to the email client; However, while the wireless communication device is receiving the word of text input to the email client, the video application may pop up unexpectedly. As another example, a voice-to-text (or voice command) input for a video calling application may be unintentionally applied to a calendar application that pops up on the display based on the occurrence of the scheduled event. Users may not know when the applications may pop up and when they may gain control of the display, so that for a new application that gets control of the display (e.g., within half a second) There may be good reasons for assuming that the user inputs received in close proximity should be applied to the predecessor application.

9A depicts a first user interface 902 for a first application with a second user interface 906 for a second application reaching foreground when the device receives an intended user input for the first application Lt; RTI ID = 0.0 > 904 < / RTI > As described above, the second application may be used in response to the wireless communication device receiving an incoming event or a timed-event, or when the process is just being completed To reach the foreground (i. E., Gain control of the display).

As an illustrative example, a user of the wireless communication device may intend to write a textual input "Hello world" into the first user interface 902 of the first application. The first user interface 902 is shown associated with a first input text "Hello wo ", such as an input typed into a wireless communication device via a touchpad or soft keyboard. Since the first application was controlling the foreground of the wireless communication device when the first input text was received (or typing input), the first user interface 902 may be associated with the first input text. The second user interface 906 is shown as being associated with the second input text "rld ", and also has a focus of input to the wireless communication device (shown by the cursor element 908 in FIG. 9A) Respectively. Since the second application was controlling the foreground of the wireless communication device when the second input text was received (or typing input), the second user interface 906 may be associated with the second input text. In other words, between the wireless communication device receiving the first input text "Hello wo" and the second input text "rld ", the second application has reached the foreground of the wireless communication device, Respectively.

9B illustrates an embodiment of a method 950 for a wireless communication device to associate received user inputs with a first or second application based on timing information. For example, the wireless communication device may perform operations for inferring an intended target application for received user inputs, by evaluating that the various time inputs have been received and the application focus shifted, via the arbiter. In various embodiments, the method 950 may be performed by a wireless communication device as part of the methods described above with reference to Figures 5-6. For example, the wireless communication device may perform method 950 after performing operations in block 160 of FIG. 5 or block 180 of FIG. 6 via an arbiter.

At block 952, the wireless communication device may detect a change in control of the foreground (or display) from the first application to the second application. For example, the second application may be a video call application in which the arbiter has transmitted a flag to the operations in block 160 of FIG. 5 or block 180 of FIG. The wireless communication device may also identify and store the time associated with the change in control, such as 0.5 seconds during the day when the second application obtained control of the foreground. In various embodiments, the wireless communication device may detect a change by evaluating not only the operating system table, system variables, or current control application, but also other stored information indicative of the time at which control was obtained by the control application . In an embodiment, the change in control may be detected based on an interrupt or other signal generated in response to the second application obtaining control of the foreground. In an embodiment, a change in control may be detected by evaluating a change in the focus indicator (e.g., the focus may be moved from one user interface to another for the purpose of inserting user inputs) .

At block 953, the wireless communication device may identify a first input occurring prior to the change in control and a second input occurring after the change in control. The wireless communication device may evaluate an input buffer, such as a temporary storage location in a memory that stores user input values or actions received by the device during a time period, and may compare the time of the received information associated with the buffered inputs And may identify the first and second inputs based on the first and second inputs. For example, received user inputs may be stored in association with applications that control the foreground (i.e., have focus) upon reception of times and / or user inputs. Alternatively, the wireless communication may be configured to use various buffers, arrays, or other data structures for different applications. For example, the wireless communication device may identify the first input as data stored in a first buffer associated with a previous application for controlling the foreground, and the second input to the current application for controlling the foreground As data stored in a second buffer associated with the second buffer. In an embodiment, the first input may be only the segment of the user input that was received prior to the change in control (e.g., the most recently received segment). For example, the first input may be identified prior to the change in control, but as a punctuation mark, a space sign, a return carriage, or other textual input received after another logical partition within the stream of text . In an embodiment, the wireless communication device may use detected input events, such as mouse click, touch, or keyboard events, to identify the time at which to receive the first and second inputs. In various embodiments, user inputs may include touch inputs (e.g., presses, sweeps, taps, etc.), text inputs (e.g., typed words, etc.) Spoken or verbal inputs (e.g., voice commands, etc.), and / or visual inputs (e.g., gestures, etc.).

When the second application obtains control of the foreground at some time after the user-written inputs (e.g., text, voice, etc.), the second application may not be considered to be stopping ongoing user input. Accordingly, at decision block 954, the wireless communication device may determine whether the first input has been received within the first time threshold of change in control. In other words, when the time between receiving the first input and the detected change in control exceeds the first time threshold, the second input may not be a continuation of the first input (i.e., May infer that the second input was intended to be associated with the second application). The first time threshold may be a predefined value such as 0.5 seconds (s), and / or may be based on user preferences. In an embodiment, the wireless communication device may compare a predefined first time threshold to a computed value representing a difference in time of reception associated with the identified first input having a time of modification in control . If the first input is received outside the first time threshold of the change in control (i.e., decision block 954 = "NO"), then at block 960 the wireless communication device transmits the second input to the second It can also be associated with an application. For example, when the first input is received a few seconds (e.g., 30 seconds, etc.) before the second application obtains control of the foreground, the wireless communication device determines that the second input is intended for the second application .

If the first input is received within the first time threshold of change in control (i.e., decision block 954 = "YES"), then at decision block 956, the wireless communication device determines that the second input is in control Lt; RTI ID = 0.0 > of the < / RTI > In other words, when the time between the detected change of control and the receipt of the second input exceeds the second time threshold, the second input may be assumed not to be a continuation of the first input (i.e., The user may be inferred that the second input was intended to be associated with the second application). Except that the wireless communication device may use the time to receive the second input instead of the time to receive the first to compute a time window for comparison with a second predetermined threshold value, Operations at block 956 may be similar to those described above with reference to decision block 954. In various embodiments, the first time threshold and the second time threshold may be the same value.

If the second input is received outside the second time threshold (i.e., decision block 956 = "no"), then at block 960, the wireless communication device may associate the second input with the second application . However, if the second input is received within the second time threshold (i.e., decision block 956 = "YES"), then at block 958, the wireless communication device may associate the second input with the first application . In other words, the wireless communication may determine that the user input to the first application is blocked by the second application taking control of the foreground, so that the second input may be associated with the first application. In optional block 962, the wireless communication device may return control of the foreground to the first application. For example, via the arbiter, the wireless communication device may send a flag to the first application indicating that it has priority to control the foreground, based on the determination that the user input is blocked.

In various embodiments, instead of performing operations in decision blocks 954 through 956, the wireless communication device simply compares the time between receiving the first and second inputs with a predefined threshold value . For example, once the wireless communication device determines that the first input is received before the change in control and the second input is received after the change in control, the wireless communication device determines that the second input is associated with the second application It may be necessary to only compare the measured time between two receivers in order to determine whether or not it may be possible.

In various embodiments, the wireless communication device may include various factors, rules sets, and / or parameters for determining whether the received user inputs (e.g., voice, text, gestures, etc.) are intended for the first or second application Balancing tests, weighting schemes, and other logic may be used. For example, in addition to evaluating the time measurements as described above, the wireless communication device may also be configured to allow the user to focus the foreground of the device corresponding to the received user inputs (e.g., a stream of typed text) (No-op) touch inputs and the location of the detected touch inputs to determine whether or not the touch input is intended to change. By way of example, the wireless communication device may identify whether the touch input was detected as being consistent with the second application text box, to determine whether the focus change associated with the second input was intentional.

Another technique for clarifying intended user inputs for the first and second applications may include creating a prompt dialog box that requests or invites additional user input (or selection input) . 10A shows a first user interface 902 for a first application, a second user interface 1003 for a second application to reach foreground, and a prompt dialog box (FIG. 10A) for inviting a selection input to clarify input 1002, < / RTI > of a wireless communication device.

By way of example, a user of the wireless communication device may intend to write a textual input "Hello world" into the first user interface 902 of the first application. The first user interface 902 is shown associated with a first input text "Hello wo ", such as an input typed into a wireless communication device via a touchpad or soft keyboard. Since the first application was controlling the foreground of the wireless communication device when the first input text was received (or typing input), the first user interface 902 may be associated with the first input text.

The second user interface 1003 is shown in Figure 10A as having no associated input. However, the prompt dialog box 1002 may also include the second input text "rld ", as well as the arrow UI elements 1004 and 1005 that prompt the user to select an application that should be associated with the second input text. In particular, the first arrow UI element 1004 may be configured to associate a second input text with the first application when selected, and the second arrow UI element 1005, when selected, Application. ≪ / RTI >

10B illustrates an embodiment of a method 1050 for a wireless communication device to associate received user input with a first or second application based on timing information and selection inputs from a user. Method 1050 is similar to method 950 described above, except that method 1050 may include operations for clarifying user inputs by using prompts that the user may respond to. For example, the wireless communication device may perform operations to infer an intended target application for user inputs by evaluating various timing measurements, via an arbiter, and may prompt to invite or request selection inputs from users (E.g., pop-up dialog boxes, tones, visual materials, etc.). In various embodiments, the method 1050 may be performed by a wireless communication device as part of the methods described above with reference to Figures 5-6. For example, the wireless communication device may perform method 1050 after performing operations in block 160 of FIG. 5 or block 180 of FIG. 6 via an arbiter.

At block 952, the wireless communication device may detect a change in control of the foreground from the first application to the second application. At block 953, the wireless communication device may identify a first input occurring prior to the change in control and a second input occurring after the change in control. At decision block 954, the wireless communication device may determine whether the first input has been received within the first time threshold of change in control. If the first input is received outside the first time threshold of the change in control (i.e., decision block 954 = "NO"), then at block 960 the wireless communication device transmits the second input to the second It can also be associated with an application. If the first input is received within the first time threshold of change in control (i.e., decision block 954 = "YES"), then at decision block 956, the wireless communication device determines that the second input is in control Lt; RTI ID = 0.0 > of the < / RTI > If the second input is received outside the second time threshold (i.e., decision block 956 = "no"), then at block 960, the wireless communication device may associate the second input with the second application .

However, if the second input is received within the second time threshold (i.e., decision block 956 = "YES"), then at block 1052, the wireless communication device transmits subsequent user selection inputs You can also render the prompt information you request. For example, the wireless communication device may include a pop-up dialog box that indicates that additional user inputs are needed to determine the intended application for the second input, a sound (e.g., music sample, tone, chirp, An audible message, etc.), and / or visual data (s) (e.g., displayed text messages, rendered symbols, etc.). The rendered prompting information may be considered as a granularity for a purely time-based decision, as described above with reference to FIG. 9B. In other words, the prompting information indicates that the wireless communication device has received the second input within the second time window after the second application has obtained control of the foreground and the first input is within the first time window It may be generated only when it is determined to be received. In this way, the prompting information may only be rendered in situations where the user's intention is particularly ambiguous (i.e., the reception of the second input is very close in time to the change in control or reception of the first input) . In an embodiment, when the wireless communication device is configured to render prompt information to clarify inputs, the first and second time thresholds may represent larger (or smaller) time windows based on user preferences.

In an embodiment, the wireless communication device may display changes in control and / or may render audible prompting information that may be listened to by the user even when he / she is not looking at the device. For example, when a user is writing input into a first application (e.g., a notepad application) running on a wireless communication device via a speech-to-text or voice command mode, May not be staring, and thus may not be able to see when a second application (e.g., a timed calendar popup) gains control of the foreground. Accordingly, in order to notify the user, the wireless communication device may emit a special tone, chirp, music, sound, or message (e.g., "switch to second application") indicating a change in control It is possible. In an embodiment, upon receiving voice inputs (e.g., speech-to-text input, voice data during voice command mode, voice data for telephone calls, etc.), the wireless communication device may send an application that currently controls the foreground You can also periodically render the displayed background sounds. For example, the wireless communication device may emit a first intrinsic background noise or tone while the first application is in foreground, or may emit a second intrinsic background noise or tone while the second application is in foreground have.

At decision block 1054, the wireless communication device may determine whether a select input (or user select input) indicating that the second input is associated with the first app is received. For example, the wireless communication device determines whether it detects touch input or other button presses corresponding to arrow UI elements on the pop-up dialog box, corresponding to associating a second input (e.g., text "rld") with the first input You can also decide if you want to. As another example, the wireless communication device may include a voice command (e.g., "switch back," continue the first application, "return to first ", etc.) indicating that the second input is associated with the first application, ≪ / RTI > As another example, the wireless communication device may include a predefined visual gesture command (e.g., a video captured by the camera indicating that the user is swiping his / her hand to a certain side) indicating that the second input is associated with the first application , An image indicating that the user performs a certain hand signal, an image indicating that the user frowns / laughs, and the like). In various embodiments, the wireless communication device may be configured to process received selection inputs using image processing, face recognition, natural language processing, and / or other speech analysis. The wireless communication device may be configured to receive received selection inputs (e.g., uttered words, on-screen gestures, etc.) to determine whether the selection input indicates that the second input is associated with a second (or first) ) With stored libraries or known patterns, words, images, and symbols.

In an embodiment, the wireless communication device may be configured to receive certain selection inputs, such as special voice commands or on-screen gestures, that disable changes in control. In other words, while the first application is in foreground notifying the wireless communication device (and the arbiter) that the current focus and associated inputs should not be blocked whatever happens in advance, Or a physical gesture (e.g., a hand signal, a swipe, etc.). For example, during the execution of the first application video call in the foreground, the wireless communication may include a voice command indicating that the focus should not change until the video call is complete (e.g., "continue calling until I do! ").

If the selection input indicating that the second input is associated with the first application is not received (i.e., decision block 1054 = "NO"), then at block 960 the wireless communication device transmits the second input to the second It can also be associated with an application. However, if a selection input indicating that a second input is associated with the first application is received (i.e., decision block 1054 = "YES"), then at block 958, 1 application.

11A shows a first user interface 1102 for a first application, a second user interface 1106 for a second application reaching foreground, and a second user interface 1106 for showing focus on the second user interface 1106 Illustrates a display 904 of a wireless communication device that renders a cursor element 908. Unlike the example illustrated above in FIG. 9A, the textual input at the two interfaces 1102 and 1106 is not separated in the middle of a word or phrase. Instead, based on the meaning or content of the text, the first input text "Hold on ..." may be used to temporarily store the user interacting with the first user interface 1102 (e.g., the first video calling application) The second input text "Are you there?" May indicate that the user intends to begin interacting with the second user interface 1106 (e.g., the second video calling application). However, if the time between receiving the first input text and the second input text is shorter than a predefined threshold (e.g., if the user quickly toggles between windows when text- ), Or the like), the wireless communication device may not be able to reasonably associate the second input text with the second user interface 1106. The method 1150 of the embodiment described below illustrates additional evaluations that a wireless communication device may perform to properly associate received inputs when a change in foreground control occurs.

11B illustrates an embodiment of a method 1150 for a wireless communication device to associate received user inputs with a first or second application based on evaluations of the content of the received user input. Except in that method 1150 may include operations for clarifying user inputs by evaluating the meaning and / or context of received user inputs in connection with a change in focus control or foreground control, 1150 < / RTI > is similar to the methods 950 and 1050 described above. For example, when textual user inputs can not be explicitly associated with a first or second application based solely on their reception time (i.e., when textual user inputs are typed into a wireless communication device) And evaluate the meaning of the textual user inputs to determine whether the inputs include contextual cues for associating them with various applications. As another example, the wireless communication device may determine the time of the launch of the second application so that it actually pops up (i. E., Control of the foreground or focal point) to determine whether the user's intended inputs should be associated with the second application ). ≪ / RTI > In various embodiments, the method 1150 may be performed by a wireless communication device as part of the methods described above with reference to Figures 5-6. For example, the wireless communication device may perform method 1150 after performing operations in block 160 of FIG. 5 or block 180 of FIG. 6 via an arbiter.

At block 952, the wireless communication device may detect a change in control of the foreground from the first application to the second application. At block 953, the wireless communication device may identify a first input occurring prior to the change in control and a second input occurring after the change in control. At decision block 954, the wireless communication device may determine whether the first input has been received within the first time threshold of change in control. If the first input is received outside the first time threshold of the change in control (i.e., decision block 954 = "NO"), then at block 960 the wireless communication device transmits the second input to the second It can also be associated with an application. If the first input is received within the first time threshold of change in control (i.e., decision block 954 = "YES"), then at decision block 956, the wireless communication device determines that the second input is in control Lt; RTI ID = 0.0 > of the < / RTI > If the second input is received outside the second time threshold (i.e., decision block 956 = "no"), then at block 960, the wireless communication device may associate the second input with the second application .

However, if the second input is received within the second time threshold (i.e., decision block 956 = "YES"), then at block 1152, the wireless communication device may evaluate the contents of the first and second inputs . The content to be evaluated may include the grammar, spelling, punctuation, format, context, and decoded meaning of the first and second inputs. The wireless communication device may perform natural language processing, speech recognition, and / or pattern matching routines to decode the contents of the inputs and determine whether the first and second inputs are concatenated. For example, the wireless communication device may evaluate inputs to determine that the second input (e.g., "rld") is a continuation of the first input (eg, "Hello Wo"). As another example, a wireless communication device may be configured such that the first input is a spoken input that represents a final or conclusional statement or word (e.g., "hold on ") and the second input is a separate communication , are you there? "). < / RTI > Based on the evaluations, the wireless communication device may decipher whether the first and second inputs are meaningful together, or otherwise, appropriate for use with the first application.

In various embodiments, the content of the inputs (e.g., the grammar, grammar, punctuation, formatting, spelling, formatting, and context or decoded meaning of the inputs) is such that the first and / May be evaluated by the wireless communication device to determine whether it is associated with the second application. The wireless communication may be based on whether the partial words and phrases and / or inputs include application-specific content or formatting (e.g., whether the second input is a name of a second application or a contact that is only associated with a second application And the like). For example, the wireless communication device may determine when the second input names a business partner whose name is stored for use with a second application (e.g., a business email client) rather than a first application (e.g., a script editor application) . As another example, a wireless communication device may be capable of receiving a second input from a slang word (e.g., "lol") or other informal abbreviations that may be used by a user in an SMS messaging application, Absence of capital letters at the beginning of the document), and so on.

In an embodiment, the wireless communication device may further decrypt the content of the second input in relation to the format or expected type of data to be utilized in the second application. For example, the wireless communication may be based on whether a second input (e.g., "hello") of the spoken word is appropriate or correct for the input element for the second application (e.g., hello "has meaning?). As another example, if the second input is a name of the city (e.g., San Diego), the wireless communication device may determine that the second input is appropriate for the text box that has focus in the second application.

At block 1154, the wireless communication device determines, for example, the elapsed time between the launch time of the second application and the change in control so that the initiation of the launch of the second application and the change in control (or focus Quot;) < / RTI > The wireless communication device may decode the order of initiation of the second application, the reception of the first and / or second inputs, and the change in control. For example, the wireless communication device may evaluate the launch time of the browser app when the browser has actually popped up to decipher whether the typed text was received and whether the typed text was intended for the browser have. In an embodiment, the wireless communication device is less likely to have the second input associated with the second application, as the time between when the second application is launched and when the second application takes control of the foreground You can decide. In other words, when the second application takes a long time to load from the start time (e.g., the time when the user clicks the executable), the user performs multi-tasking while waiting for the second application , The wireless communication device may receive inputs associated with the first application. For example, a user typing quickly into a first application (e.g., a notepad) may launch a second application (e.g., a browser app) while typing, and may launch a second application to fully load and control the foreground And continue typing by the second application while waiting. As another example, if the second application is launched before a few minutes (e.g., 10 minutes, etc.), the wireless communication device may evaluate the second input text as likely to be associated with the first application. However, if the second application is launched just a few seconds ago, the wireless communication device may evaluate the second input text as likely to be associated with the second application.

In various embodiments, the wireless communication device may evaluate the recentness and / or order of the user's actions to launch the second application. In particular, the wireless communication device may be configured to receive received user inputs on a soft keyboard or buttons, whether the user has actively initiated the launch of the second application (e.g., whether it was the result of automatic-scheduling or user input) (E.g., button presses) corresponding to the new screen on the second application, the time between the launching time of the second application, and the time between the start of the second application The time between the last entry in the previous screen of the first application and a subsequent button press may be evaluated. As a non-limiting example, there may be detected user input to launch a second application, history information indicating that it typically takes a considerable amount of time to obtain control of the foreground after the second application is launched, Based on the ultimate change of control to the second application, receiving the detected user input, typed text inputs (e. G., Telephone number) to launch the phone application May determine that the button presses are all fully tight, or may conclude that the user is likely to intend to initiate a call with the first application.

In an embodiment, the wireless communication device may also evaluate stored history information (e.g., heuristics), such as data describing average launch or load times for various applications residing on the wireless communication device computer platform . Based on the evaluation of previous experiences, the wireless communication device may determine the probability that the user may roughly know when the second application will pop up, and therefore time its input accordingly. For example, the wireless communication device may be configured to determine whether the current input from the initiator to control the foreground for the web browser application to determine whether the user may have expected the second input text data to be associated with the web browser application The time may be compared to the average load times of the history for the web browser application.

At decision block 1156, the wireless communication device may use the conclusions from the evaluations described above with reference to operations at blocks 1152-1154, for example, to perform evaluations (e.g., assessed content and / The start time of the foreground), the user may decide whether to change the focus of the foreground. In other words, the wireless communication device may utilize the decryption of inputs and / or the launch time of the second application to deduce whether the user intended to provide the second input to the second application. The wireless communication device may use various rule sets, balancing systems, weighting schemes, and decision equations to make decisions. For example, a first and a second input indicating that the first input (e.g., typed text of "hold on ...") is not related to a second input (e.g., typed text of "are you there? Based on the evaluation of the language analysis of the second inputs, the wireless communication device may determine that the user intended to switch focus. As another example, when the wireless communication device is unable to explicitly determine the intended meaning of the language of the first and second inputs (e.g., when the received inputs are apparently random characters, spelling errors, , Etc.), the wireless communication device may further emphasize the evaluation of the time between launching the second application and the time at which control of the foreground is obtained.

Based on the evaluations, if it is not determined that the user intended to switch input windows (i.e., decision block 1156 = "NO"), then at block 960, It can also be associated with an application. However, based on the evaluations, if it is determined that the user intended to switch input windows (i.e., decision block 1156 = "YES"), then at block 958, It can also be associated with an application.

(I. E., Decision blocks 954 to 956 and operations in block 1154) to determine the application to which the second input is to be associated, in various embodiments, Or instead of these evaluations, the contents of the first and second inputs. For example, the wireless communication device may be configured to determine whether a second input is associated with a first application, regardless of the time between receiving the first and second inputs, Grammar and / or word meaning. As another example, the wireless communication device may use an evaluation of the time between changes in launch and control as one of a plurality of factors in identifying an application associated with a second input. As another example, even if it is determined that the first input is not within the first time threshold, and / or the second input is determined not to be within the second time threshold, The first and second inputs may be configured to evaluate the content of the first and second inputs.

Figure 12 illustrates a method 1200 of an embodiment for associating a received user input with a first or second application based on locations of user interface elements of first and second applications. Applications may use standard layouts for user interface elements (e.g., soft buttons, etc.). For example, the first application may have a 'search' button in the upper right portion of the first user interface window and the second application may have a 'delete' button in the upper right portion of the second user interface window. Unintended actions may be performed when the focus is unexpectedly switched while the user is interacting with these user interface elements. For example, just before the user presses the " search " button on the first application, the second application may pop-up a window to control the foreground, You can also accidentally press the 'Delete' button located at the same location. The method 1200 includes operations for the wireless communication device to determine the user's intent when the user elements of the first and second applications are co-located co-located to avoid unintended UI operations in the second application You may. In various embodiments, the method 1200 may be performed by a wireless communication device as part of the methods described above with reference to Figures 5-6. For example, the wireless communication device may perform the method 1200 after performing operations in block 160 of FIG. 5 or block 180 of FIG. 6 via an arbiter.

At block 952, the wireless communication device may detect a change in control of the foreground window from the first application to the second application. At block 1202, the wireless communication device may identify a second input that occurs after the change in control, such as a touch input on the user interface. In optional block 1203, the wireless communication device may identify a first input occurring prior to a change in control. The operations at blocks 1202 through 1203 may be similar to those described above with reference to block 953, however, the user may select a single input (i.e., a second input) that needs to be associated by the wireless communication device, The operations for identifying the first input may be arbitrary.

In an optional decision block 954, the wireless communication device may determine whether the first input has been received within the first time threshold of change in control. If the first input is received outside the first time threshold of change in control (i.e., optional decision block 954 = "NO"), then at block 960, And may be associated with a second application. If the first input is received within the first time threshold of change in control (i.e., optional decision block 954 = "YES"), then the wireless communication device, at decision block 956, Lt; RTI ID = 0.0 > of the change in < / RTI > For example, the wireless communication device may determine whether a user interface element press has been detected in any number of milliseconds, seconds, etc. from a change of control to a second application. As another example, the wireless communication device may compare the time (or timestamp) of the deleted UI button event to the time that the second application obtained control of the foreground. If the second input is a second time threshold (I.e., decision block 956 = "NO"), the wireless communication device may associate the second input with the second application, at block 960. For example, Since the event was detected in seconds after the second application obtained control of the foreground, the wireless communication device may determine that the push was intended for the second application.

However, at block 1204, the wireless communication device receives a second input (e.g., a detected UI touch input) when the second input is received within a second time threshold (i.e., decision block 956 = (UI) element of the second application that matches the user interface (UI) element of the second application. For example, the wireless communication device may associate screen coordinates associated with a second input (e.g., a detected UI input having certain x-axis and y-axis coordinates) with the corresponding screen coordinates associated with the various UI elements rendered for the second application And may be compared with areas of the display. In other words, the wireless communication device may identify a soft button, text field, or other rendered element that the user has clicked, pushed, or otherwise engaged in as a second input. In an embodiment, the wireless communication device may evaluate raster information or other graphical data to identify the UI element.

At decision block 1206, the wireless communication device may determine whether the identified UI element of the second application matches the UI element of the first application. For example, the wireless communication device may compare the screen coordinates of the identified UI element with all UI elements that were not previously in foreground with the first application. The wireless communication device may determine that any similarly arranged UI elements of the first application (i.e., the identified second application UI element may not need to be positioned exactly above the first application UI element to match) You can also use a threshold to do this. If the identified UI element does not match the UI element of the first application (i.e., decision block 1206 = "NO"), the wireless communication device associates the second input with the second application at block 960 It is possible. In other words, since the second input (e.g., the UI touch input) was received within a certain time for the second application to gain control of the foreground, but because there were no similarly deployed UI elements for the first application, It may be inferred that the user may have intended to interact with the second application.

However, if the identified UI element matches the UI element of the first application (i.e., decision block 1206 = "YES"), then at block 958, the wireless communication device associates the second input with the first application . In other words, since the second input (e.g., UI touch input) is received within a certain time when the second application obtains control of the foreground and the first and second applications have similarly positioned UI elements, The device may infer that the user may have intended to interact with the first application. In various embodiments, the wireless communication device may use various other factors, such as the time from the launch of the second application, to determine whether a second input is intended for the second or first application.

As described above, in various embodiments, while the main application controls the foreground (or display), multiple applications run concurrently on the processor of the wireless communication device as background processes (or interrupted applications) There may be. For example, because the first application controls the foreground, the second application may be suspended (or configured to run in an aborted mode) in the background of the wireless communication device. The aborted applications may not be activities (e.g., do not control the foreground), but any interrupted application may be an activity, for example, in response to receiving a flag from the arbiter as described above, It may reach the ground. For example, in response to receiving a notification event corresponding to a received SMS message from the operating system, the arbiter (or arbiter app) may notify the first application to control the foreground (i.e., 1 application is instructed to be an activity in the foreground), the second application may be inhibited from reaching the foreground (i.e., the second application is commanded to be non-activity in the background).

However, non-activity applications may still try to reach the foreground, regardless of the actions of the arbiter. For example, a second application that has not received a flag from an arbiter that allows the second application to reach the foreground may still perform operations to obtain control of the foreground. These non-compliant (or "bad") applications may attempt to disregard arbiter prioritization based on data or preferences available by applications, rather than arbiters. For example, a non-compliant application may store local, hidden, or unregistered configuration information indicating that the application typically obtains control of the foreground at random times of the day. In such a case, the wireless communication device may terminate non-compliant applications. In various embodiments, such terminations may be part of the operating system of the wireless communication device, or alternatively, through an arbiter, which may have administrative privileges that may enable the arbiter to directly control other applications , A wireless communication device.

13 illustrates an embodiment method 1300 for terminating a non-compliant application in which the wireless communication device has obtained control of the foreground of the wireless communication device as opposed to prioritization by the arbiter. In other words, after performing the intervention operations in response to receiving the notification event, the wireless communication device may shut down, interrupt, or otherwise disable any application that subsequently performs operations not following the intervention It may be terminated. For example, after the wireless communication device has authorized the first application to control the foreground (via the arbiter) and process the received user input (e.g., "Hello Wo"), the second application may arrive at the foreground The wireless communication device may terminate the second application and apply any later received user input (e.g., "rld") to the first application. In various embodiments, the method 1300 may be performed by a wireless communication device as part of the methods described above with reference to Figures 5-6. For example, the wireless communication device may perform method 1300 after performing operations in block 160 of FIG. 5 or block 180 of FIG. 6 via an arbiter.

At decision block 1302, the wireless communication device may determine whether the non-compliant application was operating to control the foreground, for example, by reaching foreground without receiving a priority flag from the arbiter. In an embodiment, the wireless communication device may make this determination by periodically comparing the identity of the application currently controlling the foreground with the identity of the priority application determined through arbitration operations, as described above. In another embodiment, the wireless communication device is configured to detect a change in control or other status change, or in response to receiving an unexpected event notification (e. G., A signal indicative of a shift in focus, etc.) This determination may be made by comparing the identity of the application that currently controls the identity of the priority application determined through arbitration. If the non-compliant application is not determined to be operating to control the foreground (i.e., decision block 1302 = "NO"), the wireless communication device monitors operations for other event notifications and processes other event notifications You can continue.

However, if the non-compliant application is determined to operate to control the foreground (i.e., decision block 1302 = "YES"), then at block 1304 the wireless communication device sends a termination signal or an abort message, for example, (Or shut down) the non-compliant application. In an embodiment, the wireless communication device may terminate the non-compliant application through the arbiter and not only shut it down, but also prevent the non-compliant application from running again. For example, during a period (e.g., millisecond, seconds, etc.) after the termination of the non-compliant application, the wireless communication device may monitor, via the arbiter, for further attempts by the non-compliant application to launch and / Or it may repeat the operations in block 1304. In optional block 1306, the wireless communication device may retransmit the flag to a priority application, such as a priority application determined via the operations described above with reference to FIG. 5 or FIG.

The non-compliant application may be configured to reject the intercept messages sent by the wireless communication device, for example, via the arbiter. For example, based on information that is not available by the arbiter app, the non-compliant application may ignore the received abort message or termination signal to maintain control of the foreground. This may occur when the wireless communication device has not upgraded the software (e.g., legacy routines, apps, or software).

14 is a system block diagram of a smartphone wireless communication device 1400 suitable for use with various embodiments. The smartphone wireless communication device 1400 may include a processor 1401 coupled to an internal memory 1402 and a speaker 1454. Internal memory 1402 may be a volatile or non-volatile memory, and may also be a secure and / or encrypted memory, or a non-secure and / or non-encrypted memory, or any combination thereof. The processor 1401 may also include a first display 1403 such as a resistive-sensing touch screen, a capacitive-sensing touch screen, an infrared sensing touch screen, ). ≪ / RTI > In an embodiment, the first display 1403 of the smartphone wireless communication device 1400 need not have a touch screen function. In an embodiment, the smartphone wireless communication device 1400 may also include a second display 1460 coupled to the processor 1401, such as another touch screen or LED screen. In various embodiments, the second display 1460 can be configured to be hidden or closed for non-activity when, for example, a smartphone wireless communication device is configured to use a hinge mechanism and be closed, such as a "clamshell & . Alternatively, the second display 1460 may be a display unit that is attached to or housed in the case or housing of the smartphone wireless communication device 1400. For example, the second display 1460 may be a second screen on the rear of the housing of the wireless communication device 1400. [ In other embodiments, the second display 1460 may be tethered to the smartphone wireless communication device 1400 via wired or wireless connections (not shown).

The smartphone wireless communication device 1400 may include one or more radio signal transceivers 1405 (e.g., one or more of a plurality of radio communication devices) for transmitting and receiving electromagnetic radiation (or radio signals), such as for communicating over a WiFi local area network or a wide area network (E.g., Peanut, Bluetooth, Zigbee, WiFi, RF radio, etc.) and antennas 1404. Transceivers 1118 and antennas 1108 may be coupled to processor 1401 and may be used with the aforementioned circuitry to implement various wireless transmission protocol stacks / . In an embodiment, the smartphone wireless communication device 1400 may include a cellular network wireless modem chip 1415 that enables communication over a cellular network. The smartphone wireless communication device 1400 also typically includes menu select buttons or rocker switches 1408 for receiving user inputs. Additionally, the smartphone wireless communication device 1400 may include various sensors coupled to the processor 1401, such as a thermistor 1462, an accelerometer 1410, a gyroscope 1411, a microphone 1412, . Additionally, the smartphone wireless communication device 1400 may include a GPS receiver chip 1414 coupled to the processor 1401.

Processors 84 and 1401 may be any programmable microprocessor, microprocessor, or microprocessor, which may be configured by software instructions (applications) to perform various functions including the functions of the various embodiments described above It may be a multiprocessor chip or chips. In various devices, multiple processors may be provided, such as one processor dedicated to executing wireless communications functions and one processor dedicated to executing other applications. Typically, software applications may be stored in internal memory 88 and 1402 before they are accessed and loaded into processors 84 and 1401. Processors 84 and 1401 may include sufficient internal memory to store application software instructions. In many devices, the internal memory may be a volatile or non-volatile memory such as a flash memory, or a mixture of both. For purposes of this description, a generic reference to memory may include processors 84 and < RTI ID = 0.0 > 1401, < / RTI > including memories in processors 84 and 1401 and removable memory plugged into internal memory, 1401. < / RTI >

The above method descriptions and process flow diagrams are provided by way of illustrative example only and are not intended to be required or to imply that the steps of various embodiments should be performed in the order presented. As may be recognized by those skilled in the art, the order of the steps in the above embodiments may be performed in any order. The words "after "," next ", "next" and the like are not intended to limit the order of the steps; These words are simply used to guide the reader through a description of methods. In addition, any reference to a claim element, for example, that uses the articles "a", "an", or "the", should not be construed as limiting the element in a singular manner.

The various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, processor-executable instructions, computer software, or combinations of both . In order to clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented in hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in various ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

The hardware utilized to implement the various illustrative logic, logical blocks, modules, and circuits described in connection with the embodiments disclosed herein may be implemented or performed with a general purpose processor, a digital signal processor (DSP) An application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or perform the functions described herein Or may be implemented in any combination thereof. A general purpose processor may be a microprocessor, but, in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such combination of configurations. Alternatively, some of the steps or methods may be performed by circuitry specific to a given function.

Considering that the methods are executable on mobile communication devices and other computer platforms, the methods may thus also be performed by a program resident on a non-transitory computer readable medium (or non-transient processor-readable storage medium) Where the program instructs a mobile device or other computer device having a computer platform to perform the steps of the methods. The non-transient computer readable medium may be the memory of the server or may be in a connection database. In addition, non-transitory computer readable media can also be stored on a wireless communication device computer platform, such as a magnetic disk or tape, an optical disk, a hard disk, a flash memory, or other storage media as known in the art, Lt; / RTI > media.

In one or more exemplary embodiments, the functions described may be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, the functions may be performed on one or more instructions (e.g., processor-executable instructions or processor-executable software instructions) on a non-temporal computer-readable medium ) Or as a code. The term "computer-readable media ", which facilitates the transfer of a computer program from one place to another, is intended to encompass all types of computer- Computer storage media including any medium that facilitates transmission. The storage media may be any available media that may be accessed by a computer. By way of example, and not limitation, such non-transitory computer-readable media can be stored in RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage, or other magnetic storage devices, And may include any other medium that may be used to carry or store the desired program code and may be accessed by a computer. As used herein, discs and discs may be referred to as compact discs (CD), laser discs, optical discs, digital versatile discs (DVDs) Includes a floppy disk and a blu-ray disc, where disks typically reproduce data magnetically, while discs optically reproduce data with lasers do. Combinations of the above should also be included within the scope of non-temporary computer-readable media.

While the invention has been particularly shown and described with reference to the preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention as set forth in the following claims And may be understood by those skilled in the art. Accordingly, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the following claims and the principles and novel features disclosed herein. Also, elements of the invention may be described or claimed in the singular, but the plural is contemplated unless limitation to the singular is explicitly stated.

Claims (80)

A method of assigning control of each of a plurality of displays to an application in a plurality of applications resident on a wireless communication device,
In response to receiving a first notification event that simultaneously invokes more than one application via an arbiter, the first one of the plurality of applications controlling one of the plurality of displays based on predetermined criteria Determining an application;
Determining, via the arbiter, whether an activity associated with a second application of the plurality of applications is detected, in response to the first application determining that the one of the plurality of displays is to be controlled;
Ordering, in response to detecting the activity associated with the second application, a list of executable displays of the plurality of displays in order of priority for the second application;
Selecting a display from the ordered list of executable displays of the plurality of displays;
Determining whether the selected display is being used by a third application; And
In response to determining that the selected display is not being used by the third application, transmitting to the second application a flag that assigns control of the foreground of the selected display to the second application. Of each of the displays of the plurality of applications. The method according to claim 1,
Assigning the control of the foreground of the selected display in response to determining that the selected display is being used by the third application and the priority of the third application is lower than the priority of the second application And transmitting the flag to the second application, wherein the control of each of the plurality of displays is assigned to an application in a plurality of applications. The method according to claim 1,
Wherein the activity includes a second notification event, a predefined event displayed in the registration information associated with the second application, an encountered exception, a change of priority of one of the plurality of applications, a registration of a new application to the arbiter, A change in an operating status of one of a plurality of applications, a loss of control of a display foreground by an application of the plurality of applications, and an activity state of one of the plurality of displays Wherein the control of each of the plurality of displays is at least one of the changes in the plurality of displays. The method according to claim 1,
In response to determining that the selected display is being used by the third one of the plurality of applications and that the priority of the third application is higher than the priority of the second application, Further comprising the step of adding to the queue for display a control of each of the plurality of displays to an application in a plurality of applications. The method according to claim 1,
In response to one of a request for boot-up of the computer platform of the wireless communication device, activation of each of the plurality of applications, and registration, each of the plurality of applications is registered with the arbiter Wherein the step of registering each of the plurality of applications with the arbiter includes storing registration information for each of the plurality of applications, Lt; / RTI > 6. The method of claim 5,
Wherein the registration information for a respective one of the plurality of applications includes at least one of identification information, priority, network requirements, an indication of whether the individual application may be dynamically reordered, Of the plurality of displays, including at least one of an indication of whether the respective application is available on a secondary display of the plurality of applications and an indication of whether the respective application is a background-enabled type. How to. The method according to claim 6,
Further comprising recalculating priorities for each of the plurality of applications registered for dynamic prioritization, wherein each control of the plurality of displays is assigned to an application in a plurality of applications. The method according to claim 1,
Storing status information for each of the plurality of displays, the status information including at least operating conditions, operational requirements, and display priorities;
Polling the sensors for information indicative of current conditions of the wireless communication device;
Evaluating the feasibility of each of the plurality of displays based on the stored status information and the information indicating the current conditions of the wireless communication device;
Evaluating user interaction with each of the plurality of displays based on the information indicating the current conditions of the wireless communication device; And
Further comprising recalculating the priorities of each of the plurality of displays based on at least one of the evaluated feasibility and the evaluated user interaction of each of the plurality of displays To the application of the plurality of applications. 9. The method of claim 8,
The current conditions of the wireless communication device include ambient temperature based on thermistor sensor data, ambient brightness based on camera data, device altitude based on GPS data, device movement based on gyroscope sensor data, device inclination based on gyroscope sensor data The user inputs on the touch screen, and the identity of the user based on the camera data or microphone data. ≪ Desc / Clms Page number 24 > 9. The method of claim 8,
Wherein the user interaction includes: the user viewing the display based on eye tracking; the user viewing the display based on head tracking; and the user viewing the display Wherein each control of the plurality of displays is indicative of at least one of the plurality of displays. 9. The method of claim 8,
Wherein the step of recalculating the priorities of each of the plurality of displays based on at least one of the evaluated feasibility of each of the plurality of displays and the evaluated user interaction further comprises: Calculating a priority of each of the plurality of displays based on at least one of the estimated performance and the estimated user interaction, A method for assigning control to an application in a plurality of applications. A method of associating user input data with a plurality of applications resident on a wireless communication device in accordance with user intent,
Determine a first one of the plurality of applications that controls the display of the wireless communication device based on predetermined criteria, in response to receiving, via the arbiter, a notification event that simultaneously invokes more than one application ;
In response to determining, by the intermediary, that the first application is to control the display, control of the display from the first application in the plurality of applications to the second application in the plurality of applications Detecting a change in the content;
Identifying a first input received prior to the detected change in the control of the display and a second input received after the detected change in the control of the display;
Determining whether the first input has been received within a first time threshold of the detected change in the control of the display;
Determining whether the second input has been received within a second time threshold of the detected change in the control of the display; And
Associating the second input with the second application in response to determining that the first input has not been received within the first time threshold or that the second input has not been received within the second time threshold, Wherein the user input data is associated with a plurality of applications. 13. The method of claim 12,
The first input and the second input are both methods of associating user input data with a plurality of applications according to user intent, which is one of touch inputs, text inputs, voiced inputs, or visual inputs . 13. The method of claim 12,
Further comprising associating the second input with the first application in response to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold And associating user input data with a plurality of applications according to user intent. 13. The method of claim 12,
Responsive to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold, sending the second input to one of the first application and the second application Rendering a prompt requesting a user-selected input to associate;
Receiving the user selection input via a user interface; And
Further comprising associating the second input with one of the first application and the second application based on the received user selected input, wherein the user input data is associated with a plurality of applications . 16. The method of claim 15,
The first input is a verbal input;
The prompt is a second sound; And
The method further comprising rendering a first sound prior to detecting the change in the control of the display, wherein the user input data is associated with a plurality of applications. 13. The method of claim 12,
Evaluating the contents of the first input and the second input in response to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold;
Responsive to determining that said first input has been received within said first time threshold and said second input has been received within said second time threshold, Evaluating the start time; And
Further comprising associating the second input with the first application or the second application based on at least one of the evaluated content and the evaluated start time, ≪ / RTI > 18. The method of claim 17,
Wherein the content is at least one of grammar, spelling, punctuation, format, context, and decoded meaning, wherein the user input data is associated with a plurality of applications. 13. The method of claim 12,
Wherein the second input is a touch input,
Responsive to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold, the second user interface element of the second application corresponding to the second input ;
Determining whether the identified second user interface element of the second application matches a first user interface element of the first application; And
Further comprising associating the second input with the first application in response to determining that the identified second user interface element matches the first user interface element, To a plurality of applications. A method for controlling a plurality of applications resident on a wireless communication device,
Determine a first one of the plurality of applications that controls the display of the wireless communication device based on predetermined criteria, in response to receiving, via the arbiter, a notification event that simultaneously invokes more than one application ;
Determining whether a second one of the plurality of applications has not followed the determination through the arbiter that the first one of the plurality of applications controls the display; And
And terminating the second application in response to determining that the second one of the plurality of applications does not comply with the first application. A wireless communication device,
In response to receiving a first notification event that simultaneously invokes more than one application through the arbiter, a first application of a plurality of applications controlling one of the plurality of displays based on predetermined criteria Means for determining;
Means for determining, via the arbiter, whether an activity associated with a second application of the plurality of applications is detected in response to the determining that the first application controls the one of the plurality of displays ;
Means for ordering, in response to detecting the activity associated with the second application, a list of executable displays of the plurality of displays in order of priority for the second application;
Means for selecting a display from the ordered list of executable displays of the plurality of displays;
Means for determining whether the selected display is being used by a third application; And
Means for sending a flag to the second application to assign control of the foreground of the selected display in response to determining that the selected display is not being used by the third application. . 22. The method of claim 21,
Assigning the control of the foreground of the selected display in response to determining that the selected display is being used by the third application and the priority of the third application is lower than the priority of the second application And means for sending the flag to the second application. 22. The method of claim 21,
Wherein the activity includes a second notification event, a predefined event displayed in the registration information associated with the second application, an encountered exception, a change of priority of one of the plurality of applications, a registration of a new application to the arbiter, A change in the operational status of one of the plurality of applications, a loss of control of the display foreground by one of the plurality of applications, and a change in the activity status of one of the plurality of displays Lt; / RTI > wireless communication device. 22. The method of claim 21,
In response to determining that the selected display is being used by the third one of the plurality of applications and that the priority of the third application is higher than the priority of the second application, Further comprising means for adding to a wait queue for display. 22. The method of claim 21,
Further comprising means for registering each of the plurality of applications with the arbiter in response to one of a request to boot up a computer platform of the wireless communication device, activation of each of the plurality of applications, and registration. Including,
Wherein the means for registering each of the plurality of applications with the arbiter comprises storing registration information for each of the plurality of applications. 26. The method of claim 25,
Wherein the registration information for the respective one of the plurality of applications includes at least one of identification information, priority, network requirements, an indication of whether the individual application may be dynamically reordered, An indication of whether or not the individual application is available on the secondary display in the background, and an indication of whether the individual application is background-enabled. 27. The method of claim 26,
Further comprising means for recalculating priorities for each of the plurality of applications registered for dynamic prioritization. 22. The method of claim 21,
Means for storing status information for each of the plurality of displays, the status information including at least operating conditions, operational requirements, and display priorities; means for storing the status information;
Means for polling sensors for information indicative of current conditions of the wireless communication device;
Means for evaluating the feasibility of each of the plurality of displays based on the stored status information and the information indicative of the current conditions of the wireless communication device;
Means for evaluating user interaction with each of the plurality of displays based on the information indicating the current conditions of the wireless communication device; And
And means for recalculating the priorities of each of the plurality of displays based on at least one of the evaluated feasibility of each of the plurality of displays and the evaluated user interaction. 29. The method of claim 28,
The current conditions of the wireless communication device include ambient temperature based on thermistor sensor data, ambient brightness based on camera data, device altitude based on GPS data, device movement based on gyroscope sensor data, device inclination based on gyroscope sensor data The user inputs on the touch screen, and the identity of the user based on the camera data or microphone data. 29. The method of claim 28,
Wherein the user interaction is indicative of at least one of: the user viewing the display based on eye tracking; the user viewing the display based on head tracking; and the user indicating at least one of being touched by the display , ≪ / RTI > 29. The method of claim 28,
Wherein the means for recalculating the priorities of each of the plurality of displays based on at least one of the evaluated feasibility of each of the plurality of displays and the evaluated user interaction further comprises: And means for recalculating, for each of the plurality of applications, the priority of each of the plurality of displays based on at least one of the evaluated feasibility and the evaluated user interaction. A wireless communication device,
Determining a first one of a plurality of applications that controls the display of the wireless communication device based on predetermined criteria, in response to receiving, via the arbiter, a notification event that simultaneously invokes more than one application Means for;
In response to determining, by the intermediary, that the first application is to control the display, control of the display from the first application in the plurality of applications to the second application in the plurality of applications Means for detecting a change in the position of the object;
Means for identifying a first input received prior to the detected change in the control of the display and a second input received after the detected change in the control of the display;
Means for determining whether the first input has been received within a first time threshold of the detected change in the control of the display;
Means for determining whether the second input has been received within a second time threshold of the detected change in the control of the display; And
Means for associating the second input with the second application in response to determining that the first input has not been received within the first time threshold or that the second input has not been received within the second time threshold, The wireless communication device. 33. The method of claim 32,
Wherein the first input and the second input are both one of touch inputs, text inputs, voiced inputs, or visual inputs. 33. The method of claim 32,
Further comprising means for associating the second input with the first application in response to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold Lt; / RTI > 33. The method of claim 32,
Responsive to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold, sending the second input to one of the first application and the second application Means for rendering a prompt requesting a user-selected input to associate;
Means for receiving the user selection input via a user interface; And
And means for associating the second input with one of the first application and the second application based on the received user selected input. 36. The method of claim 35,
Wherein the first input is a speech input;
The prompt is a second sound; And
Wherein the wireless communication device further comprises means for rendering a first sound before detecting the change in the control of the display. 33. The method of claim 32,
Means for evaluating the contents of the first input and the second input in response to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold;
Responsive to determining that said first input has been received within said first time threshold and said second input has been received within said second time threshold, Means for evaluating start time; And
And means for associating the second input with the first application or the second application based on at least one of the evaluated content and the evaluated start time. 39. The method of claim 37,
Wherein the content is at least one of grammar, spelling, punctuation, format, context, and decoded meaning. 33. The method of claim 32,
Wherein the second input is a touch input,
Responsive to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold, the second user interface element of the second application corresponding to the second input Means for identifying a user;
Means for determining whether the identified second user interface element of the second application matches a first user interface element of the first application; And
And means for associating the second input with the first application in response to determining that the identified second user interface element matches the first user interface element. A wireless communication device,
Determining a first one of a plurality of applications that controls the display of the wireless communication device based on predetermined criteria, in response to receiving, via the arbiter, a notification event that simultaneously invokes more than one application Means for;
Means for determining whether a second one of the plurality of applications has not followed the determination through the arbiter that the first one of the plurality of applications controls the display; And
And means for terminating the second application in response to determining that the second one of the plurality of applications does not comply. A wireless communication device,
Memory; And
And a processor coupled to the memory, the processor configured with processor-executable instructions for performing operations, the processor-
In response to receiving a first notification event that simultaneously invokes more than one application through the arbiter, a first application of a plurality of applications controlling one of the plurality of displays based on predetermined criteria To decide;
Determining, via the arbiter, whether an activity associated with a second application of the plurality of applications is detected, in response to the determining that the first application controls the one of the plurality of displays;
Ordering, in response to detecting the activity associated with the second application, a list of executable displays of the plurality of displays in order of priority for the second application;
Selecting a display from the ordered list of executable displays of the plurality of displays;
Determining whether the selected display is being used by a third application; And
Responsive to determining that the selected display is not being used by the third application, sending a flag to the second application to assign control of the foreground of the selected display to the second application. 42. The method of claim 41,
Wherein the processor is responsive to determining that the selected display is being used by the third application and the priority of the third application is lower than the priority of the second application, And sending said flag assigning control to said second application. ≪ Desc / Clms Page number 22 > 42. The method of claim 41,
Wherein the activity includes a second notification event, a predefined event displayed in the registration information associated with the second application, an encountered exception, a change of priority of one of the plurality of applications, a registration of a new application to the arbiter, A change in the operational status of one of the plurality of applications, a loss of control of the display foreground by one of the plurality of applications, and a change in the activity status of one of the plurality of displays Lt; / RTI > wireless communication device. 42. The method of claim 41,
Wherein the processor is responsive to determining that the selected display is being used by the third application of the plurality of applications and that the priority of the third application is higher than the priority of the second application, Further comprising adding an application to a wait queue for the selected display. 42. The method of claim 41,
Wherein the processor registers each of the plurality of applications with the arbiter in response to one of a request to boot up a computer platform of the wireless communication device, activation of each of the plurality of applications, and registration ≪ / RTI > further comprising processor-executable instructions,
Wherein the processor is comprised of processor-executable instructions for causing each of the plurality of applications to register with the arbiter to store registration information for each of the plurality of applications. 46. The method of claim 45,
Wherein the registration information for the respective one of the plurality of applications includes at least one of identification information, priority, network requirements, an indication of whether the individual application may be dynamically reordered, An indication of whether or not the individual application is available on the secondary display in the background, and an indication of whether the individual application is background-enabled. 47. The method of claim 46,
Wherein the processor is further comprised of processor-executable instructions that further comprise recalculating priorities for each of the plurality of applications registered for dynamic prioritization. 42. The method of claim 41,
The processor comprising:
Storing status information for each of the plurality of displays, the status information including at least operating conditions, operational requirements, and display priorities;
Polling the sensors for information indicative of current conditions of the wireless communication device;
Evaluating the feasibility of each of the plurality of displays based on the stored status information and the information indicative of the current conditions of the wireless communication device;
Evaluating user interaction with each of the plurality of displays based on the information indicating the current conditions of the wireless communication device; And
Further comprising recalculating the priorities of each of the plurality of displays based on at least one of the evaluated feasibility of each of the plurality of displays and the evaluated user interaction Lt; / RTI > 49. The method of claim 48,
The current conditions of the wireless communication device include ambient temperature based on thermistor sensor data, ambient brightness based on camera data, device altitude based on GPS data, device movement based on gyroscope sensor data, device inclination based on gyroscope sensor data The user inputs on the touch screen, and the identity of the user based on the camera data or microphone data. 49. The method of claim 48,
Wherein the user interaction is indicative of at least one of: the user viewing the display based on eye tracking; the user viewing the display based on head tracking; and the user indicating at least one of being touched by the display , ≪ / RTI > 49. The method of claim 48,
Wherein the processor is further configured to recalculate the priorities of each of the plurality of displays based on at least one of the evaluated feasibility of each of the plurality of displays and the evaluated user interaction, Calculating the priority of each of the plurality of displays based on at least one of the evaluated availability and the evaluated user interaction for each of the plurality of applications. ≪ / RTI > instructions. A wireless communication device,
Memory; And
And a processor coupled to the memory, the processor configured with processor-executable instructions for performing operations, the processor-
Determining, via the arbiter, a first one of a plurality of applications controlling a display of the wireless communication device based on predetermined criteria, in response to receiving a notification event simultaneously invoking more than one application that;
In response to determining, by the intermediary, that the first application is to control the display, control of the display from the first application in the plurality of applications to the second application in the plurality of applications To detect a change in the content;
Identifying a first input received prior to the detected change in the control of the display and a second input received after the detected change in the control of the display;
Determining whether the first input has been received within a first time threshold of the detected change in the control of the display;
Determining whether the second input has been received within a second time threshold of the detected change in the control of the display; And
The method further comprises associating the second input with the second application in response to determining that the first input has not been received within the first time threshold or that the second input has not been received within the second time threshold Lt; / RTI > 53. The method of claim 52,
Wherein the first input and the second input are both one of touch inputs, text inputs, voiced inputs, or visual inputs. 53. The method of claim 52,
Wherein the processor is further configured to associate the second input with the first application in response to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold ≪ / RTI > further comprising processor-executable instructions. 53. The method of claim 52,
The processor comprising:
Responsive to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold, sending the second input to one of the first application and the second application Rendering a prompt requesting a user-selected input to associate;
Receiving the user selection input via a user interface; And
And associating the second input with one of the first application and the second application based on the received user selected input. 56. The method of claim 55,
Wherein the first input is a speech input;
The prompt is a second sound; And
Wherein the processor is further comprised of processor-executable instructions that further comprise rendering a first sound before detecting the change in the control of the display. 53. The method of claim 52,
The processor comprising:
Evaluating the contents of the first input and the second input in response to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold;
Responsive to determining that said first input has been received within said first time threshold and said second input has been received within said second time threshold, Evaluating the start time; And
Further comprising associating the second input with the first application or the second application based on at least one of the evaluated content and the evaluated start time, . 58. The method of claim 57,
Wherein the content is at least one of grammar, spelling, punctuation, format, context, and decoded meaning. 53. The method of claim 52,
Wherein the second input is a touch input,
Responsive to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold, the second user interface element of the second application corresponding to the second input ≪ / RTI >
Determining whether the identified second user interface element of the second application matches the first user interface element of the first application; And
Further comprising associating the second input with the first application in response to determining that the identified second user interface element matches the first user interface element , ≪ / RTI > A wireless communication device,
Memory; And
A processor coupled to the memory,
The processor is operable, by processor-executable instructions,
Determining, via the arbiter, a first one of a plurality of applications controlling a display of the wireless communication device based on predetermined criteria, in response to receiving a notification event simultaneously invoking more than one application that;
Determining whether a second one of the plurality of applications has not followed the determination through the arbiter that the first one of the plurality of applications controls the display; And
And terminating the second application in response to determining that the second one of the plurality of applications does not comply. 18. A non-transitory processor-readable storage medium having stored thereon processor-executable software instructions,
The processor-executable software instructions cause the processor to:
In response to receiving a first notification event that simultaneously invokes more than one application through the arbiter, a first application of a plurality of applications controlling one of the plurality of displays based on predetermined criteria To decide;
Determining, via the arbiter, whether an activity associated with a second application of the plurality of applications is detected, in response to the determining that the first application controls the one of the plurality of displays;
Ordering, in response to detecting the activity associated with the second application, a list of executable displays of the plurality of displays in order of priority for the second application;
Selecting a display from the ordered list of executable displays of the plurality of displays;
Determining whether the selected display is being used by a third application; And
In response to determining that the selected display is not being used by the third application, sending a flag to the second application to assign control of the foreground of the selected display to the second application Lt; RTI ID = 0.0 > processor-readable < / RTI > 62. The method of claim 61,
Wherein the stored processor-executable software instructions cause the processor to perform the steps of: in response to determining that the selected display is being used by the third application and the priority of the third application is lower than the priority of the second application And sending the flag assigning the control of the foreground of the selected display to the second application. ≪ Desc / Clms Page number 22 > 62. The method of claim 61,
Wherein the activity includes a second notification event, a predefined event displayed in the registration information associated with the second application, an encountered exception, a change of priority of one of the plurality of applications, a registration of a new application to the arbiter, A change in the operational status of one of the plurality of applications, a loss of control of the display foreground by one of the plurality of applications, and a change in the activity status of one of the plurality of displays At least one non-transitory processor-readable storage medium. 62. The method of claim 61,
Wherein the stored processor-executable software instructions cause the processor to cause the processor to perform the steps of: causing the processor to perform the steps of: determining whether the selected display is being used by the third application of the plurality of applications and the priority of the third application is higher than the priority of the second application In response to determining that the second application is a standby queue for the selected display, adding the second application to a wait queue for the selected display. 62. The method of claim 61,
Wherein the stored processor-executable software instructions cause the processor to perform each of the plurality of applications in response to one of a received request for boot-up of a computer platform, activation of each of the plurality of applications, and registration Further comprising registering with the arbiter,
Wherein the stored processor-executable software instructions are configured to cause the processor to perform operations that include registering each of the plurality of applications with the mediator storing registration information for each of the plurality of applications. Lt; RTI ID = 0.0 > processor-readable < / RTI > 66. The method of claim 65,
Wherein the registration information for a respective one of the plurality of applications includes at least one of identification information, priority, network requirements, an indication of whether the individual application may be dynamically reordered, An indication of whether or not the individual application is available on the secondary display, and an indication of whether the individual application is a background-enabled type. 67. The method of claim 66,
Wherein the stored processor-executable software instructions are configured to cause the processor to perform operations that further comprise recalculating priorities for each of the plurality of applications that are registered for dynamic post- Transient processor-readable storage medium. 62. The method of claim 61,
The stored processor-executable software instructions cause the processor to:
Storing status information for each of the plurality of displays, the status information including at least operating conditions, operational requirements, and display priorities;
Polling the sensors for information indicative of current conditions of the wireless communication device;
Evaluating the feasibility of each of the plurality of displays based on the stored status information and the information indicative of the current conditions of the wireless communication device;
Evaluating user interaction with each of the plurality of displays based on the information indicating the current conditions of the wireless communication device; And
Further comprising recalculating the priorities of each of the plurality of displays based on at least one of the evaluated feasibility of each of the plurality of displays and the evaluated user interaction , Non-transitory processor-readable storage medium. 69. The method of claim 68,
The current conditions of the wireless communication device include ambient temperature based on thermistor sensor data, ambient brightness based on camera data, device altitude based on GPS data, device movement based on gyroscope sensor data, device inclination based on gyroscope sensor data User inputs on a touch screen, and a user's identity based on the camera data or microphone data. ≪ Desc / Clms Page number 19 > 69. The method of claim 68,
Wherein the user interaction is indicative of at least one of: the user viewing the display based on eye tracking; the user viewing the display based on head tracking; and the user indicating at least one of being touched by the display , Non-transitory processor-readable storage medium. 69. The method of claim 68,
Wherein the stored processor-executable software instructions cause the processor to determine the priority of each of the plurality of displays based on at least one of the evaluated feasibility of each of the plurality of displays and the evaluated user interaction Recalculating the priority of each of the plurality of displays based on at least one of the evaluated feasibility of each of the plurality of displays and the evaluated user interaction, Calculating a value of the at least one of the at least one of the at least two of the at least two of the at least two of the at least two of the at least two processors. 18. A non-transitory processor-readable storage medium having stored thereon processor-executable software instructions,
The processor-executable software instructions cause the processor to:
Determining a first one of a plurality of applications that controls the display of the wireless communication device based on predetermined criteria in response to receiving, via the arbiter, a notification event that simultaneously invokes more than one application ;
In response to determining, by the intermediary, that the first application is to control the display, control of the display from the first application in the plurality of applications to the second application in the plurality of applications To detect a change in the content;
Identifying a first input received prior to the detected change in the control of the display and a second input received after the detected change in the control of the display;
Determining whether the first input has been received within a first time threshold of the detected change in the control of the display;
Determining whether the second input has been received within a second time threshold of the detected change in the control of the display; And
The method further comprises associating the second input with the second application in response to determining that the first input has not been received within the first time threshold or that the second input has not been received within the second time threshold ≪ / RTI > wherein the processor is configured to perform the following operations. 73. The method of claim 72,
Wherein the first input and the second input are both one of touch inputs, text inputs, voiced inputs, or visual inputs. 73. The method of claim 72,
Wherein the stored processor-executable software instructions cause the processor to determine whether the first input has been received within the first time threshold and that the second input has been received within the second time threshold, Further comprising associating an input with the first application. ≪ Desc / Clms Page number 24 > 73. The method of claim 72,
The stored processor-executable software instructions cause the processor to:
Responsive to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold, sending the second input to one of the first application and the second application Rendering a prompt requesting a user-selected input to associate;
Receiving the user selection input via a user interface; And
Further comprising associating the second input with one of the first application and the second application based on the received user selected input. ≪ Desc / Clms Page number 19 > 78. The method of claim 75,
Wherein the first input is a speech input;
The prompt is a second sound; And
Wherein the stored processor-executable software instructions are configured to cause the processor to perform operations that further comprise rendering a first sound prior to detecting the change in the control of the display. A processor-readable storage medium. 73. The method of claim 72,
The stored processor-executable software instructions cause the processor to:
Evaluating the contents of the first input and the second input in response to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold;
Responsive to determining that said first input has been received within said first time threshold and said second input has been received within said second time threshold, Evaluating the start time; And
Further comprising associating the second input with the first application or the second application based on at least one of the evaluated content and the evaluated start time. Readable storage medium. 78. The method of claim 77,
Wherein the content is at least one of grammar, spelling, punctuation, format, context, and decoded meaning. 73. The method of claim 72,
Wherein the second input is a touch input and the stored processor-executable software instructions cause the processor to:
Responsive to determining that the first input has been received within the first time threshold and the second input has been received within the second time threshold, the second user interface element of the second application corresponding to the second input ≪ / RTI >
Determining whether the identified second user interface element of the second application matches the first user interface element of the first application; And
Further comprising associating the second input with the first application in response to determining that the identified second user interface element matches the first user interface element, - Temporary processor-readable storage medium. 18. A non-transitory processor-readable storage medium having stored thereon processor-executable software instructions,
The processor-executable software instructions cause the processor to:
Determining a first one of a plurality of applications that controls the display of the wireless communication device based on predetermined criteria in response to receiving, via the arbiter, a notification event that simultaneously invokes more than one application ;
Determining whether a second one of the plurality of applications has not followed the determination through the arbiter that the first one of the plurality of applications controls the display; And
In response to determining that the second one of the plurality of applications does not comply, terminating the second application. ≪ Desc / Clms Page number 19 >

Images