EP3019971B1 - Methods and systems for performance monitoring for mobile applications - Google Patents
Methods and systems for performance monitoring for mobile applications Download PDFInfo
- Publication number
- EP3019971B1 EP3019971B1 EP14823138.4A EP14823138A EP3019971B1 EP 3019971 B1 EP3019971 B1 EP 3019971B1 EP 14823138 A EP14823138 A EP 14823138A EP 3019971 B1 EP3019971 B1 EP 3019971B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- mobile application
- performance
- mobile
- application
- progress indicator
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims description 53
- 238000000034 method Methods 0.000 title claims description 20
- 230000000694 effects Effects 0.000 claims description 7
- 238000001514 detection method Methods 0.000 claims 1
- 230000015654 memory Effects 0.000 description 26
- 230000006870 function Effects 0.000 description 15
- 230000004044 response Effects 0.000 description 11
- 238000004891 communication Methods 0.000 description 6
- 238000004519 manufacturing process Methods 0.000 description 6
- 238000012360 testing method Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 238000009434 installation Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000001413 cellular effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 230000004043 responsiveness Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013479 data entry Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000005291 magnetic effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007334 memory performance Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/08—Testing, supervising or monitoring using real traffic
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/505—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0852—Delays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/10—Scheduling measurement reports ; Arrangements for measurement reports
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/60—Subscription-based services using application servers or record carriers, e.g. SIM application toolkits
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/53—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
- A63F13/537—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game using indicators, e.g. showing the condition of a game character on screen
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/70—Game security or game management aspects
- A63F13/77—Game security or game management aspects involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Environmental & Geological Engineering (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
- Telephonic Communication Services (AREA)
Description
- The present invention relates to the field of wireless mobile devices and software applications installed thereon. More particularly, the present invention relates to monitoring performance of such devices and software applications.
- According to a study by Equation Research, slow performance is the top complaint users have with mobile device applications.
- Performance of a website can be analyzed by monitoring the network delay associated with loading web pages and comparing the average delay to that of other websites. A percentile can then be reported that helps website developers determine how their website performs compared to other websites. Companies such as New Relic provide website monitoring services. Such website performance monitoring services, however, are not readily applicable to monitoring performance of mobile applications.
- In an attempt to address the issue of slow performance of mobile applications, Compuware offers a solution that allows mobile application developers to manually configure their mobile applications to measure wait times by manually indicating the beginning and end of sections of mobile application code for which wait time is to be measured. Reporting the wait time helps mobile application developers identify portions of their application code that require optimization. It can, however, be time-consuming and cumbersome to initially configure an application to obtain these measurements and to maintain the application on an ongoing basis as changes are made to the application.
- What is needed, therefore, are improved techniques for monitoring performance of mobile applications.
US2013/081001 discloses a tool for listening for the occurrence of user-specified events that exceed a delay threshold. These can include user actions processed by a user interface thread.US2012/023475 discloses a computer implemented system. - Aspects and preferred features are set out in the accompanying claims. We disclose herein a method and an apparatus for performance monitoring for mobile applications. In an embodiment, a method of monitoring performance of a mobile application is provided. A mobile application is operated on a wireless mobile device. A progress indicator being displayed on a display screen of the mobile device during operation of the mobile application on the wireless mobile device is automatically detected. Data indicative of a time duration of the progress indicator is obtained. The data indicative of the time duration is communicated to a centralized server.
- The present invention is described with respect to particular exemplary embodiments thereof and reference is accordingly made to the drawings in which:
-
Figure 1 illustrates a system for monitoring mobile application performance in accordance with an embodiment of the present invention; -
Figure 2 illustrates the mobile device and its relevant components in accordance with an embodiment of the present invention; -
Figure 3 illustrates a performance monitoring server in accordance with an embodiment of the present invention; -
Figure 4 illustrates installation of a performance library in a mobile application as well as deployment of the mobile application to a user group in accordance with an embodiment of the present invention; -
Figure 4 illustrates installation of a performance library in a mobile application as well as deployment of the mobile application to a user group in accordance with an embodiment of the present invention; -
Figure 5 illustrates capturing of wait times experienced by users in accordance with an embodiment of the present invention; -
Figure 6 illustrates retrieval of performance data in accordance with an embodiment of the present invention; -
Figure 7 illustrates retrieval of benchmarking data in accordance with an embodiment of the present invention; and -
Figure 8 illustrates a block diagram of a machine in the form of a computer system in accordance with an embodiment of the present invention - The present invention is directed toward monitoring performance of mobile devices and software applications operating on such mobile devices. In accordance with an embodiment of the present invention, instances within a mobile application during which users of the mobile application are waiting on the mobile application are automatically discovered. Specifically, instances in which the user is waiting on a progress indicator can be automatically discovered within the mobile application and instrumented. Such progress indicators are also known as activity indicators, progress bars or, more simply, "spinners." Typically, such progress indicators are displayed on a display screen of the mobile device while the user is awaiting some action or function to be completed by the mobile application. Such actions can include displaying an image or processing a transaction. A mobile application is modified by adding instrumentation that performs performance monitoring functions described herein. Thus, instrumentation can be accomplished by adding monitoring instrumentation during code run-time, during code compilation, or both. Once instrumented, the time users wait on progress indicators can be determined and analyzed. Results can be reported to a mobile application developer. Causes of wait times can include, for example, issues related to the mobile handset's memory usage, the mobile handset's processor, network connection, network delay, disk access delay, battery drain, slow function runtimes and so forth. Context in which the wait times occur can be reported, for example, a portion of the mobile application being executed at the time may be identified, the last user input prior to the slow frame rate event may be identified or the type of activity occurring during the wait time, e.g., loading an image or awaiting a response from a subroutine or remote transaction server.
- Thus, embodiments of the present invention are directed toward automated techniques for monitoring the wait time experienced by users of mobile handset applications. Instances of a progress indicator being loaded in a mobile application are automatically identified. Then, during operation of the application on a set of mobile devices, information regarding the times that users waited on the progress indicators within the application is monitored and reported. Information relevant to the causes of the wait times, such as the context in which the progress indicator occurred, can also be reported.
- Embodiments of the present invention are directed toward benchmarking the performance of mobile applications. Specifically, performance of different types of actions in mobile applications can be monitored and compared to actions in other mobile applications.
- Actions that can be monitored for performance and benchmarked can include, for example, wait times during display of progress indicators, response times for scrolling actions or buttons being pressed or other user input gestures which then initiate activity by the mobile application. Users of mobile applications tend to expect different response times for different actions. For example a scrolling action in an application is expected to be smooth and thus generally requires shorter response times than a button click in a mobile application. It can be useful to benchmark various different types of actions such as scrolling, flipping, swiping, and clicking on buttons or links. Each such action type can have an expected response time. Average response times, and response time percentiles can be discovered from various mobile applications and used to benchmark the responsiveness of an application per user action type. Performance data used for benchmarking can be obtained by automatic instrumentation, for example, to detect wait times associated with progress indicators as described herein. Performance data can also be obtained via manual methods such as by manually adding instrumentation to the application code in order to collect performance data.
- Furthermore, depending on the usage level of different action types in an application, an overall application performance benchmark can be determined by combining individual performance benchmarks. For example, if an application has two actions, scrolling and button pressing, with the scroll action happening 50% of the time compared to the button press action, and the scrolling responsiveness was in the 80th percentile compared to other applications and button pressing in the 50th percentile, then a weighted average benchmark could place the application in the 65th percentile. Alternatively, the performance of a mobile application can be benchmarked based on the total wait time experienced by users of the application compared to other mobile handset applications.
- In addition, to help improve performance benchmarks, circumstances that cause wait times or context in which the wait time occurs can be discovered and reported to the application developer. Such cause can include, for example, issues related to the mobile handset's memory usage, the mobile handset's processor, network connection, network delay, disk access delay, battery drain, slow function runtimes and so forth. Context in which the wait times occur can be reported, for example, a portion of the mobile application being executed at the time may be identified, the last user input prior to the slow frame rate event may be identified or the type of activity occurring during the wait time, e.g., loading an image or awaiting a response from a subroutine or remote transaction server.
-
Figure 1 illustrates a system for monitoring mobile application performance in accordance with an embodiment of the present invention. The system ofFigure 1 includes a mobileapplication developer computer 100, aperformance monitoring server 260, acommunication network 500, a mobileapplication store server 310,user group 410, andmobile devices 450. Thenetwork 500 can include, for example, the Internet, a Wi-Fi network, a cellular network, and/or other types of networks. A mobile application developer can use thecomputer 100 to access theperformance monitoring server 260 over thenetwork 500. The developer can be an individual or a juristic entity such as a corporation. Thedeveloper computer 100 downloads a performance library and then includes and instantiates the performance library in a mobile application being developed by the developer. Theapplication developer computer 100 can then upload over thenetwork 500 to the production mobileapplication store server 310 the application with the performance library included. Amobile device user 450 can then connect over thenetwork 500 to the production mobileapplication store server 310 to download the application to amobile device 450. Themobile device 450 can run the mobile application and also collect resulting performance data for the mobile application. Themobile device 450 can connect to theperformance monitoring server 260 via thenetwork 500 to send application performance data that is collected by thedevice 450. -
Figure 2 illustrates a mobile device and its relevant components in accordance with an embodiment of the present invention. More specifically,Figure 2 illustrates themobile device 450 having a mobile application with an includedperformance library 201 stored within themobile device 450. Themobile device 450 further includesmemory 202,wireless communication 203,battery 204,processor 205, anddisk 206. The performance library monitors the performance of the application which can include monitoring performance during any progress indicator wait times. The performance library can also monitor other performance data or indicators, for example, response times for various different types of actions including scrolling, flipping, swiping, and clicking on buttons or links. - The performance library can be included in the mobile application by the
developer 100, as described in connection withFigure 4 . It will be apparent to those skilled in the art that such a performance library can be developed for mobile applications to automatically collect performance information while progress indicators are displayed to users without significantly affecting performance of the mobile device and its application that contains the performance library. - As an example, the
performance library 201 can monitor during the progress indicator wait time per type ofmobile device 450 and operating system version, thememory 202 allocated per function used by the mobile application, and themaximum memory 202 that is used by the application per user session relative to the total available memory per type ofmobile device 450. Theperformance library 201 can also monitor thewireless communication 203 to measure the duration of network requests made from the application whose performance can be negatively affected by slow network connections, by large amounts of data that mobile users download, or by type ofmobile device 450. Theperformance library 201 can monitor thedisk lag 206 per type ofmobile device 450 type. Theperformance library 201 can monitor the amount that the application drains thebattery 204 per type ofmobile device 450 type. Theperformance library 201 can monitor theprocessor 205 to measure the run-time per function call in the application per type ofmobile device 450. -
Figure 3 illustrates a performance monitoring server in accordance with an embodiment of the present invention. As shown inFigure 3 , theperformance monitoring server 260 includes a storedperformance library code 301, aperformance database 303, adeveloper database 308 and amobile application database 309. Thedatabase 303 stores data received by theserver 260 from themobile devices 450 in theuser group 410. Thedeveloper database 308 can store unique identifiers for developers and possibly also contact information for each developer, such as name, address, and email address. Themobile application database 309 can store the mobile applications of each developer. Each mobile application in themobile application database 309 is preferably associated with the developer's unique name or other identifier from thedeveloper database 308 and preferably also includes an application name and description. - Performance data stored in the
performance database 303 is preferably associated with the particular application and action within the application to which data pertains. For example, theperformance database 303 preferably stores the performance data along with a developer identifier from thedeveloper 308 database, as well as the application identifier from themobile application 309 database for which the performance monitoring data is collected. In the case of progress indicators, the performance data is preferably associated with a progress indicator name or other identifier which may also be reported to theserver 260. In addition, the progress indicator can be associated with various combinations of the following information which may also be reported to theserver 260 in connection with the progress indicator: the type ofmobile device 450 that data is collected on, its operating system version and type, its geographical location, its wireless network connection type, carrier name, a user action name, such as checkout button, a user action type such as a button press, a total runtime of the user action. Rather than the total runtime or in addition to the total runtime, start and stop timestamps associated with the progress indicator can be stored. The total runtime can then be determined from the start and stop timestamps. The performance data can also include performance measures for the user action including performance for the memory 202 (e.g. memory usage), wireless communication 203 (e.g. communication latency or delay), battery 204 (e.g. battery usage or drain), processor 205 (e.g. processor speed or response time), and disk 206 (e.g. disk access delay or latency). Capturing of theperformance monitoring data 303 per user action in connection with progress indicators is described in connection withFigure 5 . - In an embodiment, the
performance database 303 can also capture and store instances when the frame rate for the mobile application is below a certain threshold. For example, the duration of time that the frame rate falls below five frames per second can be determined and stored. Each instance of low frame rate can be associated with a user action if it occurs during a time period when the mobile application is responding to a user action. Such instances of low frame rate can alternatively be associated with some other activity occurring during operation of the mobile application. Otherwise the instance of low frame rate is not associated with a user action or other specified activity but can be associated with the mobile application generally. In addition, the low frame rate occurrence can be associated with various combinations of the following information which may also be reported to theserver 260 in connection with the low frame rate occurrence: the type ofmobile device 450 that data is collected on, its operating system version and type, its geographical location, its wireless network connection type, carrier name, a user action name, such as checkout button, a user action type such as a button press, a total runtime of the user action. -
Figure 4 illustrates installation of a performance library in a mobile application as well as deployment of the mobile application to a user group in accordance with an embodiment of the present invention. Instep 4400, a developer logs into theperformance monitoring server 260 using its credentials. The developer can log in using the developer computer 100 (Figure 1 ). If the developer has not logged in previously, the developer can be required to go through a registration process. During the registration process, the developer can be required to supply information such as name, mailing address, email address, and a password. Theperformance monitoring server 260 can then generate a unique developer identifier for that developer. - In
step 4401, thedeveloper computer 100 indicates if it needs to install the performance library on a mobile application. If so, then instep 4402 thedeveloper computer 100 provides the application name at which point theperformance monitoring server 260 creates a new data entry in theapplication database 309. This can include generating a new application identifier and associating it with the developer identifier from thedeveloper database 308 for the logged in developer, then thedeveloper computer 100 downloads the storedperformance library code 301 from theperformance monitoring server 260 and installs the performance library within the mobile application that is associated with or contains the newly created application identifier. Then, instep 4403, which is also reached if the benchmarking library was already installed in the application, thedeveloper computer 100 uploads the application to the production mobileapplication store server 310. Instep 4404, members of the user group 400 download over thenetwork 500 the application onto theirmobile devices 450 from the test mobile application store server 300. Also instep 4404, theuser group 410 executes the application on theirmobile devices 450. Instep 4405, themobile devices 450 send to theperformance monitoring server 260 the performance information collected by the performance library. Theperformance monitoring server 260 then stores that data in theperformance 303 database. For each mobile device, the performance data can be sent while the application is being executed on the device or after the application is executed. The data can be sent in batches periodically or can be sent in real-time as it is collected. -
Figure 5 illustrates capturing of wait times experienced by users in accordance with an embodiment of the present invention. Once the performance library is installed on amobile device 450, it captures performance information, which can include the wait time experienced by members of theuser group 410. Instep 5401, the performance library checks if a user gesture, such as a button press or swipe, has occurred. If no user gesture occurs, then step 5401 is repeated, otherwise instep 5402 the performance library checks if a progress indicator is showing in the visible screen, preferably within a predetermined time threshold. For example, the performance library may determine whether a user gesture occurred and a progress indicator is then shown within 2 seconds of the user gesture. If not, then step 5401 is repeated, otherwise in step 5403 a timer is started to time the length of time the progress indicator is shown on the display screen of themobile device 450. In addition to timing the progress indicator, the performance library may also monitor additional performance data related to, for example, memory usage, network lag, disk lag, battery drain, and function runtimes during this period. Instep 5404 the performance library checks if the progress indicator finished showing in the visible display screen. If not then step 5401 is repeated, otherwise instep 5405 the timer is stopped, and instep 5406 the total time that the progress indicator was shown is reported back to theperformance monitoring server 260 along with any other performance data that was collected during this time related to memory usage, network lag, disk lag, battery drain, and slow function runtimes. - Thus, in accordance with
Figure 5 , a timer can be started upon occurrence of a user gesture and display of a progress indicator. The timer can be stopped upon the progress indicator no longer being displayed. In an embodiment, rather than requiring a user gesture in addition to the progress indicator to start the timer, the timer may be started upon display of a progress indicator regardless of whether it is associated with a user gesture. In another embodiment, rather than commencing the timer upon display of the progress indicator, the time period may commence immediately upon receipt of the user gesture assuming the gesture is also associated with display of a progress indicator which may occur after the user gesture is received. In an embodiment, rather than ending the time period immediately upon removal of the progress indicator from the display, the time period may end upon the occurrence of a later event, such as the progress indicator being replaced with some other image or information on the display screen of the mobile device. In any event, the beginning and end of the time periods associated with display of a progress indicator are preferably determined automatically. - In an embodiment, the progress indicator may be detected only at the beginning and ending of its being displayed in the visible part of the
mobile device 450 display screen. In another embodiment, , the performance library checks continuously or periodically to determine whether the progress indicator is in the visible part of themobile device 450 screen. For example, if the progress indicator was visible when it started and ended, and if the progress indicator was in the visible part of the screen for a specified percentage of the total time the progress indicator was shown, e.g. 75%, then the total time the progress indicator was shown may be reported to the performance monitoring server 220 instep 5406. Otherwise, a shorter time duration may be reported, for example, the actual time that the progress indicator was shown may be reported. The progress indicator may not appear in the display screen even if the mobile application is responding to a request if, for example, the user scrolls the display screen so that the progress indicator is not visible, or if the user switches to a different application while awaiting a response. In this case, the application may respond and the progress indicator disabled before the user returns to progress indicator. - In yet another embodiment, if the progress indicator is in the visible part of the
mobile device 450 screen for more than a preset threshold then it is reported to theperformance monitoring server 260 instep 5406 ofFigure 5 . Otherwise, occurrence of the progress indicator may not be reported at all. The threshold can be preset by thedeveloper 100 or by theperformance monitoring server 260 instep 4402 ofFigure 4 . In this way, short duration progress indicators, which do not interfere with the user experience, may not be reported for data collection purposes. - In an embodiment, multiple progress indicators can be timed for a single user gesture. These progress indicators might appear within a certain window of time beginning when a user gesture occurred, or might be progress indicators that appear before a subsequent user gesture. This may occur, for example, when multiple images are being loaded for display to the user. In this case, the entire time during which any of the progress indicators are displayed (which would represent the total time required to load the multiple images) may be reported. Alternatively, the time associated with each progress indicator may be reported (which would provide data relative to each image being loaded).
- In an additional embodiment, the user action wait time is captured based on the
developer 100 manually indicating where a user action starts and ends in their mobile application code. This data can then be used, for example, as described herein in connection withFigure 7 to benchmark such user action wait times in the application against user actions of the same type in other applications. For example, if a user action for which thedeveloper 100 indicates a start and stop point in their code is a page swipe, then the page swipe wait times can be compared to page swipes in other applications. The user action type can either be manually specified by thedeveloper 100 or detected by theperformance monitoring server 260. - In another embodiment, the performance library monitors freezes or low frame rates that occur on
mobile devices 450. In this case, the performance library can monitor the frame rate and can capture the duration of time during which frame rates that are indicated as slow, for example, by the frame rate falling below a threshold such as 5 frames per second. Data collected in connection with such periods of low frame rates can be sent to theperformance monitoring server 260 to be saved in theperformance database 303. The periods of low frame rates can be detected and stored during periods when progress indicators are showing within a mobile application on themobile device 450, or during any part of a user's session within a mobile application. One way to capture the number of frames per second and the duration when the frame rate is below a threshold is to monitor a frequency of write operations to a display interface of the mobile device. Periods when writes are being attempted, that is not during sleep periods, and when the writes are below a certain threshold, can then be used to indicate a low frame rate and the duration of such writes can be timed to determine how long the period of low frame rates lasts. In an embodiment, additional information is collected during such periods of low frame rates, for example, a portion of the mobile application being executed at the time may be identified or the last user input prior to the slow frame rate event may be identified. In this way, the context in which the low frame rate occurred may also be reported to enable the developer to assist the developer in determining the cause of the low frame rate. - In an embodiment, the
performance monitoring library 301 can used bydevelopers 100 in production environments, for example, after a version of the mobile application is completed and is distributed to end users. In addition, or alternatively, theperformance monitoring library 301 can be used bydevelopers 100 in development and test environments, for example, while the mobile application is undergoing test and a development and prior to distributing the mobile application to end users. - In yet another embodiment, the instrumentation that detects progress indicators and associated performance metrics, such as memory usage, network lag, disk lag, battery drain, and slow function runtimes, is inserted into the mobile application during compilation of a mobile application, for example by using a plugin to the compiler that adds the instrumentation. Alternatively, the
performance monitoring library 301 can be employed to detect progress indicators and collect performance data during runtime of the mobile application. - In an alternative embodiment of the invention in
step 5402 ofFigure 5 instead of determining if a performance indicator is loaded within a certain time threshold after a user gesture, the performance library instep 5402 monitors a function call tree that is initiated by a user gesture and then only if a function in the function call tree initiates a performance indicator then the timer is started instep 5403, otherwiseFigure 5 is repeated. -
Figure 6 illustrates retrieval of performance data in accordance with an embodiment of the present invention.Figure 6 shows how amobile application developer 100 can review the performance reported by the performance library. Instep 6401 the developer usingdeveloper computer 100 logs into theperformance monitoring server 260 over thenetwork 500. The login credentials can be initialized instep 4402 ofFigure 4 and stored in a database on theperformance monitoring server 260. Instep 6402 theperformance monitoring server 260 retrieves from theperformance database 303 the performance data associated with the logged indeveloper 100. - In an embodiment, in
step 6402 ofFigure 6 the developer can identify performance issues by using specific search filters. For example, the developer could search for instances when the performance indicator was shown for more than a certain time threshold, or search for instances when memory usage was above a certain available amount, or search for instances when the function runtimes where above a certain time threshold, or search for instances when disk or network lag was above a certain time threshold. In an embodiment, default filters are provided that can be changed by the developer. - In another embodiment, in
step 6402 ofFigure 6 , theperformance monitoring server 260 identifies for thedeveloper 100 performance data that exceed preset thresholds, set by either thedeveloper 100 or theperformance monitoring server 260. For example, this information can be provided in a report or highlighted in a report provided to the developer. As described herein, the thresholds can be related to progress indicator runtimes, memory usage, network lag, disk lag, and function runtimes. Theperformance monitoring server 260 can also notify the developer without requiring the developer to log into theserver 260, for example by email or text message, upon occurrence of preset thresholds being surpassed by individual instances, or by a certain percentage of instances or monitoredmobile devices 450. -
Figure 7 illustrates retrieval of benchmarking data in accordance with an embodiment of the present invention. This allows the developer to know how the performance of a user action in a mobile application compares to the performance of similar user actions in other mobile applications. Instep 6501, the developer using thedeveloper computer 100 logs into theperformance monitoring server 260. The login credentials can be those created instep 4400 ofFigure 4 . Instep 6502, the developer selects one of the applications, and possibly also a version of the application, that is associated with that developer in themobile application database 309. The developer may also provide a time period, such as a date range, for which to receive benchmark information. Instep 6503, theperformance monitoring server 260 retrieves from theperformance database 303 the data for the mobile application as selected instep 6502. Theserver 260 may also calculate benchmarks for the data and provide results of the benchmark calculations to thedeveloper computer 100 for display and possible further analysis. In an embodiment, the average runtime of each user action of the selected application in the selected time period is compared to the run time of actions of the same type from other applications. The data from the other applications can be limited to data collected during the specified time period or can include data from different time period(s). For example, if one of the user actions in the selected application is a newsfeed scroll action, of action type scroll, then its average runtime can be compared to the average runtime of scroll actions from other applications. The comparison can calculate a percentile to report back to thedeveloper computer 100 that is logged in. For example the average runtime of the newsfeed scroll in the application can be reported as being in the 35th percentile compared to scroll runtimes in other applications during the selected time period. As another example, the average runtime of a page swipe action can be reported as being in the 80th percentile compared to the runtime of page swipe actions in other applications. The performance data used for benchmarking can be wait times that are automatically obtained as described in connection withFigure 5 , or can be performance data obtained in another manner, such as by manual instrumentation, or can be different types of performance data, as described herein. - As described above, developer may select a time period in
step 6502 for which to receive benchmark information. In an alternative embodiment, a default time period can be set by theperformance monitoring server 260. - In
step 6503, in addition to communicating the benchmark information to thedeveloper computer 100, theperformance monitoring server 260 may also provide per user action performance measures including parameters related tomemory 202,wireless communication 203,battery 204,processor 205, anddisk 206 performance. These could be averages, distribution of performance across instances of a user action, or individual performance of user actions. This information can, for example, be used by the developer to evaluate performance of its application and to improve on the reported benchmarks. - In an embodiment, performance data used for benchmarking can indicate memory performance. For example, the data can include memory usage or memory terminations. Also, applications of the same type, e.g. games or calendar applications, can be compared to each other to obtain benchmarks (e.g., percentile of memory accesses that result in termination).
- In an embodiment, the benchmarking is performed based on additional characteristics that can be specified in
step 6502 such as device type, operating system type, connection type, carrier name, and geographic location of the user. Other characteristics can be, for example, instances when the memory usage is in a specified range, and/or instances in which network or disk lag are in a specified range. - In an embodiment, the time during which the frame rate was below a threshold specified can be benchmarked and compared to such duration in other applications.
- In another embodiment, the total wait times or the total low frame rate time, or both, can be benchmarked compared to other mobile applications. In addition, instances of wait times or low frame rate times can be associated with various combinations of the following information which may also be reported to the developer: the type of
mobile device 450 that data is collected on, its operating system version and type, its geographical location, its wireless network connection type, carrier name, a user action name, such as checkout button, a user action type such as a button press, a total runtime of the user action. In this way, the context in which the wait times or low frame rate occurred may also be reported to enable the developer to assist the developer in determining the cause of the low frame rate. - In yet another embodiment, a weighted average of all of the wait times and duration of slow frame rates in an applications can be benchmarked to the weighted average of wait times and during of slow frame rates in other applications.
- In an embodiment, an application version number can be stored along with any captured performance data in the
production performance 303 database. Then instep 6503 only performance data from the latest version of an application, instead or in addition to a selected time period, is used to benchmark performance compared to other applications. - In another embodiment, the performance is benchmarked by obtaining performance of an application in a development or test environment and comparing the performance to the performance of other applications in production environment.
-
Figure 8 illustrates a block diagram of a machine in the form of a computer system that may form a server forming part of the network system.Figure 8 shows a machine 900 in the exemplary form of the performance monitoring server, developer computer, mobile device or other computer as hereinbefore described within which a set of instructions, for causing the machine to perform any one or more of the methodologies discussed herein, may be executed. In alternative embodiments, the machine operates as a standalone device or may be connected (e.g., networked) to other machines. In a networked deployment, the machine may operate in the capacity of a server or a client machine in a server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. The machine may be a personal computer (PC), a tablet PC, a set-top box (STB), a Personal Digital Assistant (PDA), a cellular telephone, a web appliance, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. Further, while only a single machine is illustrated, the term "machine" shall also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein. - The exemplary computer system 900 includes a processor 902 (e.g., a central processing unit (CPU), a graphics processing unit (GPU) or both), a main memory 904 (e.g., read only memory (ROM), flash memory, dynamic random access memory (DRAM) such as synchronous DRAM (SDRAM) or Rambus DRAM (RDRAM), etc.), and a static memory 906 (e.g., flash memory, static random access memory (SRAM), etc.), which communicate with each other via a bus 908.
- The computer system 900 may further include a video display 910 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)). The computer system 900 also includes an alpha-numeric input device 912 (e.g., a keyboard), a cursor control device 914 (e.g., a mouse), a disk drive unit 916, a signal generation device 918 (e.g., a speaker), and a network interface device 920.
- The disk drive unit 916 includes a machine-readable medium 922 on which is stored one or more sets of instructions 924 (e.g., software) embodying any one or more of the methodologies or functions described herein. The software may also reside, completely or at least partially, within the main memory 904 and/or within the
processor 902 during execution thereof by the computer system 900, the main memory 904 and theprocessor 902 also constituting machine-readable media. - The software may further be transmitted or received over a network 928 via the network interface device 920.
- While the machine-
readable medium 924 is shown in an exemplary embodiment to be a single medium, the term "machine-readable medium" should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions. The term "machine-readable medium" shall also be taken to include any medium that is capable of storing, encoding, or carrying a set of instructions for execution by the machine and that cause the machine to perform any one or more of the methodologies of the present invention. The term "machine-readable medium" shall accordingly be taken to include, but not be limited to, solid-state memories, and optical and magnetic media. It should be understood that "computer" and "computer system" as used herein can comprise a single computer or multiple computers that may be connected to one another over a network. - While certain representative embodiments and details have been shown for purposes of illustrating the invention, it will be apparent to those skilled in the art that various changes in the methods and apparatus disclosed herein may be made without departing from the scope of the invention which is defined in the appended claims.
Claims (8)
- A method of monitoring performance of a mobile application comprising:operating the mobile application on a wireless device (450), said mobile application including an instantiated performance library (201) configured to monitor mobile application performance and capture application performance data;automatically detecting, through instrumentation inserted into the mobile application, a progress indicator being displayed on a display screen of the wireless mobile device during operation of the mobile application on the wireless mobile device;obtaining, through the performance library, by the mobile application, time associated data indicative of the mobile application performance from the progress indicator, wherein the data indicative of the mobile application performance comprises instances in which a frame rate falls below a threshold; and communicating the data indicative of the mobile application performance to a centralized server (310)wherein the performance library (201) automatically collects performance information of the mobile application while progress indicators are displayed to users.
- The method according to claim 1, wherein the data indicative of the mobile application performance is obtained and communicated to the centralized server (310) only if a user gesture is detected within a specified time threshold of detection of the progress indicator; or wherein the data indicative of the mobile application performance is obtained and communicated to the centralized server (310) only if the time duration is longer than a specified time threshold.
- The method according to claim 1, wherein information indicative of a context in which the progress indicator is displayed is communicated to the centralized server (310).
- The method according to claim 3, wherein the information indicative of the context comprises one or more of the following: identification of a particular portion of the mobile application; identification of a most-recent user input; identification of a type of activity occurring; or wherein the information indicative of the context comprises one or more of the following: type of mobile device; operating system version and type; geographical location of the mobile device; wireless network connection type; wireless carrier name; user action name; and user action type.
- The method according to claim 1, comprising communicating information to the centralized server that is indicative of a context in which one or more of the instances of low frame rate occurred.
- The method according to claim 1, wherein monitoring instrumentation is inserted into the mobile application upon run-time of the mobile application or wherein monitoring instrumentation is inserted into the mobile application upon compilation of the mobile application.
- The method according to claim 1, further comprising comparing data representative of time durations of progress indicators for the mobile application to data representative of time durations of progress indicators for one or more different mobile applications in order to obtain a benchmark for the mobile application.
- A wireless mobile device (450) having a mobile application , said mobile application including an instantiated performance library configured to monitor mobile application performance and capture mobile application performance data, the mobile application being equipped with instrumentation that is configured to automatically detect a progress indicator being displayed on a display screen of the wireless mobile device during operation of the mobile application on the wireless mobile device, the mobile application being configured to obtain, through the performance library, time associated data indicative of the mobile application performance from the progress indicator and to communicate the data indicative of the mobile application performance to a centralized server via a network,
wherein the data indicative of the mobile application performance comprises instances in which a frame rate falls below a threshold.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361957800P | 2013-07-12 | 2013-07-12 | |
US201361958140P | 2013-07-22 | 2013-07-22 | |
PCT/US2014/045028 WO2015006096A1 (en) | 2013-07-12 | 2014-07-01 | Methods and systems for performance monitoring for mobile applications |
Publications (3)
Publication Number | Publication Date |
---|---|
EP3019971A1 EP3019971A1 (en) | 2016-05-18 |
EP3019971A4 EP3019971A4 (en) | 2017-03-29 |
EP3019971B1 true EP3019971B1 (en) | 2020-05-06 |
Family
ID=52278060
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14823138.4A Active EP3019971B1 (en) | 2013-07-12 | 2014-07-01 | Methods and systems for performance monitoring for mobile applications |
Country Status (4)
Country | Link |
---|---|
US (2) | US9554292B2 (en) |
EP (1) | EP3019971B1 (en) |
CN (1) | CN105637497A (en) |
WO (1) | WO2015006096A1 (en) |
Families Citing this family (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9740668B1 (en) * | 2013-03-14 | 2017-08-22 | Amazon Technologies, Inc. | Plotting webpage loading speeds and altering webpages and a service based on latency and pixel density |
WO2015006096A1 (en) | 2013-07-12 | 2015-01-15 | Pulse.io, Inc. | Methods and systems for performance monitoring for mobile applications |
US20150261929A1 (en) * | 2014-03-17 | 2015-09-17 | Edify Incorporated | System and method for determining the effectiveness of electronic therapeutic systems |
US10463957B2 (en) | 2015-03-17 | 2019-11-05 | Amazon Technologies, Inc. | Content deployment, scaling, and telemetry |
GB2527672B (en) * | 2015-05-22 | 2016-06-01 | Gamesys Ltd | Measuring device analysis |
US10387240B2 (en) * | 2015-08-12 | 2019-08-20 | Avekshaa Technologies Private Ltd | System and method for monitoring and measuring application performance using application index |
US9654993B1 (en) * | 2015-10-22 | 2017-05-16 | Cisco Technology, Inc. | Gesture based notification tuning for collaboration systems |
CN105591816A (en) * | 2015-12-10 | 2016-05-18 | 北京合力思腾科技股份有限公司 | Detection method for detecting running state of IT operation server |
US10251033B2 (en) | 2015-12-18 | 2019-04-02 | International Business Machines Corporation | Performance of secure mobile applications |
US10353799B2 (en) * | 2016-11-23 | 2019-07-16 | Accenture Global Solutions Limited | Testing and improving performance of mobile application portfolios |
CN107273275B (en) * | 2017-05-09 | 2020-04-10 | 武汉斗鱼网络科技有限公司 | Method and device for dynamically refreshing progress bar in multiple data units |
US10841156B2 (en) * | 2017-12-11 | 2020-11-17 | Ati Technologies Ulc | Mobile application for monitoring and configuring second device |
CN108121644A (en) * | 2017-12-19 | 2018-06-05 | 珠海市君天电子科技有限公司 | A kind of test method, device and the electronic equipment of page control performance |
CN108337127B (en) * | 2017-12-21 | 2020-11-03 | 中国平安人寿保险股份有限公司 | Application performance monitoring method, system, terminal and computer readable storage medium |
WO2019132744A1 (en) * | 2017-12-27 | 2019-07-04 | Telefonaktiebolaget Lm Ericsson (Publ) | Apparatus and method for controlling communication between an edge cloud server and a plurality of clients via a radio access network |
WO2019205172A1 (en) * | 2018-04-28 | 2019-10-31 | 华为技术有限公司 | Power distribution method, device, and system of image processor |
CN109240875B (en) * | 2018-07-12 | 2022-05-03 | 北京百度网讯科技有限公司 | Canton analysis method and system |
US11157383B2 (en) * | 2018-09-28 | 2021-10-26 | Ebay Inc. | Automated determination of web page rendering performance |
US10474509B1 (en) * | 2018-10-17 | 2019-11-12 | Fmr Llc | Computing resource monitoring and alerting system |
US10931513B2 (en) * | 2019-01-31 | 2021-02-23 | Cisco Technology, Inc. | Event-triggered distributed data collection in a distributed transaction monitoring system |
US20210227351A1 (en) * | 2020-01-17 | 2021-07-22 | Cisco Technology, Inc. | Out of box user performance journey monitoring |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7685183B2 (en) * | 2000-09-01 | 2010-03-23 | OP40, Inc | System and method for synchronizing assets on multi-tiered networks |
US8230426B2 (en) * | 2004-10-06 | 2012-07-24 | Digipede Technologies, Llc | Multicore distributed processing system using selection of available workunits based on the comparison of concurrency attributes with the parallel processing characteristics |
US7822837B1 (en) * | 2004-12-30 | 2010-10-26 | Packeteer, Inc. | Adaptive correlation of service level agreement and network application performance |
WO2011146750A2 (en) * | 2010-05-19 | 2011-11-24 | Google Inc. | Bug clearing house |
US8555155B2 (en) * | 2010-06-04 | 2013-10-08 | Apple Inc. | Reader mode presentation of web content |
US9158650B2 (en) * | 2010-08-04 | 2015-10-13 | BoxTone, Inc. | Mobile application performance management |
US9629012B2 (en) * | 2010-09-20 | 2017-04-18 | Empire Technology Development Llc | Dynamic mobile application quality-of-service monitor |
US8914504B2 (en) * | 2010-12-08 | 2014-12-16 | Remasys Pty Ltd | End user performance monitoring for mobile applications |
US8500553B2 (en) * | 2011-09-02 | 2013-08-06 | KamaGames Ltd. | System and method for providing a progress indicator of an amount of time left in a users turn in a virtual game environment |
US20130081001A1 (en) * | 2011-09-23 | 2013-03-28 | Microsoft Corporation | Immediate delay tracker tool |
US8359389B1 (en) * | 2011-10-11 | 2013-01-22 | Google Inc. | Monitoring application program resource consumption |
US9413893B2 (en) * | 2012-04-05 | 2016-08-09 | Assurant, Inc. | System, method, apparatus, and computer program product for providing mobile device support services |
US20140136709A1 (en) * | 2012-11-15 | 2014-05-15 | Research In Motion Limited | System and Method for Resource Management in a Wireless Network |
GB2507994A (en) * | 2012-11-16 | 2014-05-21 | Vodafone Ip Licensing Ltd | Mobile Device Application Analysis |
US9378065B2 (en) * | 2013-03-15 | 2016-06-28 | Advanced Elemental Technologies, Inc. | Purposeful computing |
US9405654B2 (en) * | 2013-06-20 | 2016-08-02 | Microsoft Technology Licensing, Llc | Monitoring mobile application performance |
CN103345944B (en) * | 2013-06-26 | 2017-02-08 | 上海华虹宏力半导体制造有限公司 | Storage device and method for testing storage device through test machine |
WO2015006096A1 (en) | 2013-07-12 | 2015-01-15 | Pulse.io, Inc. | Methods and systems for performance monitoring for mobile applications |
US20150242421A1 (en) * | 2014-02-21 | 2015-08-27 | Quixey, Inc. | Location-Based Searching |
US10430245B2 (en) * | 2017-03-27 | 2019-10-01 | Hong Kong Applied Science And Technology Research Institute Co., Ltd. | Systems and methods for dynamic low latency optimization |
-
2014
- 2014-07-01 WO PCT/US2014/045028 patent/WO2015006096A1/en active Application Filing
- 2014-07-01 EP EP14823138.4A patent/EP3019971B1/en active Active
- 2014-07-01 US US14/320,872 patent/US9554292B2/en active Active
- 2014-07-01 CN CN201480029682.7A patent/CN105637497A/en active Pending
-
2017
- 2017-01-02 US US15/396,766 patent/US10321342B2/en active Active
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
US9554292B2 (en) | 2017-01-24 |
CN105637497A (en) | 2016-06-01 |
US10321342B2 (en) | 2019-06-11 |
US20170111814A1 (en) | 2017-04-20 |
EP3019971A4 (en) | 2017-03-29 |
EP3019971A1 (en) | 2016-05-18 |
US20150019715A1 (en) | 2015-01-15 |
WO2015006096A1 (en) | 2015-01-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10321342B2 (en) | Methods and systems for performance monitoring for mobile applications | |
JP7451479B2 (en) | Systems and methods for collecting, tracking, and storing system performance and event data about computing devices | |
JP6530462B2 (en) | Determining and monitoring the performance capabilities of computer resource services | |
US20210184947A1 (en) | Automatic capture of detailed analysis information based on remote server analysis | |
US9384114B2 (en) | Group server performance correction via actions to server subset | |
CN108721898B (en) | Frame rate determination method and apparatus, storage medium, and electronic apparatus | |
US20160098334A1 (en) | Benchmarking mobile devices | |
WO2017114152A1 (en) | Service dial testing method, apparatus and system | |
US10552290B2 (en) | Measuring user interface responsiveness | |
US10491459B1 (en) | Systems and methods for on-device adaptive self-executing diagnostics tool | |
WO2014165631A1 (en) | Mobile application performance prediction | |
JPWO2005017736A1 (en) | System and program for detecting bottleneck in disk array device | |
Chowdhury et al. | Greenbundle: an empirical study on the energy impact of bundled processing | |
CN112005207A (en) | Creating statistical analysis of data for transmission to a server | |
US10432490B2 (en) | Monitoring single content page application transitions | |
CN110389872B (en) | Data acquisition method and device and related equipment | |
US10389818B2 (en) | Monitoring a network session | |
Lee et al. | User interface-level QoE analysis for Android application tuning | |
CN110825603A (en) | Page first loading time determining method and device, electronic equipment and storage medium | |
GB2527672A (en) | Measuring device performance | |
WO2022180863A1 (en) | User operation recording device and user operation recording method | |
US20180246998A1 (en) | Mobile Application Performance Simulation | |
CN111352992B (en) | Data consistency detection method, device and server | |
US10491650B1 (en) | Monitoring performance of computing devices | |
Bissig et al. | Towards measuring real-world performance of android devices |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20151005 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: GOOGLE INC. |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: RONEN, OFER Inventor name: SIMMONS, KEITH |
|
DAX | Request for extension of the european patent (deleted) | ||
A4 | Supplementary search report drawn up and despatched |
Effective date: 20170224 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G06F 15/173 20060101AFI20170220BHEP Ipc: G06F 9/44 20060101ALI20170220BHEP Ipc: H04W 4/00 20090101ALI20170220BHEP |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: GOOGLE LLC |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20180507 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602014065157 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G06F0015173000 Ipc: G06F0009440000 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04W 24/08 20090101ALI20191030BHEP Ipc: H04W 4/60 20180101ALI20191030BHEP Ipc: G06F 9/44 20180101AFI20191030BHEP |
|
INTG | Intention to grant announced |
Effective date: 20191203 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 1267874 Country of ref document: AT Kind code of ref document: T Effective date: 20200515 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602014065157 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20200506 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602014065157 Country of ref document: DE Representative=s name: VENNER SHIPLEY GERMANY LLP, DE Ref country code: DE Ref legal event code: R082 Ref document number: 602014065157 Country of ref document: DE Representative=s name: VENNER SHIPLEY LLP, DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200807 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200907 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200806 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200906 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200806 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1267874 Country of ref document: AT Kind code of ref document: T Effective date: 20200506 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602014065157 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20210209 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20200731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200731 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200701 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200731 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200701 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200731 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200506 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230505 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230727 Year of fee payment: 10 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230725 Year of fee payment: 10 Ref country code: DE Payment date: 20230727 Year of fee payment: 10 |