CN105868039B - A kind of method, system and equipment for management software problem report - Google Patents

A kind of method, system and equipment for management software problem report Download PDF

Info

Publication number
CN105868039B
CN105868039B CN201610184580.3A CN201610184580A CN105868039B CN 105868039 B CN105868039 B CN 105868039B CN 201610184580 A CN201610184580 A CN 201610184580A CN 105868039 B CN105868039 B CN 105868039B
Authority
CN
China
Prior art keywords
application
developer
software
report
equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610184580.3A
Other languages
Chinese (zh)
Other versions
CN105868039A (en
Inventor
J·苏拉茨斯基
J·B·帕克斯
D·杜达
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google LLC filed Critical Google LLC
Publication of CN105868039A publication Critical patent/CN105868039A/en
Application granted granted Critical
Publication of CN105868039B publication Critical patent/CN105868039B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/0736Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in functional embedded systems, i.e. in a data processing system designed as a combination of hardware and software dedicated to performing a certain function
    • G06F11/0742Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in functional embedded systems, i.e. in a data processing system designed as a combination of hardware and software dedicated to performing a certain function in a data processing system embedded in a mobile device, e.g. mobile phones, handheld devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/70Software maintenance or management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/0748Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a remote unit communicating with a single-box computer node experiencing an error/fault
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0766Error or fault reporting or storing
    • G06F11/0775Content or structure details of the error report, e.g. specific table structure, specific error fields
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0766Error or fault reporting or storing
    • G06F11/0781Error filtering or prioritizing based on a policy defined by the user or on a policy defined by a hardware/software module, e.g. according to a severity level
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/32Monitoring with visual or acoustical indication of the functioning of the machine
    • G06F11/324Display of status information
    • G06F11/327Alarm or error message display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00Digital computers in general; Data processing equipment in general
    • G06F15/16Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/70Software maintenance or management
    • G06F8/71Version control; Configuration management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/01Customer relationship services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/01Customer relationship services
    • G06Q30/012Providing warranty services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/01Customer relationship services
    • G06Q30/015Providing customer assistance, e.g. assisting a customer within a business location or via helpdesk
    • G06Q30/016After-sales

Abstract

Various embodiments of the present invention relate generally to a kind of method, system and equipment for management software problem report.Specifically, a kind of computer implemented system for management software problem report includes: registration subsystem, for registering the software developer from multiple and different developers tissue;Application shop, so that multiple applications from multiple application developers can be used for being obtained by the member of the public;Using loophole tracker, it is programmed for the report for the problem of receiving the application distributed using the application shop, for receiving the data about described problem, and for the data are associated with the developer of specific application or the specific application;And Report Builder, for generating one or more problem reports to the developer for providing one or more application, described problem report includes information related with data the problem of the specific application submitted about the developer to the application shop.

Description

A kind of method, system and equipment for management software problem report
Divisional application explanation
The application be the applying date be on May 19th, 2011, application No. is 201180024596.3, it is entitled " a kind of The divisional application of the Chinese invention patent application of method, system and equipment for management software problem report ".
Cross reference to related applications
This application claims the U.S. Provisional Applications of entitled " the Bug Clearing House " that submits on May 19th, 2010 Sequence No.61/346,453 priority, entire contents are incorporated by reference into this.
Technical field
This document is related to the management and distribution of information related with software application problem.
Background technique
Software development is a kind of business of difficulty.In terms of desired software developer must first be in framework and programming software Its own is trained.He or she then have to be understood that newest continually changing programming language and technology.And he or she There must be idea.Developer then needs on target computing platform in obtainable resource and the time of its own and warp How the interior solution of Ji constraint, which passes through programming, is realized the idea.In addition, he or she needs to make one in different settings, test should Program, and be corrected with the loophole in repair procedure.Developer must then solve how to fix a price and distribute software and So that people are interested in it.
Advanced programming environment help to solve these problems in certain problems, that is, advanced programming environment can make generation The tissue and typing of code are more automatic.In addition, being directed to the application on site of wireless computer device (such as, smart phone and net book) The latest developments in shop have made small developer be easier to marketing and selling software.These development have made software developer And it buys the people of their softwares and lives more preferably.But the life of software developer is still difficult.For example, being still hard to It obtains the feedback of program user and feedback is analyzed in a manner of efficiently.For example, many developers provide electricity with application Sub- mail link, can provide feedback by Email Links client.
Summary of the invention
This document is discussed for for software developer and be specifically by third party's application on site shop to wireless The user of mobile computing device (such as smart phone) sells and distributes software developer's problem of management of application or the report of loophole The system and technology of announcement.For example, developer can be the independent programmer to the system registry for providing public's application shop, so that The developer can upload to application shop and apply, which registers to apply from application shop purchase into the public Member distributes application, all these to carry out in a manner of common and is well known.It is executed on one or more mobile computing devices Particular software application and/or operating system can program for go wrong or loophole (for example, application crashes or freeze, The user of consumption power in excess or equipment Reports a Problem manually or for improving the idea applied) when collect information, and can With operated to and same tissue by operate the application shop associated with the application shop report subsystem transmission about The data of the problem.
Report subsystem each this incoming loophole report can be submitted (automatically generated by equipment or by equipment user Manually generate) with problem be directed toward computer application (for example, freeze or collapse generation when operating system open and/or pay close attention to Application) association, and can store the information of characterization problem.The information can be by keeping it associated with application and expanding Exhibition has the mode of the developer of the application to store.When developer (its can be to application shop provide software individual or The agency of person's individual) when next logging in the system, which can pull up about its software application uploaded Report, wherein report aggregation is directed to all data to Report a Problem of each this software application, and also shows with application The essence and degree to go wrong.
This report can have the certain information removed by report subsystem from it, such as by safeguarding based on its movement Equipment is calculated to undergo the problem and generate the privacy of the user of corresponding data.May be used also from subsystem to the levels of information that developer provides To depend on subsystem to the level of trust of developer.It is also possible to the rank for the information that can be shared is informed the user, and And user can choose this use for allowing or not allowing information.
This report can take various common forms, such as summary report, show problem with one or more application and occur Frequency;Discrepancy Report, with application list certain type of all problems and provide description described problem data (for example, Problem occurs in that part in code);And stack trace, when being shown when something goes wrong in equipment about each calculating The information of the state of equipment.
In addition, system can generate the data for being more widely used in third party provider in several applications.For example, operating In the case that the tissue of application shop also provides operating system to the mobile device for accessing the application shop, for multiple applications Problem data " rolling " can be reported by various modes for creating aggregation data and result to determine whether operating system deposits In problem.For example, if this data instruction multiple and different positive experience of application when accessing specific operation system service or interface Freeze, then third party provider can be reminded for service or the code of interface, and there may be problems.
In some implementations, this system and technology can provide one or more advantages.For example, developer can be with It is provided with diagnosis capability, can only be used to only establish its own loophole by using specific development environment by other means The complicated company of tracking system.The user of equipment can receive improved application from various developers, and can permit and pass through Consistent usual manner reports the loophole from multiple and different developers between multiple and different applications.And platform (such as, is grasped Make system and/or associated application shop) expectation to its platform of the provider developer and user that can improve equipment.
In one implementation, a kind of computer implemented system for management software problem report is discussed.It should System includes that registration subsystem is used to register the software developer from multiple and different developers tissue.The system further comprises Application shop buy multiple applications from multiple application developers can by Members of The Public.The system further includes application Loophole tracker, programming is for receiving with report the problem of the application for using application shop to distribute;Reception is asked about described The data of topic;And it is the data are associated with the developer of specific application or specific application.In addition, the system includes report Generator is used to generate one or more problem reports for the developer for providing one or more application, the problem report Announcement includes the information about the problem related data related to the specific application that developer submits to application shop.
Implementation may include arbitrary characteristics in following characteristics, all features or not have all.The report of problem Announcement may include from following grouping select the problem of, the grouping include application crashes, using freeze, excessive battery use and manually The calculating equipment user of calling comments on.The system can also include leak analysis device, program for analyzing problem in multiple applications Report the problem of whether report of problem indicates with specific computing device model or computer operating system identified.It should Leak analysis device may further be by identifying the statistically higher report with particular device model or operating system version Frequency come identify problem report indicate with specific computing device model or calculating operation system the problem of.The system can be with Arrange for based on level of trust limit to developer provide information, the level of trust identify developer authorize obtain about The information of the user of specific application.Whether the system can additionally program for being to manage thereon in tissue based on the developer There is the developer of the core application of the operating system of the equipment of particular problem to limit the information provided to the developer.
Equally, system can arrange for according to the type of problem by the information block about problem.The system can be with cloth Set the information for occurring the device type of the equipment of particular problem and operating system identifies symbol thereon for providing instruction.The system can To further comprise that developer uploads interface, receives the application of developer's upload and apply each with application by thereon Developer's account relating of biography.The system can be programmed for presenting to developer by leaking according to for the different of specific development person The loophole for the security level storage that the ratio in hole determines.
In one aspect, it is included in central server system from remote for the computer implemented method of management software problem Multiple software application problem reports are received from multiple and different calculating equipment of the central server system.The system further comprises The particular report of problem report is associated with the specific application provided by specific software developer.In addition, the system include from The developer of specific development person receives identification information.The system further includes in response to receiving identification information to specific development person In developer the information that description is reported by the developer by the problem of specific application of central server system management is provided.
Implementation may include arbitrary characteristics in following characteristics, all features or absolutely not.Software application problem Report may include about freeze, collapse and user generate comment report.In addition, software application problem report may include needle To the tracking data for generating the equipment that particular problem is reported and about the information of the device configuration.The system can be wrapped further It includes from multiple software developers and receives software application update;By each developer's account relating applied and be directed to the application;With And association.
The details of one or more embodiment is elaborated in attached drawing and in being described below.Other feature and advantage are by root It is easy to understand according to specification, drawings and the claims.
Detailed description of the invention
Figure 1A is shown for distributing software from multiple developers and collecting the system 100 of information operated about software Concept map;
Figure 1B is the flow chart for showing the operation for providing the feedback about software application operation;
Fig. 2 is for tracking the system 200 about the submission of the operation of software application in the equipment from calculating equipment Schematic diagram;
Fig. 3 is the flow chart for the processing of management software problem report;
Fig. 4 is the swim-lane diagram for managing the processing that multiple developer's software issues are submitted, and wherein software installation is multiple On mobile computing device;
Fig. 5 A and Fig. 5 B are the example screenshots for undergoing the mobile computing device of software application operational issue;
Fig. 6 A to Fig. 6 C is the example screenshot for developer's report that software track system generates;And
Fig. 7 shows the general purpose computing device 700 and General Mobile meter that can be used together with technology described herein Calculate the example of machine equipment 750.
Specific embodiment
This document discusses the various systems and technology that may be used to provide the feedback to software application operation.Specifically showing In example, the software developer of one group of dispersion independent of each other (for example, be same companies work, in same area operation or Person shares common software development system) its software application can be uploaded to application shop, therefrom calculate each user of equipment Can check and download application, thus carry out often payment for buy or approved applications (wherein corresponding developer will receive A part of share of payment).Operating system in equipment can execute the Common Errors processing of plant issue, including when equipment goes out Stack trace is kept when existing problem or loophole and to central server system report such information.This type of information is usually for attempting to examine The training individuals in disconnected problem source use, so that adopting remedial measures and can correct and update related software generation Code.
In example described herein, a part for the data submitted from each calculating equipment can be also used for asking for submitting to generate The code of the topic or developer of movable code checks when problem occurs.Can occur it is following operate, when problem occurs By the relevant one or more application of operating system identifies, and to central server system submit about the problem information with And the information of the one or more of applications of mark.Central server system then can store related to software application identifier The data of connection, and this identifier may further be used to identify the developer of application.When (it can be and applies this developer The operator of shop or operating system entirely different individual or tissue) report of login system and request about its code issue When announcement, the database that system can inquire wherein storage problem data carrys out pilot pin to all data of the specific development person, and And filtering by various modes and one or more reports of packet data can be generated.As an example, individual can identify Information can be removed or can be blanked from the data provided to report.Equally, the data can be according to each application Enable developer that there are many such applications to be quickly obtained about each of which relevant operation applied if stored Understand.
Figure 1A is shown for distributing software from multiple developers and collecting the system 100 of information operated about software Concept map.In general, system 100 includes that (wherein, certain developers can also be certainly with one group of user positioned at one group of developer User, and vice versa) between central server system.Central server system receives software code more from developer Newly;Provide a user code downloading;Error or problem data are received from user;And it filters and organizes such data for opening Originator is presented.
Referring now more particularly to attached drawing, central server system is shown here by the form at application center 120.It answers It include the physical assemblies and logic module of composition customer center 108 and Developer Central 110 with center 120.This class component is for example It may include front end or web server, generate for providing the user interface of service to user and developer respectively.In user The heart 108 is communicated with user 104, which is for having obtained mobile phone or application phone in this example The specific software operating system that body, the mobile phone or application phone operation are developed by the operator at application center 120.As It is provided with a part of the integrity service of operating system, operator to can be used for checking and buying for shifting using center 120 The software application of dynamic equipment.Thus, for example, user A (for example, teenager) can download multiple video-games, and user's B (example Such as, businesswoman) various business applications and user C using trustship computing platform based on cloud can be downloaded (for example, university It is raw) E-book reader application (there are multiple e-book textbooks) can be downloaded and various appendix are applied and mathematical modeling is answered With.In every case, associated user can start it is each its downloading application (this can supplement with its phone transport answering With) and interacted in a familiar manner with the application.When there is demand, user can also access to be used using center 120 In positioning and download additional application.
Sometimes, problem possibly is present in each equipment of 104 equipment of user.For example, user can run simultaneously it is multiple Using, and can produce the memory overflow condition so that one of application crashes.Alternatively, the user of equipment can adjust It is handled with problem submission, submits processing user that can fill up a form for identifying the error in application or suggesting needle by problem To the improvement feature of application.Each example in these examples and similar example is completely described as loophole herein, because it refers to Show that the problem of needing the software application fed to the developer of application (may finally determine that the problem helps through the above In operating system, device hardware or another application).
As shown here, application can take common form to obtain from application shop 112, such as website, pass through website the The application that tripartite's (other than certain first layers application submitted by the operator of application shop 112) submits can be shown as net A part of page, also shows control on webpage, when selected by the user, so that specific selected application is provided or downloaded to logical Cross the equipment that system 100 logs on to user account.
Customer center 108 further includes loophole collector 116 comprising for the component with application example automated communications, institute State the operating system group that application example is directly distributed to the equipment of user 104 or reported via the operation to application example Part is distributed to the equipment of user 104.Loophole collector can also reformat for permanently storing, such as the information of collection By being arranged in data in one or more databases including following information, on the time and date such as submitted, equipment Operating system and version, the brand of equipment and model, executed in equipment when problem incident occurs other application, recently The tracking of device activity, configuration data and other similar information for equipment.
Using center 102 another " side " be directed toward developer 106 its it is similar with user 104 can quantitatively very greatly simultaneously And it is geographically widely distributed.Specifically, user 104 and developer 106 can be with throughout world various regions, and can be by various Network (including internet) is accessed using center 102.As an example, system 100 can have thousands of activity The active user 104 of developer 106 and millions of (or even up to ten million).Technology described herein is being with a large amount of developers It works in the system on basis especially good, this is because as the user data provided to each developer is more, in the system Developer seem fewer, and the loophole reporting system of its own can not be developed.
First primary clustering of Developer Central 110 is application manager 114.The component can be 112 needle of application shop To the another aspect of user.Specifically, application manager 114 may include that developer is accessible and what is interacted is associated Software and web server, so that its own to be registered as to the legal developer member of system 100 and then uploads it to have awarded The code of power or its application for managing commercial distribution.Application manager 114 can also provide multiple generally known Additional Services, for being interacted with developer and developer being allowed easily to manage its application.
Developer side counterparty of the loophole reporter 118 as loophole collector 116, and complete the distribution of following software and Feedback cycle starts in developer 106, shifts to application manager 114 and application shop 112, then to obtaining and execute this The user 104 of application, when software when something goes wrong (but optimistic developer be regarded as chance) return loophole collector 116, Loophole reporter 118 and developer 106.
For application (it corresponds to corresponding developer), loophole reporter 118 specifically can be to web server system The problem of providing for interacting with developer 106 and report generation facility to provide with the equipment experience by user 104 is related Data.This report can be canonical form or customized form.Standard report can by application center 102 (its herein by Be shown as single entity, but operate by multiple and different tissues that coordination with one another works) operator's exploitation, and may be easy to by It is expected that understanding its respective application executes that developer how accesses and generates.Customized report can be by each independent exploitation Person is formed, and known Graphics Report developing instrument can be used.For example, developer can choose its expectation in its report The specific fields for the data seen, and the visual effect of its report can be limited.Developer can also receive with initial data The report (in the form of batch processing and in real time, because of the case where occurring in report instruction user 104) that form occurs, and can be with Using the facility of their own for manipulating simultaneously data reporting.In addition, developer 106 can limit its polymerization report for it is expected to see It accuses.For example, if developer has developed a set of product (for example, business office external member), may wish to include for In the external member part of the common parameter of each component and component and data special secondary school for specific components each component and The unitary part of data.
In this way, system 100 can be provided to developer 106 about the loophole that may be needed to pay attention in its software It is a large amount of beneficial to the data formatted.Specific development person can not need that any operation of its software progress just can be obtained certain Data (without being to provide a kind of mechanism, operating system can be identified the application being carrying out by the mechanism).At certain In a little examples, developer can make additional data be reported (such as via API), but same, and developer can not need reality It is current to be submitted in reception loophole, it is comprehensive for generating the data about client device, and for realizing by other means The comprehensive system of applicating maintenance system.Therefore, entry level developer can obtain the benefit of the program for improving its application, and And the consumer of application can be benefited in turn.
Figure 1B is the flow chart for showing the operation for providing the feedback about software application operation.In general, shown here as Graph time line (it terminates since the upper left corner and in the lower right corner) is developed for explaining following example by the sample application Person can make its software application can be used for the public and can receive the feedback about application operating, and can thus have preparation Ground and rapidly improvement application.
In operation 120, application developer is submitted to mobile application market and is applied.The submission can pass through various sides appropriate Formula occurs, and developer can apply and provide signing certainly for safety to helping to legalize in systems using offer Certificate.Operation 122 shows the application occurred in mobile application market, and may be via same developer or other exploitations 3 other applications that person had previously uploaded." ownership " of application can (it be logical with the user that uploads the application by by the application The person that is often actual development or someone for representing developer work) account relating safeguard.
In operation 124, the user of mobile computing device (for example, smart phone or application phone) under its account by stepping on Recording system has had accessed mobile application market and has identified its own.Then user has been selected in operation 120 The application of biography, and the application is installed by known way and is ready for user's execution of mobile device.
In operation 126, outburst icon index error occurs while application is just run on the mobile apparatus.The error can relate to And collapse or lock condition, or can due to the user of equipment manually indicate offer about application feedback intention.It is such Event can make the diagnostic message about the event such as receive in equipment by the operating system component executed in equipment Collection.
In operation 128, about error be reported in mobile device 128 generation-movement can management mobile device with And occur under the control of the operating system for the operation respectively applied in equipment.For example, operating system programming handle for identification when Not successfully terminate in equipment, and such event can trigger multiple data collections executed by operating system and formatting Operation.For example, it may be determined that tracking, storehouse, registration or other entities Current Content, and when error occurs in equipment The identifier of all component softwares executed.Such message can be then collected together according to arranged standard as predetermined information Grouping.
In operation 130, report or submission are illustrated as it and can reside in (at least conceptive) responsible tracking and report such In the central server system of report.In this example, report is classified according to the particular vulnerability for application, In identified 3 different loopholes.Such classification for example can be by the way which section in correlative code when error occurs be identified Code is carrying out, and provides this section of code to identifier, so that particular report can connect together to generate loophole Report.To submit the mark for the loophole assigned that can also execute by other means to certain errors, including is tracked by loophole and be User's manual classification of system.As shown here, two other loopholes have been identified, and have been deposited respectively for those loopholes It is submitted in two errors and three errors is submitted.Therefore, in this example, after a period of time, original application is had been previously identified as The error different corresponding to eight is submitted.
Understanding this type of information for the developer of application may be important.For example, one in shown three loopholes leaks Hole may be important the statistics of the user of application.If developer can quickly see the essence of such loophole, open Originator can to its quickly correction and to downloaded the application user used (but user can be given refusal this The chance that class updates) " patch " (and the patch can be released automatically) for being directed to code is provided.
In operation 132 and operation 134, this class developer is had been selected for checking that the loophole about all developers mentions The report of friendship.In this example, there are three loopholes to be just tracked in whole system, but as shown in operation 134, the leakage It is associated with the application of operation 120 that only there are two loopholes in hole.In this example, mobile application market or similar subsystem be therefore Can have and preparatively generate following report, this report, which shows about the information of certain errors and to developer's mark, is just being The information of the essence of the loophole of system tracking.
In some instances, the data essence that the data provided in Final Report can be uploaded with slave mobile device in submission Upper difference.For example, individual can identification information can from upload data in remove so that developer can not carry out about equipment user Specific determination.In one example, stack trace and similar information when collapse can be only provided about equipment, but other Information (for example, can reflect when problem goes out the information for the data that active user is manipulating) will not be passed.Equally, in detail Degree can be related to center system, but can be unrelated with most of developers, and therefore can manipulate 134 from report Middle removing.
Fig. 2 is for tracking the system 200 about the submission of the operation of software application in the equipment from calculating equipment Schematic diagram.The system 200 can be used to implement as above with respect to the movement described in Figure 1A and Figure 1B.For the sake of clarity, system 200 are shown in the form of highly simplified, and may include a large amount of add-on assembles in specific physics realization.
Referring now to the drawings, it shows by using the system 200 shown in laptop computer and desktop computer, by this The each developer 212 of system 200 can to application server system 202 submit apply, and can receive the money of return with And the feedback about its specific corresponding operation for submitting application.Such application can be by each user 210 depicted herein via can It downloads and executes the wireless mobile apparatus of application to buy or otherwise obtain.
Developer 212 and user 210 (or more technically referring to its equipment) do not communicate directly usually each other, But network 204 (such as internet) can be used and communicated by application server system 202.Such open communication can System 200 is used with the person's type that allows extensive exploitation and user.
Specific components in application server system 202 can be used being disposed by system 200 and tracking software application Aspect provides function.Useful application is shown to user 210 and user is allowed to check, taste for example, market front end 214 can be generated Try and download the user interface of such application.Market management device 218 can provide rear end to market front end 214 and support, such as logical Other known functions for crossing tracking purchase, generating bill to user 210 and remitting money to developer 212 and application shop realization.
Developer front end 216, which can be generated, which allows developer to register to system 200, upload application, manages it applies (example Such as, update, add and delete application, and check by the way that how much sales applications earn) and receive about its application operating Feedback (as above described below) user interface.In terms of such feedback is provided, the accessible loophole report generation in front end 216 Device 220 can be managed from the shifting for having already appeared loophole (for example, by collapsing, freezing to be identified with manual user report) thereon The data that dynamic equipment uploads.For example, loophole Report Builder can be responsible for receiving loophole data reporting from user equipment, be fitted When formatting to store and (to be such as stored in vulnerability database 222), then when developer's request is checked about its specific application All or part of data of institute's storing data are obtained when report.
The combination of loophole Report Builder 220 or developer front end 216 or both can suitably carry out such data It filters and formats to be delivered to developer.The life for example, two components can cooperate in response to request of the developer to report The webpage is sent at webpage and to developer.Equally, data can efficiently be streamed to the exploitation of request data polymerization feeding Person allows developer to see the loophole report while loophole reports arrival system 200.Such real-time report can be with Occur by various modes, such as sends SMS message, XML transformation (so that for example their own can be used in developer to developer Analysis tool in system carrys out the various loophole reports of tissue) and other such mechanism.
Various data storages are also shown in attached drawing for illustrating the data that can be stored, access and be managed by system 200 Form.For example, as noted, vulnerability database can store the information about the loophole report from user 210.Loophole letter Breath may include allow developer or others skilled in the art infer (at least part and it is at least some of when, or and other Loophole reports the error reason combined) when Vulnerability events occur.In some cases, vulnerability database can also include that inside can be visited It asks system 200 but does not access the information of developer 212.This type of information (such as can be reported by mode appropriate by loophole Generator 220 and/or developer front end 216) it is filtered.
Certificate database 224 can store the certificate information for developer 212 and user 210.Certificate can permit respectively Kind personnel access relevant information associated with its account, and pay or receive for buying application or selling by system 200 Sell the money of application.Equally, certificate is determined for specific user to the appropriate access level of certain data.For example, third party Developer can have its certificate associated with limitation access level, so that when it requests the report about it using loophole When, personal information is filtered to the anonymity for keeping applying user.On the contrary, internal user can have to about user equipment event The access of the data of barrier to a greater extent.
Finally, application data store 226 stores the obtainable application of user 210, including what is uploaded via developer 212 Using, and may application on the market be originally placed via the operator of system 200.
Outside server system 202, local developer 206 is also shown in this example, it can be in same domain It is communicated as application server 202, and by private network 208 with application server system 202.Local developer is application The programmer that the operator of server system 202 trusts, such as employee of the tissue of operation application server system.Such user It can be identified by various methods by application server system 202, and developer front end 216 therefore can be to developer 206 It provides and is used to analyze data to the access of error information and to the access of more strong tools to a greater extent.In other words, it develops Person 206 can be regarded as developer by system 200, but different from other developers 212.
As an example, certain user 210 may have agreed to provide to the tissue for providing application server system 202 Certain individuals can mark data, but may refuse with third party share this type of information.Local developer 206 in the case can Enough access are than the more information of developer 212.Such situation is particularly desired in from the visual angle of user 210, this is because local exploitation It is certain in most useful and ubiquitous deployment application (for example, word processing and Email) in the frequent generation system of person 206 Using, and user may expect to give its anything for needing to improve program to this class developer.
Fig. 3 is the flow chart for the processing of management software problem report.In general, the processing is related to the developer from application The computer code for being directed to each computer application is received, and is made using the member's downloading that can be used in application market by the public And it is possible that buying.After on the various computers that various applications are installed to system registry user, application can start to give birth to At alarm (for example, when occur collapsing or when other problems), the information about such alarm can return to application market by relaying Operator, and the correspondence developer that the information can be used for submitting the specific application with event, so that the developer can be with Improve and edit the code that needle is applied to.
The processing is since frame 302, and wherein the processing receives the application uploaded by developer.The developer for example can be The individual program person to work outside its family has been written that for solving the problems, such as specific small range (niche) in specific area Simple application, such as the calculator of carpenter, for specific occupation research tool or can be in mobile computing device The other similar application of upper execution.Developer can alternatively include one group of individual, such as (such as apply city with development and application The application sold on field) be business small software company.In general, there is developer claim to be generated by sales applications Income, or distribute the income that application obtains to each user by other means.
In frame 304, so that using can get on the market.This generic operation can occur in the usual way, and can be with Text description and icon arrangement including application, are supplied to market by developer.The application can be bought by payment It obtains, or acquisition can be freely downloaded, be also the mode being known in the art.
In frame 306, the example of application is delivered to the buyer for indicateing interest in and receiving application copy.Therefore, application Copy can be downloaded to mobile device associated with the user account for the user for accessing application shop or market.User is then Movement appropriate can be taken to install and apply and apply this while its purchase application or later on their device Operation.Therefore, the user that has downloaded the equipment of specific application and the other users for having downloaded the application are accessible should Using and by its think suitable in a manner of interact with the application.
Such interaction with application is as there may be problems for the operation of application.One problems includes that may cause to answer With (or process that wherein application is carrying out) collapse or the application failure hung up.Another problem may be user to using not It is satisfied, this is because the application is thought to apply without correctly execution or user can be better carried out by certain improvement.? In such situation, data can be collected manually for spy automatically or from user from equipment for the particular client device of user The parameter of signization event.In some implementations, various data described above can by operating system or the collect components of application, And including information as described above, and such as when event occurs current screenshot etc of equipment other data, also Including the information that may be inputted from the user of equipment to equipment, such as instruction user it is expected the text of the characteristic type to application addition Word.Once being collected into such diagnostic message, it can be transferred to server system from client device, the server system is then It can will format and save about alarm and from other the received alarms (frame 310) of other client devices.
In terms of executing such formatting and filtering, central server system can also identify the data for different event Between common parameters to attempt to identify the event indicated using the identical loophole of appearance.For example, if being directed to two different events Tracking information it is very close to each other, then system may infer that event is the result of common loophole.For determining that two events are No certain parameters due to identical loophole can be weighted, and other parameters can determine whether the loophole that event is classified into closes In special parameter.Each loophole in such identified loophole can be assigned label, which can be subsequently used in determination Association is created between different data with alert with common loophole, and the software developer into system provides alarm and loophole Grouped record.
In frame 312, handle the leakage about the corresponding one or more application of the developer of specific one or more application Hole information format is simultaneously delivered to the developer.As described above, report can take various forms, including beating on webpage (it is related to each event or one group of event and passes through operation application for print report, data block (such as in xml format) or data flow Various client devices are transmitted to the data of mabage report).Occur in this manner, developer can obtain on user equipment Loophole generate the related information of event, and user and/or user equipment can provide the information.
Fig. 4 is the swim-lane diagram for managing the processing that multiple developer's software issues are submitted, and wherein software installation is multiple On mobile computing device.The processing be similar to Fig. 3 processing, but show about can by system specific components execute The more details of particular example operation.The processing is since frame 402, and wherein developer develops software application.Such exploitation can be with Including framework applications, draft for application code and grouping or by other means arrangement for application code it is multiple Part.Once using being ready to using developer can register in the usual way and log in (frame 404) to application shop service Device system, and server system can start from developer in this way and interact session (frame 406).Provide about The metadata of application appropriate form (such as, the title of application, the price of purchase application, the text description of application, using staying in The icon presented on user equipment and in application shop and other proper datas) after, user or developer can be by them One or more application uploads (frame 408) with necessary metadata.
In frame 410, application shop server registration application, creation is for storing application and describing the number of the application parameter According to space, and by available means by this using master control in application shop.
Later, the user just in browse application shop finds the application and it is expected to buy.In frame 414, user's registration is simultaneously Application shop is logged in, starts session (frame 416) with user in turn.
In frame 418, user provides order for downloading application, and such as by clicking the icon of the application, then selection is special Determine to may be selected control on screen for confirming user's expectation purchase and obtaining the application.In frame 420, application shop examines user's Certificate guarantees that user has the account of the application shop, and provides a user this if user has the account and answer With.Alternatively, server can not have account with user is determined, and available by conventional methods to the such letter of user's request Breath, including by requesting credit card information for paying the application of downloading in the future to user.
Once user has downloaded application, user can begin to use the application, and in some cases, this use can give birth to At error or problem incident, as shown in the frame 422.The example of error event provides above, and may include equipment Freeze, the collapse of equipment or from user about suggest improve or application problem manual report.The equipment of user then exists Frame 424 reports that wherein data can be received simultaneously to loophole server by such event and for the diagnostic message of the event Record.Such transmission from client device can be by being subjected to the specific application of the event or residing in the difference in equipment It is generated using via operating system component.Specific interaction between equipment and loophole server can be established by API standard, and And the data can be allowed suitably to be transmitted in accordance with the standard.
Process can then wait for a period of time, and other users can execute the application in its equipment, this can anti-mistake To report the data about problem in those equipment.However, developer is then it can be desirable to check whether the application is correctly grasped Make, and therefore can finally log in (frame 226), although at this point, developer can be provided with the information from loophole server, The loophole server can start session in frame 428.One common interaction may include being directed to be set by the calculating that developer operates The request (block 430) of the standby one or more reports generated, and institute can be provided go back to developer in 432 loophole server of frame The report of request.Such service may include according to the specific model of loophole server identification come tissue error event data, and And cross filter data and developer is made to receive the data of its needs only to carry out information decision, therefore developer does not receive it and does not have The data of access.Finally, in frame 434, developer's equipment display record or report (such as on webpage), so that developer can be with It is checked and decides whether and how to update its software to solve to occur in one or more equipment Error.
Fig. 5 A and Fig. 5 B are the example screenshots for undergoing the mobile computing device of software application operational issue.In general, these sections Show the screen that can such as generate on a client device by operating system component or application when error event occurs Two examples of curtain.Screenshot in Fig. 5 A shows the warning screen generated, this is because particular procedure surprisingly stops.It should Screenshot indicates what has occurred to user, and gives the user two options for response.Specifically, user can select " by force close " is selected to stop the processing, but stops the processing and mean to do so that data may be lost.User is also an option that Report the information about the problem, wherein user is opening of thought and it is expected that help is applied or the developer of operating system changes Into the software so that similar unexpected stop at no longer occurs in the future.
User selects " report " option to make the screenshot for showing Fig. 5 B.Here, to user show control problem will how to The parameter of central server system report.Specifically, it can show to be applied to the appropriate privacy policy of transmission and be checked for user, And user can be provided with the appropriate control for correcting or updating the privacy policy.In addition, user is provided with blank text Frame, wherein user can choose the context-of description problem for example, " I just applies xyz typing abc, while it is logical to carry out phone Words are carried out the numerical operation for SETI and play full details first person shooting, do not known by Handbrake converting video What reason, hangs up using by me." this class text can be taken as with about the problem other diagnostic messages field. In some cases, if loophole is particularly troublesome and developer needs to send Email or calling party, user to user The chance that its contact details is supplied to developer can be given.Alternatively, user can not be required initially to provide any Contact details, but developer can request contact details after checking comment, and system user then can be generated can With the message of response.
User can choose " preview " button then to provide the diagram of all data about the problem of upload, or Person selects " transmission " to come so that uploading the information.
Fig. 6 A to Fig. 6 C is the example screenshot for developer's report that software track system generates.Fig. 6 A is shown about application The summary statistics of the loophole of com.android.launcher2.For example, showing report from client device or submission Sum, as the current radio for the submission freezed and collapsed.
It in another example, can be with about the information one for executing application about device battery power and the information used Play report.For example, diagnostic message can be uploaded from equipment so that central researcher if battery declines suddenly in terms of power It can determine and need power supply.For example, if specific application is frequently shown as activity when such event occurring, center System may infer that the application is the root of battery depletion.
Fig. 6 B shows the similar summary report for multiple and different applications or code file.For example, when code failure, The name of the code is shown together with its context, for the reported number of such failure and the current radio of such event.
Fig. 6 C shows the more detailed report of the specific fault about specific application, and shows about failure background more More information.For example, the stack trace for equipment is shown in report, as other certain useful information.Certain information User can be made to can see additional source data depicted therein by hyperlink.
Fig. 7 shows the general purpose computing device 700 and General Mobile meter that can be used together with technology described herein Calculate the example of machine equipment 750.Calculate equipment 700 be intended to represent various forms of digital computers (such as laptop computer, Desktop computer, work station, personal digital assistant, server, blade server, host and other suitable computers).It calculates Equipment 750 be intended to represent various forms of mobile devices (such as personal digital assistant, cellular phone, smart phone and other Similar calculating equipment).Components shown here, their connection and relationship and their function are only used to illustrate and not be used to Limit described in this document and/or claimed invention embodiment.
Equipment 700 is calculated to include processor 702, memory 704, storage equipment 706, be connected to memory 704 and high speed The high-speed interface 708 of ECP Extended Capabilities Port 710 and the low-speed interface 712 for being connected to low speed bus 714 and storage equipment 706.Component 702, each component in 704,706,710 and 712 interconnected using various buses and can be assemblied in common motherboard or Person is assembled with such as suitable other modes.Processor 702 can handle for calculating the instruction executed in equipment 700 (packet It includes and is stored in memory 704 or stores in equipment 706 for (being such as coupled to high quick access in external input/output device Mouthfuls 708 display 716) on instruction of the display for the graphical information of GUI).It in other embodiments, can be as being suitble to Multiple processors and/or multiple buses are used together with multiple type of memory with multiple memories like that.Also it can connect more A calculating equipment 700 (such as server group or blade server group or multicomputer system) and each equipment provide The part of required operation.
Memory 704 stores the information calculated in equipment 700.In one embodiment, memory 704 be one or Multiple volatile memory-elements.In another embodiment, memory 704 is one or more nonvolatile memory list Member.Memory 704 is also possible to another form of computer-readable medium (such as disk or CD).
Storage equipment 706 can provide massive store to calculate equipment 700.In one embodiment, equipment is stored 706 can be or comprising computer-readable medium (such as floppy device, hard disc apparatus, compact disk equipment or tape unit, sudden strain of a muscle It deposits or other similar solid-state memory devices or equipment array is (including setting in storage area network or other configurations It is standby)).Computer program product tangible can be implemented in information carrier.Computer program product also may be embodied in and be performed The instruction of Shi Zhihang one or more method (such as method as described above).Information carrier is computer or machine readable Medium (such as memory 704, storage equipment 706, the memory on processor 702 or the signal of propagation).
High-speed controller 708 manages the bandwidth-intensive operations for calculating equipment 700, and the management of low speed controller 712 is more Low bandwidth intensive action.Such function distribution is only for example.In one embodiment, high-speed controller 708, which is coupled to, deposits Reservoir 704, display 716 (such as passing through graphics processor or accelerator) are coupled to and can receive various expansion cards The high-speed expansion ports 710 of (not shown).In this embodiment, low speed controller 712 is coupled to storage equipment 706 and low speed ECP Extended Capabilities Port 714.It may include the low-speed expansion end of various communication port (such as USB, bluetooth, Ethernet, wireless ethernet) Mouth may be coupled to one or more input-output apparatus (such as keyboard, indicating equipment, scanner) such as passes through net Network adapter is coupled to networked devices (such as interchanger or router).
It can be implemented to calculate equipment 700 with multiple and different forms as shown in the figure.For example, it may be embodied as standards service Device 720 or as being repeatedly implemented on one group in server.It also may be embodied as the part of rack server system 724. In addition, it can also be implemented in personal computer (such as laptop computer 722).It replaces, from calculating equipment 700 Component can be combined with the other component in mobile device (not shown) (such as equipment 750).Each of such equipment Equipment may include one or more calculated in equipment 700,750 and calculate equipment, and whole system can be by phase intercommunication Multiple calculating equipment 700,750 of letter form.
Calculating equipment 750 includes processor 752, memory 764, input-output apparatus (such as display 754), communication Interface 766 and transceiver 768 and other component.The storage equipment that equipment 750 also can have for providing additional storage is (all Such as micro-move device or other equipment).Carry out each of interconnecting member 750,752,764,754,766 and 768 using various buses Component, and if the dry part in component can be assemblied in common motherboard or be assembled with other modes such as appropriate.
Processor 752 can execute the instruction calculated in equipment 750 (including the instruction being stored in memory 764).Place Reason device may be embodied as the chipset of chip, these chips include independent and multiple analog- and digital- processors.Processor example Coordination (the application and equipment 750 that such as control user interface, equipment 750 are run of the other component of equipment 750 can be such as provided Wireless communication).
Processor 752 can by control interface 758 and be coupled to the display interface device 756 of display 754 come with user Communication.Display 754 for example can be TFT LCD (Thin Film Transistor-LCD) or OLED (Organic Light Emitting Diode) Display or other appropriate display technologies.Display interface device 756 may include for driving display 754 to be in user The proper circuit of existing figure and other information.Control interface 758 can receive from user and order and convert them for from Device 752 is managed to submit.In addition, external interface 762 can be provided with the communication of processor 752 to realize that equipment 750 and other are set Standby near region field communication.External interface 762 can for example provide wire communication or in some embodiments in other implementations Wireless communication is provided in mode, and multiple interfaces also can be used.
Memory 764 stores the information calculated in equipment 750.Memory 764 may be embodied as one or more calculating In machine readable medium, one or more volatile memory-elements or one or more Nonvolatile memery unit One or more.Extended menory 774 can also be provided and for example, by may include SIMM (single input linear memory Module) expansion interface 772 of card interface is connected to equipment 750.Such extended menory 774 can be provided for equipment 750 Additional storage space or also can store for equipment 750 application or other information.Specifically, extended menory 774 may include for realizing or supplement procedures described above instruction and also may include security information.Therefore, example Can such as provide extended menory 774 as equipment 750 security module and can with allow use safely equipment 750 Instruction to extended menory 774 program.Further, it is also possible to which security application is provided together with additional information via SIMM card (such as will be identification information can not be placed on SIMM card in a manner of hacker).
As discussed below, memory for example may include flash memory and or NVRAM memory.In an embodiment party In formula, computer program product is tangible to be implemented in information carrier.Computer program product includes to execute one kind when executed Or the instruction of a variety of methods (such as method as described above).Information carrier be computer or machine readable media (such as Memory 764, extended menory 774, the memory on processor 752 can receive for example in transceiver 768 or outer The signal propagated on portion's interface 762).
Equipment 750 can be wirelessly communicated by communication interface 766, which can include digital signal if necessary Processing circuit.Communication interface 766 can be in various modes or agreement (such as GSM audio call, SMS, EMS or MMS message Sending and receiving, CDMA, TDMA, PDC, WCDMA, CDMA2000 or GPS and other modes or communication) under communication is provided.This The communication of sample can for example occur by RF transceiver 768.In addition, short range communication can also such as using bluetooth, Wi-Fi or Person other such transceiver (not shown) occur.In addition, GPS (global positioning system) receiver module 770 can also be to Equipment 750 provides additional wireless data related with navigation and position, which can be as appropriate by equipment 750 Upper operation using.
The audible communication of audio coder-decoder 760 also can be used in equipment 750, which can connect from user It receives verbal information and is converted into usable digital information.Audio coder-decoder 760 can be such as example, by equipment 750 Earpiece in loudspeaker similarly generate the audible sound for user.Such sound may include exhaling from voice call The sound that cries may include the sound (such as speech message, music file etc.) of record and also may include in equipment 750 Operation using sound generated.
As shown in the figure, can be implemented to calculate equipment 750 with a variety of different forms.For example, it may be embodied as honeycomb electricity Words 780.It also may be embodied as the part of smart phone 782, personal digital assistant or other similar mobile devices.
The various embodiments of system and technology described herein may be implemented in Fundamental Digital Circuit, integrated circuit, specially The ASIC (specific integrated circuit) of door design, computer hardware, firmware, in software and/or combination thereof.These various embodiments It may include the embodiment in one or more computer program that can be performed and/or can interpret on programmable system, it should System includes at least one programmable processor (can be dedicated or general), which, which is coupled into from storage, is System, at least one input equipment and at least one output equipment receive data and instruction and to storage system, at least one is defeated Enter equipment and at least one output equipment sends data and instruction.
These computer programs (also referred to as program, software, software application or code) include being used for programmable processor Machine instruction and can implement with level process and/or Object-Oriented Programming Language and/or with compilation/machine language. As used herein, term " machine readable media ", " computer-readable medium ", which refer to, is used to provide machine to programmable processor Instruction and/or any computer program products of data, device and/or equipment (such as disk, CD, memory, programmable are patrolled Collect device (PLD)) (including receiving machine instruction machine readable medium as a machine-readable signal).Term " machine readable letter Number " refer to any signal being used to programmable processor offer machine instruction and/or data.
In order to provide the interaction with user, system and technology described herein be can be implemented on computer, the computer With for user show information display apparatus (such as CRT (cathode-ray tube) or LCD (liquid crystal display) monitoring Device) and user can be used to be supplied to the keyboard and indicating equipment (such as mouse or tracking ball) of input to computer.Its The equipment of his type can also be used to provide the interaction with user;For example, the feedback provided a user may be any type of Sensory feedback (such as visual feedback, audio feedback or touch feedback);And it can use defeated including sound, speech or tactile Any form entered receives input from the user.
System and technology described herein can be implemented in computing system, the computing system include back-end component (such as As data server) either include middleware component (such as application server) or including front end component (such as with figure Shape user interface or crawler (user can by the graphical user interface or crawler come with it is described herein System and technology the interaction of an embodiment) client computer) either such rear end, middleware or front end Any combination of part.The component of system can be interconnected by any digital data communications form or medium (such as communication network). The example of communication network includes local area network (" LAN "), wide area network (" WAN ") and internet.
Computing system may include client and server.Client and server is generally remote from each other and usually passes through Communication network interaction.The relationship of client and server occurs by computer program, these computer programs are in Xiang Yingji It is run on calculation machine and mutually there is client-server relation.
Description has been carried out in multiple embodiments.It is, however, to be understood that before not departing from spirit and scope of the invention Put that various modifications can be carried out.For example, the major part of this document has been directed to dialing application and has been described, but also It can solve the other forms of small keyboard layout and application, be such as related to graphic icons and thumbnail and alphanumeric character Keypad.
In addition, the logic flow described in figure is without shown particular order or successively sequentially to realize required result.This Outside, can provide other steps perhaps can from the process of description delete step and can to the system of description add or Other component is removed from the system of description.Thus, other embodiments are within the scope of the appended claims.

Claims (10)

1. a kind of computer implemented system for management software problem report, the system comprises:
Registration subsystem, the registration subsystem are arranged for registering the software from multiple and different software developers tissue Developer;
Application on site shop, what the application on site shop made from the software developer multiple are completed application and can be used for It downloads and is bought by Members of The Public, the Members of The Public includes in addition to organizing associated individual's with the software developer Outer user;
It is described to be programmed for receiving using application on site shop distribution using loophole tracker using loophole tracker The report for the problem of application is completed is answered the data and specific be completed with receiving data related with described problem With or the specific software developer that application is completed it is associated, the report of described problem is that application is completed as described in executing The calculating equipment distributed automatically generate;And
Report Builder, the Report Builder be used for for have been provided it is described be completed using one or more of be completed Software developer in the software developer of application generates one or more problem reports, described problem report include about Apply relevant described problem related to specific be completed for being submitted to the application on site shop by the software developer The data information.
2. system according to claim 1 further comprises leak analysis device, the leak analysis device is programmed for point Analyse it is multiple be completed using upper problem report come identify the report of described problem whether indicate specific computing device model or The problem of computer operating system.
3. system according to claim 1, wherein whether the system is programmed to based on the software developer be group The software developer for knitting the middle core application of the operating system of equipment for managing and occurring particular problem thereon is supplied to institute to limit State the information of software developer.
4. system according to claim 1 indicates to go out thereon wherein the system is arranged in provide in problem report The device type of the equipment of existing particular problem and the information of operating system identifies symbol.
5. system according to claim 1 further comprises that software developer uploads interface, receives from software developer The application of upload and each application and software developer's account that application is completed and is uploaded by it that application will be uploaded Number association.
6. system according to claim 1, wherein the system is programmed to present to the software developer according to tight The loophole that heavy duty does not sort, wherein the severity level is according to the ratio that the different loopholes of the software developer occur come really It is fixed.
7. a kind of computer implemented method for management software problem report, which comprises
It receives in central server system from the multiple soft of multiple and different calculating equipment far from the central server system The report of part application problem, it is the multiple it is different calculate equipment in addition to being answered with the specific software in the multiple software application of exploitation Developer organizes the user except associated individual associated, and described problem report is via the multiple difference Equipment is calculated to automatically generate from the multiple different software applications executed in equipment that calculate;
By described problem report in particular problem report it is associated with the particular software application provided by specific development person;
Instruction information is received from a specific development person in the specific development person;And
In response to receiving the instruction information, a specific development person in Xiang Suoshu specific development person provides description by described one The information that the problem of particular software application that a specific development person is managed using the central server system reports,
Wherein the central server system management is for the related to application on site shop of mutually independent multiple developers each other The problem of connection, reports that the particular software application can be used to download and be purchased by Members of The Public by the application on site shop It buys, the Members of The Public includes the user other than organizing associated individual with the developer.
8. being incited somebody to action according to the method described in claim 7, further comprising receiving the software application uploaded from the specific development person Developer's account relating of each uploaded software application and the software application, and will be in the received problem report of institute and institute Particular software application association in the software application of biography.
9. having the non-transitory computer-readable storage media of instruction, described instruction by one or more processors when being run So that one or more of processors execute operation, the operation includes:
Central server system receive from it is multiple and different calculate equipment multiple software application problem reports, it is the multiple not It is associated a in addition to being organized with the developer for the particular software application developed in the multiple software application with equipment is calculated User except people is associated, and described problem report is via the multiple different equipment that calculate from the multiple difference The software application executed in equipment is calculated to automatically generate;
By described problem report in particular problem report it is associated with the particular software application provided by specific development person;
Instruction information is received from a specific development person in the specific development person;And
In response to receiving the instruction information, a specific development person in Xiang Suoshu specific development person provides description by described one The information that the problem of particular software application that a specific development person is managed using the central server system reports,
Wherein the central server system management is for the related to application on site shop of mutually independent multiple developers each other The problem of connection, reports that the particular software application can be used to download and be purchased by Members of The Public by the application on site shop It buys, the Members of The Public includes the user other than organizing associated individual with the developer.
10. non-transitory computer-readable storage media according to claim 9, wherein the operation further comprises connecing The software application uploaded from the specific development person is received, by developer's account of each uploaded software application and the software application Number association, and by received problem report be associated with the particular software application in the software application uploaded.
CN201610184580.3A 2010-05-19 2011-05-19 A kind of method, system and equipment for management software problem report Active CN105868039B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US34645310P 2010-05-19 2010-05-19
US61/346,453 2010-05-19
CN201180024596.3A CN103038752B (en) 2010-05-19 2011-05-19 A kind of method for management software problem report, system and equipment

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201180024596.3A Division CN103038752B (en) 2010-05-19 2011-05-19 A kind of method for management software problem report, system and equipment

Publications (2)

Publication Number Publication Date
CN105868039A CN105868039A (en) 2016-08-17
CN105868039B true CN105868039B (en) 2019-09-06

Family

ID=44992344

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201610184580.3A Active CN105868039B (en) 2010-05-19 2011-05-19 A kind of method, system and equipment for management software problem report
CN201180024596.3A Active CN103038752B (en) 2010-05-19 2011-05-19 A kind of method for management software problem report, system and equipment

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201180024596.3A Active CN103038752B (en) 2010-05-19 2011-05-19 A kind of method for management software problem report, system and equipment

Country Status (8)

Country Link
US (4) US8898637B2 (en)
EP (1) EP2572282A4 (en)
JP (2) JP5937577B2 (en)
KR (2) KR101789266B1 (en)
CN (2) CN105868039B (en)
AU (1) AU2011255477B2 (en)
CA (1) CA2798759C (en)
WO (1) WO2011146750A2 (en)

Families Citing this family (86)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5937577B2 (en) 2010-05-19 2016-06-22 グーグル インコーポレイテッド Bug clearing house
US8788944B1 (en) 2011-03-09 2014-07-22 Amazon Technologies, Inc. Personalized mobile device application presentation using photograph-based capability detection
US8516308B1 (en) * 2011-03-09 2013-08-20 Amazon Technologies, Inc. Crash based incompatibility prediction for classes of mobile devices crash data
US8438532B2 (en) 2011-04-19 2013-05-07 Sonatype, Inc. Method and system for scoring a software artifact for a user
US8612936B2 (en) 2011-06-02 2013-12-17 Sonatype, Inc. System and method for recommending software artifacts
US8572553B2 (en) * 2011-06-10 2013-10-29 International Business Machines Corporation Systems and methods for providing feedback for software components
US8713531B1 (en) * 2011-06-28 2014-04-29 Google Inc. Integrated bug tracking and testing
US8473894B2 (en) 2011-09-13 2013-06-25 Sonatype, Inc. Method and system for monitoring metadata related to software artifacts
US8627270B2 (en) 2011-09-13 2014-01-07 Sonatype, Inc. Method and system for monitoring a software artifact
US9141378B2 (en) * 2011-09-15 2015-09-22 Sonatype, Inc. Method and system for evaluating a software artifact based on issue tracking and source control information
US9244510B1 (en) * 2011-09-23 2016-01-26 The Mathworks, Inc. Bug report checks in a modeling system
US9703680B1 (en) * 2011-12-12 2017-07-11 Google Inc. System and method for automatic software development kit configuration and distribution
US9087154B1 (en) 2011-12-12 2015-07-21 Crashlytics, Inc. System and method for providing additional functionality to developer side application in an integrated development environment
US9262250B2 (en) 2011-12-12 2016-02-16 Crashlytics, Inc. System and method for data collection and analysis of information relating to mobile applications
US20130159851A1 (en) * 2011-12-20 2013-06-20 Bewo Technologies Pvt.Ltd Method and system for providing help content to users
US8862947B1 (en) * 2011-12-29 2014-10-14 Google Inc. Application version deployment using crash reports
CN102591667B (en) * 2012-01-16 2015-05-27 深圳市同洲电子股份有限公司 Method and device for remote publishing application
US8656343B2 (en) 2012-02-09 2014-02-18 Sonatype, Inc. System and method of providing real-time updates related to in-use artifacts in a software development environment
JP6024126B2 (en) * 2012-03-02 2016-11-09 株式会社リコー Failure response support apparatus, failure response support system, failure response support method, and failure response support program
US8825689B2 (en) 2012-05-21 2014-09-02 Sonatype, Inc. Method and system for matching unknown software component to known software component
US9792585B2 (en) * 2012-06-21 2017-10-17 Google Inc. Mobile application management
US9141408B2 (en) 2012-07-20 2015-09-22 Sonatype, Inc. Method and system for correcting portion of software application
US9135263B2 (en) 2013-01-18 2015-09-15 Sonatype, Inc. Method and system that routes requests for electronic files
US8954546B2 (en) 2013-01-25 2015-02-10 Concurix Corporation Tracing with a workload distributor
US8924941B2 (en) 2013-02-12 2014-12-30 Concurix Corporation Optimization analysis using similar frequencies
US20130283281A1 (en) 2013-02-12 2013-10-24 Concurix Corporation Deploying Trace Objectives using Cost Analyses
US8997063B2 (en) 2013-02-12 2015-03-31 Concurix Corporation Periodicity optimization in an automated tracing system
US20140237304A1 (en) * 2013-02-20 2014-08-21 Htc Corporation Method for collecting error status information of an electronic device
US20140244516A1 (en) * 2013-02-25 2014-08-28 Carrier Iq, Inc. Mobile Wireless Customer Micro-Care Apparatus and Method
US9213622B1 (en) * 2013-03-14 2015-12-15 Square, Inc. System for exception notification and analysis
US20140279131A1 (en) * 2013-03-14 2014-09-18 Robert Edward Sullivan On-line marketplace service
US9665474B2 (en) 2013-03-15 2017-05-30 Microsoft Technology Licensing, Llc Relationships derived from trace data
US9009544B2 (en) * 2013-03-28 2015-04-14 Oracle International Corporation User operation history for web application diagnostics
US9575874B2 (en) 2013-04-20 2017-02-21 Microsoft Technology Licensing, Llc Error list and bug report analysis for configuring an application tracer
WO2014176587A2 (en) 2013-04-26 2014-10-30 The Trustees Of Columbia University In The City Of New York Systems and methods for mobile applications
KR20140128737A (en) * 2013-04-29 2014-11-06 삼성전자주식회사 Apparatus and method for managing defect of application
US8990777B2 (en) 2013-05-21 2015-03-24 Concurix Corporation Interactive graph for navigating and monitoring execution of application code
US9734040B2 (en) 2013-05-21 2017-08-15 Microsoft Technology Licensing, Llc Animated highlights in a graph representing an application
US20140379747A1 (en) * 2013-06-19 2014-12-25 Microsoft Corporation Identifying relevant apps in response to queries
CN105637497A (en) * 2013-07-12 2016-06-01 谷歌公司 Methods and systems for performance monitoring for mobile applications
US9280841B2 (en) 2013-07-24 2016-03-08 Microsoft Technology Licensing, Llc Event chain visualization of performance data
US9292415B2 (en) 2013-09-04 2016-03-22 Microsoft Technology Licensing, Llc Module specific tracing in a shared module environment
EP3042314B1 (en) * 2013-09-04 2018-06-27 Microsoft Technology Licensing, LLC Module specific tracing in a shared module environment
US9298588B2 (en) 2013-09-04 2016-03-29 Microsoft Technology Licensing, Llc Tracing system for application and module tracing
US9311213B2 (en) 2013-09-04 2016-04-12 Microsoft Technology Licensing, Llc Module database with tracing options
CN104468637B (en) * 2013-09-12 2018-08-31 阿里巴巴集团控股有限公司 A kind of method and apparatus downloaded and install client
CN105765560B (en) 2013-11-13 2019-11-05 微软技术许可有限责任公司 The component software executed based on multiple tracking is recommended
US10241785B2 (en) 2013-11-13 2019-03-26 Microsoft Technology Licensing, Llc Determination of production vs. development uses from tracer data
WO2015071778A1 (en) 2013-11-13 2015-05-21 Concurix Corporation Application execution path tracing with configurable origin definition
US9626239B2 (en) * 2014-01-06 2017-04-18 Red Hat, Inc. Bug reporting and communication
KR102298562B1 (en) * 2014-01-17 2021-09-06 에스케이플래닛 주식회사 System and method for service execution quality of application
US9639412B1 (en) * 2014-03-11 2017-05-02 Apteligent, Inc. Application performance management tools with a service monitor for collecting network breadcrumb data
CN103886255B (en) * 2014-03-12 2017-11-10 可牛网络技术(北京)有限公司 The privacy authority management method and device of application program
US9836343B2 (en) 2014-03-17 2017-12-05 Microsoft Technology Licensing, Llc Framework for user-mode crash reporting
US9898189B2 (en) * 2014-03-17 2018-02-20 Htc Corporation User trial feedback method, electronic device and computer-readable medium
JP6561433B2 (en) 2014-05-15 2019-08-21 ソニー株式会社 Method, system, terminal device, and server for realizing a function by operating a plurality of hardware elements in a coordinated manner
US9952847B1 (en) * 2014-05-20 2018-04-24 Charles E. Comer Process for user-requested acquisition of remote content
US9436533B2 (en) * 2014-05-30 2016-09-06 Apteligent, Inc. System for monitoring and tracking application crashes occurring on different mobile devices
JPWO2016021184A1 (en) * 2014-08-06 2017-06-01 日本電気株式会社 Information processing system, project risk detection method and program
US20160048383A1 (en) * 2014-08-13 2016-02-18 Microsoft Technology Licensing, Llc Isv update delivery
US10114627B2 (en) * 2014-09-17 2018-10-30 Salesforce.Com, Inc. Direct build assistance
US11195162B2 (en) 2014-10-06 2021-12-07 Vmware, Inc. System for defining and tracking transactions of mobile devices
CN104281526A (en) * 2014-10-28 2015-01-14 用友软件股份有限公司 Failure feedback method, failure feedback system and terminal
US9747152B2 (en) 2015-04-27 2017-08-29 Splunk Inc. Tracking incomplete transactions in correlation with application errors
US20160357530A1 (en) * 2015-06-05 2016-12-08 Apple Inc. Method and apparatus for intermediate representation of applications
EP3131014B1 (en) * 2015-08-10 2021-12-29 Accenture Global Services Limited Multi-data analysis based proactive defect detection and resolution
US9785535B2 (en) 2015-08-10 2017-10-10 Accenture Global Services Limited Multi-data analysis based proactive defect detection and resolution
US10146512B1 (en) 2015-08-28 2018-12-04 Twitter, Inc. Feature switching kits
GB2555026A (en) * 2015-09-02 2018-04-18 Google Llc Software development and distribution platform
US10025701B2 (en) * 2016-05-16 2018-07-17 Google Llc Application pre-release report
US9971594B2 (en) 2016-08-16 2018-05-15 Sonatype, Inc. Method and system for authoritative name analysis of true origin of a file
JP6944177B2 (en) * 2017-03-01 2021-10-06 株式会社デプロイゲート Communication programs, information processing devices, and communication methods
US10482000B2 (en) * 2017-04-24 2019-11-19 Microsoft Technology Licensing, Llc Machine learned decision guidance for alerts originating from monitoring systems
CN107563205A (en) * 2017-09-20 2018-01-09 杭州安恒信息技术有限公司 Typical smart machine leak detection method and permeability apparatus
US10733040B2 (en) 2018-02-01 2020-08-04 Faro Technologies, Inc. Individual bug fixed messages for software users
CN111061410B (en) * 2018-10-16 2021-08-13 华为技术有限公司 Screen freezing processing method and terminal
JPWO2020179833A1 (en) * 2019-03-07 2020-09-10
KR102199247B1 (en) * 2019-04-02 2021-01-07 넷마블 주식회사 System providing game service for bug report
CN110580154A (en) * 2019-05-24 2019-12-17 中国银联股份有限公司 access method based on H5 access mode, access assembly and mobile terminal thereof
US11182042B2 (en) * 2019-06-26 2021-11-23 Sap Se Application input and feedback system
US11443345B2 (en) 2019-06-27 2022-09-13 International Business Machines Corporation Application modification using software services
KR20210055387A (en) 2019-11-07 2021-05-17 삼성전자주식회사 Context based application providing server and controlling method thereof
CN110990427A (en) * 2019-12-16 2020-04-10 北京智游网安科技有限公司 Statistical method, system and storage medium for application program affiliated area
US11645192B2 (en) 2020-03-11 2023-05-09 Nec Corporation Graph-based method for inductive bug localization
US20210304142A1 (en) * 2020-03-31 2021-09-30 Atlassian Pty Ltd. End-user feedback reporting framework for collaborative software development environments
CN115310099A (en) * 2022-10-12 2022-11-08 北京盛邦赛云科技有限公司 Vulnerability coordinate system establishing method, vulnerability analyzing device and related equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101155230A (en) * 2006-09-29 2008-04-02 海尔集团公司 Network trouble feedback system for household electrical appliance
TW200837558A (en) * 2007-01-15 2008-09-16 Microsoft Corp Objective assessment of application crashes from a customer environment
CN103038752B (en) * 2010-05-19 2016-04-13 谷歌公司 A kind of method for management software problem report, system and equipment

Family Cites Families (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996038733A1 (en) * 1995-06-02 1996-12-05 Pure Software, Inc. Remote monitoring of computer programs
US6725399B1 (en) * 1999-07-15 2004-04-20 Compuware Corporation Requirements based software testing method
US6665824B1 (en) * 2000-05-15 2003-12-16 Microsoft Corporation System and method for handling a failure reporting conversation
US7657872B2 (en) * 2000-10-23 2010-02-02 Nintendo Of America Inc. Product testing and bug tracking system
JP2002149855A (en) * 2000-11-10 2002-05-24 Hitachi Ltd Software problem management system
US7234131B1 (en) 2001-02-21 2007-06-19 Raytheon Company Peer review evaluation tool
AU2002240429B2 (en) 2001-02-22 2007-12-13 Accenture Global Services Limited Distributed development environment for building internet applications by developers at remote locations
US6978441B2 (en) * 2001-10-03 2005-12-20 Sun Microsystems, Inc. Rating apparatus and method for evaluating bugs
US7401321B2 (en) 2003-04-14 2008-07-15 International Business Machines Corporation Method and apparatus for processing information on software defects during computer software development
US20050097516A1 (en) 2003-11-05 2005-05-05 Microsoft Corporation Extensible and dynamically-configurable problem-reporting client
US7603653B2 (en) 2004-03-15 2009-10-13 Ramco Systems Limited System for measuring, controlling, and validating software development projects
US20060015840A1 (en) 2004-03-31 2006-01-19 Wendall Marvel Parameter-based software development, distribution, and disaster recovery
US7509626B1 (en) 2004-03-31 2009-03-24 Sprint Communications Company Demonstrating proof of concept of a project with requirements component providing weights on importance and tracking with use cases
US20060168569A1 (en) * 2005-01-26 2006-07-27 Microsoft Corporation Beta parser
US8126760B2 (en) * 2005-03-25 2012-02-28 Microsoft Corporation Work item tracking system for projects
US7458064B2 (en) * 2005-04-11 2008-11-25 Microsoft Corporation Methods and apparatus for generating a work item in a bug tracking system
US7739653B2 (en) * 2005-07-05 2010-06-15 Microsoft Corporation Representing software development item relationships via a graph
US7743360B2 (en) * 2005-07-05 2010-06-22 Microsoft Corporation Graph browser and implicit query for software development
US7614043B2 (en) 2005-08-26 2009-11-03 Microsoft Corporation Automated product defects analysis and reporting
US7305325B2 (en) * 2006-01-12 2007-12-04 International Business Machines Corporation Method to improve requirements, design manufacturing, and transportation in mass manufacturing industries through analysis of defect data
US7490081B2 (en) * 2006-01-18 2009-02-10 International Business Machines Corporation Method and system for automatic identification and notification of relevant software defects
JP2007272443A (en) 2006-03-30 2007-10-18 Hokkaido Univ Development support device, development support method and development support program
US9047164B2 (en) * 2006-09-12 2015-06-02 Opshub, Inc. Calculating defect density by file and source module
US20080141221A1 (en) * 2006-12-08 2008-06-12 Microsoft Corporation Using recorder technology to find defects in software applications
US8949770B2 (en) * 2007-04-03 2015-02-03 Ldra Technology, Inc. Automated management of software requirements verification
JP2008271126A (en) 2007-04-19 2008-11-06 Ntt Docomo Inc Mobile terminal apparatus and diagnosis method for mobile terminal apparatus
US7890814B2 (en) 2007-06-27 2011-02-15 Microsoft Corporation Software error report analysis
US20110010214A1 (en) * 2007-06-29 2011-01-13 Carruth J Scott Method and system for project management
US7895470B2 (en) * 2007-07-09 2011-02-22 International Business Machines Corporation Collecting and representing knowledge
WO2009054847A1 (en) * 2007-10-23 2009-04-30 Qualcomm Incorporated Management of failures in wireless field devices
US8448138B2 (en) * 2008-01-15 2013-05-21 Microsoft Corporation Recording user-driven events within a computing system
US7512933B1 (en) 2008-01-27 2009-03-31 International Business Machines Corporation Method and system for associating logs and traces to test cases
US8099332B2 (en) * 2008-06-06 2012-01-17 Apple Inc. User interface for application management for a mobile device
US8271949B2 (en) * 2008-07-31 2012-09-18 International Business Machines Corporation Self-healing factory processes in a software factory
US20100070231A1 (en) * 2008-09-05 2010-03-18 Hanumant Patil Suhas System and method for test case management
CN102257502B (en) * 2008-12-18 2015-11-25 皇家飞利浦电子股份有限公司 Software error and performance deficiency reporting system
US9020943B2 (en) * 2009-01-07 2015-04-28 Oracle International Corporation Methods, systems, and computer program product for automatically categorizing defects
US8745153B2 (en) * 2009-02-09 2014-06-03 Apple Inc. Intelligent download of application programs
US20100235430A1 (en) * 2009-03-13 2010-09-16 Bruce Kim Methods and systems to provide services to a mobile device
US8418147B1 (en) * 2009-05-08 2013-04-09 Versionone, Inc. Methods and systems for reporting on build runs in software development
US8438544B2 (en) * 2009-06-18 2013-05-07 International Business Machines Corporation Open systems developer portal and managing software development projects
US8332808B2 (en) * 2009-10-21 2012-12-11 Celtic Testing Expert, Inc. Systems and methods of generating a quality assurance project status
US8407724B2 (en) * 2009-12-17 2013-03-26 Oracle International Corporation Agile help, defect tracking, and support framework for composite applications
US20110252405A1 (en) 2010-04-10 2011-10-13 Ilan Meirman Detecting user interface defects in a software application
US20110321007A1 (en) * 2010-06-29 2011-12-29 International Business Machines Corporation Targeting code sections for correcting computer program product defects using records of a defect tracking system
EP2641179B1 (en) * 2010-11-21 2019-01-02 Verifyter AB Method and apparatus for automatic diagnosis of software failures
CA2773930C (en) * 2011-04-12 2017-03-07 Accenture Global Services Limited Prioritization and assignment manager for an integrated testing platform
US20130104105A1 (en) * 2011-04-18 2013-04-25 Julian M. Brown Test data supply chain manager for an integrated testing platform
US8826222B2 (en) * 2011-08-02 2014-09-02 International Business Machines Corporation Pre-merge conflict avoidance
US9491072B2 (en) * 2013-07-09 2016-11-08 Oracle International Corporation Cloud services load testing and analysis

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101155230A (en) * 2006-09-29 2008-04-02 海尔集团公司 Network trouble feedback system for household electrical appliance
TW200837558A (en) * 2007-01-15 2008-09-16 Microsoft Corp Objective assessment of application crashes from a customer environment
CN103038752B (en) * 2010-05-19 2016-04-13 谷歌公司 A kind of method for management software problem report, system and equipment

Also Published As

Publication number Publication date
US20150234699A1 (en) 2015-08-20
US9323598B2 (en) 2016-04-26
US20160299756A1 (en) 2016-10-13
CA2798759A1 (en) 2011-11-24
US8381189B2 (en) 2013-02-19
WO2011146750A3 (en) 2012-01-26
EP2572282A2 (en) 2013-03-27
CA2798759C (en) 2018-09-04
KR101789266B1 (en) 2017-11-20
WO2011146750A2 (en) 2011-11-24
CN103038752A (en) 2013-04-10
US10007512B2 (en) 2018-06-26
CN105868039A (en) 2016-08-17
AU2011255477B2 (en) 2015-04-02
JP6165922B2 (en) 2017-07-19
EP2572282A4 (en) 2017-04-26
JP2016173844A (en) 2016-09-29
KR20170119725A (en) 2017-10-27
JP2013531839A (en) 2013-08-08
CN103038752B (en) 2016-04-13
US20110314438A1 (en) 2011-12-22
KR20130114592A (en) 2013-10-17
US8898637B2 (en) 2014-11-25
AU2011255477A1 (en) 2012-11-22
JP5937577B2 (en) 2016-06-22
US20120023475A1 (en) 2012-01-26
KR101829406B1 (en) 2018-02-19

Similar Documents

Publication Publication Date Title
CN105868039B (en) A kind of method, system and equipment for management software problem report
US8423954B2 (en) Interactive container of development components and solutions
US8095911B2 (en) Method and system for utilizing development components
CN104993946B (en) Appraisal procedure, the device and system of gray scale publication
US7747494B1 (en) Non-determinative risk simulation
US11340872B1 (en) Method and system for generating dynamic user experience applications
DE112016002120T5 (en) Development and sales platform for software
CN107845033A (en) Air control report-generating method, device, equipment and computer-readable recording medium
CA3033815A1 (en) System and method for automatic learning of functions
US20090169008A1 (en) System and method for tracking testing of software modification projects from a wireless mobile device
US20130124971A1 (en) Real time web script refresh using asynchronous polling without full web page reload
US11368554B2 (en) Systems and methods for regulating service behavior
KR101193985B1 (en) Method for doing a survey using a mobile
CN114037523A (en) Letter service test method, device, equipment, medium and program product
WO2022119929A1 (en) Systems and methods for administrating a federated learning network
US20160086114A1 (en) Service-based consulting framework
CN113495498A (en) Simulation method, simulator, device, and medium for hardware device
CN113378346A (en) Method and device for model simulation
Deepadharshini et al. Probabilistic Model Deployement for Fake URL Clicks on Designated Mobile Application
CN115705188A (en) Front-end page generation method and related device
US20070260928A1 (en) System and method for engineered decoupling in a development environment
Salcedo NutriMAC: A Web-based GIS for the Nutritional Monitoring and Assessment of Children 0-71 Months
US20140279254A1 (en) Systems and methods for configuring and provisioning products
Erler et al. Adaptation and Extension of a Digital Marketing System

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: American California

Applicant after: Google limited liability company

Address before: American California

Applicant before: Google Inc.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant