WO2012024212A1 - Method and device for optical alert recognition - Google Patents
Method and device for optical alert recognition Download PDFInfo
- Publication number
- WO2012024212A1 WO2012024212A1 PCT/US2011/047737 US2011047737W WO2012024212A1 WO 2012024212 A1 WO2012024212 A1 WO 2012024212A1 US 2011047737 W US2011047737 W US 2011047737W WO 2012024212 A1 WO2012024212 A1 WO 2012024212A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- error
- alert
- image data
- recited
- display
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B5/00—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N35/00—Automatic analysis not limited to methods or materials provided for in any single one of groups G01N1/00 - G01N33/00; Handling materials therefor
- G01N35/00584—Control arrangements for automatic analysers
- G01N35/00722—Communications; Identification
- G01N35/00871—Communications between instruments or with remote terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0706—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
- G06F11/0736—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in functional embedded systems, i.e. in a data processing system designed as a combination of hardware and software dedicated to performing a certain function
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0706—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
- G06F11/0748—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a remote unit communicating with a single-box computer node experiencing an error/fault
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0751—Error or fault detection not based on redundancy
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0766—Error or fault reporting or storing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/324—Display of status information
- G06F11/327—Alarm or error message display
Definitions
- the field of the invention is related to real-time or pseudo-real-time remote monitoring of error occurrences and/or consumable inventory status of a plurality of assay testing instruments and, more specifically, to remote monitoring of assay testing instruments of varied manufacture and having manufacturer-specific protocols, proprietary software and applications.
- Each of the monitored assay testing instruments includes an associated controller that is generally, but not necessarily, located proximate to the associated monitored assay testing instrument.
- Many instrument controllers are adapted to transmit local controller display images to a remote location. Local controller display images graphically represent data, parameters, and status and inventory information concerning the operation of the respective monitored assay testing instrument.
- the multiple-process assay system further, includes at least one remote monitoring unit having a processor and a display device, e.g., a monitor screen.
- the remote monitoring unit is in communication with the controllers via a communication network.
- the remote monitoring unit is adapted to enable a single user to monitor the operating and alert status of and to control the operation of the controllers and, thereby, of their associated assay testing instrument from a single, remote location.
- an 121 (“instrument-to-informatics”) protocol enables the associated controller of a monitored assay testing instrument to transmit error occurrence data and/or consumable inventory status data to the remote monitoring unit.
- the remote monitoring unit's processor uses such data to provide a visual, auditory, and/or electronic alert message, alerting the user of an error state, e.g., of the need to replenish dwindling consumable articles, of expiry of a reagent batch, of a need for scheduled maintenance or unscheduled repairs, and the like.
- the associated controller of one or more of the monitored assay testing instruments which is to say, a "non-conforming controller" is not programmed to transmit or otherwise is incapable of transmitting error occurrence data and/or consumable inventory status data to the remote monitoring unit in a useable format that can be read by or is compatible with the remote monitoring unit.
- remote monitoring units to create an automatic visual, auditory, and/or electronic alert message (s) for non-conforming controllers and their corresponding assay testing instrument, to alert the user of the time and location of the occurrence error, of the need to replenish dwindling consumable articles at a discrete monitored assay testing instrument, and the like, even though the controller of one or more of the monitored assay testing instruments is not programmed to transmit error occurrence data and/or consumable inventory status data in a form that is readable by or compatible with the processing unit of the remote monitoring unit .
- a method of, diagnostic software for, and a laboratory process manager capable of providing a visual, auditory, and/or electronic alert message (s) to a user monitoring a plurality of assay testing instruments or any computer or processing device using a remote monitoring unit are disclosed.
- the method, diagnostic software, and laboratory process manager use display data that are transmitted by controllers associated with the assay testing instruments to the remote monitoring unit at the remote monitoring site via RFB (remote frame buffer) protocol, which is well known to those of ordinary skill in the art.
- RFB remote frame buffer
- a method for remotely displaying an error state of an assay testing instrument or any processing device or controller via a network includes generating and transmitting display images representing the operating status of the controller associated with an assay testing instrument; receiving the display images transmitted by each of the plurality of controllers at a remote monitoring unit; displaying the display images on a display device; comparing each display image to an alert (error) image (s) stored in a database therefor; and transmitting an alert (error) message indicative of the error state when any of the display images matches an alert (error) image.
- the method further includes displaying the alert (error) message on the display device, e.g., as a static or a dynamic alert (error) flag or message window that is coupled to an image of the discrete assay testing instrument shown on the display device.
- the method includes determining whether or not the display image denotes an error state in the assay testing instrument; creating a new alert (error) image that is identical or substantially identical to the discrete display image for each of the display images that denotes an error state; and storing the new alert (error) image in the database therefor.
- First and second comparison region can be designated within the display image of an error state.
- Optical character recognition (OCR) can be performed on the data within the second comparison region.
- FIG. 1 is an illustrative isometric, display screen image of a specific zone in a laboratory in accordance with the present invention
- FIG. 2 is a flow chart of a method for creating an error image recognition rule and for transmitting an alert message when a discrete error image is recognized in accordance with the present invention
- FIG. 3 is an illustrative display screen image in which FIG. 3A shows an exemplary pop-up window for designating first and second regions and for creating an error image recognition rule in accordance with the present invention and FIG. 3B shows an exemplary menu for creating an alert error rule for a discrete alert state;
- FIG. 4 is the illustrative display screen image of FIG. 1 further having a potential alert state at one of the assay testing instruments in accordance with the present invention.
- FIG. 5 is the illustrative display screen image FIG. 4 further displaying an alert (error) flag at the assay testing instrument at which an error has occurred.
- machine-readable medium having stored, machine-readable instructions, or representations of such instructions, enabling an electronic processing machine to perform the described method.
- machine-readable medium includes, but is not limited to, solid-state memories, optical and magnetic disks, and any electrical or electromagnetic signal representing information .
- Heydlauf discloses providing "integrated event ( 'flag' ) management to notify remote users in real-time of a mechanical or inventory problem or potential problem associated with one of the monitored assay systems and/or one of the controllers.
- flag management can provide pop-up flag images and/or pop-up display windows on the monitor display screen of the remote monitoring unit, to alert remote users of mechanical and/or inventory issues associated with specific controllers and/or monitored assay system.
- the fifth application can include a flag management button, e.g., on a home screen image, that provides data on all flag events, such as time of occurrence, time of acknowledgement, actions taken, and the like. These data can be filtered using a plurality of parameters such as, for example, specific date, specific time, date range, time range, by assay test, by instrument type, by specific instrument, by criticality of flag, and so forth.”
- a KVM over-IP device not so adapted but that, instead, uses a dedicated controller and potentially-specialized video capture hardware to capture keyboard, video, and/or mouse signals; to compress and to convert these signals into data packets; and to transmit the compressed and converted data packets over a network, e.g., a local area network (LAN) , a wide area network (WAN) , a telephone network, an Ethernet link, the Internet, and so forth, to a remote console application.
- a remote monitoring unit operating the remote console application subseguently unpacks and reconstitutes the dynamic graphical image data.
- This arrangement allows multiple controllers, which may or may not have an associated monitored assay testing instrument, to be controlled remotely across a LAN, WAN, telephone line, Internet, and the like using designated protocols.
- an illustrative display screen image 20 at a remote monitoring unit is shown.
- the salient features of the monitor screen image 20 includes an isometric, three-dimensional image 50 of a particular zone in a laboratory or work environment, e.g., a "Chemistry" zone 91, a plurality of static or dynamic thumbnail images 70, and a zone dashboard 90.
- a "Chemistry" zone 91 a plurality of static or dynamic thumbnail images 70
- a zone dashboard 90 e.g., a "Chemistry" zone 91
- the image 50 is "virtual"
- real-time imagery of the laboratory can also be used.
- the zone dashboard 90 includes, inter alia, an instrument alert or "flag" summary section 92 that provides an at-a-glance summary of the number and variety of instrument alert flags that have been raised on discrete monitored assay testing instruments disposed in the "Chemistry" zone 91 of the laboratory. Alert flags associated with a discrete assay testing instrument are generated and appear automatically as described in Heydlauf or as described hereinafter as potential or existing errors, consumable resource shortages, and/or other problems or shortcomings associated with the particular instrument in the particular zone occur.
- instrument flag summary section 92 of FIG. 1 Three varieties of instrument flags are shown in the instrument flag summary section 92 of FIG. 1, to provide visual indicia of the severity or criticality of the error: critical (red) summary flags 88, warning (yellow) summary flags 81, and user-defined (blue) summary flags 83.
- Critical (red) summary flags 88 refer to those errors that will stop or hinder further testing.
- Warning flags provide advance notice of pending inventory errors as well as of non-critical mechanical problems.
- User-defined flags correspond to user-created or user-defined events that can be associated with a specific instrument. Non-exclusive examples of user-defined flags include scheduled events such as instrument calibration dates, routine or scheduled maintenance dates, and the like.
- a fourth flag variety 85 also appears in the zone dashboard 90: a system (orange) summary flag 85 that applies to the system as a whole and to no particular assay testing instrument. For example, if a software update for the system were available, its availability could be reflected using a system summary flag 85.
- the numbers shown in the summary flags 81, 83, and 88 of the instrument flag summary section 92 correspond to the number of instrument flags currently raised and displayed in the virtual image 50 of the zone 91 on the monitor screen image 20. No flags will appear in the virtual image 50 for system summary flags 85.
- instrument flags 80 can include inventory errors, e.g., empty or near empty consumable levels, empty or near empty reagent levels, expired or nearly expired reagent, communication errors, quality control issues, mechanical errors, and/or optical character recognition (OCR) occurrences.
- inventory errors e.g., empty or near empty consumable levels, empty or near empty reagent levels, expired or nearly expired reagent
- communication errors e.g., quality control issues, mechanical errors, and/or optical character recognition (OCR) occurrences.
- OCR optical character recognition
- instrument flag 80 will continue to appear and the number appearing in the corresponding instrument flag summary section 92 will reflect all raised instrument flags.
- Instrument flag management for managing workflow and providing a means for auditing reaction time and actions taken (and by whom) to resolve errors, is one of the many applications of Heydlauf.
- an instrument flag and/or an alert message window When an instrument flag and/or an alert message window is generated and appears or pops-up in the monitor screen image 20, it can include or be accompanied by a visual warning to alert a remote user of its occurrence.
- the color of the instrument flags 80 can correspond to one of the three flag varieties, i.e., red, yellow or blue.
- a symbol or icon can be included in the instrument flag 80 to indicate the type of alert, viz., whether it is an inventory issue, a mechanical issue, an information issue, and so forth.
- initial notification of an error associated with an instrument can include a moving or waving instrument flag 80 and/or a blinking asterisk or other symbol (not shown) located in an upper corner of the instrument flag 80.
- the dynamic, waving motion of the instrument flag 80 and/or the blinking asterisk features can be programmed to continue until a user has acknowledged the instrument flag 80. Once acknowledged, the waving motion of the instrument flag 80 and/or the blinking asterisk will stop; although, the instrument flag 80 itself will continue to be displayed until the cause for the alert has been addressed.
- an instrument flag 80 can be performed by clicking or double-clicking on the image of the instrument flag 80 or by clicking or double-clicking on the respective assay testing instrument shown in the virtual image 50 of the zone 91. If acknowledgement does not occur within a pre-established period of time, the processing unit and/or the controllers can be adapted to generate an escalation message.
- a blinking exclamation point (not shown) can be generated and displayed in the virtual image 50, e.g., in an upper corner of the instrument flag 80; the size of the escalated alert flag can be made larger than other, non- escalated instrument flags 80; and so forth.
- a larger blinking or non- blinking exclamation point can also be included in a pop-up message window in the monitor screen image 20, to indicate the escalated status of the unacknowledged alert (error) message.
- the blinking exclamation points can continue to blink until the user finally acknowledges the respective instrument flag 80. Once acknowledged, the exclamation points can disappear; the size of the instrument flag 80 can return to the standard size; the respective instrument flag 80 will stop waving; and the like.
- the processing unit and/or the controllers can be adapted to cause the instrument flag 80 to move or wave again and, if resolution is still not accomplished, the processing unit and/or the controllers can be adapted to generate another escalation message as previously described.
- Thumbnail images of each of the assay testing instruments in the zone of the laboratory are shown on the monitor display screen 20 of the remote monitoring unit in real-time or pseudo- real time in a static or dynamic (scrolling) fashion.
- Real-time imaging refers to the capability of the system to record and transmit images of happenings and events at each monitored assay system continuously and in real-time.
- Pseudo-real time imaging refers to the capability of the system to detect changes in local imaging at the controller level and to transmit any changes to the remote monitoring unit after detection. Because there is a short lag time between detection and transmission, the thumbnail images would be displayed in pseudo-real time.
- Pseudo-real time imaging can also refer to the capability of the system to transmit images of happenings and events at each monitored assay testing instrument at a periodic, predetermined time interval, such as a refresh feature on commercially available software and Internet Web sites.
- thumbnail images 82a, 84a, 86a, 87a, and 95a shown in the static or scrolling display 70 corresponds to a discrete assay testing instrument 82, 84, 86, 87, and 95 disposed in the zone of the laboratory corresponding to the virtual image 50.
- instrument 89 inter alia, is included in the virtual image 50
- a corresponding thumbnail image is not shown in the scrolling display 70 because the dimensions of the monitor display device and monitor display screen 20 are not large enough to display all of the thumbnail images at once, i.e., statically.
- the thumbnail images are scrolled across the thumbnail display area dynamically.
- monitor display screens having relatively larger screen areas can provide a greater screen area to accommodate relatively more and/or relatively larger static thumbnail images than monitor display screens with relatively smaller screen areas. Much of this again depends on the desired quality and detail of the static thumbnail image on the monitor display screen, which are affected, for example, by the number of pixels per static thumbnail image, which can vary from display screen to display screen and from user to user. Some users may be predisposed to include a single horizontal row of static thumbnail images on a monitor display screen while other users may prefer more than one horizontal row of static thumbnail images on the monitor display screen.
- instrument 95 in the zone 91 is "non-conforming", which is to say that, the controller of the assay testing instrument 95 is incapable of providing alert (error) messages to the processing unit of the remote monitoring unit in a language or using a protocol that the processing unit, e.g., the software, of the remote monitoring unit can read, translate or otherwise use. More specifically, the non-conforming assay testing instrument 95, by itself, is incompatible with the previously-described, integrated event flag management.
- the processing unit of the remote monitoring unit and/or the controllers of the "conforming" instruments 82, 84, 86, 87, and 89 are adapted to transmit real-time or pseudo-real-time graphical images associated with the respective monitored assay testing instruments for display as a monitor display image 20 on the monitor display screen as long as the monitored assay testing instrument is operating and coupled to the remote monitoring unit via a network.
- Each of the real-time or pseudo- real-time thumbnail images 82a, 84a, 86a, and 87a displayed as display images 20 on the monitor display screen of the remote monitoring unit is identical to the graphical images being shown locally on the display device associated with the respective controller of the monitored assay testing instrument.
- thumbnail image (s) 95a of the non-conforming instrument (s) 95 shown in the monitor display image 20 on the display device of the remote monitoring unit is substantially similar or identical to the graphical image (s) being shown in real-time or pseudo-real-time on a display device associated with the controller of the non-conforming instrument 95.
- an alert (flag) message can still be automatically displayed in accordance with the following method.
- thumbnail images of the images shown on local display screens of a plurality of controllers are shown statically or dynamically in real-time or pseudo-real time on a monitor display screen of a remote monitoring unit (STEP 1) . This occurs whether or not the assay testing instrument is conforming or non-conforming.
- the thumbnail images in the display screen image 20 are identical or virtually identical to the graphical images being shown on the local display device associated with the respective controllers of the conforming or non-conforming system.
- the thumbnail images 95a must be monitored continuously by an alert user for any changes to the image shown on the monitor display screen (STEP 2) .
- the processing unit of the system causes an alert notification, e.g., a flag, an icon, a message window, and the like, to be displayed on the display screen image 20 according to the pre- established rule associated with the error rule image (STEP 4) .
- an auditory alert, an electronic mail message, an electronic page, a cell phone or telephone call, and the like can automatically be sent (STEP 5) in addition to the visual alert notification (STEP 4).
- the human user monitoring the monitor display device of the remote monitoring unit will be trained to respond to, i.e., acknowledge, the occurrence and recognition of any alert notification (STEP 6), including notification from a non ⁇ conforming instrument.
- Acknowledgement of the alert notification (STEP 6) can include, for purposes of illustration and not for the purposes of limitation, simply notifying or signaling the system that the user is aware of the alert notification and/or that the cause of the alert notification has been addressed or resolved, e.g., new reagent has been added to the instrument, an expired reagent has been replaced by a fresh reagent, a mechanical malfunction has been repaired, and so forth.
- the processing unit of the system can be programmed to escalate the alert notification (STEP 7) .
- Escalation (STEP 7) is discussed in greater detail above and in the Heydlauf patent .
- a new error rule image is not created and the processing unit of the system continues to perform remote monitoring of the thumbnail images shown on the monitor display screen 20.
- a separate database or memory can be provided for non-error rule images for use in comparing a change in a thumbnail image 95a of a non-conforming instrument, to preclude the user from having to ascertain that the change to the thumbnail image 95a does not require a new error rule image.
- the user also creates an alert symbol, icon, message window, and the like (STEP 12) to be displayed on the monitor display screen 20 of the remote monitoring unit and attributes that symbol, icon, message window, and the like to the error rule image; so that, whenever subsequent high resolution data corresponding to the thumbnail images 95a match the error rule image, the symbol, icon, message window, and the like will automatically be displayed in the display screen image 20. More particularly, the symbol, icon, message window, and the like attributed to a particular error rule image can be displayed pointing to, referring to or coupled to the corresponding virtual image of the non-conforming instrument 95 in the virtual image 50 of the zone 91.
- processing unit software associated with the remote monitoring unit will be designed to generate a pop-up menu or message window 30 that includes a variety of action options.
- the pop-up window menu or message window 30 in FIG. 4 includes an "AUTO SCROLL” function, a "SIZE TO FIT" function, a "REMOTE CONTROL LIS 4" function, and a "CREATE OAR RULE” function.
- the user By clicking or double-clicking on the "CREATE OAR RULE" option 31 in the pop-up menu or message window 30, the user signals the processing unit of the remote monitoring unit to create a new error rule image (STEP 9) .
- the processing unit of the remote monitoring unit will, first, create, display, and store an identical or substantially identical digital copy of the display screen image 32 (FIG. 3A) that is shown on the display screen of the controller of the non-conforming instrument at the time of the error message as well as in one of the thumbnail images 95a in a display screen image 20 on the monitor display device of the remote monitoring unit.
- the digital copy of the display screen image 32 can include a background image 39, e.g., a blue or black screen, and any non-error-related data, as well as an image of the error message box 38 from the display screen image 32 of the display device of the controller of the non-conforming instrument.
- the pre-rule screen image 35 can also include a prompt message box 33 and a movable cursor 34.
- the prompt message box 33 enables the user to create an error rule image for the alert and the movable cursor 34 enables the user to highlight, designate or tag a discrete region (s) (STEP 10) on the displayed digital image 32, e.g., the entire image of the error message box 38 or some portion thereof, which can be used for future rule image-matching comparisons (STEP 3) .
- an appropriate alert message After reading the alert message text 37 contained or written in the image of the error message box 38, the user is able to determine the alert state of the non-conforming instrument 95, which is to say, the nature of the error or problem (STEP 11) in order to create an appropriate alert message whenever another digital image matches the rule image. For example, if the text message 37 in the image of the error message box 38 of the non-conforming instrument 95 mentions approaching an expiration date or expiration time for a reagent being used in the instrument, an appropriate alert message can read "REPLACE REAGENT A", which will appear automatically (STEP 4) . Referring to FIG. 5, an appropriate alert message includes a visual alert icon or symbol, e.g., a flag 36, that appears on the virtual image of the instrument 95 in the zone 50 (STEP 12) on the digital image shown on the display screen of the remote monitoring unit .
- a visual alert icon or symbol e.g., a flag 36
- the cursor 34 can also be used to designate a second, discrete region 37 within the digital image 32 of the error message box 38, e.g., the original text of the error message or alert state.
- Data corresponding to the second, discrete region (s) 37 can also be stored in memory provided therefor (STEP 13), for use during image-matching operations.
- Optical character recognition (OCR) can then be used with data of the second, discrete region (s) to ascertain the specific alert state, e.g., by matching the alert message contained in the second discrete region 37 with the texts of saved images of error messages or alert states.
- an illustrative interactive rule setting screen 40 is shown.
- the rules in the rule setting screen 40 are changeable and govern what series of events occurs once an error message or alert state in connection with a non ⁇ conforming instrument 95 that matches a stored error rule image is discovered.
- the rule setting screen 40 can include at least one of: an identification of the non ⁇ conforming instrument 95 involved; an indication as to whether image-matching is based on the first and/or based on the second, discrete region; whether or not electronic messages, e.g., email, pager, text messages, and the like, are to be transmitted and, if so, to which addresses; escalation instructions; and an enable/disable function for the rule.
- Optical alert image recognition at the first discrete region levels is not necessarily binary, but rather should allow matching at a 90 to 98 percent probability level.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Automatic Analysis And Handling Materials Therefor (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/816,973 US20130207812A1 (en) | 2010-08-16 | 2011-08-15 | Method and Device for Optical Alert Recognition |
CN2011800393058A CN103026341A (en) | 2010-08-16 | 2011-08-15 | Method and device for optical alert recognition |
EP11818616.2A EP2591418A1 (en) | 2010-08-16 | 2011-08-15 | Method and device for optical alert recognition |
JP2013524905A JP2013542477A (en) | 2010-08-16 | 2011-08-15 | Method and apparatus for optical alarm recognition |
AU2011292257A AU2011292257B2 (en) | 2010-08-16 | 2011-08-15 | Method and device for optical alert recognition |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US37388910P | 2010-08-16 | 2010-08-16 | |
US61/373,889 | 2010-08-16 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2012024212A1 true WO2012024212A1 (en) | 2012-02-23 |
Family
ID=45605402
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2011/047737 WO2012024212A1 (en) | 2010-08-16 | 2011-08-15 | Method and device for optical alert recognition |
Country Status (6)
Country | Link |
---|---|
US (1) | US20130207812A1 (en) |
EP (1) | EP2591418A1 (en) |
JP (1) | JP2013542477A (en) |
CN (1) | CN103026341A (en) |
AU (1) | AU2011292257B2 (en) |
WO (1) | WO2012024212A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2016541036A (en) * | 2013-09-30 | 2016-12-28 | エムティーエス システムズ コーポレイション | Mobile application interaction user interface for remote computing devices monitoring test devices |
US10445202B2 (en) | 2012-02-07 | 2019-10-15 | Mts Systems Corporation | Mobile communication platform for test system applications |
US10796108B2 (en) | 2017-12-07 | 2020-10-06 | Mts Systems Corporation | Integrated machine information management with application interactive user interface |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10089443B2 (en) | 2012-05-15 | 2018-10-02 | Baxter International Inc. | Home medical device systems and methods for therapy prescription and tracking, servicing and inventory |
JP2013247003A (en) * | 2012-05-28 | 2013-12-09 | Sony Corp | Charge control device for secondary battery, charge control method for secondary battery, charged state estimation device for secondary battery, charged state estimation method for secondary battery, deterioration degree estimation device for secondary battery, deterioration degree estimation method for secondary battery, and secondary battery device |
US20140372809A1 (en) * | 2013-06-12 | 2014-12-18 | Ge Medical Systems Global Technology Company Llc | Graphic self-diagnostic system and method |
US10028658B2 (en) | 2013-12-30 | 2018-07-24 | Welch Allyn, Inc. | Imager for medical device |
US10237421B2 (en) | 2016-12-22 | 2019-03-19 | Datamax-O'neil Corporation | Printers and methods for identifying a source of a problem therein |
EP3679448A4 (en) | 2017-09-06 | 2020-10-21 | Siemens Healthcare Diagnostics Inc. | Alert-enabled passive application integration |
US10699419B2 (en) * | 2018-09-10 | 2020-06-30 | Siemens Aktiengesellschaft | Tracking and traceability of parts of a product |
FR3088785B1 (en) * | 2018-11-16 | 2020-10-30 | Blade | MAINTENANCE PROCEDURE FOR A VIRTUAL MACHINE HOSTED ON A SERVER OF A HOST COMPUTER |
WO2020116106A1 (en) * | 2018-12-06 | 2020-06-11 | 株式会社日立ハイテク | Automatic analysis device |
WO2021159132A1 (en) | 2020-02-07 | 2021-08-12 | Siemens Healthcare Diagnostics Inc. | Performance visualization methods and diagnostic laboratory systems including same |
US20220020481A1 (en) | 2020-07-20 | 2022-01-20 | Abbott Laboratories | Digital pass verification systems and methods |
CN114017092A (en) * | 2021-11-04 | 2022-02-08 | 山东东山新驿煤矿有限公司 | Coal mine operation ventilation system |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050156737A1 (en) * | 2004-01-08 | 2005-07-21 | Al-Khateeb Osama O.M. | Image data analysis security camera |
US20050198063A1 (en) * | 1997-07-01 | 2005-09-08 | Thomas C. D. | Methods for remote monitoring and control of appliances over a computer network |
US20090322874A1 (en) * | 2007-04-23 | 2009-12-31 | Mark Knutson | System and method for remote surveillance |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
AU2002230821A1 (en) * | 2000-10-30 | 2002-05-15 | Ocean Systems Engineering Corporation | Environment and hazard condition monitoring system |
US7139938B2 (en) * | 2002-04-01 | 2006-11-21 | Capital One Financial Corporation | System and method for providing common event format using alert index |
US8069239B2 (en) * | 2004-07-20 | 2011-11-29 | Beckman Coulter, Inc. | Centralized monitor and control system for laboratory instruments |
BRPI0817039A2 (en) * | 2007-08-24 | 2015-07-21 | Stratech Systems Ltd | Runway surveillance system and method |
US8648910B2 (en) * | 2007-12-27 | 2014-02-11 | Siemens Healthcare Diagnostics Inc. | Method and apparatus for remote multiple process graphical monitoring |
-
2011
- 2011-08-15 JP JP2013524905A patent/JP2013542477A/en not_active Withdrawn
- 2011-08-15 EP EP11818616.2A patent/EP2591418A1/en not_active Withdrawn
- 2011-08-15 CN CN2011800393058A patent/CN103026341A/en active Pending
- 2011-08-15 WO PCT/US2011/047737 patent/WO2012024212A1/en active Application Filing
- 2011-08-15 AU AU2011292257A patent/AU2011292257B2/en not_active Ceased
- 2011-08-15 US US13/816,973 patent/US20130207812A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050198063A1 (en) * | 1997-07-01 | 2005-09-08 | Thomas C. D. | Methods for remote monitoring and control of appliances over a computer network |
US20050156737A1 (en) * | 2004-01-08 | 2005-07-21 | Al-Khateeb Osama O.M. | Image data analysis security camera |
US20090322874A1 (en) * | 2007-04-23 | 2009-12-31 | Mark Knutson | System and method for remote surveillance |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10445202B2 (en) | 2012-02-07 | 2019-10-15 | Mts Systems Corporation | Mobile communication platform for test system applications |
JP2016541036A (en) * | 2013-09-30 | 2016-12-28 | エムティーエス システムズ コーポレイション | Mobile application interaction user interface for remote computing devices monitoring test devices |
US10255156B2 (en) | 2013-09-30 | 2019-04-09 | Mts Systems Corporation | Mobile application interactive user interface for a remote computing device monitoring a test device |
US10671503B2 (en) | 2013-09-30 | 2020-06-02 | Mts Systems Corporation | Mobile application interactive user interface for a remote computing device monitoring a test device |
US10796108B2 (en) | 2017-12-07 | 2020-10-06 | Mts Systems Corporation | Integrated machine information management with application interactive user interface |
Also Published As
Publication number | Publication date |
---|---|
EP2591418A1 (en) | 2013-05-15 |
US20130207812A1 (en) | 2013-08-15 |
AU2011292257B2 (en) | 2014-07-10 |
JP2013542477A (en) | 2013-11-21 |
AU2011292257A1 (en) | 2013-01-10 |
CN103026341A (en) | 2013-04-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
AU2011292257B2 (en) | Method and device for optical alert recognition | |
US9398265B2 (en) | Method and apparatus for remote multiple-process graphical monitoring | |
US20050182831A1 (en) | Configuration display apparatus for computer, computer configuration display method, and computer configuration display program | |
CN109545366B (en) | Method and system for summarizing diagnostic analyzer related information | |
US20190075031A1 (en) | System and Methods Utilizing Dataset Management User Interface | |
US7124119B2 (en) | Communication between intelligent agents and humans in a distributed system environment | |
CN104011611A (en) | System and method for managing industrial processes | |
JP2007193419A (en) | Plant monitoring device | |
US9183202B2 (en) | Notification methods for non-programmatic integration systems | |
US9824204B2 (en) | Systems and methods for synchronized sign-on methods for non-programmatic integration systems | |
EP3327528A1 (en) | Information processing apparatus, information processing system, information processing method, and information processing program | |
US10755553B2 (en) | Collaborative alarm monitoring system and method | |
US10482741B2 (en) | Multi-frame display for a fire protection and security monitoring system | |
US9081632B2 (en) | Collaboration methods for non-programmatic integration systems | |
US20120102397A1 (en) | Safety methods for non-programmatic integration systems | |
US10924362B2 (en) | Management of software bugs in a data processing system | |
CN111066038A (en) | Alarm enabled passive application integration | |
US20170255605A1 (en) | Annotations and Issue Tracking for Graphical Data | |
JP2000056823A (en) | Data monitoring system | |
JP3031888B2 (en) | Display device | |
US20120185124A1 (en) | Automated vehicle-wide data acquisition and issue management system | |
JP2000148331A (en) | Display device | |
US20240289708A1 (en) | Monitoring and alerting system and method | |
CN117457158A (en) | Integration and prioritization of patient emergency notifications | |
CN112367368A (en) | Method for quickly positioning equipment fault |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201180039305.8 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11818616 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2011292257 Country of ref document: AU Date of ref document: 20110815 Kind code of ref document: A |
|
REEP | Request for entry into the european phase |
Ref document number: 2011818616 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011818616 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2013524905 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13816973 Country of ref document: US |