JP6800937B2 - Systems and methods for collection confirmation and sample tracking during clinical use - Google Patents

Description

The present invention relates to systems and methods for identifying and tracking sample collection procedures, and more particularly to systems and methods that operate hand-free with wearable electronic devices.

Blood sampling is a common health care procedure that involves drawing at least one drop of blood from a patient. Blood samples are generally taken from patients in hospitalized, home care, and emergency rooms by finger stick, heel stick, or venipuncture. After being collected, blood samples can be analyzed to obtain medically useful information, including chemical composition, hematology, coagulation, and the like.

Similarly, fluid delivery to a patient is achieved using a variety of vascular access devices, including syringes, automatic syringes, pen-type syringes, catheters, and infusion devices. In the medical setting, a clinician or technician makes an injection by inserting a needle into a patient's vein. The therapeutic agent is delivered to the patient directly or passively via the needle. For example, a medical technician can inject a fluid by pushing a piston rod and a plunger through an injection tube and drain the fluid from there. Alternatively, the therapeutic agent may be passively delivered from the IV bag via an infusion set.

Prior to performing the fluid sampling or delivery procedure, the clinician or technician is responsible for obtaining any of the required medical devices and devices. The clinician or technician can also be responsible for making an initial examination of the patient by examining body temperature, heart rate, or respiration. The clinician or technician will review the description in the patient's chart, or other printed instructions, to ensure that these initial steps are performed correctly and that any necessary equipment is available. Can be guaranteed. Alternatively, the technician can scan the bar code or identification on the obtained equipment to record that some items are in use. The medical professional then obtains a fluid sample or injects the fluid. After the sample has been collected or the fluid has been infused, the clinician or technician may need to properly document the completion of the procedure. For example, the clinician or technician can write in the patient's chart a statement that includes the time the procedure was completed, a description of the procedure performed, and a record of any unusual or unexpected event. In addition, when obtaining a liquid sample, a medical professional may be responsible for closing or sealing the sample collected with a tamper-proof seal to ensure that the sample is not damaged prior to testing. .. The technician or clinician may be responsible for verifying the seal, for example, by signing his or her name or initials on a tearable label covering the seal.

In many medical facilities, these preparation, confirmation, and documentation tasks are performed manually by a clinician or technician when or after the procedure has been completed. For example, the clinician or technician may be responsible for manually labeling each collected fluid sample with identification information about the patient before transferring the sample for examination. Similarly, the clinician or technician can be responsible for manually recording the type of fluid injected into the patient in the patient's chart. Medical professionals can also be expected to record the date and time when the procedure was performed. In some situations, the clinician or technician is equipped with electronic recording means, such as a computer, laptop computer, table PC, smartphone, or similar easily mobile computing device. However, the technician or clinician is still responsible for manually entering the information into the electronic device. Alternatively, the data entry technician may be responsible for electronically entering information about the procedure performed, based on records taken by the clinician or technician. In addition, many large medical facilities utilize electronic patient databases for electronically storing patient information. However, even such electronic databases still require manual data entry by clinicians or technicians, or post-data entry based on contemporaneous records taken by clinicians or technicians. To do.

Numerous manual steps required before, during, and after a liquid sampling or liquid delivery procedure create an opportunity for user error. User errors can result in incomplete or incorrect treatment, or loss of patient data. For example, a clinician or technician may inject an incorrect volume, incorrect fluid type or concentration, or may not be able to obtain a sufficient amount of fluid sample for the test to be performed. is there. Medical clinicians or technicians may also forget to correctly record that a fluid sample was obtained or under what conditions the sample was obtained. In addition, clinicians or technicians may fail to correctly record which patients provided a particular fluid sample. These problems can harm the patient, or at least some fluid sample treatments may need to be repeated. Therefore, there is a need for systems for delivering fluids to patients and for obtaining laboratory specimens to assist clinicians or technicians in performing and recording medical procedures. The system should be configured to thwart errors that commonly occur during such procedures and should provide visual or auditory warnings when errors occur. The system should also be automatically integrated with existing patient data systems, so information about the type of treatment to be performed is readily accessible to the clinician or technician. Further confirmation that the procedure has been performed and relevant information about the procedure may be provided automatically and directly to the patient's medical record to ensure that patient data is not lost. The systems and methods described below are provided to address some or all of these issues.

According to one aspect of the present disclosure, an object of the present disclosure is to provide a system and method for performing collection confirmation and sample tracking during clinical use.

The systems and methods provided herein reduce the risk of drug infusion and delivery errors, and clinical work to identify, confirm, and record drug and fluid delivery to patients. Improve the flow of. These identification, confirmation, and documentation tasks are accomplished in real time and during clinical use.

The system is designed to provide such benefits without the use of hands during clinical use. Similarly, through reporting the results, systems and methods for establishing a reliable chain of custody from the time of collection are also provided. The system establishes specimen identification, collection confirmation, sample and result tracking, and integration into patient data systems in an automatic, non-clinically disruptive, hand-free manner. Make it possible. Finally, the system can further provide improved visualization to enhance success during insertion of the vascular access device. Systems and methods include vascular anatomical structure visualization and mapping, venous and device selection assistance, and means for successful insertion of vascular access devices (or other subcutaneous infusion devices), and indwelling vascular access during use. Evaluation of devices (peripheral IV catheters, blood collection sets, peripheral inserted central venous catheters (PICCs), central venous lines, etc.) can be included.

Given these alleged benefits, aspects of the invention provide a system for hand-free confirmation and tracking of test samples. The system includes wearable electronic devices that are configured to be worn by the user. The device includes a housing, at least one imaging sensor enclosed in or associated with the housing, and a data transmission interface for sending or receiving data from the external electronic device. It has a microprocessor for managing one image sensor and a data transmission interface, and a program for acquiring and processing an image acquired by the image sensor. The system further includes a sampling device for collecting liquid samples in the sample container and at least one identification tag attached to or integrally formed with the sampling device or sample container. The identification tag contains or is associated with a tracking code. The program processes the image captured by the imaging sensor to identify the identification tag and determine the tracking code. In addition, the program sends a confirmation and tracking code that the sample was taken to an external electronic device via a data transmission interface. Image capture, image processing, and data transmission are automatic without the need for user input or manipulation.

According to embodiments of the present invention, the system includes wearable electronic devices configured to be worn by the user. The wearable electronic device includes a housing, at least one imaging sensor associated with the housing, a data transmission interface for sending data to or receiving data from the external electronic device, and at least one imaging sensor. , And at least one microprocessor for managing the data transmission interface, and a program for acquiring and processing images acquired by at least one imaging sensor. The system further includes a sampling device for collecting liquid samples in a sample container and at least one identification tag attached to or integrally formed with the sampling device or sample container, the at least one identification tag. Includes or is associated with a tracking code. The program processes the image captured by at least one imaging sensor to identify at least one identification tag and determine the tracking code. The program also sends a confirmation and tracking code that the sample was taken to an external electronic device via a data transmission interface. Image capture, image processing, and data transmission are automatic without the need for user input or manipulation.

In some configurations, the system further includes a data reporting accessory for providing data to the user. Optionally, image capture, image processing, and data transmission are managed programmatically without the use of hands. The sampling device can be a vascular access device, a phlebotomy set, a renal catheter, a tissue sampling device, or any combination thereof. The vascular access device can be a peripheral IV catheter, a PICC line, or a central venous line.

The wearable electronic device can be a head-worn computer, and the data reporting accessory can be a projection prism configured to project a virtual layer into the user's field of view. The virtual layer can include a user interface, which includes a patient information part, a sample collection confirmation part, an identification tag confirmation part, or any combination thereof.

The at least one imaging sensor can be a digital camera or a digital video camera. The wearable electronic device can further include a program, sample collection confirmation, tracking code for the sample container, or data storage medium for storing images captured by at least one imaging sensor. Wearable electronic devices can also include peripheral data input devices that allow the user to manually enter data into the wearable electronic device. In some configurations, the peripheral data input device is a motion sensor, gyroscope, pressure sensor, accelerometer, touchpad, touchscreen, or any combination thereof. Optionally, the wearable electronic device may include a power source within the housing of the wearable electronic device.

The data transmission interface may be configured to send data to and receive data from the patient data system. The information received from the patient data system includes information about the procedure to be performed, the type of fluid sampling device used, the amount of fluid sample required, the suggested vascular access site, or the patient. be able to. The information sent to the external electronic device should include confirmation that the sample was obtained, the time and date the sample was obtained, information about the location of the injection site, a tracking code for the sampling device, or any combination thereof. Can be done.

The identification tag can include a two-dimensional bar code, a three-dimensional bar code, a short-range wireless communication device, or a label having text readable by an optical character recognition algorithm. The program processes the image to locate the position marker on the sampling device and at least one identification tag in the captured image based on the position of the position marker. The identification tag can be identified.

Optionally, the system can also include a patient identification device that includes, or is associated with, identification information about the patient, which can be read by at least one imaging sensor of the wearable electronic device. The system also uses a portion of the fluid sample to inspect the fluid sample for one or more of the following: chemicals, electrolytes, hematology, blood gas concentration, coagulation, or cardiac markers: It can include a point-of-care testing device that is configured to receive. The point-of-care test device can be a test piece, dipstick, immunoassay, glass slide, or diagnostic cartridge.

The program can be configured to capture an image of the point of care test device after the point of care test device has been exposed to a portion of the fluid sample, and the program will capture the image of the point of care test device. Process to determine the results of the Point of Care testing device. The point-of-care test device can contain identification information about the point-of-care test device, or an identification tag associated with it, and the program processes the image of the point-of-care test device to determine the identification information. To do.

The program confirms that a liquid sample has been collected by processing a series of images of the sample container captured by at least one imaging sensor to determine when the minimum amount of liquid is present in the sample container. Can be decided. In some configurations, the wearable electronic device warns the user when the minimum amount of liquid is collected.

According to another embodiment of the invention, the method for identifying and tracking the obtained liquid sample is to collect the liquid sample in the sample collection container of the sampling device and the liquid sample is collected. When, using a wearable electronic device with at least one imaging sensor, to take a series of images of the sample collection container and to determine when a given amount of liquid is present in the sample collection container. Includes steps to process a series of images in real time. The system also includes a step of notifying the user wearing the wearable electronic device that the sample collection is complete when an image showing the sample collection container filled with a predetermined amount of liquid is obtained. The process is performed automatically without the need for user operation.

In some configurations, the method is also a series to identify and extract information about the sampling device or sample collection container from an identification tag attached to or integrally formed with the sampling device or sample collection container. Includes steps to process at least one of the images in. The information extracted from the identification tag can include a tracking code for the sampling device. The method can further include confirming that the sample has been collected and transmitting the tracking code for the sampling device to an external source via the data transmission interface of the wearable electronic device. In some configurations, the wearable electronic device is a head-worn computer that includes a projection prism configured to project a virtual layer containing information and instructions into the user's field of view.

For the operating methods and functions of these other features and properties of the invention, as well as the combination of related elements and parts of the structure, and the economics of manufacture, see the accompanying drawings, all of which form part of this specification. It will become clearer if the following description and the scope of the attached claims are examined. In the figures, similar reference numbers specify the corresponding parts in the various figures. However, it should be clearly understood that the drawings are for illustration and illustration purposes only and are not intended to define the limitations of the present invention. As used herein and in the claims, the singular forms "one (a)", "one (an)", and "the" indicate other forms with a clear context. Unless otherwise specified, it also includes multiple referents.

According to the present invention, it is possible to provide a system and a method for performing collection confirmation and sample tracking during clinical use.

FIG. 5 is a schematic view of a hand-free system for ensuring delivery of a patient's drug and fluid according to the principles of the present invention. It is the schematic of the field of view display for the system of FIG. FIG. 6 is a schematic of a hand-free system for ensuring delivery of a patient's drug and liquid having a wearable electronic device in the form of eyeglasses and a patient identification device according to the principles of the present invention. It is a schematic of a handless system for ensuring delivery of a patient's drug and liquid having a wearable device in the form of a wrist-mounted device and a patient identification device according to the principles of the present invention. FIG. 5 is a schematic view of a hand-free system for ensuring delivery of a patient's drug and fluid according to the principles of the present invention. FIG. 6 is a schematic diagram of a hand-free system for establishing test specimen identification and performing sample tracking according to the principles of the present invention. It is the schematic of the field of view display for the system of FIG. FIG. 6 is a schematic representation of a system for performing improved visualization during insertion of an invasive device according to the principles of the present invention. FIG. 6 is a schematic representation of a system for performing improved visualization during insertion of an invasive device according to the principles of the present invention. It is the schematic of the field of view for the system of FIG. 9 is a schematic view of the field of view for the system of FIG.

The following description is provided to allow one of ordinary skill in the art to make and use the aforementioned embodiments intended to carry out the present invention. However, various modified forms, equivalent forms, modified forms, and alternative forms will still be readily apparent to those skilled in the art. Any and all such modified, modified, equivalent, and alternative forms are intended to be included in the spirit and scope of the invention. However, it should be understood that the present invention may take various alternative variants and sequences of steps, unless expressly specified the opposite. It should also be understood that the particular devices and processes shown in the accompanying drawings and described herein are merely exemplary embodiments of the invention. Therefore, the specific dimensions and other physical properties associated with the embodiments disclosed herein should not be considered limiting. To facilitate understanding of the present invention, the accompanying drawings and descriptions show preferred embodiments thereof, from which the present invention, various embodiments, configurations, and methods of operation of its structure, and many others. Benefits can be understood and recognized.

The present invention is directed to systems and methods for hand-free identification, confirmation, and documentation of various medical procedures during clinical use, including invasive procedures that require procedural guidance. To do. Exemplary treatments include, but are not limited to, drug and fluid delivery, specimen or sample collection, and / or vascular access treatment. The system improves on existing patient data systems by collecting and recording data without the need for positive action by a user or operator, hereinafter referred to as a medical technician. More specifically, the system is a scanner, camera, which does not require a user or operator, hereinafter referred to as a medical technician, to manually record information, or is currently required by existing patient data systems. Allows you to perform the required identification, verification, and documentation tasks without having to interact with data entry devices such as keyboards or touch screens. The system improves clinical workflow and data entry integrity by reducing the likelihood of technician error. In addition, the system reduces the risk of infection to patients and healthcare technicians. In particular, the medical technician does not have to touch or operate the data input device, reducing the risk of contamination of the input device.

The system can be integrated with existing equipment, including disposable medical devices already in use, as well as existing patient databases and patient monitoring software. Therefore, the system does not require further equipment or capital base improvements on the part of the healthcare facility. Similarly, the system can be easily integrated with the procedures and practices of a particular medical facility.

With reference to FIG. 1, a system 10a for guaranteeing and verifying fluid delivery to hands-free patients during clinical use is shown. The system 10a effectively obtains data on the liquid delivery performed from an external source such as a patient data system, records that the liquid treatment has been performed, and sends confirmation of the treatment to the external source. The system 10a is provided to reduce the risk of drug error at the time of administration by providing real-time patient information, warnings, drug identification, and administration confirmation without the use of hands.

System 10a includes wearable electronic devices. In a preferred and non-limiting embodiment, the wearable electronic device is a wearable computer with an augmented reality display, hereinafter referred to as "wearable electronic device 18". An exemplary wearable electronic device 18 is available from Google Corp. , Mountain View, eyeglasses incorporating Google Glass technology created by CA, and the like. Although the Google Glass technique is not currently commercially available, it is believed that those skilled in the art could readily implement it in the systems of the invention if Google Glass or similar products are commercially available. Alternatively, the wearable electronic device 18 can be a head-mounted face shield that also incorporates Google Glass technology. In a further embodiment, the wearable electronic device 18 can be a wrist-mounted device that also incorporates Google Glass technology. The wearable electronic device can also have other shapes and configurations based on the particular liquid delivery procedure performed. For example, wearable electronic devices may be buttons or pins attached to medical technician clothing, wrist-worn watches, necklaces, pendants, or any other type of invisible, easy-to-carry item. be able to.

The wearable electronic device 18 is a hat, helmet, face shield, wristband, or frame having a display portion 16, such as a projection prism, face shield, or wrist-worn display that extends into the medical technician's field of view. 20 (eg, one spectacle frame) can be included. The display portion 16 may be arranged close to the wearer's eyes, such as in the case of a projection prism. The display portion 16 is configured to present a virtual layer, such as the projected layer of FIG. 2, within the wearer's field of view, which is equivalent to a larger screen viewed from a greater distance. For example, in the example where the display portion 16 is a projection prism, the projection prism can be placed less than 1 inch (2.54 cm) from the wearer's eyes, but viewed at a distance of 8 feet (2.44 m) 25. Presents a viewable screen that appears similar to an inch (63.5 cm) screen. The augmented reality display projects a virtual projection or layer 22 that includes a portion of the wearer's field of view. The overall view of the medical technician is not blocked by the virtual layer 22. The medical technician can still "see" the real layer 24 beyond or adjacent to the virtual layer 22.

In another embodiment, the data display portion 16 of the wearable electronic device 18 can be a visual display, such as a standard monitor for a computer or smartphone. Standard monitors include liquid crystal displays (LCDs) and light emitting diode (LED) displays. The monitor can be an external screen or device that can be formed integrally with a wearable electronic device or that can be viewed by a technician. The wearable electronic device 18 can also convey treatment and patient information to the technician via other means of communication, including but not limited to audio alerts or palpable confirmation. For example, the wearable electronic device 18 can make a beep or vibrate to notify the technician that the problem has been identified.

The wearable electronic device 18 further includes a computer housing 26 or housing attached to the frame 20. The housing 26 can be of any size required to hold the required associated electronic device. Related electronic devices within the computer housing 26 can include data acquisition devices and sensors, data transmission and communication circuits, data processing circuits, and data display and warning devices and circuits. It is desirable that the computer housing 26 be sufficiently small and lightweight so that the operator does not substantially hinder the wearer or the operator when performing normal functions and operations.

The data collection device can include various sensors and recording devices to obtain information about the medical procedure being performed. For example, the data acquisition function may include one or more image capture devices 12 such as a digital camera for image or video capture. In some embodiments, the image capture device 12 may be adapted to provide a stationary or moving 2D image (s), or a 3D anatomical scanning geometry. An image or video camera is typically a set of charge-coupled device (CCD) or complementary metal oxide semiconductor (CMOS) imaging sensors, lenses, multifunction video control / digital signal processing (DSP) chips, and discrete components (a set of discrete components. For example, capacitors, resistors, and connectors). The video control / DSP chip can be formed integrally with the camera 12. Alternatively, the image processing can be performed either on a wearable electronic device or even on an external controller or computer. The lens can include a focal range useful for imaging as described herein, or the video camera can include an autofocus function. Similarly, the lens can be equipped with a zoom function. The video control component on the chip performs several image acquisition tasks, while the DSP component on the same chip performs data processing algorithms such as noise reduction and simple forms of data compression and encryption. The digital output from the video control / DSP chip can be in parallel or serial form, depending on the particular chip design and input configuration at the next data processing or interface stage. The system can also include a microphone for auditory (eg, voice command) input, a touch mechanism or trackpad for tactile input, an accelerometer, a gyroscope, and the like.

Electronic communication and data transmission devices, as well as electronic circuits, can include a data transmission interface 14 for sending and receiving data to and from external sources such as external electronic devices. The external device can be a data storage device, an external computer, a local computer network consisting of several computing devices, or the Internet. For convenience, these external electronic devices will be collectively referred to as the cloud 15. The data transmission interface actually creates a personal area network (PAN) that includes a wearable electronic device 18, a data transmitter, and an external receiver attached to an external source. A PAN is a computer network used for communicating (eg, transmitting data) within a computer device including a telephone and a personal digital assistant (PDA) in close proximity to the technician's body. PANs can be used to communicate within the personal device itself (internal communication) or to connect to higher level networks and the Internet (uplink). Wireless personal area networks (WPAN) are made possible using wireless network technologies such as Bluetooth®, WiFi, Z-Wave, and ZigBee. A WiFi (eg, IEEE802.11a, b, g, n) networking protocol can be used, which is advantageous because it has a larger transmission range than Bluetooth®, but as a result, it consumes more power. It also has a quantity. A suitable external source for receiving data transmitted from the device and optionally processing the data is to back up a computer, tablet PC, or smartphone, and / or an external hard drive, or stored data. Includes other devices.

In some embodiments, the data transmission interface 14 is integrated with an existing patient data system or database. Mobile patient data acquisition and recording systems integrated for use with handheld electronic devices, such as smartphones, may also be integrated with the data transmission interface 14. These systems use handheld electronic devices to allow users to remotely update patient data. The updated information is transferred to a data storage location where it can be accessed for future use. Commercially available software platforms can be used to coordinate the recording of patient data and can include features that make such data readily accessible at the time of nursing. As a result of such integration of the existing database with the software platform, the system 10a of the present invention may automatically update the patient data stored in the patient data system or database as the procedure is performed. it can. However, unlike existing systems, the system 10a automatically updates patient data without the need for direct input from a medical technician. Therefore, the system 10a is fully and automatically integrated into the patient data system. In contrast, previously, data was manually entered by a healthcare technician after the procedure was performed.

In some embodiments, the wearable electronic device 18 can also include a data storage device 21 formed integrally with the computer housing 26. In one non-limiting embodiment, the storage device 21 is a digital recording device such as a disk drive, which records data on a storage medium. In another embodiment, the storage medium is flash memory. The storage medium can be any type of non-volatile memory, such as, for example, a magnetic data storage medium such as a hard disk drive or magnetic tape, or a flash-based memory. Flash memory is a non-volatile computer storage chip that uses NAND or NOR type memory found in MicroSD cards, USB flash drives, or solid state drives. File systems optimized for flash memory (solid state media) include embedded transaction file systems (ETFS), exFat, and FFS2 systems. The storage medium can be a random access memory (RAM) or a read-only memory (ROM). The memory may be removable from the device or permanently mounted within the housing and transferable to an external device via the data transmission interface 14.

In one embodiment, the wearable electronic device 18 further comprises one or more power sources, such as a battery 23, contained within the computer housing 26. The battery 23 comprises one or more electrochemical cells that convert the stored chemical energy into electrical energy. A non-limiting example of a useful battery is a lithium ion battery. Lithium-ion batteries are rechargeable batteries often used in electronic devices. The capacity of the lithium-ion battery is preferably sufficient to power the wearable electronic device for a full day or longer. However, in some cases where the device does not operate continuously, batteries with smaller capacities are more suitable to reduce device dimensions and weight. Other types of batteries suitable for use in devices include nickel cadmium (NiCd) and nickel metal hydride (NiMH) batteries. The battery 23 is preferably rechargeable, in which case the device further includes a battery recharge port.

The electronic devices and circuits included in the housing 26 of the mountable electronic device 18 are controlled by one or more controllers such as a microprocessor. A microprocessor is a chip that includes one or more integrated circuits that receive data and process the data according to instructions stored in the chip's memory. A microprocessor, along with other functions, typically manages data collection from various sensors and digital cameras 12, directs data storage by a data storage system, and allocates system resources among electronic components to consume power. Reduce the amount and reduce the need for overlapping electronic systems. The microprocessor can include software for controlling various data collections and software for processing the collected data. Similarly, the microprocessor can include software for displaying the collected data as well as for interacting with the technician. Alternatively, the controller can facilitate the transfer of data and instructions between the wearable electronic device and an external processing device such as an external computer or workstation.

With reference to FIG. 1 in succession, the system 10a includes a liquid delivery device 28 such as a prefilled syringe, a pen-type syringe, an automatic syringe, an infusion set, a catheter, or any combination thereof. The wearable electronic device 18 is configured to identify and recognize the liquid delivery device 28. To facilitate identification and recognition, the liquid delivery device 28 may include an identification tag 30 formed integrally with or attached to it. The identification tag 30 is a standard 2D barcode, 3D barcode (eg, quick read (QR) code, etc.), as well as various manufacturer-specific encoded codes known in the art. It can be a computer-readable tag and label. The identification tag 30 may be integrally formed on or within the liquid delivery device 28. Alternatively, the identification tag 30 may be printed on the liquid delivery device 28 or on a label adhered to the liquid delivery device 28. In any case, the wearable electronic device 18 is configured to identify the identification tag 30 and extract information from it. The identification tag 30 can provide information about the liquid delivery device 28 and the liquids contained therein, including drug type, total liquid volume, manufacturer, needle size, liquid warranty period, and the like.

In some embodiments, the wearable electronic device 18 can include an image processing function for identifying and extracting data from the image of the identification tag 30 captured by the digital camera 12. The image processing function may be configured to identify various position markers on the liquid delivery device 28. The position marker may point to the identification tag 30, which can trigger the wearable electronic device 18 to start capturing the image of the identification tag 30. When the appropriate image is captured, the image processing function evaluates the image and extracts information from the identification tag 30. The image processing function can also include a time delay, such as, for example, 3 seconds, which means that the wearable electronic device 18 has an image of the identification tag 30 until the position marker is in the field of view for at least 3 seconds. Means not start an attempt to process or read. The time delay feature saves computational power by limiting when image processing takes place. In particular, only the identification tag 30, which is of sufficient interest to the technician to see for a few seconds, is scanned and information is extracted from it. In some embodiments, the identification tag 30, which is not in the technician's field of view for at least 3 seconds, is assumed to be insignificant and therefore unreadable.

Alternatively, the identification tag 30 may be a standard printed letter, a standard medical label containing the name and amount of the drug or therapeutic agent. The wearable electronic device 18 may be configured to capture an image of the label and read the information contained therein. For example, system 10a can include an optical character recognition algorithm configured to extract data from printed text, such as a printed medical label. Therefore, the system can be used with existing liquid delivery devices 28 and syringes, and may not require the addition of additional tags or electronic positioning devices.

In another alternative embodiment, the identification tag 30 is a radio frequency identification (which can project a readable signal that can be identified and read by a scanner, transmitter, or antenna associated with the wearable electronic device 18. It can be a Near Field Communication (NFC) device, such as an RFID) tag or electronic device. Including NFC devices, or RFID tags, simplifies the data extraction process. In particular, no image processing is required to extract information from NFC devices or RFID tags.

In some embodiments, the identification tag 30 uses a selectively visible type of ink that is only readable at a particular time, such as just before liquid delivery takes place. Can be printed on or attached to. After the liquid delivery is complete, another or modified identification tag 30 becomes visible, indicating the end of use or the completion of infusion.

The system 10a can also include means for identifying when the liquid delivery has taken place, or optionally, means for estimating the liquid delivery volume. The system 10a can monitor liquid delivery by tracking the movement of an actuating or liquid draining mechanism, such as the plunger 32 or piston rod 34, during the liquid delivery procedure. In some further embodiments, the identification tag 30 can be used to estimate the position of the plunger 32 or piston rod 34. For example, image processing software can also record the initial position of the plunger 32 or piston rod 34 relative to the position of the identification tag 30. When the plunger 32 or piston rod 34 moves relative to the position of the identification tag 30, the image processing software determines that the injection has started. When the plunger 32 or piston rod 34 advances a predetermined distance from the identification tag 30, it can be assumed that the injection is complete.

The system 10a may also be configured to automatically locate the plunger 32 or piston rod 34 with respect to other markers on the liquid delivery device 28. In some embodiments, the marking can also be a graduated line or indication on the injection barrel. In that case, the movement of the plunger 32 or piston rod 34 with respect to the marking can determine not only the initiation and administration, but also the amount of fluid delivered. In a further embodiment, the plunger 32 can include a coating or indicator that is easily identifiable on the image captured by the digital camera 12. Alternatively, the coating can be readily detectable by another scanning element, such as an ultraviolet or infrared detector. Such devices or scanners can also be associated with wearable electronic devices 18. Improving the visibility of the plunger 32 can improve the estimation of the quantity by improving the recognition by the image processing function and enabling more accurate measurement of the position of the plunger 32.

In some embodiments, additional electronic or mechanical sensors can be associated with the liquid delivery device 28 to provide further evidence or confirmation of liquid delivery. For example, the sensor may be located near the injection needle 36 of the liquid delivery device 28. The sensor can record when the needle 36 was properly inserted into the patient and also ensures that the fluid has passed through the needle 36 and has been drained to the patient. The data collected by the sensor can be transmitted to the wearable electronic device 18 by a wireless transmitter, preferably a wireless transmitter such as Bluetooth®, adapted for short-range communication. Including the sensor directly on the liquid delivery device 28 increases the complexity of the liquid delivery device 28 and associated electronic devices, but is advantageous as it provides further confirmation that the liquid delivery to the patient has actually taken place. is there.

In addition to being used to locate and read the identification tag 30 and to provide end-of-dose confirmation, the image capture function of the wearable electronic device 18 also preserves the liquid delivery procedure. , And can be used to record. For example, an image of the infusion process (eg, inserting a needle into a patient's vein), an image of an empty syringe, and an image of a discarded syringe can be obtained and included in the patient's electronic record. Each of these images can be incorporated with a time stamp. Timestamps can be used to update a patient's medical record with the exact time the procedure was performed.

The wearable electronic device 18 is configured to present the data collected by image capture and other functions of the system to the technician in an easy-to-use and easily accessible way. It is desirable that the data be presented to the technician in a clear and concise manner directly within the technician's field of view via the display portion 16 of the wearable electronic device 18.

An exemplary field of view 100 seen by a technician wearing the wearable electronic device 18 and including both the virtual layer 22 and the real layer 24 is shown in FIG. As shown in FIG. 2, the virtual layer 22 includes a user interface 110. The user interface 110 can include a heading bar 112 or title that contains information about the patient, such as the patient's name and patient identification number. The heading bar 112 or title can also include a description of the medical procedure performed, or information about the type of infusion or required fluid delivery device. The user interface 110 can also include a syringe volume indicator icon 114 indicating the estimated fluid remaining in the syringe. The icon 114 allows the operator to easily determine when all the fluid has been infused into the patient and therefore serves as an end-of-dose indicator. Finally, the user interface 110 can also display the identification tag confirmation icon 116. The icon 116 can also be shown when the identification tag 30 is identified on the image obtained by the image capture function. Further, the identification tag confirmation icon 116 can indicate confirmation that the identification tag 30 is correct, such as when the liquid delivery device 28 required for the particular procedure to be performed is recognized. If the location of the identification tag 30 cannot be determined, or if an incorrect identification tag 30 is found, the icon 116 can display a warning to indicate to the technician that the injection should not be performed.

As described above, the virtual layer 22 does not block the operator's overall view 100. Therefore, the operator can still see the reality layer 24 even if the user interface 110 is visible. Therefore, the technician can see any warning while preparing to take action. As a result, the technician's chances of missing a warning due to his busy preparation for infusion are substantially reduced.

With reference to FIG. 3A, a system 10b for ensuring delivery of a patient's drug or fluid is shown according to a further embodiment. System 10b includes a wearable electronic device 18 having a frame 20 in the form of head-worn eyeglasses. In system 10b of FIG. 3A, the wearable electronic device 18 is the patient in step (a) to visualize the liquid delivery device and in step (b), as described anywhere in this specification. Can be used to visualize patient ID 38 in the form of a wristband 40 worn around the wrist of the patient. It should be noted that steps (a) and (b) can be accomplished in any order herein. The wristband 40 includes an identification tag 42 having a QR code. The patient ID 38 also includes a unique visual marker or display near the identification tag 42 or QR code to trigger the image capture function of the wearable electronic device 18. When the unique marker is identified, the wearable electronic device 18 with the frame 20 in the form of head-worn eyeglasses begins processing the captured image to find and read the QR code. Patient ID 38 is also an NFC tag (eg RFID), visual coding such as text that can be identified and read by image processing functions, Bluetooth® or similar short range data transmission antennas, and other Additional coding or identification techniques, such as proximity sensing techniques, can be included. The patient ID 38 contains information about the patient and, optionally, can be directly linked to an electronic patient record on the patient data system. The patient ID 38 can further include a position-providing technique, such as GPS, to determine the position of the patient. The technician scans the patient ID 38 to obtain information about the patient, such as the procedure to be performed or the schedule for when future fluid delivery should be performed, as well as any known medical condition of the patient. Can be done. The patient ID 38 links the wearable electronic device 18 to the patient's electronic record so that any information or document taken during the procedure, such as the time of infusion, the duration of infusion, or the amount of fluid infused. The conversion can also be sent to the patient's electronic record and stored there. As discussed herein, the display of information is provided to the wearer of the wearable electronic device 18 on the spectacle-mounted display 16 described with reference to FIG.

With reference to FIG. 3B, as described above with reference to FIG. 3A, a system 10b for ensuring delivery of a patient's drug or fluid is shown, and the wearable electronic device 18 is a smartwatch. Etc., provided in the form of a wrist-mounted display 19. As described herein, except that the display 16 is tuned via a wrist-mounted display 19 that is physically located on the user's wrist but provides similar functionality to the display 16. , The system of FIG. 3B functions similarly to the system of FIG. 3A. In system 10b of FIG. 3, the wearable electronic device 18 is the patient in step (a) to visualize the liquid delivery device and in step (b), as described anywhere in this specification. It can be used to visualize patient ID 38 in the form of a wristband 40 worn around the wrist. It should be noted that steps (a) and (b) can be accomplished in any order herein.

Referring to FIG. 4, a further embodiment of the system 10c for ensuring fluid delivery to the patient is shown. The system 10c is via a fluid delivery device 28 such as an infusion set 44 that includes various fluid containers 46, namely an intravenous treatment (IV) bag, an associated tube 48, and a catheter 50 that extends into the patient's veins. , Used to administer fluid to patients. Tube 48 may further include one or more access ports 52. The syringe 54 may be connected to the access port 52 to provide the patient with additional or different types of medical fluid. As in the previously described embodiment, the system 10c includes a wearable electronic device 18, a liquid delivery device 28, and an identification tag 30 readable by the wearable electronic device 18. The identification tag 30 includes, or is associated with, identification information about the liquid delivery device 28. System 10c confirms the procedure to be performed and the fluid to be infused, identifies the required devices and devices, confirms that the fluid is being administered to the patient, and records the procedure.

In some embodiments, the system 10c may be configured to ensure that the infusion set 44 is properly installed and connected. For example, the image processing function can identify various connection points of the infusion set 44, the liquid container 46, and the catheter 50. System 10c will then verify that the elements are properly connected. If the proper connection is not identified, the system 10c can warn the technician to check the connection before initiating the liquid delivery. System 10c can also provide various other device maintenance warnings. For example, the system 10c can warn the technician when a predetermined indwelling time limit is reached. Similarly, the system 10c can alert the technician at various intervals when system maintenance should be performed.

In some further embodiments, the system 10c is configured to visually monitor the drip count of the infusion set 44 to establish and confirm the rate of fluid delivery. For example, the image capture function of the wearable electronic device 18 can record the time of insertion of the catheter 50. The image capture function will then record the outflow port of the liquid container 46 for a predetermined period of time to record the droplets flowing from the catheter 46 into the infusion set 44. The image processing function of the wearable electronic device 18 identifies individual droplets and estimates the fluid delivered to the patient over a period of time. The system 10c may be configured to send a warning when a sufficient period of time has passed for delivery of a given volume.

Referring to FIGS. 1 to 4, when using the systems 10a, 10b and 10c, the technician wears a wearable electronic device 18. For example, a technician can wear a wearable electronic device 18 at the beginning of a shift or before initiating a particular infusion or liquid delivery procedure. When the wearable electronic device 18 is in place and powered on, the wearable electronic device 18 provides technicians with initial instructions such as a patient to visit and a task list with actions to be taken. You can display the start screen provided to. The wearable electronic device 18 can also ask a technician to verify his identity to ensure that the correct person has been given the correct instructions. Upon first contact with the patient, the technician uses the wearable electronic device 18 to capture an image of the patient ID 38. Based on the information about or associated with patient ID 38, medical information about the patient is obtained, including the infusions performed. The information obtained is displayed on the user interface 110 with instructions for performing the procedure. Based on the displayed instructions, the technician will provide the necessary items for injection, including the appropriate liquid delivery device 28 and, optionally, a medical liquid vial or cartridge to be loaded into the liquid delivery device 28. Obtainable. When the operator "sees" the injection device and other items within the field of view 100, the wearable electronic device 18 identifies and reads the identification tag 30 attached to the item. The systems 10a, 10b, and 10c can examine the medical items obtained to ensure that only the items required for treatment are available and no additional items are needed. Once the item has been obtained and identified by the system, the instructions on user interface 110 are updated. For example, if the correct item is obtained, a confirmation message may be displayed on the user interface 110. A warning may be presented to the technician if an incorrect item is obtained. The warning can be visual, such as an icon displayed on the user interface 110, as well as tactile, audible, or any combination thereof.

After the item is obtained, the technician will perform a medical procedure. When the technician takes action, the injection operation is monitored to verify the injection. For example, the wearable electronic device 18 can ensure that the needle 36 has been inserted into the patient's skin and that the fluid has been drained from the fluid delivery device 28. Information including the time and date of infusion, as well as the name of the technician, can be recorded and transmitted to an external system such as a patient data system. Therefore, the collected information may be automatically included in the patient's digital record. Information may also be sent to a third party insurer for billing or, if necessary.

In some additional embodiments, time and date information can be used to establish a baseline for future medical procedures. The baseline can be used to determine how long the infusion should be performed, or to set the number of times to examine the infusion set 44. Similarly, when injecting from a syringe or syringe, baseline time data can be used to schedule the next treatment. Based on this information, the systems 10a, 10b, 10c may be configured to indicate an alarm or warning to the user interface 110 when subsequent treatment should be provided.

According to another aspect of the invention, and also with reference to FIGS. 5 and 6, systems 10d and methods for capturing and tracking relevant patient, treatment, and / or sample information are shown. System 10d may provide tracking of relevant patient, treatment, and / or sample information at multiple "points of connection" throughout the process, including through the process of obtaining test specimens for medical testing and diagnosis. it can. This can be done in the order of the test, with test result reporting and integration with EMR.

Because System 10d provides an automatic, non-clinically destructive, hand-free method for establishing specimen identification, collection confirmation, sample and outcome tracking, and integration into patient data information systems. It is advantageous. System 10d is configured to track the process control of the liquid sample starting when the sample is obtained and can be continued through sampling or reporting results. In addition, the system 10d is automatically integrated with the existing patient data system, so that information about the types of samples collected and about the tests performed can be displayed to the technician.

As in the previously described embodiment, the system 10d includes a wearable electronic device 18. System 10d also includes a blood sampling device 56 that can be part of a larger extravasation fluid collection system. The blood sampling device 56 provides a fluid connection between the larger extravascular fluid collection system and the interior of the sample collection container 55. The blood sampling device 56 generally includes a spike or port at its distal end. The specimen collection vessel 55 can be inserted onto a spike or port to collect liquid samples via a blood sampling device. The blood sampling device 56 may also be configured to release a small amount of liquid sample, such as a discontinuous number of droplets, through a proximal opening in the blood sampling device 56. The extravasation system includes an invasive access device (shown in FIG. 10) such as a blood sampling device 56, a specimen collection vessel 55, an extension tube 57, and a vascular access device. Alternatively, the sampling device 56 may be directly connected to the intravenous catheter hub without the use of additional components such as an extension tube 57 to reduce the number of components and simplify the collection and sampling process.

System 10d can further include a point of care inspection device 58. Specimens, glass slides, and diagnostic cartridges are point-of-care testing devices 58 that receive blood samples and test blood for one or more physiological and biochemical conditions. Examples of inspection cartridges include i-STAT® inspection cartridges from the Abbott Enterprise Group. Testing cartridges, such as i-STAT® cartridges, can be used to test for a variety of conditions, including the presence of chemicals and electrolytes, hematology, blood gas concentration, coagulation, or cardiac markers.

As is known in the art, the blood sampling device 56 can be disconnected from the extravascular fluid collection system, as indicated by the arrow 210. The disconnected blood sampling device 56 is used to guide a portion of the fluid sample to the point of care testing device 58, as indicated by arrow 212. When the liquid sample is read by a testing instrument and used with it, the point of care testing device 58 is subjected to a color change or some other identifiable conversion, and some analytes are present. Identify whether it is present in the liquid sample. In some embodiments of system 10d, the wearable electronic device 18 may be configured to capture an image of the point of care inspection device 58 used. The image processing function may be configured to read the point of care inspection device 58 and determine the inspection result. Alternatively, the image can be transmitted to a remote location, where the image can be read or interpreted by an appropriate medical professional.

As in the previous embodiment of system 10d, system 10d attaches an identification tag 30 attached to various containers or blood sampling devices 56, invasive access devices such as vascular access devices, and point of care testing device 58. Including. The identification tag 30 includes, or is associated with, identification information about the container or device. The identifying information can include the type of blood sampling device 56 or container, the procedure in which the container or device is used, or the volume of sample obtained. The identification information can also include a unique designation for each container, allowing the system 10d to track the container after placing the liquid sample in it. As previously described in the present invention, the identification tag 30 can be any type of display, such as a barcode or QR code that can be read by the image capture function of the wearable electronic device 18. The identification tag 30 can also be an NFC tag such as an RFID tag that can be read by an antenna or transmitter associated with the wearable electronic device 18.

The system 10d can also include a patient ID 38, such as a wristband 40 worn by the patient. The patient ID 38 includes an identification tag 30 such as a QR code that includes or is associated with patient information. The patient ID 38 allows the wearable electronic device 18 to access the patient's electronic information, such as patient information stored on an external patient database system. The wearable electronic device 18 is configured to receive patient data and display relevant information to the technician.

Referring to FIG. 6, the wearable electronic device 18 makes the virtual layer 22 including the user interface 110 visible to the technician. The user interface 110 is designed to provide the technician with important relevant information in a way that is easy to understand. An exemplary user interface 110 is shown in FIG. However, it should be understood that the information, content, and design of user interface 110 may be adapted to a particular type of medical facility or procedure. The appearance of the interface 110 can also be adapted based on the preferences of a particular technician.

User interface 110 includes one or more pieces of information displaying relevant information about the patient, tests performed, containers used, and other relevant data. This information can be used to collect / track information from the inspection sequence through the entire process, collect and prepare samples and supplies, confirm the correct inspection device and end of shelf life, obtain inspection samples, track process control, sample processing, samples. It can include inspections, results, time, date reports, and other relevant information throughout process control. It can also include warning the clinician or EMR for any abnormalities in the directed test procedure, patient information, or sample processing associated with the required test procedure, and process control requirements. For example, the user interface 110 can include a portion 118 that has patient identification information such as a patient ID number. The patient information portion 118 can also include information about the type of sample indicated and visual confirmation when the indicated sample is obtained. The user interface 110 can also include an identification tag portion, such as an identification tag confirmation icon 116. The identification tag confirmation icon 116 can include a visual display when the identification tag 30 is recognized and correctly read. The user interface 110 can also include a sample collection portion 120 indicating the icon 122 of the sample collection container, such as a test tube. Icon 122 can change its appearance when the sample is safely sealed in a container. In some embodiments, the icon 122 can visually indicate that the container is filled with a liquid sample and also display a visual warning when a sufficient amount of liquid is available. Can be done.

When used, the technician initiates by placing the patient ID 38 within the field of view 100 of the wearable electronic device 18 and scanning the patient ID 38 so that the patient information can be read by the wearable electronic device 18. be able to. Based on the patient information, details about the patient and the tests performed are displayed to the technician on the user interface 110. The technician can then collect the blood sampling device 56, and other items required for the particular procedure performed. In some embodiments, the wearable electronic device 18 recognizes each item as it is obtained by a technician, eg, by recognizing and reading the identification tag 30 attached to the item. Can be done. The user interface 110 can notify the technician after each required item has been acquired. User interface 110 can also display a warning if the required item has not yet been acquired or is not recognized.

The user interface 110 can then display instructions for obtaining a liquid sample. These instructions can include the required fluid volume, suggested vascular access sites, or any other relevant information. The technician then collects the sample in a blood sampling device 56 or other suitable container. The image capture function of the wearable electronic device 18 can capture an image of the sampling device 56 or the container filled with the sample, and can warn the technician when a sufficient amount of liquid is obtained. After the sample is obtained, the technician can seal the sampling device 56 or container. The image capture function of the wearable electronic device 18 can record that a sample has been obtained and can record the time and a unique identification number for the sampling device 56 or container. In this way, the container is electronically tied to a particular patient, reducing the likelihood of sample loss or identification to the wrong patient.

If a point-of-care test should be performed, details regarding the test can be provided to the technician. The technician prepares the inspection device 58, for example, by placing it on a table or other suitable surface. The surface is preferably white or a similar high contrast color in order to improve the image quality of the inspection device 58 acquired by the wearable electronic device 18. The identification tag 30 of the inspection device 58 is identified and recorded by the image capture function. The technician can then perform the test, for example by placing a drop of liquid sample on the test device 58. System 10d can wait for a predetermined period of time for the inspection to be performed and then obtain an image of the inspection device 58 used. The captured image can be processed to determine the test result. Alternatively, the technician can visually determine the test result and record the information using the data input function of the wearable electronic device 18. If the inspection device 58 is stored and needs to be sent to a laboratory or other facility, the image capture function will use the identification tag 30 and the identification tag 30 for the particular inspection device 58 used to ensure correct process control. Identification information can be recorded. As in the previous embodiment of the system 10, the wearable electronic device 18 monitors each step of the sample acquisition and inspection process. If the technician makes a mistake in the step, the user interface 110 will warn the technician and provide instructions to correct any of the mistakes.

According to another aspect of the invention and also with reference to FIGS. 7-10, for improved visualization and indwelling vascular access during insertion of an invasive access device such as the vascular access device 60. A system 10e for evaluating device 60 is shown. The vascular access device 60 includes, but is not limited to, syringes, subcutaneous needles, peripheral venous catheters, blood collection sets, central venous lines, or any combination of these elements, for infusion, or venous fluid. It can be any suitable device for taking samples. An exemplary vascular access device 60 is a straight, ported venous catheter such as an AUTOGUARD ™ shielded catheter by Becton, Dickinson and Company, an integrated peripheral venous catheter, a winged needle set, and a blood collection set. including. An exemplary catheter used with the system is shown in FIG. As in the previously described embodiment, the system 10e can be integrated with the patient data system to identify the medical procedure to be performed and to make treatment confirmation.

The system 10e includes the wearable electronic device 18 described in detail above. System 10e further includes a vascular access device 60. The vascular access device 60 may include one or more identification tags 30 that include, or are associated with, information about the vascular access device 60. The information can include needle thickness and length, as well as other relevant information required for a particular procedure. The system 10e can further include a patient ID 38 (shown in FIG. 3) worn by the patient. The patient ID 38 allows the system 10e to automatically identify the patient and may be linked to the patient's electronic record.

In some embodiments, the wearable electronic device 18 also includes, or is associated with, additional systems such as ultrasound or other scanning devices that enhance the anatomy externally or internally. This improved anatomy can assist the technician in positioning the vascular access device 60 by providing a visual indication of the location of the veins suitable for needle insertion (eg, virtual trace 62). .. The technician can orient the needle of the vascular access device 60 based on the position of the virtual trace 62.

In some embodiments, the virtual trace 62 is projected onto the technician's field of view 100 using the display function of the wearable electronic device 18. The virtual trace 62 can be a computer-generated image or icon showing where the veins are. The location of veins can be determined by a number of different image processing techniques. In one embodiment of the system 10e, the image of the injection site is captured by the image capture function of the wearable electronic device 18. Image processing performed on the captured image identifies various anatomical markers on the image. For example, the anatomical position of the part of the arm (eg, wrist, elbow, finger, etc.) can be identified. In an alternative embodiment, the anatomical marker can be placed directly on the outside of the patient's skin or applied to a bandage. The size and shape of the arm can be calculated based on the position of these anatomical markers, the distance between the markers, and the orientation of the arm with respect to the imaging function. After the position and dimensions of the arm have been identified, an approximate vein position can be estimated. Based on these estimates, the virtual trace 62 is projected into the technician's field of view 100 at an approximated position. The virtual trace 62 can be seen on the reality layer 24 of the field of view 100, including the patient's arm.

Referring to FIG. 8, in some embodiments, visualization based on anatomical positioning is performed by various external imaging devices such as ultrasound, infrared imaging, magnetic resonance imaging (MRI), or a combination thereof. Improves based on the readings obtained using. As shown in FIG. 8, the system 10e includes a control module 66 and an external ultrasonic monitor 64 attached to a wand 68 or a scanner. The control module 66 can include an integrated display. The ultrasound monitor 64 can be used to obtain an initial image of the anatomy of the patient's blood vessels before performing an invasive procedure. The resulting ultrasound images can help to anatomically distinguish between arteries and veins and help determine which veins are best suited for a particular vascular access. And it can assist in choosing the correct catheter size and length for a particular vein. Images of the injection site captured by the digital camera 12 can be captured simultaneously to facilitate alignment of the two images using ultrasonic scanning.

After the images have been acquired and the desired invasive access sites and veins have been determined, this location information is transmitted to the wearable electronic device 18 and the anatomical positioning information obtained by processing the captured images. Used with to determine the position with respect to the virtual trace 62. Approximate locations of preferred veins and injection sites are projected into the technician's field of view 100 (shown in FIG. 10). The virtual vein trace 62 can be color coded or animated to provide further information to the technician. For example, vein diameter information may be projected next to each virtual vein trace 62 to assist the technician in selecting veins of the appropriate size and also in selecting a catheter of the appropriate size. it can. Similarly, veins of different dimensions are displayed in different colors to assist in the selection process.

Integrating data obtained from imaging devices such as ultrasound improves the selectivity, accuracy, and specificity of external visualization information projected to the technician. Therefore, the technician can be confident that the displayed vein position is correct and that the vein is dimensionally suitable for the type of vascular access device 60 used.

Ultrasound images of the venous anatomical structure may be stored locally on a wearable electronic device 18 for inclusion in the patient's record or transmitted to an external data device such as a patient database system. Ultrasound images can then be automatically provided for subsequent vascular access therapy to assist with vein selection.

After the insertion has been performed, the system 10e may be configured to acquire a real-time ultrasound image to confirm that the needle of the vascular access device 60 has been correctly placed in the vein. Similarly, the system 10e may record time and date stamps for insertions and include such information in the patient's record. The system 10e can also record the location of the vessel insertion. This information can be used to prevent repeated insertions in the same area of the patient's body.

In some further embodiments, the ultrasound monitor 64 may be configured to provide real-time information to the technician. For example, the user interface 110 of the wearable electronic device 18 may be configured to provide the technician's field of view 100 with a real-time image obtained using the ultrasonic monitor 64. In this way, the technician can also "watch" the insertion process to ensure that the vascular access device 60 has been properly inserted into the desired vein. Such real-time information allows the technician to modify any changes in anatomical structure and device position that may occur during the insertion process. Similarly, such a real-time system can be useful in assessing the feasibility, location, and changes in the venous structure of the indwelling vascular access device 60. Therefore, the technician will be able to better determine when the indwelling vascular access device 60 needs to be removed or rearranged.

In a further embodiment, the wearable electronic device 18 provides a means for providing subcutaneous illumination on the patient's skin by projecting or radiating light, such as light provided by one or more LED bulbs or laser light pipes. Can include. The projected light can improve the visualization of veins and can be used to improve the quality of captured images. The enhanced and captured image can be used to improve the approximated virtual trace 62 provided by the image processing function. Intercannula illumination, or illumination with catheter stripes, can also be used to enhance the actual visualization of arteries and veins within the scope of the invention.

The invasive device of the system can also be composed of materials that can be magnetized for use in ultrasonic systems, where the ultrasonic system utilizes magnetic capabilities to improve visualization and invasive devices. Provides a means of projection in the form of a pathway as it moves towards the target anatomical structure.

Like the system 10e described above, the user interface 110 projected onto the virtual layer 22 of the technician's field of view 100 provides important information about the actions to be taken, the devices used, and the progress of the insertion process. It is advantageous to convey it to the technician easily and without using hands. Referring to FIG. 8, the overall user visual experience of the system 10e emphasizes the anatomical structure of the patient's blood vessels, resulting in improved insertion success for the technician's view 100 (FIG. 8). Includes having a virtual layer 22 projected onto (indicated by 10). FIG. 9 is a schematic view of a virtual vein trace 62 including a portion of the patient's arm.

With reference to FIG. 10, a further embodiment of the technician's field of view 100, including the virtual layer 22 projected onto the reality layer 24, is shown. The virtual layer 22 includes a user interface 110 consisting of a heading bar 112, which contains patient identification information and information about the treatment to be performed. The user interface 110 also provides a warning portion 124 to the technician when the needle of the vascular access device 60 is intravenous or pierced, and to the subcutaneous anatomical structure targeted by the invasive device. Includes the projected trajectory of the invasive device while being placed. User interface 110 also includes one or more schematic images 126 showing the position of the needle with respect to the vein. For example, one schematic image 126A shows the position of the needle with respect to the vein from the top view and indicates to the technician whether the needle needs to be moved to the left or right and forward or backward. Can be done. The user interface 110 can also include a second schematic image 126B that draws an elevational or side view showing the depth of the needle relative to the vein. It is further contemplated herein that further schematic drawings showing other images or views of the desired structure may be provided for viewing in user interface 110. For example, other views can include a cross-sectional view of the image shown in the first schematic image 126A or the second schematic image 126B. Alternatively, an image obtained from outside the plane, such as an ultrasonic probe, may also be provided. Finally, the user interface 110 can include an icon 128 indicating certain information about the vascular access device 60, such as the thickness or length of the catheter or needle.

When used, the technician begins by deciding which action should be taken and obtaining the necessary equipment. As in the previous embodiment of the system 10e, the technician can determine this information by scanning the patient ID 38. Based on the information obtained from patient ID 38, user interface 110 displays instructions for the procedure to be performed, which items need to be obtained, and any other relevant information about the procedure or patient. be able to. The technician then obtains an item for treatment, ie, the vascular access device 60. The system 10e can verify that the correct item is obtained by scanning the identification tag 30 for each item. Warnings can be displayed if the technician fails to obtain the required item.

Prior to performing the infusion or vascular access procedure, the technician scans the desired insertion site using a wand 68 or scanner of an imaging device such as an ultrasound monitor 64 to obtain a subcutaneous 3D image of the patient's vascular system. Can be obtained. The system 10e can automatically process the resulting image and identify suitable veins for insertion of the vascular access device 60. While the vein is being identified, an image of the injection site is also obtained using an image capture function, such as the digital camera 12 of the wearable electronic device 18. Processing captured images identifies various anatomical markers, which are used to determine the size, shape, and orientation of the patient's arm, or other selected injection site. To. Based on these processing tasks, a vein trace, referred to herein as a virtual vein trace 62, is presented to the technician on the user interface 110. The technician positions the needle of the vascular access device 60 based on the virtual trace 62. The technician then inserts the needle into the vein. The user interface 110 can display a warning or confirmation when the needle is placed correctly.

In addition to assisting needle positioning, the system 10e records the insertion operation to ensure that the procedure was actually performed correctly. For example, insertion time, insertion position, technician's name, insertion site, and other information may be transmitted from the wearable electronic device 18 to the patient data system. Information is recorded to assist in performing future insertion procedures.

Although specific embodiments of the present invention have been described in detail, those skilled in the art will appreciate that various modifications and alternatives to these details can be developed in view of the entire teachings of the present disclosure. .. Therefore, the specified configurations disclosed are merely exemplary and do not imply any limitation on the scope of the invention, the scope of the invention being the appended claims and any of them. The full breadth of all equivalent forms should be given. Further, the present invention has been described in detail for exemplary purposes based on what is currently considered to be the most practical and preferred embodiment, but such details are solely for that purpose. And the invention is not limited to the disclosed embodiments, but conversely, to include modifications and equivalent configurations contained within the purpose and scope of the appended claims. Please understand what is intended for. For example, it is understood that the present invention is intended to the extent possible that one or more functions of any embodiment can be combined with one or more functions of any other embodiment. I want to.

Claims (27)

It's a system
A wearable electronic device configured to be worn by the user, for transmitting data to or from a housing, at least one imaging sensor associated with the housing, and an external electronic device. Acquires and processes an image acquired by a data transmission interface for receiving data, at least one imaging sensor, at least one microprocessor for managing the data transmission interface, and at least one imaging sensor. a program for, only contains the wearable electronic device is a head-mounted computer, the at least one imaging sensor is configured to capture images of the field of view of the user, the wearable electronic With the device
A sampling device for collecting liquid samples in a sample container,
At least one identification tag attached to the sampling device or sample container or integrally formed with the sampling device or sample container, wherein the at least one identification tag includes or is associated with a tracking code. With one identification tag,
The program processes the image captured by the at least one imaging sensor to identify the at least one identification tag and determines the tracking code.
The program confirms that the sample has been obtained and sends the tracking code to the external electronic device via the data transmission interface.
Image capture, image processing, and data transmission are performed automatically without any input or manipulation activity by the user.
The program was incorporated by processing the image to locate a position marker on the sampling device and then locating the at least one identification tag based on the position of the position marker. The at least one identification tag is identified in the image and
The position marker points to the at least one identification tag and triggers the wearable electronic device to start the image processing of the at least one identification tag.
After locating the position marker by processing the image, the program runs the program until a predetermined time elapses with the position marker on the sampling device in the field of view of at least one imaging sensor. A system that delays the start of the image processing of the at least one identification tag. Further provided with a data reporting accessory for providing data to the user.
The system according to claim 1. Before Symbol Data Report accessory is configured projection prism to project virtual layer in view of the user,
The system according to claim 2. The virtual layer includes a user interface.
The user interface includes a patient information portion, a sample collection confirmation portion, an identification tag confirmation portion, or any combination thereof.
The system according to claim 3. Image capture, image processing, and data transmission are managed by the program in a hands-free manner.
The system according to claim 1. The sampling device is a vascular access device, a phlebotomy set, a renal catheter, a tissue sampling device, or any combination thereof.
The system according to claim 1. The system of claim 6, wherein the vascular access device is a peripheral IV catheter, a PICC line, or a central venous line. The at least one imaging sensor is a digital camera or a digital video camera.
The system according to claim 1. The wearable electronic device further comprises the program, sample collection confirmation, the tracking code for the sample container, or a data storage medium for storing images captured by the at least one imaging sensor.
The system according to claim 1. The wearable electronic device includes a peripheral data input device that allows the user to manually input data into the wearable electronic device.
The system according to claim 1. The peripheral data input device is a motion sensor, a gyroscope, a pressure sensor, an accelerometer, a touch pad, a touch screen, or any combination thereof.
The system according to claim 10. The wearable electronic device further comprises a power source in the housing of the wearable electronic device.
The system according to claim 1. The data transmission interface is configured to send data to and receive data from the patient data system.
The system according to claim 1. The information received from the patient data system includes information about the procedure to be performed, information about the type of fluid sampling device used, information about the amount of fluid sample required, information about proposed vascular access sites. , Or contains information about the patient,
The system according to claim 13. The information transmitted to the external electronic device includes the confirmation that the sample was taken, the time and date the sample was taken, information about the location of the injection site, the tracking code for the sampling device, and more. Or any combination of them,
The system according to claim 1. The at least one identification tag comprises a two-dimensional bar code, a three-dimensional bar code, or a label having text readable by an optical character recognition algorithm.
The system according to claim 1. Further equipped with a patient identification device that includes or is associated with the identification information about the patient.
The patient identification device is readable by the at least one imaging sensor of the wearable electronic device.
The system according to claim 1. Further comprising a point-of-care test device used to test the fluid sample for one or more of a chemical, electrolyte, hematology, blood gas concentration, coagulation, or cardiac marker.
The system according to claim 1. The point-of-care test device is one or more of a test piece, a dipstick, an immunoassay, a glass slide, or a diagnostic cartridge.
The system according to claim 18. The program captures an image of the point of care inspection device when inspecting the liquid sample.
The program processes the image of the point of care inspection device to determine the result of the inspection.
The system according to claim 19. The point-of-care test device includes identification information about the point-of-care test device or includes an identification tag associated with the identification information about the point-of-care test device.
The program processes the image of the point of care inspection device to determine the identification information.
The system according to claim 18. The program confirms that the liquid sample has been collected by processing a series of images of the sample container captured by the at least one imaging sensor, and the amount of liquid in the sample container is minimized. Judging when it is the amount of liquid,
The system according to claim 1. The wearable electronic device warns the user when the minimum amount of liquid is collected.
The system according to claim 22. Check the harvested liquid sample, a method for tracking, the method comprising:
A step of acquiring an image of a sample collection container of a sampling device by a wearable electronic device having at least one image sensor , wherein the wearable electronic device acquires an image in the field of view of a user wearing the wearable electronic device. a head-mounted computer is configured to, the wearable electronic device, acquiring a series of images of the sample collection container when said liquid sample is taken, the steps,
A step of processing the series of images in real time to determine when the amount of liquid in the sample collection container is a predetermined amount, and
When an image indicative of the sample collection container which is filled with the predetermined amount of liquid is obtained, and notifying that the sample collection is completed for the user wearing the wearable electronic device,
The sampling device or from at least one identification tag that has been processed from at least one of the series of images and attached to the sampling device or sample collection container or integrally formed with the sampling device or sample collection container. Steps to recognize and extract information about sampling containers,
Including
The process is automatically performed without any operation activity by the user.
The process processes the at least one series of images from the at least one identification tag in the at least one series of images to locate a position marker on the sampling device or sample collection vessel. Recognizing and extracting the information about the sampling device or sample collection vessel by locating the at least one identification tag based on the position of the position marker.
The position marker points to the at least one identification tag, and the wearable electronic device processes the at least one identification tag in order to recognize and extract the information about the sampling device or the sample collection container. Trigger to start
After locating the position marker by processing the at least one of the series of images, the information about the sampling device or sample collection area is then identified in the at least one of the series of images. The process of recognizing and extracting from a tag is delayed in starting until a predetermined time elapses with the position marker on the sampling device or sample collection container in the field of view captured by the series of images. .. The information extracted from the identification tag includes a tracking code for the sampling device.
24. The method of claim 24. Further comprising confirming that a sample has been collected via the data transmission interface of the wearable electronic device and transmitting the tracking code for the sampling device to an external source.
25. The method of claim 25. The wearable electronic device, to the field of view of the user, information and including a structure projection prism to project virtual layer containing instructions,
24. The method of claim 24.

Images