KR20220019114A - Telemedicine system for self driving cars - Google Patents

Abstract

In accordance with the present invention, provided is a telemedicine system of an autonomous driving vehicle, capable of enabling an autonomous driving vehicle to sense the body condition of a passenger and enable quick diagnosis and treatment when detecting a symptom, thereby maximizing the safety of the passenger while efficiently driving the autonomous driving vehicle. In accordance with one aspect of the present invention, the telemedicine system of an autonomous driving vehicle includes: an autonomous driving vehicle including a sensing part collecting a biometric signal or image of a user, and a control part calculating a driving route and controlling driving; and a diagnostic server receiving the collected biometric signal or image. The diagnostic server includes: a first diagnostic server primarily determining whether the collected biometric signal or image is abnormal; and a second diagnostic server confirming the abnormality.

Description

Telemedicine system for autonomous vehicle {TELEMEDICINE SYSTEM FOR SELF DRIVING CARS}

The present invention relates to a remote medical treatment system, and more particularly, to a remote medical treatment system for an autonomous vehicle.

An autonomous vehicle is a vehicle that can drive automatically without human driving. Autonomous vehicles drive autonomously by recognizing their surroundings using radar, light detection and ranging (LIDAR), GPS, and cameras and specifying a destination. Unmanned vehicles that are already being put into practical use include unmanned vehicles that patrol preset routes operated by the Israeli military, and unmanned driving systems such as dump trucks operated in overseas mines and construction sites.

The first core technologies of these autonomous vehicles are the driverless vehicle system and the actual system. It is a technology that not only simulates in the laboratory but also actually builds an unmanned vehicle system. It implements the driving devices such as accelerators, reducers and steering devices to suit unmanned operation, and enables control using the computer, software and hardware installed in the unmanned vehicle. do.

The second core technology is to receive and process visual information using vision and sensors. As the basis of autonomous driving for unmanned operation, it is a technology that accepts image information and extracts necessary information from the image. It uses not only CCD (charge-coupled device) cameras but also ultrasonic sensors and range filters to fuse information necessary for distance and driving, so that it can avoid obstacles and cope with unexpected situations through analysis and processing.

The third core technology is the integrated control system and operation monitoring fault diagnosis system technology. This technology establishes a driving monitoring system that monitors vehicle operation and gives appropriate commands according to frequently changing situations, analyzes various situations generated by individual processors and sensors, diagnoses system failures, and provides appropriate information to the operator or to perform the function of notifying an alarm.

The fourth core technology is intelligent control and intelligent operation device. This technology is an unmanned driving technique that generates control commands based on mathematical analysis using real vehicle models. Intelligent Forward Control is a system that maintains the distance from the vehicle in front or obstacles by adjusting the speed by itself without the driver operating the pedals based on radar guide technology. When the driver inputs the distance to the vehicle in front, the long-distance radar attached to the front of the vehicle detects the position of the vehicle in front, maintains a constant speed, decelerates or accelerates, and stops completely if necessary, which is useful in weather where visibility is difficult.

The fifth applied technology is the lane departure prevention system. This is a technology that notifies the driver of an unintended departure situation by detecting the lane with a camera installed inside.

The sixth application technology is the parking assistance system. This is a system that helps the car park in reverse by adjusting the steering system when the driver finds the assist button, puts in reverse gear, and presses the brake pedal. By automatically guiding the vehicle from the departure point to the parking space based on infrastructure as well as vehicle-mounted sensors, it saves unnecessary time and energy when parking, thereby minimizing cost and environmental pollution.

The seventh application technology is the automatic parking system. This is a technology in which the driver stops the car in front of the parking lot, turns off the engine, gets off, and presses the remote control lock switch twice in succession. am.

The eighth application technology is a blind spot information guidance system. It is used to change lanes by checking obstacles and vehicles on both sides in complex road conditions, as sensors mounted on both sides of the car determine whether there is another vehicle in the blind spot that is not visible through the side mirrors and warn the driver. .

The biggest advantage of driverless cars is that they help fuel efficiency by avoiding repeated stops by making the control device more even because the driving speed and traffic management data match. will be. In addition, it has the advantages of solving fatigue caused by long-term driving, greatly reducing the risk of traffic accidents, speeding up road traffic flow, and reducing traffic congestion.

When such autonomous vehicles become common in the future, not only will the vehicle sharing service proceed more actively, but also, an emergency may occur in the body of a vehicle occupant in a fully autonomous driving situation of the autonomous vehicle. In particular, handling of emergency situations may be a problem if the vehicle occupants are elderly persons including minors or children.

Accordingly, in the field of technology, there is a demand for technology development for providing a service based on automatic recognition of an autonomous vehicle in an emergency situation to an occupant in the autonomous vehicle.

Korean Patent Application No. 10-2018-0004940 "SYSTEM AND METHOD FOR PROVIDING INTEGRATED ARTIFICIAL INTELLIGENCE SERVICE INTERWORKING VIRTUAL ACCOUNT USING SELF-DRIVING VEHICLE"

The present invention is to solve the problems of the prior art, and an object of the present invention is to maximize the safety of passengers by enabling an autonomous vehicle to detect a occupant's physical condition and promptly provide medical treatment and treatment when abnormal symptoms occur It provides a remote medical treatment system for autonomous vehicles that enables efficient operation of autonomous vehicles while also providing an autonomous driving system.

A remote medical treatment system for an autonomous vehicle according to an aspect of the present invention includes an autonomous vehicle and the collected biosignals, comprising: a sensing unit that collects a user's biosignals or images; and a controller that calculates a driving route and controls driving; or a diagnosis server for receiving an image, wherein the diagnosis server includes a first diagnosis server that first determines whether there is an abnormality in the collected biosignal or image, and a second diagnosis server that determines whether there is an abnormality is done

In this case, the second diagnosis server may determine whether the biosignal or the image is abnormal according to the patient's final determination input.

In addition, when the first diagnosis server first determines whether a biosignal or image is abnormal and the second diagnosis server determines whether there is an abnormality, the controller may change the driving route.

In addition, the remote medical treatment system of the autonomous vehicle may further include a medicine server, and when the second diagnosis server determines whether there is an abnormality, the medicine server is configured to operate on the driving path of the autonomous vehicle or a pharmacy on a path adjacent to the driving path. You can send a prescription to

In addition, the remote medical treatment system of the autonomous vehicle further includes a hospital, and when the second diagnosis server determines whether an abnormality is The diagnosis server may transmit a control signal for converting the driving destination of the autonomous vehicle to a hospital located the shortest distance from the current driving route.

In addition, the autonomous driving vehicle further includes an output unit, and when transmitting a control signal for converting a driving destination of the autonomous driving vehicle to a hospital located at the shortest distance from the current driving route, the display unit displays an emergency situation or an emergency situation sound can be printed out.

The present invention maximizes the safety of passengers and promotes efficient operation of the autonomous vehicle in normal times by allowing the autonomous vehicle to detect the body condition of the occupant and promptly provide medical treatment and treatment by changing the driving route when an abnormal symptom occurs. .

1A to 1H are diagrams for explaining a user scenario of a remote medical treatment system for an autonomous vehicle according to an embodiment of the present invention.
2 is a configuration diagram of a remote medical treatment system for an autonomous vehicle according to an embodiment of the present invention.
FIG. 3 is a configuration diagram illustrating the sensing unit of FIG. 2 in more detail.
4 is a configuration diagram illustrating the control unit in FIG. 2 in more detail.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement them. Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail. However, this is not intended to limit the present invention to specific embodiments, and it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention.

Terms including an ordinal number such as 1st, 2nd, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

Unless defined otherwise, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Hereinafter, a remote medical treatment system 1000 for an autonomous vehicle according to an embodiment of the present invention will be schematically described. 1A to 1H are diagrams for explaining a user scenario of a charging system for an autonomous vehicle according to an embodiment of the present invention.

First, as shown in FIG. 1A , the user calls and boards the autonomous vehicle as usual. As shown in FIG. 1B , the sensing unit of the autonomous vehicle after boarding collects the user's biosignals, such as body temperature and blood pressure, and collects the user's health status through the user's face recognition.

At this time, as shown in FIG. 1C, the collected bio-signals are transmitted to the first diagnosis server. The first diagnosis server is composed of an application processor and can determine the state unattended, but the opinion of the medical staff is not intervened. When the first diagnosis server determines whether there is an abnormality, it transmits it to the second diagnosis server. Referring to FIG. 1D , the biosignal data, the user's image data, and the first judgment opinion of the first diagnosis server are transmitted to the medical staff associated with the second diagnosis server. In this case, as shown in FIG. 1E , it is possible to consult with the medical staff remotely. When the medical staff makes a final determination as to whether there is an abnormality, the prescription is transmitted.

Such a prescription will be transmitted to a pharmacy located on or adjacent to the route of the autonomous vehicle, and the user will be able to receive the drug without significant change in the driving route. At this time, the medical staff makes a definitive judgment on whether there is an abnormality, and when a serious condition such as a serious condition or a coma occurs, the autonomous vehicle is driven to an emergency center adjacent to the driving route.

The remote medical treatment system of the autonomous vehicle according to the present embodiment for implementing the user scenario as described above will be described in more detail.

2 is a configuration diagram of a remote medical treatment system for an autonomous vehicle according to an embodiment of the present invention, FIG. 3 is a configuration diagram illustrating the sensing unit in FIG. 2 in more detail, and FIG. 4 is a diagram showing the control unit in FIG. 2 in more detail. It is a configuration diagram showing in detail.

First, referring to FIG. 2 , the remote medical treatment system 1000 of an autonomous driving vehicle according to an embodiment of the present invention includes an autonomous driving vehicle 100 in which a user 10 rides, a first diagnosis server 200, and a second A diagnosis server 300 , a medicine server 400 , and an emergency center 500 are included.

First, referring to FIG. 3 , the autonomous vehicle 100 includes an input unit 110 , a sensing unit 120 , an output unit 130 , a control unit 140 , a communication unit 150 , and a driving unit 160 .

The input unit 110 serves to input a destination of the autonomous vehicle 100 . At this time, a user terminal (not shown) authenticated through the communication unit 150 may also input a destination.

Referring to FIG. 3 , the sensing unit 120 detects a traffic situation necessary for autonomous driving and serves to capture a user's biosignal or image. First, the sensing unit 120 may include a radar 121 and a lidar 122 , and may further include a camera 123 .

The radar 121 refers to a device capable of moving unmanned while performing a radar detection operation by mounting an antenna on the autonomous vehicle 100 . The radar 121 is not limited to performing only a radar detection operation using the provided antenna, and such as a plurality of sensors or complex sensors capable of sensing the surrounding environment, such as the lidar 122 and the camera 123 . It can be implemented in the form In addition, the radar 121 generates surrounding sensing information by sensing the surrounding environment, and determines inanimate objects such as roads, other vehicles, people, and buildings that are obstacles in the driving direction based on the surrounding sensing information.

The lidar 122 is a device that precisely draws a surrounding state by emitting a laser pulse, receiving the light reflected from the surrounding target object, and measuring the distance to the object. The lidar 122 emits a laser pulse to the ground surface and measures the return time by analyzing the spatial position of the reflection point to measure the topography, and the reflected return time is different depending on the structure. A difficult three-dimensional model can be obtained.

The lidar 122 is composed of a laser, a scanner, a receiver, and a positioning system, and the wavelength of the laser is 600-1000 nm. The scanner is the part that lets you quickly scan your surroundings to get information. The receiver is a part that detects the returning light, and the sensitivity to the light of the receiver is a major factor influencing the performance of the lidar 122 .

In addition, since the sensing unit 120 needs to utilize location information of the autonomous vehicle, the GPS 124 is essentially further included. Furthermore, the sensing unit 120 may further include a microphone 125 to intervene in autonomous driving with a voice or the like even if the passenger does not perform a steering operation.

Meanwhile, the remote medical treatment system for an autonomous vehicle according to an embodiment of the present invention is essentially provided with a biometric information sensor 126 . The biometric information sensor 126 senses the body temperature, heartbeat, pinching pressure, brain waves, etc. of the passenger and transmits the sensed information to the first diagnosis server 200 . In this case, another camera 123 disposed inside the vehicle captures an image of the user.

The captured images may utilize various emergency situation comparison image image patterns stored in the first diagnosis server 200 for comparison between emergency situation comparison image images. That is, the first diagnosis server 200 0 compares various emergency situation comparison video image patterns, those inclined at a preset angle of each emergency situation comparison video image pattern, and the reversed ones, etc. with the received video image through pattern comparison. It can be determined whether there is an abnormality or an emergency situation.

Referring to FIG. 4 , the controller 140 controls the driving of the autonomous vehicle 100 , and includes a route calculation module 141 , a route change module 142 , and an emergency transfer module 143 . The route calculation module 141 refers to setting the driving route of the autonomous vehicle according to the first input destination. However, the remote medical treatment system 1000 of the autonomous vehicle according to the present embodiment necessarily includes the route change module 142 because there is a possibility that the driving route is always changed according to the user's emergency situation.

That is, when the first diagnosis server 200 does not determine whether an abnormality is first and the second diagnosis server 300 does not determine whether there is an abnormality, the path does not need to be changed, but the second diagnosis server 200 ), the route must be changed for receiving medicines or for autonomous transport to hospitals. Accordingly, in this case, the route change module 142 determines the route from the control signal transmitted by the first diagnostic server 200 (or the second diagnostic server 300 ) to the driving route or the pharmacy or hospital located at the shortest distance from the driving route. change to Of course, there is no need to separately change the driving route when a variable destination is located on the driving route.

The emergency transfer module 143 is the output unit of the vehicle when a situation such as unconsciousness is detected in the user's bio-signals and camera-captured images detected after or before the second diagnosis server 300 determines whether there is an abnormality. Control 130 to output an emergency situation display or emergency situation sound, and the first diagnosis server 200 transmits a control signal for converting the driving destination of the autonomous vehicle to a hospital located the shortest distance from the current driving route. In this case, it is more preferable that the first diagnosis server 200 transmits a control signal for immediate determination.

The diagnosis server receives and analyzes the collected bio-signals or images as described above, and consists of a first diagnosis server 200 that first determines whether there is an abnormality and a second diagnosis server 300 that determines whether there is an abnormality. .

The first diagnosis server 200 is composed of an application processor so that the user's state can be determined unattended, but the opinion of the medical staff is not intervened. Accordingly, when it is determined whether there is an abnormality, the first diagnosis server 200 transmits it to the second diagnosis server. At this time, the biosignal data, the user's image data, and the first judgment opinion of the first diagnosis server are transmitted to the medical staff associated with the second diagnosis server 200 .

In this case, as described above, it is possible to consult remotely with the medical staff. When the medical staff makes a final determination as to whether there is an abnormality, the prescription is transmitted, and the above-described control unit 140 can change the driving route to receive the prescription. do. In this case, the diagnosis server is provided with an associated medicine server 400, and the medicine server 400 transmits a prescription to a pharmacy on a driving route of an autonomous vehicle or a route adjacent to the driving route. Accordingly, the autonomous vehicle can receive the medicine on the driving route or in a place adjacent thereto without a separate long-distance movement.

In addition, the remote medical treatment system 1000 of the autonomous vehicle according to the present embodiment further includes a hospital 500, the second diagnosis server 300 determines whether there is an abnormality (or even before that), and performs the first diagnosis When the server 200 detects whether there is an additional abnormality in the biosignal or the user image, as described above, the first diagnosis server 200 sets the driving destination of the autonomous vehicle 100 to the hospital located the shortest distance from the current driving route. It transmits a control signal that converts to Therefore, it is intended to promote the rapid transport of emergency patients.

As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms are used, these are only used in a general sense to easily explain the technical content of the present invention and help the understanding of the present invention. , it is not intended to limit the scope of the present invention. It will be apparent to those of ordinary skill in the art to which the present invention pertains that other modifications based on the technical spirit of the present invention can be implemented in addition to the embodiments disclosed herein.

10: user
100: autonomous vehicle
110: input unit
120: detection unit
121: radar
122: lidar
123: camera
124: GPS
125: microphone
126: biometric information sensor
130: output unit
140: control unit
141: path calculation module
142: path change module
143: emergency transfer module
150: communication department
160: driving unit
200: first diagnosis server
300: second diagnosis server
400: medicine server
500: emergency center

Claims (6)

An autonomous driving vehicle comprising: a sensing unit that collects a user's bio-signals or images; and a control unit that calculates a driving route and controls driving; and
Including; a diagnostic server for receiving the collected bio-signals or images;
wherein the diagnosis server comprises a first diagnosis server that first determines whether there is an abnormality in the collected bio-signals or images, and a second diagnosis server that determines whether there is an abnormality in the collected biosignal or image. .
The method of claim 1,
The second diagnosis server is a remote medical treatment system for an autonomous vehicle, characterized in that it determines whether there is an abnormality in the biosignal or the image by the patient's confirmation input.
According to claim 1,
The remote medical treatment system for an autonomous vehicle, characterized in that when the first diagnosis server first determines whether there is an abnormality in the biosignal or image and the second diagnosis server determines whether there is an abnormality, the control unit changes the driving route .
The method of claim 1,
The remote medical treatment system of the autonomous vehicle further includes a medicine server,
The remote medical treatment system for an autonomous vehicle, characterized in that when the second diagnosis server determines whether there is an abnormality, the medicine server transmits a prescription to a pharmacy on a driving route of the autonomous vehicle or a route adjacent to the driving route.
According to claim 1,
The remote medical treatment system of the autonomous vehicle further includes a hospital,
When the second diagnosis server determines whether there is an abnormality and the first diagnosis server detects whether there is an additional abnormality in the biosignal or the user image, the first diagnosis server sets the driving destination of the autonomous vehicle as the current driving route and the shortest A remote medical treatment system for an autonomous vehicle, characterized in that it transmits a control signal that is converted to a hospital located on the street.
6. The method of claim 5,
The autonomous vehicle further includes an output unit,
When transmitting a control signal that converts the driving destination of the autonomous vehicle to a hospital located the shortest distance from the current driving route, the display unit outputs an emergency situation display or emergency situation sound system.

Images