KR20200082456A - Method and apparatus for managing health care information in vehicle - Google Patents

Abstract

The method for managing health care information in a vehicle according to one embodiment receives a biometric signal from a biometric information measurement sensor attached to a vehicle steering wheel, analyzes the received bio-signal to generate health information, and outputs the generated health information so that a driver of the vehicle can recognize the generated health information.

Description

Method and apparatus for managing health care information in vehicle}

Embodiments relate to a method and apparatus for managing health information in a vehicle.

ADAS (Advanced　Driver　Assistance　Systems, hereinafter referred to as'ADAS') is sometimes referred to as an advanced driver assistance system, which responds to the vehicle with a faster reaction speed than the driver, providing convenience to the driver as well as safety and road The goal is to reduce the above accidents. Above all, since most of the ADAS technology is done through sensors, the sensor is considered to be very important, and ADAS technologies are also applied to autonomous vehicles in the future.

ADAS sensors can be broadly divided into camera, radar, and lidar.

A radar (Radio Detection And Ranging, Radar) is a system that captures electromagnetic waves in the air and measures the reflected waves that return from a certain object and then grasps the direction, distance, and speed of the detected object. Because it uses radio waves, it is able to measure distances stably regardless of the weather environment or day and night, and complements the camera. Since it is difficult to increase the measurement distance and measurement angle at the same time, the radar is divided into a long-range radar and a medium- and short-range radar according to the ADAS function. In terms of technology, automotive radars have been developed with the goal of increasing the measurement distance, measurement angle, and frequency bandwidth of radio waves to increase the accuracy of data, while efforts are being made to reduce weight, reduce size, and reduce costs.

Lidar (Light Detection And Ranging, LiDAR) has the same basic principles as radar, but differs in that it acquires distance information using a high-power pulse laser. This is a method of measuring the speed of the light coming back from the lidar sensor constantly. Since it shoots millions of rays per second to calculate the actual distance, it is possible to combine all of them to reconstruct visual information in 3D. It is necessary to prevent collision accidents that may occur due to the intention or negligence of others by judging not only the forward situation but also the rear situation in the direction of the car.

The camera is the most basic in the ADAS system because it can grasp accurate shape information that cannot be identified through radar and lidar. Accurate data analysis through the camera is essential to determine traffic sign recognition, blind spot detection, and lane departure.

On the other hand, recently, various biosignal recognition sensors mounted on a mobile terminal or a smart watch, for example, technologies using a PPG sensor or a camera provided on the back of a mobile terminal have been studied.

[Previous technical document number]

Preceding 1: Korean Patent Publication No. 2016-0032595

Embodiments are to provide a method and apparatus for managing health information in a vehicle. In addition, it is to provide a recording medium readable by a computer recording a program for executing the method on a computer. The technical problem to be solved is not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above-described technical problem, a method for managing health information in a vehicle according to an embodiment includes receiving a biosignal from a bioinformation measurement sensor attached to a handle of the vehicle; Generating health information by analyzing the received bio-signals; And outputting the generated health information so that the driver of the vehicle can recognize it.

The output step is characterized by outputting the generated health information to at least one of a HUD and a navigation display displayed on the windshield of the vehicle.

The biometric information measurement sensor is characterized in that it is attached to the cover of the steering wheel of the vehicle.

The bio-information measurement sensor is included in the smart watch, and the smart watch is attached to the handle to receive the bio-signal.

The method for managing health information in the vehicle may further include performing a vehicle control operation corresponding to the generated health information.

The apparatus for managing health information in a vehicle according to another embodiment includes a memory in which at least one program is stored; And a processor for driving the health information management device by executing the at least one program, wherein the processor receives a biosignal from a bioinformation measurement sensor attached to a vehicle handle, and analyzes the received biosignal. Health information is generated, and the generated health information is output to be recognized by a driver of the vehicle.

The processor is characterized by outputting the generated health information to at least one of a HUD and a navigation display displayed on the windshield of the vehicle.

The biometric information measurement sensor is characterized in that it is attached to the cover of the steering wheel of the vehicle.

The bio-information measurement sensor is included in the smart watch, and the smart watch is attached to the handle to receive the bio-signal.

It includes a recording medium recording a program for executing the position correction method in a computer according to another embodiment.

1 is an internal block diagram of a vehicle according to an embodiment.
FIG. 2 is a block diagram of the vehicle driving assistance system (ADAS) shown in FIG. 1.
3 is a schematic diagram of a health information management device 300 in a vehicle according to another embodiment.
4 is an exemplary diagram of outputting health information according to another embodiment.
5 is a flowchart illustrating a method for managing health information in another vehicle according to another embodiment.

The phrases “in some embodiments” or “in an embodiment” appearing in various places in the specification are not necessarily all referring to the same embodiment.

Some embodiments of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented with various numbers of hardware and/or software configurations that perform particular functions. For example, the functional blocks of the present disclosure can be implemented by one or more microprocessors, or by circuit configurations for a given function. Also, for example, functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks can be implemented with algorithms running on one or more processors. In addition, the present disclosure may employ conventional techniques for electronic environment setting, signal processing, and/or data processing. Terms such as “mechanism”, “element”, “means” and “composition” can be used widely, and are not limited to mechanical and physical configurations.

In addition, the connection lines or connection members between the components shown in the drawings are merely illustrative of functional connections and/or physical or circuit connections. In an actual device, connections between components may be represented by various functional connections, physical connections, or circuit connections that are replaceable or added.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

1 is an internal block diagram of a vehicle according to an embodiment.

Referring to FIG. 1, the vehicle 100 includes a communication unit 110, an input unit 120, a sensing unit 125 memory 130, an output unit 140, a vehicle driving unit 150, and a vehicle driving assistance system (ADAS) , 160 ), a control unit 170, an interface unit 180, and a power supply unit 190.

The communication unit 110 may include a short-range communication module, a location information module, an optical communication module, and a V2X communication module.

The input unit 120 may include a driving operation means, a camera, a microphone, and a user input unit.

The driving operation means receives a user input for driving the vehicle 100. The driving operation means may include a steering input means, a shift input means, an acceleration input means, and a brake input means.

The acceleration input means receives an input for acceleration of the vehicle 100 from the user. The brake input means receives an input for deceleration of the vehicle 100 from the user.

The camera may include an image sensor and an image processing module. The camera can process still images or moving pictures obtained by an image sensor (for example, CMOS or CCD). The image processing module may process the still image or video acquired through the image sensor, extract necessary information, and transmit the extracted information to the controller 170.

Meanwhile, the vehicle 100 may include a front camera that photographs a vehicle front image, an around view camera that photographs a vehicle surrounding image, and a rear camera that photographs a vehicle rear image. Each camera can include a lens, an image sensor and a processor. The processor may process the photographed image by computer, generate data or information, and transmit the generated data or information to the controller 170. The processor included in the camera may be controlled by the controller 170.

The camera may include a stereo camera. In this case, the processor of the camera may detect a distance from the object, a relative speed with the object detected from the image, and a distance between a plurality of objects using a disparity difference detected in the stereo image.

The camera may include a Time of Flight (TOF) camera. In this case, the camera may include a light source (eg, infrared or laser) and a receiver. In this case, the processor of the camera detects the distance to the object, the relative speed with the object, and the distance between the plurality of objects based on the time until the infrared ray or laser emitted from the light source is reflected and received by the object. can do.

Meanwhile, the rear camera may be disposed in the vicinity of the rear license plate or the trunk or tail gate switch, but the position in which the rear camera is disposed is not limited thereto.

Each image photographed by a plurality of cameras is delivered to a processor of the camera, and the processor may synthesize the respective images to generate an image around the vehicle. At this time, the image around the vehicle may be displayed through the display unit as a top view image or a bird eye image.

The sensing unit 125 senses various situations of the vehicle 100. To this end, the sensing unit 125 includes a collision sensor, a wheel sensor, a speed sensor, a tilt sensor, a weight sensor, a heading sensor, a yaw sensor, and a gyro sensor. , Position module, vehicle forward/reverse sensor, battery sensor, fuel sensor, tire sensor, steering sensor by steering wheel rotation, vehicle interior temperature sensor, vehicle interior humidity sensor, ultrasonic sensor, illuminance sensor, radar, rider, etc. It may include.

Accordingly, the sensing unit 125 includes vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward/reverse information, battery information , It is possible to obtain a sensing signal for fuel information, tire information, vehicle lamp information, vehicle interior temperature information, vehicle interior humidity information, steering wheel rotation angle, and vehicle exterior illumination.

The memory 130 is electrically connected to the control unit 170. The memory 130 may store basic data for the unit, control data for controlling operation of the unit, and input/output data. The memory 130 may be various storage devices such as ROM, RAM, EPROM, flash drive, and hard drive in hardware. The memory 130 may store various data for the overall operation of the vehicle 100, such as a program for processing or controlling the control unit 170.

The output unit 140 is for outputting information processed by the control unit 170, and may include a display unit, an audio output unit, and a haptic output unit.

The display unit may display information processed by the controller 170. For example, the display unit may display vehicle-related information. Here, the vehicle-related information may include vehicle status information informing the current vehicle status or vehicle operation information related to the operation of the vehicle. For example, the display unit may display the speed (or speed) of the current vehicle, the speed (or speed) of the surrounding vehicle, and distance information between the current vehicle and the surrounding vehicle.

Meanwhile, the display unit may include a cluster so that the driver can check the vehicle status information or the vehicle driving information while driving. Clusters can be placed on the dashboard. In this case, the driver can check the information displayed on the cluster while keeping the gaze in front of the vehicle.

The sound output unit converts and outputs an electrical signal from the control unit 170 into an audio signal. To this end, the sound output unit may include a speaker or the like.

The vehicle driving unit 150 may control operations of various types of vehicles. The vehicle driving unit 150 may include a power source driving unit, a steering driving unit, a brake driving unit, a lamp driving unit, an air conditioning driving unit, a window driving unit, an airbag driving unit, a sunroof driving unit, and a suspension driving unit.

The power source driving unit may perform electronic control of the power source in the vehicle 100. For example, when a fossil fuel-based engine (not shown) is a power source, the power source driver may perform electronic control of the engine. Thus, the output torque of the engine and the like can be controlled. When the power source driving unit is an engine, under the control of the control unit 170, the engine output torque may be limited to limit the speed of the vehicle.

The brake driving unit may perform electronic control of a brake apparatus (not shown) in the vehicle 100. For example, by controlling the operation of the brake disposed on the wheel, the speed of the vehicle 100 can be reduced. As another example, by differently operating the brakes disposed on the left and right wheels, the traveling direction of the vehicle 100 may be adjusted to the left or right.

The lamp driver may control turn-on/turn-off of lamps disposed inside and outside the vehicle. Also, it is possible to control the light intensity, direction, and the like of the lamp. For example, it is possible to perform control for a direction indicator lamp, a brake lamp, and the like.

The control unit 170 may control the overall operation of each unit in the vehicle 100. The control unit 170 may be referred to as an electronic controller unit (ECU). The collision prevention device described above may be driven by the control unit 170.

The control unit 170 includes hardware, application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors ( It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions.

In one embodiment, the controller 170 captures a road image using an ADAS camera while driving the vehicle, acquires horizontal data of the road from the captured road image, and uses the sensor of the vehicle while driving the vehicle to tilt the vehicle body. Obtain the measured tilt data, and correct the position of the ADAS camera based on the obtained horizontal data and the tilt data.

The interface unit 180 may serve as a passage with various types of external devices connected to the vehicle 100. For example, the interface unit 180 may be provided with a port connectable to a mobile terminal (not shown), and may be connected to a mobile terminal (not shown) through the port. In this case, the interface unit 180 may exchange data with the mobile terminal.

The power supply unit 190 may supply power required for the operation of each component under the control of the control unit 170. In particular, the power supply unit 190 may receive power from a battery (not shown) or the like inside the vehicle.

FIG. 2 is a block diagram of the vehicle driving assistance system (ADAS) shown in FIG. 1.

ADAS 200 is a vehicle driving assistance system that assists the driver to provide convenience and safety.

The ADAS 200 includes an automatic emergency braking module (hereinafter, AEB: Autonomous Emergency Braking) 210, a forward collision avoidance module (hereinafter, FCW: Foward Collision Warning) 211, and a lane departure warning module (hereinafter, LDW: Lane) Departure Warning (212), Lane Keeping Assist Module (hereinafter referred to as LKA: Lane Keeping Assist) (213), Speed Assist System Module (hereinafter referred to as SAS: Speed Assist System) (214), Traffic Signal Detection Module (TSR: Traffic Sign) Recognition (215), adaptive high light control module (hereinafter, HBA: High Beam Assist) (216), blind spot monitoring module (hereinafter, BSD: Blind Spot Detection) (217), automatic emergency steering module (hereinafter, AES: Autonomous Emergency Steering (218), Curve Speed Warning System Module (hereinafter, CSWS: Curve Speed Warning System) (219), Adaptive Forward Control Module (hereinafter, ACC: Adaptive Cruise Control) (220), Smart Parking System Module (hereafter) , SPAS: Smart Parking Assist System (221), traffic congestion support module (hereinafter, TJA: Traffic Jam Assist) 222 and around view monitor module (hereinafter, AVM: Around View Monitor) 223 may be included. .

Each of the ADAS modules 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223 may include a processor for vehicle driving assistance function control.

The processors included in each of the ADAS modules 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223 may be controlled by the control unit 270 .

Each of the ADAS module (210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223) processor, hardware, application specific integrated circuits (ASICs), DSPs (digital signal processors), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors ( microprocessors) and other electrical units for performing other functions.

The AEB 210 is a module that controls automatic braking to prevent collision with the detected object. The FCW 211 is a module that controls a warning to be output in order to prevent collision with an object in front of the vehicle. LDW 212 is a module that controls a warning to be output to prevent lane departure during driving. The LKA 213 is a module that controls to maintain the driving lane while driving. The SAS 214 is a module that controls to travel at a set speed or less. The TSR 215 is a module that detects a traffic signal while driving and provides information based on the detected traffic signal. The HBA 216 is a module that controls the irradiation range or irradiation amount of the high beam according to the driving situation. The BSD 217 is a module that detects an object outside the driver's field of view while driving and provides detection information. The AES 218 is a module that automatically performs steering in an emergency. The CSWS 219 is a module that controls to output a route when traveling at a predetermined speed or more during curve driving. The ACC 220 is a module that controls to follow and drive the preceding vehicle. The SPAS 221 is a module that detects a parking space and controls it to park in the parking space. The TJA 222 is a module that controls to automatically operate when traffic is congested. The AVM 223 is a module that provides a vehicle surrounding image and controls to monitor the vehicle surroundings.

The ADAS 200 provides a control signal for performing each vehicle driving assistance function to the output unit 250 or the vehicle driving unit 260 based on data obtained from the input unit 230 or the sensing unit 235 can do. The ADAS 200 may directly output the control signal to the output unit 250 or the vehicle driver 260 through in-vehicle network communication (eg, CAN). Alternatively, the ADAS 200 may output the control signal to the output unit 250 or the vehicle driving unit 260 through the control unit 270.

3 is a schematic diagram of a health information management device 300 in a vehicle according to another embodiment.

Referring to FIG. 3, the health information management device 300 includes a control unit 310, a PPG sensor 320, and an output unit 330. In an embodiment, the health information management apparatus 300 receives a bio-signal from the bio-information measurement sensor attached to the handle of the vehicle, analyzes the received bio-signal to generate health information, and the driver of the vehicle generates the health information. Print it for recognition. Here, the health information management apparatus 300 may output health information to a HUD and a navigation display displayed on the windshield of the vehicle. Here, the PPG sensor 320 may be attached to a handle cover of a vehicle or included in a smart watch, to attach or mount a smart watch to the handle or handle cover of the vehicle, and receive a bio signal from the smart watch. In addition, it is possible to perform the charging function of the smart watch.

The PPG sensor 320 is a sensor capable of measuring heart rate, oxygen saturation, and body temperature. Here, the PPG sensor 320 will be described as an example, but is not limited thereto, and may include a sensor capable of variously measuring heart rate and oxygen saturation, for example, a camera, a pulse wave sensor, and the like, and measure body temperature. Of course, it may include a thermometer that can be. The pulse wave propagates to the pulsatile wave by contraction and relaxation of the heart, resulting in a change in blood vessel volume. Photoplethysmograph (hereinafter referred to as “PPG”) is a method of measuring pulse waves using light, and changes in optical properties such as reflection of tissues and absorption and transmission ratios of blood vessels in the blood vessel are changed by the optical sensor. Detect and measure. Unlike electrocardiograms, changes in blood flow delivered to peripheral blood vessels are measured, but pulse waves can be easily measured by applying light sources and light sensors to fingers, forehead, earlobe, etc. without using electrocardiogram electrodes. In addition, although the change of the pulse wave using PPG is not the change of the electrocardiogram, HRV can be estimated by the variation of the pulse wave measured from PPG.

Here, the PPG sensor 320 may be provided at a specific position of a steering wheel of a vehicle, for example, a hand holding portion. In addition, the PPG sensor 320 is provided on the smart watch, it is also possible to measure the bio-signal through a structure that can be attached to the handle or the cover of the handle.

The controller 310 analyzes the bio-signals measured from the PPG sensor 320 and generates health information. Here, the health information includes heart rate, stress index, body temperature, and the like, and is controlled to be output through the output unit 330 so that the driver of the vehicle can recognize the generated health information. Here, the output unit 330 may be a HUD displayed on the windshield of the vehicle, or may include a navigation display. Also, it may include auditory information as well as visual information. In addition, health information may be transmitted to the driver's smart phone through the output unit 330.

The analysis of health information is Heart Rate Variability (hereinafter referred to as “HRV”), which is a non-invasive measure to measure the state of the autonomic nervous system from signals made from a series of data by sequentially connecting the continuous changes of the heart rate cycle (Non -invasive) tool. The HRV can calculate stress, sleep analysis, and emotional analysis.

The control unit 310 may analyze the bio-signals to generate health information, or may receive the health information analyzed by the smart watch and control it to be output to an output means of the vehicle.

In addition, the controller 310 may perform a vehicle control operation corresponding to the generated health information. Here, the vehicle control operation is a vehicle control operation according to a driver's health condition, such as opening a window, recommending music to play in a tired or stressful situation, suggesting to change the driving mode, or reducing the speed of the vehicle. , May include various driver assistance actions.

4 is an exemplary diagram of outputting health information according to another embodiment.

As illustrated in FIG. 4, when the biosignal measurement sensors 410 and 420 provided on the handle of the vehicle are held by the driver's hand, the biosignal of the driver is measured. The health information management device may analyze the driver's health information from the measured bio-signal and display the analyzed health information on the HUD 430 or the navigation display 440 of the windshield of the vehicle. Here, two bio-signal measurement sensors 410 and 420 are illustrated, but the number is not limited to the number. In addition, although the bio-signal measurement sensors 410 and 420 are shown as being provided on the handle, they may be attached to the cover of the handle. In addition, although the bio-signal measurement sensors 410 and 420 are shown as separate sensors, the driver may be in the form of a smart watch worn on the wrist, and may have a structure for attaching the smart watch to the handle or the handle cover. have. In addition, the handle or the handle cover may further include a charging structure to perform the charging function of the smart watch.

The method and apparatus for managing health information in a vehicle according to an embodiment can easily check and check a driver's health information in the vicinity of a body to be measured, for example, a hand, while driving, thereby driving a long-distance drive or a current driver's condition. You can support safe driving while checking.

5 is a flowchart illustrating a method for managing health information in another vehicle according to another embodiment.

Referring to FIG. 5, in step 500, a biosignal is received from a bioinformation measurement sensor attached to a steering wheel of a vehicle. In step 502, the received bio-signal is analyzed to generate health information. In step 504, the generated health information is output to be recognized by the driver of the vehicle.

The embodiments may also be implemented in the form of a recording medium including instructions executable by a computer, such as program modules executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer-readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, other data in a modulated data signal, such as program modules, or other transport mechanisms, and includes any information delivery media.

In addition, in this specification, the “part” may be a hardware component such as a processor or circuit, and/or a software component executed by a hardware component such as a processor.

The above description of the present specification is for illustration only, and those skilled in the art to which the contents of this specification belong can understand that it can be easily modified to other specific forms without changing the technical spirit or essential features of the present invention. There will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present embodiment is indicated by the claims, which will be described later, rather than by the detailed description, and should be interpreted to include all modified or modified forms derived from the meaning and scope of the claims and their equivalent concepts.

Claims (10)

Receiving a bio-signal from a bio-information measurement sensor attached to the handle of the vehicle;
Generating health information by analyzing the received bio-signals; And
And outputting the generated health information so that a driver of the vehicle can recognize the health information in the vehicle. According to claim 1,
The output step,
A method for managing health information in a vehicle, characterized in that the generated health information is output to at least one of a HUD and a navigation display displayed on the windshield of the vehicle. According to claim 1,
The biological information measurement sensor,
Health information management method in a vehicle, characterized in that attached to the cover of the handle of the vehicle. According to claim 1,
The biological information measurement sensor,
A method for managing health information in a vehicle, which is included in a smart watch and receives the bio-signal by attaching the smart watch to the handle. According to claim 1,
A method of managing health information in a vehicle, further comprising performing a vehicle control operation corresponding to the generated health information. A recording medium recording a program for executing a method according to any one of claims 1 to 5 in a computer. A memory in which at least one program is stored; And
And a processor for driving the health information management device by executing the at least one program,
The processor,
In a vehicle that receives a bio-signal from a bio-information measurement sensor attached to the handle of the vehicle, analyzes the received bio-signal, generates health information, and outputs the generated health information so that the driver of the vehicle can recognize it. Health information management device. The method of claim 7,
The processor,
A device for managing health information in a vehicle, characterized in that the generated health information is output to at least one of a HUD and a navigation display displayed on the windshield of the vehicle. The method of claim 7,
The biological information measurement sensor,
Health information management device in a vehicle, characterized in that attached to the cover of the handle of the vehicle. The method of claim 7,
The biological information measurement sensor,
It is included in the smart watch, health information management device in a vehicle characterized in that the smart watch is attached to the handle to receive the bio-signal.

Images