CN107121952A - The system and method for communication tool system control based on physiological character - Google Patents

The system and method for communication tool system control based on physiological character Download PDF

Info

Publication number
CN107121952A
CN107121952A CN201710275548.0A CN201710275548A CN107121952A CN 107121952 A CN107121952 A CN 107121952A CN 201710275548 A CN201710275548 A CN 201710275548A CN 107121952 A CN107121952 A CN 107121952A
Authority
CN
China
Prior art keywords
physiological
vehicles
user
data
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710275548.0A
Other languages
Chinese (zh)
Other versions
CN107121952B (en
Inventor
P·卢
X·黄
J·F·什塞尔巴
T·E·奈恩达姆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GM Global Technology Operations LLC
Original Assignee
GM Global Technology Operations LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/342,451 external-priority patent/US20170120932A1/en
Priority claimed from US15/410,582 external-priority patent/US10137777B2/en
Application filed by GM Global Technology Operations LLC filed Critical GM Global Technology Operations LLC
Publication of CN107121952A publication Critical patent/CN107121952A/en
Application granted granted Critical
Publication of CN107121952B publication Critical patent/CN107121952B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/023Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
    • B60R16/0231Circuits relating to the driving or the functioning of the vehicle
    • B60R16/0232Circuits relating to the driving or the functioning of the vehicle for measuring vehicle parameters and indicating critical, abnormal or dangerous conditions
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/04Programme control other than numerical control, i.e. in sequence controllers or logic controllers
    • G05B19/042Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
    • G05B19/0428Safety, monitoring
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • B60R21/01Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
    • B60R21/015Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
    • B60R21/01512Passenger detection systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/24Pc safety
    • G05B2219/24024Safety, surveillance

Abstract

The present invention relates to the system and method for the control of the communication tool system based on physiological character.System and method there is provided the vehicles are controlled based on physiological character.This method includes:Receive the physiological data from one or more biosensors;Handle the physiological data received to determine one or more physiological status by processor;And, based on identified physiological status, one or more control signals are output into communication tool system to control the operation of communication tool system.

Description

The system and method for communication tool system control based on physiological character
The cross reference of related application
The U.S. Provisional Application No.62/287 submitted this application claims on January 26th, 2016,422 rights and interests, and be The U. S. application No.15/342 submitted on November 3rd, 2016,451 part continuation application, U. S. application No.15/342, 451 require that the U.S. Provisional Application No.62/250,180 submitted on November 3rd, 2015 rights and interests.The application of above-mentioned reference Each it is incorporated herein by reference.
Technical field
The disclosure is broadly directed to the vehicles, and relates more specifically to one or more physiological characters based on user The system and method that (physiological traits) controls communication tool system.
Background technology
The automatic Pilot vehicles (autonomous vehicle) are can to sense its environment and a little or do not have The vehicles driven in the case of having user's input.The automatic Pilot vehicles use sensing device further such as radar, laser thunder Reach, imaging sensor etc. senses its environment.Automatic Pilot communication tool system is further using from global positioning system (GPS) technology, navigation system, the vehicles to vehicle communication, the vehicles to infrastructure technique and/or drive-by-wire The message of system drives a conveyance.
Vehicles automation has been categorized into umerical automation rank, from corresponding to the nothing manually controlled entirely The zero of automation changes to full-automatic five controlled corresponding to prosthetic.Various automatic Pilot person's accessory systems are for example cruised control System, adaptive learning algorithms and parking assistance system are corresponding to relatively low automation rank, and really " unmanned " traffic Instrument corresponds to higher automation rank.
The vehicles can have one or more automatic Pilot person's accessory systems of relatively low automation rank, and it needs to use Inputted in the user of operation.But in some cases, user can not provide and directly input, for example, it is attributed to current driving feelings Shape or the health status related to user.In other cases, user can want simply have the indirect operation vehicles Or the convenience of communication tool system, without the careful action of user.
Accordingly, it is desirable to provide the system and method inputted with caution without user for controlling communication tool system.Enter one Walk the system and method that communication tool system is controlled desirable to provide one or more physiological characters based on user.In addition, passing through Subsequent embodiment and appended claims, is considered in conjunction with accompanying drawing and technical field and background technology above, this public affairs The other desired characters and characteristic opened will be apparent.
The content of the invention
The system and method that the control vehicles are provided.In one embodiment, it is a kind of that traffic is controlled based on physiological character The method of instrument includes:Receive the physiological data from one or more biosensors;The life received is handled by processor Data are managed to determine one or more physiological status;And, based on identified physiological status, by one or more control signals Communication tool system is output to control the operation of communication tool system.
In various embodiments, this method further comprises:Handle the physiological data received to produce base by processor Plinth (baseline) physiologic readout;Handle the physiological data being subsequently received to determine physiological change by processor;And, it is based on One or more control signals are output to communication tool system to control the behaviour of communication tool system by identified physiological change Make.This method further comprises:The retrieval setting value associated with identified physiological change, wherein, by one or more controls Signal output processed to communication tool system be based on the setting value.The setting value is user-defined setting value or predefined Default setting value.This method further comprises:Message is output to by external authorization system based on identified physiological status.The party Method also includes:Based on the GPS location of identified physiological status at least output notice and the vehicles.This method includes:It is based on Identified physiological status output prompting;And, determined whether to have been received by user response by processor, wherein, by one Or it is based on the user response that multiple control signal, which is output to communication tool system,.Determined whether to have been received by by processor User response further comprises:Receive the sensing data from one or more response sensors;Handle the sensing data To determine whether user has made gesture;And, the determination based on gesture, it is determined that having been received by response.
There is provided a kind of system that the vehicles are controlled based on physiological character in one embodiment.The system includes and friendship The source of the relevant physiological data of logical tool user.The system also includes the control module with processor, and it handles physiological data And at least one in one or more control signals is output to vehicle control system with automatic based on the physiological data The vehicles are operated, and one or more control signals are output to vehicle control system to order based on the physiological data Make one in HVAC system, seat system, information entertainment, car lock system, illuminator, window system and warning system Or it is multiple.
The source of physiological data is the personal device associated with user.The processor handles the physiological data to produce basis Physiologic readout, handles the physiological data being subsequently received to determine physiological change, and based on identified physiological change by one Or multiple control signal is output to vehicle control system.Processor retrieval is associated with identified physiological change to be set Definite value, also, it is based on the setting value that one or more control signals are output into vehicle control system.The setting value It is user-defined setting value or predefined default setting value.The processor handles the physiological data received and determination one Or multiple physiological status, and one or more control signals are output to vehicles control by physiological status based on determined by System.Message is output to external authorization system by processor physiological status based on determined by.Processor output is based on institute The GPS location of the physiological status of determination at least output notice and the vehicles.Processor physiological status based on determined by is defeated Go out prompting, it is determined whether have been received by user response, and the control module is based on the user response by one or more controls Signal output processed is at least one communication tool system.The processor is based on the biography received from one or more response sensors Sensor data determine whether to have been received by user response, and whether the processor handle sensing data to determine user Through making gesture.Determination of the processor based on gesture, it is determined that having been received by user response.
There is provided a kind of wearable electro-physiologic device in one embodiment.The wearable electro-physiologic device is given birth to including at least one Sensor is managed, it observes at least one physiological status associated with the wearer of electro-physiologic device and based on this generation sensor Signal.The wearable electro-physiologic device also includes the control module with processor, and it handles sensor signal and believes sensor Number it is output to the system associated with the vehicles.
The wearable electro-physiologic device is to be selected to include the portable electron device of following every group:Wrist-watch, finger ring, ear Ring, bracelet, cuff button, necklace, necktie, glasses, pectoral girdle, intelligent clothing and combinations thereof.
Brief description of the drawings
Exemplary embodiment will be described together with accompanying drawing below, wherein, the similar element of similar digitized representation, and its In:
Fig. 1 is the functional block diagram according to each embodiment, shows the automatic Pilot vehicles with physiologic control system;
Fig. 2 is the functional block diagram according to each embodiment, shows one or more automatic Pilot vehicles with Fig. 1 Traffic system (transportation system);
Fig. 3 is the DFD according to each embodiment, shows automated driving system, and it includes the automatic Pilot vehicles Physiologic control system;
Fig. 4 is the DFD according to each embodiment, shows the physiologic control system of Fig. 1 automatic Pilot vehicles Control system;
Fig. 5 is the flow chart according to each embodiment, shows the control method of Fig. 1 physiologic control system;
Fig. 6 is the flow chart according to each embodiment, shows the control method of Fig. 1 physiologic control system;
Fig. 7 is the flow chart according to each embodiment, shows the control method of Fig. 1 physiologic control system;
Fig. 8 schematically illustrates the exemplary computer architecture according to each embodiment;
Fig. 9 shows the example memory part of the Computer Architecture of Fig. 8 according to each embodiment;
Figure 10 shows the exemplary wearable device according to each embodiment, and it is worn on user, and to user Action is sampled;
Figure 11 schematically illustrates the illustrative methods according to each embodiment;With
Figure 12 shows to be inputted and exported according to the example system of each embodiment.
Embodiment
It is that following detailed description is substantially merely exemplary and be not intended to limit application and use.In addition, not It is intended to be expressed by any present in preceding technical field, background technology, the content of the invention or posterior embodiment Or the theoretical limitation implied.Terms used herein module refers to any hardware, software, firmware, electronic control part, place Logic and/or processor device are managed, independently or with any combinations, is included but is not limited to:Application specific integrated circuit (ASIC), electronics Circuit, processor (shared, special or packet) and memory, the combination for performing one or more softwares or firmware program Logic circuit and/or other suitable parts that the function is provided.
Embodiment of the disclosure can be described in terms of function and/or logical block components and each process step herein.Should When, it is realized that this kind of block part can be implemented as any amount of hardware, software and/or the firmware for being configured to perform specific function Part.For example, embodiment of the disclosure can use various integrated circuit components, such as memory element, Digital Signal Processing member Part, logic element, inquiry table etc., they can be performed under the control of one or more microprocessors or other control systems Various functions.In addition, it will be appreciated by persons skilled in the art that embodiment of the disclosure can be together with any amount of system Implement, also, communication tool system described herein is only an exemplary embodiment of the disclosure.
For simplicity, herein, (and this is with signal transacting, data transfer, signalling, control and the system The single operation part of system) the related routine techniques of other function aspects can be not described in detail.In addition, include herein The connecting line shown in each figure is intended to represent the example functional relationships and/or physical connection between each element.It should be noted that Arrive, many replacements or additional functional relationship or physical connection may reside in embodiment of the disclosure.
Reference picture 1, according to each embodiment be shown generally as 100 physiologic control system it is related to the vehicles 10 Connection.Generally speaking, physiologic control system 100 is received from physiological monitoring device 102 inputs and intelligently controls traffic based on it Instrument 10.
As Fig. 1 is painted, the vehicles 10 mainly include chassis 12, vehicle body 14, front-wheel 16 and trailing wheel 18.Vehicle body 14 is arranged in On chassis 12, and substantially surround the part of the vehicles 10.Vehicle body 14 and chassis 12 can be jointly formed vehicle frame.Wheel 16-18 is each rotationally coupled to chassis 12, positioned at each corner vicinities of vehicle body 14.
In various embodiments, the vehicles 10 are the automatic Pilot vehicles, and physiologic control system 100 be incorporated to or It is associated with the automatic Pilot vehicles 10 (the hereinafter referred to as automatic Pilot vehicles 10).The automatic Pilot vehicles 10 are for example It is automatically controlled to transport passenger to the vehicles of another location from a position.In the embodiment shown driving automatically Sail the vehicles 10 and be described as car, it is to be appreciated, however, that any other vehicles is could be used that, including motorcycle, card Car, sport vehicle (SUV), Amusement vehicle (RV), ocean ships, aircraft etc..In one exemplary embodiment, certainly Dynamic drive a conveyance 10 is so-called three-level, level Four or Pyatyi automated system.Three-level system represents " automation of having ready conditions ", Refer to that automated driving system performs specific driving model in all aspects of dynamic driving task, it is expected that human driver will Request is responded appropriately to be intervened.Level Four system representation " increasingly automated ", refers to that automated driving system is driven dynamically Specific driving model is performed in all aspects for sailing task, even if human driver does not respond appropriately to request to be intervened. Pyatyi system representation " full automation ", refer to automated driving system in all roads that can be managed by human driver and In the full-time execution of all aspects of dynamic driving task under environmental condition.But will be noted that, if desired, physiology control System 100 can also be connected to or be combined with the other automated system of even lower level.
As indicated, the vehicles 10 mainly include propulsion system 20, transmission system 22, steering 24, brakes 26, Sensing system 28, actuator system 30, at least one data storage device 32, at least one controller 34 and communication system 36.In various embodiments, propulsion system 20 can include internal combustion engine, motor such as traction motor and/or fuel cell is promoted System.Transmission system 22 is configured to according to optional speed than transferring power to wheel 16-18 from propulsion system 20.According to each implementation Example, transmission system 22 can include rank ratio (step-ratio) automatic transmission, buncher or other suitable speed changers. Brakes 26 is configured to provide braking moment to wheel 16-18 and/or transmission system 22.In various embodiments, braking system System 26 can include friction brake, brake-by-wire device, regeneration brake system such as motor and/or other suitable braking systems System.The route of the traveling of the influence automatic Pilot of steering 24 vehicles 10, such as position by adjusting wheel 16-18.Though So it is described as including steering wheel for illustration purpose, still, in some embodiments conceived in the range of the disclosure, steering system System 24 can not include steering wheel.
The vehicles 10 also mainly include the comfortable and convenient sexual system of one or more users, include but is not limited to, heat supply Ventilation and cooling (HVAC) system 21, seat system 23, information entertainment 25, car lock system 27, illuminator 29, window system System 31, warning system 33 etc..In various embodiments, HVAC system 21 includes being connected to the motor of air blower, and the horse Up to activateding to drive the air blower to guide air through condenser (for cooled air) and/or heater (for quilt The air of heating) to reach the expectation ambient air temperature in the vehicles 10.Condenser and heater can also activated to cool down Or air-flow of the heating from air blower.In various embodiments, one or more seatings of seat system 23 and the vehicles 10 Surface or seat are associated and including one or more motors, and motor is activated to move corresponding seat in all directions, Including but not limited to, it is front and rear, up and down, tilt etc..Seat system 23 can also include motor, its activated with provide enhancing or The lumbar support of decrease, and heating coil can also be included, it activated to provide thermal output for one or more seats (such as seat warmer).In various embodiments, seat system 23 can also include cooling control valve, and it is activated with the future One or more seats, which are directed to, from the cooled air of HVAC system 21 takes surface (such as seat cooling device) to cool down.
In various embodiments, information entertainment 25 includes display 25a and one or more input unit 25b.Letter Other consumer entertainment options, including but not limited to radio, DVD etc. can also be included by ceasing entertainment systems 25.Infotainment system System 25 communicates with physiologic control system 100 and provides input by user and one or more interacting for input unit 25b To physiologic control system 100.Display 25a generally includes any display, and it may be implemented within the instrument of the vehicles 10 In plate, such as flat-panel monitor, curved surface or other shapes, or the projection display, 3D virtual monitors etc..Display 25a includes any appropriate technology for display information, including but not limited to liquid crystal display (LCD), Organic Light Emitting Diode (OLED), plasma or cathode-ray tube (CRT).Input unit 25b includes any dress that input and/or order are received from user Put (such as wearable device, hand gesture detecting device, microphone, button, keyboard etc.), and input unit 25b can include with Touch screen layer associated display 25a.
In various embodiments, car lock system 27 includes one or more lock actuators, and its is operable to lock and beat Open the corresponding one or more doors being associated with the vehicles 10.It should be noted that car lock system 27 can also include one Or multiple lock actuators, its is operable to lock and open the rear baffle associated with the vehicles 10 or goods access plate. In certain embodiments, car lock system 27 can also include one or more latch actuators, its is operable pull open or latch with The breech lock of corresponding one in the vehicles 10 associated one or more doors, rear baffle or goods access plate.
Illuminator 29 includes one or more light in the compartment of the vehicles 10 or outside the compartment of the vehicles 10 Output device (such as headlight and taillight).In each embodiment, illuminator 29 can activated to light vehicles compartment Lamp outside outer one or more lamps or the compartment of the flicker vehicles 10.In addition, illuminator 29 can be actuated to change The color of the light exported in the compartment for becoming the vehicles 10 or the compartment for illuminating the vehicles 10.In various embodiments, window Family system 31 includes one or more motors, and each is associated with the corresponding drive system of the window of the vehicles 10.One Individual or multiple motors are actuated to move corresponding window between an open position and a closed.In various embodiments, it is alert Reporting system 33 includes siren, or, other output devices are actuated to produce big noise.
Sensing system 28 includes one or more sensors or sensing device further 40a, 40b ... 40n, and it senses external rings The observable situation in border and the internal environment and/or mode of operation of the automatic Pilot vehicles 10.Sensing device further 40a, 40b ... 40n can include, but not limited to radar, laser radar, global positioning system, optical camera, thermal sensation camera, ultrasound Wave sensor and/or other sensors, communication link device or gps antenna.Actuator system 30 includes one or more actuatings Device device 42a, 42b ... 42n, it controls one or more vehicles features, part, system and/or function, for example but It is not limited to propulsion system 20, transmission system 22, steering 24, brakes 26, HVAC system 21, seat system 23, information Entertainment systems 25, car lock system 27, illuminator 29, window system 31 and warning system 33.
Data storage device 32, which is stored in, automatically controls the data that the automatic Pilot vehicles 10 are used.In each embodiment In, data storage device 32 storage can navigational environment definition mapping.In various embodiments, this definition mapping can be by long-range System is predefined and is obtained (reference picture 2 is described in more detail) from the remote system.For example, this definition mapping can be by remote Journey system collects and sends the automatic Pilot vehicles 10 (wirelessly and/or in wired mode) to and be stored in data In storage device 32.If recognizing, data storage device 32 can be a part for controller 34, with 34 points of controller From, or, it is that a part for controller 34 is a part for piece-rate system again.
Controller 34 includes at least one processor 44 and computer readable storage means or medium 46.Processor 44 can It is any customized or commercially available processor, CPU (CPU), graphics processing unit (GPU) and controller Secondary processor, semiconductor-based microprocessor (form of microwafer or chipset) among 34 associated several processors, Macrogenerator, their any combination or any device for being generally used for execute instruction.For example, computer-readable storage dress Put or medium 46 can include read-only storage (ROM), random access memory (RAM) and keep alive memory Volatile and nonvolatile storage in (keep-alive memory, KAM).KAM is perpetuity or nonvolatile memory, and it can For storing each operating parameter when 44 power down of processor.Computer readable storage means or medium 46 can be used Any in many known as memory devices realize, such as PROM (programmable read-only memory), EPROM (electric PROM), EEPROM (electrically erasable PROM), flash memory or data-storable any other electric, magnetic, light or combination are deposited Storage device, some of them represent executable instruction, are used by controller 34 when controlling the automatic Pilot vehicles 10.
The instruction can include the program of one or more separation, each include for the executable of logical function The ordered list of instruction.These instructions are received and signal of the processing from sensing system 28, performed when being performed by processor 44 For logic, calculating, method and/or the algorithm of the part for automatically controlling the automatic Pilot vehicles 10, and produce control Signal automatically controls the automatic Pilot vehicles 10 to actuator system 30 with logic-based, calculating, method and/or algorithm Part.Although only showing a controller 34 in Fig. 1, the embodiment of the automatic Pilot vehicles 10 can be included arbitrarily The controller 34 of quantity, they communicate in the combination of any suitable communication media or communication media, and cooperate with handling Sensor signal, execution logic, calculating, method and/or algorithm, and produce control signal automatically to control automatic Pilot to hand over The feature of logical instrument 10.
In various embodiments, one or more instructions of controller 34 are incorporated in physiologic control system 100, also, When being performed by processor 44, processor 44 is promoted to handle the input received from physiological monitoring device 102 and output one or many Individual control signal is to actuator system 30 with one based on the input control vehicles 10 received from physiological monitoring device 102 Or multiple vehicles features, part, system and/or function.For example, processor 44 can be handled from physiological monitoring device 102 inputs received simultaneously export one or more control signals to actuator system 30 with based on one or more sensor signals Or the input received from physiological monitoring device 102 automatically drives a conveyance 10.Processor 44 can be handled from physiology prison Survey the input that receives of device 102 and export one or more control signals to actuator system 30 with control HVAC system 21, One in seat system 23, information entertainment 25, car lock system 27, illuminator 29, window system 31 and warning system 33 It is individual or multiple.
Communication system 36 is configured to wirelessly send a message to other entities 48 or transmits information from other entities 48, for example But it is not limited to other vehicles (" V2V " communicates), infrastructure (" V2I " communicates), remote system and/or personal device (ginseng According to Fig. 2 more detailed descriptions).In one exemplary embodiment, communication system 36 is wireless communication system, be configured to by using The WLAN (WLAN) of the standards of IEEE 802.11,Or transmitted by using cellular data communication.So And, additional or replacement communication means, such as DSRC (DSRC) passage is contemplated in the scope of the present disclosure It is interior.DSRC passages refer to that unidirectional or two-way short distance, to intermediate range wireless communication, is designated specifically to motor vehicle purposes and one The corresponding agreement of group and standard.Communication system 36 can be also configured to data encoding or produce coded data.By communication system 36 coded datas produced can be encrypted.Safe key can be used to decrypting and decoding the coded data, such as this area What technical staff recognized.Safe key can be pass word or allow the data to coded data decryption, fingerprint, eyes Other arrangements of fingerprint, face recognition or DNA identifications.
The vehicles 10 also include one or more response sensors 39.One or more response sensors 39 with and control Physiologic control system 100 in device 34 processed communicates.The user of the one or more observation of response sensor 39 vehicles 10 and base In this generation sensor signal.In various embodiments, the response of the one or more observation of response sensor 39 users or gesture And based on this generation sensor signal.For example, one or more response sensors 39 include but is not limited to camera, it is radar, wired Gloves and wearable device, including but not limited to portable electron device, form are wrist-watch, finger ring, earrings, bracelet, cuff button, item Chain, necktie, glasses, pectoral girdle, intelligent clothing etc., they are configured to observe one or more gestures or the motion that user makes. Based on the sensor signal from response sensor 39, physiology control device 100 controls one or more systems of the vehicles 10 System, for example HVAC system 21, seat system 23, information entertainment 25, car lock system 27, illuminator 29, window system 31, Warning system 33 and automated driving system 200.In other words, one or more motions of the user of the vehicles 10 or gesture are seen Examine and handled by physiologic control system 100 to control one or more communication tool systems or the vehicles 10 behaviour of itself Make.
In certain embodiments, response sensor 39 includes at least one camera 39 ' and at least one range sensor (range sensor).The range sensor can include short-range radar (SRR), ultrasonic sensor, long-range radar, optical detection And ranging (LiDAR) sensor.Camera 39 ' and range sensor can include sensing system 28 sensor 40a, One in 40b ... 40n.Shown camera 39 ' schematically represents one or more cameras, is placed in any of the vehicles 10 Appropriate or suitable position, such as at vehicles side mirror, near door handle at OR gate handle, at rear car case lid, from friendship Logical instrument headlight and/or taillight face out, in the compartment of the vehicles 10 etc..Each camera 39 ' is configured to detect user Presence, in certain embodiments, detect user movement presence.It is each movable, for example, by computer based system The actuator that 700 (Fig. 8) or controller 34 are controlled automatically moves the user moved to follow the trail of near the vehicles.Camera can It is used together with other sensors such as laser motion detection sensor to recognize user gesture.Sensing includes user's fortune of gesture Dynamic sensor can be oriented in any one in multiple directions, without departing from the scope of the present disclosure.
In one embodiment, response sensor 39 is user's set 54.In this embodiment, user's set 54 is configured There is at least one sensor such as motion detector based on radar to detect user movement.User's set 54 can include being used for Any suitable part of user gesture or motion is sensed, such as camera components, the inertia with one or more accelerometers are moved Unit (IMU) is measured, and the user gesture or motion sensed is passed to the vehicles 10 by communication network 56.
Referring now to Fig. 2, in various embodiments, it can be adapted to use on Fig. 1 automatic Pilot vehicles 10 described In taxi or a certain geographic region (such as city, school or enterprise campus, shopping center, amusement park, event center etc.) In shuttle system environment, or can be simply by remote system administration.For example, the automatic Pilot vehicles 10 can with based on The remote traffic system of the automatic Pilot vehicles is associated.Fig. 2 shows to be shown generally as the exemplary reality of 50 operating environment Example is applied, it includes the remote traffic system 52 based on the automatic Pilot vehicles, the system is described with one or more on Fig. 1 The automatic Pilot vehicles 10a, 10b ... 10n be associated.In various embodiments, operating environment 50 further comprises one Individual or multiple user's sets 54, remote physiological processing system 66, one or more physiological monitoring devices 102 and one or more outer Portion's authoring system 80, it is communicated with the automatic Pilot vehicles 10 and/or the remote traffic system 52 by communication network 56.
Communication network 56 supports the communication (example between device, system and the part supported by operating environment 50 as required Such as, by tangible communication link and/or wireless communication link).For example, communication network 56 can include wireless carrier system 60 Such as cellular telephone system, it includes multiple cell tower (not shown), one or more mobile switching centres (MSC) and (not shown Go out) and any other connection wireless carrier system 60 and the network components required for GCS Ground Communication System.Each cell tower bag Include and send and receive antenna and base station, the base station from different cell towers is connected to MSC, directly or through mid-mount Such as base station controller.Wireless carrier system 60 is able to carry out any suitable communication technology, including for example digital technology is for example CDMA (such as CDMA2000), LTE (for example, 4GLTE or 5GLTE), GSM/GPRS or other be popular or emerging wireless skill Art.Other cellular tower/base stations/MSC arrangements are possible, and can be used together with wireless carrier system 60.Closed for example, slightly lifting The numerical example that removing the work is put, base station and cell tower can be co-located at identical place, or they can be arranged away from each other, each Base station can be responsible for single cell tower, either single base station can service each cell tower or, each base station is connectable to Single MSC.
In addition to including wireless carrier system 60, the second wireless carrier system of the form of satellite communication system 64 can be included Unite to provide the unidirectional or two-way communication with the automatic Pilot vehicles 10a, 10b ... 10n.It can use one or more logical Letter satellite (not shown) and up-link transmitting station (not shown) accomplish this point.One-way communication can include such as satelline radio Service, wherein, programme content (news, music etc.) is received by transmitting station, and packing is uploaded, and is then sent to satellite, its this Individual programm broadcasting is to subscriber.Two-way communication can include such as satellite phone technological service, be handed over using satellite in automatic Pilot Relay forwarding telephone communication between logical instrument 10 and station.Satellite phone technology can be used as being additional to wireless carrier system 60, or replace wireless carrier system 60.
GCS Ground Communication System 62 is may further include, it is attached to the conventional continental rise of one or more land line phones Telecommunicatio network, and wireless carrier system 60 is connected to remote traffic system 52.For example, GCS Ground Communication System 62 can be wrapped Public switched telephone network (PSTN) is included, such as providing hard-wired telephony, packet switched data communication and because of spy The public switched telephone network of net infrastructure.One or more sections of GCS Ground Communication System 62 can be by using standard cable Net, fiber or other light nets, cable system, power line, other wireless networks such as WLAN (WLAN) or provide broadband without Line accesses the network or their any combination of (BWA) to realize.In addition, remote traffic system 52 is without going through ground communication System 62 is connected, but can include radio telephone equipment so as to it can directly with wireless network such as wireless carrier system 60 Communication.
Although only showing a user's set 54 in Fig. 2, the embodiment of operating environment 50 can support Arbitrary Digit The user's set 54 of amount, including multiple user's sets 54 that a people possesses, operates or otherwise used.By operating environment The 50 each user's sets 54 supported can use any suitable hardware platform to realize.At this point, user's set 54 can It is embodied as any common form factor, includes but is not limited to:Desktop computer;Laptop computer (such as tablet PC, portable Formula computer or net book);Smart mobile phone;TV game computer;Digital media player;Single type home entertainment is equipped;Number Code-phase machine or video camera;Wearable computing device (for example, intelligent watch, intelligent glasses, intelligent clothing) etc..Therefore, user Device 54 can be mancarried device.The each user's set 54 supported by operating environment 50 is embodied as computer is performed or base In the device of computer, patrolled with hardware, software, firmware and/or the processing needed for implementing each technology described herein and method Volume.For example, user's set 54 includes the microprocessor of programmable device form, it include being stored in internal memory structure and It is used to receive binary system to set up one or more instructions of binary system output.In certain embodiments, user's set 54 include GPS module, and it can receive gps satellite signal and produce gps coordinate based on those signals.In other embodiments, User's set 54 includes cellular communication function, so that, the device is using one or more cellular communication protocols in communication network Implement sound and/or data communication on network 56, as described herein.In various embodiments, user's set 54 is aobvious including vision Show device, such as touch screen graphic alphanumeric display or other displays.
Generally, communication network 56 enables to communicate between user's set 54 and the automatic Pilot vehicles 10, so that, Communication system 36 receives one or more start from user's set 54 and asked and/or user preference, and they are transmitted to physiology control System 100 processed.Start request and/or user preference can be by the user input apparatus associated with user's set 54 (for example Keyboard, speech recognition system etc.) provide.In addition, startup request and/or user preference can be by user's sets 54 The application program (i.e. " app ") of operation is provided.
Communication network 56 can also to communicate between physiological monitoring device 102 and the automatic Pilot vehicles 10.It is logical Often, communication system 36 communicates with physiological monitoring device 102, so that, controller 34 receives one or more biosensor signals Or physiological sensor data, they are transmitted to physiologic control system 100.Further, physiological monitoring device 102 can pass through One or more the biosensor signals or physiological sensor data are sent to remote physiological processing system by communication network 56 66 and/or external authorization system 80.
Although only showing a physiological monitoring device 102 in Fig. 2, the embodiment of operating environment 50 can be supported Any number of physiological monitoring device 102, including multiple physiology monitorings dress that a people possesses, operates or otherwise used 102 are put, they can for example monitor different physiological characters.Physiological monitoring device 102 communicates with communication network with controller 34 Physiological sensor data or sensor signal are provided on network 56 to physiologic control system 100.By operating environment 50 support it is each Physiological monitoring device 102 can use any suitable hardware platform to realize.In addition, each physiology supported by operating environment 50 Monitoring device 102 is embodied as computer is performed or computer based device, with implementation each technology described herein and side Hardware, software, firmware and/or processing logic needed for method.For example, physiological monitoring device 102 includes programmable device form Microprocessor, it includes being stored in internal memory structure and be used to receive binary system to set up binary system output One or more instructions.
In various embodiments, physiological monitoring device 102 includes one or more biosensors 104 and physiology communication system System 106.Physiological monitoring device 102 also includes physiology control module 108.In one example, biosensor 104, physiology lead to Letter system 106 and physiology control module 108 are installed in housing 110, and housing is connected to the user of the automatic Pilot vehicles 10 (i.e. driver, operator or passenger).Therefore, in one example, physiological monitoring device 102 can include wearable device, It can be placed on user's body and can be connected to the body of user, for example, finger ring, pectoral girdle, bracelet and other wearable Device, including but not limited to wrist-watch, finger ring, earrings, bracelet, cuff button, necklace, necktie, glasses, pectoral girdle, intelligent clothing etc. shape The portable electron device of formula.Therefore, in certain embodiments, physiological monitoring device 102 includes and the automatic Pilot vehicles The personal device that 10 operator is associated, its can by operator carry and using the automatic Pilot vehicles 10 when with Operator is brought into the automatic Pilot vehicles 10.It will be realized that physiological monitoring device 102 can include one or more physiology Monitoring device, they are fixedly coupled to the automatic Pilot vehicles 10, and are not therefore that user is wearable.
One or more physiological characters of the observation user of biosensor 104 simultaneously produce sensor signal based on this.Each In individual embodiment, biosensor 104 observation physiological character such as blood pressure, pulse frequency, body temperature, respiratory rate, blood glucose, alcohol Level (such as blood alcohol level) and the body action of user, and based on this generation sensor signal.It should be noted that raw Reason sensor 104 can observe the other characters or feature of user, what list above was merely exemplary.Physiology control module 108 from biosensor 104 receive sensor signal and control physiology communication system 106 with by communication network 56 transmission come The associated controller 34 of the vehicles 10 and/or teleprocessing system life are given from the sensor signal of biosensor 104 Manage processing system 66.In various embodiments, physiology control module 108 also controls the physiology communication system 106 with by communication Network 56 transmits the sensor signal from biosensor 104 to user's set 54 and/or the external authorization system 80.
Sensor signal from biosensor 104 is passed to logical by communication network 56 by physiology communication system 106 Letter system 36, remote physiological processing system 66, user's set 54 and/or external authorization system 80.Physiology communication system 106 is with leading to Letter system 36, remote physiological processing system 66, user's set 54 and/or external authorization system 80 by operating environment 50 by being supported Any suitable communication protocol communicate, and therefore, physiology communication system 106 can include but is not limited to Transceiver, wireless set, cellular transceiver, 2G/3G/4G LTE transceivers and/or Wi-Fi transceivers.Physiology communicates System 106 can also include one-way transmission machine.In addition, physiology communication system 106 can with controller 34 carry out wire communication with Offer inputs to physiologic control system 100.
Remote traffic system 52 includes one or more back-end server systems, and it can be based on cloud, based on network Or reside in specific campus or geographical position, serviced by remote traffic system 52.Remote traffic system 52 can be by manually turning round and look at Ask or the combination of automatic consultant or both is manipulated.Remote traffic system 52 can be with user's set 54 and automatic Pilot traffic work Tool 10a, 10b ... 10n communications assign the automatic Pilot vehicles 10a, 10b ... 10n, etc. to dispatch traveling.At each In embodiment, the storage of remote traffic system 52 account such as subscriber's checking information, vehicle identity symbol, overview note Record, behavior pattern and other related Subscriber Informations.
According to typically example operational flow is used, the registered user of remote traffic system 52 can pass through user's set 54 Set up traveling request.Traveling request generally gets a lift the expectation for representing passenger position (or current GPS location), desired purpose Position (it can recognize predefined parking and/or user-defined the destination of the passenger) and is got a lift the time.Remote traffic system System 52 receive traveling request, handle the request and assign in automatic Pilot vehicles 10a-10n select one (when and Have one it is available in the case of) to specify get a lift position and reasonable time to carry passenger.Remote traffic system 52 may be used also Properly configure confirmation message to produce and send or notify to user's set 54 to allow passenger to know the vehicles on the way.
In various embodiments, remote traffic system 52 includes remote physiological processing system 66, and it is in response to passing through communication The remote notification that network 56 is received from the physiologic control system 100 of the automatic Pilot vehicles 10.Generally, remote physiological is handled System 66 includes remote physiological control module 68 and telecommunication system 70.Telecommunication system 70 is with being associated with automatic Pilot friendship The communication system 36 of logical instrument 10 communicates, and is communicated also on communication network 56 with one or more external authorization systems 80. In various embodiments, telecommunication system 70 includesTransceiver, wireless set, cellular transceiver, 2G/3G/4G LTE transceivers and/or Wi-Fi transceivers, and can be also configured to data encoding or produce coded data. The data received from remote physiological control module 68 are sent to external authorization system 80 and from certainly by telecommunication system 70 Dynamic 10 physiologic control system 100 of driving a conveyance receives remote notification.
Remote physiological control module 68 receives remote notification and outputs data to external authorization system based on the remote notification System 80.In various embodiments, remote physiological control module 68 accesses remote data storage 72, and long-range based on receiving Notify to retrieve user's overview.Remote data storage 72 stores one or more user's overviews.In one example, Mei Geyong Family overview includes but is not limited to the health associated with the user of physiological monitoring device 102 and/or case history, emergency coordinator Information, residential information etc..User's overview can be by user is by the application program based on WWW or passes through user's set 54 On application program input.User's overview is also based on the data from the collection of physiological monitoring device 102 to input, the physiology Monitoring device can also communicate with remote physiological processing system 66, so as to which corresponding user's overview is inputted into remote data storage In 72.Remote physiological control module 68 export to external authorization system 80 data include user's overview, the vehicles 10 work as Front position and the physiological data received from physiological monitoring device 102.
In each example, external authorization system 80 includes but is not limited to remote vehicle or user support system, police Examine dispatching system, emergency medical response dispatching system, health care supplier, underwriter or insurance company, based on what is retrieved The user's overview one or more emergency coordinators associated with the user, taxi dispatching system and/or lease traffic Instrument dispatching system.Remote traffic system 52 can also be external authorization system.Each external authorization system 80 includes communication Part such as wireless communication unit,Transceiver, wireless set, cellular transceiver, 2G/3G/4GLTE are received Hair machine and/or Wi-Fi transceivers are to receive the data transmitted by telecommunication system 70.Telecommunication system 70 can also pass through Email on internet directly communicates with external authorization system 80, or by communication network 56 directly with based on WWW Interapplication communications.The communication system 36 associated with the vehicles 10 can also directly by communication network 56 export one or Multiple message (Email, text etc.) give external authorization system 80,.
If recognize, it is considered as mark that subject matter disclosed herein, which provides some enhanced features and function to those, The accurate or basic automatic Pilot vehicles 10 and/or the remote traffic system 52 based on the automatic Pilot vehicles.Therefore, automatic Drive a conveyance and the remote traffic system based on the automatic Pilot vehicles can be modified by, strengthens or otherwise mend Offer supplementary features are provided, are described in more detail below.
Referring now to Fig. 3, and with continued reference to Fig. 1, according to each embodiment, controller 34 performs automatic Pilot and drives system Unite (ADS) 200.That is, the suitable software of controller 34 (for example, processor 44 and computer readable storage means 46) And/or hardware component is utilized to provide the automated driving system 200 used together with the vehicles 10.
In various embodiments, the instruction of automated driving system 200 can be by function or system organization.For example, such as Fig. 3 institutes Show, automated driving system 200 can include sensor fusion system 124, alignment system 126, guiding system 128 and the vehicles Control system 130.If recognize, in various embodiments, the instruction can be organized into any number of system (example Such as, in combination, further segment, etc.), because the disclosure is not limited to present example.
In various embodiments, sensor fusion system 124 synthesizes and handled sensing data and predicts the vehicles 10 Environment object and presence, position, classification and/or the path of feature.In various embodiments, sensor fusion system 124 Can merge the information from multiple sensors, including but not limited to camera, laser radar, radar and/or it is any number of its The sensor of its type.
Alignment system 126 handles sensing data together with other data, to determine position of the vehicles 10 relative to environment Put (for example, local position relative to map, the exact position relative to road track, vehicles direction, speed etc.). Guiding system 128 handles sensing data together with other data, to determine path that the vehicles 10 are followed.The vehicles are controlled System 130 produces control signal, for the path clustering vehicles 10 according to determination.In various embodiments, system is guided The 128 also exact positions of the processing vehicles 10 and map datum from data storage device 32 are one or more to determine Position is managed, for reception processing, is rested and/or the vehicles 10 that stop, including but not limited to one or more neighbouring hotels, Hospital, urgent rescue, outpatient service, parking lot, gas station, pharmacy etc..
In various embodiments, controller 34 performs machine learning techniques to contribute to the function of controller 34, such as special Levy part detection/classification, plug release, route traversal, mapping, sensor integration, ground truth determination etc..
In various embodiments, vehicle control system 130 receives the physiology control mould from physiologic control system 100 The output 199 of block 202.Operation of the vehicle control system 130 based on this control vehicles 10.In one example, hand over Logical tool control system 130 receives the output 199 from physiologic control system 100 and produces vehicles control output 180 At least one in output 182 is controlled with second vehicles.Vehicles control output 180 include one group of actuator commands with Control operation of the vehicles 10 along the path of determination, including but not limited to diversion order, gearshift order, throttle command and system Dynamic order.Second vehicles control output 182 includes one group of actuator commands and comes from vehicle control system 130 to obtain To comfortable or convenience the setting ordered, including but not limited to HVAC orders, seat order, Infotainment order, car Lock order, illumination command, window order and alert command.
Vehicles control output 180 and second vehicles control output 182 are transmitted to actuator system 30.One In exemplary embodiment, actuator 42 includes course changing control, gearshift control, Throttle Opening Control, control for brake, HVAC controls, seat Control, Infotainment control, lock control, Lighting control, window control and alarm control.Course changing control can for example control to turn To system 24, as shown in fig. 1.Gearshift control can for example control transmission system 22, as shown in fig. 1.Throttle Opening Control can be with Propulsion system 20 is for example controlled, as shown in fig. 1.Control for brake can for example control wheel brake system 26, such as institute in Fig. 1 Show.HVAC controls can for example control HVAC system 21, as shown in Figure 1.Chair control can for example control seat system 23, such as Shown in Fig. 1.Infotainment control can such as control information entertainment systems 25, as shown in Figure 1.Lock control can be controlled for example Car lock system 27, as shown in Figure 1.Lighting control can for example control illuminator 29, as shown in Figure 1.Window control can example Window system 31 is such as controlled, as shown in Figure 1.Alarm control can for example control warning system 33, as shown in Figure 1.
As briefly mentioned above, Fig. 1 physiologic control system 100 is included within automated driving system 200, for example, The vehicles control output 182 of output 180 and second is controlled for producing the vehicles of vehicle control system 130.Such as It will discuss, physiologic control system 100 produces output 199, and it is used to produce traffic work by vehicle control system 130 Tool control output 180 and/or second vehicles control output 182, it is transmitted to actuator system 30.Therefore, physiology control System 100 processed produces output 199, and it is used with the system and method control based on the disclosure by vehicle control system 130 One or more actuators 42 of actuator system 30.
For example, as reference picture 4 is shown in further detail, and with continued reference to Fig. 3, physiologic control system 100 is controlled including physiology Module 202.In various embodiments, physiology control module 202 based on the sensor signal from physiological monitoring device 102, come Sensor signal from response sensor 39, the input from user's set 54, the input from input unit 25b are simultaneously based on this Disclosed vehicle control system and method export output 199 to vehicle control system 130.Physiology control module 202 based on the sensor signal from physiological monitoring device 102, the sensor signal from response sensor 39, from user The input of device 54, the input from input unit 25b and the vehicle control system based on the disclosure and method output are used In the position of the remote notification of remote physiological processing system 66, physiological data and the vehicles 10.In various embodiments, physiology Control module 202 based on the sensor signal from physiological monitoring device 102, the sensor signal from response sensor 39, Input from user's set 54, the input from input unit 25b and the vehicle control system based on the disclosure and side Method also exports the message for one or more external authorization systems 80.Physiology control module 202 is based on from physiology monitoring dress Put 102 sensor signal and the vehicle control system and method based on the disclosure are also exported for being shown in display Interface on 25a.
Referring now to Fig. 4, and with continued reference to Fig. 1-3, DFD shows the control for physiologic control system 100 Each embodiment of system 300 processed, it can be embedded in physiology control module 202.According to the disclosure, control system 300 it is each Individual embodiment can include any number of submodule being embedded in physiology control module 202.As can appreciate that, shown in Fig. 4 Submodule can combine and/or further segment similarly to produce output 199 for vehicle control system 130, hair Data are sent to remote physiological processing system 66 and/or external authorization system 80 and are exported for being shown on display 25a Interface.Input to control system 300 can be received, from information entertainment 25 (Fig. 1) from physiological monitoring device 102 (Fig. 1) Input unit 25b receive, receive, connect from the response sensor 39 associated with the vehicles 10 from user's set 54 (Fig. 1) Receive, its from associated with the vehicles 10 other control module (not shown) reception and/or in physiology control module 202 Its submodule (not shown) determination/modeling.In various embodiments, physiology control module 202 include numerical value according to memory 302, Physiology monitoring module 304, response data memory 306, response identification module 308, setting data storage 310, state control Module 312, communication control module 314 and user interface (UI) control module 316.
The storage of numeric data memory 302 represent one of one or more feasible values of one or more physiological characters or Multiple tables (such as inquiry table) and also storage basic physiology reading.In other words, numeric data memory 302 store one or Multiple tables, it provides the one or more predefined feasible values for the physiological character observed or measured by biosensor 104 318, and also store the initial or basic reading 318a from biosensor 104.In various embodiments, these tables can be with It is to index the interpolation table defined by one or more.The one or more numerical value 318 provided by least one in these tables lead to Often represent the normal or tolerance interval of corresponding physiological character.For example, one or more numerical value 318 include the acceptable of blood pressure Scope, the tolerance interval of pulse frequency, the tolerance interval of body temperature, the tolerance interval of respiratory rate, blood glucose connect By scope, the tolerance interval of blood alcohol level, amount of exercise tolerance interval.It is used as an example, one or more tables It can be indexed with parameters, such as, but not limited to blood pressure, pulse frequency, body temperature, respiratory rate, blood glucose, blood alcohol water Flat or motion, to provide one or more numerical value 318.Basic reading 318a includes most starting to be observed by the biosensor 104 Or blood pressure, pulse frequency, body temperature, respiratory rate, blood glucose and/or the blood alcohol level measured, they are by physiology monitoring mould Block 304 is stored in numeric data memory 302.
Physiology monitoring module 304 receives physiological sensor data 320 as input.Physiological sensor data 320 includes coming From the sensor signal of the biosensor 104 associated with physiological monitoring device 102.Physiology monitoring module 304 handles physiology Sensing data 320, and the physiological sensor data 320 received (such as when the vehicles 10 are started) based on most starting produces Raw basic physiology reading 318a.Physiology monitoring module 304 stores the basic physiology reading 318a in numeric data memory 302 In.Based on the sample rate associated with biosensor 104, (exist once receiving the physiological sensor data 320 sampled recently The physiological sensor data 320 received after initial baseline reading), physiology monitoring module 304 compares later physiology sensing Device data 320 and basic physiology reading 318a simultaneously determines whether one or more physiological characters have changed.Based on this determination, Physiology monitoring module 304 sets the physiological change 321 for status control module 312.Example physiological change includes but not limited The lifting/lowering of lifting/lowering, pulse frequency in blood pressure, the lifting/lowering of body temperature, the lifting/lowering of respiratory rate, the lifting/lowering of blood glucose, motion Add drop etc..
Physiology monitoring module 304 also handles physiological sensor data 320, and retrieves one from numeric data memory 302 Individual or multiple numerical value 318.One or more numerical value 318 based on retrieval, physiology monitoring module 304 determines physiological sensor data Whether 320 within tolerance interval.If physiological sensor data 320 is beyond tolerance interval, physiology monitoring module 304 Just set for communication control module 314 and the physiological status of UI control modules 316 322.Physiological status 322 shows that physiology is sensed Device data 320 are abnormal or beyond acceptable one or more numerical value 318.
Physiology monitoring module 304 also receives the response 324 from response identification module 308 as input.Response 324 comes From user to eliminate by response of the UI control modules 316 based on the prompting 330 for receiving physiological status 322 and exporting.Based on response 324, the setting physiological data 326 of physiology monitoring module 304, it can include the physiological status determined and the physiology received sensing Device data 320, for communication control module 314.
Response data memory 306 stores one or more response setting values 328.In other words, response data memory One or more setting values of the response for the gesture that the 306 storage vehicles 10 are made to user.For example, response data memory The one or more response setting values 328 of 306 storages, they are corresponding with the gesture that user makes, and mould is controlled from UI for responding The prompting 330 of block 316.In other words, response data memory 306 stores one or many of the certain gestures made for user Individual predefined vehicles response (response setting value).In various embodiments, response setting value 328 is by from user's set 54 inputs received and user configuring and/or come the input that receives since input unit 28b, such as further discuss herein State.In other embodiments, response setting value is acquiescence or factory set value.In various embodiments, response data is deposited The storage response setting value 328 of reservoir 306, it makes specific user's gesture associated with pointing out 330 elimination, and stores response and set Definite value 328, it makes specific user's gesture associated with the enable command of status control module 312.
Respond identification module 308 and receive response sensor data 332 as input.Response sensor data 332 include coming From the sensor signal of response sensor 39.Respond the processing response sensor of identification module 308 data 332 and access response number According to memory 306 to retrieve response setting value 328, it corresponds to the gesture that response sensor 39 is observed.Based on response setting Value 328, response identification module 308 determines the desired vehicles response for the gesture observed based on response sensor 39. In each embodiment, based on response setting value 328, response identification module 308 sets the response for physiology monitoring module 304 324, it represents to eliminate prompting 330 by user by the gesture observed.Based on response setting value 328, identification module 308 is responded Also setting gesture, which enables 365, is used for status control module 312.Gesture enables 365 expressions and receives gesture to enable shape from user State control module 312.
The physiological status 322 of physiological change 321 and determination based on determination, setting data storage 310 is stored and traffic One or more setting values that the control of the system of instrument 10 is associated, including but not limited to vehicle control system 130, HVAC system 21, seat system 23, information entertainment 25, car lock system 27, illuminator 29, window system 31 and alarm system System 33.In various embodiments, based on physiological change 321 and physiological status 322, setting data storage 310 store one or Multiple tables (such as inquiry table), its represent be used for HVAC system 21, seat system 23, information entertainment 25, car lock system 27, The predefined control command of one or more of illuminator 29, window system 31 and warning system 33.In other words, if Determine data storage 310 and store one or more tables, it is provided sets with associated one or more of physiological change 321 of determination Definite value 334, and the physiological status 322 based on determination provides one or more setting values 334.In various embodiments, these Table is based on the input received from user's set 54 and/or user-defined from the input that input unit 28b is received.Other In embodiment, these tables are based on default value and predefined based on user-defined preference.As an example, one or Multiple tables can be indexed with parameters, such as, but not limited to the particular system of the vehicles 10, physiological change 321 or physiology Situation 322, to provide one or more several setting values 334.
Status control module 312 receives physiological change 321 and physiological status 322 as input.At status control module 312 Manage physiological change 321 and physiological status 322;And retrieve corresponding setting value 334.The setting based on retrieval of status control module 312 Definite value 334, which exports the output 199, is used for vehicle control system 130, and it includes HVAC data 336, seat data 338, handed over Logical instrument control data 340, Infotainment data 342, illumination data 344, lock data 346, window control data 347 and police Count off is according to 349.In one example, HVAC data 336 include one or more controls for vehicle control system 130 Signal with order actuator system 30 control HVAC system 21 come be raised and lowered the compartment of the vehicles 10 temperature (for example, One or more control signals are to motor, condenser and/or heater).Seat data 338 includes being used for vehicles control system One or more control signals of system 130 control seat system 23 to enable seat cooling device, seat with order actuator system 30 Chair warmer and/or one or more actuators with moved seat associated with corresponding seat.Vehicles control data 340 Including one or more control signals for vehicle control system 130 to pass through one to actuator system 30 or many Individual order automatically or semi-automatically controls the operation of the vehicles 10, to control steering 24, transmission system 22, promote to be System 20 and/or wheel brake system 26.Vehicles control data 340 can also include being used for vehicle control system 130 One or more control signals control wheel brake system 26 and/or propulsion system 20 to limit with order actuator system 30 The speed of the vehicles 10.
Infotainment data 342 include one or more control signals for vehicle control system 130 to order The command information entertainment systems 25 of actuator system 30 change Music Radio, play predefined playlist, recommend entertainment or Activity etc..Illumination data 344 include one or more control signals for vehicle control system 130 to order actuating Device system 30 order illuminator 29 lights the light source of the vehicles 10, includes but is not limited to, beats opening/closing one or more Interior lamp, beat one or more outsides of opening/closing etc., change color related to one or more interior lamps etc..Lock number Include one or more control signals for vehicle control system 130 according to 346 with the order car of order actuator system 30 The one or more locks and/or related with the vehicles 10 being associated to one or more doors are locked or opened to lock system 27 The goods access plate of connection, include but is not limited to, open or lock the door/goods access plate in one, open/lock all doors/ Goods access plate etc..Window control data 347 includes one or more control signals for vehicle control system 130 The one or more windows associated with the vehicles 10 are moved with the order window system 31 of order actuator system 30, including But it is not limited to, opens and/or close a window, open and/or close all windows, opens and/or close driver side Window, open and/or close the window and opening of passenger side and/or close skylight and/or the vehicles 10 turn up car Top.Data with alert 349 includes one or more control signals for vehicle control system 130 with order actuator system 30 order warning systems 33 are to enable or disable alarm.
Status control module 312 also receives navigation data 348 as input.Navigation data 348 includes the letter on position Breath, the position be the current geographic position based on the vehicles 10 for reception processing, rest and/or the vehicles 10 that stop Retrievable position, it for example guides system 128 to receive from automated driving system 200.Navigation data 348 can also be directly from remote Journey traffic system 52 is received.Status control module 312 handles navigation data 348, and based on navigation data 348 and physiological status 322, status control module 312 is the setting position option 350 of UI control modules 316.Location options 350 include one or more attached Near position, for reception processing, rests and/or the vehicles 10 that stop, including but not limited to one or more neighbouring trips Shop, hospital, urgent rescue, outpatient service, parking lot, gas station, pharmacy etc..Proximal most position for processing can also be output to friendship Logical tool control system 130 is handled with automatically or semi-automatically controlling the vehicles 10 to operate to this position.
Communication control module 314 receives physiological data 326 and physiological status 322 as input from physiology monitoring module 304. Communication control module 314 handles physiological data 326 and physiological status 322;And physiological status data 352 are exported, so as to by communicating System 36 is sent to remote physiological processing system 66.Physiological status data 352 include the life received from physiology monitoring module 304 Data 326 and physiological status 322 are managed, and the identifier of the user of physiological monitoring device 102 can be included.Communication control module 314 also export gps data 354 and remote notification 356, to be sent to remote physiological processing system 66 by communication system 36.GPS Data 354 include the current geographic position of the vehicles 10, are such as received from such as alignment system 126 of automated driving system 200 , remote notification 356 includes the notice that physiological sensor data 320 exceeds tolerance interval, as indicated in physiological status 322 's.
Based on physiological data 326 and physiological status 322, the also output message 358 of communication control module 314.In each implementation In example, message 358 is the output for communication system 36, to be sent to external authorization system 80.For example, message 358 includes The Email or text message to user's set received from UI control modules 316, itself and for example urgent shape of coordinator 360 Condition coordinator is associated.Emergency coordinator can also be received as defeated from the user's set 54 associated with the vehicles 10 Enter.
Communication control module 314 also receives the mancarried device data 362 from user's set 54 as input.It is portable Device data 362 include the input to user's set 54 received, and it includes but is not limited to, and user gesture is for example responded and carried The preference of the vehicles response for the gesture shown, pair one or more setting values associated with one or more physiological status Preference and one or more emergency coordinators.Communication control module 314 handles mancarried device data 362 and set Device preference 364, for response data memory 306 and setting data storage 310.Communication control module 314 is also handled just Portable device data 362 are used for one or more coordinators, and in various embodiments, communication control module 314, which is sent, to disappear Breath 358 is to the one or more coordinators identified in mancarried device data 362.In various embodiments, Control on Communication Module 314 also handles mancarried device data 362, and determine whether to have been received by enable request with output 199 export To vehicle control system 130.Request is enabled if having received, communication control module 314 can just set and enable data 363 are used for status control module 312.Data 363 are enabled based on receiving, physiology of the status control module 312 based on determination becomes Change 321 and/or physiological status 322, export the output 199, it includes HVAC data 336, seat data 338, vehicles control Data 340 processed, Infotainment data 342, illumination one or more of data 344 and lock data 346.
In various embodiments, based on the one or more sensor signals received from response sensor 39, Neng Gouqi With one or more communication control modules 314 and status control module 312.In other words, response identification module 308 can pass through inspection The rope response setting value 328 associated with the gesture identified handles response sensor data 332, and determines the vehicles Response is that gesture enables 365.Based on this determination, the response setting of identification module 308 gesture enables 365, for Control on Communication mould One or more of block 314 and status control module 312.365 are enabled based on gesture, communication control module 314 can be received With processing mancarried device data 362.365 are enabled based on gesture, status control module 312 can receive and handle physiological status 322 and physiological change 321.Therefore, in various embodiments, the motion of the user observed by response sensor 39 or gesture It can provide and enable request for status control module 312 and/or communication control module 314.
UI control modules 316 receive input data 366.Input data 366 is including receiving to the defeated of input unit 28b Enter.UI control modules 316 handle input data 366, and set for response data memory 306 and setting data storage 310 device preference 368;And set the coordinator 360 for communication control module 314.Preference 368 is included in response to carrying Show one or more user-defined preferences (response setting value 328) of 330 gesture, to enabling status control module 312 One or more user-defined preferences (response setting value 328) of gesture and pair become with one or more physiological status or physiology Change one or more user-defined preferences of associated setting value 334.Input data 366 may be responsive to prompting 330 inputs to input unit 28b received.
UI control modules 316 also receive physiological status 322 and location options 350 as input.UI control modules 316 are handled Physiological status 322, and based on physiological status 322, the output of UI control modules 316 prompting 330.Prompting 330 can be user circle The part in face 370.Prompting 330 include the request to gesture, the request to body kinematics, the figure to user, text and/or Auditory tone cues, it can send the warning of the physiological status 322 on determination, and alternatively, it is contemplated that it is determined that physiology shape There is provided the suggestion to action for condition 322.For example, prompting 330 can be included in automatic driving mode (so that, the vehicles 10 enter Row be automatically brought into operation) or in semi-automatic driving pattern dispose the vehicles 10 prompting.Further, the prompting can include To advising from the transfer of plan route to rest or find the prompting of processing.In some examples, based on from status control module 312 The location options 350 received, point out 330 also to include one or more positions, for user's rest, find processing or traffic of stopping Instrument 10.
Referring now to Fig. 5, and with continued reference to Fig. 1-2, flow illustrates control method 400, and it can be by according to this public affairs The Fig. 1-4 opened physiology control module 202 is performed.As can appreciate that according to the disclosure, the operation order in this method The order shown in Fig. 5 is not limited to perform, but can be applicable according to the disclosure and according to the disclosure one or many The order of individual change is performed.
In various embodiments, this method can be based on predefined event, based on receiving physiological sensor data 320 Run, and can continuously be run during the operation of the automatic Pilot vehicles 10 according to plan.This method is since 402. 404, method receives physiological sensor data 320 from physiological monitoring device 102 and sets up basic physiology reading.Basic physiology is read Number is typically to be obtained when exciting physiologic control system 100, and provides the initial sensing received from physiological monitoring device 102 Device signal or sensing data.Method stores this basic physiology reading 318a in numeric data memory 302.In 406, side Method handles physiological sensor data 320 to determine physiological change 321 and physiological status 322, and retrieves one or more numerical value 318.408, method determines whether the physiological sensor data 320 received exceeds outside acceptable values 318.If physiology Sensing data 320 exceeds one or more tolerance intervals based on one or more numerical value 318, then, method is branched to A on Fig. 6.
Otherwise, 410, method determines whether the physiological sensor data 320 received changes from basic physiology reading Become.If physiological sensor data 320 does not change from basic physiology reading 318a, or, if physiological sensor data 320 With the predefined tolerance of basic physiology reading 318a difference within, method just proceeds to 412.Otherwise, method is determined Physiological change 321 simultaneously proceeds to 414.412, whether in operation method determines the vehicles 10, and this can be based on from sensing The data that device system 28 is received are carried out.If in operation, method is just recycled back to 404 to the vehicles 10.Otherwise, method exists 416 terminate.
414, physiological change 321 of the method based on determination retrieves setting value 344 and exports the output 199, and it includes For one or more control signals of actuator system 30, with based on the setting value associated with the physiological change 321 of determination One or more systems of the 334 control vehicles 10, such as vehicle control system 130, HVAC system 21, seat system 23rd, information entertainment 25, car lock system 27, illuminator 29, window system 31 and warning system 33.In each embodiment In, this method exports the output 199 based on the setting value 334 associated with the physiological change 321 of determination.
Alternatively, method proceeds to 418, and determines whether to enable data 363 from what user's set 54 was received. If true, method just proceeds to 414 and enables request and the physiological change determined based on what is received from user's set 54 321 export the output 199, and it includes HVAC data 336, seat data 338, vehicles control data 340, Infotainment number According to one or more of 342, illumination data 344, lock data 346, window control data 347 and data with alert 349.It is no Then, this method proceeds to 420, and is determined whether based on sensor signal or sensing data from response sensor 39 It is received to enable 365 to gesture.If true, method just proceeds to 414 and based on enabling for being received from user's set 54 Request and the physiological change 321 determined export the output 199, and it includes HVAC data 336, seat data 338, vehicles control Data 340 processed, Infotainment data 342, illumination data 344, lock data 346, window control data 347 and data with alert One or more of 349.Otherwise, this method is recycled back to 418.From 414, method proceeds to 412.
Reference picture 6, and with continued reference to Fig. 1-4, flow illustrates control method 500, and it can be by according to the disclosure Fig. 1-3 physiology control module 202 is performed.As can appreciate that according to the disclosure, the operation order in this method is not limited Order shown in Fig. 6 is performed, but can one or more changes applicable according to the disclosure and according to the disclosure The order of change is performed.
In one example, method starts from A.502, method is based on the output of physiological status 322 prompting 330.504, Method determines whether to have been observed that user response or gesture based on the sensor signal from response sensor 39.If observation To user response or gesture, 506, method just from the retrieval of response data memory 306 response setting value 328 and determines gesture Whether prompting 330 will be eliminated.If gesture is to eliminate prompting 330, method just proceeds to the B on Fig. 5.
Otherwise, 508, physiological status 322 retrieval setting value 344 of the method based on determination simultaneously exports the output 199 to friendship Logical tool control system 130, this includes vehicles control data 340.Alternatively, method is based on receiving from user's set 54 Enable request export the output 199 give vehicle control system 130.510, method exports the message 358 and awarded to outside Power system 80.512, method output remote notification 356, physiological status data 352 and gps data 354 give remote physiological processing System 66.Method terminates 514.
Reference picture 7, and with continued reference to Fig. 1-4, flow illustrates control method 600, and it can be by according to the disclosure Fig. 1 and 2 remote physiological control module 68 is performed.As can appreciate that according to the disclosure, the operation order in this method The order shown in Fig. 7 is not limited to perform, but can be applicable according to the disclosure and according to the disclosure one or many The order of individual change is performed.
Method starts 602.604, method receives remote notification 356, gps data 354 and physiology from the vehicles 10 Status data 352.606, receipt that method processing is received and based on the data received from the vehicles 10 from long-range Data storage 72 retrieves user's overview.608, method exports and sends gps data 354, user's overview and physiological status number One or more external authorization systems 80 are given according to 352.Method terminates 610.
It should be noted that system (for example HVAC system 21, seat system 23, information entertainment 25, car lock system 27, Illuminator 29, window system 31 and warning system 33) and vehicle control system 130 need not only by physiology input enable. On the contrary, one or more systems and/or vehicle control system 130 can be enabled, so that, based on being connect from user's set 54 Input, vehicles to vehicle communication (V2V) etc. are received, one or more control signals are output to system (such as HVAC System 21, seat system 23, information entertainment 25, car lock system 27, illuminator 29, window system 31 and warning system And/or vehicle control system 130 33).
The vehicles-user mutual based on gesture
Reference picture 8, further describe user with the vehicles 10 interacting by one or more gestures.Generally, traffic The wearable device that instrument 10 can also be dressed with user communicate, its can be enabled based on body gesture one of the vehicles or Multiple functions.In various embodiments, wearable device is the physiological monitoring device 102 of user's wearing, itself and the vehicles 10 Communicate with initiating vehicles function and transmit sensor signal or sensor from one or more biosensors 104 Data.Therefore, in various embodiments, physiological monitoring device 102 is configured to transport based on the user for being related to physiological monitoring device 102 Dynamic each signal that sends is to the vehicles.
The response sensor 39 of the vehicles 10 can include any to connect in selected sensor and communication control processor User's input is received, the calculating unit especially programmed is used to determine the vehicles function corresponding with user's input, and output Part is used for the vehicles function for enabling or starting identification.Wearable device such as physiological monitoring device 102 is configured at each Signal, the reception for the vehicles 10 are produced and sent in embodiment with the motion based on user.If for example, user passes through Gesture mode initiates emergency calling or text message, by the device of mobile wearing, or only by body action, hands over Logical instrument 10 is made a phone call or sent text message using communication system 36.
Fig. 8 shows computer based system 700.In the embodiment of design, some or all peaces of computing system 700 Put in remote call-in or control centre, as remote traffic system 52 (Fig. 2).
Fig. 8 computer based system 700 can also be the model of other electronic systems for current techniques, deserve Preceding technology is, for example, wearable device, such as Intelligent bracelet, finger ring, cuff button, strap attachment, shoes or boots (footwear) annex, Socks, coat-sleeve, clothes, earphone, head-wearing piece, cap or other headwears, wrist-watch, glasses, sunglasses, earrings etc., it is such as following Description, including it is relevant with Figure 10.Computer based system 700 is the main computation unit such as traffic work of the vehicles 10 A part for the controller 34 (Fig. 1) of tool 10.The system and its part can be hardware based.Computer based system 700 include computer-readable recording medium or data storage device 704, and also include for example calculating by communication link 708 Processing hardware cell 706 that the is connection of machine bus or may be connected to computer readable storage means 704.In various embodiments, It is processor 44 to handle hardware cell 706.
Either multiple processors can be included by handling hardware cell 706, and it can include individual machine or multiple machines In distributed processors or parallel processor.Processing hardware cell can be used for supporting virtual processing environment.The processing hardware Unit can include the programmable gate array (PGA) of state machine, application specific integrated circuit (ASIC) including field PGA or state machine.This The processing hardware cell that text is referred to performs code or instruction can be included with performing operation, action, task, function, step etc. Processing hardware cell directly performs operation and/or promotes, instructs or cooperate with another device or part to perform operation.
In various embodiments, data storage device 704 is any Volatile media, non-volatile media, removable medium With non-disconnectable medium.The term " computer-readable medium " and its deformation used in specification and claims refers to tangible Storage medium.The medium can be device, and can be non-temporary.In certain embodiments, storage medium includes Volatile and/or non-volatile, removable and/or non-removable medium, for example, random access memory (RAM), read-only depositing Reservoir (ROM), EEPROM (EEPROM), solid-state memory or other memory technologies, CDROM, DVD, Blu-ray Disc or other disk storages, tape, magnetic disk storage or other magnetic memory devices.Data storage device 704 is wrapped One or more memory modules are included, it stores the executable computer-readable instruction of processing hardware cell 706, to perform this paper institutes The function for the computer based system 700 stated.For example, data storage device 704 includes the vehicles-machine based on group Frame module 710.
In various embodiments, response sensor 39 supplies information to computer based system 700, including represents adjacent The presence and motion of vehicles user and the information of the motion of the user in the vehicles 10.In addition, response sensor 39 It can be a part for sensing system 28.
Fig. 9 shows the more details of Fig. 8 data storage device 704.Referring now to the figure, further describe data and deposit The part of storage device 704.As provided, data storage device 704 includes one or more modules 710.Also, memory is also Accessory 712 can be included, for example, support the Add-ons and/or data of the execution of disclosed method.
Accessory 712 can include for example one or more user's overviews.The overview can include setting value, for handing over The acquiescence of one or more users (such as driver) of logical instrument and/or conventional setting.Herein, these or other data portions Part includes describing elsewhere below along with operating method 1000.This technology can carry out personalized or customization in such ways. In various embodiments, accessory 712 includes response data memory 306.
Module 710 can include at least three (3) modules 802,804,806, and next section is further described.In an implementation In example, module 710 includes one or more add-on modules.Some instructions can belong to more than one module, also, retouch herein The function of stating can be performed by the computing device of corresponding more than one module.
Functions described herein, but be not significantly with relevant a, Neng Goushi in these three modules 802,804,806 The part of one and/or a part for additional support module or multiple modules 808 of these three modules.The energy of support module 808 Enough such as subscriber identification module, passenger recognition module, study modules of including are (for example to learn user gesture style or user Freely activity or gesture-type so that improve efficiency and effect or custom system interaction) and/or recommend, suggestion or teaching module (for example, to provide suggestion carrys out triggering selection vehicles function to user on how to make gesture, so as to improve efficiency and effect Power or custom system interaction).
Each module can be referred to any of multiple names, such as with the term or phrase for representing its function.Based on meter The module 802,804,806 of the system 700 of calculation machine can be referred to as:For example, user gesture determining module 802;Vehicles function Identification module 804;Vehicles function enables module 806;It is similar or other.
The processing hardware cell 706 for performing user gesture determining module 802 determines user based on user input data Which gesture made.The user input data can include one or more data components.From one or many of various data sources Individual reception user input data gives processing hardware cell 706, so that performing module 802.Sample data source is filled including physiology monitoring Put 102 or user wearing other wearable devices one or more sensors and such as vehicles 10 it is one or more Other sensors, it is constructed and configured to the motion for sensing one or more user's body parts, for example, arm, wrist, head Etc..Other wearable devices include Intelligent bracelet, finger ring, cuff button, strap attachment, shoes or boots (footwear) annex, socks Son, coat-sleeve, clothes, earphone, head-wearing piece, cap or other headwears, glasses, finger ring, sunglasses or wrist-watch, these are only several Individual example.
The example wearable device of Intelligent bracelet form is marked with numeral 900 in Fig. 10.As mentioned, device 900 Can be computerization or electronic installation, with any those parts similar to shown in Fig. 8 and 9, such as including executable finger The memory cell of order and the processing unit for performing these instructions.In addition, as discussed, device 900 can be physiology prison Device 102 is surveyed, or one or more features of physiological monitoring device 102 can be included, and therefore, it can include one Or multiple biosensors 104.
In various embodiments, device 900 includes at least one conveyer or transceiver component, at least sending signal Or message is to the vehicles, such as signal or message and biosensor signal corresponding with user gesture.Conveyer/transceiver Can have any property or other characteristics of the above-mentioned communication component for physiological monitoring device 102.Transmitter/transmitting-receiving function Enough configure for example for being communicated according to any of various agreements, these agreements include Infrared ray, IrDA (IRDA), near-field communication (NFC) be similar or their improvement.
And as mentioned, in certain embodiments, the system is configured to for example by sensing one of user gesture Or multiple vehicle sensors record whether user is just dressing device 900.As provided, the data source includes one Or multiple sensors, it is configured to the motion for sensing user's body part such as wrist, head, arm or hand.User's arm, hand Wrist and hand figure 10 illustrates.These sensors can include but is not limited to include the physiologic control system above in connection with Fig. 1 and 2 Those of 100 description of response sensor 39, for example, the sensing system 28 of at least one camera 39 ' and/or the vehicles 10 Sensing device further 40a, 40b ... 40n (Fig. 1).
In various embodiments, the vehicles 10 and/or device 900 are configured to determine whether user occurs or neighbouring traffic Instrument, such as by determining wearable device adjacent to the vehicles 10.Therefore, together with the neighbouring or attached of detection user's mobile device This is added to, the vehicles 10 can exist by any identification or checking user of various modes, for example, pass through voice verification, face Portion's checking, retina scanning etc..In various embodiments, making at presence or apparatus adjacent 900 and/or the vehicles 10 Determination after, device 900 and/or the vehicles 10 are only sensed and/or acted in user gesture.
The processing hardware cell 706 that execution vehicles function enables module 806 is performed by performing first module 802,804 Processing hardware cell 706 recognize function.Illustrative functions include initiating 911 callings, lock or open car door etc..
Figure 11 shows the illustrative methods 1000 according to the embodiment of this technology.It should be appreciated that method 1000 is not Must occur with any particular order, and some or all steps are performed feasible and are conceived to alternate orders.Should also When understanding, shown method 1000 can terminate at any time.
In certain embodiments, some or all steps of process 1000 and/or substantially equivalent step are by processor For example computer processor is performed, and its execution is stored in or is included in computer-readable medium computer based as escribed above Computer executable instructions on the data storage device 704 of system 700.
The flow of method 1000 is divided into four sections by way of example:User individual and input section 1010, Comfortably/convenience vehicles function section 1020, local alarm vehicles function section 1030 and telecommunication or alarm Section 1040.
1011, user puts or with physiological monitoring device 102, as shown by Figure 10 exemplary device 900, or Other mobile devices such as smart phone.1012, mobile device and/or sensor and the computing system religion for being subordinate to the vehicles Lead and/or understand user movement, such as gesture and related expectation vehicles function.One or many of the motion of these study It is individual to be stored in as response setting value in response data memory 306.In various embodiments, the system can have can The gesture of acquiescence for using is set up, and/or user can set up gesture, such as by setting up interactive rank in systems, For example, the first order of facility/comfortableness gesture;With the second level for emergency.Teaching can include suggestion user and use Gesture is to trigger corresponding vehicles function.These suggestions can be from the vehicles are by user's set or pass through display 25a (Fig. 1) sends user to.These suggestion can include standard or acquiescence gesture, they with corresponding traffic work Having function is associated.User selects one or more of these suggestions as preference 368, and it can be stored in response data and deposit In reservoir 306.
1013, inputted based on user, acquiescence is programmed, instructed or the renewal from remote traffic system 52, this method is adopted With or definition acquiescence or personalized gesture control.1014, this method determines that user arranges.Operation can include for example determining to use Family is close to the vehicles 10, the neighbouring vehicles, in a vehicle or leave the vehicles 10.
1015, this method detects user gesture or motion and based on the signal identification received from response sensor 39 The gesture.This method determination vehicles function corresponding with user movement or vehicles response.In various embodiments, This method based on the gesture retrieval response setting value 528 identified and sets traffic based on the response setting value 328 retrieved Instrument is responded or function.
1021, this method performs the local facility determined in previous operation 1015 or comfortable function.This section 1020 In illustrative functions include but is not limited to light or flash the lamp of vehicle exterior (under headlight, taillight, indicator, vehicle body Lamp and/or body light), lock door/door opening, or car door, deck lid or luggage case beat opening/closing, enables state control mould Block 312, elimination prompting 330 etc..
1031, this method performs the local alarm determined in previous operation 1015 or emergency function.The local work(of example It can include starting that vehicle horn, flicker car be outer or body light etc. herein.In the embodiment of design, the function includes handing over Logical tool records audio and/or video, are related to user or the possible crime situation close to user so as to record., should 1041 Method performs correlation function outside the car determined in previous operation 1015.Illustrative functions herein include initiate phone, text message, GPS location or video are transmitted, such as in 1031 those recorded.Phone can make 911, can be automatic calling, wherein, The vehicles provide a message to recipient, or can be user's callings, wherein, transmit real-time audio.In the embodiment of design In, the function include any user's mobile device or neighbouring tape deck, such as parking lot infrastructure, record audio and/ Or video, it is related to user or the possible crime situation close to user so as to record.
Method 1000 can terminate, or, any one or more operations of method 1000 can be performed again.
Figure 12 shows the example system input 1110 separated by gesture recognition system 1160 of the embodiment according to this technology With the arrangement 1100 of output 1150.Input 1110 can be divided into three primary tapes:1130 are inputted outside user gesture 1120, car Inputted for 1140 (on a vehicle) on (outside the vehicles) and car.
Example user gesture 1120 is including above mentioned any, for example, user's body partial turn 1121, straight line refer to To or it is mobile 1122, fiercely attack and 1123 and click 1124.Input 1130 includes coming from one or more vehicles outside the car of example The input 1141 of camera, the input 1142 of other vehicle sensors, the Bluetooth to the vehicles 10 inputs 1143, To such as remote input 1144 from remote traffic system 52 of the vehicles 10, from the vehicles or mobile device application Program 1145 is for example navigated or wearable position determines the input of application, the vehicles or vehicles relevant control or function number Enter 1146 such as user's Trackpad, vehicle illuminations, keyfob memory (keyfob), lock/unblock button or actuating, key Spoon pendant memory, and vehicle position input 1147.Input 1140 includes the positional information (example from satellite on example car Such as GPS) or other data inputs 1131, the data input 1132 from base station, data input 1133 (V2V, V2I from V2X Etc.), or pass through the data 1134 of the internet connected in any suitable manner.
In various embodiments, gesture recognition system 1160 includes appointing for the part provided above in connection with gesture identification function One kind, such as user's mobile device or vehicle sensors and computing system.
Output function 1150 includes but is not limited to those any described above, for example, light light for vehicle 1151, car door lock 1152 is locked/unlocked, vehicle horn 1153 is manipulated, communication 1154 such as calling or text message is initiated, Or mobile device or vehicle position and/or record in mobile device, the vehicles or neighbouring structure such as parking lot phase The transmission 1155 of audio or video on machine.In various embodiments, output function 1150 also enables 365 use including setting gesture In status control module 312 and set response 324 be used for physiology monitoring module 304.
Although at least one presented exemplary embodiment in embodiment above, it is appreciated that depositing In various changes.It is to be further appreciated that this exemplary embodiment or these exemplary embodiments are only example, and It is not intended to limit the scope of the present disclosure, applicability or configuration in any way.On the contrary, embodiment above will be this Art personnel provide the facility approach for implementing this exemplary embodiment or these exemplary embodiments.It should be appreciated that Do not depart from the case of the appended claims and its disclosure scope of equivalent elaboration, can be to the function and arrangement of element Make various changes.

Claims (20)

1. a kind of method that the vehicles are controlled based on physiological character, including:
Receive the physiological data from one or more biosensors;
Handle the physiological data received to determine one or more physiological status by processor;And
Based on identified physiological status, one or more control signals are output into communication tool system to control the traffic The operation of tool system.
2. according to the method described in claim 1, further comprise:
Handle the physiological data received to produce basic physiology reading by the processor;
Handle the physiological data being subsequently received to determine physiological change by the processor;And
Based on identified physiological change, it is described to control that one or more control signals are output into the communication tool system The operation of communication tool system.
3. method according to claim 2, further comprises:
The retrieval setting value associated with identified physiological change,
Wherein, one or more of control signals are output to by the communication tool system based on the setting value.
4. method according to claim 3, wherein, the setting value is user-defined setting value or predefined acquiescence Setting value.
5. according to the method described in claim 1, further comprise:
Message is output to by external authorization system based on identified physiological status.
6. according to the method described in claim 1, further comprise:
Based on the GPS location of identified physiological status at least output notice and the vehicles.
7. according to the method described in claim 1, further comprise:
Exported and pointed out based on identified physiological status;And
Determine whether to have been received by user response by the processor,
Wherein, one or more of control signals are output to by the communication tool system based on the user response.
8. method according to claim 7, wherein, determined whether to have been received by the user response by the processor Further comprise:
Receive the sensing data from one or more response sensors;
The sensing data is handled to determine whether user has made gesture;And
Based on the determination of the gesture, it is determined that having been received by the response.
9. a kind of system that the vehicles are controlled based on physiological character, including:
The source of the physiological data relevant with the user of the vehicles;With
Control module with processor, the processor handles the physiological data and by one or more control signals At least one be output to vehicle control system, operate the vehicles to be automatically based on the physiological data, and And one or more control signals are output to the vehicle control system, with based on the physiological data order HVAC systems One or more of system, seat system, information entertainment, car lock system, illuminator, window system and warning system.
10. system according to claim 9, wherein, the source of the physiological data is the personal device associated with user.
11. system according to claim 9, wherein, the processor handles the physiological data to produce basic physiology Reading, handles the physiological data being subsequently received to determine physiological change, and based on identified physiological change by one or many Individual control signal is output to the vehicle control system.
12. system according to claim 11, wherein, the processor retrieval is associated with identified physiological change Setting value, and one or more of control signals are output to by the vehicle control system based on the setting value.
13. system according to claim 12, wherein, the setting value is user-defined setting value or predefined silent Recognize setting value.
14. system according to claim 9, wherein, the processor handles the physiological data received and determination one Individual or multiple physiological status, and one or more control signals are output to the traffic work by physiological status based on determined by Has control system.
15. system according to claim 14, wherein, processor physiological status based on determined by exports message To external authorization system.
16. system according to claim 14, wherein, processor physiological status based on determined by least exports logical Know the GPS location with the vehicles.
17. system according to claim 14, wherein, processor physiological status output prompting based on determined by, Determine whether to have been received by user response, and the control module is based on the user response by one or more of controls Signal output processed at least one communication tool system described in.
18. system according to claim 17, wherein, the processor is based on receiving from one or more response sensors To sensing data determine whether to have been received by the user response, and the processor handles the sensing data To determine whether user has made gesture, and rung based on the determination of the gesture to determine to have been received by the user Should.
19. a kind of wearable electro-physiologic device, including:
At least one biosensor, it observes at least one physiological status associated with the wearer of the electro-physiologic device, And sensor signal is produced based at least one described physiological status;With
Control module with processor, the processor handles the sensor signal and is output to the sensor signal The system associated with the vehicles.
20. wearable electro-physiologic device according to claim 19, wherein the wearable electro-physiologic device is to be selected to include such as The portable electron device of lower every group:Wrist-watch, finger ring, earrings, bracelet, cuff button, necklace, necktie, glasses, pectoral girdle, intelligence Energy clothes and combinations thereof.
CN201710275548.0A 2016-01-26 2017-01-26 System and method for vehicle system control based on physiological traits Active CN107121952B (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201662287422P 2016-01-26 2016-01-26
US62/287422 2016-01-26
US15/342451 2016-11-03
US15/342,451 US20170120932A1 (en) 2015-11-03 2016-11-03 Gesture-based vehicle-user interaction
US15/410,582 US10137777B2 (en) 2015-11-03 2017-01-19 Systems and methods for vehicle system control based on physiological traits
US15/410582 2017-01-19

Publications (2)

Publication Number Publication Date
CN107121952A true CN107121952A (en) 2017-09-01
CN107121952B CN107121952B (en) 2020-12-08

Family

ID=59295917

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710275548.0A Active CN107121952B (en) 2016-01-26 2017-01-26 System and method for vehicle system control based on physiological traits

Country Status (2)

Country Link
CN (1) CN107121952B (en)
DE (1) DE102017101343A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108845513A (en) * 2018-06-28 2018-11-20 郝清海 A kind of supervisor control of amusement facility
CN109591823A (en) * 2017-09-29 2019-04-09 操纵技术Ip控股公司 Driver's health monitoring and response system
US11520345B2 (en) 2019-02-05 2022-12-06 Nvidia Corporation Path perception diversity and redundancy in autonomous machine applications
US11966838B2 (en) * 2019-05-10 2024-04-23 Nvidia Corporation Behavior-guided path planning in autonomous machine applications

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017130628A1 (en) 2017-12-20 2019-07-11 Autoliv Development Ab System, method and computer program product for increasing driving safety in traffic
FR3103606A1 (en) * 2019-11-27 2021-05-28 Psa Automobiles Sa MONITORING OF VEHICLE PASSENGERS BY COMPARISON OF PHYSIOLOGICAL PARAMETER VALUES TO REFERENCE VALUES
US11475873B2 (en) * 2020-07-01 2022-10-18 International Business Machines Corporation Translating inputs for voice communication
DE102020214556A1 (en) 2020-11-19 2022-05-19 Volkswagen Aktiengesellschaft Communication system for a vehicle for dealing with an occupant's sleep disorder
DE102022127596A1 (en) 2022-10-19 2024-04-25 Bayerische Motoren Werke Aktiengesellschaft Vehicle door for a motor vehicle, in particular for a passenger car, as well as motor vehicles

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103370249A (en) * 2010-10-05 2013-10-23 谷歌公司 System and method for predicting behaviors of detected objects
CN104216514A (en) * 2014-07-08 2014-12-17 深圳市华宝电子科技有限公司 Method and device for controlling vehicle-mounted device, and vehicle
CN104508719A (en) * 2012-07-17 2015-04-08 日产自动车株式会社 Driving assistance system and driving assistance method
CN104656503A (en) * 2013-11-22 2015-05-27 福特全球技术公司 Wearable computer in an autonomous vehicle
CN104875745A (en) * 2015-05-18 2015-09-02 百度在线网络技术(北京)有限公司 Status information processing method and system
US20150246673A1 (en) * 2014-02-28 2015-09-03 Ford Global Technologies, Llc Vehicle operator monitoring and operations adjustments
CN104973054A (en) * 2014-04-04 2015-10-14 现代自动车株式会社 Apparatus and method for controlling driving of vehicle based on driver's fatigue
CN105000020A (en) * 2014-04-22 2015-10-28 通用汽车环球科技运作有限责任公司 Systems and methods for interpreting driver physiological data based on vehicle events
CN105117147A (en) * 2015-07-24 2015-12-02 上海修源网络科技有限公司 Method and apparatus for manipulating vehicle-mounted operating system based on gesture and vehicle-mounted device
CN105138125A (en) * 2015-08-25 2015-12-09 华南理工大学 Intelligent vehicle-mounted system based on Leapmotion gesture recognition
CN105189241A (en) * 2013-02-04 2015-12-23 英特尔公司 Assessment and management of emotional state of a vehicle operator

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103370249A (en) * 2010-10-05 2013-10-23 谷歌公司 System and method for predicting behaviors of detected objects
CN104508719A (en) * 2012-07-17 2015-04-08 日产自动车株式会社 Driving assistance system and driving assistance method
CN105189241A (en) * 2013-02-04 2015-12-23 英特尔公司 Assessment and management of emotional state of a vehicle operator
CN104656503A (en) * 2013-11-22 2015-05-27 福特全球技术公司 Wearable computer in an autonomous vehicle
US20150246673A1 (en) * 2014-02-28 2015-09-03 Ford Global Technologies, Llc Vehicle operator monitoring and operations adjustments
CN104973054A (en) * 2014-04-04 2015-10-14 现代自动车株式会社 Apparatus and method for controlling driving of vehicle based on driver's fatigue
CN105000020A (en) * 2014-04-22 2015-10-28 通用汽车环球科技运作有限责任公司 Systems and methods for interpreting driver physiological data based on vehicle events
CN104216514A (en) * 2014-07-08 2014-12-17 深圳市华宝电子科技有限公司 Method and device for controlling vehicle-mounted device, and vehicle
CN104875745A (en) * 2015-05-18 2015-09-02 百度在线网络技术(北京)有限公司 Status information processing method and system
CN105117147A (en) * 2015-07-24 2015-12-02 上海修源网络科技有限公司 Method and apparatus for manipulating vehicle-mounted operating system based on gesture and vehicle-mounted device
CN105138125A (en) * 2015-08-25 2015-12-09 华南理工大学 Intelligent vehicle-mounted system based on Leapmotion gesture recognition

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109591823A (en) * 2017-09-29 2019-04-09 操纵技术Ip控股公司 Driver's health monitoring and response system
CN109591823B (en) * 2017-09-29 2022-06-17 操纵技术Ip控股公司 Automobile driver health monitoring and response system
CN108845513A (en) * 2018-06-28 2018-11-20 郝清海 A kind of supervisor control of amusement facility
US11520345B2 (en) 2019-02-05 2022-12-06 Nvidia Corporation Path perception diversity and redundancy in autonomous machine applications
US11966838B2 (en) * 2019-05-10 2024-04-23 Nvidia Corporation Behavior-guided path planning in autonomous machine applications

Also Published As

Publication number Publication date
DE102017101343A1 (en) 2017-07-27
CN107121952B (en) 2020-12-08

Similar Documents

Publication Publication Date Title
US10137777B2 (en) Systems and methods for vehicle system control based on physiological traits
CN107121952A (en) The system and method for communication tool system control based on physiological character
US20190197430A1 (en) Personalized ride experience based on real-time signals
US11659038B2 (en) Smart vehicle
US20210328991A1 (en) Systems and Methods for a Secure Tipping Notification for a Motorized Mobile Chair
US10606275B2 (en) System for accurate object detection with multiple sensors
US9043130B2 (en) Object sensing (pedestrian avoidance/accident avoidance)
CN107415938A (en) Based on occupant position and notice control autonomous vehicle function and output
CN104978024B (en) Driving is detected with wearable calculating equipment
US11526166B2 (en) Smart vehicle
CN107918781A (en) Movable sensor platform
US10887155B2 (en) System and method for a unified connected network
CN104379414B (en) User interface and the virtual personalities presentation based on user profiles
US20170153636A1 (en) Vehicle with wearable integration or communication
CN107357194A (en) Heat monitoring in autonomous land vehicle
CN107688866A (en) Use shared system and the method by bus of intelligent object
CN110431036A (en) It is supported via the safe driving of autocentre
CN104321220A (en) Access and portability of user profiles stored as templates
CN106293032A (en) Portable terminal device and control method thereof and device
US20210080966A1 (en) Smart vehicle
CN108791184A (en) Car door actuator for autonomous vehicle adjusts
CN104778530A (en) Inventory tracking system classification strategy
US11219075B2 (en) Systems and methods for providing a mobility service
US10134261B1 (en) Method and apparatus for vehicular item tracking
US11094026B2 (en) System and method for determining a safe return to a vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant