WO2020246198A1 - 操作者状態判断システム - Google Patents

操作者状態判断システム Download PDF

Info

Publication number
WO2020246198A1
WO2020246198A1 PCT/JP2020/018596 JP2020018596W WO2020246198A1 WO 2020246198 A1 WO2020246198 A1 WO 2020246198A1 JP 2020018596 W JP2020018596 W JP 2020018596W WO 2020246198 A1 WO2020246198 A1 WO 2020246198A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
operator
state
writing
pen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2020/018596
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
秀樹 藤巻
司 能美
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wacom Co Ltd
Original Assignee
Wacom Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wacom Co Ltd filed Critical Wacom Co Ltd
Priority to JP2021524721A priority Critical patent/JP7646544B2/ja
Publication of WO2020246198A1 publication Critical patent/WO2020246198A1/ja
Priority to US17/542,182 priority patent/US20220091673A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545—Pens or stylus
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns

Definitions

  • the present invention relates to an operator state determination system for determining whether or not an operator (for example, a driver) who operates (for example, drives) an operation target device (for example, an automobile) is in an inappropriate state for operation. ..
  • the driver is asked to wear a biosensor, and the management center collects and monitors the driver's biometric information such as heartbeat, body temperature, and sweating from this biosensor, thereby monitoring changes in the driver's physical condition. It has been proposed to prevent accidents by recognizing them (see, for example, Patent Document 1 (Japanese Unexamined Patent Publication No. 2017-217333)).
  • the driver's emotional state may appear as biometric information, but it is very difficult to grasp the mental state (emotional state) from the biometric information. Therefore, it is difficult to effectively avoid an unexpected situation such as a traffic accident because the mental state cannot be grasped only by monitoring the biological information of the operator such as the driver as in the conventional case. There is.
  • An object of the present invention is to provide an operator state judgment system capable of solving the above problems.
  • An information collecting device that collects information for the operator who operates the operation target device to determine whether or not the state is inappropriate for the operation, and an information collecting device for the operator to perform the operation. It is an operator state judgment system equipped with a judgment device for judging whether or not the state is inappropriate.
  • the information collecting device is A biological information acquisition means for acquiring the biological information of the operator, and A writing locus information acquisition means that accepts the writing input by the operator and acquires the writing locus information corresponding to the writing input.
  • a transmission means for transmitting the biological information acquired by the biometric information acquisition and the written locus information acquired by the written locus information acquisition means to the determination device.
  • the judgment device is A receiving means for receiving the biological information and the written locus information transmitted from the information collecting device, and A state determining means for determining whether or not the operator is in an inappropriate state for performing the operation based on the biological information received by the receiving means and the written locus information.
  • An operator state judgment system characterized by being provided with.
  • the operator state determination system having the above configuration is provided with a writing locus information acquisition means that accepts the writing input by the operator and acquires the writing locus information corresponding to the writing input. It is known that a person draws a writing locus according to a mental state (emotional state) at that time when writing input. For example, when you are frustrated or angry, your mental state (emotional state) appears in your writing trajectory. Therefore, the mental state (emotional state) of the operator can be grasped from the written trajectory information of the operator.
  • a mental state emotional state
  • the judgment device can grasp the change in the physical condition of the operator from the biological information, and can grasp the mental state (emotional state) of the operator from the written locus information. Therefore, it can be determined whether or not the operator, for example, the driver, is in an inappropriate state for operating, for example, driving the operation target device, for example, the automobile.
  • FIG. 1 is a diagram for explaining an outline of a first embodiment of an operator state determination system according to the present invention.
  • the operator state determination system of the first embodiment described below is a case where the operation target device is a car used as a taxi, and the taxi company is a taxi driver as an example of the operator (hereinafter referred to as a driver). ) Is an example when used to manage the state.
  • each of the automobiles 1 1 to 1 n is also configured to be connected to the determination device 4 by wireless communication through the communication network 5 and to be controlled by the determination device 4.
  • the biometric information such as each heart beat and body temperature of the driver 2 1 ⁇ 2 n
  • each of the drivers 2 1 to 2 n uses the creation of a driving diary to collect the writing trajectory information of the driving diary as electronic data, and the collected biological information and writing. Based on the trajectory information, the states related to the physical condition and emotions of the drivers 2 1 to 2 n are judged and managed.
  • each of the drivers 2 1 to 2 n writes and records the service content in the operation diary each time the taxi service is provided to the passengers, and the written trajectory information of the recorded operation diary. Is transmitted to the determination device 4 including the server device operated by the taxi company together with the driver's biometric information.
  • Information collecting apparatus 3 1 ⁇ 3 n in this example, the driver 2 1, ..., and each of the respective tablet terminal 10 1 ⁇ 10 n to be assigned of 2 n, the electronic pen 20 1, ..., It is composed of each of 20 n and each of smart watches 30 1 to 30 n .
  • Tablet device 10 1 ⁇ 10 n are those having the same configuration, also, the electronic pen 20 1, ⁇ ⁇ ⁇ , 20 n are also those having the same configuration, the smart watch 30 1 ⁇ 30 n also It has a similar configuration. Pair respectively of the tablet terminal 10 1 ⁇ 10 n, the electronic pen 20 1, ..., and each of the 20 n has a function means constituting the respective examples of handwriting trajectory information acquisition means.
  • each of the smart watches 30 1 to 30 n includes functional means constituting an example of the biological information acquisition means.
  • n (n 1, 2, 7) Vehicles 1 1 to 1 n , n drivers 2 1 to 2 n , and n information collecting devices 3 respectively.
  • vehicles 1 1 to 1 n 1, 2, ...
  • n drivers 2 1 to 2 n n information collecting devices 3 respectively.
  • n information collecting devices 3 respectively.
  • the smart watch 30 is worn on the arm of the driver 2 like a wristwatch, and has a function of detecting biological information of the driver 2, such as heartbeat, body temperature, sweating, and blood pressure in this example.
  • the detected biological information includes information on the detection time.
  • the smart watch 30 is provided with, for example, a Bluetooth (registered trademark) standard short-range wireless communication unit in order to transmit the detected biological information to the tablet terminal 10.
  • the tablet terminal 10 is provided with a Bluetooth (registered trademark) standard wireless communication unit for communicating with the smartwatch 30, and receives the biometric information of each driver 2 from the smartwatch 30. To get it.
  • a Bluetooth (registered trademark) standard wireless communication unit for communicating with the smartwatch 30, and receives the biometric information of each driver 2 from the smartwatch 30. To get it.
  • the tablet terminal 10 has a position detection device unit 100 (see FIGS. 2 and 3 described later) that detects a position indicated by the electronic pen 20 by interacting with the electronic pen 20 by electromagnetic induction coupling. Be prepared.
  • the taxi driver 2 creates an operation diary by writing and inputting to the tablet terminal 10 using the electronic pen 20.
  • the tablet terminal 10 detects the writing input by the electronic pen 20 and generates and acquires the writing locus information of the operation diary as electronic data.
  • the tablet terminal 10 includes a wireless communication unit that wirelessly communicates with the determination device 4 through the communication network 5. Then, the tablet terminal 10 adds the acquired writing trajectory information of the operation diary and the biological information of the driver 2 acquired from the smart watch 30 to the identification information for identifying the driver 2, as will be described later. It is transmitted to the determination device 4 through the communication network 5.
  • the determination device 4 includes a management server device 40 and an emotion server device 50 in this embodiment.
  • the management server device 40 receives the written locus information of the operation diary from each of the tablet terminals 10 and the biometric information of each of the drivers 2.
  • the management server device 40 includes a biometric information database, and analyzes each of the received biometric information of the driver 2 using the stored data of the biometric information database to enable each of the drivers 2.
  • the physical condition of the driver 2 is checked, and it is determined whether or not each of the drivers 2 is in an inappropriate state with respect to driving the automobile 1. Then, the management server device 40 transmits an alarm to each of the drivers 2 who have determined that they are in an inappropriate state in relation to driving the automobile 1, and each of the automobiles 1 is driven. Encourage them to suspend or stop their operation.
  • the management server device 40 forcibly temporarily suspends the driving of the vehicle 1 which is the target of the driver 2 who is in an inappropriate physical condition to drive, together with the alarm transmission.
  • the management server device 40 is temporarily stopped when the driver's physical condition returns after the driver's rest for a predetermined time (re-operation is possible on the day), and is stopped when it is determined that the driver's physical condition does not return even after the rest (restart on the day is possible). It can also be controlled such as (cannot be restarted on the day).
  • the management server device 40 accumulates the written locus information of the received operation diary, extracts the written locus information of a specific pattern included in the operation diary, and creates the operation diary.
  • the mental change of the driver 2 is detected, and based on the mental change, it is determined whether or not the driver 2 is in an inappropriate mental state to drive.
  • the operation diary stipulates that the driver 2 signs his / her own name by himself / herself, and the signature is used as a specific pattern for grasping the mental change of the driver 2. Be done.
  • the management server device 40 is given an electronic pen with its own name when each of the drivers 2 is in a mental state suitable for driving a car, such as a relaxed state or a concentrated state.
  • the writing locus information detected and acquired by the tablet terminal when self-signed by using it is registered as comparison reference information (normal time information), and it is stored as a specific pattern writing locus information database.
  • the example of the specific pattern is not limited to the signature of the driver's name as in this embodiment, and any writing pattern may be used as long as it is a predetermined writing pattern.
  • any writing pattern may be used as long as it is a predetermined writing pattern.
  • the management server device 40 analyzes the written locus information of the signature, which is a specific pattern in the written locus information of the operation diary of the driver 2, by using the stored data of the specific pattern written locus information database. It is checked whether or not the mental state of 2 has changed from a mental state suitable for driving a car to an inappropriate mental state.
  • the management server device 40 cooperates with the emotion server device 50 to not only determine whether or not the mental state of the driver 2 has changed, but also the changing mental state. We are devising so that we can grasp what kind of emotional state the state is. That is, as will be described later, the emotion server device 50 stores emotional states such as relaxed, concentrated state, frustrated state, and angry state in association with written locus information in each emotional state. To be equipped.
  • the management server device 40 sends an emotional state estimation request including the written trajectory information of the signature, which is a specific pattern, to the emotional server device 50.
  • the emotion server device 50 estimates the emotional state at the time of the written trajectory information of the received signature by using the written trajectory information of the signature included in the request and the information of the database for emotion estimation. The result is returned to the management server device 40.
  • the management server device 40 does not send only the written locus information of the signature, which is a specific pattern, to the emotion server device 50, but sends the information of the written locus information of the operation diary to the emotion server device 50. Of course, it may be configured to perform the estimation of.
  • the management server device 40 operates from the analysis result using the writing locus information of the signature which is a specific pattern, the stored data of the specific pattern writing locus information database, and the estimated emotional state acquired from the emotion server device 50. It is determined whether or not the mental state of the person 2 has changed from a mental state suitable for driving the automobile 1 to an inappropriate mental state.
  • the management server device 40 specifies even when it is determined that the judgment result about the physical condition based on the biological information of the driver 2 is not in an inappropriate state for driving the automobile 1. An alarm is sent to the driver 2 who judges that the judgment result about the mental state based on the written trajectory information of the signature, which is a pattern, is in an inappropriate state regarding driving the car 1. Then, the driver is urged to suspend or stop the operation of the automobile 1. Further, the management server device 40 forcibly drives the vehicle 1 which is the target of the driver 2 who is in an inappropriate mental state to drive, together with the alarm transmission. Send control information that is remotely controlled to pause or stop.
  • the operation diary is recorded and saved on the paper by being written and input on a predetermined paper (operation diary paper), and the writing locus information, which is electronic data of the writing locus, is stored in the tablet terminal 10. It is configured so that it can be acquired and held using the function of the position detection unit.
  • the tablet terminal 10 is configured so that the tablet terminal 10 can be locked with the paper placed on the position detection sensor of the position detection unit.
  • the electronic pen 20 is configured to have a function of printing on paper as a writing stationery, and in this example, a ballpoint pen function.
  • FIG. 2 and 3 show a hardware configuration example of the tablet terminal 10 in the first embodiment together with a configuration example of the electronic pen 20.
  • FIG. 2 is a diagram for explaining the appearance of the tablet terminal 10 and the electronic pen 20 of this example
  • FIG. 3 is an exploded configuration diagram for explaining a hardware configuration example of the tablet terminal 10.
  • the instruction input surface (detection area of the position detection sensor) by the electronic pen 20 is the paper placing surface 10s.
  • the tablet terminal 10 of this example includes a clip member 11 at the upper end of the mounting surface 10s, which holds the operation diary paper 6 and fixes it on the mounting surface 10s, which is an instruction input surface of the tablet terminal 10. It has the same appearance as stationery that is widely used and is called a binder.
  • the position detection device unit 100 of the electromagnetic induction type is mounted inside the tablet terminal 10 which is the back surface side of the mounting surface 10s.
  • the position detection device unit 100 includes a position detection sensor 110, a coordinate data generation unit 120, and a controller unit 130.
  • the upper cover (upper plate) 12 (FIG. 3 (A)) and the electronic pen 20 are arranged in order from the top, with the mounting surface 10s side serving as the instruction input surface as the upper side.
  • a position detection sensor 110 (FIG. 3 (B)), a shield sheet 13 (FIG. 3 (C)), and a sensor cover 14 (FIG. 3 (D)) for interacting with and electromagnetic induction coupling are provided.
  • a coordinate data generation unit 120 and a controller unit 130 connected to the position detection sensor 110 with the shield sheet 13 interposed therebetween are provided under the shield sheet 13.
  • the coordinate data generation unit 120 detects the coordinate data of the position indicated by the electronic pen 20 based on the output from the position detection sensor 110, and also receives and acquires the pen pressure data and the pen ID.
  • the controller unit 130 is connected to the coordinate data generation unit 120, and together with the coordinate data detected by the coordinate data generation unit 120, the pen pressure data and the pen ID are transmitted to the management server device 40 of the determination device 4 through the communication network 5. It has a function to transmit.
  • the controller unit 130 includes a short-range wireless communication unit for wireless communication with the smartwatch 30, receives biometric information sent from the smartwatch 30, coordinates data of a position indicated by the electronic pen 20, and a brush. It has a function of transmitting the pressure data and the pen ID to the management server device 40 of the determination device 4 through the communication network 5.
  • a transmission antenna AT is provided for the wireless communication unit of the controller unit 130.
  • the upper cover 12 is formed of a material that transmits a signal (radio wave) transmitted from the electronic pen 20, such as synthetic resin, glass, or ceramic.
  • the surface side exposed to the outside of the upper cover 12 is the mounting surface 10s that also serves as the instruction input surface of the position detection device unit 100.
  • the sensor cover 14 is made of synthetic resin, metal, or the like, and has a thin box shape with an opening on the upper surface.
  • the controller unit 130 and the shield sheet 13 are stored.
  • the wall portion of the sensor cover 14 is configured to project around the mounting surface 10s and act as a position regulating member for the operation diary paper 6. That is, when the paper is placed on the mounting surface 10s, the placement position of the operation diary paper 6 is regulated by the wall portion of the sensor cover 14.
  • the clip member 11 is composed of a plate-shaped component and a spring member, and is configured to hold the operation diary paper 6 by elastically pressing it against the mounting surface 10s.
  • the operation diary form 6 is printed with a paper form in which predetermined items are entered in a predetermined column.
  • the operation diary paper 6 is locked.
  • the state is such that it matches the instruction input area of the position detection sensor 110 of the position detection device unit 100 of the tablet terminal 10.
  • each column of the paper form printed on the operation diary paper 6 is in a state of being within the predetermined coordinate range position of the position detection sensor 110. Therefore, the written input of the signature to the driver's signature line 6a formed on the paper form printed on the operation diary paper 6 is a signature from the coordinate data output information detected by the position detection device unit 100. It can be distinguished and recognized as the coordinate data in the column 6a.
  • the tablet terminal 10 of this embodiment is provided with a rechargeable battery, and when the power button 15 is turned on, a drive voltage is supplied from the battery. Further, as shown in FIGS. 2 and 3, the tablet terminal 10 is provided with an end button 16 that is pressed when the driver completes the written input of the operation diary using the electronic pen 20. The pressing of the end button 16 is a trigger for transmitting the written locus information of the operation diary entered in writing to the management server device 40.
  • the clip member 11 of the tablet terminal 10 of this embodiment is provided with indicators 11a to 11c and a speaker 11sp.
  • the end button 16, the indicators 11a to 11c, and the speaker 11sp are provided on the component of the plate-shaped body of the clip member 11.
  • the indicators 11a to 11c are composed of LEDs (Light Emitting Diodes).
  • Indicator 11a is for notifying the power-on status.
  • the indicator 11b is for notifying the state of the wireless connection between the tablet terminal 10 and the management server device 40.
  • the indicator 11c is for confirming whether or not the operation diary paper 6 placed on the mounting surface 10s is correctly placed on the mounting surface 10s.
  • the speaker 11sp is for notifying the user of various states by an alarm voice, and may be used in combination with the above-mentioned notifications by the indicators 11a to 11c.
  • a paper mounting sensor 11s for detecting whether or not the operation diary paper 6 is sandwiched and locked by the clip member 11 is provided. Has been done.
  • the power button 15, the end button 16, the indicators 11a to 11c, the speaker 11sp, and the paper mounting sensor 11s are connected to the controller unit 130 through the connection connector CN.
  • the electronic pen 20 of this embodiment has a core body 21 filled with writing ink and a tip portion (pen tip) 22 provided at an end portion of the core body 21.
  • a tip portion (pen tip) 22 provided at an end portion of the core body 21.
  • it has a ballpoint pen function as a function that can visually leave a handwriting on the paper 6.
  • the electronic pen 20 sends and receives a signal to and from the position detection sensor 110 of the tablet terminal 10 by an electromagnetic induction method, so that the indicated position is detected by the position detection device unit 100 of the tablet terminal 10.
  • an electromagnetic induction method As for the mechanical configuration of the electronic pen 20 of this embodiment, a known electromagnetic induction type electronic pen configuration can be used except that the core body 21 has a ballpoint pen function. Therefore, the mechanical configuration is described here. Illustration is omitted for various configurations.
  • the electronic pen 20 of this embodiment is provided with a pen pressure detecting unit for detecting the pen pressure applied to the pen tip, and is provided with a means for transmitting the detected pen pressure information to the tablet terminal 10.
  • this pen pressure detection unit uses, for example, a semiconductor element whose capacitance is variable according to the pen pressure as disclosed in JP2013-161307. It has a structure.
  • the capacitance of the pen pressure detecting unit changes according to the pen pressure, for example, using a pen pressure detecting means having a well-known mechanical structure described in Patent Document: Japanese Patent Application Laid-Open No. 2011-186803. It can also be configured as a variable capacitance capacitor.
  • the electronic pen 20 is provided with a pen ID memory for storing unique identification information (referred to as a pen ID), and is provided with a means for transmitting the pen ID to the tablet terminal 10.
  • a pen ID memory for storing unique identification information (referred to as a pen ID)
  • the pen pressure information from the electronic pen 20 and the pen ID are configured to be transmitted to the tablet terminal 10 as an ASK modulation signal as described later through interaction by electromagnetic induction coupling.
  • the pen pressure information from the electronic pen 20 and the pen ID are configured to be wirelessly transmitted by using, for example, a Bluetooth (registered trademark) standard short-range wireless communication means, instead of interaction by electromagnetic induction coupling. You can also do it.
  • Each of the pen IDs 1 , ..., 20 n also serves as identification information for the drivers 2 1 , ..., 2 n .
  • FIG. 4 is a diagram showing an equivalent circuit of an electronic circuit included in the electronic pen 20 and a circuit configuration example of the position detecting device unit 100 of the tablet terminal 10 that performs position detection and pen pressure detection by the electronic pen 20 and an electromagnetic induction method. is there.
  • the position detection device unit 100 of the tablet terminal 10 in the example of FIG. 4 includes a position detection sensor 110, a coordinate data generation unit 120, and a controller unit 130.
  • the position detection sensor 110 the X-axis direction loop coil group 111 and the Y-axis direction loop coil group 112 are laminated and formed, and the loop coil of one of the two loop coil groups 111 and 112 is formed.
  • a selection circuit 113 for sequentially selecting is provided.
  • the electronic pen 20 includes a signal control circuit composed of an IC 200, and an exciting coil provided in a position detection sensor 110 of a position detection device unit 100 of the tablet terminal 10 to supply a drive voltage for driving the IC 200. It is configured to be obtained from the excitation signal transmitted from 114.
  • the loop coils 111 and 112 of the position detection sensor 110 are described as being used only for receiving the electromagnetic coupling signal from the electronic pen 20, but are electromagnetically coupled with the electronic pen 20. By doing so, it is not excluded to drive the signal control circuit provided in the electronic pen 20 instead of the exciting coil 114. Further, it does not exclude the transmission of signals such as predetermined control data to the signal control circuit provided in the electronic pen 20.
  • the exciting coil 114 surrounds the X-axis direction loop coil group 111 and the Y-axis direction loop coil group 112. It is arranged. As shown in FIG. 4, the exciting coil 114 is connected to the drive circuit 122, and the drive circuit 122 is connected to the oscillation circuit 121 that oscillates at the frequency fo.
  • the drive circuit 122 is controlled by a processing control unit 128 composed of a microcomputer.
  • the processing control unit 128 controls the drive circuit 122 to control the supply of the oscillation signal of the frequency fo from the oscillation circuit 121 to the exciting coil 114, and transmits the signal from the exciting coil 114 to the electronic pen 20. Control.
  • the selection circuit 113 is selectively controlled by the processing control unit 128 to select one loop coil.
  • the induced voltage generated in the loop coil selected by the selection circuit 113 is amplified by the receiving amplifier 123 and supplied to the bandpass filter 124, and only the component of the frequency fo is extracted.
  • the bandpass filter 124 supplies the extracted component to the detection circuit 125.
  • the detection circuit 125 detects a frequency fo component and supplies a DC signal corresponding to the detected frequency fo component to the sample hold circuit 126.
  • the sample hold circuit 126 holds the voltage value at a predetermined timing of the output signal of the detection circuit 125, specifically, a predetermined timing during the reception period, and sends the voltage value to the AD conversion circuit 127.
  • the AD conversion circuit 127 converts the analog output of the sample hold circuit 126 into a digital signal and outputs it to the processing control unit 128.
  • the processing control unit 128 supplies the signal of the predetermined timing to the sample hold circuit 126.
  • the processing control unit 128 determines whether or not the digital signal from the AD conversion circuit 127 exceeds a predetermined threshold value, and the loop coil selected by the selection circuit 113 is an electronic pen. It is determined whether or not the loop coil is at the position indicated by 20 and the indicated position by the electronic pen 20 is detected based on the determination.
  • the processing control unit 128 has a clock function, and the information of the position indicated by the detected electronic pen includes the time information at the time of detection. Therefore, the writing locus information consisting of a series of information on the indicated position by the electronic pen also includes the time change information, and the writing locus formation speed can be detected.
  • the processing control unit 128 also detects the interruption of the signal from the electronic pen 20 as a digital signal of several bits in addition to the detection of the indicated position by the electronic pen 20, and detects the writing pressure. At the same time, the pen ID is detected.
  • the position detection device unit 100 of the tablet terminal 10 has a function of detecting the inclination of the electronic pen 20 and the height position of the electronic pen 20, although not shown.
  • the inclination of the electronic pen 20 is the inclination of the electronic pen 20 with respect to the input surface of the position detection sensor 110.
  • the height position of the electronic pen 20 is a height position from the input surface of the position detection sensor 110. Since the inclination and height position of the electronic pen 20 can be detected by using a known method, the description of the detection method will be omitted here.
  • the tablet terminal 10 has written locus information including information on the indicated position of the detected electronic pen 20, pen pressure information, tilt information, height position information, and time information added as described above. Is associated with the pen ID and supplied to the controller unit 130.
  • the controller unit 130 temporarily stores the received written trajectory information in the transmission information generation unit 131. Further, the controller unit 130 receives the biological information such as the driver's heartbeat and body temperature from the smart watch 30 by the short-range wireless communication unit 132, supplies it to the transmission information generation unit 131, and temporarily stores it.
  • the smart watch 30 is provided with a short-range wireless communication unit 30T that communicates with the short-range wireless communication unit 132 of the controller unit 130.
  • the transmission information generation unit 131 of the controller unit 130 generates transmission information as if the writing locus information and the biological information are associated with a pen ID.
  • the controller unit 130 transmits the information in which the pen ID is associated with the writing locus information and the biometric information temporarily stored in the transmission information generation unit 131 to the management server device 40 through the wireless communication unit 133.
  • the circuit configuration of the electronic pen 20 is as shown by being surrounded by a dotted line in FIG. However, in the example of FIG. 4, the circuit portion for detecting the inclination of the electronic pen 20 by the position detecting device unit 100 is omitted.
  • the capacitor 202 is connected in parallel with the coil 201 to form the resonance circuit 203.
  • the switch circuit 204 is connected in parallel with the resonance circuit 203.
  • the switch circuit 204 is configured to be on / off controlled by the IC 200.
  • the resonance circuit 203 resonates with respect to the signal from the position detection sensor 110 (AC signal from the exciting coil 114).
  • the switch circuit 204 is on, the capacitor 202 connected in parallel to the coil 201 is short-circuited, and the resonance operation with respect to the signal from the position detection sensor 110 by the resonance circuit 203 is turned off.
  • the IC 200 transmits the AC signal received by electromagnetic induction from the position detection sensor 110 of the position detection device unit 100 of the tablet terminal 10 to the rectifier circuit (power supply circuit) 207 including the diode 205 and the capacitor 206 in the resonance circuit 203. It is configured to operate by the power supply voltage Vcc obtained by rectifying.
  • the IC 200 is connected to the resonance circuit 203 via a capacitor 208, and monitors the operating status of the resonance circuit 203.
  • the IC 200 uses the electromagnetic coupling status of the position detection sensor 110 with the exciting coil 114, or, although the description is omitted in this example, two loop coil groups 111 and 112 are used. Therefore, it is possible to detect a signal such as control data transmitted from the position detection sensor 110 of the position detection device unit 100 and perform desired operation control.
  • the IC200 is connected to a capacitance variable capacitor Cv composed of a pen pressure detection unit.
  • the IC 200 detects the writing pressure applied to the tip 20T of the electronic pen 20 from the value of the capacitance of the variable capacitance capacitor Cv. Then, the IC 200 converts the detected pen pressure into a multi-bit digital signal, and controls the switch circuit 204 with the digital signal corresponding to the pen pressure to add the pen pressure information to the position detection signal.
  • the information is transmitted to the position detection device unit 100 of the tablet terminal 10.
  • an ID memory 210 that stores the pen ID, which is the identification information of the electronic pen 20, is connected to the IC 200.
  • the IC 200 controls the switch circuit 204 by the digital signal of the pen ID stored in the ID memory 210, so that the pen ID is also used as additional information of the position detection signal, together with the pen pressure information, and the tablet terminal. It is transmitted to the position detection device unit 100 of 10.
  • the processing control unit 128 of the coordinate data generation unit 120 of the position detection device unit 100 first drives the drive circuit 122 to transmit a signal from the exciting coil 114 to the electronic pen 20 for a predetermined time. After that, the processing control unit 128 drives the drive circuit 122 to send a burst signal from the exciting coil 114, and the selection circuit 113 sequentially selects one loop coil of the X-axis direction loop coil group 111. Is performed for all the loop coils of the X-axis direction loop coil group 111.
  • the electronic pen 20 receives the burst-shaped signal in the resonance circuit 203 and returns it to the position detection sensor 110 of the position detection device unit 100 of the tablet terminal 10, so that the processing control unit 128 receives the burst signal. By detecting the returned burst-shaped signal as a position detection signal, the X coordinate value of the position indicated by the electronic pen 20 is obtained.
  • the processing control unit 128 drives the drive circuit 122 again to transmit a signal from the exciting coil 114 to the electronic pen 20 for a predetermined time, and then drives the drive circuit 122 to generate a burst-like signal from the exciting coil 114. Is sent out, and the process of sequentially selecting one loop coil of the Y-axis direction loop coil group 112 by the selection circuit 113 is performed for all the loop coils of the Y-axis direction loop coil group 112. Then, the processing control unit 128 obtains the Y coordinate value of the position indicated by the electronic pen 20 by detecting the burst-shaped signal returned from the electronic pen 20 as a position detection signal.
  • the processing control unit 128 continues from the exciting coil 114 for a predetermined time or longer in order to detect the pen pressure information and the pen ID as additional information from the electronic pen 20.
  • the burst-shaped signal is continuously transmitted / received as many times as the number of bits of the digital signal of the additional information from the electronic pen 20.
  • the selection circuit 113 selects the loop coil closest to the electronic pen 20 (either the X-axis direction loop coil or the Y-axis direction loop coil) according to the detected coordinate values, and receives the signal.
  • the IC 200 of the electronic pen 20 is a tablet terminal 10 based on a digital signal of additional information including pen pressure information and pen ID obtained corresponding to the capacitance of the capacitance variable capacitor Cv constituting the pen pressure detection unit.
  • the switch circuit 204 is on / off controlled in synchronization with the transmission / reception of the signal from the position detection device unit 100.
  • the resonant circuit 203 can return the signal transmitted from the position detection device unit 100 to the position detection device unit 100, so that the loop coil of the position detection device unit 100 transmits this signal.
  • Receive
  • the resonance circuit 203 is in a state in which the resonance operation is prohibited. Therefore, no signal is returned from the resonance circuit 203 to the position detection device unit 100, and the position detection device The loop coil of unit 100 does not receive a signal.
  • the processing control unit 128 of the coordinate data generation unit 120 of the position detection device unit 100 determines the presence / absence of the received signal several times as many times as the digital signal bit of the additional information, so that the pen pressure information and the pen ID can be divided into a plurality of bits.
  • the digital signal can be received and the pen pressure information and the pen ID from the electronic pen 20 can be detected. Therefore, the electronic pen 20 transmits the pen pressure information and the pen ID as an ASK (Amplitude Shift Keying) modulated signal to the position detection device unit 100 of the tablet terminal 10.
  • ASK Amplitude Shift Keying
  • the processing control unit 128 of the position detection device unit 100 detects the information of the indicated position by the electronic pen 20, and also detects the pen pressure information and the pen ID from the electronic pen 20, and determines the indicated position by the detected electronic pen 20. , Pen pressure information and pen ID are supplied to the controller unit 130.
  • FIG. 5 is a block diagram showing a configuration example of the management server device 40 of the operator state determination system of this embodiment.
  • the management server device 40 in this embodiment has a control unit 401 composed of a computer, a wireless communication unit 402, an information reception processing unit 403, a biometric information database 404, and a specific pattern through the system bus 400.
  • the automobile control information generation unit 413, and the display unit 414 are connected to each other.
  • the signature writing information which is the writing locus information of the above, is stored in association with each other.
  • the signature written information is written and input when each of the drivers 2 1 , ..., 2 n is in a state suitable for driving a car such as a concentrated state or a relaxed state. It is said that time information is attached to the coordinate data constituting the writing locus information, and the writing speed of each character of the signature writing information can be detected from the time information.
  • the driver ID and the pen ID are associated and stored in the specific pattern writing locus information database 405, they can be associated by referring to the specific pattern writing locus information database 405 by the pen ID. It is possible to acquire the driver ID that is (linked).
  • biometric information in the normal state of each of the drivers 2 1 , ..., 2 n in this example, numerical values in the normal state range such as heart rate, body temperature, and sweating are obtained. Information is stored.
  • biometric information of a normal state the electronic pen 20 1, ..., are 20 n of associated with each of the pen ID and the string attached is the driver ID storage.
  • the biometric information database 404, the driver 2 1, ... has been adapted to store the biometric information in each of the normal state of the 2 n, rather than each driver 2, unspecified Information on the normal state generated from the biological information of a large number of subjects may be stored and used.
  • the communication connection information storage unit 406 includes connection information for connecting each of the driver IDs to each of the tablet terminals 10 1 to 10 n through the wireless communication unit 402, and an automobile.
  • Each of 1 1 to 1 n and the connection information for connecting through the wireless communication unit 402 are stored in association with each other.
  • the wireless communication unit 402 is for wireless communication with each of the tablet terminals 10 1 to 10 n through the communication network 5.
  • the information reception processing unit 403 includes biometric information, writing locus information, signature information as specific pattern writing locus information in the writing locus information, and time information from the information received from each of the tablet terminals 10 1 to 10 n. , Pen ID is recognized separately, and each information is distributed to necessary parts.
  • the information reception processing unit 403 acquires the driver ID by referring to the specific pattern writing locus information database 405 by the pen ID, and adds the acquired driver ID to the information to be distributed as well. To.
  • all the written trajectory information of the received operation diary is associated with the driver ID and / or the pen ID and the accompanying date and time information. Try to accumulate.
  • values such as heart rate, body temperature, and sweating correspond to the biological information of the driver 2 (hereinafter referred to as driver 2S) who has transmitted the written trajectory information of the operation diary in the biological information database 404. It is checked whether or not the physical condition of the driver 2S is altered depending on whether or not it is within the numerical range of the normal state such as the driver's heartbeat, body temperature, and sweating. Then, the biological information analysis unit 408 sends the analysis result to the state determination unit 411.
  • the writing locus information analysis unit 409 extracts the writing locus information in the signature column from the written locus information of the received operation diary, and sets the signature signature information of the driver 2S in the specific pattern writing locus information database 405. By comparison reference, it is checked whether the mental state of the driver 2S has changed to a state inappropriate for driving a car. Then, the writing locus information analysis unit 409 sends the analysis result to the state determination unit 411. As mentioned above, the writing locus information analysis unit 409 analyzes all the written locus information of the received operation diary, and the mental state of the driver 2S is inappropriate for driving a car. You may want to check if the state has changed.
  • the emotional state information acquisition unit 410 extracts the written locus information in the signature line from the written locus information of the received operation diary, and the extracted written locus information in the signature line is combined with the pen ID or the driver ID. It is included in the emotional state estimation request, sent to the emotional server device 50 through the communication network 5, and waits for the answer.
  • the emotion server device 50 When the emotion server device 50 receives the emotion state estimation request, the emotion server device 50 estimates the emotion state of the driver 2S from the written locus information of the signature included in the request, and responds to the management server device 40 as described later. ..
  • the emotional state information acquisition unit 410 sends the emotional state information of the driver 2S acquired from the emotional server device 50 to the state determination unit 411.
  • the state determination unit 411 is based on the analysis result from the biological information analysis unit 408, the analysis result from the writing locus information analysis unit 409, and the emotional state information from the emotional state information acquisition unit 410, and is based on the physical condition state of the driver 2S. And / or determine if the emotional state has changed to a state that is inappropriate for driving the car. Then, the state determination unit 411 sends the determination result to the driver transmission information generation unit 412 and the automobile control information generation unit 413. Further, the state determination unit 411 sends the determination result as display information to the display unit 414.
  • the driver transmission information generation unit 412 generates driver transmission information according to the determination result from the state determination unit 411. In this case, the driver transmission information generation unit 412 drives when the determination result from the state determination unit 411 indicates that the driver is in an inappropriate state for driving the vehicle.
  • Information sent by the driver consisting of an alarm that disallows the continuation of, for example, "Physical condition or mental condition is not suitable for driving. Please pause driving for a while” or "Physical condition or mental condition is not suitable for driving. Generate an alarm voice message such as "Please cancel".
  • the driver transmission information generation unit 412 transmits the generated alarm voice message information to the tablet terminal 10 of the driver 2S through the wireless communication unit 402 and the communication network 5, and then to the tablet terminal 10. Send a communication end request to end the communication.
  • the driver transmission information generation unit 412 is the operation stored in the communication connection information storage unit 406. A communication path is generated using the connection information of the person 2S with the tablet terminal 10, and the driver transmission information is transmitted.
  • the driver transmission information generation unit 412 indicates that the determination result from the state determination unit 411 indicates that the driver 2S is "not in an inappropriate state for driving a car"
  • the communication with the tablet terminal 10 is terminated.
  • the driver transmission information generation unit 412 indicates that the judgment result from the state judgment unit 411 indicates that the driver 2S is "not in an inappropriate state for driving a car”
  • the vehicle control information generation unit 413 When the determination result from the state determination unit 411 indicates that the driver 2S is "in an inappropriate state for driving the vehicle", the vehicle control information generation unit 413 indicates that the vehicle 1 is in an inappropriate state. Is generated, and the generated control signal is transmitted to the driving target vehicle 1 of the driver 2S through the wireless communication unit 402 and the communication network 5. At this time, the automobile control information generation unit 413 acquires the connection information of the vehicle 1 to be driven by the driver 2S stored in the communication connection information storage unit 406, and generates a communication path using the connection information. Then, the control signal is sent to the car.
  • each of the automobiles 1 When each of the automobiles 1 receives a control signal from the management server device 40, it is a functional unit that controls the operation so as to stop the operation by, for example, cutting off the supply of electric power from the battery to the parts involved in driving. It has.
  • the display unit 414 includes a display screen, receives the written trajectory information of the operation diary from the information reception processing unit 403, and displays it on the display screen.
  • the management server device 40 is provided in the taxi company, and the driver state manager who manages the physical condition and mental state of the driver of the taxi company displays the operation diary on this display screen. Observe the display information of the writing trajectory of.
  • the driver status manager created the operation diary by observing the writing trajectory of the operation diary on the display screen of the display unit 414 and visually grasping whether it is different from the normal time. It is possible to infer the modulation of the driver's physical condition and mental condition.
  • the driver's state is displayed on the display screen in addition to the display information of the writing locus of the operation diary. Is displayed. Therefore, the driver state manager of the taxi company can grasp the driver's state on the display screen of the display unit 414, and if necessary, directly talks to the driver using a mobile phone terminal or the like. You can inquire about your physical condition and mental condition, and give advice.
  • the management server device 40 described above stores the written locus information of the signature by the driver 2, it stores the written locus information of the signature of the signature column of the operation diary sent from the tablet terminal. It is also possible to authenticate the driver 2S by comparing it with the written trajectory information of the signature of the driver 2.
  • the control unit 401 can realize a program that executes each function as software processing.
  • not all of the above parts are processed by a program, and some of them may be configured as hardware components.
  • FIG. 8 is a block diagram showing a hardware configuration example of the emotion server device 50.
  • the emotion estimation database 502 the wireless communication unit 503, the emotion state estimation request reception unit 504, and the emotions are sent to the control unit 501 composed of a computer through the system bus 500.
  • the state estimation unit 505 and the provided information generation unit 506 are connected and configured.
  • the emotion estimation database 502 various emotional states and pen state information of the electronic pen in each emotional state are associated and stored for each of the drivers 2 1 , ..., 2 n. There is.
  • the stored data of the emotion estimation database 502 is constructed based on the collected information in which necessary information is collected in advance from each of the drivers 2 1 , ..., 2 n .
  • each of the drivers 2 1 , ..., 2 n has emotional states such as “relaxed state”, “concentrated state”, “irritated state”, “distracted state”, and “angry state”.
  • Each emotional state is made to continue for a time width of a predetermined time or more by adding a situational stimulus that causes the person to appear. At that time, it is confirmed by measuring with an electroencephalograph that each of the drivers 2 1 , ..., 2 n is in their respective emotional states.
  • each of the drivers 2 1 , ..., 2 n becomes an emotional state of "relaxed state", “concentrated state”, “irritated state”, “distracted state”, and "angry state”.
  • the electronic pen 20 1 ..., asked to the handwriting input to each of the tablet terminals 10 1 ⁇ 10 n using 20 n, each of the tablet terminal 10 1 ⁇ 10 n ,
  • the writing trajectory information (information on the indicated position, the tilt of the electronic pen, the pen state information such as the height position) in the above emotional state is detected.
  • the written locus information of each emotional state acquired by each of the tablet terminals 10 1 to 10 n is associated with the pen ID and sent to the device for constructing the emotion estimation database.
  • each driver is divided into each emotional state of "relaxed state", “concentrated state”, “irritated state”, “distracted state”, and "angry state”.
  • 2 1 ⁇ ⁇ ⁇ ⁇ 2 n Holds the written locus information.
  • the range that can be taken by each of the pen state information such as the information of the indicated position in the writing trajectory information, the inclination of the electronic pen, and the height position is set to the emotional state. It is calculated as the existence range that is the feature value for each.
  • each information value of the pen state of the electronic pen movesement change of the indicated position, pen pressure value, tilt of the electronic pen, height position, etc.
  • the existence range of each pen state information for each emotional state is calculated.
  • the existence range of each pen state information for each calculated emotional state is the stored content of the emotion estimation database shown in FIG. 10 to be described later.
  • the writing pressure applied to the electronic pen 20 in the "relaxed state” has a relatively low average value and an existence range in which the deviation from the average value is relatively small. Further, the writing pressure applied to the electronic pen 20 in the "irritated state” has a relatively high average value and an existence range in which the deviation from the average value is relatively large.
  • the range information of the pen state information determines the range in which most of each value of the pen state information in a certain emotional state, for example, 90%, falls within the range, that is, exists. It is calculated by.
  • the range information (information on the existence range) of the pen state information can be range information including the above-mentioned average value and deviation.
  • the device for constructing the emotion estimation database also stores the "characteristic pattern at the time of writing characters" by the electronic pen 20 in each emotional state of the driver 2. Therefore, in this example, the driver 2 is made to write a predetermined character in a predetermined rectangular area in each emotional state.
  • the driver 2 is urged to display the character input square frame FL on the display screen of the tablet terminal 10 and input the characters in the input square frame FL. ..
  • the driver 2 writes and inputs the character requested to be input, in this example, “A” in the input square frame FL with the electronic pen 20.
  • the driver 2 writes and inputs the requested characters so as to fit them properly in the input square frame FL. That is, the center position of the character is near the center position of the input square frame FL, and the size of the character does not exceed the size of the input square frame FL.
  • each emotion includes the range of deviation from the center position of the character and the range of transition of the size of the character. Calculate according to the condition.
  • the characteristic pattern when writing characters not only the characteristic pattern for one character but also the characteristic pattern between the plurality of characters when writing a plurality of characters continuously may be calculated.
  • the name of each driver which is the specific pattern described above, is used as the "characteristic pattern at the time of writing characters”.
  • the device for constructing the database for emotion estimation associates the information of each emotion state of the driver 2 with the range information for each of the plurality of types of pen state information with each other, and associates the information with the pen ID of the electronic pen 20. And store it in the emotion estimation database 502.
  • FIG. 10 shows an example of the stored contents of the emotion estimation database 502 at this time.
  • each emotion of "relaxed state”, “concentrated state”, “irritated state”, “distracted state”, and “angry state” is associated with the pen ID of the electronic pen 20.
  • the state is memorized, and the information in the range (existence range) that each pen state information in each emotional state can take is stored in association with each emotional state.
  • the pen pressure range that can be taken in each emotional state (for example, Pra1 to Prb1) Is remembered.
  • the pen pressure in the concentrated state is larger than the pen pressure in the relaxed state, and the pen pressure range is narrow.
  • the writing pressure varies, so the writing pressure range becomes wider.
  • the writing pressure increases.
  • the time change of the writing pressure may also be stored in the emotion estimation database 502. For example, in the "relaxed state” and “concentrated state”, the degree of time change of the writing pressure is small, and in the "irritated state” and "distracted state", the degree of time change of the writing pressure is large.
  • the "tilt” is tilted in the emotion estimation database 502 according to each emotional state.
  • the range eg SLa1 to SLb2
  • the time change of the inclination may be stored in the emotion estimation database 502.
  • the inclination may be stored separately in the emotion estimation database 502 when the writing pressure is zero and the writing pressure is in the hovering state and when the writing pressure is greater than zero and is in contact with the sensor.
  • the "height position” is taken when the driver 2 in various emotional states described above holds the electronic pen 20 and the electronic pen 20 is in the hover state in the standby state before inputting an instruction (writing input).
  • the range information (for example, Ha1 to Hb1) of the obtained height position (height position in the direction orthogonal to the sensor surface) is stored in the emotion estimation database 502.
  • “Position blur at hover position” is when the driver 2 holds the electronic pen 20 and is in each emotional state of the coordinate position on the sensor surface in the standby state before inputting an instruction (writing input). It is the range information of possible changes (for example, Ara1 to Arb1). That is, for example, when the driver 2 is in the "concentrated state", the “positional shake at the hover position” becomes small, and when the driver 2 is in the "irritated state” or the “distracted state", it becomes large. In this case as well, the time change of "positional blurring at the hover position" may be stored in the emotion estimation database 502.
  • the wireless communication unit 503 transfers the received emotion state estimation request to the emotion state estimation request receiving unit 504.
  • the emotional state estimation request receiving unit 504 extracts the pen ID and the writing locus information included in the received emotional state estimation request and passes them to the emotional state estimation unit 505.
  • the emotional state estimation unit 505 searches the emotion estimation database 502 based on the received pen ID and the pen state information of the writing locus information, estimates the corresponding emotional state, and provides the emotional state of the estimation result. Information generation Hand over to department 506.
  • the provided information generation unit 506 generates provided information including information notifying the emotional state of the received estimation result, and transmits the provided information to the management server device 40 that has made the emotional state estimation request through the wireless communication unit 503.
  • the processing of the emotion state estimation request receiving unit 504, the emotion state estimation unit 505, and the provided information generation unit 506 is a program stored in the memory built in by the control unit 501. It may be configured as a software function that processes according to.
  • FIG. 11 and FIG. 12 which is a continuation thereof are flowcharts for explaining a processing operation example of the tablet terminal 10.
  • the processing control unit 128 of the tablet terminal 10 monitors whether or not the instruction input by the electronic pen 20 is detected (step S101), and when it is determined that the instruction input by the electronic pen 20 is not detected, performs other processing. (Step S102), and after the other processing is completed, the processing is returned to step S101.
  • step S101 When the processing control unit 128 determines in step S101 that the instruction input by the electronic pen 20 is detected, the time is added to the detected instruction position information, the writing pressure information, the inclination information, and the height position information.
  • the writing locus information including the information to which the information is added is acquired, associated with the pen ID, and supplied to the controller unit 130 (step S103).
  • the controller unit 130 sends a biometric information acquisition request to the smartwatch 30, acquires the biometric information sent from the smartwatch 30 in response to the acquisition request, and is writing from the processing control unit 128. It is held in association with the pen ID together with the locus information (step S104).
  • step S105 the controller unit 130 determines whether or not the end button 16 has been pressed (step S105), and when it determines that the end button 16 has not been pressed, returns the process to step S101.
  • controller unit 130 determines in step S105 that the end button 16 has been pressed, it analyzes the writing trajectory information and determines whether or not the signature has been written and input in the signature line (step S106). Then, when the controller unit 130 determines in step S106 that the signature has not been written and input in the signature field, the controller unit 130 sends a voice message prompting the signature input through the speaker 11sp (step S107), and then performs the process in step S101.
  • the controller unit 130 determines in step S106 that the signature has already been written and input in the signature field, the controller unit 130 provides information in which the written locus information of the operation diary and the biometric information held are associated with the pen ID. The information is transmitted to the management server device 40 through the wireless communication unit 133 and the communication network 5 (step S108).
  • the controller unit 130 determines whether or not an alarm has been received from the management server device 40 (step S111 in FIG. 12), and when it determines that the alarm has not been received, the communication from the management server device 40 ends. It is determined whether or not the request has been received (step S112). Then, when the controller unit 130 determines in step S112 that the communication end request has not been received, the process returns to step S111, and when it is determined that the communication end request has been received, the controller unit 130 performs the communication end process (step). S115), this processing routine is terminated.
  • step S111 when the controller unit 130 determines in step S111 that an alarm has been received from the management server device 40, the controller unit 130 emits a corresponding alarm sound through the speaker 11sp (step S113).
  • the controller unit 130 determines whether or not the communication end request from the management server device 40 has been received (step S114). Then, when it is determined in step S114 that the communication end request has not been received, the controller unit 130 returns the process to step S114, and when it is determined that the communication end request has been received, the controller unit 130 performs the communication end process (step). S115), this processing routine is terminated.
  • FIG. 13 and FIG. 14 which is a continuation thereof are flowcharts for explaining a processing operation example of the management server device 40.
  • the operation of each step of the flowcharts of FIGS. 13 and 14 is described by the control unit 401, the information reception processing unit 403, the biological information analysis unit 408, the writing locus information analysis unit 409, the emotional state information acquisition unit 410, and the like.
  • the case where the functions of the state determination unit 411, the driver transmission information generation unit 412, and the automobile control information generation unit 413 are realized as software processing will be described.
  • the control unit 401 monitors the reception of the transmission information from the tablet terminal 10 (step S201), and when it is determined that the transmission information from the tablet terminal 10 is not received, performs other processing (step S202). After that, the process returns to step S201.
  • step S201 When it is determined in step S201 that the transmission information from the tablet terminal 10 has been received, the control unit 401 acquires the driver ID by referring to the specific pattern writing trajectory information database 405 by the pen ID included in the received information. (Step S203). Then, the control unit 401 stores the written locus information of the operation diary in the operation diary memory 407 in association with the driver ID and the pen ID (step S204).
  • control unit 401 reads out the biometric information associated with the driver ID acquired in step S203 among the biometric information stored in the biometric information database 404, and wirelessly communicates with the read biometric information. By comparing and analyzing the biometric information received through the unit 402, it is checked whether or not the physical condition of the driver 2 specified by the driver ID is inappropriate for continuous driving (step S205). ).
  • control unit 401 extracts the written locus information of the signature in the signature column from the written locus information of the operation diary, and also extracts the written locus information of the signature stored in the specific pattern written locus information database 405 from the written locus information of the signature.
  • the written locus information of the signature of the driver 2 corresponding to the driver ID acquired by using the pen ID in step S203 is read out.
  • the written locus information of the extracted signature and the written locus information of the signature read from the specific pattern written locus information database 405 are compared and analyzed, and the mental state of the driver 2 specified by the driver ID performs driving. Check whether the state is inappropriate for continuous operation (step S206).
  • control unit 401 sends an emotional state estimation request including the written trajectory information of the extracted signature to the emotional server device 50, and acquires the estimated emotional state information of the answer from the emotional server device 50 ( Step S207).
  • control unit 401 uses the analysis result of the generated information acquired in step S205, the analysis result of the specific pattern writing trajectory information, and the estimation result of the emotional state acquired from the emotion server device 50 to write the writing trajectory information of the operation diary.
  • the physical condition and the mental state of the driver who has transmitted the message are grasped (step S208).
  • control unit 401 determines from the physical condition state and the mental state of the driver 2 grasped in step S208 whether or not the state of the driver 2 is an inappropriate state for driving (FIG. 14).
  • step S211 when it is determined that the state is not inappropriate, a communication termination request is transmitted to the tablet terminal 10 of the driver 2 (step S214), and wireless communication termination processing is performed (step S215). Terminate this processing routine.
  • step S211 when it is determined in step S211 that the state of the driver 2 is an inappropriate state for driving, the control unit 401 generates an alarm consisting of a voice message in this example, and the driver. It is transmitted to the tablet terminal 10 of 2 (step S212).
  • the control unit 401 executes a vehicle stop control routine for stopping or stopping the driving of the vehicle 1 of the driver 2 who is in an inappropriate state for driving (step S213).
  • the control unit 401 acquires connection information for the automobile 1 of the driver 2 who is in an inappropriate state for driving, and communicates with the automobile 1 in a wireless communication path. Is generated, and control information for stopping or stopping the running of the automobile 1 is transmitted to the automobile 1 so as to control the automobile.
  • control unit 401 transmits a communication end request to the tablet terminal 10 of the driver 2 (step S214), performs wireless communication end processing (step S215), and ends this processing routine. To do.
  • the operator state determination system of the first embodiment not only the physical condition state is modulated based on the biological information of the driver 2, but also the mental state of the driver 2 is determined from the written trajectory information of the operation diary. It checks whether it is in an inappropriate state for driving, and if it is in an inappropriate state, it issues an alarm to the driver and refrains from driving the car 1 by the driver 2. Let me do it. Therefore, it is possible to prevent the occurrence of a traffic accident.
  • a control signal from the management server device 40 is used. Since the driver 2 is controlled to stop or stop the driving of the vehicle to be driven, it is possible to prevent the occurrence of a traffic accident.
  • the driver 2 since the mental state of the driver 2 is checked by using the written trajectory information of the operation diary, the driver 2 only needs to write and input the operation diary, and the mental state of the driver 2 is required. There is an effect that it is not necessary to impose a special burden on the driver 2 for checking.
  • whether or not the mental state of the driver 2 is an appropriate state for driving is appropriate for the specific pattern written locus information simply registered. It is appropriate for driving because the emotion server device 50 is used to refer not only to the deviation from the information at the time but also to the grasp result of the emotional state estimated from the written trajectory information. It also has the effect of being able to more accurately determine whether or not it is in a state.
  • the emotion estimation database of the emotion server device 50 stores the correspondence between the pen state information and the emotion state generated from the specific pattern writing locus information of each driver 2.
  • the writing locus information of another writing pattern may be used instead of the special pattern writing locus information.
  • the emotion server device 50 may include an emotion estimation database constructed from the emotion states of an unspecified number of people and the pen state information generated from the writing trajectory information at each emotion state.
  • the emotional state of an unspecified number of people and the pen state information generated from the written locus information at each emotional state are collected in large quantities as so-called big data, whereby the emotion server device.
  • the estimated accuracy of the emotional state at 50 is improved.
  • the tablet terminal 10 is provided with a function of wirelessly communicating with the management server device 40, but the wireless communication terminal having a function of wirelessly communicating with the management server device 40.
  • a device may be separately provided so that the tablet terminal 10 and the wireless communication terminal device are connected by wire or by short-range wireless communication.
  • the wireless communication terminal device in that case, for example, a mobile communication device such as a smartphone can be used, and an alarm from the management server device 40 is displayed on the display screen of the mobile communication device and notified as a voice message. You may try to do so.
  • the emotion server device 50 is configured separately from the management server device 40, but the functions of the emotion server device 50 are provided in the management server device 40 and integrated. It can also be configured.
  • the writing locus information of the electronic data is obtained together with the electronic pen 20 having the function of a ballpoint pen as a writing instrument and the writing by the electronic pen 20 on the operation diary paper 6.
  • the tablet terminal 10 having a configuration capable of generating is used, the writing locus information acquisition means cannot write on the operation diary paper 6, but can acquire the writing locus information of electronic data in general. It may be an electronic pen and a tablet device having a configuration.
  • the biological information of the driver exemplifies heartbeat, body temperature, sweating, but in addition, blood pressure, blood glucose, pulse, etc. may be used, or a combination thereof may be used.
  • the second embodiment is also an example in the case of the operator state determination system operated by the taxi company shown in FIG. 1, and is a modified example of the above-mentioned first embodiment.
  • FIG. 15 shows a diagram for explaining the outline of the operator state determination system of the second embodiment.
  • the heart rate, body temperature, sweating, etc. are collected as the biological information of the driver 2, and in order to acquire the biological information, the driver 2 uses the heart rate sensor and the body temperature sensor. I tried to wear the smart watch 30 that I have.
  • the face image of the driver 2 is collected as the biological information of the driver 2. In this case, the face image is acquired as a color image so that the complexion color, the color of the lips, and the like can be recognized.
  • the tablet terminal 10 of the driver 2 collects not only the writing locus information but also the biometric information, and wireless communication for transmitting the writing locus information and the biometric information to the management server device 40. I made it equipped with means.
  • the automobile 1 used for the service as a taxi is provided with the automobile device 60 capable of wireless communication with the management server device 40A.
  • the management server device 40A of the second embodiment is configured to integrate the functions of the management server device 40 of the first embodiment and the emotion server device 50.
  • the management server device 40A has a biometric information database in which information on a color face image in a state in which each driver 2 is in good physical condition is stored in association with a driver ID. Be prepared.
  • the face image includes a face image taken not only from the front but also from a plurality of directions from the left and right sides.
  • the management server device 40A includes not only a specific pattern writing trajectory information database but also an emotion estimation database.
  • the biometric information analysis unit of the management server device 40A of the second embodiment is stored in the database in advance with the face image of the driver 2 taken by the camera 70 at the time of writing input of the writing trajectory information of the operation diary.
  • a change in physical condition such as a pale complexion or a purple lip color.
  • the facial expression of the driver 2 is analyzed to detect the facial expression when the driver is in pain, the facial expression when he / she is very tired, and the like.
  • the automobile device 60 of the automobile 1 is provided with a camera 70 connected to take a face image of the driver 2 who is in the driver's seat.
  • the camera 70 is connected to the automobile device 60 by wire or wirelessly, and the automobile device 60 controls the operation of the camera 70 to capture the facial image information of the driver 2 taken by the camera 70.
  • the tablet terminal 10A used by each driver 2 does not include the controller unit 130, but instead wirelessly connects to the short-range wireless communication unit provided in the automobile device 60. It is equipped with a short-range wireless communication unit.
  • Other configurations of the tablet terminal 10A are the same as those of the tablet terminal 10 of the first embodiment.
  • each of the drivers 2 is made to perform writing input to the tablet terminal 10A by the electronic pen 20 used in the first embodiment described above.
  • the configuration and processing operation of the tablet terminal 10A are the same as those of the tablet terminal 10 except for the part of the controller unit 130. Therefore, the description thereof will be omitted here together with the operation of the electronic pen 20. Further, the configuration and processing operation of the management server device 40A includes the components of the emotion server device 50, and the function processing operation is also executed.
  • the management server device 40 of the first embodiment described above is different. Since it is the same as the above, the description thereof will be omitted here.
  • FIG. 16 is a block diagram showing a hardware configuration example of the automobile device 60 according to the second embodiment.
  • the short-range wireless communication unit 602, the wireless communication unit 603, the user interface unit 604, and the transmission information generation are performed by the system bus 600 to the control unit 601 composed of a computer.
  • the unit 605, the reception information analysis unit 606, and the travel control unit 607 are connected, and the camera 70 is further connected to the system bus 600.
  • the short-range wireless communication unit 602 is for communicating with the short-range wireless communication unit included in the tablet terminal 10, and in this example, it is configured as a Bluetooth (registered trademark) standard wireless communication unit.
  • the wireless communication unit 603 is for communicating with the management server device 40A through the communication network 5.
  • the user interface unit 604 includes a display and a speaker, displays an alarm from the management server device 40A, and emits a sound by voice.
  • the transmission information generation unit 605 generates transmission information from the writing locus information (with a pen ID) from the tablet terminal 10A acquired through the short-range wireless communication unit 602 and the face image information of the driver 2 acquired from the camera 70. , The generated transmission information is transmitted to the management server device 40A through the wireless communication unit 603.
  • the reception information analysis unit 606 analyzes the information sent from the management server device 40A and performs processing according to the analysis result.
  • the reception information analysis unit 606 determines that the alarm from the management server device 40A has been received
  • the reception information analysis unit 606 controls the user interface unit 604 to display the received alarm on the display and emit an alarm sound from the speaker.
  • a travel stop control signal is sent to the travel control unit 607.
  • the travel control unit 607 When the travel control unit 607 receives the travel stop control signal from the reception information analysis unit 606, the travel control unit 607 controls to stop or stop the travel of the own vehicle.
  • the processing of the transmission information generation unit 605, the reception information analysis unit 606, and the travel control unit 607 is processed according to the program stored in the built-in memory by the control unit 601. It may be configured as a software function.
  • FIG. 17 is a flowchart for explaining a processing operation example of the automobile device 60.
  • the processing of each step of the flowchart of FIG. 17 is a program in which the control unit 601 stores the processing of the transmission information generation unit 605, the reception information analysis unit 606, and the travel control unit 607 in the built-in memory. Therefore, it will be described as a case where it is configured as a software function to be processed.
  • the control unit 601 determines whether or not the short-range wireless communication unit 602 has received the writing locus information from the tablet terminal 10 (step S301), and when it is determined that the writing locus information has not been received, other processing is performed. Is executed (step S302), and then the process returns to step S301.
  • step S301 When it is determined in step S301 that the writing locus information has been received, the control unit 401 temporarily stores and holds the received writing locus information (with time information) in the buffer memory in association with the pen ID (step S303). Next, the photographed information of the driver 2's face image photographed by the camera 70 is acquired, and is stored in the buffer memory in association with the writing locus information (step S304).
  • control unit 401 determines whether or not the writing end has been received from the tablet terminal 10 (step S305), and when it is determined that the writing end has not been received, the process is returned to step S301, and the process is returned to step S301 and thereafter. Repeat the process of.
  • step S305 when it is determined in step S305 that the writing end has been received from the tablet terminal 10, the control unit 401 has the writing locus information of the operation diary stored in the buffer memory and the face image of the driver 2 as biometric information.
  • the information associated with the pen ID is transmitted to the management server device 40A through the communication network 5 through the wireless communication unit 603 (step S306).
  • control unit 401 determines whether or not an alarm has been received from the management server device 40A (step S307), and when it is determined that the alarm has not been received, determines whether or not a communication termination request has been received (step S307). Step S308).
  • the control unit 401 returns the process to step S307 and repeats the processes after this step S307.
  • the wireless communication process with the management server device 40A is terminated (step S311), and this process routine is terminated.
  • step S307 when it is determined in step S307 that the alarm has been received, the alarm is displayed on the display of the user interface unit 604 and the alarm sound is emitted from the speaker so that the driver 2 can suspend or stop the operation. Is controlled to stop or stop the running of the own vehicle (step S309). Then, the control unit 401 waits for the reception of the communication end request from the management server device 40A (step S310), and when it is determined that the communication end request has been received, executes a process of disconnecting the wireless communication path with the management server device 40A. (Step S311). Then, this processing routine is terminated.
  • the same operation and effect as those of the first embodiment described above can be obtained, and the driver 2 does not need to wear the smart watch and simply keeps track of the operation diary.
  • the effect is that it is sufficient to simply input the written trajectory information by writing.
  • the tablet terminal 10 since the tablet terminal 10 does not need to have a function of collecting biological information and does not need to have a wireless communication function with the management server device 40A, it has a simple configuration having only a function of generating written trajectory information. It has the effect of being able to.
  • the position detection device unit of the electronic pen and the tablet terminal in the above-described embodiment is of the electromagnetic induction type
  • the present invention is not limited to this, and for example, the active electrostatic type electronic pen and the position detection device unit may be used. It goes without saying that it can be used.
  • the biological information collected in the first embodiment described above is not limited to heartbeat and body temperature.
  • the operator is the driver and the vehicle to be operated is a taxi, but it goes without saying that the present invention is not limited to this.
  • the operation target may be a truck carrying luggage and the operator may be the driver, or the operation target may be a bus and the operator may be the driver.
  • the operation target is not limited to the automobile, but may be a motorcycle or a bicycle.
  • the automobile is not limited to the one traveling on land, and may be an amphibious vehicle or an air-land amphibious vehicle.
  • the operation target may be a ship or an aircraft instead of an automobile.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Dermatology (AREA)
  • Neurology (AREA)
  • Neurosurgery (AREA)
  • Educational Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Hospice & Palliative Care (AREA)
  • Psychiatry (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • Child & Adolescent Psychology (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Developmental Disabilities (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • User Interface Of Digital Computer (AREA)
PCT/JP2020/018596 2019-06-06 2020-05-08 操作者状態判断システム Ceased WO2020246198A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2021524721A JP7646544B2 (ja) 2019-06-06 2020-05-08 操作者状態判断システム
US17/542,182 US20220091673A1 (en) 2019-06-06 2021-12-03 Operator state determining system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019-105778 2019-06-06
JP2019105778 2019-06-06

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/542,182 Continuation US20220091673A1 (en) 2019-06-06 2021-12-03 Operator state determining system

Publications (1)

Publication Number Publication Date
WO2020246198A1 true WO2020246198A1 (ja) 2020-12-10

Family

ID=73652792

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/018596 Ceased WO2020246198A1 (ja) 2019-06-06 2020-05-08 操作者状態判断システム

Country Status (3)

Country Link
US (1) US20220091673A1 (https=)
JP (1) JP7646544B2 (https=)
WO (1) WO2020246198A1 (https=)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2024110200A (ja) * 2023-02-02 2024-08-15 株式会社日立製作所 心理特性推定システム及び方法
WO2024224575A1 (ja) * 2023-04-27 2024-10-31 篤史 小野 心身状態を評価するためのテスト方法

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020069517A2 (en) 2018-09-30 2020-04-02 Strong Force Intellectual Capital, Llc Intelligent transportation systems
US11631151B2 (en) 2018-09-30 2023-04-18 Strong Force Tp Portfolio 2022, Llc Intelligent transportation systems
US12481362B2 (en) * 2024-01-23 2025-11-25 Nicholas Gordon Bruns Systems and methods for an assistive brain computer interface for digital stylus inputs

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008056691A1 (en) * 2006-11-07 2008-05-15 Aisin Seiki Kabushiki Kaisha Physical condition management system
JP2009055934A (ja) * 2007-08-29 2009-03-19 Nippon Auto-Photo Kk 生体情報登録装置
JP2015148947A (ja) * 2014-02-06 2015-08-20 ソニー株式会社 情報処理システム、情報処理方法、及びプログラム
JP2016137204A (ja) * 2015-01-29 2016-08-04 マツダ株式会社 車両用乗員感情対応制御装置

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5587560A (en) * 1995-04-10 1996-12-24 At&T Global Information Solutions Company Portable handwritten data capture device and method of using
US20060028429A1 (en) * 2004-08-09 2006-02-09 International Business Machines Corporation Controlling devices' behaviors via changes in their relative locations and positions
JP4937341B2 (ja) 2006-04-04 2012-05-23 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 表現ペン
US9329767B1 (en) * 2010-06-08 2016-05-03 Google Inc. User-specific customization based on characteristics of user-interaction
EP2836927B1 (en) 2012-04-11 2019-10-16 BlackBerry Limited Systems and methods for searching for analog notations and annotations
US9229543B2 (en) 2013-06-28 2016-01-05 Lenovo (Singapore) Pte. Ltd. Modifying stylus input or response using inferred emotion
US10032065B2 (en) * 2013-10-25 2018-07-24 Wacom Co., Ltd. Dynamic handwriting verification, handwriting-based user authentication, handwriting data generation, and handwriting data preservation
US9956963B2 (en) * 2016-06-08 2018-05-01 GM Global Technology Operations LLC Apparatus for assessing, predicting, and responding to driver fatigue and drowsiness levels

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008056691A1 (en) * 2006-11-07 2008-05-15 Aisin Seiki Kabushiki Kaisha Physical condition management system
JP2009055934A (ja) * 2007-08-29 2009-03-19 Nippon Auto-Photo Kk 生体情報登録装置
JP2015148947A (ja) * 2014-02-06 2015-08-20 ソニー株式会社 情報処理システム、情報処理方法、及びプログラム
JP2016137204A (ja) * 2015-01-29 2016-08-04 マツダ株式会社 車両用乗員感情対応制御装置

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2024110200A (ja) * 2023-02-02 2024-08-15 株式会社日立製作所 心理特性推定システム及び方法
JP7807407B2 (ja) 2023-02-02 2026-01-27 株式会社日立製作所 心理特性推定システム及び方法
WO2024224575A1 (ja) * 2023-04-27 2024-10-31 篤史 小野 心身状態を評価するためのテスト方法
GB2644257A (en) * 2023-04-27 2026-03-25 Good House Inc Test method for evaluating mind/body condition

Also Published As

Publication number Publication date
JPWO2020246198A1 (https=) 2020-12-10
US20220091673A1 (en) 2022-03-24
JP7646544B2 (ja) 2025-03-17

Similar Documents

Publication Publication Date Title
WO2020246198A1 (ja) 操作者状態判断システム
JP7108752B2 (ja) 感情状態推定要求と返信情報とのやり取り方法
EP2945133B1 (en) Driver rest recommendation
CN106249869B (zh) 具有与用户神经系统的接口的标记读取系统
US10390748B2 (en) Monitoring a driver of a vehicle
EP1654986B1 (en) Information processing terminal and communication system
JP6803299B2 (ja) システム及び方法
CN105373219A (zh) 可穿戴装置及其操作方法
US20190209100A1 (en) In-vehicle user health platform systems and methods
CN105303793A (zh) 使用移动终端处理车辆的事故
JP2021045568A (ja) システム及び方法
JP2019072486A (ja) 電子装置
KR102533993B1 (ko) 복수의 생체 신호에 기반하여 건강 정보를 생성하는 전자 장치 및 이의 동작 방법
US11260874B2 (en) Driver assistance device that can be mounted on a vehicle
JP2014027961A (ja) 体調管理装置、体調管理ユニット、体調管理システム及び体調管理方法
CN111568444A (zh) 一种车载情感通信交互系统
CN112307813A (zh) 一种智能虚拟管家系统及车辆
SK392020A3 (sk) Volant na monitorovanie vitálnych funkcií vodiča
KR101689713B1 (ko) 휴대 단말기 및 그 동작 방법
KR101696720B1 (ko) 휴대 단말기 및 그 동작 방법
KR101772881B1 (ko) 스마트 키 기능을 갖는 웨어러블 장치
CN118113937A (zh) 车载推荐系统、方法、设备及存储介质
CN121013685A (zh) 信息处理系统、信息处理装置及信息处理方法
SK9278Y1 (sk) Volant na monitorovanie vitálnych funkcií vodiča
CN115257775A (zh) 一种可穿戴车载生物传感智能控制系统、方法以及设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20819076

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021524721

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20819076

Country of ref document: EP

Kind code of ref document: A1