US10647253B2 - Information processing device, method of controlling terminal device, and non-transitory computer-readable recording medium - Google Patents

Information processing device, method of controlling terminal device, and non-transitory computer-readable recording medium Download PDF

Info

Publication number
US10647253B2
US10647253B2 US16/292,251 US201916292251A US10647253B2 US 10647253 B2 US10647253 B2 US 10647253B2 US 201916292251 A US201916292251 A US 201916292251A US 10647253 B2 US10647253 B2 US 10647253B2
Authority
US
United States
Prior art keywords
user
vehicle
terminal device
information processing
communication unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US16/292,251
Other languages
English (en)
Other versions
US20190283668A1 (en
Inventor
Akira Sasaki
Masashi Nakagawa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toyota Motor Corp
Original Assignee
Toyota Motor Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toyota Motor Corp filed Critical Toyota Motor Corp
Assigned to TOYOTA JIDOSHA KABUSHIKI KAISHA reassignment TOYOTA JIDOSHA KABUSHIKI KAISHA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: NAKAGAWA, MASASHI, SASAKI, AKIRA
Publication of US20190283668A1 publication Critical patent/US20190283668A1/en
Application granted granted Critical
Publication of US10647253B2 publication Critical patent/US10647253B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80—Arrangements for controlling instruments
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00—Individual registration on entry or exit
    • G07C9/00174—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00309—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys operated with bidirectional data transmission between data carrier and locks
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18—Status alarms
    • G08B21/24—Reminder alarms, e.g. anti-loss alarms
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M11/00—Telephonic communication systems specially adapted for combination with other electrical systems
    • H04M11/08—Telephonic communication systems specially adapted for combination with other electrical systems specially adapted for optional reception of entertainment or informative matter
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/178—Warnings
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/55—Remote control arrangements
    • B60K2360/56—Remote control arrangements using mobile devices
    • B60K2360/566—Mobile devices displaying vehicle information
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/55—Remote control arrangements
    • B60K2360/56—Remote control arrangements using mobile devices
    • B60K2360/573—Mobile devices controlling vehicle functions
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C2209/00—Indexing scheme relating to groups G07C9/00 - G07C9/38
    • G07C2209/60—Indexing scheme relating to groups G07C9/00174 - G07C9/00944
    • G07C2209/62—Comprising means for indicating the status of the lock
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C2209/00—Indexing scheme relating to groups G07C9/00 - G07C9/38
    • G07C2209/60—Indexing scheme relating to groups G07C9/00174 - G07C9/00944
    • G07C2209/63—Comprising locating means for detecting the position of the data carrier, i.e. within the vehicle or within a certain distance from the vehicle

Definitions

  • the present disclosure relates to an information processing device, a method of controlling a terminal device, and a non-transitory computer-readable recording medium storing a program.
  • JP 2014-125779 A Japanese Unexamined Patent Application Publication No. 2014-125779
  • JP 2014-125779 A includes an electronic key that transmits radio waves for locking or unlocking a vehicle door, and an in-vehicle device that performs a process of locking or unlocking the vehicle door according to reception of the radio waves transmitted from the electronic key.
  • JP 2010-159615 A discloses a system that determines whether or not a user temporarily gets off and improves accuracy of warning.
  • a warning is transmitted to an electronic key. Therefore, when the user is far away from the vehicle, communication with the electronic key cannot be performed and the user cannot receive the warning.
  • JP 2005-240349 A a user who has forgotten a manipulation of a vehicle is warned via a center device provided at a service center or the like. However, since the warning is always via the center device, a notification time is needed even when the user is near the vehicle.
  • the present disclosure provides an information processing device capable of alleviating annoyance of a double notification and appropriately warning a user, a method of controlling a terminal device, and a non-transitory computer-readable recording medium storing a program.
  • a first aspect of the present disclosure relates to an information processing device that notifies a user of a vehicle of an abnormality in a state of the vehicle.
  • the information processing device includes a first communication unit configured to communicate with a first terminal device using a first communication scheme; a second communication unit configured to communicate with a second terminal device using a second communication scheme; and a controller.
  • the controller is configured to generate an abnormality detection signal when an abnormality is detected based on vehicle information on the vehicle, and determine a position of the user based on a communication state of the first terminal device and the second terminal device possessed by the user.
  • the controller is configured to cause the first communication unit to transmit the abnormality detection signal to the first terminal device when the controller determines that the position of the user is included in a first region, and cause the second communication unit to transmit the abnormality detection signal to the second terminal device when the controller determines that the position of the user is included in a second region that is farther from the vehicle than the first region.
  • the information processing device may further include a third communication unit configured to communicate with the second terminal device using a third communication scheme.
  • the controller may be configured to cause the third communication unit to transmit the abnormality detection signal to the second terminal device when the controller determines that the position of the user is included in neither the first region nor the second region.
  • the controller may be configured to give instruction for a manipulation of the vehicle based on a user instruction signal indicating content of an instruction of the user when the controller acquires the user instruction signal from the second terminal device.
  • the controller may be configured to acquire the user instruction signal that is continuously transmitted while the user is executing a predetermined manipulation with respect to the second terminal device and stop giving instruction for the manipulation of the vehicle when the controller does not acquire the user instruction signal.
  • the vehicle information may be information on opening or closing of a door of the vehicle
  • the controller may be configured to generate the abnormality detection signal when an abnormality that a door of a driver seat of the vehicle is not locked is detected.
  • a second aspect of the present disclosure relates to a method of controlling a terminal device including a communication unit, a display unit, and an input unit.
  • the communication unit is configured to communicate with an information processing device that notifies a user of a vehicle of an abnormality in a state of the vehicle using an abnormality detection signal.
  • the method includes receiving, by the communication unit, the abnormality detection signal when the information processing device determines that a position of the user is included in a second region that is farther from the vehicle than a first region based on a communication state of the terminal device possessed by the user; displaying, by the display unit, content of the abnormality based on the abnormality detection signal; detecting, by the input unit, an instruction of the user for the abnormality; and transmitting, by the communication unit, a user instruction signal indicating content of the instruction of the user to the information processing device.
  • a third aspect of the present disclosure relates to a non-transitory computer-readable recording medium storing a program causing a terminal device including a communication unit, a display unit, and an input unit to execute a process.
  • the communication unit is configured to communicate with an information processing device that notifies a user of a vehicle of an abnormality in a state of the vehicle using an abnormality detection signal.
  • the process includes receiving, by the communication unit, the abnormality detection signal when the information processing device determines that a position of the user is included in a second region that is farther from the vehicle than a first region based on a communication state of the terminal device possessed by the user; displaying, by the display unit, content of the abnormality based on the abnormality detection signal; detecting, by the input unit, an instruction of the user for the abnormality; and transmitting, by the communication unit, a user instruction signal indicating content of the instruction of the user to the information processing device.
  • a fourth aspect of the present disclosure relates to an information processing device that notifies a user of a vehicle of an abnormality in a state of the vehicle.
  • the information processing device includes a first communication unit configured to communicate with a first terminal device using a first communication scheme; a second communication unit configured to communicate with a second terminal device using a second communication scheme; and a controller.
  • the controller is configured to generate an abnormality detection signal when an abnormality is detected based on vehicle information on the vehicle, and determine a position of the user based on a communication state of the first terminal device and the second terminal device possessed by the user.
  • the controller is configured to cause the first communication unit to transmit the abnormality detection signal to the first terminal device when the controller determines that the position of the user is included in a first region and the abnormality is predetermined content, and cause the second communication unit to transmit the abnormality detection signal to the second terminal device when the controller determines that the position of the user is included in the first region and the abnormality is not the predetermined content.
  • FIG. 1 is a diagram illustrating a schematic configuration of a vehicle manipulation forgetting notification system
  • FIG. 2 is a diagram illustrating an example of an information processing device mounted in a vehicle
  • FIG. 3 is a diagram illustrating an example of a first terminal device possessed by a user
  • FIG. 4 is a diagram illustrating an example of a second terminal device possessed by the user
  • FIG. 5 is a diagram illustrating a determination of a position of the user
  • FIG. 6 is a sequence diagram illustrating a process when the user is in a first region
  • FIG. 7 is a sequence diagram illustrating a process when the user is in a second region
  • FIG. 8A is a sequence diagram illustrating a process when the user is outside the second region
  • FIG. 8B is a sequence diagram illustrating a process when the user is outside the second region
  • FIG. 9 is a flowchart showing an operation of the information processing device
  • FIG. 10 is a flowchart showing an operation of the second terminal device.
  • FIG. 11 is a flowchart showing an operation of the information processing device.
  • FIG. 1 is a diagram illustrating a schematic configuration of a vehicle manipulation forgetting notification system 1 including an information processing device according to an embodiment of the present disclosure.
  • the vehicle manipulation forgetting notification system 1 includes an information processing device 10 , a server 20 , a first terminal device 40 , and a second terminal device 50 .
  • the information processing device 10 is, for example, an in-vehicle device mounted in a vehicle such as an automobile.
  • the information processing device 10 is, for example, a navigation device.
  • the information processing device 10 may be a smartphone, a tablet terminal, or any other device that is used by a user. A configuration of the information processing device 10 will be described below.
  • the server 20 is, for example, a server device that performs a process regarding a vehicle.
  • the server 20 is installed in a management center that collects and analyzes information on vehicles, for example.
  • the information on the vehicle is, for example, position information of each of vehicles that are management targets.
  • the server 20 may be configured of one or a plurality of server devices capable of communicating with each other. Further, the server 20 communicates with one or more information processing devices 10 mounted in one or more vehicles. A configuration of the server 20 will be described below.
  • the first terminal device 40 is, for example, a mobile terminal device possessed by the user of the vehicle.
  • the first terminal device 40 is, for example, an electronic key.
  • the first terminal device 40 is not limited to the electronic key.
  • the first terminal device 40 may be a mobile terminal device having a simpler configuration than the second terminal device 50 described below.
  • the first terminal device 40 may be, particularly, a mobile terminal device that does not include a display. A configuration of the first terminal device 40 will be described below.
  • the second terminal device 50 is, for example, another mobile terminal device possessed by the user of the vehicle.
  • the second terminal device 50 is, for example, a smartphone.
  • the second terminal device 50 is not limited to the smartphone.
  • the second terminal device 50 may be, for example, a tablet terminal. A configuration of the second terminal device 50 will be described below.
  • an information processing device 10 includes a display unit 11 , an input unit 12 , a sound reproduction unit 13 , a communication unit 14 , a storage unit 15 , and a controller 16 .
  • the display unit 11 includes a display that displays information.
  • the display may include, for example, a flat panel display such as a liquid crystal panel or an organic electro luminescence (EL) panel.
  • the information processing device 10 includes a touch panel display in which the display unit 11 and the input unit 12 are integrated.
  • the input unit 12 includes one or more input interfaces that receive an input from the user.
  • the input unit 12 is, for example, a touch panel provided integrally with the display unit 11 .
  • the input unit 12 may be a keyboard that receives a character input or a microphone that receives a voice input.
  • the sound reproduction unit 13 includes one or more speakers.
  • the sound reproduction unit 13 may reproduce sound such as route guidance to the destination, for example.
  • the communication unit 14 includes one or more communication interfaces.
  • the communication unit 14 may include a communication interface corresponding to a mobile communication standard such as 4G (4th Generation), a wired local area network (LAN) standard, a wireless LAN standard, or the like.
  • the communication unit 14 includes a first communication unit 14 A, a second communication unit 14 B, and a third communication unit 14 C that use different communication schemes.
  • the communication unit 14 includes a communication interface of a controller area network (CAN).
  • the communication unit 14 receives vehicle information from an electronic control unit (ECU) of the vehicle via the CAN.
  • the communication unit 14 transmits an instruction of a manipulation of the vehicle, which will be described below, to the ECU via the CAN.
  • the vehicle information includes information such as opening or closing of a door, opening or closing of a window or a roof, turning on and off of a light, a state of a driver seat, or a state of an engine.
  • the first communication unit 14 A performs communication with the first terminal device 40 using a first communication scheme.
  • the first communication scheme is one of short-distance wireless communications.
  • the first communication scheme is a communication using an ultra high frequency (UHF) signal (radio waves in a UHF band) suitable for communication with the first terminal device 40 at a position very close to the information processing device 10 .
  • UHF ultra high frequency
  • the position very close to the information processing device 10 is, for example, within 2 m from the vehicle in which the information processing device 10 is mounted.
  • the second communication unit 14 B communicates with the second terminal device 50 using a second communication scheme.
  • the second communication scheme is one of a wireless local area network (LAN) and a wireless personal area network (PAN), and has a longer communication distance than the first communication scheme.
  • the second communication scheme is communication under a Bluetooth (registered trademark) Low Energy (BTLE) standard suitable for communication with the second terminal device 50 at a position closer to the information processing device 10 .
  • the position closer to the information processing device 10 is, for example, farther than 2 m from the vehicle in which the information processing device 10 is mounted and within 10 m.
  • the third communication unit 14 C communicates with the second terminal device 50 using a third communication scheme.
  • the third communication scheme is a communication scheme that enables communication over a longer distance than the second communication scheme.
  • the third communication unit 14 C communicates with the second terminal device 50 via the server 20 . Therefore, the third communication scheme uses a mobile communication standard such as 4 Q which is suitable for communication with the server 20 .
  • the third communication scheme includes communication via a network such as the Internet between a mobile communication base station and the server 20 .
  • the third communication unit 14 C performs communication, for example, when the second terminal device 50 is at a position far from the information processing device 10 .
  • the position far from the information processing device 10 is, for example, a position farther than 10 m away from the vehicle in which the information processing device 10 is mounted.
  • the storage unit 15 includes one or more memories.
  • the memory may include, for example, a semiconductor memory, a magnetic memory, or an optical memory.
  • Each memory included in the storage unit 15 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory.
  • the storage unit 15 stores any information that is used for an operation of the information processing device 10 .
  • the storage unit 15 may store identification (ID) profile data for specifying the second terminal device 50 that is a communication destination, which is used when communication with the second terminal device 50 is performed using the second communication scheme or the third communication scheme. Further, the storage unit 15 may store map information to be used in route guidance to be described below.
  • ID identification
  • the controller 16 includes one or more processors.
  • the processor may include, for example, a general-purpose processor, and a dedicated processor specialized to a specific process.
  • the controller 16 may be a central processing unit (CPU).
  • the controller 16 controls an overall operation of the information processing device 10 .
  • the controller 16 includes a vehicle state detection unit 16 A and a position determination unit 16 B.
  • the vehicle state detection unit 16 A When the vehicle state detection unit 16 A detects an abnormality based on vehicle information, the vehicle state detection unit 16 A generates an abnormality detection signal.
  • the vehicle state detection unit 16 A acquires vehicle information (for example, information on opening or closing of a door, opening or closing of a window or a roof, turning on or off of a light, a state of a driver seat, and a state of an engine) from the ECU of the vehicle via the communication unit 14 .
  • vehicle information for example, information on opening or closing of a door, opening or closing of a window or a roof, turning on or off of a light, a state of a driver seat, and a state of an engine
  • the vehicle state detection unit 16 A can determine that a user (particularly, a driver) of the vehicle is outside a vehicle cabin.
  • the vehicle state detection unit 16 A when the vehicle state detection unit 16 A detects an abnormality that a door of the driver seat is not locked from information on opening or closing the door, the vehicle state detection unit 16 A can generate an abnormality detection signal indicating that there is an abnormality in door lock.
  • the abnormality detection signal includes at least information indicating the content of abnormality of the vehicle.
  • the generated abnormality detection signal is transmitted to the first terminal device 40 or the second terminal device 50 as will be described below.
  • the position determination unit 16 B determines the position of the user based on a communication state of the first communication unit 14 A and the second communication unit 14 B.
  • the communication state is determined based on the intensity of a received signal.
  • the first communication unit 14 A performs communication using a UHF signal.
  • the first communication unit 14 A transmits a test signal for position confirmation to the first terminal device 40 possessed by the user.
  • the second terminal device 50 performs communication according to a BTLE standard.
  • the second terminal device 50 transmits a test signal for position confirmation to the second terminal device 50 possessed by the user according to the BTLE standard.
  • the test signal is transmitted a plurality of times at predetermined intervals, for example.
  • the first communication unit 14 A and the second communication unit 14 B receive the signals transmitted from the first terminal device 40 and the second terminal device 50 in response to the test signal.
  • the position determination unit 16 B acquires information on the intensity of the signal received by the first communication unit 14 A and the second communication unit 14 B.
  • a well-known technique can be used as a method of estimating the position of the user from the intensity of the received signal. For example, when the intensity of the received signal of the first communication unit 14 A is equal to or higher than a predetermined threshold value (for example, 20% of the maximum intensity), the position determination unit 16 B determines that the user is in a region within a first distance (for example, 2 m) from the vehicle.
  • a predetermined threshold value for example, 20% of the maximum intensity
  • the position determination unit 16 B may determine that the user is in a region farther than the first distance from the vehicle and within a second distance (for example, 10 m). Further, for example, when the intensity of the received signal of the second communication unit 14 B is lower than the predetermined threshold value, the position determination unit 16 B may determine that the user is in a region farther than the second distance from the vehicle.
  • the information processing device 10 is a navigation device.
  • the information processing device 10 displays a map on the touch panel display (corresponding to the display unit 11 and the input unit 12 ) while the vehicle is moving.
  • the information processing device 10 guides the route to the user by voice using the sound reproduction unit 13 .
  • the information processing device 10 notifies the user of the vehicle of the abnormality through the abnormality detection signal when the information processing device 10 detects the abnormality in the state of the vehicle based on the vehicle information.
  • the controller 16 loads the program stored in the storage unit 15 and executes the program, such that functions such as the route guidance of the vehicle state detection unit 16 A, the position determination unit 16 B, and the vehicle can be realized.
  • the server 20 includes a server communication unit 21 , a server storage unit 22 , and a server controller 23 .
  • the server communication unit 21 includes one or more communication interfaces.
  • the server communication unit 21 may include a communication interface corresponding to a mobile communication standard such as 4G (4th Generation), a wired local area network (LAN) standard, a wireless LAN standard, or the like.
  • the server communication unit 21 can communicate with the third communication unit 14 C of the information processing device 10 .
  • the server communication unit 21 can communicate with the second terminal device 50 . Communication between the third communication unit 14 C of the information processing device 10 and the second terminal device 50 is performed via the server communication unit 21 .
  • the server storage unit 22 includes one or more memories. Each memory included in the server storage unit 22 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory.
  • the server storage unit 22 stores any information that is used for an operation of the server 20 .
  • the server storage unit 22 may store ID profile data for specifying the second terminal device 50 that is a communication destination, which is used, for example, when the abnormality detection signal or the like from the information processing device 10 is transferred to the second terminal device 50 .
  • the server storage unit 22 may store the profile data instead of the storage unit 15 of the information processing device 10 . In this case, the information processing device 10 may start communication with the second terminal device 50 after acquiring the profile data from the server 20 .
  • the server controller 23 includes one or more processors.
  • the processor may include, for example, a general-purpose processor, and a dedicated processor specialized to a specific process.
  • the server controller 23 controls an overall operation of the server 20 .
  • the first terminal device 40 includes a first terminal communication unit 41 , a first terminal storage unit 42 , a first terminal controller 43 , a first terminal input unit 44 , and a first terminal notification unit 45 .
  • the first terminal communication unit 41 includes one or more communication interfaces.
  • the first terminal communication unit 41 may include a communication interface corresponding to a mobile communication standard such as 4G (4th Generation), a wired local area network (LAN) standard, a wireless LAN standard, or the like.
  • the first terminal communication unit 41 can directly communicate with the first communication unit 14 A of the information processing device 10 . That is, the first terminal communication unit 41 performs communication with the first communication unit 14 A using the first communication scheme.
  • the first terminal storage unit 42 includes one or more memories. Each memory included in the first terminal storage unit 42 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The first terminal storage unit 42 stores any information that is used for an operation of the first terminal device 40 . The first terminal storage unit 42 may store ID profile data for specifying a vehicle of which the door is locked or unlocked by the first terminal device 40 which is an electronic key.
  • the first terminal controller 43 includes one or more processors.
  • the processor may include, for example, a general-purpose processor, and a dedicated processor specific to a specific process.
  • the first terminal controller 43 controls an overall operation of the first terminal device 40 .
  • the first terminal controller 43 causes the first terminal communication unit 41 to transmit radio waves for locking or unlocking the door in response to an instruction from the user.
  • the first terminal controller 43 can control various operations of the first terminal device 40 by loading a program stored in the first terminal storage unit 42 and executing the program.
  • the first terminal input unit 44 includes one or more input interfaces that receive an input from the user.
  • the first terminal input unit 44 is configured of buttons.
  • the first terminal input unit 44 may be a pressure sensitive element or the like.
  • the first terminal notification unit 45 notifies the user that predetermined information has been received.
  • the predetermined information is an abnormality detection signal from the information processing device 10 .
  • the first terminal notification unit 45 notifies the user by vibration.
  • the first terminal notification unit 45 may include a motor that starts operation when the first terminal communication unit 41 has received the abnormality detection signal.
  • the first terminal notification unit 45 may notify the user by sound.
  • the first terminal notification unit 45 may be configured to include a speaker.
  • the first terminal device 40 is an electronic key.
  • the first terminal device 40 includes a button 441 for locking the door of the vehicle and a button 442 for unlocking the door of the vehicle.
  • the first terminal device 40 transmits radio waves for locking the door.
  • the button 442 the first terminal device 40 transmits radio waves for unlocking the door.
  • the ECU of the vehicle locks or unlocks the door when the ECU receives the radio waves for locking or unlocking the door.
  • the second terminal device 50 includes a second terminal communication unit 51 , a second terminal storage unit 52 , a second terminal controller 53 , a second terminal input unit 54 , and a second terminal display unit 55 .
  • the second terminal communication unit 51 includes one or more communication interfaces.
  • the second terminal communication unit 51 may include a communication interface corresponding to a mobile communication standard such as 4G (4th Generation), a wired local area network (LAN) standard, a wireless LAN standard, or the like.
  • the second terminal communication unit 51 can directly communicate with the second communication unit 14 B of the information processing device 10 . That is, the second terminal communication unit 51 performs communication with the second communication unit 14 B using the second communication scheme.
  • the second terminal communication unit 51 communicates with the third communication unit 14 C via the server 20 . That is, the second terminal communication unit 51 also performs communication using the third communication scheme.
  • the second terminal storage unit 52 includes one or more memories. Each memory included in the second terminal storage unit 52 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The second terminal storage unit 52 stores any information that is used for an operation of the second terminal device 50 . The second terminal storage unit 52 may store ID profile data for specifying the information processing device 10 that is a communication destination.
  • the second terminal controller 53 includes one or more processors.
  • the processor may include, for example, a general-purpose processor, and a dedicated processor specific to a specific process.
  • the second terminal controller 53 controls an overall operation of the second terminal device 50 .
  • the second terminal controller 53 causes the second terminal communication unit 51 to transmit the user instruction signal indicating the content of the instruction of the user.
  • the user instruction signal is a signal indicating the content of the instruction of the user.
  • the instruction of the users includes, for example, closing the window or roof of the vehicle, turning off the light, and locking the door.
  • the second terminal controller 53 can control various operations of the second terminal device 50 by loading the program stored in the second terminal storage unit 52 and executing the program.
  • the second terminal input unit 54 includes one or more input interfaces that receive an input from the user.
  • the second terminal input unit 54 is a touch panel provided integrally with the second terminal display unit 55 .
  • the second terminal input unit 54 may be a keyboard that receives a character input or a microphone that receives a voice input.
  • the second terminal display unit 55 includes a display that displays information.
  • the display may include, for example, a flat panel display such as a liquid crystal panel or an organic electro luminescence (EL) panel.
  • the second terminal device 50 includes a touch panel display in which the second terminal display unit 55 and the second terminal input unit 54 are integrated.
  • the second terminal device 50 is a smartphone.
  • a message 551 , a button 541 , and a button 542 are displayed on a touch panel display in which the second terminal display unit 55 and the second terminal input unit 54 are integrated.
  • the message 551 indicates content of abnormality of the vehicle based on the abnormality detection signal received by the second terminal device 50 .
  • the message 551 warning that the user has forgotten about closing of the window and got off the vehicle is displayed.
  • the button 541 and the button 542 are for the user to give an instruction for the abnormality of the vehicle.
  • the second terminal controller 53 causes the second terminal communication unit 51 to transmit a user instruction signal including the content of the instruction “close the window”. Further, when the second terminal input unit 54 detects the touch of the button 542 written as “as it is”, the second terminal controller 53 causes the second terminal communication unit 51 to transmit a user instruction signal including content of an instruction “keep the window as it is”.
  • the display of the button 541 and the button 542 can change according to the abnormality of the vehicle. For example, when the abnormality is “not turn off light,” the button 541 may change to a statement “turn off”.
  • the display of FIG. 4 may be a screen of an application for communication with the information processing device 10 installed in the second terminal device 50 .
  • the second terminal device 50 may first display a pop-up screen on the touch panel display.
  • the second terminal device 50 may activate the application and perform a display as illustrated in FIG. 4 .
  • the second terminal device 50 may change the content of the message 551 to “completed” or the like when the second terminal device 50 receives the normality detection signal from the information processing device 10 after the second terminal device 50 performs the display of FIG. 4 .
  • the normality detection signal is generated when the manipulation (for example, closing a window) according to the instruction of the user is completed in the vehicle and the information processing device 10 detects normality (resolving of abnormality) based on the vehicle information.
  • FIG. 5 is a diagram illustrating a determination of the position of the user (hereinafter simply referred to as a “position determination”).
  • FIG. 5 is a top view in which a vehicle M is at a center.
  • the position determination unit 16 B of the information processing device 10 determines the position of the user based on the communication state of the first communication unit 14 A and the second communication unit 14 B. In the embodiment, the position determination unit 16 B determines whether the position of the user is the first region R 1 , the second region R 2 , or a region (hereinafter simply referred to as a “third region”) farther than the second region R 2 . As illustrated in FIG.
  • the first region R 1 in the embodiment is a region outside the vehicle M and within a first distance d 1 from the vehicle M.
  • the first distance d 1 is 2 m.
  • the second region R 2 in the embodiment is a region outside the vehicle M and farther than the first distance d 1 from the vehicle and within a second distance d 2 .
  • the second distance d 2 is 10 m.
  • the third region in the embodiment is a region outside the vehicle M and farther than the second distance d 2 from the vehicle (that is, 10 m).
  • the first region R 1 is a region in which the first communication unit 14 A and the first terminal device 40 can communicate using the first communication scheme. It is desirable for the first region R 1 to be further set to be a region in which the user notified of the abnormality by the first terminal device 40 can immediately return to the vehicle M (for example, within 10 seconds). The user who is notified of the abnormality in the state of the vehicle in the first region R 1 is expected to return to the vehicle M and resolve the abnormality. Therefore, for the user in the first region R 1 , the information processing device 10 transmits an abnormality detection signal to the first terminal device 40 that does not display the content of the abnormality. That is, when the position determination unit 16 B determines that the position of the user is included in the first region R 1 , the controller 16 of the information processing device 10 transmits an abnormality detection signal to the first terminal device 40 using the first communication unit 14 A.
  • the second region R 2 is a region in which the second communication unit 14 B and the second terminal device 50 can communicate using the second communication scheme. Further, the second region R 2 is a region in which it is difficult for the first communication unit 14 A and the first terminal device 40 to communicate using the first communication scheme. It is desirable for the second region R 2 to be further set to be a region in which a remote manipulation can be performed while viewing the vehicle M. Specifically, the remote manipulation using the second terminal device 50 is a manipulation in which the user resolves the abnormality of the vehicle M by touching the button 541 or the like on the touch panel display.
  • the remote manipulation is realized by the controller 16 of the information processing device 10 instructing an ECU or the like of the vehicle M to manipulate the vehicle (for example, close the window) based on the user instruction signal transmitted from the second terminal device 50 .
  • the information processing device 10 determines that the position of the user is included in the second region R 2 , the information processing device 10 transmits the abnormality detection signal to the second terminal device 50 so that the user who is difficult to immediately return to the vehicle M can execute the remote manipulation.
  • the third region is a region in which the third communication unit 14 C and the second terminal device 50 can communicate using the third communication scheme. Further, the third region is a region in which communication using the first communication scheme and the second communication scheme is difficult.
  • the information processing device 10 transmits an abnormality detection signal to the second terminal device 50 capable of displaying the content of the abnormality using the third communication scheme.
  • communication is performed via the server 20 . Therefore, although a communication speed decreases, it is possible to transmit the abnormality detection signal or the like to the second terminal device 50 of a user far away from the vehicle M.
  • the first region R 1 and the second region R 2 are elliptical in a top view, but the first region R 1 and the second region R 2 are not limited to this shape.
  • the first region R 1 and the second region R 2 may have a perfect circle shape.
  • the first region R 1 and the second region R 2 may have the same shape (for example, a substantially rectangular shape) as that of the vehicle M.
  • FIG. 6 is a sequence diagram illustrating an example of a communication process in a case where the position determination unit 16 B determines that the position of the user is included in the first region R 1 .
  • the information processing device 10 When the information processing device 10 detects an abnormality based on the vehicle information, the information processing device 10 generates an abnormality detection signal (step S 1 ).
  • the abnormality is, for example, that the door is not locked.
  • the information processing device 10 determines that the user of the vehicle is outside the vehicle cabin based on the information indicating that the driver seat is vacant, for example (step S 2 ).
  • the information processing device 10 can determine that the driver seat is vacant based on the state of the driver seat which is one of pieces of vehicle information, as described above.
  • the information processing device 10 transmits an abnormality detection signal (step S 3 ).
  • the information processing device 10 transmits the abnormality detection signal to the first terminal device 40 using the first communication scheme.
  • the first terminal device 40 receives the abnormality detection signal (step S 4 ).
  • the first terminal device 40 is an electronic key possessed by the user.
  • the first terminal device 40 notifies the user that the first terminal device 40 has received the abnormality detection signal (step S 5 ).
  • the first terminal device 40 which is an electronic key, notifies the user through vibration.
  • the user since the user is in the first region R 1 , the user can immediately return to the vehicle.
  • the user can deal with the abnormality to resolve the abnormality while confirming the abnormality occurring in the vehicle.
  • the user can deal with the abnormality without returning to the vehicle.
  • the user can lock the door by pushing the button 441 of the first terminal device 40 which is an electronic key when the user is reminded that the door is not locked at the time of getting off by notification.
  • the abnormality of the vehicle that can be resolved at a distance place using the first terminal device 40 is limited to the predetermined content (in this example, the door is not locked).
  • the predetermined content is determined according to an instruction of the user that can be performed by the first terminal device 40 .
  • the first terminal device 40 which is an electronic key, also includes a switch that can remotely open or close the roof of the vehicle
  • the predetermined content may be that the door is not locked and the roof is open.
  • FIG. 7 is a sequence diagram illustrating an example of a communication process in a case where the position determination unit 16 B determines that a position of the user is included in the second region R 2 .
  • Step S 11 When the information processing device 10 detects an abnormality, the information processing device 10 generates an abnormality detection signal (step S 11 ). Further, the information processing device 10 determines that the user of the vehicle is outside the vehicle cabin (step S 12 ). Steps S 11 and S 12 correspond to steps S 1 and S 2 in FIG. 6 . Therefore, detailed description will be omitted.
  • the information processing device 10 transmits an abnormality detection signal (step S 13 ). In this case, the information processing device 10 transmits the abnormality detection signal to the second terminal device 50 using the second communication scheme.
  • the second terminal device 50 receives the abnormality detection signal (step S 14 ).
  • the second terminal device 50 is a smartphone possessed by the user.
  • the second terminal device 50 notifies the user of the abnormality based on the received abnormality detection signal (step S 15 ).
  • the abnormality notification to the user is executed, for example, by displaying the message 551 in FIG. 4 .
  • the second terminal device 50 detects an instruction of the user (step S 16 ).
  • the detection of the instruction of the user is executed by detecting the touch of the user to the button 541 or the button 542 in FIG. 4 , for example.
  • the second terminal device 50 transmits a user instruction signal indicating the content of the instruction of the user (step S 17 ).
  • the second terminal device 50 transmits the user instruction signal to the information processing device 10 using the second communication scheme.
  • Content of the instruction of the user is, for example, an instruction to close the window.
  • the information processing device 10 receives the user instruction signal (step S 18 ).
  • the information processing device 10 gives instruction for a manipulation of the vehicle based on the user instruction signal (step S 19 ).
  • the information processing device 10 is, for example, an in-vehicle device such as a navigation device.
  • the information processing device 10 transmits an instruction to manipulate the vehicle (for example, an instruction to close the window) to the ECU of the vehicle via the CAN.
  • the information processing device 10 determines that a manipulation as instructed by the ECU has been executed, based on the vehicle information acquired after the instruction is transmitted.
  • the information processing device 10 performs normal detection based on the vehicle information, that is, detects that the abnormality has been resolved (step S 20 ).
  • the information processing device 10 generates a normality detection signal.
  • the normality detection signal includes at least information indicating that the abnormality of the vehicle has been resolved.
  • the information processing device 10 transmits the normality detection signal (step S 21 ). In this case, the information processing device 10 transmits the normality detection signal to the second terminal device 50 using the second communication scheme.
  • the second terminal device 50 receives the normality detection signal (step S 22 ).
  • the second terminal device 50 notifies the user of the normality based on the received normality detection signal (step S 23 ).
  • the normality notification to the user is executed, for example, by hiding the button 541 and the button 542 in FIG. 4 and changing the content of the message 551 to “completed” or the like.
  • the user since the user is in the second region R 2 , the user can perform a remote manipulation while viewing the vehicle. Further, communication between the information processing device 10 and the second terminal device 50 is performed using the second communication scheme such as a BTLE standard. Therefore, a communication speed is not degraded unlike the third communication scheme in which communication is performed via the server 20 .
  • the second communication scheme such as a BTLE standard. Therefore, a communication speed is not degraded unlike the third communication scheme in which communication is performed via the server 20 .
  • FIGS. 8A and 8B are sequence diagrams illustrating an example of a communication process in a case where the position determination unit 16 B determines that the position of the user is included in the third region.
  • Step S 31 When the information processing device 10 detects an abnormality, the information processing device 10 generates an abnormality detection signal (step S 31 ). Further, the information processing device 10 determines that the user of the vehicle is outside the vehicle cabin (step S 32 ). Steps S 31 and S 32 correspond to steps S 1 and S 2 in FIG. 6 . Therefore, detailed description will be omitted.
  • the information processing device 10 transmits the abnormality detection signal (step S 33 ).
  • the information processing device 10 transmits the abnormality detection signal to the second terminal device 50 via the server 20 using the third communication scheme.
  • the server 20 transfers the abnormality detection signal received from the information processing device 10 to the second terminal device 50 (step S 34 ).
  • the server 20 can specify the second terminal device 50 that is a transfer destination associated with the information processing device 10 based on the profile data stored in the server storage unit 22 .
  • the second terminal device 50 receives the abnormality detection signal (step S 35 ). In addition, the second terminal device 50 notifies the user of the abnormality (step S 36 ). Further, the second terminal device 50 detects an instruction of the user (step S 37 ). Steps S 35 , S 36 , and S 37 correspond to steps S 14 , S 15 , and S 16 in FIG. 7 . Therefore, detailed description will be omitted.
  • the second terminal device 50 transmits a user instruction signal indicating content of the instruction of the user (step S 38 ). In this case, the second terminal device 50 transmits the user instruction signal to the information processing device 10 via the server 20 using the third communication scheme.
  • the server 20 transfers the user instruction signal received from the second terminal device 50 to the information processing device 10 (step S 39 ).
  • the information processing device 10 receives the user instruction signal (step S 40 ). Further, the information processing device 10 gives instruction for a manipulation of the vehicle (step S 41 ). Further, the information processing device 10 performs normal detection (step S 42 ). Steps S 40 , S 41 , and S 42 correspond to steps S 18 , S 19 , and S 20 in FIG. 7 . Therefore, detailed description will be omitted.
  • the information processing device 10 transmits a normality detection signal (step S 43 ).
  • the information processing device 10 transmits the normality detection signal to the second terminal device 50 via the server 20 using the third communication scheme.
  • the server 20 transfers the normality detection signal received from the information processing device 10 to the second terminal device 50 (step S 44 ).
  • the second terminal device 50 receives the normality detection signal (step S 45 ). In addition, the second terminal device 50 sends a normality notification to the user (step S 46 ). Steps S 45 and S 46 correspond to steps S 22 and S 23 in FIG. 7 . Therefore, detailed description will be omitted.
  • the communication between the information processing device 10 and the second terminal device 50 is performed using the third communication scheme in which communication is performed via the server 20 . Therefore, the communication speed decreases.
  • the information processing device 10 can notify the user in the third region distant from the vehicle of the abnormality in the state of the vehicle.
  • FIG. 9 is a flowchart showing an operation (control method) of the information processing device 10 when the communication process is executed.
  • the controller 16 of the information processing device 10 detects an abnormality based on the vehicle information (step S 101 ).
  • the controller 16 of the information processing device 10 may acquire the vehicle information at predetermined intervals or in response to a predetermined event, and detect the abnormality.
  • step S 102 the controller 16 of the information processing device 10 ends the process because there is no need to notify the abnormality.
  • Step S 102 When the user is not inside the vehicle (No in Step S 102 ), the controller 16 of the information processing device 10 proceeds to a process of step S 103 .
  • the controller 16 of the information processing device 10 determines that the position of the user is included in the first region R 1 (Yes in step S 103 ), the controller 16 causes the first communication unit 14 A to transmit an abnormality detection signal to the first terminal device 40 (step S 104 ).
  • the first communication unit 14 A transmits an abnormality detection signal using the first communication scheme.
  • step S 105 the controller 16 of the information processing device 10 determines that the position of the user is not included in the first region R 1 (No in step S 103 ). the controller 16 proceeds to a process of step S 105 .
  • the controller 16 of the information processing device 10 determines that the position of the user is included in the second region R 2 that is away from the vehicle relative the first region R 1 (Yes in step S 105 )
  • the controller 16 of the information processing device 10 causes the second communication unit 14 B to transmit the abnormality detection signal to the second terminal device 50 (step S 109 ).
  • the second communication unit 14 B transmits the abnormality detection signal using the second communication scheme.
  • the controller 16 of the information processing device 10 instructs the ECU to manipulate the vehicle based on the user instruction signal received from the second terminal device 50 (step S 110 ).
  • the controller 16 of the information processing device 10 detects that the abnormality of the vehicle has been resolved based on the vehicle information, the controller 16 of the information processing device 10 causes the second communication unit 14 B to transmit the normality detection signal to the second terminal device 50 (step S 111 ).
  • the second communication unit 14 B transmits the normality detection signal using the second communication scheme.
  • the controller 16 of the information processing device 10 determines that the position of the user is included in neither the first region R 1 nor the second region R 2 (No in step S 105 ).
  • the controller 16 of the information processing device 10 causes the third communication unit 14 C to transmit the abnormality detection signal to the second terminal device 50 (step S 106 ).
  • the third communication unit 14 C transmits the abnormality detection signal using the third communication scheme.
  • the controller 16 of the information processing device 10 instructs the ECU to manipulate the vehicle based on the user instruction signal received from the second terminal device 50 (step S 107 ).
  • the controller 16 of the information processing device 10 When the controller 16 of the information processing device 10 has detected that the abnormality of the vehicle has been resolved based on the vehicle information, the controller 16 of the information processing device 10 causes the third communication unit 14 C to transmit the normality detection signal to the second terminal device 50 (step S 108 ).
  • the third communication unit 14 C transmits the normality detection signal using the third communication scheme.
  • FIG. 10 is a flowchart showing an operation (a control method) of the second terminal device 50 in a case where the communication process is executed.
  • the second terminal communication unit 51 of the second terminal device 50 receives the abnormality detection signal (step S 201 ).
  • the second terminal display unit 55 of the second terminal device 50 displays a pop-up screen for warning that there is an abnormality in the vehicle (step S 202 ).
  • the second terminal input unit 54 of the second terminal device 50 detects a predetermined manipulation of the user (step S 203 ) and notifies the second terminal controller 53 of the manipulation.
  • the second terminal input unit 54 for example, is integrated with the second terminal display unit 55 to constitute a touch panel display.
  • the predetermined manipulation of the user is, for example, a touch of the pop-up screen.
  • the second terminal controller 53 of the second terminal device 50 starts an application for communication with the information processing device 10 (step S 204 ). That is, the second terminal controller 53 operates the application for communication with the information processing device 10 in a foreground.
  • the application for communication with the information processing device 10 is installed in advance and stored in the second terminal storage unit 52 .
  • the second terminal display unit 55 of the second terminal device 50 displays the content of the abnormality based on the abnormality detection signal (step S 205 ).
  • the content of the abnormality is displayed in the message 551 in an application screen, for example.
  • the second terminal input unit 54 of the second terminal device 50 detects an instruction of the user (step S 206 ) and notifies the second terminal controller 53 of the instruction.
  • the instruction of the user is performed, for example, by touching the button 541 or the button 542 in the application screen.
  • the second terminal controller 53 generates a user instruction signal indicating the content of the instruction of the user.
  • the second terminal communication unit 51 of the second terminal device 50 transmits the user instruction signal to the information processing device 10 (step S 207 ).
  • the second terminal communication unit 51 of the second terminal device 50 receives the normality detection signal (step S 208 ).
  • the second terminal display unit 55 of the second terminal device 50 notifies the user of the normality based on the received normality detection signal (step S 209 ).
  • the information processing device 10 notifies the first terminal device 40 or the second terminal device 50 of the abnormality in the state of the vehicle according to the determined position of the user. Therefore, there is no annoyance of a double notification. Further, with the information processing device 10 according to the embodiment, when the position of the user is the first region R 1 in which the user can immediately return to the vehicle, a notification (for example, vibration) to the user is performed by the first terminal device 40 . Further, when the user is further away from the first region R 1 , the content of the abnormality is displayed on the second terminal device 50 . That is, with the information processing device 10 according to the embodiment, an appropriate warning can be made according to the position of the user.
  • a notification for example, vibration
  • the information processing device 10 transmits the abnormality detection signal to the first terminal device 40 or the second terminal device 50 according to the determined position of the user.
  • the information processing device 10 may further select the transmission destination according to the content of the abnormality.
  • FIG. 11 is a flowchart showing an operation of the information processing device 10 in a modification example in which a transmission destination is selected according to the content of abnormality.
  • step S 103 of the flowchart of FIG. 9 is changed to steps S 103 A and S 103 B. Therefore, description of steps other than steps S 103 A and S 103 B will be omitted.
  • step S 103 A when the controller 16 of the information processing device 10 determines that the position of the user is included in the first region R 1 (Yes in step S 103 A), the controller 16 proceeds to a process of step S 103 B.
  • step S 105 the controller 16 of the information processing device 10 executes the process of step S 105 in which the controller 16 determines whether the user is in the second region R 2 .
  • the controller 16 of the information processing device 10 causes the first communication unit 14 A to transmit the abnormality detection signal to the first terminal device 40 (step S 104 ).
  • the predetermined content is content of an abnormality that the user can remotely deal with using the first terminal device 40 .
  • the predetermined content is that the door is not locked.
  • the controller 16 of the information processing device 10 causes the second communication unit 14 B to transmit the abnormality detection signal to the second terminal device 50 (step S 109 ).
  • the user can remotely deal with abnormalities other than predetermined content.
  • the information processing device 10 enables the user to deal with the abnormality of the vehicle remotely through the above process. That is, the information processing device 10 according to the modification example enables the user to cope with the abnormality even when the user does not return to the vehicle.
  • the user can remotely manipulate the vehicle using the second terminal device 50 .
  • the remote manipulation may be executed solely while the user is executing the predetermined manipulation with respect to the second terminal device 50 , so that the remote manipulation can be executed more safely.
  • the predetermined manipulation is, for example, that the user touches a manipulation button displayed on the touch panel display. That is, when the user releases a finger or the like from the manipulation button, the remote manipulation may be immediately stopped.
  • the second terminal controller 53 of the second terminal device 50 continues to cause the second terminal communication unit 51 to transmit a user instruction signal.
  • the controller 16 of the information processing device 10 may acquire the user instruction signal via the communication unit 14 and stop giving instruction for the manipulation of the vehicle when the user instruction signal is not acquired.
  • the second terminal display unit 55 of the second terminal device 50 also displays the content of the abnormality based on the abnormality detection signal for the user in the third region.
  • the second terminal display unit 55 of the second terminal device 50 may display a message for prompting the user in the third region to return to the second region R 2 .
  • the user in the third region can perform remote manipulation using the second terminal device 50 .
  • the remote manipulation using the second terminal device 50 may be executable after the user returns to the second region R 2 in which the user can see and confirm the vehicle.
  • the second terminal display unit 55 of the second terminal device 50 may hide the button 541 or the button 542 for the user in the third region.
  • the controller 16 of the information processing device 10 detects an abnormality based on the vehicle information before a determination as to whether or not the user is outside the vehicle cabin.
  • the controller 16 of the information processing device 10 may perform abnormality detection after determining that the user is outside the vehicle cabin.
  • the position determination unit 16 B determines the position of the user based on the communication state of the first communication unit 14 A and the second communication unit 14 B.
  • the position determination unit 16 B may determine the position of the user based on the communication state of the first communication unit 14 A or the second communication unit 14 B.
  • the position determination unit 16 B may determine that the user is in the first region R 1 when an intensity of a received signal of the second communication unit 14 B is higher than a first threshold value (for example, 80% of a maximum intensity).
  • a first threshold value for example, 80% of a maximum intensity
  • the position determination unit 16 B may determine that the user is in the third region.
  • the position determination unit 16 B may determine that the user is in the second region R 2 , for example, when the intensity of the received signal of the second communication unit 14 B is lower than the first threshold value and is higher than the second threshold value.
  • the information processing device 10 may include a communication state determination unit instead of the position determination unit 16 B. That is, the information processing device 10 may switch between the communication schemes based on at least one of the communication states of the first communication unit 14 A and the second communication unit 14 B without clearly determining the position of the user.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Chemical & Material Sciences (AREA)
  • Emergency Management (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Alarm Systems (AREA)
  • Selective Calling Equipment (AREA)
  • Emergency Alarm Devices (AREA)
  • Telephonic Communication Services (AREA)
  • Lock And Its Accessories (AREA)
US16/292,251 2018-03-19 2019-03-04 Information processing device, method of controlling terminal device, and non-transitory computer-readable recording medium Active US10647253B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018050781A JP6977638B2 (ja) 2018-03-19 2018-03-19 情報処理装置、制御方法およびプログラム
JP2018-050781 2018-03-19

Publications (2)

Publication Number Publication Date
US20190283668A1 US20190283668A1 (en) 2019-09-19
US10647253B2 true US10647253B2 (en) 2020-05-12

Family

ID=67903529

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/292,251 Active US10647253B2 (en) 2018-03-19 2019-03-04 Information processing device, method of controlling terminal device, and non-transitory computer-readable recording medium

Country Status (3)

Country Link
US (1) US10647253B2 (zh)
JP (1) JP6977638B2 (zh)
CN (1) CN110288800B (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2021160554A (ja) * 2020-03-31 2021-10-11 パイオニア株式会社 情報処理装置
CN114627627B (zh) * 2020-12-14 2024-07-09 深圳Tcl新技术有限公司 设备异常处理方法、装置、终端及计算机可读存储介质
US20220375291A1 (en) * 2021-05-20 2022-11-24 Sera4 Ltd. Secure locking of keyless lock controllers

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6263333B1 (en) * 1998-10-22 2001-07-17 International Business Machines Corporation Method for searching non-tokenized text and tokenized text for matches against a keyword data structure
US20050184862A1 (en) 2004-02-25 2005-08-25 Asako Nagata Operational omission alarm system and apparatus for vehicle
JP2010159615A (ja) 2008-12-09 2010-07-22 Tokai Rika Co Ltd 操作忘れ防止システム
US20110074565A1 (en) * 2009-09-28 2011-03-31 Ford Global Technologies, Llc Method and apparatus for in-vehicle presence detection and driver alerting
US20120050021A1 (en) * 2010-08-27 2012-03-01 Ford Global Technologies, Llc Method and Apparatus for In-Vehicle Presence Detection and Driver Alerting
JP2014125779A (ja) 2012-12-26 2014-07-07 Denso Corp 車両ドア制御システム
US20150048927A1 (en) * 2013-08-13 2015-02-19 Directed, Llc Smartphone based passive keyless entry system
US9731652B2 (en) * 2014-12-05 2017-08-15 Honda Motor Co., Ltd. Alert system for user of vehicle
US20170282791A1 (en) * 2016-03-29 2017-10-05 Jorja Voorhies Smart Seat

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004102939A (ja) * 2002-09-12 2004-04-02 Denso Corp 駐車状態監視装置及び駐車状態監視システム
JP2004142543A (ja) * 2002-10-23 2004-05-20 Fuji Photo Film Co Ltd 自動車異常通知装置
US9070276B2 (en) * 2012-07-03 2015-06-30 Ford Global Technologies, Llc Method and apparatus for detecting a left-behind phone
CN104899942A (zh) * 2014-03-05 2015-09-09 厦门歌乐电子企业有限公司 一种自动门锁的控制装置
JP6482147B2 (ja) * 2015-10-21 2019-03-13 本田技研工業株式会社 報知システム

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6263333B1 (en) * 1998-10-22 2001-07-17 International Business Machines Corporation Method for searching non-tokenized text and tokenized text for matches against a keyword data structure
US20050184862A1 (en) 2004-02-25 2005-08-25 Asako Nagata Operational omission alarm system and apparatus for vehicle
JP2005240349A (ja) 2004-02-25 2005-09-08 Denso Corp 車両操作忘れ通知システムおよび車載通知装置
JP2010159615A (ja) 2008-12-09 2010-07-22 Tokai Rika Co Ltd 操作忘れ防止システム
US20110074565A1 (en) * 2009-09-28 2011-03-31 Ford Global Technologies, Llc Method and apparatus for in-vehicle presence detection and driver alerting
US20120050021A1 (en) * 2010-08-27 2012-03-01 Ford Global Technologies, Llc Method and Apparatus for In-Vehicle Presence Detection and Driver Alerting
JP2014125779A (ja) 2012-12-26 2014-07-07 Denso Corp 車両ドア制御システム
US20150048927A1 (en) * 2013-08-13 2015-02-19 Directed, Llc Smartphone based passive keyless entry system
US9731652B2 (en) * 2014-12-05 2017-08-15 Honda Motor Co., Ltd. Alert system for user of vehicle
US20170282791A1 (en) * 2016-03-29 2017-10-05 Jorja Voorhies Smart Seat

Also Published As

Publication number Publication date
JP2019165293A (ja) 2019-09-26
JP6977638B2 (ja) 2021-12-08
US20190283668A1 (en) 2019-09-19
CN110288800A (zh) 2019-09-27
CN110288800B (zh) 2021-03-19

Similar Documents

Publication Publication Date Title
JP6482147B2 (ja) 報知システム
EP2597838B1 (en) Mobile terminal and image display apparatus mounted in a car
CN105278677B (zh) 与可穿戴装置通信的车辆计算系统
JP6372688B2 (ja) 車両用通信システム
US10647253B2 (en) Information processing device, method of controlling terminal device, and non-transitory computer-readable recording medium
JP6101244B2 (ja) 報知システム
US20150287257A1 (en) Electronic key fob with bluetooth and radio frequency transceivers
US20150249908A1 (en) Method and Apparatus for Detecting a Left-Behind Phone
US10414376B1 (en) Systems and methods for vehicle lock/unlock alerts
US10913352B2 (en) Method, computer program and device for the remote control of a transportation vehicle via a mobile device
JP2005240349A (ja) 車両操作忘れ通知システムおよび車載通知装置
US9120437B2 (en) Vehicle component control
US20160048249A1 (en) Wearable computing device for handsfree controlling of vehicle components and method therefor
JP6056461B2 (ja) 車両ドア制御システム
JP6536787B2 (ja) 車両用制御システム
JP5811935B2 (ja) 車両用通信システム、車両用通信装置及び携帯通信端末
US11999294B2 (en) Vehicle and control method thereof
CN114900380B (zh) 信息处理装置、信息处理方法和记录介质
US20220258574A1 (en) Information processing device, information processing method, and system
CN111674344B (zh) 检测仅充电连接的方法、移动计算设备及存储介质
CN113013966B (zh) 无线充电装置及其警示信号产生方法
US20160028867A1 (en) Method and apparatus for controlling outgoing call during phone book information download
JP2006037410A (ja) 遠隔操作システム
JP2016108768A (ja) 車両制御システム
WO2023181459A1 (ja) 電子キーシステム及び移動体の制御装置

Legal Events

Date Code Title Description
AS Assignment

Owner name: TOYOTA JIDOSHA KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SASAKI, AKIRA;NAKAGAWA, MASASHI;REEL/FRAME:048500/0096

Effective date: 20190129

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4