WO2023210433A1 - 異常検出システム及び異常検出方法 - Google Patents

異常検出システム及び異常検出方法 Download PDF

Info

Publication number
WO2023210433A1
WO2023210433A1 PCT/JP2023/015378 JP2023015378W WO2023210433A1 WO 2023210433 A1 WO2023210433 A1 WO 2023210433A1 JP 2023015378 W JP2023015378 W JP 2023015378W WO 2023210433 A1 WO2023210433 A1 WO 2023210433A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
abnormality
image data
cloud
detection system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2023/015378
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
真啓 小川
邦彦 林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Denso Corp
Original Assignee
Denso Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Denso Corp filed Critical Denso Corp
Priority to JP2024517217A priority Critical patent/JP7704300B2/ja
Priority to DE112023002034.5T priority patent/DE112023002034T5/de
Priority to CN202380036197.1A priority patent/CN119110969A/zh
Publication of WO2023210433A1 publication Critical patent/WO2023210433A1/ja
Priority to US18/908,165 priority patent/US20250029473A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18—Status alarms
    • G08B21/24—Reminder alarms, e.g. anti-loss alarms
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/29—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area inside the vehicle, e.g. for viewing passengers or cargo
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/141—Control of illumination
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30268—Vehicle interior

Definitions

  • the present disclosure relates to a technology for detecting an abnormality such as dirt on a seat or the like in a vehicle interior.
  • one aspect of the present disclosure provides a technology that is preferable for businesses and users when communicating between a vehicle and a cloud to perform processing regarding an abnormality such as dirt in a vehicle interior.
  • An abnormality detection system (1) includes a cloud (5) that collects data on a vehicle (9), and an on-vehicle device (3) communicably connected to the cloud, This is an abnormality detection system that detects abnormalities within the vehicle interior.
  • This abnormality detection system includes a plurality of applications each configured to detect a target abnormality based on image data from a camera (25) that photographs the interior of the vehicle.
  • the in-vehicle device includes a detection unit (41) and a transmission unit (43).
  • the detection unit is configured to analyze image data and detect an abnormality when each of the plurality of applications is executed.
  • the transmission unit is configured to transmit to the cloud the analysis results analyzed by the detection unit and at least the image data used when an abnormality is detected.
  • the cloud includes a storage unit (61).
  • the storage unit is configured to store the analysis results and image data transmitted from the transmission unit.
  • the abnormality detection system is configured to notify the analysis results to the notification target from at least one of the on-vehicle device and the cloud.
  • the abnormality detection system of one aspect of the present disclosure can be used in a car sharing business, for example, when communicating between a vehicle and the cloud to perform processing related to an abnormality such as dirt inside the vehicle. Therefore, it is possible to provide technology that is preferable (for example, highly convenient) for people who use cars and vehicles.
  • the in-vehicle device analyzes image data to detect an anomaly when each of a plurality of applications is executed, and the analysis results obtained by the detection unit are analyzed. and at least the image data used when an abnormality is detected (that is, predetermined image data) are transmitted to the cloud.
  • the cloud stores the analysis results and predetermined image data transmitted from the transmission unit. Then, the analysis results are reported from the in-vehicle device or the cloud to broadcast targets such as businesses and users.
  • the abnormality detection system can detect abnormalities such as dirt based on image data taken of the interior of the vehicle. Further, by transmitting analysis results such as abnormality detection results and predetermined image data to the cloud, the analysis results and image data can be stored in the cloud.
  • analysis results and image data (for example, image data that is the basis for an abnormality) can be reliably saved, so that the basis for taking measures based on the analysis results at a later date is ensured. Further, since the analysis results are notified to business operators and users, the business operators and users who receive the notification can take appropriate measures according to the content of the notification.
  • An abnormality detection system (1) includes a cloud (5) that collects data of a vehicle (9), and an in-vehicle device (3) communicably connected to the cloud. This is an abnormality detection system that detects abnormalities within the vehicle interior.
  • This abnormality detection system includes a first application and a second application each configured to detect a desired abnormality based on image data from a camera that photographs the interior of the vehicle.
  • the abnormality detected by the first application has a higher degree of urgency than the abnormality detected by the second application.
  • the in-vehicle device includes a first detection unit (121), a first transmission unit (123), and a second transmission unit (125).
  • the first detection unit is configured to analyze image data and detect abnormalities when implementing the first application.
  • the first transmission unit is configured to transmit the analysis results analyzed by the first detection unit to the cloud, and also transmit at least the image data used when an abnormality is detected to the cloud. .
  • the second sending unit is configured to send the image data to the cloud when implementing the second application.
  • the cloud includes a first storage unit (131), a second detection unit (133), and a second storage unit (135).
  • the first storage unit is configured to store the analysis results and image data transmitted from the first transmission unit when implementing the first application.
  • the second detection unit is configured to analyze the image data transmitted from the second transmission unit and detect an abnormality when implementing the second application.
  • the second storage unit is configured to store the image data transmitted from the second transmission unit and the analysis results analyzed by the second detection unit.
  • the abnormality detection system is configured to notify the analysis results to the notification target from at least one of the on-vehicle device and the cloud.
  • the abnormality detection system can perform communication between the vehicle and the cloud to perform processing related to abnormalities such as dirt in the vehicle interior, for example, when performing car sharing. It is possible to provide technology that is preferable to business operators who operate the vehicle and users who use the vehicle.
  • An abnormality detection system includes a cloud (5) that collects data of a vehicle (9), and a relay device that is communicably connected to the cloud and that relays frames flowing to the vehicle network.
  • This is an abnormality detection system (1) that detects an abnormality in a vehicle interior, and includes an in-vehicle device (3) that is communicatively connected to an in-vehicle device (23).
  • the in-vehicle device includes an in-vehicle communication unit (45), a detection unit (41), and a transmission unit (43).
  • the in-vehicle communication unit is configured to communicate with an electronic control device (32, 36) connected to the vehicle network via a relay device.
  • the detection unit is configured to detect an abnormality by analyzing image data from a camera (25) that photographs the interior of the vehicle.
  • the transmission unit is configured to transmit the analysis result analyzed by the detection unit to the cloud, and also transmit at least the image data used when an abnormality is detected to the cloud.
  • the in-vehicle device is configured to notify the outside of the vehicle of the analysis results analyzed by the detection unit.
  • the abnormality detection system of one aspect of the present disclosure can be used in a car sharing business, for example, when communicating between a vehicle and the cloud to perform processing related to an abnormality such as dirt inside the vehicle. Therefore, it is possible to provide technology that is preferable (for example, highly convenient) for people who use cars and vehicles.
  • An abnormality detection method enables communication between an on-vehicle device (3) mounted on a vehicle (9) and a cloud (5), and detects an abnormality in a vehicle interior. This is an anomaly detection method.
  • This abnormality detection method uses a plurality of applications each configured to detect a desired abnormality based on image data from a camera (25) that photographs the interior of the vehicle.
  • the in-vehicle device analyzes the image data for each to detect anomalies, sends the analyzed results to the cloud, and at least uses the system when an anomaly is detected. Send image data to the cloud.
  • the cloud stores the transmitted analysis results and image data.
  • the analysis results are notified to the notification target from at least one of the in-vehicle device and the cloud.
  • the abnormality detection method of one aspect of the present disclosure can be used in a car sharing business, for example, when communication is performed between a vehicle and the cloud to perform processing related to an abnormality such as dirt in the vehicle interior. It is possible to provide technology that is favorable for people who use cars and vehicles.
  • An abnormality detection method is such that communication is possible between an in-vehicle device (3) mounted on a vehicle (9) and a cloud (5), and the abnormality detection method is configured to detect an abnormality in a vehicle interior. This is an anomaly detection method.
  • This abnormality detection method uses a first application and a second application that are configured to detect a target abnormality, respectively, based on image data from a camera (25) that photographs the interior of the vehicle.
  • the abnormality detected by the second application has a higher degree of urgency than the abnormality detected by the second application.
  • the in-vehicle device analyzes the image data to detect an abnormality, sends the analyzed analysis results to the cloud, and at least transmits the image data used when an abnormality is detected. to the cloud.
  • image data is sent to the cloud.
  • the cloud stores the transmitted analysis results and image data when implementing the first application.
  • the transmitted image data is analyzed to detect an abnormality, and the transmitted image data and the analyzed analysis result are stored.
  • the analysis results are reported to the notification target from at least one of the in-vehicle device and the cloud.
  • the abnormality detection method enables communication between the vehicle and the cloud to perform processing related to an abnormality such as dirt in the vehicle interior, for example, when car sharing is performed. It is possible to provide technology that is preferable to business operators who operate the vehicle and users who use the vehicle.
  • An abnormality detection method includes a cloud (5) that collects data on a vehicle (9), and a cloud (5) that is communicably connected to the cloud and that transmits frames flowing to the network of the vehicle.
  • This is an abnormality detection method that detects an abnormality in the vehicle interior using a relay device (23) that relays and an in-vehicle device (3) that is communicably connected.
  • the in-vehicle device communicates with the electronic control device (32, 36) connected to the vehicle's network via the relay device, and receives image data from the camera (25) that captures the interior of the vehicle. Anomalies are detected through analysis, and the analyzed analysis results are sent to the cloud, and at least the image data used when an anomaly is detected is sent to the cloud. Furthermore, this cloud broadcasts the transmitted analysis results to the broadcast target.
  • the abnormality detection method enables communication between the vehicle and the cloud to perform processing related to an abnormality such as dirt in the vehicle interior, for example, when car sharing is performed. It is possible to provide technology that is preferable to business operators who operate the vehicle and users who use the vehicle.
  • FIG. 1 is an explanatory diagram showing the overall configuration of an abnormality detection system according to a first embodiment.
  • FIG. 2 is a block diagram showing a hardware configuration installed in the vehicle of the first embodiment.
  • FIG. 2 is an explanatory diagram showing how to use the abnormality detection system of the first embodiment.
  • FIG. 2 is a block diagram functionally showing a control unit of the in-vehicle device according to the first embodiment.
  • FIG. 2 is a block diagram functionally showing a control unit of the cloud according to the first embodiment. It is a flowchart which shows dirt detection processing of a 1st embodiment. It is a flowchart which shows the forgotten item detection process of 1st Embodiment.
  • FIG. 7 is a block diagram functionally showing a control unit of the in-vehicle device according to the second embodiment.
  • FIG. 2 is a block diagram functionally showing a cloud control unit according to a second embodiment. It is a flowchart which shows living body detection processing of a 2nd embodiment. It is a flow chart which shows dirt detection processing of a 2nd embodiment.
  • an abnormality detection system that detects an abnormality such as dirt inside a vehicle (for example, an automobile) will be described as an example of a mobility IoT system.
  • IoT is an abbreviation for Internet of Things.
  • the abnormality detection system 1 includes an in-vehicle device 3, a cloud 5, and a service providing server 7. Note that a server that manages the operations of the cloud 5 is referred to as a management server.
  • the abnormality detection system 1 may include a plurality of in-vehicle devices 3, for example, and the plurality of in-vehicle devices 3 may each be connected to a different vehicle 9. It may be installed on.
  • the in-vehicle device 3 is capable of wireless communication with the cloud 5 and the mobile terminal 15 via the communication device 11 mounted on the vehicle 9. Note that detailed configurations of the in-vehicle device 3 and the vehicle 9 will be described later.
  • the cloud 5 can communicate with the in-vehicle device 3 , the service providing server 7 , and the mobile terminal 15 via the communication unit 13 .
  • the communication unit 13 can communicate wirelessly with the in-vehicle device 3 and the mobile terminal 15.
  • the cloud 5 can collect data on the vehicle 9 from the in-vehicle device 3 via the communication device 11 and the communication unit 13. Note that the detailed configuration of the cloud 5 will be described later.
  • the service providing server 7 can communicate with the cloud 5.
  • the service providing server 7 is, for example, a server installed to provide a service for managing the operation of the vehicle 9.
  • the abnormality detection system 1 may include a plurality of service providing servers 7 with mutually different service contents.
  • the mobile terminal 15 is, for example, a mobile terminal (that is, an information terminal) owned by a car sharing operator.
  • Examples of the mobile terminal 15 include a smartphone, a tablet terminal, and a notebook PC. Note that in addition to the mobile terminal 15, a desktop type computer may be used.
  • the vehicle 9 includes, in addition to the on-vehicle device 3, a sensor 21, a vehicle ECU 23, a camera 25, a lighting device 27, a communication device 11, and an alert device 29.
  • the sensor 21 is a detection device that detects the state of the vehicle 9.
  • This sensor 21 includes, for example, turning the engine on or off, starting or stopping the vehicle, vehicle speed, shift position, whether the seat 40 (for example, see FIG. 3) is seated, opening or closing the door, locking the door (i.e., locking the door ), various sensors that detect states such as unlocking (that is, unlocking).
  • the vehicle ECU 23 is an electronic control unit (ie, ECU) connected to the sensor 21. This vehicle ECU 23 receives signals from the sensor 21 and processes the signals as necessary. Further, the vehicle ECU 23 transmits a signal (ie, information) obtained from the sensor 21 to the vehicle-mounted device 3 via a communication line.
  • ECU electronice control unit
  • the camera 25 is one or more in-vehicle cameras placed in the vehicle interior to photograph the interior of the vehicle, and for example, an infrared camera is used.
  • an infrared camera is used.
  • a digital camera such as a CCD camera may also be used.
  • a color image can be used as the image to be photographed.
  • the camera 25 may be installed at the top of the windshield, near the room mirror, or on the ceiling.
  • the photographing range of the camera 25 is set to include an area within the vehicle interior where an object or the like is likely to be placed and an area where dirt is likely to adhere.
  • the photographing range of the camera 25 includes, for example, the driver's seat, passenger seat, and rear seat 40 (e.g., the seat surface and backrest portion of the seat 40), the dashboard, the inside surface of the door, etc. , is set to include some or all of the information.
  • a plurality of cameras 25 may be arranged so that a three-dimensional object can be detected and the object to be photographed can be photographed from different angles.
  • the illumination device 27 is a light that is turned on to illuminate the interior of the vehicle when the camera 25 photographs the interior of the vehicle, and for example, a light that emits infrared rays, an LED light, or the like can be used.
  • the communication device 11 is a communication device capable of wireless communication with the communication unit 13 of the cloud 5 and the mobile terminals 15 and 16. This communication device 11 transmits image data, analysis results of the image data, etc. from the vehicle 9 to the cloud 5. Note that, as will be described later, the in-vehicle device 3 can be controlled by signals from the mobile terminal 15.
  • the alert device 29 is a device that issues a warning to the user of the vehicle 9 using an electronic sound, voice, or the like.
  • a speaker or the like can be adopted.
  • the vehicle ECU 23 includes a CPU 24 and a memory 26 such as a ROM 26a and a RAM 26b as a configuration for performing various calculation processes.
  • the vehicle ECU 23 is connected to a plurality of ECUs 32 and an external communication device 34 that communicates with the outside of the vehicle via an in-vehicle communication network 30 that performs communication within the vehicle. Further, each ECU 32 is communicably connected to each other ECU 36.
  • each ECU 32 is provided for each domain divided by function in the vehicle 9, for example, and can mainly control a plurality of ECUs 36 existing within that domain. Examples of domains include powertrain, body, chassis, and cockpit. Note that the ECU 36 is, for example, an ECU that controls sensors and actuators.
  • the network within the vehicle 9 transmits and receives frames containing various information between each component within the vehicle 9 (for example, the on-vehicle device 3, the ECU 23, 32, 36, the external communication device 34, etc.). used for. Examples of this network include the in-vehicle communication network 30 and the like. Furthermore, the on-vehicle device 3 is connected to a vehicle battery 50 and shares a power source with other electrical components within the vehicle 9.
  • the in-vehicle device 3 includes a control section 31 and a storage section 33.
  • the control unit 31 includes a CPU 35 and a semiconductor memory (hereinafter referred to as a memory 37) such as a RAM or a ROM. Note that the control unit 31 is configured by, for example, a microcomputer or the like.
  • control unit 31 The functions of the control unit 31 are realized by the CPU 35 executing a program stored in a non-transitional physical recording medium (ie, the memory 37). Also, by executing this program, a method corresponding to the program is executed.
  • control unit 31 is not limited to software, and some or all of the elements may be realized using one or more pieces of hardware.
  • the electronic circuit may be realized by a digital circuit including a large number of logic circuits, an analog circuit, or a combination thereof.
  • the memory 37 includes a plurality of applications (i.e., programs) each configured to detect a target abnormality based on the image data from the camera 25 that captures the interior of the vehicle 9. ) are stored.
  • applications i.e., programs
  • a program for detecting dirt on the sheet 40 a program for detecting items left on the sheet 40, etc. are stored.
  • the storage unit 33 is a storage that can store information.
  • This storage unit 33 can store, for example, information on images taken by the camera 25 (ie, image data). Further, the results of analyzing the image (ie, the analysis results) can be stored.
  • examples of the storage unit 33 include a hard disk drive (namely, HDD) and a solid disk drive (namely, SSD).
  • control unit 31 of the vehicle 9 functionally includes a detection unit 41, a transmission unit 43, and an in-vehicle communication unit 45.
  • the detection unit 41 acquires and analyzes image data (i.e., image data of a before image and a after image, which will be described later) taken by the camera 25. , is configured to detect abnormalities in the vehicle interior, such as dirt on the seat 40 and items left behind.
  • the transmitting unit 43 sends an analysis result that is an abnormality detection result (for example, an analysis result indicating that an abnormality has been detected) and at least image data used when the abnormality was detected (for example, a previous image and a subsequent image).
  • the communication device 11 is configured to drive the communication device 11 to transmit the image data (image data of the image) to the cloud 5.
  • the in-vehicle communication unit 45 is configured to communicate with the vehicle ECU 23 and with other ECUs 32 and 36 via the vehicle ECU 23.
  • the cloud 5 includes a control section 51, a communication section 13, and a storage section 53.
  • the control unit 51 includes a CPU 55 and a semiconductor memory such as a RAM or a ROM (hereinafter referred to as a memory 57 which is a non-transitional physical recording medium).
  • the configuration and functions of the control unit 51 are basically the same as those of the control unit 31 of the vehicle 9, and are realized by the CPU 55 executing a program stored in the memory 57. Also, by executing this program, a method corresponding to the program is executed.
  • the communication unit 13 can perform wireless communication with the communication device 11 and the mobile terminal 15.
  • the cloud 5 can receive analysis results and image data transmitted from the vehicle 9 via the communication device 11 and the communication unit 13.
  • the storage unit 53 is a storage that stores the same information as the storage unit 33 of the vehicle 9, and can store analysis results and image data received from the vehicle 9.
  • the cloud 5 configured as described above can collect data on the vehicle 9 transmitted from each of the plurality of in-vehicle devices 3 via the communication device 11. Furthermore, the cloud 5 can store the collected data in the storage unit 53 for each vehicle 9.
  • the cloud 5 creates a digital twin based on the data of the vehicle 9 stored in the storage unit 53.
  • a digital twin is normalized index data.
  • the service providing server 7 can acquire the data of the predetermined vehicle stored in the storage unit 53 using the index data acquired from the digital twin.
  • the service providing server 7 determines the control details for the vehicle 9 and transmits instructions corresponding to the control details to the cloud 5.
  • the cloud 5 transmits control details to the vehicle 9 based on the instructions.
  • control section 51 ⁇ Functional configuration of control unit>
  • the functional configuration of the control section 51 will be explained.
  • control unit 51 of the cloud 5 functionally includes a storage unit 61.
  • the storage unit 61 is configured to store the analysis results and image data transmitted from the communication device 11 of the vehicle 9 in, for example, the storage section 53.
  • the analysis results stored in the storage unit 53 are notified from the cloud 5 to the mobile terminal 15 of the operator via the communication unit 13, but are also notified to the mobile terminal 16 of the user. Good too.
  • a user who uses the vehicle 9 through car sharing usually registers and obtains an IC card (not shown) to be used when using the vehicle 9.
  • the interior of the vehicle can be photographed by the camera 25 (that is, the previous image can be acquired).
  • the user opens the door, gets into the vehicle, and obtains a key (not shown) for the vehicle 9 stored in, for example, a glove box inside the vehicle.
  • a key for the vehicle 9 stored in, for example, a glove box inside the vehicle.
  • input that the vehicle 9 is in use is input using a switch or the like.
  • the engine of the vehicle 9 is started and the vehicle 9 is started.
  • the interior of the vehicle can be photographed by the camera 25 (that is, a subsequent image can be acquired).
  • ⁇ Other methods of determining before boarding and after disembarking> As a method for determining whether before getting on the vehicle (that is, before using the vehicle) and after getting off the vehicle (that is, after using the vehicle), there may be a method that uses an IC card to unlock or lock the door, as described above. In other words, one possible method is to unlock the door with the IC card before getting on the vehicle, and lock the door with the IC card after getting off the vehicle.
  • a front image can be obtained by photographing the inside of the vehicle before getting on the vehicle
  • a after image can be obtained by photographing the inside of the vehicle after getting off the vehicle.
  • the door when the door is opened and closed (that is, when the door is opened and then closed) and no one is inside the vehicle, it may be determined that the vehicle has exited the vehicle. Note that when the door is opened or closed and there is a person inside the vehicle, it may be determined that the vehicle is in the vehicle.
  • the vehicle may be determined that the vehicle has not yet entered the vehicle. Further, for example, if the door is locked after the seating sensor detects that the vehicle has changed from the seated state to the non-seated state, it may be determined that the vehicle has exited the vehicle.
  • a predetermined time before the user starts using the vehicle for example, the interior of the vehicle is automatically photographed by a control signal from the cloud 5 to obtain a previous image. You may also do so.
  • the in-vehicle device 3 is not powered until at least it acquires the front image and the rear image, detects an abnormality, and sends the analysis results and image data to the cloud 5. and is ready for operation.
  • the results of this analysis include cases where an abnormality is detected (i.e., abnormal case) and cases where no abnormality is detected (i.e., normal case). It is desirable to send the results to the cloud 5. Note that only in the case of an abnormality, a message indicating that an abnormality has been detected may be sent to the cloud 5.
  • the second embodiment is also the same as to whether to transmit the analysis results and image data only when there is an abnormality, or whether to transmit the analysis results and image data regardless of whether there is an abnormality or normality.
  • the analysis results for example, presence of dirt or left behind items
  • image data sent from the vehicle 9 are stored in the storage unit 53.
  • the analysis result is sent to the mobile terminal 15 of the operator. Note that even if no abnormality is detected, the analysis result may be transmitted to the mobile terminal 15.
  • the analysis results may be sent to the user's mobile terminal 16, for example, if there is something left behind.
  • an alert device 29 such as a speaker may be used to notify the user that something has been left behind.
  • one application i.e. dirt detection application
  • another application i.e. , an application for detecting left behind items
  • a dirt detection application and a forgotten item detection application are used to compare a front image taken before getting on the train and a after image taken after getting off the car, and to determine the difference between the before image and the after image. , for example, to detect dirt on the sheet 40 or abnormalities in left behind items.
  • the difference between the before image and the after image is taken (that is, a difference image is obtained), and an abnormality is detected based on the difference.
  • the brightness between the previous image and the subsequent image is adjusted so that the difference can be detected accurately.
  • the two images to be compared are adjusted to a constant gamma value (i.e. adjusted to have the same brightness value). ). Thereby, the accuracy of foreign object detection can be improved.
  • a difference image corresponding to the dirt (that is, an image including a difference area corresponding to the dirt) can be obtained between the before image and the after image taken with the infrared camera. It will be done. In this way, when a difference image is obtained from the previous image and the subsequent image, it can be determined that the sheet 40 is contaminated. In other words, if there is a difference between the previous image and the subsequent image (that is, if there is a difference area), it can be determined that there is an abnormality such as dirt.
  • dirt, forgotten items, etc. may be detected by applying information obtained by well-known machine learning to the photographed image.
  • control processing includes processing performed by the control unit 31 of the vehicle 9 and processing performed by the control unit 51 of the cloud 5.
  • This stain detection process is a process performed in a stain detection application.
  • a camera 25 for example, an infrared camera
  • photographs the interior of the vehicle to obtain an image of the interior of the vehicle (i.e., a previous image).
  • a camera 25 for example, an infrared camera
  • the lighting device 27 is turned on to illuminate the interior of the vehicle.
  • S110 it is determined whether there is an instruction from the operator's mobile terminal 15 to photograph the interior of the vehicle before boarding. If an affirmative determination is made here, the process returns to S100 to photograph the interior of the vehicle before getting into the vehicle, whereas if a negative determination is made, the process proceeds to S120. Note that when returning to S100, if a previous image has already been acquired, two previous images captured at different times are acquired, but either image may be used as the previous image.
  • S120 it is determined whether there is an instruction from the operator's mobile terminal 15 to photograph the interior of the vehicle after boarding. If an affirmative determination is made here, the process proceeds to S160, whereas if a negative determination is made, the process proceeds to S130.
  • S130 it is determined whether the door of the vehicle 9 has been opened or closed based on a signal from a sensor such as a door switch.
  • a sensor such as a door switch.
  • a person is extracted (that is, a person is detected) inside the vehicle.
  • a person is extracted by photographing the interior of the vehicle with the camera 25 and analyzing the image data (that is, well-known image recognition).
  • the person may be extracted using a well-known seating sensor that detects when a person is seated on the seat 40, a temperature sensor that detects the body temperature of the person, or the like.
  • S150 it is determined whether or not there is a person inside the vehicle according to the result of the person extraction process in S140. If an affirmative determination is made here, the process returns to S110, whereas if a negative determination is made, the process proceeds to S160. Note that when returning to S110, the process waits until the door is opened and closed again.
  • the stain detection result (that is, the analysis result) is sent to the cloud 5.
  • the analysis result may be sent only when there is dirt, but the analysis result may be sent even when there is no dirt.
  • the analysis result for example, if there is dirt, image data of the previous image and the subsequent image used to detect the dirt are transmitted to the cloud 5. Further, the analysis results and image data are stored in the storage unit 53.
  • the result of the dirt detection in S170 may be notified to the operator's mobile terminal 15 and the user's mobile terminal 16 before the processing in S180. You may also do so. In that case, the determination in S190 and the notification in S195 can be omitted.
  • This lost item detection process is a process performed in an application for detecting left behind items.
  • left behind item detection is performed using the before and after images used in the stain detection process. Note that in this lost item detection process as well, a process of acquiring a front image and a back image by photographing may be performed, similar to the stain detection process.
  • an image taken by the camera 25 such as an infrared camera can be used.
  • a three-dimensional object i.e., a forgotten item
  • the lost item detection results (i.e., analysis results) are sent to the cloud 5.
  • the analysis result may be transmitted only when there is something left behind, but the analysis result may be transmitted even when there is no forgotten item.
  • image data of the previous image and the subsequent image used for detecting the forgotten item is transmitted to the cloud 5. Note that the analysis results and image data are stored in the storage unit 53.
  • the results of the lost item detection in S210 are sent to the operator's mobile terminal 15 or the user's mobile terminal 16 before the processing in S220. You may also make a notification. In that case, the determination in S230 and the notification in S240 can be omitted.
  • the operation (i.e., activation) of the on-vehicle device 3 ends. That is, the vehicle enters a power-off state in which the supply of power from the vehicle battery 50 is cut off.
  • the dirt detection or lost item detection applications described above are running, there will be no progress until the processing of each application is completed (that is, until each step in the flowchart of FIG. 6 or 7 comes to an end).
  • the in-vehicle device 3 is kept activated to execute processing. Then, when the processing is completed to the end of each flowchart, the power is turned off. Note that when executing both applications, the power is turned off after the processing is completed up to the end of both flowcharts.
  • the in-vehicle device 3 analyzes image data to detect an abnormality, and compares the analysis result obtained by the detection unit 41 with at least when an abnormality is detected.
  • the used image data (that is, predetermined image data) is transmitted to the cloud 5.
  • the cloud 5 stores the analysis results and predetermined image data transmitted from the transmission unit 43. Then, the analysis results are notified to business operators and users from the in-vehicle device 3 and the cloud 5.
  • the in-vehicle device 3 can detect abnormalities such as dirt based on image data taken of the interior of the vehicle 9. Further, by transmitting analysis results such as abnormality detection results and predetermined image data to the cloud 5, the analysis results and image data can be stored in the cloud 5.
  • analysis results and image data (for example, image data that is the basis for an abnormality) can be reliably saved, so that the basis for taking measures based on the analysis results at a later date is ensured. Further, since the analysis results are notified to business operators and users, the business operators and users who receive the notification can take appropriate measures according to the content of the notification. Note that by detecting an abnormality using the in-vehicle device 3, there is an advantage that the occurrence of an abnormality can be promptly notified to the user, if necessary.
  • an infrared camera can be used as the camera 25, so abnormalities in the sheet 40 and the like can be easily detected from images taken by the infrared camera.
  • the image data of the previous image taken by the camera 25 of the interior of the vehicle 9 before the user boarded the vehicle 9 i.e., the previous image data
  • An abnormality in the seat 40 or the like can be easily detected based on the difference between the image data of the rear image taken by the camera 25 of the rear interior of the vehicle (that is, the rear image data).
  • the vehicle 9 corresponds to a vehicle
  • the cloud 5 corresponds to a cloud
  • the in-vehicle device 3 corresponds to an in-vehicle device
  • the anomaly detection system 1 corresponds to an anomaly detection system
  • the camera 25 corresponds to a camera
  • the detection unit 41 corresponds to an in-vehicle device.
  • the transmission unit 43 corresponds to a detection unit
  • the transmission unit 43 corresponds to a transmission unit
  • the storage unit 61 corresponds to a storage unit
  • the vehicle ECU 23 corresponds to a relay device.
  • the configuration shown in FIG. 8, which is managed by the cloud 5 (that is, the management server), can be adopted. That is, the analysis results may be recorded in the database 71 and the image data may be recorded in the file server 101 using a known cloud service.
  • the database 71 can be configured to include a control unit 73 having a CPU 91 and a memory 93, and a communication unit 75, and the analysis results sent from the management server to the database 71 are stored in the storage unit 77. be remembered.
  • a configuration including a control unit 103 having a CPU 111 and a memory 113, and a communication unit 105 can be adopted, and image data sent from the management server to the file server 101 is stored in the storage unit 107. be done.
  • the hardware configuration of the second embodiment is the same as that of the first embodiment, so a description thereof will be omitted.
  • the abnormality detection system 1 includes a first application and a second application configured to detect target abnormalities, respectively, based on image data from a camera 25 that captures images of the interior of a vehicle 9. We are prepared. Further, the abnormality detected by the first application has a higher degree of urgency than the abnormality detected by the second application.
  • the control section of the in-vehicle device 3 functionally includes a first detection unit 121, a first transmission unit 123, and a second transmission unit 125.
  • the first detection unit 121 is configured to analyze image data and detect abnormalities when implementing the first application.
  • the first transmitting unit 123 transmits the analysis results analyzed by the first detecting unit 121 to the cloud 5, and transmits at least the image data used when an abnormality is detected to the cloud 5. It is configured.
  • the second transmission unit 125 is configured to transmit image data to the cloud 5 when implementing the second application.
  • control unit 51 of the cloud 5 includes a first storage unit 131, a second detection unit 133, and a second storage unit 135.
  • the first storage unit 131 is configured to store the analysis results and image data transmitted from the first transmission unit 123 when implementing the first application.
  • the second detection unit 133 is configured to analyze the image data transmitted from the second transmission unit 125 and detect an abnormality when implementing the second application.
  • the second storage unit 135 is configured to store the image data transmitted from the second transmission unit 125 and the analysis results analyzed by the second detection unit 133.
  • the analysis results are configured to be notified from at least one of the in-vehicle device 3 and the cloud 5 to at least one of the operator's mobile terminal 15 and the user's mobile terminal 16.
  • This living body detection process is a process (that is, a process performed by the first application) with a high degree of urgency (that is, priority) for notification.
  • the in-vehicle device 3 performs a living body detection process.
  • This living body detection process is a process for detecting living things (that is, living bodies) such as children such as babies, elderly people, and pets.
  • any abnormality is detected from the difference between the above-mentioned before image and after image. That is, if there is a difference area corresponding to the difference between images, it is determined that there is some kind of abnormality. For example, there is a method of detecting a baby, a pet, etc., by performing well-known image recognition processing on the object for which an abnormality has been detected. Further, at that time, it is possible to improve the detection accuracy by detecting the temperature of the object. Furthermore, the detection accuracy can be further improved by employing the method of detecting a three-dimensional object described above.
  • the living body detection result is transmitted to the cloud 5.
  • the analysis results may be transmitted only when a living body is detected, but the analysis results may be transmitted even when no living body is detected.
  • image data of the before image and the after image used for detecting the living body is transmitted to the cloud 5. Note that the analysis results and image data are stored in the storage unit 53.
  • the results of the living body detection in S370 are sent to the operator's mobile terminal 15 and the user's mobile terminal 16 before the processing in S380. You may also make a notification. In that case, the determination in S390 and the notification in S395 can be omitted.
  • This stain detection process is a process that has a lower notification priority than the living body detection process (that is, a process performed by the second application). Note that the above-mentioned forgotten item detection process may be performed instead of the dirt detection process.
  • This stain detection process uses the before and after images used in the living body detection process. Note that in this stain detection process as well, a process of photographing and acquiring a front image and a back image may be performed, similar to the stain detection process of the first embodiment.
  • S400 it is determined whether a front image and a rear image have been acquired by the first application. If an affirmative determination is made here, the process proceeds to S410, whereas if a negative determination is made here, the process is temporarily terminated.
  • the image data of the previous image and the subsequent image is transmitted to the cloud 5.
  • the image data is stored in the storage section 53.
  • the cloud 5 performs a process of detecting dirt using the same method as in the first embodiment.
  • the analysis results are stored in the storage unit 53.
  • the second embodiment has the same effects as the first embodiment. Furthermore, in the second embodiment, the process of detecting a living body such as a baby or pet is carried out immediately after getting off the vehicle, and if a baby or pet is detected, the user or business operator is promptly notified. Therefore, it has the effect of high safety.
  • a forgotten item detection process similar to the first embodiment can be adopted instead of the living body detection process.
  • a forgotten item detection process such as S210 can be adopted, and instead of the process of determining presence of a living body of S390, the process of determining presence of a forgotten item such as S230. can be adopted.
  • the present disclosure can be applied to a service in which a vehicle is shared by multiple users. For example, it can be applied to car sharing services and rental car services.
  • Abnormalities in the vehicle interior include dirt, forgotten items, damaged parts, and the presence of living organisms after exiting the vehicle.
  • Examples of abnormal locations include the seat and locations other than the seat (for example, doors, windows, floors, and dashboards).
  • Image data sent from the vehicle side to the cloud side includes image data used to detect an abnormality (for example, image data of a front image and a rear image) when an abnormality is detected. Even if no abnormality is detected, the image data may be transmitted for confirmation.
  • an abnormality for example, image data of a front image and a rear image
  • the anomaly detection system and anomaly detection method described in the present disclosure are provided by configuring a processor and memory programmed to perform one or more functions embodied by a computer program. It may also be realized by a dedicated computer.
  • the anomaly detection system and anomaly detection method described in this disclosure may be implemented by a dedicated computer provided by a processor configured with one or more dedicated hardware logic circuits.
  • the anomaly detection system and anomaly detection method described in the present disclosure may include a processor and a memory configured to perform one or more functions, and a processor configured by one or more hardware logic circuits. It may also be realized by one or more dedicated computers configured in combination.
  • the computer program may also be stored as instructions executed by a computer on a computer-readable non-transitory tangible storage medium.
  • the method for realizing the functions of each part included in the anomaly detection system does not necessarily need to include software, and all the functions may be realized using one or more pieces of hardware.
  • the present disclosure can be applied in various forms, such as a program for making the computer of the abnormality detection system function, a non-transitional tangible recording medium such as a semiconductor memory in which this program is recorded, and a control method. It can also be achieved.
  • An abnormality detection system (1) that detects abnormalities in a vehicle interior, comprising a cloud (5) that collects data of a vehicle (9), and an on-vehicle device (3) communicably connected to the cloud.
  • the in-vehicle device includes: a detection unit (41) configured to analyze the image data and detect the abnormality when each of the plurality of applications is implemented;
  • a transmission unit (43 )and, Equipped with The cloud is a storage unit (61) configured to store the analysis result and the image data transmitted from the transmission unit; configured to notify the analysis result to a notification target from at least one of the in-vehicle device and the cloud; Anomaly detection system.
  • An abnormality detection system (1) that detects abnormalities in a vehicle interior, comprising a cloud (5) that collects data of a vehicle (9), and an on-vehicle device (3) communicably connected to the cloud.
  • a first application and a second application each configured to detect the target abnormality based on image data from a camera photographing the inside of the vehicle,
  • the abnormality detected by the first application has a higher degree of urgency to be notified when the abnormality is detected than the abnormality detected by the second application
  • the in-vehicle device includes: When implementing the first application, a first detection unit (121) configured to analyze the image data and detect the abnormality;
  • a first device configured to transmit an analysis result analyzed by the first detection unit to the cloud, and transmit at least the image data used when the abnormality is detected to the cloud.
  • a transmitting unit (123); a second sending unit (125) configured to send the image data to the cloud when implementing the second application; Equipped with The cloud is
  • a first storage unit (131) configured to store the analysis result and the image data transmitted from the first transmission unit;
  • a second detection unit (133) configured to analyze the image data transmitted from the second transmission unit and detect the abnormality;
  • a second storage unit (135) configured to store the image data transmitted from the second transmission unit and the analysis result analyzed by the second detection unit; Equipped with configured to notify the analysis result to a notification target from at least one of the in-vehicle device and the cloud; Anomaly detection system.
  • a cloud (5) that collects data of the vehicle (9) is communicably connected to the cloud, and is communicably connected to a relay device (23) that relays frames flowing to the vehicle network (30).
  • An abnormality detection system (1) for detecting an abnormality in a vehicle interior comprising: an in-vehicle device (3);
  • the in-vehicle device includes: an in-vehicle communication unit (45) configured to communicate with an electronic control device (32, 36) connected to the network of the vehicle via the relay device; a detection unit (41) configured to detect the abnormality by analyzing image data from a camera (25) photographing the interior of the vehicle;
  • the abnormality detection system according to any one of items 1 to 3, The abnormality is an abnormality related to the sheet, including at least stains on the sheet (40) or items left behind on the sheet. Anomaly detection system.
  • the abnormality detection system according to any one of items 1 to 4, The camera (25) is an infrared camera. Anomaly detection system.
  • the abnormality detection system according to any one of items 1 to 5, When photographing with the camera, a light is turned on to illuminate the object to be photographed; Anomaly detection system.
  • the abnormality detection system according to any one of items 1 to 6, Pre-image data taken by the camera before the user gets into the vehicle; and post-image data taken by the camera after the user gets off the vehicle. configured to detect the abnormality based on the difference; Anomaly detection system.
  • Anomaly detection system The abnormality detection system described in item 7, When detecting the abnormality based on the difference between the before image data and the after image data, the brightness of the before image data and the after image data is adjusted. Anomaly detection system.
  • the abnormality detection system according to any one of items 1 to 8, The abnormality is configured to distinguish between dirt and forgotten items. Anomaly detection system.
  • the abnormality detection system according to any one of items 1 to 9, When the instruction to take the photograph is received from outside the vehicle, the camera is configured to take a photograph and detect the abnormality based on the image data obtained by the photograph. Anomaly detection system.
  • the abnormality detection system according to any one of items 1 to 10 The in-vehicle device is connected to a vehicle battery (50), and is configured to terminate activation of the camera and the in-vehicle device itself when the ignition (52) of the vehicle is turned off. was done, Anomaly detection system.
  • An abnormality detection method that enables communication between an on-vehicle device (3) mounted on a vehicle (9) and a cloud (5), and detects an abnormality in a vehicle interior, Using a plurality of applications each configured to detect the target abnormality based on image data from a camera (25) photographing the interior of the vehicle, When each of the plurality of applications is executed, the in-vehicle device analyzes the image data to detect the abnormality, transmits the analyzed analysis result to the cloud, and detects at least the abnormality.
  • An abnormality detection method that enables communication between an on-vehicle device (3) mounted on a vehicle (9) and a cloud (5), and detects an abnormality in a vehicle interior, A first application and a second application each configured to detect the target abnormality based on image data from a camera (25) photographing the interior of the vehicle are used, and the first application detects the abnormality.
  • the abnormality has a higher degree of urgency to be notified when the abnormality is detected than the abnormality detected by the second application,
  • the image data is analyzed to detect the abnormality, and the analyzed result is transmitted to the cloud and used at least when the abnormality is detected.
  • a cloud (5) that collects data of the vehicle (9) is communicably connected to the cloud, and is communicably connected to a relay device (23) that relays frames flowing to the vehicle network (30).
  • An abnormality detection method for detecting an abnormality in a vehicle interior using an in-vehicle device (3) comprising:
  • the in-vehicle device includes: Communicate with an electronic control device (32, 36) connected to the network of the vehicle via the relay device, and detect the abnormality by analyzing image data from the camera (25) that photographs the interior of the vehicle. and transmitting the analyzed analysis result to the cloud, and transmitting at least the image data used when the abnormality is detected to the cloud, and transmitting the analyzed analysis result, Notifying the outside of the vehicle; Anomaly detection method.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Quality & Reliability (AREA)
  • Mechanical Engineering (AREA)
  • Emergency Alarm Devices (AREA)
  • Alarm Systems (AREA)
  • Traffic Control Systems (AREA)
PCT/JP2023/015378 2022-04-27 2023-04-17 異常検出システム及び異常検出方法 Ceased WO2023210433A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2024517217A JP7704300B2 (ja) 2022-04-27 2023-04-17 異常検出システム及び異常検出方法
DE112023002034.5T DE112023002034T5 (de) 2022-04-27 2023-04-17 Anomalieerfassungssystem und anomalieerfassungsverfahren
CN202380036197.1A CN119110969A (zh) 2022-04-27 2023-04-17 异常检测系统以及异常检测方法
US18/908,165 US20250029473A1 (en) 2022-04-27 2024-10-07 Abnormality detection system and abnormality detection method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022-073548 2022-04-27
JP2022073548 2022-04-27

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/908,165 Continuation US20250029473A1 (en) 2022-04-27 2024-10-07 Abnormality detection system and abnormality detection method

Publications (1)

Publication Number Publication Date
WO2023210433A1 true WO2023210433A1 (ja) 2023-11-02

Family

ID=88518570

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/015378 Ceased WO2023210433A1 (ja) 2022-04-27 2023-04-17 異常検出システム及び異常検出方法

Country Status (5)

Country Link
US (1) US20250029473A1 (https=)
JP (1) JP7704300B2 (https=)
CN (1) CN119110969A (https=)
DE (1) DE112023002034T5 (https=)
WO (1) WO2023210433A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2026018388A1 (ja) * 2024-07-18 2026-01-22 日産自動車株式会社 車両制御装置及び車両制御方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11132959A (ja) * 1997-10-29 1999-05-21 Hitachi Ltd 欠陥検査方法および装置
US20170098364A1 (en) * 2015-10-02 2017-04-06 Lg Electronics Inc. Apparatus, method and mobile terminal for providing object loss prevention service in vehicle
JP2019172191A (ja) * 2018-03-29 2019-10-10 矢崎総業株式会社 車内監視モジュール、及び、監視システム
JP2019205078A (ja) * 2018-05-24 2019-11-28 株式会社ユピテル システム及びプログラム等

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7354946B2 (ja) 2020-07-06 2023-10-03 トヨタ自動車株式会社 車両及び車室内外モニタリングシステム
JP7519270B2 (ja) 2020-11-02 2024-07-19 株式会社Ｎｔｔドコモ 直流電源システム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11132959A (ja) * 1997-10-29 1999-05-21 Hitachi Ltd 欠陥検査方法および装置
US20170098364A1 (en) * 2015-10-02 2017-04-06 Lg Electronics Inc. Apparatus, method and mobile terminal for providing object loss prevention service in vehicle
JP2019172191A (ja) * 2018-03-29 2019-10-10 矢崎総業株式会社 車内監視モジュール、及び、監視システム
JP2019205078A (ja) * 2018-05-24 2019-11-28 株式会社ユピテル システム及びプログラム等

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2026018388A1 (ja) * 2024-07-18 2026-01-22 日産自動車株式会社 車両制御装置及び車両制御方法

Also Published As

Publication number Publication date
JP7704300B2 (ja) 2025-07-08
CN119110969A (zh) 2024-12-10
US20250029473A1 (en) 2025-01-23
DE112023002034T5 (de) 2025-02-20
JPWO2023210433A1 (https=) 2023-11-02

Similar Documents

Publication Publication Date Title
CN107972609B (zh) 用于门状态检测的方法和装置
CN111762184B (zh) 车辆控制系统以及车辆
CN109754612A (zh) 无人驾驶运输系统
US20190272755A1 (en) Intelligent vehicle and method for using intelligent vehicle
US11845390B2 (en) Cabin monitoring system
CN106029455A (zh) 打开车辆的行李箱的装置和方法以及记录执行方法的程序的记录介质
CN113799729B (zh) 车辆控制系统及车辆控制方法
KR20220014681A (ko) 자동차 및 그를 위한 실내 청결 관리 방법
CN107683223A (zh) 下车通知装置
CN114572141A (zh) 乘员监测系统、乘员遗留提醒方法及相关设备
US20250029473A1 (en) Abnormality detection system and abnormality detection method
JP4144448B2 (ja) 車両後方表示装置
JP2022155584A (ja) 検知システム及び空間利用システム
JP2018169689A (ja) 非搭乗型自動運転システム、及び非搭乗型自動運転方法
KR20250112852A (ko) 차량의 제어 방법, 장치, 차량 및 기억 매체
CN117400847A (zh) 车辆中信息的发送方法、装置和存储介质
CN110723096B (zh) 用于检测被夹柔性材料的系统及方法
KR102151192B1 (ko) 생명체와 물건의 차량 내 방치 방지시스템 및 그 방치 방지방법
CN116895062B (zh) 控制系统以及控制系统的控制方法
CN114809833B (zh) 开启车门的控制方法、车门控制装置及车门控制系统
CN112744169B (zh) 汽车控制装置及汽车安全保护方法
US20240232731A9 (en) Moving object utilization system and moving object utilization method
KR102174411B1 (ko) 생명체와 물건의 차량 내 방치 방지시스템 및 그 방치 방지방법
CN119018080A (zh) 车内生命体监测控制方法、装置、设备、系统、车辆
JP7517272B2 (ja) 車載装置、物体の報知方法、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23796176

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2024517217

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 202380036197.1

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 112023002034

Country of ref document: DE

WWP Wipo information: published in national office

Ref document number: 112023002034

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 23796176

Country of ref document: EP

Kind code of ref document: A1