JP7100326B1 - Detection system and space utilization system - Google Patents

Abstract

An object of the present invention is to provide a detection system and a detection method capable of detecting with high accuracy that a specific event has occurred in a predetermined space. A first information acquisition means comprising at least one computer device for acquiring first information from a predetermined space; and a second information acquisition means for acquiring second information different from the first information from the predetermined space. 2 information acquisition means, and condition determination means for determining whether the acquired first information and second information satisfy a predetermined condition indicating that a specific event has occurred in a predetermined space, detection system. [Selection drawing] Fig. 4

Description

The present invention relates to a detection system and a detection method capable of detecting the occurrence of a specific event in a predetermined space. The present invention also relates to a space utilization system and a space utilization method that give benefits to users who use a predetermined space.

Traditionally, services for renting or sharing vehicles such as automobiles have been provided. These services have the advantage that the vehicle can be used at a desired timing without owning the vehicle.

In these car rental and car sharing services, the vehicle is used by an unspecified user, so if the user who used it first pollutes the inside of the vehicle without maintaining a clean state, the next user will be the same vehicle. You will not be able to use it comfortably. In order to solve such a problem, for example, an information processing system that acquires the intensity of the odor in the vehicle interior and outputs information for requesting cleaning of the vehicle when the intensity of the odor is equal to or higher than the threshold value. It is disclosed (see, for example, Patent Document 1).

By the way, there is a device other than Patent Document 1 that can detect the occurrence of a specific event by using a sensor. For example, for the purpose of caring for the sick, infants, etc., image data of the subject is acquired, odor data around the subject is acquired, and the condition of the subject is based on these image data and odor data. A monitoring system for determining the level is disclosed (see, for example, Patent Document 2).

Although such a system is disclosed, there are cases where it is not possible to accurately detect the occurrence of a specific event in a predetermined space.

Japanese Unexamined Patent Publication No. 2020-189599 Japanese Unexamined Patent Publication No. 2013-164684

The present invention has been made to solve such a problem. That is, a first object of the present invention is to provide a detection system and a detection method capable of detecting the occurrence of a specific event in a predetermined space with high accuracy.

A second object of the present invention is to provide a novel space utilization system and space utilization method that grants benefits to users who use a predetermined space.

The subject of the present invention is
[1] A first information acquisition means that includes at least one computer device and acquires first information from a predetermined space, and a second that acquires second information different from the first information from the predetermined space. Detection including an information acquisition means and a condition determination means for determining whether or not the acquired first information and the second information satisfy a predetermined condition indicating that a specific event has occurred in a predetermined space. system;
[2] The condition determination means determines whether or not the acquired first information satisfies a predetermined first condition, and whether the acquired second information satisfies a predetermined second condition. A second condition determining means for determining whether or not is provided, and whether or not the condition determining means is determined to satisfy a predetermined first condition and whether or not it is determined to satisfy a predetermined second condition. The detection system according to the above [1], which determines whether or not the predetermined condition is satisfied according to the above.
[3] The first information is information about an image obtained by capturing an image of a predetermined space, the second information is information about a temperature or carbon dioxide concentration in a predetermined space, and a specific event occurs in the predetermined space. The detection system according to the above [1] or [2], which is a doze state of a person in the room or a sign of the doze.
[4] A third information acquisition means for acquiring the first information and a third information different from the second information from the predetermined space is provided, and the condition determination means acquires the first information, the second. And the third information determine whether or not a predetermined condition indicating that a specific event has occurred in a predetermined space is satisfied, and the first information is an image obtained by capturing an image of the predetermined space. The second information is information about a thermal image in a predetermined space, the third information is information about a carbon dioxide concentration in a predetermined space, and a specific event occurs in a predetermined space. , The detection system according to [1] or [2] above, wherein there is something left behind;
[5] The first information is information about an image obtained by capturing an image of a predetermined space, the second information is information about a thermal image in a predetermined space, and a specific event is caused by a person in the predetermined space. The detection system according to the above [1] or [2], wherein the above-mentioned [1] or [2] is present;
[6] A third information acquisition means for acquiring the first information and a third information different from the second information from the predetermined space is provided, and the condition determination means acquires the first information, the second. And the third information determine whether or not a predetermined condition indicating that a specific event has occurred in a predetermined space is satisfied, and the first information is an image obtained by capturing an image of the predetermined space. Information about
The second information is information about a thermal image in a predetermined space, the third information is information about an odor in a predetermined space, and a specific event is that an animal other than a human is present in the predetermined space. The detection system according to the above [1] or [2].
[7] The first information is information about an image obtained by capturing an image of a predetermined space, the second information is information about a thermal image in a predetermined space, and a specific event causes heat generation in the predetermined space. The detection system according to the above [1] or [2], wherein a person is present;
[8] The first information is information about an image obtained by capturing an image of a predetermined space, the second information is information about an odor in a predetermined space, and a specific event occurs in a predetermined space by a person or an animal. The detection system according to [1] or [2] above, which is to vomit;
[9] The above [1] to [8] include information on voice generated in a predetermined space as information for determining whether or not a condition indicating that a specific event has occurred in a predetermined space is satisfied. ] The detection system described in any of;
[10] The above-mentioned [3] to [9], wherein the first condition determining means determines whether or not a predetermined first condition is satisfied based on the feature amount extracted from the captured image. Detection system;
[11] The fact that a specific event has occurred when the computer device is a server device capable of communicating with another computer device and the server device is determined by the condition determination means to satisfy a predetermined condition. The detection system according to any one of the above [1] to [10], comprising an event information transmitting means for transmitting the information of the above to another computer device. ;
[12] A detection method executed in a detection system including at least one computer device, the first information acquisition step of acquiring the first information from a predetermined space, and the first information from the predetermined space. Whether or not the second information acquisition step for acquiring different second information and the acquired first information and the second information satisfy a predetermined condition indicating that a specific event has occurred in a predetermined space. A detection method having a condition determination step for determining
[13] A space utilization system provided with at least one computer device for the user to use a predetermined space, and among the information that can be acquired from the information acquisition device installed in the predetermined space, the user Select the information to be actually acquired when using the predetermined space, or select the information to be calculated by the computer device from the information that can be acquired from the information acquisition device installed in the predetermined space. Space utilization system with selection means to
[14] The above-mentioned [13], wherein a specific granting means for granting a privilege to a user who uses a predetermined space is provided, and the privilege granting means grants a different type and / or a different amount of privilege according to the selected information. Space utilization system described in;
[15] The space utilization system according to the above [14], wherein the privilege can be utilized in connection with the utilization of a predetermined space by a user;
[16] A space utilization method that is provided in at least one computer device and is executed in a space utilization system for a user to use a predetermined space, and can be acquired from an information acquisition device installed in the predetermined space. Of the information, when the user uses the predetermined space, the information to be actually acquired is selected, or among the information that can be acquired from the information acquisition device installed in the predetermined space, the calculation by the computer device. A space utilization method having a selection step of selecting the target information of.

According to the present invention, it is possible to provide a detection system and a detection method capable of detecting the occurrence of a specific event in a predetermined space with high accuracy. According to the present invention, it is possible to provide a novel space utilization system and a space utilization method that give a privilege to a user who uses a predetermined space.

It is a block diagram which shows the structure of the detection system which concerns on embodiment of this invention. It is a block diagram which shows the structure of the server apparatus which concerns on embodiment of this invention. It is a figure which shows the flowchart of the 1st detection process which concerns on embodiment of this invention. It is a figure which shows the flowchart of the 2nd detection processing which concerns on embodiment of this invention. It is a figure which shows the flowchart of the privilege grant process which concerns on embodiment of this invention.

Hereinafter, embodiments of the present invention will be described, but the present invention is not limited to the following embodiments as long as it does not contradict the gist of the present invention. The detection system of the present invention can detect that a specific event has occurred in a predetermined space, but the predetermined space is not particularly limited here. In the detection system and the space utilization system of the present invention, examples of the predetermined space include a moving body, the periphery of the moving body, or the inside of the moving body. Hereinafter, the case where the detection system and the space utilization system of the present invention are mainly used for car sharing and car rental services will be described.

As a moving object, it is used not only in vehicles such as automobiles, but also in aircraft such as drones, helicopters, airships, gliders and jets, ships such as ferries and freighters, and public transportation such as buses and trains. Examples include all types of vehicles that people such as vehicles can board. In other words, the mobile body is a concept that includes not only vehicles but also the above-mentioned aircraft and ships.

FIG. 1 is a block diagram showing a configuration of a detection system and a space utilization system according to an embodiment of the present invention. As shown in the figure, the detection system includes a server device 1, an information acquisition device 3 provided in the vehicle 2, and a communication network 6. The server device 1 can communicate with another computer device, that is, the user terminal 4 or the administrator terminal 5 via the communication network 6. The server device 1 will be described later.

The vehicle 2 is not particularly limited as long as it is a vehicle that can move on land, but it is preferable that the vehicle 2 has wheels. The vehicle 2 is, for example, not only a bicycle, a motorized bicycle, a motorcycle, an automobile, etc., but also a construction vehicle used for construction purposes such as a dump truck and a bulldozer, an industrial vehicle used for cargo handling such as a forklift, and an agricultural use such as a tractor. It is a concept that includes those used for special purposes such as agricultural vehicles used in.

In one vehicle 2, the information acquisition device 3 is provided with at least the first information acquisition device 3a and the second information acquisition device 3b, but the third information acquisition device 3c and the fourth information acquisition device 3b are provided. It may be provided with three or more information acquisition devices such as 3d and the fifth information acquisition device 3e. The information acquisition device 3 may include a plurality of devices of the same type (that is, devices capable of acquiring the same information), or may include a plurality of different types of devices.

The information acquisition device 3 is not particularly limited as long as information around the information acquisition device 3 can be acquired. The information acquisition device 3 makes it possible to acquire information about the vehicle 2, the periphery of the vehicle 2, or the inside of the vehicle 2 (inside the vehicle). Here, the information about the vehicle 2 is information about the whole or a part of the vehicle 2, and is a concept including, for example, information about parts and devices constituting the vehicle such as tires and engines of the vehicle 2 or their vicinity. The information about the periphery of the vehicle 2 is the information about the outside of the vehicle 2.

In the space utilization system of the present invention, the first information and the second information different from the first information are acquired by the information acquisition device 3 from the vehicle 2, the periphery of the vehicle 2, or the inside of the vehicle 2, and the first And the second information determine whether or not a predetermined condition indicating that a specific event has occurred is satisfied. More specifically, whether a specific event has occurred depending on whether the first information satisfies a predetermined first condition and whether the second information satisfies a predetermined second condition. It may be determined whether or not. The first information and the second information may be acquired from the same one information acquisition device 3, or the first information and the second information may be acquired from different information acquisition devices 3.

Further, the space utilization system of the present invention acquires the first information, the second information, and the third information from the vehicle 2, the periphery of the vehicle 2, or the inside of the vehicle 2 by the information acquisition device 3, and the first information. , The second information and the third information may determine whether or not a predetermined condition indicating that a specific event has occurred is satisfied. More specifically, whether or not the first information satisfies a predetermined first condition, whether or not the second information satisfies a predetermined second condition, and whether or not the third information satisfies a predetermined third condition. Depending on whether or not the condition is satisfied, it may be determined whether or not a specific event has occurred. Similar to the above, the first information, the second information, and the third information may be acquired from the same one information acquisition device 3, and the first information, the first information, may be acquired from different information acquisition devices 3. The information of 2 and the third information may be acquired.

In the space utilization system of the present invention, the number of information to be determined as to whether or not a predetermined condition indicating that a specific event has occurred is not particularly limited as long as it is 2 or more. It may be determined whether or not a specific event has occurred depending on whether or not each of the plurality of information acquired from the information acquisition device 3 satisfies the condition set for each information.

Examples of the information acquisition device 3 include a driver monitoring system (DMS) and an in-vehicle device. The DMS can detect whether or not the driver is in an appropriate state. The on-board unit can acquire position information by GPS or the like and acceleration information by an acceleration sensor.

In addition, examples of the information acquisition device 3 include a gas sensor, an alcohol checker, a body temperature sensor, a temperature sensor, and the like. The gas sensor can detect air pollution, the amount of carbon dioxide in the vehicle 2, and the like. In addition, the alcohol checker can detect the alcohol concentration contained in the exhaled breath of the user. The temperature sensor can measure the temperature inside the vehicle 2.

Further, as the information acquisition device 3, an image pickup device capable of capturing a still image or a moving image can be mentioned. Whether there is dirt, whether there is something left behind, whether there is an act such as vomiting, whether there is an act such as vomiting, infants etc. get on board due to the difference in image information before and after using the inside of the vehicle 2 or by using AI etc. It is possible to detect whether or not it is left as it is. It is possible to detect that a person, an animal, or the like is moving from the change of the image information acquired by the image pickup device with the passage of time.

The mounting position of the image pickup device is not particularly limited, but for example, it can be mounted on the ceiling of the vehicle 2 to image the state inside the vehicle 2. The image pickup device can be placed in the center of the ceiling to capture all the states of the driver's seat, the passenger's seat, and the rear seats, and on the ceiling of the vehicle 2, the driver's seat, the passenger's seat, and the rear seats are overhead. A plurality of image pickup devices may be arranged in the space. Examples of the image pickup device include an infrared camera and a 360-degree camera.

By the way, if the user attaches a tape or the like to the image pickup device to hide it, the internal state of the vehicle 2 cannot be accurately captured. For example, in the image pickup device, it is possible to detect that the image pickup device is hidden by using the fact that the illuminance cannot be detected as a trigger. When it is detected that the image pickup device is hidden, it is possible to call attention by a voice output or an alarm by lighting.

For example, as will be described later, in a car sharing service or a rental car service, even when points are given to the user according to the use of the vehicle 2, the user attaches a tape to the image pickup device as a result. When it is detected that the image pickup device is hidden for a certain period of time or longer, it is possible to take measures such as reducing the points given to the user or not giving points.

Further, as the information acquisition device 3, it is also possible to measure and acquire the air pressure and temperature inside the tire by a tire sensor installed on the tire of the vehicle 2 (or in the vicinity of the tire). It is also possible to estimate the presence or absence of a flat tire based on the information acquired from the tire sensor. Further, as the information acquisition device 3, it is also possible to measure and acquire the engine rotation speed and temperature by an engine sensor installed in the engine of the vehicle 2 (or in the vicinity of the engine).

In addition to these, the information acquisition device 3 includes a drive recorder. When a large impact is applied to the vehicle, such as when the vehicle collides with some obstacle and suddenly stops due to the drive recorder, the video and audio of the outside of the vehicle (front or rear of the vehicle) for a period of several tens of seconds before and after that. Can be obtained.

As the information acquisition device 3, not only the voice sensor provided in the drive recorder described above but also the voice sensor installed separately from the drive recorder can be used. The voice sensor detects the voice collected from the microphone provided in the vehicle 2. The voice sensor can detect and analyze the voice in the vehicle 2. By voice analysis, it is possible to improve the accuracy of determining whether a person or an animal exists in the vehicle 2, or whether the object existing in the vehicle 2 is a forgotten object or a person. The determination accuracy can be improved. In addition, voice recognition that converts utterances into text is also possible by voice analysis.

In addition, the presence or absence of danger or violence in the vehicle 2 can be estimated by combining the image information captured by the image pickup device and the voice analysis. Furthermore, accidents and hilarious hats can be detected by combining position information by a position sensor such as GPS, acceleration information by an acceleration sensor, and voice analysis.

The vehicle 2 includes all of the DMS, GPS, acceleration sensor, gas sensor, alcohol checker, body temperature sensor, temperature sensor, image pickup device, tire sensor, drive recorder, and voice sensor exemplified here as the information acquisition device 3. It is also possible to have only a part of any of them. Further, the information acquisition device 3 may be provided with a sensor or a measuring device other than those exemplified here.

Each of the information acquisition devices 3 has a wireless communication function, and the information acquired by the information acquisition device 3 may be transmitted to the server device 1 by this communication function. Further, each of the information acquisition devices 3 does not have a long-distance communication function, but the communication device provided in the vehicle 2 and the information acquisition device 3 perform short-distance communication by wireless or wired, and the communication device is used. The information acquired by each of the information acquisition devices 3 can also be transmitted to the server device 1 via the information acquisition device 3.

Further, the information acquired by the information acquisition device 3 may be processed by the arithmetic unit provided in the vehicle 2 and only the feature amount information may be transmitted to the server device 1 side. Further, it is also conceivable that the threshold value is determined based on the feature amount information processed by the arithmetic unit, and only the information such as the pass / fail result is transmitted to the server device 1. As a result, the information that identifies the user is not stored in the server device 1, so that the user can use the vehicle with peace of mind without worrying about privacy. Even if the information acquired by the information acquisition device 3 or the information processed by the arithmetic unit based on these information is encrypted from the viewpoint of security and then transmitted to the server device 1 side. good.

It is also possible to rewrite the threshold values required for various determinations in the arithmetic unit via the cloud or by using a remote communication means.

Information can be acquired by the information acquisition device 3 periodically at predetermined time intervals. Further, information acquisition by the information acquisition device 3 may be executed by a predetermined operation on the vehicle 2 by the user (for example, unlocking the door, operating the engine, etc.) as a trigger. The frequency and timing of information acquisition by the information acquisition device 3 may be the same frequency and timing in any of the information acquisition devices 3, and the frequency and timing may be appropriate depending on the type of the information acquisition device 3. It may be done in.

When using vehicle 2 for car sharing or car rental service, the reservation period reserved for use by the user of vehicle 2, a certain period immediately before the reservation period, and immediately after the reservation period. It is also possible to set the information acquisition device 3 to automatically acquire information only for a certain period of time.

The detection system and the space utilization system of the present invention include at least two or more information acquisition devices 3, and the combination thereof can be appropriately designed according to the event to be detected.

For example, when the engine is running, the driver's doze is determined by the combination of the driver's image information acquired by the DMS and the carbon dioxide concentration and / or the temperature in the vehicle 2 acquired by the gas sensor. It is possible to detect a condition or a sign of falling asleep. More specifically, based on the information of the driver's face image acquired by DMS, it is detected that yawning or the state where the eyes are closed continues, and the inside of the vehicle 2 acquired by the gas sensor. When the carbon dioxide concentration of the vehicle 2 is equal to or higher than the threshold value and / or when the temperature inside the vehicle 2 is equal to or higher than a predetermined temperature, the driver's dozing state or a sign of dozing can be detected. Whether or not the engine is running can be detected by the engine sensor (hereinafter, the same applies).

Further, when the engine is not operating, the presence or absence of a forgotten item can be detected by combining the image information by the image pickup device in the vehicle 2 and the image information related to the thermal image in the vehicle 2 acquired by the thermo camera. .. More specifically, the image information captured in the state where the engine of the vehicle 2 is not operating is different from the image information in the initial state before the start of use of the vehicle 2, and does not exist in the initial state. Detects the existence of an object. Further, it is detected that the captured image information does not change with the passage of time and the object is in a stationary state without movement. Then, when the carbon dioxide concentration in the vehicle 2 does not change with time and the body temperature of the living thing is not detected by the thermal image of the thermo sensor, it is possible to detect that a forgotten item has occurred. When it is detected that an object that did not exist in the initial state exists from the image information captured in the state where the engine of the vehicle 2 is not operating, the analysis of the voice acquired by the voice sensor is used. As a result, it is possible to improve the determination accuracy as to whether the object remaining in the vehicle 2 is a human being, an animal, or a forgotten object.

In addition, when the engine is not running, the image information in the vehicle 2 acquired by the image pickup device and the image information related to the thermal image in the vehicle 2 acquired by the thermo camera are combined to leave children such as infants behind. Can be detected. More specifically, when it is detected that the image information in the vehicle 2 acquired by the image pickup device changes with the passage of time and the body temperature of the living thing is detected by the thermal image of the thermo sensor, a child such as an infant It is possible to detect the possibility of leaving behind.

Further, by combining the image information in the vehicle 2 acquired by the image pickup device, the odor in the vehicle 2 acquired by the gas sensor, and the image information on the thermal image in the vehicle 2 acquired by the thermo camera, the animal such as a pet can be used. It is possible to detect the ride. More specifically, the image information in the vehicle 2 acquired by the image pickup device changes with the passage of time, it is detected that the object is in a moving state, and the intensity of the odor acquired by the gas sensor is strong. Is equal to or greater than the threshold value (or larger than the threshold value), and further, when the body temperature of the organism is detected by the thermal image of the thermo sensor, it is possible to detect that an animal such as a pet other than a human is on board. At this time, it is possible to improve the determination accuracy by using the analysis of the voice acquired by the voice sensor as to whether the organism remaining in the vehicle 2 is a human being or an animal such as a pet.

Further, by combining the image information in the vehicle 2 acquired by the image pickup apparatus and the thermal image information regarding the thermal image in the vehicle 2 acquired by the thermo camera, it is possible to detect that the heat generator is on board. More specifically, when the movement is detected by the image information in the vehicle 2 acquired by the image pickup device, and the body temperature of the organism detected by the thermal image of the thermo sensor is equal to or higher than the predetermined body temperature. It is possible to detect the possibility that a fever is on board. Further, if the movement of coughing or sneezing can be detected by AI or the like from the image information acquired by the image pickup device, or if the occurrence of droplets due to coughing or sneezing can be detected, a person in poor physical condition gets on the vehicle 2. It is possible to detect what is being done.

Further, by combining the image information in the vehicle 2 acquired by the image pickup apparatus and the information on the odor in the vehicle 2 acquired by the gas sensor, it is possible to detect that a person or an animal has vomited. More specifically, it is detected that the image information in the vehicle 2 acquired by the image pickup device is different from the image information in the initial state before the start of use by the user of the vehicle 2 in the state where no person or animal is on board. , When the intensity of the odor acquired by the gas sensor is equal to or higher than the threshold value (or larger than the threshold value), it is possible to detect that vomiting or other stains have occurred. In addition, when voice recognition detects utterances such as "vomiting", "dirty", and "spilling" in the vehicle 2, it detects with high accuracy that cleaning is required. be able to.

In addition, the judgment criteria and the thresholds on the data when judging whether or not these specific events have occurred are based on a large number of verification experiments and operational results, and after reflecting the user's voice. The administrator (or the administrator of car sharing or car rental service) who operates and manages the detection system and the space utilization system can be appropriately determined. In addition, AI (artificial intelligence) is made to perform machine learning using these demonstration experiments, operational results, user's voices, etc. as teacher data, and AI is made to judge whether or not a predetermined condition is satisfied, or to specify an appropriate threshold value. You can also do it.

FIG. 2 is a block diagram showing a configuration of a server device according to an embodiment of the present invention. The server device 1 includes at least a control unit 11, a RAM 12, a storage unit 13, and a communication interface 14, and is connected to each other by an internal bus.

The control unit 11 is composed of a CPU and a ROM, executes a program stored in the storage unit 13, and controls the server device 1. Further, the control unit 11 includes an internal timer that measures the time. The RAM 12 is a work area of the control unit 11. The storage unit 13 is a storage area for storing programs and data. The control unit 11 reads the program and data from the RAM 12, and performs the program execution process based on the information received from the information acquisition device 3.

The communication interface 14 can be connected to the communication network 3 wirelessly or by wire, and can transmit and receive data to and from the server device 1 via the communication network 6. The data received via the communication interface 14 is loaded into the RAM 12, and the control unit 11 performs arithmetic processing.

The user terminal 4 is a terminal operated by a user using the vehicle 2. Further, the administrator terminal 5 is a terminal operated by an administrator (or an administrator who operates and manages a car sharing or car rental service) who operates and manages a detection system and / or a space utilization system. When a specific event occurs in the vehicle 2, the server device 1 notifies the user terminal 4 and / or the administrator terminal 5 of information that the specific event has occurred. The user terminal 4 and / or the administrator terminal 5 is not particularly limited as long as it is a computer device having a display screen and an input unit, and for example, a conventional mobile phone, a tablet terminal, a smartphone, a notebook personal computer, or the like can be used. Can be mentioned. The user terminal 4 and / or the administrator terminal 5 can be connected to the communication network 6 wirelessly or by wire, and can transmit and receive data to and from the server device 1 via the communication network 6.

FIG. 3 is a diagram showing a flowchart of the first detection process according to the embodiment of the present invention. The first detection process is executed by the arithmetic unit provided in the server device 1 or the vehicle 2. The server device 1 or the arithmetic unit executes the following processing based on the information acquired by the information acquisition device 3. The following processing is periodically executed at predetermined time intervals.

First, based on the driver's face image data acquired by DMS, it is determined whether yawning has occurred within a predetermined time and whether the state in which the eyes are closed continues (step S1). Whether the driver has yawned or the state in which the eyes are closed is continuously determined by using AI learned by machine learning such as deep learning. When it is determined that neither yawning nor continuation of the eyes closed has occurred (No in step S1), the server device 1 or the arithmetic unit indicates that no problem has occurred in the vehicle 2. It is registered as history information (step S2), and the first detection process ends. In the registration of the history information, the history information is registered by associating the user using the vehicle 2 with the identifiable user ID and / or associating the vehicle 2 with the identifiable vehicle ID. The same applies to the registration of the following history information.

On the other hand, when it is determined that yawning and continuation of the eyes closed have occurred (Yes in step S1), is the carbon dioxide concentration in the vehicle 2 acquired by the gas sensor equal to or higher than the threshold value (or)? Whether it is larger than the threshold value) is determined (step S3). In step S3, instead of the carbon dioxide concentration, it can be determined whether the temperature in the vehicle 2 acquired by the temperature sensor is equal to or higher than the threshold value (or is larger than the threshold value). Further, it may be determined whether both the conditions of the carbon dioxide concentration in the vehicle 2 being equal to or higher than the threshold value and the temperature in the vehicle 2 being equal to or higher than the threshold value are satisfied.

If No is determined in step S3, the fact that no problem has occurred in the vehicle 2 is registered as history information in the server device 1 or the arithmetic unit (step S4), and the first detection process ends.

On the other hand, if Yes is determined in step S3, the driver has a doze state or a sign of doze, and that fact is transmitted to the user terminal 4 and / or the administrator terminal 5 (step S5). .. Then, in the vehicle 2, the fact that the driver has fallen asleep or a sign of falling asleep is registered as history information in the server device 1 or the arithmetic unit (step S6), and the first detection process ends.

FIG. 4 is a diagram showing a flowchart of the second detection process according to the embodiment of the present invention. The second detection process is executed by the arithmetic unit provided in the server device 1 or the vehicle 2. The server device 1 or the arithmetic unit executes the following processing based on the information acquired by the information acquisition device 3. The following processing is periodically executed at predetermined time intervals while the vehicle 2 is being used by the user.

First, it is determined whether or not the engine is operating based on the information such as the engine speed acquired by the engine sensor (step S11). When the engine is not running (No in step S11), it is determined whether or not the image information captured by the image pickup device is different from the image information in the initial state before the start of use of the vehicle 2 (step S12). Here, the image information in the initial state refers to image information captured in a state where no one is in the vehicle 2 before the user starts using the vehicle 2. For example, by receiving a signal requesting the unlocking of the door of the vehicle 2 from the outside as a trigger, and immediately after receiving the signal, the inside of the vehicle 2 is imaged to acquire the image information in the initial state. Can be done.

For example, the background subtraction method can be used to determine whether or not the image information captured by the image pickup apparatus in step S12 is different from the image information in the initial state before the start of use of the vehicle 2. For example, it is a method of obtaining a difference image by using the image information in the initial state as a background image and calculating the absolute value of the difference from the image captured by the image pickup apparatus. When a difference image is obtained, it can be seen that the image captured by the image pickup device is different from the image in the initial state. In addition to the background subtraction method, an edge detection method can also be used. By extracting contours from both the image in the initial state by the edge detection method and the image captured by the image pickup device and comparing the contours extracted from each image, the image information captured by the image pickup device can be obtained. It is possible to determine whether or not the image information is different from the image information in the initial state before the start of use of the vehicle 2.

When it is determined that the image information captured by the image pickup device is not different from, that is, the same as the image information in the initial state before the start of use of the vehicle 2 (No in step S12), the odor acquired by the gas sensor. It is determined whether or not the strength is equal to or greater than the threshold value (or is greater than the threshold value) (step S13). When the intensity of the odor acquired by the gas sensor is less than the threshold value (No in step S13), the server device 1 or the arithmetic unit indicates that no specific event has occurred and no problem has occurred in the vehicle 2. Is registered as history information in (step S14), and the second detection process ends.

When the intensity of the odor acquired by the gas sensor is equal to or higher than the threshold value (Yes in step S13), there is a possibility that stains due to vomiting or the like have occurred, and the user terminal indicates that the vehicle 2 has stains due to vomiting or the like. 4 and / or transmit to the administrator terminal 5 (step S15). Then, the fact that the vehicle 2 is contaminated due to vomiting or the like is registered as history information in the server device 1 or the arithmetic unit (step S16), and the second detection process ends.

When it is determined that the image information captured by the image pickup device is different from the image information in the initial state before the start of use of the vehicle 2 (Yes in step S12), the image information captured by the image pickup device is the time. It is determined whether or not the change has occurred over time (step S17). As in step S12, the background subtraction method or the edge detection method can be used for the determination in step S17.

When it is determined that the image information captured by the image pickup device has not changed with the passage of time (No in step S17), the carbon dioxide concentration in the vehicle 2 measured by the gas sensor changes with time. Whether or not it is determined is performed (step S18). When the carbon dioxide concentration in the vehicle 2 does not change with time (No in step S18), it is determined whether or not there is data corresponding to a predetermined temperature or higher in the thermal image data acquired from the thermo camera. (Step S19). Here, the predetermined temperature can be appropriately set, but for example, 35 ° C. can be set. The body temperature of homeothermic animals including humans is approximately 35 to 43 ° C., and by setting a predetermined temperature in this way, it is possible to detect the presence of many homeothermic animals including humans.

If there is no data corresponding to a predetermined temperature or higher in the thermal image data acquired from the thermo camera (No in step S19), there is a high possibility that the user's forgotten item remains in the vehicle 2, and the vehicle 2 has a high possibility of being left behind. It is transmitted to the user terminal 4 and / or the administrator terminal 5 that the user has left behind (step S20). Then, in the vehicle 2, the fact that the forgotten item by the driver or the passenger remains is registered as history information in the server device 1 or the arithmetic unit (step S21), and the second detection process ends.

If there is data corresponding to a predetermined temperature or higher in the thermal image data acquired from the thermo camera (Yes in step S19), it is unlikely that a child such as an infant is left behind in the vehicle 2, but somehow. Since there is a possibility that a trouble has occurred, the fact that the trouble may have occurred is transmitted to the user terminal 4 and / or the administrator terminal 5 (step S22). Then, in the vehicle 2, the fact that a trouble may occur is registered as history information in the server device 1 or the arithmetic unit (step S23), and the second detection process ends.

When it is determined that the image information captured by the image pickup device has changed with the passage of time (Yes in step S17), or when the carbon dioxide concentration in the vehicle 2 has changed over time (step S18). Yes), there is a possibility that a child or pet such as an infant has been left behind in the vehicle 2, and the possibility that the child or pet has been left behind is transmitted to the user terminal 4 and / or the administrator terminal 5. (Step S24). Then, in the vehicle 2, the fact that the child may be left behind is registered as history information in the server device 1 or the arithmetic unit (step S25), and the second detection process ends. In step S24, before transmitting to the user terminal 4 and / or the administrator terminal 5 that there is a possibility that the child or pet may be left behind, the child or pet is left behind by using the strength of the odor acquired by the gas sensor. It may be determined whether it is a child or a pet.

Next, a case where Yes is determined in step S11 will be described. It is determined whether or not the image information captured by the image pickup apparatus has changed with the passage of time (step S26). As in step S13, the background subtraction method or the edge detection method can be used for the determination in step S26. When it is determined that the image information captured by the image pickup device has not changed with the passage of time (No in step S26), the server device 1 or the arithmetic unit indicates that no problem has occurred in the vehicle 2. It is registered as history information (step S27), and the second detection process ends.

When it is determined that the image information captured by the image pickup device changes with the passage of time (Yes in step S26), the thermal image data acquired from the thermo camera contains data corresponding to a predetermined temperature or higher. It is determined whether or not it exists (step S28). In step S28, 37 ° C. can be set as a predetermined temperature. The body temperature of many homeothermic animals other than humans is 37 ° C. or higher, and step S28 can determine whether or not there is a possibility of a fever or an animal in the vehicle 2.

When there is no data corresponding to a predetermined temperature or higher in the thermal image data (No in step S28), the presence of a heat generator or an animal cannot be confirmed in the vehicle 2, so that no particular problem has occurred. It is registered as history information in the server device 1 or the arithmetic unit (step S29), and the second detection process ends.

On the other hand, when there is data corresponding to a predetermined temperature or higher in the thermal image data (Yes in step S28), whether or not the intensity of the odor acquired by the gas sensor is equal to or higher than the threshold value (or larger than the threshold value). Is determined (step S30). When the intensity of the odor acquired by the gas sensor is less than the threshold value (No in step S30), the presence of a heat generator in the vehicle 2 is transmitted to the user terminal 4 and / or the administrator terminal 5 (step). S31). Then, the fact that the heat generator exists in the vehicle 2 is registered as history information in the server device 1 or the arithmetic unit (step S32), and the second detection process ends.

When the intensity of the odor acquired by the gas sensor is equal to or higher than the threshold value (Yes in step S30), the fact that the pet is in the vehicle 2 is transmitted to the user terminal 4 and / or the administrator terminal 5 (step S33). ). Then, in the vehicle 2, the fact that the pet is on board is registered as history information in the server device 1 or the arithmetic unit (step S34), and the second detection process ends.

The predetermined conditions in the detection system of the present invention may be determined by the administrator of the detection system and the determined conditions may be registered in the server device 1, but the user himself determines the conditions and the user terminal 4 It is also possible to register the condition determined by the user in the server device 1 by inputting the condition by operating the above and transmitting the input condition to the server device 1.

Next, the space utilization system of the present invention will be described. In the car sharing service and rental car service in which the detection system and the space utilization system of the present invention are introduced, the user can make a reservation for using the vehicle 2. Then, when making a reservation for using the vehicle 2, it is possible to select which of the plurality of information acquisition devices 3 provided in the vehicle 2 is permitted to acquire information. Alternatively, when making a reservation for use of the vehicle 2, any of the plurality of information acquired from the information acquisition device 3 provided in the vehicle 2 is analyzed by the server device 1 (for example, the first described above). It is possible to select whether to use the detection process or the target of the calculation in the second detection process).

For many users, there is psychological resistance to acquiring and utilizing the information of the vehicle 2. Therefore, in order to give the user an incentive to utilize the information of the vehicle 2, many points can be given to the user who has permitted the acquisition or use of the information from the information acquisition device 3. Further, among the information acquisition devices 3, there are devices such as an image pickup device, which tend to have a large psychological resistance due to use. Therefore, by changing the number of points given to the user according to the type of the information acquisition device 3 or by giving the user points having different rarities and values, the information acquisition device 3 acquires or uses the information. Can be encouraged.

Next, the space utilization system of the present invention will be described. FIG. 5 is a diagram showing a flowchart of reservation processing in the space utilization system according to the embodiment of the present invention. A user who wishes to use a car sharing service or a rental car operates a user terminal 4 to access a predetermined website. A user ID and password are registered for each user, and the user logs in to the website by inputting the user ID and password into the user terminal 4 (step S41).

When the user logs in to the website and inputs conditions such as the date and time of use and the budget, information about a plurality of reservable vehicles that meet the conditions is transmitted from the Web server and displayed on the user terminal 4 (step S42). ). The vehicle information includes, for example, information such as a vehicle type, the number of passengers, a cost, and an external image of the vehicle. By operating the user terminal 4, the user can select one vehicle to be reserved from a plurality of vehicles (step S43). Next, among the plurality of information acquisition devices provided in the vehicle, it is possible to select which information acquisition device is permitted to acquire or use the information when the vehicle is actually used (step S44). .. The "selection of information" is a concept that includes not only selecting information such as image information captured by an image pickup device and voice information acquired by a voice sensor, but also selecting an information acquisition device such as an image pickup device and a voice device. Is.

When the selection is completed in step S44, the points given to the user are calculated (step S45). The points granted can be used to reduce the cost for the user to use the car sharing service or rental car service from the next time onward, or to make a reservation with priority over other users. Points can be awarded different types and / or different amounts of benefits depending on the information selected. The point calculation method can be set as appropriate, but for example, as the number of information permitted to be used increases, the number of points to be given can be increased. For example, points are set for each information that can be selected, and points are added according to the selected information. For information that has a large psychological resistance due to use, such as image information acquired by an image pickup device, it is possible to give more points than other information. In addition, different types of points can be given depending on the information that is permitted to be used.

Next, the information regarding the confirmed reservation is registered in the server device 2 (step S46). In the server device 2, the date and time of use of the vehicle, the reserved vehicle, and the information permitted to be acquired are recorded in association with the user ID. Further, in the server device 2, the points calculated in step S45 are added in association with the user ID. The reservation process is completed by the process of steps S41 to S46.

In step S44, the user can operate the user terminal 4 to select which information acquisition device 3 is permitted to acquire or use the information, but the server device 1 automatically determines which information acquisition device 3 is permitted to use. In addition, information that is actually acquired or used by the information acquisition device 3 can be selected. For example, the server device 1 can automatically select whether to allow the acquisition or use of information from the information acquisition device 3 according to the user's attributes and the information registered in advance by the user.

In the embodiment described above, when the user makes a reservation for using the vehicle 2, it is determined which information acquisition device 3 is permitted to acquire or use the information, but the user selects the vehicle 2. It may be possible to select which information acquisition device 3 is permitted to acquire or use information at a time different from the time when the use reservation is made. For example, it may be possible to select which information acquisition device 3 is permitted to acquire or use information immediately before, immediately after, or during use of the vehicle 2.

In the embodiment described above, it has been described that the detection system and the space utilization system of the present invention are mainly applied to the car sharing service and the rental car service, but it can also be preferably used in the car leasing service. .. Unlike car leasing, the same user uses the same vehicle for a long period of time, but by using this detection system, the leasing company can grasp the deterioration status of the car body. .. The leasing company can evaluate the vehicle by using the information obtained from the detection system, and can present appropriate resale conditions for resale to the user when the vehicle is returned by the user.

Further, the detection system and the space utilization system of the present invention can detect that a specific event has occurred in a space in a moving body such as a vehicle. For example, it can be used in all spaces such as general households, schools, hospitals, offices, factories, various shops, and public transportation.

According to the present invention, it is provided with at least one computer device, and it is determined whether or not the first information and the second information acquired from a predetermined space satisfy a predetermined condition indicating that a specific event has occurred. Therefore, it is possible to determine with higher accuracy than to determine whether a specific event has occurred based on the information obtained from one sensor or the like.

According to the present invention, the above-mentioned predetermined information depends on whether or not the acquired first information satisfies a predetermined first condition and whether or not the acquired second information satisfies a predetermined second condition. Since it is determined whether or not the condition is satisfied, it is possible to determine with higher accuracy whether or not a predetermined event has occurred in a predetermined space.

According to the present invention, the first information is information about an image obtained by capturing an image of a predetermined space, and the second information is information about a temperature or carbon dioxide concentration in a predetermined space, so that the information is within the predetermined space. It is possible to detect the dozing state of a person in the room or a sign of dozing.

According to the present invention, the first information is information about an image captured in a predetermined space, the second information is information about a thermal image in a predetermined space, and the third information is information about a predetermined space. It is possible to detect the existence of a forgotten object in a predetermined space by the information regarding the carbon dioxide concentration in the above.

According to the present invention, the first information is information about an image captured in a predetermined space, and the second information is information about a thermal image in a predetermined space, so that a person can be placed in the predetermined space. Can be detected to be present.

According to the present invention, the first information is information about an image captured in a predetermined space, the second information is information about a thermal image in a predetermined space, and the third information is information about a predetermined space. It is possible to detect the existence of an animal other than a human in a predetermined space by the information regarding the odor in the above.

According to the present invention, the first information is information about an image captured in a predetermined space, and the second information is information about a thermal image in a predetermined space, so that heat is generated in the predetermined space. It is possible to detect the existence of a person.

According to the present invention, the first information is information about an image captured in a predetermined space, and the second information is information about an odor in a predetermined space, so that a person or an animal can be in a predetermined space. It is possible to detect vomiting.

According to the present invention, as information for determining whether or not a condition indicating that a specific event has occurred in a predetermined space is satisfied, information on a voice generated in the predetermined space is included. Whether or not an event has occurred can be determined with higher accuracy.

According to the present invention, since it is determined whether or not the first information satisfies the predetermined first condition based on the feature amount extracted from the captured image, a predetermined event occurs in the predetermined space. Whether or not it has occurred can be determined with higher accuracy.

According to the present invention, when a user terminal operated by a user who uses a predetermined space and a server device capable of communicating with the user terminal are provided and it is determined that a predetermined condition is satisfied, a specific event occurs. Since the occurrence is transmitted to the user terminal, it is possible to notify the user that a specific event has occurred. Further, according to the present invention, a specific administrator terminal for operating and managing the detection system and a server device capable of communicating with the administrator terminal are provided and it is determined that a predetermined condition is satisfied. Since the fact that an event has occurred is transmitted to the administrator terminal, it is possible to notify the administrator / operator that a specific event has occurred.

According to the present invention, among the information that can be acquired from the information acquisition device installed in the predetermined space, when the user uses the predetermined space, the information that is actually acquired is selected or the predetermined space. Among the information that can be acquired from the information acquisition device installed in the computer device, the information to be calculated by the computer device can be selected. Therefore, which information acquisition device is used to acquire information, or information acquisition, depending on the user who uses the predetermined space and each time the same user uses the predetermined space. You can select which information to use obtained from the device.

According to the present invention, when a privilege is given to a user who uses a predetermined space, a different type and / or a different amount of privilege is given according to the selected information, so that the information in the predetermined space can be obtained. It is possible to give an incentive to the user that many of them are targeted for use by the administrator and that information that the user does not positively want to be targeted for use is targeted for use by the administrator.

According to the present invention, since the privilege can be utilized in connection with the use of the predetermined space by the user, it is possible to encourage the user to use the predetermined space.

1 server device, 2 vehicle, 3 information acquisition device, 4 user terminal,
5 administrator terminal, 6 communication network, 11 control unit, 12 RAM,
13 Storage unit, 14 Communication interface

Claims (4)

Equipped with at least one computer device
A first information acquisition means for acquiring the first information from a predetermined space,
A second information acquisition means for acquiring second information different from the first information from the predetermined space, and
A third information acquisition means for acquiring the first information and the third information different from the second information from the predetermined space.
A condition determination means for determining whether or not the acquired first information, second information, and third information satisfy a predetermined condition indicating that a specific event has occurred in a predetermined space is provided.
The first information is information about an image captured in a predetermined space.
The second information is information about a thermal image in a predetermined space.
The third information is information on the carbon dioxide concentration in a predetermined space.
A detection system in which a specific event is the existence of something left behind in a given space. Equipped with at least one computer device
A first information acquisition means for acquiring the first information from a predetermined space,
A second information acquisition means for acquiring second information different from the first information from the predetermined space, and
A third information acquisition means for acquiring the first information and the third information different from the second information from the predetermined space.
A condition determination means for determining whether or not the acquired first information, second information, and third information satisfy a predetermined condition indicating that a specific event has occurred in a predetermined space is provided.
The first information is information about an image obtained by capturing a predetermined space.
The second information is information about a thermal image in a predetermined space.
The third information is information about odor in a predetermined space.
A detection system in which a specific event is the presence of a non-human animal in a given space. A detection method performed in a detection system including at least one computer device.
The first information acquisition step of acquiring the first information from a predetermined space,
A second information acquisition step of acquiring second information different from the first information from the predetermined space, and
A third information acquisition step of acquiring the first information and the third information different from the second information from the predetermined space, and the third information acquisition step.
It has a condition determination step for determining whether or not the acquired first information, second information, and third information satisfy a predetermined condition indicating that a specific event has occurred in a predetermined space.
The first information is information about an image captured in a predetermined space.
The second information is information about a thermal image in a predetermined space.
The third information is information on the carbon dioxide concentration in a predetermined space.
A detection method in which a specific event is the existence of a forgotten object in a predetermined space. A detection method performed in a detection system including at least one computer device.
The first information acquisition step of acquiring the first information from a predetermined space,
A second information acquisition step of acquiring second information different from the first information from the predetermined space, and
A third information acquisition step of acquiring the first information and the third information different from the second information from the predetermined space, and the third information acquisition step.
It has a condition determination step for determining whether or not the acquired first information, second information, and third information satisfy a predetermined condition indicating that a specific event has occurred in a predetermined space.
The first information is information about an image obtained by capturing a predetermined space.
The second information is information about a thermal image in a predetermined space.
The third information is information about odor in a predetermined space.
A detection method in which a specific event is the presence of a non-human animal in a given space.

Images