JP2010237826A - Monitoring device and system for traveling object - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide the monitoring device of a traveling object, which secures the safety drive of a driver, and suppresses a burglary act in a traveling object without hindering the mobility or air conditioning of a driver's seat or a relation between the driver and a passenger. <P>SOLUTION: There is provided the monitoring device of the traveling object installed in a traveling object for invalidly or validly setting the operation of an object to be controlled. The monitoring device of the traveling object is provided with: an operation restricting part for turning to an invalid state for electrically inhibiting the operation of the object to be controlled or a valid state for releasing the inhibition; an operation part which is operated by the user of the traveling object; a biological information detection part for detecting the biological information of the user; a tension determination part for determining whether the user is put in a tense condition, from the biological information; and a release control part for, when the operation part is operated, and it is determined that the user is not put in the tense condition, outputting a release signal to the operation restricting part to turn to the valid state. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a monitoring device and a monitoring system for a moving body that enables or disables the operation of a controlled object provided in the moving body, and in particular, in a state where a passenger of a moving body can be harmed, The present invention relates to a monitoring device and a monitoring system for a moving body capable of suppressing operation.

In general, business vehicles such as taxis and mobile store vehicles are loaded with certain money items such as sales, fishing and other necessary funds, and operator's money.
In recent years, criminal acts such as so-called taxi robbery in which such business vehicles attack the driver and snatch money loaded are increasing, and this is a social problem.

Conventionally, a countermeasure for protecting the driver by providing a partition such as a panel between the driver's seat and the rear passenger cabin is known. (For example, Patent Document 1)
In Patent Document 1, a partition bar made of an acrylic plate, a wire, or the like is provided between the driver's seat and the rear passenger compartment, and in an emergency, the partition bar is tilted by an operator's operation to restrain passengers in the rear passenger cabin A security device is disclosed.

JP 2006-130951 A

However, such a measure by the partition panel may cause an obstacle or a reflection of light when the operator confirms the rear with a rearview mirror, and there is a risk of hindering safe driving.
That is, when partitioning with a restraining member such as a wire, the rear view is physically obstructed, and when partitioning with a transparent member such as an acrylic plate, there is a problem that it is difficult to confirm the rear due to light reflection.

In addition, the installation of a panel behind the driver's seat makes it difficult for the driver's seat to tilt backwards, making it difficult for the driver to take a break, and separating the driver's seat from the rear passenger compartment, There may be a problem that air convection is hindered between the rear part and air conditioning is difficult to reach the rear passenger seat.
In addition, there is a risk of intimidating the presence of the panel from the passengers in the rear cabin, and the communication between the driver and the passengers may be deteriorated.

  Therefore, the present invention realizes a mobile monitoring device that can secure a safe operation of a driver and suppress robbery in the mobile body without obstructing the movement of the driver's seat, air conditioning, and the relationship with the passenger. Objective.

  In order to achieve the above object, a moving body monitoring apparatus according to the present invention is a moving body monitoring apparatus that disables or enables the operation of a controlled object provided in the moving body, An operation restricting unit that is in an invalid state in which operation is electrically prohibited or an effective state in which the prohibition is canceled, an operation unit that is operated by a user of the mobile object, and physiological information detection that detects physiological information of the user A tension determination unit that determines whether the user is in a tension state from the physiological information, and a release signal to the operation restriction unit when it is determined that the user is not in the tension state when the operation unit is operated. And a release control unit that outputs the signal and makes it valid.

  In such a configuration, the mobile monitoring device determines whether or not there is tension from the user's physiological information, and cancels the prohibition of operation of the controlled object if there is no tension when there is an input operation from the user. A release signal is output to actuate the operation of the controlled object.

According to such a configuration, it becomes possible to enable the operation of the controlled object when the user is not in a tension state, so that a user such as an operator feels some danger or is psychologically unstable. Below, the operation of the controlled object can be prohibited, and unauthorized operation due to criminal acts can be suppressed.
Thereby, it becomes possible to suppress the criminal act in a mobile body, without separating a front seat and a rear cabin. If such a mechanism is widely known, it is recognized that there is a high risk of performing a criminal act in a mobile object, and a further improvement in crime prevention effect can be obtained.

  In addition, preferably, an image acquisition unit that acquires image data from an imaging device that images the inside of the mobile body, a communication unit connected to a remote monitoring center, and the operation unit when the operation unit is operated An image sending unit for sending image data to the monitoring center.

  According to such a configuration, it is possible to monitor the image data of the moving body at the monitoring center when the operation of the controlled object becomes effective by transmitting the image data when the operation unit is operated. If a criminal act or an abnormal situation occurs at this time, it can be immediately handled by the monitoring center, and image recording or the like can be performed.

  Furthermore, preferably, a communication determination unit that determines whether communication by the communication unit is possible, an image storage unit that records the image data when it is determined that communication is impossible when the operation unit is operated, The image sending unit sends the image data recorded in the image storage unit to the monitoring center when the communication becomes possible.

  According to such a configuration, when there is a possibility that communication cannot be performed and image data cannot be transmitted, an image when the operation of the controlled object is enabled is saved and communication is possible later. It can be sent to the monitoring center. As a result, an image when the controlled object is operated under a situation where the image data could not be transmitted can be confirmed later by sending it to the monitoring center, and security can be improved.

  Preferably, the physiological information detected by the physiological information detection unit is at least one of the user's pulse data, blood pressure data, sweat data, blink count data, and line-of-sight movement data, and the tension determination unit includes: The tension is calculated based on the size of the data detected as the physiological information, and it is determined whether or not the user is in a tension state.

  According to this configuration, at least one of pulse data, blood pressure data, sweating data, blink number data, and eye movement number data is detected as physiological information of the user, and the degree of tension is calculated from the size of the detected data. By doing so, it becomes possible to specifically quantify and quantitatively grasp the degree of tension of the user at that time from data closely related to mental tension.

  Further preferably, it further includes a collation unit that determines whether or not the user is a person registered in advance, and the release control unit further includes the use of the collation unit when the operation unit is operated. A release signal is output to the operation restriction unit with a weighting condition that the person is determined to be a person registered in advance.

  According to such a configuration, when it is determined that the occupant of the mobile body is a person registered in advance, it becomes possible to validate the operation of the controlled object, and when the mobile body is stolen or in the mobile body When a suspicious person enters, it is possible to prevent the controlled object from being illegally operated.

  Preferably, the controlled object is an in-vehicle storage that has an opening in a part and allows an article to be input from the outside, and the operation restriction unit is in the in-vehicle storage when in the effective state. The storage can be opened, and when the vehicle enters the invalid state, the in-vehicle storage is locked to the opening prohibition.

  According to such a configuration, it is possible to open the in-vehicle storage for taking out articles thrown in from the opening by enabling the operation, and prohibiting the opening when the operation is disabled. Works. Thereby, it becomes possible to protect this from criminal acts, such as a burglar, by storing in the in-vehicle storage a large amount of bills that are not used as funds required for business such as fishing.

  The monitoring system according to the present invention is a moving body monitoring system including a moving body monitoring device that enables or disables the operation of a controlled object provided in the moving body, and a monitoring center that communicates with the monitoring device. The monitoring device is an invalid state in which the operation of the controlled object is electrically prohibited or an effective state for releasing the prohibition, an operation unit operated by a user of the mobile object, A physiological information detection unit for detecting physiological information of the user; a tension determination unit for determining whether or not the user is in a tension state based on the physiological information; and when the operation unit is operated, the tension is not in the tension state A release control unit that outputs a release signal to the operation restriction unit to make it valid, and the monitoring center stores the monitoring device and information on the moving body in association with each other. The monitoring device And receiving the image data and a notification unit for informing the output, characterized by comprising a display unit, the displaying information of the image data and image sending the monitoring device or mobile.

According to the present invention, an operation of a controlled object can be prohibited under a situation where a user such as an operator feels some danger or is psychologically unstable, and an unauthorized operation due to a criminal act can be suppressed. .
As a result, criminal acts such as taxi robbery can be suppressed without physically separating the front seat and the rear passenger cabin, and the risk of performing criminal acts on mobile objects is widely known. Can be recognized and the crime prevention effect can be further improved.

  In addition, an image when the operation of the controlled object is valid can be sent to the outside according to the communication state, and security can be improved.

The figure which shows the whole structure of the monitoring system of the moving body which concerns on this invention Perspective view showing in-vehicle storage Block diagram showing the configuration of the monitoring device The flowchart which shows operation | movement of the monitoring program of the moving body performed with a monitoring apparatus Flowchart showing the operation of the communication status monitoring program executed by the monitoring device

Embodiments of the present invention will be specifically described below with reference to the drawings.
FIG. 1 is a block diagram showing a moving body monitoring system using the moving body monitoring apparatus of the present invention. The moving body monitoring system includes a taxi vehicle 1 as a moving body, an in-vehicle storage 2 as a controlled object mounted inside the vehicle, a monitoring device 3 provided inside the vehicle, a monitoring device 3 and a wireless communication network. 4 and a center device 5 connected via 4.
In the present embodiment, a taxi vehicle 1 will be described as an example of a moving body. Note that the moving body is not limited to this, and may be any vehicle that can be boarded, such as another vehicle such as a bus or truck, a ship, or an airplane.

FIG. 2 is a perspective view showing the in-vehicle storage 2. The in-vehicle storage 2 has a fixed portion 21 fixed to the passenger compartment 1a, and is installed in a center console between two front seats provided side by side including the driver's seat of the taxi vehicle 1. The in-vehicle storage 2 is provided with a locked storage item extraction door 22, and a space serving as a storage unit 23 is provided inside the storage item extraction door 22. The in-vehicle storage is provided with a bill insertion slot 24 that communicates with the inside and outside of the storage portion 23 and the outside.
The operator of the taxi vehicle 1 inserts the 10,000 yen bill received from the passenger as sales proceeds from the bill insertion slot 24 and stores it in the storage unit 23. That is, 10,000 yen bills are not handed over to passengers as fishing, and are not used as necessary for business. Also, if 10,000 yen bills are stored carelessly, taxi robbers will be attacked. Therefore, in this embodiment, 10,000 yen bills are stored in the in-vehicle storage 2 and the operation of the in-vehicle storage 2 is monitored to suppress the burglary action aiming at the stored items.

  The in-vehicle storage 2 is provided with a locking / unlocking portion 25, and the stored-item take-out door 22 is locked / unlocked by the locking / unlocking portion 25. The locking / unlocking unit 25 is a so-called electric lock, and is connected to the monitoring device 3, and the locking / unlocking is controlled by the monitoring device 3. The locking / unlocking unit 25 is in a locked state in which the operation of the stored item take-out door 22 of the in-vehicle storage 2 is prohibited and the opening is prohibited in a normal state, and the door 22 can be opened when receiving a release signal from the monitoring device 3. Then, the door 22 is activated.

The monitoring device 3 acquires image data, pulse data, and the like of the driver as physiological information of the driver who is a user of the in-vehicle storage 2 from the camera unit 6 and the physiological information sensor 37 in the passenger compartment 1a. And if the operation part 31 is operated by the operator, the monitoring apparatus 3 will calculate whether the operator is tense based on the input physiological information. Thereby, it is determined whether or not the operator is in a tension state. Thus, the monitoring device 3 discriminates whether or not the user is in tension when using the in-vehicle storage 2 and controls the unlocking of the stored item take-out door 22 of the storage 2 if it is determined that the user is not in a tension state. .
For example, when the taxi 1 returns to the garage and takes out the sales, or when the stored 10,000 yen bill is exchanged for passenger fishing, etc., the driver is not in a particular state of tension. The stored item take-out door 22 is unlocked and the stored item can be taken out.

  The monitoring device 3 transmits image data captured by the camera unit 6 to the center device 5 via the wireless communication network 4 when the operation unit 31 is operated and the user attempts to open the storage 2. Thereby, the supervisor of the monitoring center 50 can confirm the image data in the taxi 1, and can monitor the situation in the taxi 1 from the outside.

  The monitoring center 50 is a facility including a center device 5 operated by a security company, a taxi operation management company, or the like. The center device 5 is composed of one or a plurality of computers, and realizes the function of the monitoring center 50 related to the present invention. In the monitoring center 50, the image data received from the monitoring device 3 is recorded, and the received image data and various types of information are displayed on the display, and the monitor constantly monitors the taxi vehicle to be monitored.

  Further, the center device 5 of the monitoring center 50 includes the identification information of the monitoring device 3, vehicle information of the taxi 1 such as the chassis number corresponding to the monitoring device 3, the nomination and face image of the driver, and the mobile phone number of the driver. And a database for storing and managing taxi company information in association with each other. Further, the center device 5 stores and manages the area in charge of the currently working operator and the position information of the vehicle 1 in association with each other.

On the display of the center device 5, corresponding vehicle information and operator information are displayed from the image data received from the monitoring device 3 and the identification information of the monitoring device 3 received together with the image data. Further, the position information received from the monitoring device 3 is displayed on the display of the center device 5. When the center device 5 receives the image data from the monitoring device 3, the center device 5 has notification means for notifying the monitoring staff of this by sound or display.
The monitoring person confirms that the taxi vehicle 1 is normal by looking at the image data. Here, if it is determined that an abnormality has occurred due to a suspicious person, a request is made to the police or a counselor. In addition, the vehicle radio installed in the taxi vehicle 1 gives a warning to stop the crime from a distance.

<Monitoring device>
Next, details of the monitoring device 3 will be described with reference to FIG. FIG. 3 is a block diagram illustrating the configuration of the monitoring device 3.
The monitoring device 3 is arranged near the driver's seat with the operation unit 31 installed under a vehicle dashboard or an instrument panel, and operates by receiving power supply from an in-vehicle battery.
The monitoring device 3 is connected to the camera unit 6 and receives an input of image data in the vehicle interior, a connection unit 33 connected to the locking / unlocking unit 25 of the in-vehicle storage 2, and in-vehicle storage by the user. An operation unit 31 that receives an operation input for starting use of the storage 2, a physiological information sensor 37 as a physiological information detection unit that acquires physiological information of the user, a storage unit 34 that stores image data, a program, and the like, and wireless communication The wireless communication part 35 connected with the center apparatus 5 via the network 4 and the control part 36 which controls these each parts are comprised roughly.

The image acquisition unit 32 functions as an input I / F (interface) that receives image data input from the camera unit 6. The camera unit 6 has a wide-angle lens and is installed on the ceiling of the passenger compartment so that the in-vehicle storage 2 and the operator as a user can take an image in the passenger compartment 1a, and is installed at predetermined intervals (for example, 1/5 second). Output image data.
The connection unit 33 is connected to the locking / unlocking unit 25 of the in-vehicle storage 2 and outputs a release signal or a prohibition signal by processing of the control unit 36 described later. It functions as an input / output I / F that receives input of detection signals for closing and unlocking or locking.

The operation unit 31 is a switch that allows an operation input to start using the in-vehicle storage 2.
The storage unit 34 is configured by a ROM, a RAM, or an HDD, stores identification information for identifying itself, various programs, and the like, and further stores user registration information for identifying a user. In addition, the storage unit 34 stores communication enable / disable information that stores a communication enable / disable determination result that is a predetermined number of past detection results, and an untransmitted flag that indicates that image data to be transmitted to the center device 5 is stored. To do. In addition, the storage unit 34 has an image storage unit that records image data input from the camera unit 6.

The physiological information sensor 37 is a biological information measuring instrument that acquires pulse data while being in close contact with the skin surface of the user, and inputs the acquired pulse data to the control unit 36. In the present embodiment, the physiological information sensor 37 is attached to the user's arm like a wristwatch, and inputs measurement data to the control unit 36 by short-range wireless.
The physiological information sensor 37 is not limited to this, and any physiological information sensor may be used as long as it acquires physiological information whose value is known to change between tension and normal, such as blood pressure data and sweat data. 1 may be used to acquire a plurality of physiological information. Furthermore, it is not limited to the wristwatch type, and may be detected by a scanning means provided in the monitoring device 3, and the scanning means may be provided in the operation unit 31 or embedded in the seating seat.

The wireless communication unit 35 is typically a mobile phone, and is connected to the center device 5 via the base station 41 and the wireless communication network 4. The wireless communication unit 35 includes a communication control unit, and controls communication between the control unit 36 of the monitoring device 3 and the center device 5. Specifically, information such as image data input from the control unit 36 is sent to the center device 5, and when information is received from the center device 5, it is output to the control unit 36.
The wireless communication unit 35 includes position acquisition means such as base station information and GPS, and transmits the acquired current position information to the center device 5 at predetermined intervals. Since the method for acquiring the current position information and periodically transmitting it to the outside is already widely known, detailed description thereof will be omitted.

  The control unit 36 includes a microcomputer including a CPU, a ROM, a RAM, and the like and peripheral circuits thereof, and controls the monitoring device 3. For this purpose, the control unit 36 includes a communication determination unit 361, an image transmission unit 362, a release control unit 363, and a physiological image detection function module implemented by the microcomputer and a computer program executed on the microcomputer. A unit 364, a tension determination unit 366, an operation restriction unit 365, and a collation unit 367. The storage unit 34 described above may be realized by a storage circuit in the control unit 36.

The communication determination unit 361 determines whether or not the wireless communication unit 35 is in a state where it can reliably communicate with the base station 41. Specifically, it is determined whether or not communication is possible based on whether or not negotiation between the wireless communication unit 35 and the base station 41 is established. When the negotiation with the base station 41 is established, it is determined that communication is possible. When the negotiation is not established and the process times out, it is determined that communication is impossible.
Note that the process for determining whether communication is possible may be performed based on the received electric field strength of the radio wave received from the base station 41 via the wireless communication unit 35.
The communication determination unit 361 performs communication determination processing, and stores the result in communication enable / disable information of the storage unit 34.

The image sending unit 362 converts image data sequentially input from the camera unit 6 into a digital signal using an image analog / digital converter, and generates image data that conforms to the JPEG standard as an image compression encoding method using an image compression circuit. . The image compression encoding method may be another standard such as the JPEG2000 standard or the MPEG2 Video standard using continuous interframe information.
Then, the image sending unit 362 outputs the compression-coded image data to the wireless communication unit 35 or the storage unit 34 in response to an input from the release control unit 363. When the image data is input, the wireless communication unit 35 sends the identification information stored in the storage unit 34 together with the identification information to the center device 5. The storage unit 34 stores the image data in the image storage unit. In addition, the image sending unit 362 outputs the compressed and encoded image data to the physiological image detecting unit 364.

When the release control unit 363 receives an input for starting the use of the in-vehicle storage 2 from the operation unit 31, the release control unit 363 uses the physiological information of the user detected by the physiological information sensor 37 and the physiological image detection unit 364 to the tension determination unit 366. The degree of tension is calculated to determine whether or not the person is in a tension state. Further, the collation unit 367 determines whether or not the occupant is a user registered in advance. If it can be determined from the determination result by the tension determination unit 366 that the user is not in a tension state and it can be determined from the determination result of the collation unit 367 that the passenger is a registered user, the information is stored in the storage unit 34. The latest communication availability determination result is referred to. As a result, if communication is possible, the image sending unit 362 is made to send image data. When the image data is sent to the center device 5, a release signal is output to the operation restriction unit 365. If there is an input indicating that the stored item take-out door 22 is locked from the operation restriction unit 365, the transmission of the image data is terminated.
On the other hand, if communication is not possible at this time, the release control unit 363 causes the image sending unit 362 to store the image data in the storage unit 34 and outputs a release signal to the operation restriction unit 365. In this case, if there is an input indicating that the stored item take-out door 22 is locked from the operation restriction unit 365, the release control unit 363 ends the storage of the image data.

The physiological image detection unit 364 functions as a physiological information detection unit that detects user's physiological information from the image data of the camera unit 6. Specifically, in the present embodiment, the physiological image detection unit 364 extracts the eye area of the operator who is the user from the image data captured by the camera unit 6 and compressed and encoded by the image transmission unit 362. Changes in the eye area within a unit time are detected.
The physiological image detection unit 364 captures the input image data in the unmanned state in advance with the current image data in the unmasked region, using the region corresponding to the preset window portion of the vehicle 1 as a mask region. A difference value between pixels corresponding to each other with the background image data is calculated to generate a difference image. Then, the difference image is binarized based on the magnitude of the luminance value of each pixel included in the generated difference image and a predetermined threshold value, and a fluctuation pixel in which the fluctuation of the luminance value is equal to or greater than the threshold value is extracted. A differential binary image is generated. As a result, a fluctuation region composed of fluctuation pixels whose luminance value fluctuation is equal to or greater than the threshold value is extracted. At this time, it is preferable to generate a binary image from which noise has been removed by filtering for expansion / contraction and micro-area exclusion.

  The physiological image detection unit 364 groups substantially continuous variation pixel groups included in the generated difference binary image as one variation region, and labels each variation region with a unique label. Then, an edge image is generated by extracting pixels having a predetermined or higher edge strength for each labeled fluctuation region, and a template matching process is performed using a face or head template stored in advance for the edge image. The physiological image detection unit 364 determines that a region having a predetermined similarity or higher as a result of performing this template matching process for each variation region is a user's face region or head region. Then, the physiological image detection unit 364 searches for an eye region that is an oval region that exists in a substantially horizontal contrast instead of a skin color in the determined face region (head region).

Then, the physiological image detection unit 364 performs tracking processing on the eye region over a predetermined frame (for example, 15 frames) set in advance, and calculates the number of moving pixels that is a variation amount of the pupil (non-white region) in the eye region. By adding for each frame, the total number of moving pixels of the pupil between predetermined frames (15 frames) is detected. This means the total moving distance of the pupil.
In addition, the physiological image detection unit 364 detects the number of frames in which the eye area or pupil cannot be detected between predetermined frames (between 15 frames) tracking the eye area. This means the number of times the user has blinked.
The physiological image detection unit 364 outputs the detected total movement distance of the pupil and the number of blinks to the tension determination unit 366. In addition, an area similar to the extracted face or head is output to the matching unit 367.

  Note that the target to be detected by the physiological image detection unit 364 is not limited to this, as long as it is known that the value changes between tension and normal, such as the amount of change in pupil area between predetermined frames. Either may be sufficient.

When the operation unit 31 is operated, the tension determination unit 366 calculates the user's tension level according to an instruction from the release control unit 363 and determines whether the user is in a tension state. The degree of tension is an initial value of 0 and represents the degree of tension of the user.
The tension determination unit 366 receives the pulse data detected by the physiological information sensor 37, the total pupil movement distance and the number of blinks between predetermined frames detected by the physiological image detection unit 364, The tension is calculated from these data. Specifically, each of the input pulse data, pupil movement distance, and number of blinks is compared with a preset threshold value, and if any data exceeds the threshold value, the tendency to tension And 1 is added to the degree of tension, and when the degree of tension becomes 2 or more, the user determines that it is in a tension state. That is, if any two of the pulse data, the pupil movement distance, and the number of blinks are determined to be a tension tendency, the user is determined to be in a tension state.

It is known that the pulse increases with tension. Generally, the pulse rate when an adult is resting is about 50 to 80 times per minute, and a state exceeding 100 times is a tachycardia. Therefore, in the present embodiment, if the pulse data detected by the physiological information sensor 37 is 100 times or more (tachycardia) in the past one minute, it is determined as a tension tendency and 1 is added to the degree of tension.
It is also known that eye movements increase rapidly due to tension. The threshold value for comparing the total moving distance of the pupils may be set to an arbitrary value from the observation time, the frame rate (1/5 second in this example), the resolution of the image data, and the person area reflected in the image. In the present embodiment, when the vehicle interior is imaged with SXGA size (1280 × 1024 pixels) image data, if the pupil moves 15 pixels or more in 15 frames (3 seconds), it is determined as a tension tendency and the degree of tension is determined. Add one.
It is also known that the number of blinks increases due to tension. Generally, the number of blinks when an adult is at rest is approximately 15 to 20 times per minute. Therefore, in this embodiment, if the number of blinks is 15 or more in 15 frames (3 seconds), it is determined as a tension tendency and 1 is added to the tension degree.

  As described above, the tension determination unit 366 determines whether each of the pulse data, the pupil movement distance, and the number of blinks is a tension tendency, calculates the tension, and the tension is equal to or greater than the majority, that is, 2 If it is above, it will determine with a user being a tension state. Moreover, if it is 1 or less, it will determine with not being a tension | tensile_strength. The determination result as to whether or not it is in a tension state is output to the release control unit 363, and the degree of tension is reset to an initial value.

The collating unit 367 determines whether or not an occupant on the vehicle 1 is a registered user. Specifically, in the present embodiment, the collation unit 367 uses the user registration information included in the user registration information stored in advance in the storage unit 34 for an area similar to the face or head extracted by the physiological image detection unit 364. Compare with face image. For the comparison of face images, for example, the similarity of face information of two faces to be compared is calculated, and if there is an area that exceeds a predetermined threshold by absolute evaluation of the similarity, it is registered in advance. It may be determined that the user is on board, and any other existing technology may be applied.
The determination result of whether or not the occupant is a registered user is output to the release control unit 363. At this time, if a plurality of occupants (regions similar to the face or head) are detected in the vehicle interior 1a by the matching unit 367, the determination result is output for each occupant.

  Note that the user determination process by the collating unit 367 is not limited to this, and it may be determined whether or not the occupant on the vehicle 1 is a registered user by other means. For example, the operation unit 31 may be provided with a reading function such as biometric information such as a fingerprint, a personal identification number, and an IC card, and may perform comparison and collation with user registration information based on information to be input. In this case, user registration information corresponding to information input from the operation unit is stored in advance.

  The operation restricting unit 365 electrically restricts the operation of the in-vehicle storage 2 to be controlled, and enables the operation of the stored item take-out door 22, that is, an invalid state in which opening is prohibited or can be released by releasing this prohibition. Set to the enabled state. When receiving the input of the release signal from the release control unit 363, the operation restriction unit 365 outputs the release signal to the locking / unlocking unit 25 via the connection unit 33.

When receiving the release signal, the locking / unlocking unit 25 unlocks the stored item take-out door 22. Then, the operation restricting unit 365 determines the open / closed state of the stored item take-out door 22 based on the door open / close signal received from the storage 2, and stores the stored item take-out door 22 once opened and then closed. A prohibition signal is transmitted to the locking / unlocking unit 25 so as to lock the object take-out door 22. Further, if the door 22 is not opened even after a predetermined opening allowance time (for example, 2 minutes) has passed after the release signal is transmitted, a prohibition signal is transmitted to the locking / unlocking unit 25. When receiving the input of the prohibition signal, the locking / unlocking unit 25 locks the stored item take-out door 22.
In addition, this locking control may implement | achieve the locking / unlocking part 25 as an automatic locking type electric lock. In this case, the locking / unlocking portion 25 locks the stored item take-out door 22 when the stored item take-out door 22 is once opened and then closes, and the door 22 even after a predetermined opening allowance time (2 minutes) has elapsed. If the door is not opened, the storage door 22 is locked.

<Description of operation>
Next, the operation of the mobile monitoring system configured as described above will be described. FIG. 4 is a flowchart showing the operation of the moving body monitoring program executed by the monitoring device 3.
When the monitoring device 3 is activated, it performs various initial settings and executes such processing. The monitoring device 3 waits for an input from the operation unit 31 (step ST1). When there is an input to start using the in-vehicle storage 2 from the operation unit 31 (step ST1-Yes), the release control unit 363 detects the pulse data detected by the physiological information sensor 37 input to the tension determination unit 366, Then, the degree of tension is calculated from the total moving distance of the pupil between the predetermined frames detected by the physiological image detection unit 364 and the number of blinks. The tension determination unit 366 performs threshold processing corresponding to each of the pulse data, the total moving distance of the pupil, and the number of blinks, determines that the data exceeding the threshold is a tension tendency, and adds 1 to the degree of tension. (Step ST2). Then, if the tension degree is 2 or more, the tension determination unit 366 determines that the user is in a tension state and outputs the determination result to the release control unit 363 (step ST3-Yes), and the release control unit 363 performs processing. Proceeding to step ST14, abnormal output is performed.

On the other hand, if the calculated tension degree is 1 or less, the tension determination unit 366 determines that the user is not in a tension state (step ST3-No), and the release control unit 363 causes the matching unit 367 to determine the user. To determine whether the occupant is a user registered in advance (step ST4).
The collation unit 367 collates the area similar to the face or head extracted by the physiological image detection unit 364 with the face image of the user included in the user registration information stored in the storage unit. If the region similar to the face or head extracted by the physiological image detection unit 364 cannot be verified as a pre-registered user (step ST5-No), the release control unit 363 takes out the stored items. It is determined that the door 22 is prohibited from being opened, and the process ends. At this time, the determination result may be output to the outside from the monitoring device.

  On the other hand, if the region similar to the face or head extracted by the physiological image detection unit 364 can be collated as a pre-registered user (step ST5-Yes), the release control unit 363 determines whether the storage unit 34 can communicate. The latest communication availability determination result stored in the information is referred to (step ST6). If communication is possible (step S7-Yes), the release control unit 363 causes the image sending unit 362 to send the image data input from the camera unit 6 and compression-coded to the center device 5 (step ST8). The image data is transmitted to the center device 5 together with the identification information stored in the storage unit 34. And the cancellation | release control part 363 waits for the response concerning communication connection from the center apparatus 5 (step ST9). If no response data is received even after a predetermined time has elapsed, the processing ends.

  On the other hand, the release control unit 363 receives the response data from the center device 5, establishes communication with the center device 5, and starts sending image data (step ST9-Yes). Output a signal. In response to this, the operation restricting unit 365 outputs a release signal to the locking / unlocking unit 25 of the storage 2 to release the locked state in which the operation is prohibited to enter the unlocked state (step ST10).

The operation restriction unit 365 outputs a prohibition signal that locks the locking / unlocking unit 25 when detecting that the stored item take-out door is opened and closed (step ST11—Yes). Further, when the opening allowable time (2 minutes) elapses after the release signal is transmitted and the door 22 is not opened or closed (step ST12-Yes), whether or not the door 22 can be locked, that is, the door 22 is closed. It is determined whether or not (step ST13). If the door 22 remains open and cannot be locked even after the allowable opening time (2 minutes) has passed (step ST13-No), an alarm signal such as a buzzer is output and an abnormal signal is sent from the wireless communication unit 35 to the center device 5. Is output (step ST14).
On the other hand, when the opening allowable time (2 minutes) has passed without the door 22 being opened (step ST13—Yes), the operation restriction unit 365 outputs a prohibition signal for locking the locking / unlocking unit 25 (step ST15).
Then, the release control unit 363 causes the image transmission unit 362 to end the image data transmission process (step ST16), and ends the process.

As described above, the monitoring device 3 is based on the operation input from the operator, and the operator is nervous from the physiological state such as whether the pulse of the operator is remarkably high, the eyeball is moving rapidly, or the number of blinks is remarkably high. It is determined whether it is in a state, and on the condition that it is not in a tension state, a signal is sent to the locking / unlocking portion 25 of the storage 2 so that the stored item take-out door 22 can be unlocked. As a result, in the situation where the operator is in a tense state due to an emergency situation such as taxi robbery, it is prohibited to take out the 10,000 yen bills stored in the storage, and to suppress illegal acts such as taxi robbery Is possible.
Further, when the person in the vehicle is determined to be a passenger registered in advance, the operation restriction unit 365 can open the in-vehicle storage 2 so that the vehicle theft and roughing can be performed in a vehicle without a valid passenger. It is possible to prevent the in-vehicle storage 2 from being opened.
Furthermore, by transmitting the image data at this time to the center device, it becomes possible to take out the 10,000 yen bill stored in the storage 2 and use it for exchange etc. in a situation monitored by a remote third party. In addition, fraudulent acts such as taxi robbery can be suppressed.

  A case where it is determined in step ST7 that communication is impossible will be described. When the operator is not in a tension state, the release control unit 363 has an input to start using the in-vehicle storage 2 and if the communication is impossible at this time, the image transmission unit 362 outputs image data to the image storage unit to generate an image. Data storage is started (step ST17). Then, the release control unit 363 outputs a release signal to the operation limiting unit 365 when image data storage is started. In response to this, the operation restricting unit 365 outputs a release signal to the locking / unlocking unit 25 of the storage case 2 to release the locked state in which the operation is prohibited to enter the unlocked state (step ST18).

  The operation restriction unit 365 monitors the opening and closing of the stored item take-out door 22 and the allowable opening time. Steps ST19 to ST22 are the same as steps ST11 to ST15 that have already been described, and therefore redundant description is omitted. That is, if the use of the storage 2 is completed and the lock can be locked, the stored item take-out door 22 is locked and the process proceeds to step ST23. When the allowable opening time elapses without being locked, an abnormal output is output in step ST14. Done. If communication is not possible at this time, output of an abnormal signal is suspended and output when communication is possible.

  In step ST23, the cancellation control unit 363 ends the output of the image data from the image transmission unit 362 to the image storage unit, and ends the storage of the image data. Then, the non-transmission flag in the storage unit 34 is established and the process is terminated (step ST24). The untransmitted flag is a flag that means that image data to be transmitted to the center device 5 is stored.

  In this way, the monitoring device 3 stores the image data at this time when the operator is not in a tension state and the image data of the vehicle interior 1a cannot be sent to the monitoring center 50. As a result, it is possible to confirm the situation where the in-vehicle storage 2 is opened in a situation where it cannot be confirmed by a third party from the recorded image data, and it is possible to ensure the evidence and improve the security. It becomes.

Next, communication state monitoring processing will be described. FIG. 5 is a flowchart showing the operation of the communication status monitoring program executed by the monitoring device 3. This process may be executed in parallel with the moving body monitoring program shown in FIG.
The communication determining unit 361 determines whether or not the wireless communication unit 35 can communicate with the base station 41 at predetermined intervals (for example, 1 second) (step ST51). If it is determined that communication is impossible (step ST52-No), the current time and communication impossibility are stored in the communication availability information of the storage unit 34 (step ST53), and the process is terminated.

  On the other hand, if it can be determined in step ST52 that communication is possible (step ST52-Yes), the communication determination unit 361 stores the current time and communication possible in the communication availability information in the storage unit 34 (step ST54), and stores it in the communication availability information. It is confirmed whether or not the communication status of the immediately preceding communication is impossible (step ST55). If the previous communication state is incapable of communication (step ST55-Yes), the communication determination unit 361 checks the state of the untransmitted flag in the storage unit 34 (step ST56). If the unsent flag is ON, that is, if there is image data recorded during a period during which communication was not possible (step ST56-Yes), the image data stored in the image storage unit is transmitted from the wireless communication unit 35 to the center device. 5 (step ST57). The image data is transmitted to the center device 5 together with the identification information stored in the storage unit 34. When the transmission ends (step ST58-Yes), the image data that has been transmitted is deleted from the image storage unit (step ST59), the untransmitted flag is turned off (step ST60), and the process ends.

  In this way, the monitoring device 3 can communicate with the monitoring center 5 the image data recorded when the stored item take-out door 22 operates in a situation where the image data of the vehicle interior 1a cannot be sent to the monitoring center 5. Send. Thereby, it becomes possible to confirm appropriately the situation where the in-vehicle storage 2 was opened under the situation that cannot be confirmed by a third party, and the evidence can be ensured.

The embodiment of the mobile monitoring system has been described above.
In addition, although the said embodiment demonstrated the example which made the to-be-controlled object the vehicle-mounted storage, it is not limited to this. In other words, any device may be used as long as it is not preferable to be operated by a user other than a valid user such as an operator. A typical example is vehicle ignition. In this case, the vehicle ignition may be controlled and the operation may be permitted only when the user is not in a tension state.

In the above-described embodiment, the physiological information detection unit has been described as an example in which the acquisition of contact-type physiological information by a physiological information sensor and the acquisition of physiological information by contact by a physiological image detection unit are used. It is not limited. That is, using only one of data detected by contact with the user's skin such as pulse, blood pressure, and sweating, and data detected by contact such as blinking, eye movement, and pupil area change amount in advance. It may be determined whether or not the patient is in a tension state by the set threshold processing, and at least one physiological information that serves as an index for tension determination may be used.
In addition, those skilled in the art can use various modifications in accordance with the embodiment to be implemented within the scope of the present invention.

DESCRIPTION OF SYMBOLS 1 Vehicle 1a Vehicle interior 2 Car-mounted storage 21 Fixing part 22 Storage thing taking-out door 23 Storage part 24 Bill insertion slot 25 Locking / unlocking part 3 Monitoring apparatus 31 Operation part 32 Image acquisition part 33 Connection part 34 Storage part 35 Wireless communication part 36 Control Section 37 Physiological information sensor 4 Wireless communication network 41 Base station

Claims (7)

A monitoring device for a moving body that disables or enables an operation of a controlled object provided in the moving body,
An operation restricting unit for electrically disabling the operation of the controlled object and an effective state for releasing the prohibition;
An operation unit operated by a user of the moving body;
A physiological information detector for detecting physiological information of the user;
A tension determination unit that determines whether or not the user is in a tension state from the physiological information;
When it is determined that the operation unit is not in the tension state, a release control unit that outputs a release signal to the operation restriction unit to make it valid, and
A moving body monitoring apparatus comprising:
further,
An image acquisition unit that acquires image data from an imaging device that images the inside of the moving body;
A communication unit connected to a remote monitoring center;
The mobile monitoring apparatus according to claim 1, further comprising: an image sending unit that sends the image data to the monitoring center when the operation unit is operated.
further,
A communication determination unit for determining whether communication by the communication unit is possible;
An image storage unit that records the image data when it is determined that communication is impossible when the operation unit is operated,
The mobile image monitoring apparatus according to claim 2, wherein the image sending unit sends the image data recorded in the image storage unit to the monitoring center when the communication becomes possible.
The physiological information detected by the physiological information detection unit is at least one of the user's pulse data, blood pressure data, sweat data, blink count data, and eye movement data,
The mobile body according to any one of claims 1 to 3, wherein the tension determination unit calculates a degree of tension based on the size of data detected as the physiological information, and determines whether or not the user is in a tension state. Monitoring device.
Furthermore, a collation unit for determining whether the user is a person registered in advance is provided,
When the operation unit is operated, the release control unit outputs a release signal to the operation restriction unit with a weighting condition that the user is determined to be a pre-registered person by the verification unit. The moving body monitoring apparatus according to claim 1.
The controlled object is an in-vehicle storage that has an opening in a part and can input an article from outside,
The monitoring of the moving body according to any one of claims 1 to 5, wherein the operation restriction unit enables the in-vehicle storage to be opened when the effective state is entered, and locks the in-vehicle storage to be prohibited from being opened when the invalid state is entered. apparatus.
A moving body monitoring system comprising: a moving body monitoring device configured to enable or disable the operation of a controlled object provided in the moving body; and a monitoring center communicating with the monitoring device.
The monitoring device
An operation restricting unit that electrically disables the operation of the controlled object or an effective state that releases the prohibition, an operation unit that is operated by a user of the mobile object, and detects physiological information of the user A physiological information detecting unit, a tension determining unit that determines whether or not the user is in a tension state from the physiological information, and the operation restriction when it is determined that the user is not in the tension state when the operation unit is operated. A release control unit that outputs a release signal to the unit to make it valid, and
With
The monitoring center is
A storage unit that stores the monitoring device and information on the moving body in association with each other, a notification unit that outputs a notification when image data is received from the monitoring device, and the image data and information on the monitoring device or moving body that has transmitted the image. A display unit to display;
A moving body monitoring system comprising:

Images