JP7289165B1 - Information processing system and program, etc. - Google Patents

Abstract

A mechanism for controlling a photographing device that creates video data of at least one of the interior and exterior of the vehicle based on the state or action of a person using the vehicle, and a reservation information system for a predetermined service. Information is acquired, and based on the reservation information, there is provided a mechanism for managing image data of photographing devices mounted on a plurality of the vehicles. SOLUTION: An information processing system has a function of controlling a photographing device that creates video data of at least one of the interior and exterior of the vehicle based on the state or action of a person using the vehicle. [Selection drawing] Fig. 8

Description

The present invention relates to an information processing system, a program, and the like.

As a background art of this technical field, there is Japanese Patent Laying-Open No. 2018-160135 (Patent Document 1). In this publication, it is stated that "the alerting device 10 when getting out of the vehicle is a system mounted on an automatic driving vehicle, and includes a front external sound acquisition microphone 22, a rear external sound acquisition microphone 23, a front camera 24, a rear camera 25, a camera 26, equipped with a front external sound speaker 31, a rear external sound speaker 32, a first indicator 33, and a second indicator 34, and notifies inside or outside the vehicle of a warning when passengers get off the vehicle. It is used for.” (see abstract).

JP 2018-160135 A

The conventional system has various problems, for example, in Patent Literature 1, no consideration is given to a mechanism for controlling the photographing device based on the state and motion of the person using the vehicle.

SUMMARY OF THE INVENTION In view of the above problems, one of the objects of the present invention is to provide a system or the like that is superior to the conventional system, such as a mechanism for controlling photographing equipment based on the state or motion of a person using a vehicle. Another object of the present invention is, for example, to acquire reservation information from a reservation information system for a predetermined service, and based on the reservation information, image data of photographing equipment mounted on a plurality of the vehicles. It is to provide a system that is superior to the conventional system, such as a mechanism for management.

The object of the present invention is not limited to this, and we have the intention to acquire rights by divisional application, amendment, etc. for the structure aiming to obtain the effect of the structure disclosed in the specification and drawings. For example, the present specification discloses a problem in which the descriptions such as "can do", "possible", etc. are replaced with "is a problem". The problems are described as independent ones, and we intend to acquire the rights for the structure for solving each problem independently by filing a divisional application, an amendment, etc. Even if the problem is implicitly grasped from the description of the specification, the applicant intends to claim part of the configuration described in this specification in an amended or divisional application. It also discloses a configuration that solves a problem that combines these independent problems, and has the intention to acquire the right.

In order to solve the above problems, for example, the configurations described in the claims are adopted.
The present application includes a plurality of means for solving the above problems, and one example is to create image data of at least one of the interior and exterior of the vehicle based on the state or action of the person using the vehicle. It is characterized by having a function of controlling an imaging device. To give another example, it has a function of acquiring reservation information from a reservation information system for a predetermined service, and managing video data of photographing equipment mounted on a plurality of vehicles based on the reservation information. characterized by

According to the present invention, a mechanism for controlling a photographing device that creates at least one of video data of the inside or outside of a vehicle based on the state or action of the person using the vehicle, or the state or action of the person using the vehicle An information processing system superior to the conventional one, such as a mechanism for acquiring reservation information for a predetermined service based on the above, and managing video data of shooting equipment mounted on a plurality of the vehicles based on the reservation information. etc. can be provided.
Problems, configurations, and effects other than those described above will be clarified by the following description of the embodiments.

In addition, the effect of the invention of the present application is not limited to this, and the effect exerted by the parts of the structure disclosed in the specification and drawings, etc. is also disclosed, and the structure exerting the effect is also obtained by divisional application, amendment, etc. Intend to acquire rights. For example, in this specification, the places described as "can do", "can be", etc. are descriptions that clearly show the effect, and even if there is no description such as "can be done", "can be done", etc. There are parts shown. Moreover, even without such a description, there is an effect that can be grasped by the configuration.

FIG. 1 is an explanatory diagram for explaining the installation positions, shooting directions, etc. of shooting devices 101 (101F, 101R) and vehicle interior shooting cameras 102 (102F, 102R) in a vehicle 10 in the system of the present embodiment. For example. FIG. 2 is an example of a connection diagram between the photographing equipment 101 (101F, 101R) and the network 103. As shown in FIG. FIG. 3 shows an example of the hardware configuration of the photographing equipment 101 (101F, 101R) connected to the vehicle interior photographing camera 102 (102F, 102R). FIG. 4 is an example of the hardware configuration of the reservation management server 104. As shown in FIG. FIG. 5 is an example of the hardware configuration of the facility terminal 105. As shown in FIG. FIG. 6 is an example of the hardware configuration of the user terminal 106. As shown in FIG. FIG. 7 is an example of the hardware configuration of the external management server 107. As shown in FIG. FIG. 8 is an example of a control flow 800 of the imaging equipment 101 (101F, 101R). FIG. 9 is an example flow 900 for identifying a person's state or action. FIG. 10 is an example of another human state or action identification flow 1000 . FIG. 11 is an example of another control flow 1100 for the imaging equipment 101 (101F, 101R). FIG. 12 is an example of a vehicle state identification flow 1200 . FIG. 13 is an example of a cooperation flow 1300 with a reservation information system. FIG. 14 shows an example of facility terminal 105 connected to processing device 108 . FIG. 15 is an example of an operation screen 1500 of the facility terminal viewer. FIG. 16 is an example of another operation screen 1600 of the facility terminal viewer. FIG. 17 is an example of a preview screen 1700 of the facility terminal viewer. FIG. 18 is an example of a map information screen 1800 of the facility terminal viewer. FIG. 19 is an example of a preview screen 1700 of a facility terminal displaying video information 524 subjected to privacy protection processing. FIG. 20 is an example of a display screen 2000 of a user terminal displaying video information 524 subjected to privacy protection processing. FIG. 21 is an example of a preview screen 1700 of the facility terminal 105 displaying different situations with the same distance between passengers. FIG. 22 is an example of the hardware configuration of the processing device 108. As shown in FIG.

EMBODIMENT OF THE INVENTION Hereinafter, the form for implementing this invention is demonstrated with reference to drawings. The embodiment shown below is one embodiment that provides the present invention, and the content of the present invention should not be construed as being limited based on the following description.
In addition, in the following description, based on the state or action of the person using the vehicle, individual Although the components will be specifically described, the components of this system are not limited to them, and other configurations and modes can be used as long as they can perform the functions described in relation to the individual components. It doesn't matter if it is.
Further, the video data may be data constituting either a still image or a moving image, but moving image data is particularly preferable. The term "image" in the following description may be a still image (still image) or a moving image (moving image) viewed by the human eye. Furthermore, it is preferable that the video data include audio data.

Furthermore, the control of the photographic equipment involves changing and adjusting the parameters of video data shot by the photographic equipment, changing the operation mode of the photographic equipment, starting and stopping the functions of the photographic equipment, and controlling the connection with the photographic equipment. It may also be control related to a device that cooperates with the device or the imaging equipment.

Note that each mode may be a combination of one or more functions. For example, one operational mode may be the ability to operate the imaging device with at least one operational feature of the imaging device enabled.

FIG. 1 is an example of an explanatory diagram for explaining the installation positions, shooting directions, etc. of shooting devices 101 (101F, 101R) and vehicle interior shooting cameras 102 (102F, 102R) in a vehicle 10 in the system of the present embodiment. be.
1(a) is a side view of the vehicle 10, and FIG. 1(b) is a top view of the vehicle 10. FIG.

As shown in FIGS. 1(a) and 1(b), the vehicle 10 has two photographing devices 101 (101F, 101R) in front and rear of the passenger compartment.
In the embodiment of FIG. 1, vehicle interior photography cameras 102 (102F, 102R) are attached to the photographing equipment 101 (101F, 101R) side by side in the left-right direction of the vehicle 10 .

The front vehicle interior photographing camera 102F is mounted on the front side of the vehicle 10. For example, when viewed in the front-rear direction of the vehicle 10, at least in the vehicle interior of the vehicle 10, it is preferable to be mounted on the front side of the center in the front-rear direction. . The front side of the vehicle interior of the vehicle 10 is advantageously located, particularly in the range between the headrests and backrests of the front seats and the windshield, and is particularly preferred for attachment to the windshield.

The rear vehicle interior photography camera 102R is mounted on the rear side of the vehicle 10. For example, when viewed in the front-rear direction of the vehicle 10, at least in the vehicle interior of the vehicle 10, it is preferable to be mounted on the rear side of the center in the front-rear direction. . The rear side of the vehicle interior of the vehicle 10 is advantageously arranged, particularly in the range between the position of the headrests and backrests of the rear seats and the rear glass.
The vehicle interior photography cameras 102 (102F, 102R) are mounted in a state of being mechanically and electrically connected to the photography equipment 101 (101F, 101R).

The photographing device 101 (101F, 101R) is an electronic device having a photographing function, and may be a camera provided for the purpose of crime prevention, surveillance, or other sensing purposes. The best thing is the drive recorder itself.

In the embodiment of FIG. 1, the front photographing device 101F provided in front of the passenger compartment photographs the outside of the front of the vehicle, and the front camera 102F for photographing the vehicle interior photographs the inside of the vehicle from the front to the rear of the passenger compartment. However, the front photographing device 101F may photograph the interior of the vehicle from the front to the rear of the vehicle interior, and the front camera 102F for photographing the interior of the vehicle may photograph the front exterior of the vehicle.
Similarly, the rear photographing device 101R provided at the rear of the passenger compartment photographs the exterior of the rear of the vehicle, and the rear camera 102R for photographing the vehicle interior photographs the interior of the vehicle from the rear of the passenger compartment to the front. The rear photographing device 101R may photograph the inside of the vehicle from the rear to the front of the vehicle, and the rear camera 102R for photographing the interior of the vehicle may photograph the rear exterior of the vehicle.

Instead of the embodiment of FIG. 1, a simpler configuration may be adopted in which a single imaging device 101F is used to photograph both the exterior and interior of the vehicle, and a single imaging device 101R is used to photograph both the exterior and interior of the vehicle. good. Alternatively, vehicle 10 may have only one of image capture equipment 101F or image capture equipment 101R, and may have only one of cameras 102F or 102R, or camera 102 (as described above). 102F, 102R).
In addition to the embodiment shown in FIG. 1, a configuration for executing more diverse information processing may be adopted by adding another photographing device, another camera for photographing outside the vehicle, a camera for photographing inside the vehicle, or the like.
The information processing system according to the present application may be configured such that a plurality of photographing devices 101 (101F, 101R) and cameras 102 (102F, 102R) provided in the vehicle 10 are controlled by the control unit of the vehicle 10. FIG.

In addition to the embodiment of FIG. 1, the inside of the vehicle 10 may be photographed by the photographing equipment 101 (101F, 101R), and the exterior of the vehicle 10 may be photographed by the vehicle interior photographing cameras 102 (102F, 102R).

Examples of the arrangement, shooting direction, etc. of the shooting devices 101 (101F, 101R) and the vehicle interior shooting cameras 102 (102F, 102R) have been described above. Examples of functions, roles, etc., of the photographing devices 101 (101F, 101R) and the vehicle interior photographing cameras 102 (102F, 102R) will be described below.
In the following description, a configuration in which each process is mainly executed by the control unit 303 of the imaging device 101 (101F, 101R) will be described. It is also possible to Furthermore, processing that does not need to be executed in the vehicle 10 while the vehicle 10 is in use can be executed by a control unit other than the control unit 303 alone.

By using the photographing equipment 101 (101F, 101R) and the vehicle interior photographing cameras 102 (102F, 102R) as shown in FIG. can specify the state and operation of the vehicle 10

In the embodiment of FIG. 1, the vehicle 10 is provided with an accommodation space 110 . The accommodation space 110 accommodates a storage medium for storing image data captured by the imaging equipment 101 (101F, 101R) and the vehicle interior imaging cameras 102 (102F, 102R).
Note that the storage medium is an example of a recording medium, and the storage space 110 is an example of a storage medium storage section.

The accommodation space 110 is preferably provided at a position where it is difficult for an occupant of the vehicle 10 to visually recognize it while riding in the vehicle 10. For example, the accommodation space 110 is configured as a protective case or the like provided in the trunk or under the seat. Good.

Storage media housed in the housing space 110 are connected to the photographing equipment 101 (101F, 101R) and the vehicle interior photographing cameras 102 (102F, 102R) via cables 120 which are also part of the network 103. FIG.
As a result, the storage medium accommodated in the accommodation space 110 stores at least a part of the image data captured by the imaging equipment 101 (101F, 101R) and the vehicle interior imaging cameras 102 (102F, 102R). It is preferable to be configured so that it can be set as a storage destination for video data in which actions are recorded.

In this way, the accommodation space 110 and the storage medium accommodated in the accommodation space 110 are provided separately from the photographing equipment 101 (101F, 101R) and the vehicle interior photographing cameras 102 (102F, 102R). As a result, the storage medium becomes hidden. In particular, the storage space 110 may be hidden during normal use of the vehicle 10 .
Further, it is preferable that the accommodation space 110 is lockable so that anyone other than the administrator cannot take out the storage medium or touch the storage medium.

The control unit 303 of the imaging device 101 (101F, 101R) communicates the image data stored in the storage medium accommodated in the accommodation space 110 via the wireless network 103, for example, via a wireless LAN. It is preferable that the data can be transferred to the facility terminal 105, the external management server 107, or the like based on radio waves.
Accordingly, the user does not have to unlock or open/close the storage space 110 in order to obtain the video data stored in the storage medium stored in the storage space 110, which is preferable.

By doing so, for example, when the vehicle 10 is used for providing a service, and a plurality of people use the vehicle 10 in turn or alternately, and an accident occurs in the vehicle 10 Even if the person who has caused the problem behavior tries to dispose of the video data together with the storage medium, the administrator can easily keep securing the video data more safely.
Then, for example, even if the administrator notices the occurrence of the problem behavior after some time, it becomes easier for the administrator to confirm who caused the problem behavior from among the plurality of persons.

In this specification, expressions such as "a plurality of people use the vehicle 10 in turn or alternately" mean that the occupant changes each time the vehicle 10 is used, or that the vehicle 10 is used from the start to the end of use. change of driver or other occupant during a single use of the vehicle, e.g., change of driver or occupant other than the driver, or use by different occupants during a period of time; It means that the person who uses the vehicle 10 alternates between weekdays and holidays, etc. Furthermore, not only one vehicle 10 but also a plurality of vehicles 10 are operated by a plurality of people alternately or alternately. is also meant to be used for

In addition to the above, the storage space 110 may be placed in a safer position in the collision safety test of the vehicle 10 . As a result, for example, even if the built-in storage unit of the photographing equipment 101 (101F, 101R) is damaged due to a collision accident or the like, the possibility that the storage medium accommodated in the storage space 110 can maintain the backup data increases. , it is very useful for verification of the situation after the accident.

In FIG. 1, the vehicle 10 is illustrated as a four-wheeled passenger car, but the vehicle 10 is a vehicle capable of mounting photographing equipment 101 (101F, 101R) and vehicle interior photographing cameras 102 (102F, 102R). or a moving object.

The vehicle 10 is, for example, a bus (such as a shuttle bus, a sightseeing bus, a long-distance bus, an articulated bus, etc.) or a truck that is a large vehicle with four or more wheels, or a vehicle such as a two- or three-wheeled motorcycle or buggy. Welfare vehicles, ambulance vehicles, disaster response vehicles, other special vehicles operated by local governments and ministries, and special vehicles such as forklifts, cranes, trailer trailers, heavy machinery and earthworking machines. , may be

The driving system of the vehicle 10 may be an internal combustion engine, but it is better to use an electric motor or the like, particularly an xEV vehicle or the like, from the viewpoint of ease of electrification of the vehicle 10 .
xEV refers to BEV (Battery Electric Vehicle), HEV (Hybrid Electric Vehicle), PHEV/PHV (Plug-in Hybrid Electric Vehicle/Plug-in Hybrid Vehicle), FCEV/FCV (Fuel Cell Electric Vehicle/Fuel Cell Vehicle). ) is a general term for motorized vehicles such as

Furthermore, the vehicle 10 may be a bicycle, in particular a bicycle with a carrier attached, or a trolley that is manually transported, in particular a trolley with a container with an openable part.
It may be a vehicle of a transportation system such as a train, bullet train, monorail, linear motor car, streetcar or tram.

Furthermore, when the embodiments described below can be applied in the same or similar manner, not only those that move on land routes, but also aircraft, ships, research ships, submersibles, etc. that move on air routes, sea routes, and undersea, sports A device such as an exercise bike (registered trademark) such as a gym or a running machine may be regarded as the vehicle 10 .
When the vehicle 10 described above is used alternately by a plurality of persons, various controls of the photographing equipment 101 (101F, 101R), which will be described later, are more effective, which is better.

Each terminal and management server of the information processing system may be, for example, a portable terminal (mobile terminal) such as a smartphone, tablet, mobile phone, or personal digital assistant (PDA), or a wearable device such as glasses type, wristwatch type, or clothing type. It can be terminal. It may also be a stationary or portable computer, or a server arranged on a cloud or network. Also, the function may be a VR (Virtual Reality) terminal, an AR (Augmented Reality) terminal, or an MR (Mixed Reality) terminal. Alternatively, it may be a combination of these terminals. For example, a combination of one smart phone and one wearable terminal can logically function as one terminal. Information processing terminals other than these may also be used.

Each terminal and management server of the information system has a processor that executes an operating system, applications, programs, etc., a main storage device such as RAM (Random Access Memory), an IC card, a hard disk drive, and an SSD (Solid State Drive). , auxiliary storage devices such as flash memory, communication control units such as network cards, wireless communication modules, mobile communication modules, etc., and input devices such as touch panels, keyboards, mice, voice input, and input by motion detection by imaging the camera unit. , and an output device such as a monitor or display. The output device may be a device or terminal that transmits information for output to an external monitor, display, printer, device, or the like.

Various programs and applications (modules) are stored in the main storage device, and each functional element of the entire system is realized by the processor executing these programs and applications. Note that each of these modules may be implemented by hardware by integration or the like. Each module may be an independent program or application, or may be implemented in the form of a partial subprogram or function in one integrated program or application.

In this specification, each module is described as an entity (subject) that performs processing, but actually a processor that processes various programs and applications (modules) executes processing.
Various databases (DB) are stored in the auxiliary storage device. A "database" is a functional element (storage unit) that stores a set of data so as to support arbitrary data manipulation (eg, extraction, addition, deletion, overwriting, etc.) from a processor or external computer. The database implementation method is not limited, and may be, for example, a database management system, spreadsheet software, or a text file such as XML or JSON.

FIG. 2 is an example of a connection diagram between the photographing equipment 101 (101F, 101R) and the network 103. As shown in FIG.
In the embodiment of FIG. 2, the photographing equipment 101 (101F, 101R) is connected via the network 103 to the vehicle interior photographing cameras 102 (102F, 102R), the reservation management server 104, the facility terminal 105, the user terminal 106, the external management It is connected to the server 107 and the processing device 108 .
Network 103 may be a combination of wired and wireless connections.
In the following description, a configuration in which the facility terminal 105 is the first external device will be mainly described. It is an example of an external device. As will be described later, the user terminal 106 is also an example of a second external device.

FIG. 3 shows an example of the hardware configuration of the photographing equipment 101 (101F, 101R) connected to the vehicle interior photographing cameras 102 (102F, 102R).
The imaging equipment controller 302 (DVR controller 302) includes a camera 304 for mainly capturing images outside the vehicle, particularly including the area directly in front of or immediately behind the vehicle, an acceleration sensor 305, an SD card 306, a GNSS sensor 307, an input/output unit 315, and the like. It is connected to other sensors, etc., and controls them. In addition, based on the information received from these elements, the imaging equipment controller 302 generates status information indicating the state of the imaging equipment controller 302 . Also, the imaging equipment controller 302 transmits the generated status information to the microcomputer 301 .

The photographing equipment controller 302 is connected via an input/output unit 315 to the vehicle interior photographing cameras 102 (102F, 102R) that photograph the interior of the vehicle from the front to the rear or from the rear to the front, which are different from the camera 304. It is
The microcomputer 301 performs, for example, the following various processes.
• Control the communication processing unit 314 .
- The position information acquired by the communication processing unit 314 is notified to the imaging device controller 302 .
The status information acquired from the imaging device controller 302 and the position information acquired from the communication processing unit 314 are converted into 16-byte data, for example.
・Sleep control is performed when the secondary battery is driven.
• Execute the test mode during manufacturing and testing.

The microcomputer 301 is programmable, and the microcomputer 301 stores a program for executing the various processes described above. By executing the program by the processing unit of the microcomputer 301, the various processes described above are realized. do. In this embodiment, the processing unit of the microcomputer 301 and the microcomputer 301 itself may be called a control unit 303 .

Note that the photographing equipment controller 302, the microcomputer 301, and the communication processing unit 314 can each be implemented by an integrated circuit (chip) such as SoC (System on a chip), or a plurality of these can be integrated into one chip. It may be configured to be implemented in In particular, in the present embodiment, the photographing equipment controller 302 and the microcomputer 301 operate in cooperation, so they may be mounted together in one chip.

Alternatively, the microcomputer 301 may execute some of the functions of the imaging equipment controller 302 , or the imaging equipment controller 302 may execute some of the functions of the microcomputer 301 . In this embodiment, the photographing equipment controller 302 and the microcomputer 301 are collectively called a control unit 303 . The control unit 303 may be one chip, or may be composed of a plurality of chips in which the functions of the photographing equipment controller 302 and the microcomputer 301 are divided.

By installing an AI processing function that performs pre-processing in the image sensor of the camera 304, the following output, for example, may be performed along with or instead of generating a normal captured image. The AI processing function has a function of performing image recognition based on the images captured by these cameras 304 .
・Output the object in the image as metadata.
- Output an ISP (Image Signal Processor) output format, such as a YUV or RGB image.
・Output an image that is cut out only in a specific area.
The AI processing function described above may be configured to perform similar processing on video data transmitted from the vehicle interior imaging cameras 102 (102F, 102R).

By performing pre-processing on the image sensor side in this way, it becomes possible to reduce the amount of data and real-time tracking of an object by high-speed AI processing.
For example, if the imaging device 101 is equipped with an AI processing function that performs preprocessing on the image sensor of the camera 304, the imaging device 101 (101F, 101R) independently executes video processing and image processing, 101 (101F, 101R) may be configured to create image information of ideal image quality.
The same processing can be performed on the video data transmitted from the vehicle interior photography cameras 102 (102F, 102R), and by updating the photography equipment 101 (101F, 101R), the connected vehicle interior photography cameras 102 (102F, 102R) may be configured to add processing according to the model and type.

The acceleration sensor 305 detects acceleration and generates acceleration information. For example, the control unit 303 detects the occurrence of an event when there is a sudden change in acceleration due to an impact, sudden steering, sudden stop, or the like. The control unit 303 may be configured to estimate a situation such as an accident that has occurred in an automobile or the like by analyzing changes in the acceleration information.
The SD card 306 is a storage device for recording various information such as image information and recording information corresponding to the image information. Note that the memory is not limited to the SD card, and any configuration that can store data may be used, but a flash memory with high vibration resistance is preferable for being mounted on a vehicle.

The communication processing unit 314 transmits the information of the imaging device 101R to the user terminal 106 via the wireless communication antenna 308 and the network.
The GNSS sensor 307 has a position information acquisition unit implemented by an integrated circuit or the like, and based on the signal received from a GNSS antenna compatible with a GNSS (Global Navigation Satellite System) such as a GPS (Global Positioning System). to obtain location information. Also, the position information acquisition unit may be configured to acquire time information, moving speed information, and moving direction information.

The imaging device 101R has a power supply 311 connected to the vehicle power supply 310 .
The power supply 311 supplies power received (or sometimes referred to as power reception) from the vehicle power supply 310 to the imaging equipment controller 302 and charges the secondary battery 312 . Note that an input/output unit 315 (to be described later) may also be configured to supply electric power.

The secondary battery 312 is, for example, a rechargeable battery such as a lithium ion battery, a nickel-cadmium battery, a nickel-hydrogen battery, or a lead-acid battery. However, a non-rechargeable primary battery may also be used. When the accessory power supply (ACC power supply) is turned off, or when the power supply from the vehicle power supply 310 to the power supply 311 of the imaging equipment 101 (101F, 101R) is interrupted due to a failure such as disconnection or disconnection of wiring due to an accident. , or when the power supply 311 fails to supply power, the secondary battery 312 transmits power (or may be referred to as power transmission or power supply) to the microcomputer 301, the communication processing unit 314, or the like. Maintain at least some functions of (101F, 101R).

The control unit 303 acquires image information from the camera 304 of the imaging device 101 (101F, 101R) and stores it in a storage device such as an SD card 306 or the like. In this specification, "storage" may also be referred to as "recording", "recording", or "recording".

The input/output unit 315 inputs and/or outputs video data shot by the camera 304 or the vehicle interior shooting cameras 102 (102F, 102R) and/or video data stored in a storage unit such as the SD card 306. . Input and/or output of video data is basically performed digitally, but is not limited to this.
The input/output unit 315 is connected to the imaging equipment controller 302, but may be configured to be connected to the microcomputer 301 instead.
The input/output unit 315 is directly connected to the network 103, but may be configured to be connected to the network 103 via the vehicle interior imaging cameras 102 (102F, 102R).
Further, as described above, the input/output unit 315 may be configured to input/output electric power from the vehicle power source 310 .

Vehicle interior photography cameras 102 ( 102 F, 102 R) are additional cameras 102 ( 102 F, 102 R) connected to photography device 101 R via input/output unit 315 .
The vehicle interior photography camera 102 (102F, 102R) transmits the image data captured by the vehicle interior photography camera 102 (102F, 102R) to the photography device controller 302 of the photography device 101R via the input/output unit 315. .

Further, the vehicle interior imaging cameras 102 (102F, 102R) may be configured to output to the network 103 the video data input from the imaging equipment 101 (101F, 101R). In addition, vehicle interior photography cameras 102 ( 102 F, 102 R) may be configured to output electric power input from vehicle power source 310 .
By configuring the vehicle interior photography camera 102 (102F, 102R) to input/output video data and electric power, the vehicle interior photography camera 102 (102F) can , 102R), video data and power can be passed through to the outside, and new cameras 102 (102F, 102R) can be added without changing the configuration of the existing imaging equipment 101 (101F, 101R). It is convenient because it is possible to
In another embodiment, the shooting directions of the shooting equipment 101 (101F, 101R) and the vehicle interior shooting camera 102 (102F, 102R) can be changed. For example, it is possible to change the configuration so that the camera 101 (101F, 101R) mainly photographs the interior of the vehicle, and the camera 102 (102F, 102R) for photographing the interior of the vehicle mainly photographs the exterior of the vehicle.

Components, modules, and the like of the terminals and servers described below with reference to FIGS. 4 to 7 and 22 can be added, omitted, integrated, or substituted according to the embodiment.
4 to 7 and 22 are schematic examples of hardware configurations, and it should be noted that the components and modules described therein are all essential components for each terminal and server. I don't mean it.

Each component, module, etc. of the terminal and server described using FIGS. 4 to 7 and 22 are distributed and stored in the entire system for control and processing. There may be.

FIG. 4 is an example of the hardware configuration of the reservation management server 104. As shown in FIG.
The reservation management server 104 is an example of a reservation system, and includes information on various services related to driving schools, kindergartens/nursery schools, day care, taxis, rental cars, car sharing, dispatch, tourism, limousine cruises, transportation and delivery, A server that manages information related to various tasks such as moving, transportation, loading and unloading, movement to work sites, sales, commuting, etc. It is composed of terminals such as smartphones, tablets, notebook PCs, desktop PCs, etc. be done.

In the explanations below, the explanations about "driving school" and "driving school" will explain general driving schools for passenger cars, motorcycles, large vehicles, etc., but these terms are technically or practically possible. As long as there are facilities for operating skill training and special education for heavy machinery, earthworking machines, and transport vehicles such as excavators, wheel loaders, bulldozers, crane vehicles, and forklifts, as well as training and lessons for ships and aircraft. It may be a facility.

In addition, terms such as "reservation" and "reservation management" in this specification should be read as "schedule" and "schedule management" unless the substantial content of each embodiment disclosed in this specification is changed. may
Programs and applications such as a reservation management module 410 and a cooperation module 411 are stored in the main storage device 401 of the reservation management server 104 . A functional element is realized.
Further, the reservation management server 104 may be a server that manages information on various services related to sports gyms, personal gyms, and the like.

The reservation management module 410 manages reservation information 421 regarding various services. A user who is an operator of the reservation management server 104 and a user of the service use the input device 404, the output device 405, the communication control unit 406, and the network 103 to update, publish, and use the contents of the service that can be provided. You can check and book the services you want.

For example, if the service is driving lessons, the reservation management module 410 is the reservation system of the driving school.
Each instructor 1910 of the driving school inputs his/her available time zone, and the reservation management module 410 stores the input information as the employee information 423 . The reservation management module 410 associates the instructor 1910 with the vehicles 10 that can be used and the vehicles 10 that can be driven during the time slot input by the instructor 1910, using, for example, the instructor ID and the vehicle ID. It is better if it is a configuration for memorizing.
The employee information 423 is an example of provider information regarding service providers.

When each trainee 1920 of the driving school makes a reservation, the reservation management module 410 provides each trainee 1920 with information according to the stage of the course of each student based on the information on each instructor 1910 and each vehicle 10 described above. To present a reservation-available time slot and accept a reservation within it.

At least some of this information associated with each instructor 1910, vehicle 10, and student 1920 is shared with, for example, the facility terminal 105 via the cooperation module 411 described below.

However, in another embodiment, the vehicle 10 may be a vehicle 10 that is used to perform business, such as around business, and the reservation management server 104 may, for example, store the content of business appointments, such as date and time and location. etc., may be managed.

The cooperation module 411 cooperates with at least one of the facility terminal 105, the user terminal 106, and the external management server 107 described below with reference to FIGS. etc., can be used in each embodiment disclosed in this specification.
Note that the cooperation module 411 may be divided into, for example, a facility terminal cooperation module, a user terminal cooperation module, an external management server cooperation module, and the like, and configured as individual modules.

Specifically, the cooperation module 411 includes a training reservation ID, a trainee ID, an instructor ID, a vehicle ID that identifies each vehicle 10, a vehicle attribute ID that identifies a vehicle type and a vehicle type, a course course ID, a reservation time period, , whether to use an MT car or an AT car, whether the training is in a driving school or on the road, etc., is sent to a linkage target, such as a facility, connected via the network 103 by ODBC (Open Database Connectivity). provided to terminal 105 .

When providing the above information, the cooperation module 411 may be configured to acquire the data output by the reservation management module 410 in the form of a CSV file or a spreadsheet software file and provide the information to the cooperation target. .
In particular, the cooperation module 411 acquires the information by connecting to a database storing the above information, or acquires the information output by the reservation management module 410 in a CSV file or spreadsheet software file format. should have a function to switch between

The auxiliary storage device 402 of the reservation management server 104 stores reservation information 421, user information 422, employee information 423, etc. regarding various services. The reservation management server 104 provides at least part of the information to the facility terminal 105, the user terminal 106, the external management server 107, and the like, which cooperate with each other.
The information is not limited to information about one service, and may be information about different services provided by a plurality of organizations such as group companies and partner companies. For example, information that combines multiple services, such as pick-up reservation management for kindergartens and nursery schools and taxi dispatch reservation management, and pick-up and drop-off of multiple children who did not make the pick-up reservation time by taxis of affiliated taxi companies. may be

In addition, the reservation information 521 and the like stored in the auxiliary storage device 502 and the like of the equipment such as the facility terminal 105 and the like are information based on the reservation information 421 of the reservation management server 104, and technical inconsistencies do not occur in the following description. The range may be read as the reservation information 421 of the reservation management server 104 .

FIG. 5 is an example of the hardware configuration of the facility terminal 105. As shown in FIG.
The facility terminal 105 provides information on various services such as driving school, kindergarten/nursery school, daycare, taxi, rental car, car sharing, vehicle dispatch, sightseeing, limousine cruise, etc. It is a server that manages information related to various tasks related to transportation, sales, commuting, etc., and video data shot by the shooting equipment 101 (101F, 101R), such as smartphones, tablets, notebook PCs, desktop PCs, etc. terminal.

The facility terminal 105 may also be a server that manages information about services such as sports gyms and personal gyms, image data, and the like.
As will be described later, information on various services and information on various tasks managed by the facility terminal 105 are equivalent or similar to information managed by the reservation management server 104 .

The main storage device 501 of the facility terminal 105 includes a reservation management server cooperation module 510, a camera equipment cooperation module 511, a user terminal cooperation module 512, an external management server cooperation module 513, a display control module 515, a data management module 516, and a data processing module. Programs and applications such as 517 and processor cooperation module 518 are stored, and each functional element of the facility terminal 105 is realized by the processor 503 executing these programs and applications.

The reservation management server cooperation module 510 cooperates with the cooperation module 411 of the reservation management server 104 to enable connection and cooperation between the facility terminal 105 and the reservation management server 104 .
Further, the reservation management server linking module 510 stores at least one of various information stored in the auxiliary storage device 402 of the reservation management server 104, such as reservation information 421, user information 422, employee information 423, and setting information 420. Get the part.
The reservation management server cooperation module 510 stores such information in the auxiliary storage device 502 of the reservation management server cooperation module 510 as reservation information 521, user information 522, employee information 523, and setting information 520. FIG.

The reservation management server cooperation module 510 causes the reservation management server 104 to automatically execute the screen operation of the reservation system, for example, CSV export, by RPA (robotics process automation) at every scheduled time, It is preferable to have a function to execute the process of writing to

A directory may be read as a file.
The predetermined directory may be a directory provided in advance as the reservation information 421 or the setting information 420 of the auxiliary storage device 402 of the reservation management server 104, or the reservation information of the auxiliary storage device 402 of the reservation management server 104. 421 and setting information 420 may be a directory newly provided after the connection between the reservation management server 104 and the facility terminal 105 is established, for example.

The reservation management server cooperation module 510 monitors the predetermined directory, and when there is a new CSV file, causes the cooperation module 411 of the reservation management server 104 to transmit the new CSV file, and automatically imports the CSV file. Then, the contents of the auxiliary storage device 502 of the facility terminal 105 should be updated.

The “every fixed hour” may be immediately after the deadline for booking the service provided using the vehicle 10 has passed. For example, when accepting service reservations at 00:00 every day, it is preferable to start the RPA at 00:05, for example.

The imaging device cooperation module 511 cooperates with the control unit 303 of the imaging devices 101 (101F, 101R) to enable connection and cooperation between the facility terminal 105 and the imaging devices 101 (101F, 101R).
The user terminal cooperation module 512 cooperates with the facility terminal cooperation module 614 of the user terminal 106 to enable connection and cooperation between the facility terminal 105 and the user terminal 106 .

The external management server cooperation module 513 cooperates with the facility terminal cooperation module 714 of the external management server 107 to enable connection and cooperation between the facility terminal 105 and the external management server 107 . The external management server 107 is a server operated by, for example, a company that manufactures and sells the imaging equipment 101 (101F, 101R), as will be described later with reference to FIG.

The processing device cooperation module 518 cooperates with the cooperation module 2211 of the processing device 108 to enable connection and cooperation between the facility terminal 105 and the processing device 108 . As will be described later with reference to FIGS. 14 and 22, the processing device 108 transfers, copies, stores, processes, etc. information stored in a storage medium, such as the SD card 306, of the imaging device 101 (101F, 101R). , and is manufactured or sold by a company or the like that manufactures and sells the photographing equipment 101 (101F, 101R).

In the embodiment of FIG. 5, the reservation management server cooperation module 510, the imaging device cooperation module 511, the user terminal cooperation module 512, the external management server cooperation module 513, and the processing device cooperation module 518 are configured as separate modules. They may be configured as one cooperation module like the cooperation module 411 in the embodiment of FIG. Moreover, depending on the case, the configuration may be partially omitted or integrated.

Furthermore, individual modules and their functions are pre-installed in the main storage device 501 and can be activated or deactivated at arbitrary timing, or individual modules and their functions can be activated at arbitrary timing. It is preferable that the software can be installed in or uninstalled from the main storage device 501, because it is possible to flexibly respond to the user's requests and situations on a case-by-case basis. Such a configuration can be similarly implemented in the embodiments shown in FIGS. 6 and 7 below.

The display control module 515 displays video information in various forms on the output device 505 such as a display based on the reservation information 521 and the video information 524 stored in the auxiliary storage device 502 . A specific display mode by the display control module 515 will be described in detail with reference to FIGS. 15 to 19. FIG.

The data management module 516 manages video data and various types of information included in the video data.
For example, if the user is an operator or manager of a driving school, the data management module 516 can extract the distance between the instructor 1910 and the student 1920, the distance between the instructor 1910 and the student 1920, and the The contact between 1910 and the student 1920, the facial expressions and emotions of the instructor 1910 and the student 1920, the gazes of the instructor 1910 and the student 1920, the postures of the instructor 1910 and the student 1920, the driving motions of the instructor 1910 and the student 1920, etc. It is preferable to have a configuration in which the data is analyzed and the results are summarized as management data. Furthermore, it is better to analyze the relationship between the environment inside the vehicle and the environment outside the vehicle, or statistically analyze the results, score the results as management data, and put them together.

With the configuration as described above, the user can determine the appropriateness of the training by the instructor 1910, the state of tension and relaxation of the student 1920, the appropriateness of driving by the student 1920, the driving proficiency of the student 1920, and the It is possible to provide services that take into consideration various items such as compatibility with the instructor 1910, presence or absence of various types of harassment during lessons, and the like.

Note that part of the above analysis may be performed completely or in a simplified manner by the control unit 303 of the imaging equipment 101 (101F, 101R). Furthermore, it is preferable that the data management module 516 is configured to perform more precise analysis based on various analysis results performed by the control unit 303 of the imaging device 101 (101F, 101R).

The data processing module 517 executes various processes on the video data stored as the video information 524 in the auxiliary storage device 502 . The contents of each processing will be described later, but for example, image processing, information collection, analysis, comparison, etc., which will be described in connection with FIGS. 17 and 19 to 21, are performed.

The auxiliary storage device 502 of the facility terminal 105 stores setting information 520, reservation information 521, user information 522, employee information 523, video information 524, and the like.
The setting information 520 includes at least part of the setting information of the reservation management server 104 in addition to the setting information for each module of the facility terminal 105 stored in the main storage device 501 .

The reservation information 521 corresponds to at least a part of the reservation information 421 acquired from the reservation management server 104, such as the date and time and details of the reservation, the vehicle 10 assigned to the reservation, the area where the vehicle 10 is scheduled to be used, the person who made the reservation, and the reservation. including information such as employees who
Further, the reservation information 521 preferably includes information regarding whether or not image processing has been performed on the video data, the type of event determined from the video data, and the like.

User information 522 includes at least part of information about each user registered in reservation management server 104 .
Employee information 523 includes at least part of information about each employee registered in reservation management server 104 .

The video information 524 may include information related to various events included in the video data, in addition to the video data captured by the imaging devices 101 (101F, 101R). In this specification, video data means, for example, still image information, moving image information, audio information related thereto, and the like. The main storage device 501 stores still images in still image file formats such as JPEG, PNG, and GIF formats, and stores moving images in moving image file formats such as MOV, MP4, AVI, WMV, and WeMM formats. store in the form

The auxiliary storage device 502 of the facility terminal 105 may be a large-capacity storage device connected to the facility terminal 105, such as an external HDD or SSD. Further, as the auxiliary storage device 502 of the facility terminal 105, a storage device within the processing device 108 in the embodiment of FIG. 15, which will be described later, may be used.
In another embodiment, facility terminal 105 may have the capability to perform some or all of the functions of processor 108 of FIG. 15, for example.

FIG. 6 is an example of the hardware configuration of the user terminal 106. As shown in FIG.
The user terminal 106 is a person who uses various services such as driving school, kindergarten / nursery school, day care, taxi, rental car, car sharing, dispatch, sightseeing, limousine cruise etc. taxi passengers) and persons involved in the provision of those services (e.g., driving school instructor 1910, kindergarten teacher, nursery teacher, pick-up bus driver, taxi driver, etc.). It consists of terminals such as notebook PCs and desktop PCs.
The user terminal 106 may also be a terminal owned by a user or trainer of a gym, personal gym, or the like.

The main storage device 601 stores programs and applications such as a reservation management server cooperation module 610, a camera equipment cooperation module 611, an external management server cooperation module 613, a facility terminal cooperation module 614, a display control module 615, and the like. Each functional element of the user terminal 106 is implemented by the processor 603 executing programs and applications.

The reservation management server cooperation module 610 cooperates with the cooperation module 411 of the reservation management server 104 via the network 103 to enable connection and cooperation between the user terminal 106 and the reservation management server 104 . For example, the reservation management server cooperation module 610 acquires information directly from the reservation management server 104 and performs data transmission/reception.
The imaging device cooperation module 611 performs connection and functional cooperation with one or more imaging devices 101 (101F, 101R). For example, the imaging device cooperation module 611 acquires video data directly from the imaging devices 101 (101F, 101R) in the vehicle 10, and transmits information regarding changes in imaging modes to the imaging devices 101 (101F, 101R). etc.

The external management server cooperation module 613 cooperates with the external management server 107 via the network 103 and executes various functions and controls.
The external management server cooperation module 513 cooperates with the user terminal cooperation module 512 of the external management server 107 to enable connection and cooperation between the user terminal 106 and the external management server 107 . The external management server 107 is a server operated by, for example, a company that manufactures and sells the imaging equipment 101 (101F, 101R), as in the embodiment of FIG.

As described above, each cooperation module 610, 611, 613 may be configured as one cooperation module. Moreover, depending on the case, the configuration may be partially omitted or integrated.

The display control module 615 and data processing module 617 of the user terminal 106 function in the same manner as the display control module 515 and data processing module 517 of the facility terminal 105, so description thereof will be omitted.

Furthermore, as already described in the embodiment of FIG. 5 below, individual modules and their functions can be activated or deactivated at any time, or can be installed or installed at any time. An uninstallable configuration is better because it can flexibly respond to the user's requests and situations on a case-by-case basis.

The auxiliary storage device 602 saves reservation information 621 for each module stored in the main storage device 601, video information 624 received and stored from the imaging equipment 101 (101F, 101R), and the like. The video information 624 is the same as the video information 524 of the facility terminal 105, so the description is omitted.

FIG. 7 is an example of the hardware configuration of the external management server 107. As shown in FIG.
The external management server 107 is a server operated by, for example, a company that manufactures and sells the imaging equipment 101 (101F, 101R), and is composed of terminals such as smart phones, tablets, notebook PCs, and desktop PCs.

The main storage device 701 stores programs and applications such as a reservation management server cooperation module 710, a camera equipment cooperation module 711, a user terminal cooperation module 712, a facility terminal cooperation module 714, a data management module 716, and a data processing module 717. Each functional element of the external management server 107 is realized by the processor 703 executing these programs and applications.

The roles and functions of each cooperation module 710-714 are similar to the corresponding modules already described in connection with the embodiments of FIGS.

The data management module 716 manages video data and various types of information included in the video data. The role and functionality of data management module 716 are similar to corresponding data management module 516 previously described in connection with the embodiment of FIG.
The data management module 716 of the external management server 107 is preferably configured to have higher computing power than the general facility terminal 105, thereby providing management data and the like analyzed with higher accuracy to the user. be able to.

For example, analysis of the distance and contact between people, facial expressions and emotions of people, gaze of people, posture of people, driving behavior, etc., their relationships with the environment inside and outside the vehicle, their statistical analysis, and their A configuration in which machine-learning-like analysis or the like is performed and provided as management data that can be used by the user is better because the user can reflect the advanced analysis results in his/her own service or the like.

More specifically, for example, when the user is the operator or manager of a driving school and receives a complaint about harassment from the instructor 1910 who is an employee, the data management module 716 etc., not only to manage the analysis results such as the presence or absence of acts that actually correspond to harassment acts, or acts that can be misunderstood as harassment acts, but also to identify the cause of such complaints from video data. It is preferable that the structure manages analysis results such as the presence or absence of characteristic actions of the instructor 1910 before the action actually occurs. In this specification, an act that receives complaints about harassment, an act that can be misunderstood as harassment, etc. is referred to as a "harassment-like act".
Advanced processing such as image processing and analysis is performed by the data processing module 717, and data and information management is performed by the data management module 716, but the present invention is not limited to this. The data processing module 717 or the data management module 716 may execute processing independently, or may be configured to execute processing cooperatively.

The imaging device cooperation module 711 of the external management server 107 is configured to directly transmit such characteristic behavior as a new determination criterion by the control unit 303 of the imaging device 101 (101F, 101R). The facility terminal cooperation module 714 of the management server 107 transmits such characteristic behavior to the facility terminal 105, and the user determines such a new criterion by the control unit 303 of the imaging device 101 (101F, 101R). It is good to have the structure which can decide whether to use for.

Then, according to the newly added determination criteria, the photographing equipment 101 (101F, 101R), when the relevant instructor 1910 is conducting training, when the relevant instructor 1910 performs the above-described characteristic behavior, It is preferable to have a configuration for issuing a notification about it. In particular, it is better if the user can set such a notification so that the trainee student 1920 does not feel uncomfortable.
This makes it easier for the instructor 1910 to become aware of actions that may be perceived as harassment, and to improve his/her own response so that complaints and the like associated with the actions are less likely to occur. As a result, the trainee 1920 does not have to experience harassing behavior or the behavior itself that may be perceived as harassing behavior.

It is preferable that the control unit 303 is configured to change the determination criteria for each person. For example, if it is known that a certain trainee 1920 tends to dislike approaching the instructor 1910 more than many other trainees 1920, even if the instructor 1910 usually has no problem , may result in complaints about harassing behavior. In such a situation, by adopting a stricter criterion, for example, by judging even an approach at a distance farther than the normal approach judgment as a harassment-like act, the user tends to dislike the approach. A more comfortable learning environment can be provided for 1920 as well.

The data processing module 717 executes processing that requires a relatively high computational load and processing of video data that is provided as an individual additional service among processing of video data to be described later. With such a configuration, even if the arithmetic processing capability of the user's own terminal does not reach the recommended arithmetic processing capability for the desired processing, the user receives the desired processing from the external management server 107. Video data can be easily obtained. In such a configuration, the user can obtain the processed video data while maintaining the existing system, for example, by paying a fee only when necessary or by paying a fixed usage fee. can be done.

FIG. 22 is an example of the hardware configuration of the processing device 108. As shown in FIG.
The processing device 108 is a device that executes processing such as transfer, duplication, storage, and processing of information stored in a storage medium of the imaging device 101 (101F, 101R), such as the SD card 306 or the like. Such a processing device 108 is a device obtained by adding functions to a general card reader, and its specifications may be, for example, higher than that of a general card reader and lower than that of a personal computer.
Note that the processing device 108 may be configured integrally with the facility terminal 105 or the like, for example. In such a configuration, the modules and applications stored in the main storage device 501, such as the facility terminal 105, may be able to implement at least some of the functions of the processing device 108 described below.

In particular, the processing device 108 preferably has a function of transferring, duplicating, or the like to the facility terminal 105 or the like, such as video data stored in the storage media of the imaging devices 101 (101F, 101R).
A specific usage example of the processing device 108 will be described later with reference to FIG.

The main storage device 2201 of the processing device 108 stores programs and applications such as a data reading module 2210, a cooperation module 2211, a display control module 2215, a data management module 2216, a data processing module 2217, and an information integration module 2219. Each functional element of the processing device 108 is implemented by the processor 2203 executing these programs and applications.

The data reading module 2210 has a function of reading various types of information, such as video information 2224 such as video data, from the storage medium of the imaging device 101 (101F, 101R).
The data management module 2216 has a function of transferring, storing, duplicating, etc. the read information, such as video information 2224 such as video data, etc., to the auxiliary storage device 2202 of the processing device 108 .

The cooperation module 2211 cooperates with the corresponding cooperation module of the device connected to the processing device 108, for example, the processing device cooperation module 518 of the facility terminal 105, and transfers the information read by the data reading module 2210 to the facility terminal 105, for example. It has a function of storing and duplicating in the auxiliary storage device 502 of the facility terminal 105 .

The display control module 2215 has a function of displaying the transfer state of the video information 524 on the output device 2205 of the processing device 108, such as a liquid crystal monitor or an indicator.
The display control module 2215 also creates information related to display on output devices of devices coupled to the processing unit 108 , such as the facility terminal 105 .

The data management module 2216 of the processing device 108 has a function of managing video data and various information contained in the video data. Since it is the same as 516, the explanation is omitted.

The data processing module 2217 of the processing device 108 performs various types of processing on the video data stored as the video information 2224 in the auxiliary storage device 2202 in the same way as the data processing module 517 of the facility terminal 105 . The contents of each processing will be described later, but for example, image processing, information collection, analysis, comparison, etc., which will be described in connection with FIGS. 17 and 19 to 21, are performed.

The information integration module 2219 of the processing device 108 has a function of integrating information recorded in a plurality of storage media, such as video data.
"Information integration" means to associate, identify, etc. information stored on different storage media, such as different SD cards 306, so that they can be accessed collectively or more efficiently. are doing.

The information integration module 2219 of the processing device 108, for example, relates to information stored in different storage media, associates individual video data, subjects to be photographed, reservation information 421 for services and business, etc. It is preferable to associate and identify contents, event information, and the like.
Note that the event information is an example of recorded information. Also, an event or occurrence is an example of a phenomenon.

The auxiliary storage device 2202 of the processing device 108 stores setting information 2220, reservation information 2221, user information 2222, employee information 2223, video information 2224, user information 2225, and the like.
The setting information 2220, reservation information 2221, user information 2222, employee information 2223, and video information 2224 are the same as the setting information 520, reservation information 521, user information 522, employee information 523, and video information 524 of the facility terminal 105. , the description is omitted.
User information 2225 is information related to the user who owns the facility terminal 105 .

The user information 2225 may include, for example, control parameters of the photographing equipment 101 (101F, 101R) set by the user, setting information 520 of part or all of the facility terminal 105, and the like.
The input device 2204 of the processing device 108 has slots 1401 to 1410 into which a storage medium or the like of the imaging device 101 (101F, 101R) can be inserted.
Slots 1401-1410 will be described in detail with reference to FIG.

FIG. 8 is an example of a control flow 800 of the imaging equipment 101 (101F, 101R).
The control unit 303 of the imaging device 101 (101F, 101R) identifies the state or motion of the person (S810), and controls the imaging device 101 (101F, 101R) based on the identification result obtained each time (S820). .

In the control flow 800 of FIG. 8, only one step S810 for specifying the state or motion of the person is illustrated, but the control unit 303 executes step S810 for specifying the state or motion of the person a plurality of times, The imaging device 101 (101F, 101R) may be controlled based on a plurality of identification results.

Before and after the control flow 800, the control unit 303 of the imaging device 101 (101F, 101R) may execute another control flow of the imaging device 101 (101F, 101R). , 101R) can be controlled more flexibly.

In addition, a person is an occupant of the vehicle 10, particularly a driver of the vehicle 10, a passenger in a front passenger seat, or a fellow passenger in a rear seat. In the following description, they are also collectively referred to as "passengers".
"Identification of the state or action of the person" in S810 is performed, for example, by a specification flow 900 or another specification flow 1000, which will be described in detail with reference to FIGS. 9 and 10 below.

Further, in controlling the imaging equipment 101 (101F, 101R) based on the identification result in S820, in addition to controlling the imaging equipment 101 (101F, 101R) itself, control of devices connected to the imaging equipment 101 (101F, 101R) is performed. and control of the functions of the vehicle 10 that can be controlled based on commands and information from the control unit 303 of the imaging equipment 101 (101F, 101R).

Devices connected to the imaging equipment 101 (101F, 101R) mainly include various devices installed in the vehicle 10 and devices retrofitted to the vehicle 10 by the user, such as speakers, monitors, consoles, control tablets, and external devices. A speaker, an external monitor, a car navigation device, a radar detection device, a personal assistant device, an advertising tablet, an emergency display device, etc., but may be a device outside the vehicle that can be connected to the imaging device 101 (101F, 101R). .

Note that the control unit 303 of the front photographing device 101F and the control unit 303 of the rear photographing device 101R may independently control the front photographing device 101F and the rear photographing device 101R, cooperate or synchronize. It is preferable that the configuration is such that they can also be controlled by In yet another embodiment, one of the control unit 303 of the front imaging device 101F and the control unit 303 of the rear imaging device 101R may function as a common control unit 303 .

FIG. 9 is an example flow 900 for identifying a person's state or action.
The control unit 303 of the photographing equipment 101 (101F, 101R) executes the following processing according to the human state or motion identification flow 900 . In the following description, description of specific algorithms, settings, and the like for image processing and video processing by the control unit 303 of the imaging device 101 (101F, 101R) will be omitted.

The control unit 303 acquires images (video data such as still images and moving images) and sounds from the imaging devices 101 (101F, 101R) and the vehicle interior imaging cameras 102 (102F, 102R) (S910), Analyze (S920). In addition, it is preferable that the audio is the audio included in the video data, but it is more preferable that the audio can be selected from a plurality of audios recorded separately from the video data.
Also, depending on the content to be analyzed, only an image or only a sound may be acquired and analyzed.

Based on the analysis result, the control unit 303 identifies each set state and action of the person who uses the vehicle 10 (S930).
The control unit 303 outputs information about the specified content in the form of data or signals, for example (S940), and the control unit 303 executes corresponding control based on the output information (S820).

In the following description, an example in which the main body of processing in steps S910 to S930 is the control unit 303 will be described. module may do. This also applies to another specific flow 1000 and the like described below.

For example, the image acquisition module may execute the image acquisition step S910, the image analysis module may execute the image analysis step S920, the specific module may execute the specific step S930, and the control unit 303 may cooperate with each module. .
Furthermore, individual modules may be implemented in hardware or in software.

FIG. 10 is an example of another human state or action identification flow 1000 .
The control unit 303 of the photographing equipment 101 (101F, 101R) receives status information and attribute information of persons stored in the external reservation management server 104, etc., such as reservation information 421, user information 422, and employee information 423. (S1010), and the state of the person using the vehicle 10 is specified based on the information (S1020). The control unit 303 outputs information about the identified content in the form of data, signal, or the like (S1030).

It is preferable that the number of pieces of state information and attribute information acquired in the identification flow 1000 in FIG. 10 is plural. 101F, 101R) may be controlled.

For example, the control unit 303 establishes a communication connection between the imaging device 101 (101F, 101R) and the reservation management server 104 and the facility terminal 105, and the information is obtained from the reservation management server 104 and the facility terminal 105. This is done by acquiring various information stored in those auxiliary storage devices 402 and 502 .

The control unit 303 may be configured to acquire the above information directly from the reservation management server 104. However, the control unit 303 may be configured to obtain the above information directly from the reservation management server 104. However, the control unit 303 may acquire the above information via the facility terminal 105, for example, by using the imaging device cooperation module 511 of the facility terminal 105. 101R).
The control unit 303 may be configured to connect with the reservation information system of the reservation management server 104 according to, for example, a linking flow 1300 with the reservation information system shown in FIG. 13 to be described later.

A specific example of the control of the imaging equipment 101 (101F, 101R) executed by the control unit 303 according to the control flow 800 in FIG. 8 will be described below with reference to FIGS.
Note that the term "notification" in the description may be replaced with, for example, "notification", "warning", "notification", "explanation", "commentary", "assistance", "driving assistance", and the like. Further, expressions such as "output from the imaging equipment 101 (101F, 101R)" may be read as "output from a device cooperating with the imaging equipment 101 (101F, 101R)".

In the control flow 800 of the photographing device 101 (101F, 101R) in FIG. A part or combination of the human states or actions listed below is specified, and the imaging equipment 101 (101F, 101R) corresponding to these is controlled (S820).
Alternatively, based on the state information, attribute information, etc. of the person acquired from the reservation system or the like in another flow 1000 for specifying the state or action of the person in FIG. It specifies, and controls the imaging equipment 101 (101F, 101R) corresponding to these (S820).
Alternatively, by combining the flow 900 for specifying the state or action of a person in FIG. 9 and another flow 1000 for specifying the state or action of a person in FIG. It specifies, and controls the imaging equipment 101 (101F, 101R) corresponding to these (S820).

Examples of human states, behaviors and attributes:
Whether a person got into the vehicle 10 or
Has a person gotten out of the vehicle 10?
Has there been an act of harassment?
how many passengers boarded the vehicle 10;
How many passengers can be confirmed inside the vehicle?
how many passengers got off the vehicle 10;
whether the occupant is a specific user,
the passenger is the person who made the reservation;
Whether there are infants in the crew,
whether the occupant is a legitimate user;
whether the crew is a user of the service;
Did the occupant operate the brakes?
Whether it is the first ride of the day for the person who got into the vehicle 10,
whether the occupants are in work clothes;
Whether the percentage of people in the video is larger than the set value, or
whether the occupants are relaxed or tense,
whether the occupant operated the console of the vehicle 10;
whether the occupant has operated the seat belt of the vehicle 10;
Whether the crew has taken the prescribed action,
Whether the occupant showed a specific facial expression or biological reaction,
Did the crew have a conversation?
Whether the occupant has operated the opening/closing part of the vehicle 10,
Whether the crew acted in an extreme manner,
Whether the occupant has used extreme handling or braking,
whether the distance between the driver and the occupant in the front passenger seat is greater than the first set value;
whether the distance between the driver and the passenger in the rear seat is greater than the second set value;
whether the distance between adjacent occupants in the rear seats is greater than the third set value;
whether the occupant has spoken or initiated or engaged in a conversation;
what stage of service the crew is at,
How many times the crew has used the service.

In particular, the control unit 303 performs a plurality of analyzes and determinations described above, and based on a combination of a plurality of analyzes and determination results, specifies a part or combination of human states, motions, and attributes, 101R), and it is more preferable that the user can select the target of analysis and judgment.

It should be noted that the control unit 303 can similarly execute the above identification processing in step S1110 of "first identification of human state or motion" described in FIG.

A specific example of control of the photographing equipment 101 (101F, 101R) and the like based on some specific contents related to the above analysis contents will be described below.
In addition, in the following description, for the purpose of simplification of expression, the description will be made simply by referring to the “photographing device 101 (101F, 101R)”, but the “vehicle interior photographing camera 102 (102F, 102R)” Alternatively, it may be a combination of the "photographing equipment 101 (101F, 101R)" and the "vehicle interior photographing camera 102 (102F, 102R)".

Note that the control unit 303 executes the control in each control example described below in combination with another specific content, executes the individual control examples in combination, or executes or stops only an arbitrary control example. It is better to have a function to
For example, with respect to the control examples described below, the control unit 303 performs at least one control step (S820) of another control example in addition to the identification performed in the identification steps (S810, S930, S1010) described for one control example. may be combined.

In the following description, each control example is executed by the control unit 303 of the imaging device 101 (101F, 101R) while the vehicle 10 is in use. Other examples of control that can be executed, such as control for processing video data, can be similarly executed by each module of the facility terminal 105, the user terminal 106, the external management server 107, and the processing device 108, or , each module can be executed cooperatively.
For example, control related to image and sound processing of video data can be executed by the control unit 303 of the imaging equipment 101 (101F, 101R) while the vehicle 10 is in use, or the data processing module of the facility terminal 105 can be executed. 517, the data processing module 617 of the user terminal 106, the data processing module 717 of the external management server 107, and the data processing module 2217 of the processing device 108 independently or in cooperation with each other after receiving corresponding video data. can also

A specific control example will be described below.
First control example Input example: An image that can specify that a person got into the vehicle 10 or got off the vehicle 10 .
Output example: Change the quality of video data.

When the control unit 303 identifies that a person has boarded the vehicle 10 (S810, S930), the control unit 303 sets the frame rate, resolution, and bit rate of the video data for the shooting settings of the shooting equipment 101 (101F, 101R). to a higher value (S820).
It should be noted that the fact that a person has boarded the vehicle 10 is an example of a person's boarding motion.

When the control unit 303 identifies that a person has gotten off the vehicle 10 (S810, S930), the control unit 303 sets various parameters included in the video data, for example, At least one of frame rate, resolution, bit rate, etc. is changed to a lower value (S820).

With these configurations, for example, the control unit 303 controls the image capturing device 101 (101F, 101R) to perform long-time recording, which is capable of recording for a long time, although the image quality and sound quality of the video data are low, when there is no one in the vehicle 10 . mode, and after a person has boarded the vehicle 10, it can be operated in an occupant recording mode in which the condition of the occupants in the video data can be identified in greater detail.

The long time recording mode is a mode in which continuous recording is performed over a long period of time. In the long-time recording mode, if the vehicle 10 is used in a driving school or the like, for example, the control unit 303 continues recording during the operating hours of the driving school.

The control unit 303 performs shooting in the long-time recording mode according to the length of time for continuous recording and the capacity of the SD card 306 of the shooting device 101 (101F, 101R). For example, the quality of video data such as frame rate, resolution, bit rate, etc. (hereinafter simply referred to as "video data quality") may be changed.

It should be noted that "change in quality of video data" is preferably a change in at least one of various parameters included in the video data, such as frame rate, resolution, bit rate, and the like.

The occupant recording mode described above is a mode for capturing video data with higher quality than the long-time recording mode. In the crew recording mode, for example, if the vehicle 10 is a vehicle 10 used in a driving school or the like, the control unit 303 records the distance between the instructor 1910 and the trainee 1920, facial expression, line of sight, movement, handling operation, conversation, etc. Capture and record video data with a quality that can be analyzed later.
The control unit 303 is preferably capable of changing the quality of video data such as the frame rate, resolution, and bit rate of video data shot in the passenger recording mode according to the specified target.

In the passenger recording mode, it is preferable that the control unit 303 can further change the quality of the video data according to the occurrence (event) specified each time. As a result, as will be described later, when occurrence of various harassment acts or harassment-like acts is identified, the quality of the video data is changed to a higher quality for recording, so that the control unit 303 can achieve a higher image quality at that time. It is possible to accurately determine whether or not an act that has occurred corresponds to an act of harassment, or the user who checks the video data can consider later in detail whether an act that has occurred corresponds to an act of harassment. can be done.

This makes it easier for the control unit 303 to perform both long-time recording and high-quality recording as necessary, even with limited power and storage capacity.
It should be noted that the change in the quality of the video data described above is understood in the same way in the control examples described later, and will be described only schematically in the following description.

Second control example Input example: A video that can identify the occurrence of harassment.
Output example: change the quality of video data.

When the control unit 303 identifies that there has been an act of harassment according to the set criteria (S810, S930), the control unit 303 further improves the quality of the video data with respect to the shooting settings of the shooting devices 101 (101F, 101R). Change to high (S820).
It should be noted that the quality of the video data that is changed to a higher level in this second control example should be higher than in the long-time recording mode described in connection with the first control example. Higher quality is better.

Based on one type of parameter, the control unit 303 identifies, as harassment behavior, that contact or violence has occurred when the distance between crew members becomes 0, for example, or when the distance between crew members suddenly approaches 0 or becomes negative. It is preferable to specify that a threat has been made or that one of the occupants has suddenly spoken in a loud volume.

Based on two or more types of parameters, the control unit 303 detects, as harassment, a situation in which, for example, the distance between passengers becomes 0 or rapidly approaches 0, and a situation in which the volume inside the vehicle suddenly increases. In such a case, it is preferable to use a configuration that specifies that power harassment or the like has occurred, because it is possible to specify the situation of variations with higher accuracy and more detail.

Their identification will be described later in more detail in connection with FIGS. 17 and 21. FIG.

Additionally or alternatively, based on two or more parameters, the control unit 303 determines, as harassment behavior, for example, a situation in which the distance between crew members becomes 0 or rapidly approaches 0, and the content of the conversation of the crew members. , or the content of the passenger's utterance includes a sound such as "Yametekudasai", it may be configured to specify that sexual harassment, etc. has occurred. .

As described above, when occurrence of various harassment acts or harassment-like acts is identified, the control unit 303 changes the quality of the video data to a higher quality and records it, thereby preventing harassment by the control unit 303 or the user. It becomes easier to judge and consider actions more accurately.

Note that, when various harassment acts are specified, the control unit 303 of the imaging device 101 (101F, 101R) adds information related to the specified harassment acts to the video data, or adds information related to the specified harassment acts to the video data. It is better to be a composition that assigns information.
Each module of the photographing equipment 101 (101F, 101R), the facility terminal 105, the user terminal 106, the external management server 107, and the processing device 108, in particular, the respective data management modules 516, 716, and 2216 add or The assigned information can be used as index information regarding video data.

In the description of this specification, it should be noted that an act determined to be a "harassment act" by the control unit 303 of the photographing device 101 (101F, 101R) necessarily corresponds to a legal or socially accepted harassment act. Not intended.
For example, "contact" or "approach" between passengers may be set as "harassment behavior" or "harassment-like behavior". In that case, for example, whether or not "contact" or "approaching" between passengers due to sudden turns of the vehicle 10 to avoid danger constitutes harassment can be determined by the user by checking the actual video data. can do.

In this second control example, a mode in which shooting and recording are performed with higher video data quality is called a harassment recording mode.
As another example of combination with the above-described first control example, the control unit 303 performs long-time recording without changing from the long-time recording mode to the occupant recording mode when an occupant gets into the vehicle 10. Recording may be continued while in the mode, and when it is determined that an act of harassment has occurred, the mode may be directly shifted to the harassment recording mode.

In such a configuration, compared to a configuration in which video data is recorded only when an act of harassment or an act similar to harassment occurs, video data is recorded over the time period in which the vehicle 10 is used. It becomes easy to confirm or prove that there was no action during the use time of the vehicle 10.例文帳に追加
The result that the occurrence of the following predetermined events, which are determined by clear standards in the processing of video data, such as the proximity and contact of passengers, and loud threats, was not detected or identified, and the grounds thereof. The fact that the user can present both video data is useful as a basis for not allowing the event in question during the time the vehicle 10 is in use. At the same time, it is also useful for a third party other than the user to independently verify.

In addition to the above advantages, such a configuration has the advantage that harassment acts during the usage time of the vehicle 10 are less likely to occur than a configuration in which only low image quality is recorded during a recording time period including before and after an event occurs. When suspicion arises, the user can determine whether or not the suspected act is harassment with higher reliability and validity by using video data recorded with higher image quality. It has the advantage of being able to

As a result, even if the occurrence of the problematic event is not specified during the usage time of the vehicle 10, it can be verified from the video data, and at the same time, the control unit 303 can detect the occurrence of the problematic event during the usage time of the vehicle 10. When it is specified mechanically, it is possible for a user or the like to verify whether or not such an event has actually occurred using higher-quality video data by human judgment.

In this embodiment and in this specification, "harassment" includes power harassment, moral harassment, sexual harassment, maternity harassment, and gender harassment. I assume.

In the case of power harassment or sexual harassment, the control unit 303 analyzes, for example, the distance between the crew members, the approach speed of the distance between the crew members, the voice volume of the crew members, etc., alone or in combination, thereby causing violence, intimidation, or harassment. and insults can be determined.
In the case of moral harassment, sexual harassment, maternity harassment, and gender harassment, the control unit 303 analyzes, for example, conversations in the car and other sounds such as clicks of the tongue and whistles, alone or in combination, to detect harassment and insults. Occurrence can be determined.

For example, by analyzing the presence or absence of semantic content that despises women, men, and pregnant women, such as "because of women," "because of men," and "because of pregnant women," the occurrence of harassment can be determined. It is also possible to determine the occurrence of harassment from the presence or absence of sounds or combinations of sounds such as "onna no kuseni", "otokonokuseni", and "nymp no kuseni" by analyzing sounds during conversation and with a lower computational load.

In a configuration where a plurality of microphones are present in the vehicle, the control unit 303 may further have a function of accepting a selection input by the user of a person whose conversation is to be preferentially recorded. In such a configuration, the control unit 303 may be configured to adjust the sensitivity and gain of each microphone so as to better record the conversation of the target person in the car.
As a result, the user can more reliably record the conversation of the target person even when the target person utters a remark corresponding to harassment in a noisy car, for example.

It is preferable that the control unit 303 can change the criteria for transitioning to various harassment recording modes for each crew member.
For example, if the control unit 303 determines that the occupants are male only, stopping the execution of the determination of maternity harassment can advantageously reduce computational load and storage capacity consumption.

Third control example Input example: Video that can identify the number of passengers.
Example output: Information based on number of passengers.

3-1 Control Example When the control unit 303 identifies the number of passengers who have boarded the vehicle 10 (S810, S930), the control unit 303 determines the number of passengers who have boarded the vehicle 10 and the However, the information about the total number of people is output from the speaker or display unit of the imaging equipment 101 (101F, 101R), or output from the external speaker or monitor connected to the imaging equipment 101 (101F, 101R) (S820).
With such a configuration, for example, when the number of children getting on is fixed, such as a shuttle bus for a kindergarten or a nursery school, the driver or the leader can easily check whether the planned number of children have boarded. can be done.

Control Example 3-2 Similarly, when the control unit 303 specifies the number of passengers that can be confirmed inside the vehicle (S810, S930), the control unit 303 determines the number of passengers that can be confirmed inside the vehicle 10. Information about the number of people is output from the speaker or display unit of the imaging device 101 (101F, 101R), or output from an external speaker or monitor connected to the imaging device 101 (101F, 101R) (S820).
With such a configuration, for example, when the crew is small and it is difficult to grasp the crew, such as a shuttle bus for a kindergarten or nursery school, it is possible to detect that the crew is moving to a place that cannot be confirmed on the video data. It is possible to quickly notify the hand and leader.

Furthermore, if there is a difference from the total number of people who have boarded the vehicle 10 so far in the above control example, the control unit 303 can notify information about the difference, for example, as an alarm. One of the causes of such a difference is that the child is in a blind spot from the imaging range of the imaging equipment 101 (101F, 101R) inside the vehicle and the vehicle interior imaging camera 102 (102F, 102R), such as a seat. and the floor between the seats, the gap under the seat, and the inside of the bag loaded on the vehicle 10 as luggage.

Based on the above differences, the control unit 303 places the child in a blind spot from the shooting range of the shooting equipment 101 (101F, 101R) in the car and the camera 102 (102F, 102R) for shooting inside the car. It is possible to quickly warn the driver or leader that the vehicle has moved.
As a result, the driver can stop the vehicle 10 to return the target child to the normal seat, and the leader can confirm the target child.

Control Example 3-3 Similarly, when the control unit 303 specifies the number of passengers who got off the vehicle 10 (S810, S930), the control unit 303 determines the number of passengers who got off the vehicle 10. Information about the number of people is output from the speaker or display unit of the imaging device 101 (101F, 101R), or output from an external speaker or monitor connected to the imaging device 101 (101F, 101R) (S820).

In such a configuration, for example, like a shuttle bus for a kindergarten, nursery school, etc., if the number of children who get off at the following predetermined places, such as the parking lot of a facility such as a kindergarten, nursery school, etc. In cases such as when it is decided that all the children and their guardians will get off the car, the control unit 303 can notify that there are still passengers in the car and that there are people left behind. can. As a result, the user can more reliably prevent the occupant from being left behind in the vehicle.

Furthermore, the control unit 303, for example, when the engine or power of the vehicle 10 is turned off before the number of passengers who got off the vehicle reaches the following predetermined value, for example, the value of the number of passengers who got on, A configuration may be adopted in which a notice of confirmation of abandonment is transmitted to the user terminal 106 via the network 103 of the mobile phone 106 by e-mail or the like. In that case, for example, the control unit 303 attaches a URL address or the like to an e-mail, and when the user accesses the URL address or the like, reproduces the target in-vehicle video on the user terminal 106 or via the user terminal 106 , the user's voice and appearance may be output from the speaker or display unit of the imaging device 101 (101F, 101R) or an external speaker or monitor connected to the imaging device 101 (101F, 101R).

In addition to or alternatively to the above configuration, the control unit 303 controls the facility confirmed by an imaging device in the facility, for example, a thermal camera for checking the health condition when entering the facility, a body surface temperature measurement camera, etc. Information about the number of visitors to the park may be obtained and used to determine the occurrence of desertion.
For example, even if the number of people getting off the train confirmed by the control unit 303 is less than the planned number of people getting off, for example, the total number of passengers, if the number of people entering the facility corresponds to the planned number of people getting off, they will be left behind. It is preferable not to notify the confirmation, or to notify again that the planned number of people have entered the facility after the notification of the abandoned confirmation.

By combining the above three control examples, it is possible to more effectively prevent accidents related to pick-up and drop-off, especially children left behind, and to reduce the burden on drivers and guardians. can be done.

One embodiment of the configuration for executing the above three control examples is, for example, a configuration for use in shuttle buses, sightseeing buses, long-distance buses, etc.
As one of the photographing equipment 101 (101F, 101R) and the vehicle interior photographing camera 102 (102F, 102R), or separately from the photographing equipment 101 (101F, 101R) and the vehicle interior photographing camera 102 (102F, 102R) For example, as a handy terminal or a portable terminal, when getting on and off the vehicle 10, a first counting system that performs identity verification, body temperature confirmation, photographing, etc., and counts the number of people getting on and off, and passengers in the vehicle 10 and a second counting system that measures the number of people, and notifies information based on the number of passengers measured by the first counting system and the number of passengers measured by the second counting system, for example, in a highway parking area There is a configuration in which a notification about the shortage of the number of people in the car at the time of departure after a break or the like is given by video or audio.

In such a configuration, it is preferable that information on the number of people counted can be exchanged via the cooperation modules respectively provided in the first counting system and the second counting system. In particular, when the first counting system is a device such as a handy terminal or a portable terminal, it is preferable to install a module for cooperation with the second counting system afterward. It is preferable that a function for linking the first counting system and the second counting system can be added to the imaging device linking module 611 of the user terminal 106 such as a smartphone to be connected.

As external speakers and monitors connected to the imaging equipment 101 (101F, 101R) that can be used in the control examples 3-1 to 3-3, for example, the The external speaker or monitor may be a virtual character display device that displays a virtual character recognized as a virtual leader, a virtual drive assistant, a virtual drive companion, a virtual passenger, or the like.
In such a configuration, it is preferable to output a message from the virtual character to the kindergartener, such as "Please take a seat." In addition, it is more preferable that the user can select to output a message such as "I want you to teach me how to sit" instead of such a message so that the child wants to sit in the seat himself. good.

Fourth control example Input example: An image that can specify that a person got into the vehicle 10 or got out of the vehicle 10 .
Output example: Change the length of time until recording of video data ends.

4-1 Control Example When the control unit 303 identifies that a person has boarded the vehicle 10 (S810, S930), the control unit 303 controls the photographing equipment 101 (101F, 101R) and the vehicle interior photographing camera 102. (102F, 102R), the length of time until the recording of video data by the imaging device 101 (101F, 101R) is completed, and the power source 311 of the imaging device 101 (101F, 101R). The length of time until the camera is turned off or until the shooting or recording of shooting is stopped is extended beyond the length of time set at that time (S820).

Note that the above-mentioned length of time is the length of time until the photographing device 101 (101F, 101R) is shifted to a standby state, a sleep state, a shutdown state, or the like, for example, in order to save battery capacity or storage medium capacity. be. The control unit 303 may be configured to be able to change these time lengths from preset lengths based on the setting input by the user.

In this way, the control unit 303 can more reliably monitor a specific event, such as whether or not the occupant has fastened a seatbelt, during the extended period of time after the occupant enters the vehicle 10. can run to
In another embodiment, when the vehicle 10 is a commercial vehicle or the like and the crew is a sales person, the control unit 303 starts moving during the extended time after the crew gets into the vehicle 10. It is also possible to monitor whether or not

4-2 Control Example When the control unit 303 identifies that a person has gotten out of the vehicle 10 (S810, S930), the control unit 303 controls the photographing equipment 101 (101F, 101R) or the vehicle interior photographing camera 102 (102F, 102R), the length of time until the recording of video data by the imaging device 101 (101F, 101R) is completed, and the power source 311 of the imaging device 101 (101F, 101R). The length of time until the camera is turned off or until the shooting or recording of shooting is stopped is extended beyond the length of time set at that time (S820).

The control unit 303 may be configured to set the above time length in the same manner as in the control example 4-1.
In this way, the control unit 303 can detect a specific event, for example, whether the occupant has safely left the vehicle 10 or whether the vehicle 10 has stopped after the occupant has exited the vehicle 10 until the extended time has elapsed since the occupant exited the vehicle 10 . It is possible to more reliably monitor whether or not a suspicious person has approached before the door is locked.

In particular, it is preferable that the control unit 303 can set the length of time to be extended when a person gets out of the vehicle 10 longer than the length of time to be extended when a person gets into the vehicle 10 . As a result, when a person gets off the vehicle 10, particularly when a person disappears from the vehicle 10, the control unit 303 can monitor the presence of the person in the vehicle 10 with the human eye. The above monitoring can be performed for a longer period of time than when a person gets into the vehicle 10 .

In both the 4-1 control example and the 4-2 control example, the control unit 303 sets the time length to each of the imaging devices 101 (101F, 101R) and the cameras 102 (102F, 102R). It is preferable that the configuration can be set individually.
For example, in a situation where the crew uses the vehicle 10 for construction or civil engineering work, after the crew gets out of the vehicle 10, for example, the hatchback door at the rear of the vehicle 10 can be opened to load and unload work tools and equipment on a daily basis. When a relatively long time is spent, the photographing time of the photographing equipment 101 (101F, 101R) for photographing the surroundings of the hatchback door and the camera 102 (102F, 102R) for photographing the interior of the vehicle is set to a longer period of time, and the work tool is used. It should be possible to record more reliably from the start to the end of the loading and unloading work of equipment, etc.

4-3 Control Example When the control unit 303 identifies that a person has boarded the vehicle 10 (S810, S930), the control unit 303 controls the input/output unit 315 of the imaging device 101 (101F, 101R), From the output device of the device connected to the photographing device 101 (101F, 101R), an image and sound notifying that the vehicle interior is being recorded is output (S820). ' or an image or video saying 'Recording inside the vehicle' is output on the monitor.

As a result, the user can more reliably avoid situations where recording is performed without the passenger's permission.
Furthermore, the user gives the passenger a sense of security that the video inside the car is being recorded, and on the other hand, impresses that the video inside the car is being recorded. etc. can be enhanced.
Giving the impression that the video inside the car is being recorded makes it easier to reduce the occurrence of false complaints about criminal acts, harassment acts, etc., for the purpose of mischief, personal grudges, and the like.

Fifth control example Input example: video, reservation information 421, 521, etc. that can identify the individual passenger.
Example output: Activation of an individual's assigned function.

5-1 Control Example When the control unit 303 identifies that the occupant who got into the vehicle 10 is a specific person (S810, S930, S1010), the control unit 303 starts executing the function assigned to the identified person. (S820).

5-1-1 Control Example The control unit 303 controls the vehicle 10 to be used for providing a service, for example, the vehicle 10 used in a driving school. is the instructor 1910 (S810, S930, S1010), the instruction support function of the photographing equipment 101F, 101R is turned on (S820).
The guidance support function is, for example, the time until the end of the training, information about whether the vehicle 10 is traveling within the driving range of the road training, etc. , or output from an external speaker or monitor connected to the imaging device 101 (101F, 101R). As a result, instructor 1910 can concentrate more on driving instruction and the like.

5-1-2 Control Example The control unit 303 controls the control unit 303 in a situation where the vehicle 10 is used to provide a service, for example, the vehicle 10 used in a driving school. is the trainee 1920 (S810, S930, S1010), turn on the training driving support function of the photographing devices 101F, 101R (S820).

The training driving support function is, for example, a message that relieves tension to the trainee 1920 at the start of the training, such as "Vehicle 001 is in charge of today's training. Thank you very much." is good, so I think I can drive comfortably", "Jupiter, Twitter!", "Jupiter, I'm watching over you!" ) messages such as catchphrases used on the website, and messages that notify in advance that you are approaching a road or traffic situation with a high degree of driving difficulty set for each driving school, for example, This is the most difficult route in the course.", etc., from the speaker or display unit of the imaging device 101 (101F, 101R), or output from the external speaker or monitor connected to the imaging device 101 (101F, 101R). is.
As a result, trainee 1920 is more relaxed, more relaxed, or more at ease when driving. In particular, when a message such as a commercial for the photographic equipment 101 or a catchphrase used on the website of the manufacturer or sales company of the photographic equipment 101 is notified, the trainee casually uses the product of the same manufacturer or sales company during training. or appeal to the instructor.

5-1-3 Control Example When the control unit 303 identifies that the occupant is a person requiring observation (S810, S930, S1010), it turns on the person tracing function of the photographing devices 101F, 101R (S820). .

The person tracing function has a higher quality than the setting in the continuous recording mode of the photographing equipment 101 (101F, 101R), for example, the setting in the above-described long-time recording mode, and the individual who is the person to be observed can be traced to the vehicle 10. Continue shooting while using .
As a result, the user can more accurately verify whether the service is appropriate for customers who feel uneasy about using the service, or more precisely verify the behavior of employees who frequently receive complaints. be able to.

5-1-4 Control Example When the control unit 303 identifies that the person registered in the reservation information 421 and the person photographed by the photographing equipment 101 (101F, 101R) are different persons (S810, S930, S1010), and outputs information about the mismatch of persons to at least one of persons and devices inside and outside the vehicle (S820).

The control unit 303 receives information on person mismatch from, for example, the input/output unit 315 of the imaging device 101 (101F, 101R), such as a speaker or monitor, or from the speaker or monitor of a device connected to the imaging device 101 (101F, 101R). Therefore, it is preferable to notify by voice, image, video, etc., or transmit to an external device.
As a result, the person inside the vehicle, for example, the instructor 1910 of the driving school, and the user outside the vehicle, such as the person in charge of the driving school, who is registered in the reservation information 421 and is originally scheduled to use the vehicle 10, be able to respond more quickly to situations where someone is on behalf of

For example, in the case of use at a driving school, if the trainee 1920 is replaced by another person, the instructor 1910 will give a notice in the car such as "The person who made the reservation is different." You can contact us quickly.

In another example, the user can respond more quickly when the person who has reached the next available driving time and the person who is about to drive the vehicle 10 are different people.
A “person who has reached the time allowed for the next drive” is, for example, a person who has passed a predetermined rest period defined by laws and regulations after the previous driving.
The control unit 303 is, for example, driving schedule information of a driver such as a sightseeing bus that uses a plurality of vehicles 10, and based on the driving schedule information that reflects a predetermined break time stipulated by laws and regulations, It is preferable to specify a person who has reached the next drivable time, and to determine whether or not the person who intends to drive the vehicle 10 is included among those persons.

5-1-5 control example The control unit 303 determines from the reservation information 421 or the video data of the imaging equipment 101 (101F, 101R) that the person driving the vehicle 10 is a person set as an output restriction target. is specified (S810, S930, S1010), the output restriction notification mode of the imaging device 101 (101F, 101R) and the output restriction mode of the vehicle 10 are turned on (S820).

The "output limit notification mode" is an operation mode in which a notification is issued when, for example, the speed of the vehicle 10 or the volume of the in-vehicle speaker approaches the limit value.
In such a configuration, for example, when multiple forklift trucks are shared by multiple drivers, more attention should be given to drivers who tend to drive beyond the safe speed range set by the user. While being prompt, other drivers can be avoided from being distracted by such reminders.

The "output limit mode" is, for example, a control mode that limits the speed of the vehicle 10, the maximum volume of the in-vehicle speaker, and the like.
In such a configuration, for example, when a plurality of forklifts are shared by a plurality of drivers, a speed limit can be set for drivers who tend to drive beyond the safe speed range set by the user. , while being able to manage a safer driving speed on average for that driver's driving, other drivers are allowed to temporarily exceed the safe speed range when necessary. It becomes possible.

Control Example 5-1-6 The control unit 303 determines that the person driving the vehicle 10 is the person set as the driving behavior monitoring target based on the reservation information 421 or the video data of the imaging equipment 101 (101F, 101R). When it is specified (S810, S930, S1010), the driving behavior monitoring mode of the photographing device 101 (101F, 101R) and the vehicle 10 is turned on (S820).

The “driving behavior monitoring mode” is, for example, a mode for monitoring inattentive driving or operation of the user terminal 106 during driving.
In such a configuration, when a plurality of drivers share a plurality of vehicles 10 , the control unit 303 controls a person set by the user, for example, a person who tends to frequently look aside while driving. It closely monitors the behavior and outputs various notification sounds and notification screens as appropriate, such as ``Watch out for distracted driving'' and ``At this intersection you need to be careful ahead''.

As a result, the user can increase the attention of the driver who needs more attention by outputting unnecessary attention to the driver who has no history of accidents, etc., while calling the attention of the driver with high frequency. It becomes easier to avoid scraping.

Note that the control unit 303 converts the notification sound and the notification screen, for example, as a notification or conversation by a character such as a virtual assistant, into the display of the imaging device 101 (101F, 101R) or the device that cooperates with the imaging device 101 (101F, 101R). or output from a speaker.

5-1-7 control example When the control unit 303 identifies, from the reservation information 421, 521, etc., that the passenger is a person who is scheduled to receive a service during a predetermined time period determined by a timetable, etc. (S810, S1010), and set the imaging time zone of the imaging equipment 101 (101F, 101R) (S820).

For example, if the user is a manager of a driving school or the like, the control unit 303 of the photographing equipment 101 (101F, 101R) determines, for each passenger specified from the acquired reservation information 521, For example, during the training period, the imaging equipment 101 (101F, 101R) performs imaging.

Note that the control unit 303 selects at least one of the time period before the start of the training and the time period after the end of the training, in addition to the time period from the start to the end of the training, for example, as the time period for using the service. , for example, about 5 to 10 minutes.

In this way, the user can also acquire video data around the vehicle 10 before and after the training, so that such video data can be used to provide more appropriate services and to prevent problems in the vicinity of the vehicle 10. It can be used for verification when

5-1-8 Control Example When the control unit 303 identifies, from the reservation information 421, 521, etc., that the passenger is scheduled to receive training-related services (S810, S1010), the photographing device 101 (101F, 101R) Information on training contents for each passenger is output (S820).

For example, if the user is a manager of a training gym or a personal gym, the control unit 303 of the photographing device 101 (101F, 101R) is a passenger using an exercise bike or running machine specified from the acquired reservation information 521 or the like. For each trainee, at least one of audio, image, and moving image is output as information on the training content of the crew member.

Note that the control unit 303 uses predetermined training information, performance of the crew during training, such as exercise load, lap time, form, etc., and biological information such as heart rate, respiration rate, and perspiration, as information related to training content. It is better to have a function to output training information based on such as quantity.

By doing so, the user can cause the training information based on the desired training content and exercise intensity input by the trainee as the reservation information 421 and the user information 422 to be output from the photographing equipment 101 (101F, 101R). , trainers and trainees can output training information personalized to each trainee without having to set menus and the like by themselves each time during training.
As a result, trainees can receive personalized training for themselves even in situations where they cannot communicate with the trainer at close range.

5-1-9 Control Example When the control unit 303 identifies that the passenger has changed (S810, S1010), it outputs information about the company or organization (S820).
The information about the company or organization is, for example, information about the user's company or information about the manufacturer or sales company of the imaging equipment 101 (101F, 101R).

For example, when the photographing equipment 101 (101F, 101R) detects that the person sitting in the driver's seat has changed, even if the accessory power source is not operated, the above-described photographing equipment 101 manufacturer or sales company It is preferable to provide a function of displaying a startup screen including a name or a housemark, such as a Y logo startup screen displaying the applicant's housemark, also called the Y logo. In this way, regardless of whether or not the accessory power supply is operated, when the person sitting in the driver's seat changes, the new person sitting in the driver's seat can be appealed about the manufacturer or the sales company. can be done.

Alternatively, when the accessory power is turned off (ACCOFF), the photographing equipment 101 (101F, 101R) displays the name of the manufacturer or sales company of the photographing equipment 101, or an end screen containing a house mark, for example, the end screen of the Y logo. It is preferable to have a function to turn off the accessory power supply while displaying, etc. In this way, when the accessory power source is turned off and the use of the vehicle ends, the manufacturer or sales company can be appealed.

Alternatively, when the accessory power supply is turned on, the photographing equipment 101 (101F, 101R) will say, "Start XX recording" or "Turn on XX power" ("XX" indicates the name of the operator.) In this way, it has a function of outputting, by voice or display, a message indicating the operation of the photographing equipment 101 (101F, 101R) such as that the accessory power supply is turned on or that recording is started, together with the name of the operator. good. By doing so, it is possible to notify the fact that the accessory power supply is turned on or the fact that recording is started, and casually appeal to the manufacturer or the sales company.

Alternatively, the imaging device 101 (101F, 101R) may say, "Please drive carefully. By 〇〇", "Please drive safely. By 〇〇" It is preferable to have a function of outputting the name of the business operator and a message prompting safe driving by voice or display. By doing so, it is possible to inform the driver of safe driving and casually appeal to the manufacturer or the sales company.

Alternatively, when the power supply for the accessory is turned off, the imaging device 101 (101F, 101R) may display "Thank you for your hard work. 〇〇", "Thank you for the ride. 〇〇", and "Please use again. 〇〇". (“〇〇” indicates the name of the business operator.) Along with the name of the business operator, it is desirable to have a function to output, by voice or display, a message to thank the person who has finished driving. In this way, it is possible to show respect to the person who has finished driving and casually appeal to the manufacturer or the sales company.

Alternatively, the photographing equipment 101 (101F, 101R) is configured to be switchable between the driving school mode and the general-purpose mode. name or a house mark, while other modes, such as the general-purpose mode, should not perform this process. By doing so, it is possible to target people who are in training and appeal to the manufacturer or the sales company.

5-2 Control Example When the control unit 303 identifies that an infant is included among the occupants who have boarded the vehicle 10 (S810, S930, S1010), the control unit 303 executes an abandoned prevention function and an infant watching function. (S820). It should be noted that the inclusion of infants in the occupants can be specified based on the video image of the video data, and can also be performed based on the audio of the video of the video data.
As a result, the control unit 303 can perform the abandonment prevention function without requiring an input operation by the user, even in a state in which the user gets on and off while taking care of the infant, and thus has less time to spare compared to normal getting on and off. and an infant watching function can be executed.

Abandonment prevention function means that when an infant is left alone in the vehicle 10 for a period longer than the set time length, the control unit 303 outputs a command to sound the horn of the vehicle 10 or activate the air conditioner. Adjust the temperature inside the vehicle, deploy a sunshade to avoid direct sunlight, output a command to bring the environment in the vehicle 10 closer to the set environment, or notify the designated contact of the occurrence of the abandoned vehicle by telephone, e-mail, or the like. It is a function to

The function to watch over infants means that the infants in the car are exposed to sunlight, especially their face and eyes, objects are hitting infants in the car, especially their face and mouth, and the infant's posture is unstable. For example, the child's body protrudes from the child seat. This makes it easier for the user to deal with situations that are uncomfortable for young children, which are difficult for the user to recognize while driving.

In addition to infants, generally children from one to six years old, for example, infants, elderly people, people requiring nursing care, individuals with some kind of disability or handicap, pets, etc. can also be applied.

5-3 Control Example When the control unit 303 identifies that the occupant who got into the vehicle 10 is an authorized user (S810, S930, S1010), the control unit 303 activates the photographing device 101 (101F, 101R). Operate in the normal operation mode assigned to the authorized user (S820).

It should be noted that normal operation modes assigned to authorized users include operation modes that are pre-registered in the photographing equipment 101 (101F, 101R), and operation modes in which on/off of various functions are personalized for each user. There may be.

5-4 Control Example Conversely, when the control unit 303 identifies that the passenger who got into the vehicle 10 is not the authorized user (S810, S930, S1010), the control unit 303 controls the photographing device 101 (101F, 101R) in silent mode (S820).

The silent mode is an operation mode in which it is difficult to visually confirm that the imaging device 101 (101F, 101R) is in operation. For example, recording is performed without turning on the recording lamp. As a result, the control unit 303 can perform photographing without being noticed by the culprit when the vehicle 10 has been burgled or stolen.
As a result, the culprit who notices that the photographing equipment 101 (101F, 101R) has taken a picture destroys the photographing equipment 101 (101F, 101R) or removes the storage medium from the photographing equipment 101 (101F, 101R). easier to avoid.
Note that, in this control example, the control unit 303 may be configured to collectively identify persons other than authorized users as individuals called “unauthorized users”.

5-5 Control Example When the control unit 303 identifies a specific person who got into the vehicle 10 (S810, S930, S1010), the control unit 303 generates information based on the identified person's situation, state, preference, etc. is output (S820).
The control unit 303 changes at least one of the notification sound and the notification screen output from the photographing equipment 101 (101F, 101R) based on the specified state or action of the person. In particular, the control unit 303 outputs from or connects to the imaging equipment 101 (101F, 101R) for each person even if the environments and situations inside and outside the vehicle 10 are the same or similar. It is preferable to change the notification sound and the notification screen output from the device that receives the notification.

Furthermore, the control unit 303 may present changeable notification sounds and notification screens to the user, and may be configured to receive user selections for them. It is better if the configuration is such that
As a result, the user can select and customize desired notification sounds and notification screens preset in the photographing equipment 101 (101F, 101R), etc., or create unique notification sounds and notifications that better reflect the user's preferences. You can set the screen.

Control Example 5-5-1 When the control unit 303 identifies an individual whose reservation or schedule regarding the use of the vehicle 10 is known (S810, S930, S1010), the information about the known reservation or schedule is output (S820).

In one embodiment, when the vehicle 10 is used for training at a driving school and the control unit 303 identifies an individual whose training content is known while using the vehicle 10 this time, the control unit 303 For example, it is preferable to notify the trainee 1920 of the outline of the current training content, points to note, etc. before starting driving, thereby making it easier for the trainee 1920 to face the training more smoothly.

It is preferable that the control unit 303 further outputs caution points set according to the training stage of the trainee 1920, advice reflecting the contents of the previous training, and the like.
For example, the control unit 303 provides the following information: "Today is the nth lesson, isn't it?"; , "Please do your best, Mr. 〇〇" (〇〇 is the name of the trainee 1920), etc., advice, support, etc.
Furthermore, the control unit 303 preferably has a function of receiving input of notifications and advice from the user.

In another embodiment, the vehicle 10 is used for business, and the control unit 303 determines the content of the business during the current use of the vehicle 10, such as the date and place of the appointment with the business partner. When the individual who is in the car is identified, the control unit 303 may notify, for example, an outline of the content of the current lesson and points to note before driving, so that the student 1920 can more smoothly participate in the lesson. I feel refreshed.

In still another embodiment, when the vehicle 10 is used for work and the control unit 303 identifies an employee whose work performance is known, the employee's performance and achievements can be thanked or given advice. , etc., which makes it easier for the person in charge of the business, who is the user, to support each employee individually.
As a result, the user can provide a more detailed follow-up system for each individual user of the vehicle 10, thereby easily improving the satisfaction of the service of the user of the vehicle 10 and the work of the employee. .

5-5-2 Control Example When the control unit 303 identifies a passenger based on the reservation information 421, the employee information 423, the user information 422, etc. at the start of the photographing equipment 101 (101F, 101R) (S810 , S930, S1010), and changes the startup screen and startup sound of the photographing device 101 (101F, 101R) according to the specified passenger (S820).
The startup screen and startup sound to be changed may be preset in the imaging devices 101 (101F, 101R) and may be selected by the user. It is preferable to have a configuration that accepts input to the storage area.

The control unit 303 has a storage area configured to be unrewritable by the user in addition to a storage area configured to be rewritable by the user. It is preferable that the preset startup screen and startup sound are stored in a storage area configured to be unrewritable by the user.
A non-rewritable storage area is a storage area in which the manufacturer or sales company of the photographing equipment 101 (101F, 101R) does not assume, guarantee, recommend, or prohibit rewriting by the user. means

The control unit 303 may be configured to acquire the start-up screen for change and the start-up sound from the input from the input/output unit 315 of the imaging device 101 (101F, 101R), for example, from the microphone. , and as will be described later in relation to the operation screens 1500 and 1600 of FIG.
Note that the operation screens 1500 and 1600 are examples of video data management screens.

The control unit 303 displays a list of voice phrases and the like on the screen formed as the input/output unit 315, and provides a recording button formed as another input/output unit 315. When the button is pressed, a selection is made from the list. It is preferable to have a function to record the voice corresponding to the voice phrase. The control unit 303 preferably has a function of reproducing the recorded voice for confirmation.
Note that the voice phrase may be recorded on the SD card 306 using a viewer (for example, a PC viewer) so that it can be imported into the imaging device 101 (101F, 101R). For example, a viewer that can be operated using the facility terminal 105 will be described later using FIGS. 15 to 19 and the like.
The control unit 303 preferably has a function of stopping the voice playback and entering a recording state when the record button is pressed during voice playback, and replacing the voice being played back with the recorded one.

Since the startup screen and startup sound are less likely to remain in passengers' memories and impressions than other screens and sounds, the user considers the startup screen and startup sound to be more attractive to passengers. By changing to , it is possible to further improve the passenger's impression of the service and work. The startup screen may include, for example, the name or house mark of a company formed by the user of the imaging device 101 or its affiliated companies, or the name or house mark of the manufacturer or sales company of the imaging device 101 (for example, the applicant's (also called a Y logo as a house mark) is preferably displayed on the screen in order to enhance the advertising effect. As the startup sound, it is desirable to use the sound calling out the name of the manufacturer or sales company of the photographing equipment 101 in order to enhance the advertising effect. Also, for example, it is desirable to use a voice message such as a catchphrase used in the commercials of the photographing equipment 101 as described above or on the website of the manufacturer or sales company of the photographing equipment 101 in order to enhance the advertising effect. For example, since there is a possibility that a graduate of a driving school will purchase a vehicle, such an advertising effect increases the possibility that the above-mentioned manufacturing company or sales company's products and in-vehicle equipment (for example, drive recorders) will be purchased. expected to be effective.

When the user uses the vehicle 10 for service provision or business, the control unit 303 further sets the startup logo of the photographing equipment 101 (101F, 101R) to the manufacturer of the photographing equipment 101 (101F, 101R). It is preferable to have a function to change the logo of the sales company to that of the user's company or organization.
It is preferable that the control unit 303 has a function capable of similarly changing information such as other notification screens and notification sounds in addition to the change start screen and start sound.

It is preferable that the control unit 303 further has a function of changing the start-up screen and the start-up sound for each day of the week, month, and day. Note that the day of the week and month and day are examples of date and time information.
In such a configuration, the user sets a detailed message for the vehicle 10 used for business in accordance with the philosophy, such as "Let's look at each other and say hello", "Let's act with the customer's feelings in mind", etc. can do.

5-5-3 Control Example When the photographing equipment 101 (101F, 101R) is activated, the control unit 303, prior to outputting the activation screen and the activation sound, determines the attributes of the occupant, such as age and sex, from the photographing data. and appearance features are identified (S810, S930, S1010), the startup screen and startup sound are changed according to the identified attributes (S820).
The startup screen and startup sound to be changed can be set in the same manner as in the control example of 5-5-2 above, so the description is omitted.

In both the control example 5-5-2 and the control example 5-5-3, the user can finely change the startup screen and the startup sound according to the characteristics of the occupant. Yes, it is possible to output a more targeted message to service customers and employees at a timing that is very likely to leave an impression.
The control unit 303 may specify the characteristics of the passengers by allocating the characteristics preset by the manufacturer or sales company of the photographing equipment 101 (101F, 101R) to each passenger.

Additionally or alternatively, the controller 303 may add passenger characteristics based on characteristics entered by the user. Furthermore, it is preferable that the control unit 303 be configured to be able to add various features or a feature set consisting of a plurality of features provided by the manufacturer or sales company of the imaging device 101 (101F, 101R) by updating or purchasing. .

When the manufacturer or sales company of the imaging equipment 101 (101F, 101R) provides characteristics obtained by analyzing video data collected from a plurality of users by machine learning or the like, the user can understand the relationship between data volume and computational load. It is possible to efficiently use features that are difficult for users to obtain by themselves.

5-5-4 control example When the control unit 303 determines that the external features of the vehicle 10 used up to the previous time differ from the external features of the vehicle 10 used this time (S810, S930 , S1010), and output information about the difference in appearance characteristics (S820).

The appearance feature may be a feature that can be identified from the appearance of the user, such as whether or not glasses are worn. For example, when a specific individual who wore glasses when using the vehicle 10 until the previous time does not wear glasses when using the vehicle 10 this time, the control unit 303 asks, for example, "Do you need glasses?" A message such as "Are you wearing contacts today?" is output.
As a result, the user of the vehicle 10 can feel a sense of security as if he or she is being watched over, and can be reminded to put on the glasses if the user has actually forgotten to put them on.
The control unit 303 may acquire information about the characteristics of the vehicle 10 used up to the previous time as the user information 522 from the facility terminal 105, for example (S1010).
The appearance features may also be features that can be identified from the appearance of the user, such as the length of the user's hair, the hairstyle, the presence or absence of makeup, the method of makeup, facial expression, and clothing. The message may include information about changes in appearance characteristics and information pointing out appearance characteristics (for example, information praising appearance characteristics).

Control Example 5-5-5 When the control unit 303 identifies an individual whose taste is known (S810, S930, S1010), it outputs a content video or advertisement video that matches the passenger's taste (S820). .
It should be noted that the control unit 303 controls persons classified into various statistical groups based on age, sex, body type, occupation, fashion, destination, content of conversation in the vehicle, etc., and hobbies and If a person who belongs to a group whose preference is known is specified as a ``person whose preference is known'', the content of notification information can be selected and determined more flexibly.

Further, the controller 303 determines from the video data that the occupant is exhibiting boredom-related reactions, such as squinting or closed eyes, frequency of yawning, jerky head movements, etc. In such a case, for example, outputting information that matches the statistically known tastes of the passengers can easily draw out the passengers' interest in the content video and the advertisement video.

5-5-6 Control Example When the control unit 303 identifies an individual whose personality is known (S810, S930, S1010), the expression of the notification is changed to match the passenger's personality (S820). .
The control unit 303 preferably acquires information about the personality of the individual from the facility terminal 105, for example, as the user information 522 (S1010).

Control example of 5-5-6-1 When the control unit 303 identifies that a specific individual who tends to play calm music has boarded the vehicle 10 (S810, S930, S1010), the control unit Various notifications and messages output by 303 are selected from a notification set or message set with a calm impression and output (S820).

The calm impression notification set or message set is, for example, audio files preset in the imaging device 101 (101F, 101R) recorded by a highly rated voice actor or the like giving a calm impression, or by the user. A set of audio files recorded in the voice of a character recognized as having a calm personality.

5-5-6-2 control example When the control unit 303 identifies that a specific individual who tends to play up-tempo music has boarded the vehicle 10 (S810, S930, S1010), control Various notifications and messages to be output by the unit 303 are selected from a notification set and a message set with a lively and active impression and output (S820).
The lively and active impression notification set and message set are, for example, audio files preset in the imaging device 101 (101F, 101R) recorded by highly rated voice actors who give a lively and active impression. Alternatively, a set of audio files recorded in the voice of a character perceived by the user to have a lively and active personality.

The control unit 303 of the same imaging device 101 (101F, 101R) mounted on the same vehicle 10 is described in the control example of 5-5-6-1 and 5-5-6-2. Control may be performed for each person using the vehicle 10 on a case-by-case basis.

The user can use the notification set and message set described in the control examples of 5-5-6-1 and 5-5-6-2 to the manufacturing companies and sales companies of the imaging equipment 101 (101F, 101R). Additional purchases may be made from
Further, the control unit 303 preferably has a function of proposing a notification set or a message set that is likely to suit the preferences of the user or the passenger to the user or the passenger.

5-5-7 Control Example When the control unit 303 identifies that the passenger is the person who reserved the copy of the video data (S810, S930, S1010), the control unit 303 copies the video data. Video data is created by subjecting a person other than the person who reserved the video data to privacy protection processing (S820).
An example of this control will be described later with reference to FIGS. 19 and 20. By doing so, the user can provide video data in consideration of the privacy of fellow passengers to the person who reserved the duplication of the video data. can be done.

Sixth control example Input example: video or information that can specify that a person has boarded the vehicle 10 .
Output example: Control for starting shooting and recording of the shooting devices 101 (101F, 101R).

The control unit 303 detects that a person has boarded the vehicle 10 based on the images from the imaging devices 101 (101F, 101R), the signals from the human sensors mounted on the vehicle 10, the signals from the user terminal 106, and the like. is specified (S810, S930), the control unit 303 performs control to start photographing and recording by the photographing equipment 101 (101F, 101R) and the vehicle interior photographing cameras 102 (102F, 102R) (S820).
Control unit 303 preferably has a configuration that executes the above-described control regardless of whether the main power supply, engine, motor, etc. of vehicle 10 are on or off.

As a result, the user can, for example, view video data of the vehicle 10 being parked with the engine turned off, being used for a purpose unintended by the user, or of an unexpected situation occurring with the engine turned off. , can be obtained more reliably.

Seventh control example Input example: An image that can identify a person who operates an operation element of the vehicle 10 .
Example output: Event settings according to the person who performed the operation.

When the control unit 303 identifies the person who has operated the operation element of the vehicle 10 based on the image captured by the imaging device 101 (101F, 101R) (S810, S930), the control unit 303 detects the same operation by another person. Control is performed to set the operation of an element as a different event (S820).
Thereby, the user can judge the appropriateness of the executed event by more clearly distinguishing the person who operated the operation element.

7-1 Control Example The control unit 303 determines whether the person who performed the brake operation (operation) in the vehicle 10 provided with a plurality of brake pedals, for example, the vehicle 10 for driving training, is the instructor 1910, or , if the trainee 1920 is specified based on the movement of at least one of the legs of the instructor 1910 and the trainee 1920 in the image captured by the imaging device 101 (101F, 101R) (S810, S930, S1010) , the brake operation is set as a separate event depending on whether the person who performed the brake operation is the instructor 1910 or the trainee 1920 (S820).

As a result, the control unit 303 allows the instructor 1910 to perform the braking operation even if the driving environment of the vehicle 10 is the same, for example, even if the inter-vehicle distance and relative speed with respect to other vehicles and changes thereof are the same. Different event information may be assigned to the video data depending on whether the trainee 1920 has braked or not.

For example, when the trainee 1920 brakes suddenly in a driving state in which the distance between the vehicle and the relative speed to another vehicle is appropriate and the brake operation is not required, the control unit 303 can The brake operation by 1920 is not recorded as a problem event, and in the same state, if the instructor 1910 brakes suddenly, it is recorded as a problem event because there is a possibility that inappropriate instruction was given. should be done.

The processing described above may be executed at the transfer destination of the video data connected to the processing device 108, for example, the facility terminal 105, at the time of transferring the video data using the processing device 108 described above, or after that. .

Eighth control example Input example: An image that can identify that the occupant is the person who got into the vehicle 10 for the first time that day.
Output example: Change notification sound or notification screen.

When the control unit 303 identifies that it is the first ride of the day for the person who got into the vehicle 10 (S810, S930, S1010), the control unit 303 outputs a daily first-ride notification sound ( S820).

The voice for notifying the first boarding time for each day is stored in the voice information stored in the storage area configured so as not to be rewritable by the user of the photographing device 101 (101F, 101R) and in the storage area configured so as to be rewritable by the user. It is preferable to have a configuration in which selection can be made between stored audio information.

It is preferable that the control unit 303 is configured to share the usage status of other vehicles on that day. For example, in a driving school or a taxi office that owns a plurality of vehicles 10, the control unit 303 is in a state where the photographing devices 101 (101F, 101R) of each vehicle 10 are connected to each other via a wireless LAN or the like. It is preferable that the information about the person using the vehicle 10 is shared.
This makes it easier for the user to avoid a situation in which a notification that is scheduled to be sent once a day, such as a safety chant before starting work, is sent multiple times to one crew member.

Ninth control example Input example: A video that can identify the clothes of the crew.
Output example: Change of the operation mode of the imaging device 101 (101F, 101R) according to clothes.

When the control unit 303 identifies that the driver is wearing work clothes (S810, S930), the control unit 303 causes the photographing equipment 101 (101F, 101R) to operate in business mode (S820).
For example, if the user is a private taxi driver, the control unit 303 can divide the operation mode of the imaging device 101 (101F, 101R) between business use and private use.

The control unit 303 may record the operating time of the imaging equipment 101 (101F, 101R) in the business mode. The control unit 303 transmits information about the total operating time in the business mode for a month to, for example, the external management server 107 operated by the sales company of the imaging equipment 101 (101F, 101R). The sales company may charge the user of the vehicle 10 for use of the business mode based on the received total operation time in the business mode for the month, the user information 725, the setting information 720, and the like.
By doing so, the user can try and start using the business mode at a lower cost than purchasing the right to use the business mode.

Tenth control example Input example: A video that can specify the ratio of the occupants to the angle of view of the video data.
Output example: Execution and stop of shooting and recording for each of the shooting devices 101 (101F, 101R).

When the control unit 303 specifies that the ratio of the occupants within the angle of view photographed by each of the photographing devices 101 (101F, 101R) and the vehicle interior photographing cameras 102 (102F, 102R) is larger than the set value. (S810, S930), the images of the photographing devices 101 (101F, 101R) and the vehicle interior photographing cameras 102 (102F, 102R) that are photographing images in which the ratio of the occupants occupying the angle of view to be photographed is greater than the set value. Data recording or video recording is stopped (S820).

A state in which the ratio of occupants in the angle of view is 0% is, for example, a state in which there are no people in the vehicle, and a state in which the ratio of occupants in the angle of view is 100%, for example, is too close to the photographing equipment 101 (101F, 101R) and the vehicle interior photographing camera 102 (102F, 102R), and only the person appears in the image.

Note that in another embodiment, instead of stopping the shooting or recording, the shooting or recording can be changed to the low image quality mode.
Thereby, the user can effectively utilize the storage capacity of the storage medium of the imaging device 101 (101F, 101R).
Furthermore, even when a person or object is in contact with the lenses of the photographing equipment 101 (101F, 101R) or the vehicle interior photographing camera 102 (102F, 102R) and the image data is completely dark, the control unit 303 Similar control should be performed.

Eleventh control example Input example: video and biometric information that can specify the biometric reaction of the occupant.
Output example: Activation of control modes and functions according to the emotions and physical conditions of passengers.

The control unit 303 detects the occupant from facial expressions, movements, etc. in the captured image data of the occupant, and biological information detected by the user terminal 106, such as a wearable terminal, such as heartbeat, biopotential, body temperature, etc. is in a relaxed state or in a tense state (S810, S930), various notification sounds, notification screens, etc. are output according to the identified state of the driver (S820). .
For example, when the control unit 303 identifies that the driver is in a relaxed state (S930), by playing up-tempo music, the driver's mood is further improved, leading to an appropriate awakening state, for example You can avoid being overly relaxed, which can lead to drowsiness.

In another embodiment, when the control unit 303 identifies that the driver is in a tense state (S930), by playing relaxation music or starting a conversation with a character such as a virtual assistant, It can be configured to calm the driver and reduce the tension.
As a result, the user outputs a notification that can be expected to give a better impression or to make the person more relaxed according to the person's state of tension or relaxation, for example, for each person in the vehicle 10. can do.

Twelfth control example Input example: An image that can identify the operation of the operation unit of the vehicle 10 by the passenger.
Output example: Activation of the voice input mode of the operation panel.

When the control unit 303 identifies that the occupant has operated the operation unit of the vehicle 10, such as the central console (S810, S930), it starts accepting voice input for various functions assigned to the console. (S820).
The control unit 303 may output information notifying that acceptance of the voice input has started when the voice input is started.

As a result, the occupants, especially the driver, can receive assistance by voice input at appropriate timing based on the motion of trying to operate the in-vehicle device while facing the front while driving, which is captured in the video data, for example. can.
It should be noted that the console or the like may be configured to respond to voice input, and may be an operation unit originally provided in the vehicle 10 or an operation unit retrofitted by the user.
Further, the control unit 303 may be configured to change the function enabling voice input according to the driver, for example, according to the frequency of each function for each driver.

Thirteenth control example Input example: A video that can specify that a predetermined event has occurred.
Output example: Output of records and notifications according to events.

When the control unit 303 identifies that a predetermined event has occurred (S810, S930, S1010), the control unit 303 adds information related to the event that has occurred to the video data, or outputs a notification related to the information related to the event. etc. are executed (S820).
Predetermined events include, for example, various harassment acts and harassment-like acts, approaching or contacting fellow passengers, leaving personal belongings behind in the car, chatting, remarks containing set keywords, sudden loud vocalizations, sudden It is good to be able to adjust the criteria for judgment for each person.

When these events occur, the control unit 303 records them as events and records video data. The control unit 303 may further add event information that has occurred to the video data, and associate the video data with the event information that has occurred.

Further, the control unit 303 notifies the person in the vehicle that the above event has occurred or that the event has occurred in the video data when the vehicle 10 is used next time, for example, after the imaging equipment 101 (101F, 101R) is activated. is being recorded, for example, a voice message such as "This SD card contains deviated data" or an image message that changes the color of the screen or indicator according to the recorded event. Alternatively, a notification about the occurrence of such an event or that the event is being recorded is sent to the terminal of the system administrator or the like via the network 103 .

Further, the control unit 303 may change settings of an event to be specified and an event to be recorded, for example, for each person according to selection input by the user. As a result, it is possible to flexibly record the video data of each event and recognize the presence or absence thereof.

For example, if the user is an operator or a manager of a driving school, the instructor 1910 who frequently complains about problematic behavior such as harassment behavior or behavior similar to harassment should be asked about these behaviors. While setting strict criteria for event recording and recording more video data, instructors 1910 who have never received complaints about such behavior should By loosely setting criteria for event recording, or by leaving low-quality video recording even after identifying an event occurrence, the recording capacity can be used effectively.

The process of identifying an act of harassment from the video data and the process of recording the occurrence of an act of harassment may be executed by the processing device 108 when the video data is transferred, or may be executed by the facility terminal 105 or the like that receives the video data. You may Thereby, the calculation load of the control unit 303 of the imaging device 101 (101F, 101R) can be reduced.

14th control example Input example: video that can identify the conversation of the crew.
Output example: Changing the sound quality of video data.

When the control unit 303 identifies that a conversation has occurred inside the vehicle (S810, S930), the control unit 303 uses the microphones attached to the photographing devices 101 (101F, 101R) and the vehicle interior photographing cameras 102 (102F, 102R) and the photographing devices. 101 (101F, 101R), the voice recording setting of the microphone attached to the device connected to 101 (101F, 101R) is changed, and control such as processing of voice information of video data is executed (S820).
The control unit 303 changes the voice recording settings by improving the recording sound quality, improving the recording sensitivity, switching the directivity, adjusting the gain, and the like.

The control unit 303 removes or reduces noise and environmental sounds from the audio information of the video data using noise canceling technology or the like as processing of the audio information of the video data.
Additionally or alternatively, the control unit 303 may perform speech clarification as processing the audio information of the video data.
It is preferable that the control unit 303 is configured to change the voice recording settings described above and process the voice information of the video data differently for each microphone installed in the vehicle.

Fifteenth control example Input example: video that can identify the conversation of the crew.
Output example: Playback priority setting according to conversation.

When the control unit 303 identifies that a conversation in the vehicle, particularly a conversation that seems to be lively, has occurred (S810, S930), the plurality of image capturing devices 101 (101F, 101R) and the vehicle interior image capturing camera 102 (102F, 102R) is set to a reproduction priority (S820).
For example, the control unit 303 sets a high video playback priority for video data in which the figure of a person having a conversation is best recorded, and also sets the video reproduction priority to the video data in which the voice of a person having a conversation is best recorded. Set a higher priority for audio playback of the video data that is being played.

When the user selects playback based on the playback priority for a plurality of video data shot in the same time slot of the same vehicle 10, the control unit 303 of the shooting device 101 (101F, 101R) controls the playback of the plurality of video data. From the data, for moving images, switch the moving image in which the figure of the person having a conversation is best recorded for each hour, and for the audio, switch the best recording of the voice of the person having a conversation for each hour. switch the audio that is played.
As a result, the user can reproduce a video that looks like it has been edited by picking up a plurality of videos captured by a multi-angle camera for each attractive scene.

The above control is based on the playback priority set by the control unit 303 of the imaging equipment 101 (101F, 101R), the display control module 515 of the facility terminal 105, the display control module 615 of the user terminal 106, and the processing device 108. The display control module 2215 can perform similarly.
It is preferable that the data processing module 517 of the facility terminal 105, the data processing module 717 of the external management server 107, the data processing module 2217 of the processing device 108, etc. have a function of setting the playback priority after the fact. .

The processing described above may be executed at the transfer destination of the video data connected to the processing device 108, for example, the facility terminal 105, at the time of transferring the video data using the processing device 108 described above, or after that. .

16th control example Input example: A video that can identify an occupant or an operation of an opening/closing part of the vehicle 10 .
Output example: Changing the setting of the imaging device 101 (101F, 101R) for imaging the vicinity of the opening/closing part.

When the control unit 303 determines that the opening/closing unit of the vehicle 10 has been operated (S810, S930, S1010), it turns on the recording extension function of the imaging device 101 (101F, 101R) (S820).

For example, the control unit 303 operates in an automatic recording stop mode in which recording is stopped in a predetermined time after the driver turns off the driving unit of the vehicle, such as the engine and the motor. For example, when it is identified that a door, hatchback, trunk, hood, etc., has been operated (S810, S930, S1010), it is preferable to enable the recording extension function for each person who operated the opening/closing part (S820).
The predetermined period of time may be a user-selectable period of time between several minutes and several hours.
The recording extension function is a function that extends the time until recording stops.

The control unit 303 determines which opening/closing unit is operated to execute the recording extension function, which opening/closing unit is operated, how long recording is to be extended, and whether the opening/closing unit is open. , whether to continue recording, and the like.
For example, when the user carries luggage, equipment, materials, waste, etc. from the vehicle 10 to the destination multiple times with the hatchback open, the control unit 303 shoots video data while the hatchback is open. should be continued.

In particular, when a plurality of photographing devices 101 (101F, 101R) are mounted on the vehicle 10, the image data of the photographing devices 101 (101F, 101R) for photographing the vicinity of the hatchback and the vehicle interior photographing cameras 102 (102F, 102R) Better to improve the quality of
If the frame rate of the improved video data is, for example, 30 fps, it is preferable because it is easy to confirm when a problem occurs.

Furthermore, if a person other than the user is being photographed while shooting continues, a voice message such as "Currently recording" will be output, and the sensitivity of the microphone that records the sound around the hatchback will be improved. Better.

Furthermore, it is preferable that the control unit 303 is configured to change the content of the setting change of the photographing device 101 (101F, 101R) based on which passenger has operated the opening/closing unit.
For example, in the case where the vehicle 10 is used in a driving school, if the student 1920 opens and closes the door near the end of the driving lesson, the instructor 1910 is still in the vehicle. If the instructor 1910 opens and closes the door without executing the control to improve the recording, in order to more reliably record the state of the inside and outside of the car after the lesson is over, control is executed to extend the recording and improve the quality of the video data. good.

In addition, for example, if the vehicle 10 is used for taxi business, if a passenger opens and closes the door when getting off the vehicle, this is a common occurrence (event) of normal business, so recording extension or video data quality change may be necessary. If the driver opens and closes the door, or there is a possibility that a problem will occur, control should be executed to extend the recording or improve the quality of the video data.

Seventeenth control example Input example: A video that can identify the occupants and the situation outside the vehicle.
Output example: Creation and distribution of NFT data based on images of passengers and the situation outside the vehicle.

17-1 Control Example The control unit 303 identifies a state in which the occupant exhibits a specific reaction, such as a state in which the occupant is happily riding in the vehicle or a state in which the occupant reacts to the scenery outside the vehicle. If so (S810, S930, S1010), create non-fungible token data (hereinafter referred to as "NFT data" (NFT: Non-Fungible Token)) of video data that captures such a situation, or Data used for creating NFT data, for example, data in the previous stage of NFT data, is created from video data obtained by photographing a situation (S820).

In the following description, NFT data itself or data used when creating NFT data is also referred to as "NFT-related data". The NFT-related data functions as a digital data possession certificate or an appraisal certificate, and certifies, for example, who took the video data and when it was taken.

For example, the control unit 303 of the photographing equipment 101 (101F, 101R) mounted on the vehicle 10 used in the driving school is configured to be able to associate the image outside the vehicle and the image inside the vehicle at the same time. The control unit 303 can create the NFT-related data based on video data with a sense of realism that makes it easy to understand the situation outside the vehicle and the reaction of the trainee 1920 .

The control unit 303 may create the NFT-related data, for example, in response to an input from the user terminal 106 of the occupant in the vehicle, or by referring to the reservation information 521 acquired from the facility terminal 105. good too.

The control unit 303 may have, for example, a function of writing the hash value of the video to the NFT blockchain.
By doing so, the user can expect not only to provide the training student 1920 with simple video data, but also NFT-related data with higher added value or higher value. NFT-related data can be provided to students 1920, particularly as purchasable merchandise.

Control unit 303 preferably has a function of transmitting NFT-related data to user terminal 106 owned by trainee 1920 .
User terminal 106 owned by student 1920 is an example of a second external device.

For example, if the trainee 1920 becomes an F1 driver in the future, the value of the NFT-related data and images based on it when he was a beginner in driving before becoming an F1 driver may be very high. It is possible not only to provide the student 1920 with an opportunity for training, but also to provide an attractive product for the trainee 1920 that has never existed before.

17-2 Control Example The control unit 303 identifies a state in which the occupant exhibits a specific reaction, such as a state in which the occupant is happily riding in the vehicle or a state in which the occupant reacts to the scenery outside the vehicle. If so (S810, S930, S1010), the NFT-related data of the video data that captures such a situation is created and output to the platform for distribution (S820).
Note that the platform is an example of a second external device. Also, the state of riding happily is an example of an emotional reaction.

As a result, for example, entertainers, distributors of various SNS, influencers, etc. can more easily distribute the NFT-related data created as described above with the owner specified. .

The control unit 303 recognizes the face of an occupant, for example, a driver, and displays an image/image including when there is movement in the face, for example, when there is movement in the orientation or facial expression of the face, or when there is conversation or utterance by the occupant. Cut out the audio section, convert the video data of the cut-out video section into NFT-related data and write it to the blockchain, and upload the entity of the video data of the section to the server, for example, the external management server 107, and automatically It is preferable to have a function to generate a site that sells (for example, auctions) on a regular basis.

The control unit 303 is even better if it has a function of including an image of the scenery outside. It is better to have a function to include video data of the cameras 102 (102F, 102R).

As a result, celebrities and various SNS distributors can provide fans, etc. with images of their latest situations as products or works relatively soon after shooting the video data, without editing work. can be sold.

Note that processing related to the creation and output of the NFT-related data described above may be executed in the transfer destination of the video data connected to the processing device 108 , such as the facility terminal 105 .
In such a configuration, for example, the data processing module 517 of the facility terminal 105 has a function of creating and outputting NFT-related data for video data edited by picking up more attractive scenes. It is better because you can create and output more sophisticated NFT-related data.

17-3 Control Example The control unit 303 identifies a state in which the occupant exhibits a specific reaction, such as a state in which the occupant is happily riding in the vehicle or a state in which the occupant reacts to the scenery outside the vehicle. If so (S810, S930, S1010), the NFT-related data of the video data that captures such a situation, including data for smart contracts, such as processing routines, etc., is created and transferred to a platform for distribution. Output (S820).

The “smart contract” in this configuration is automatically executed in relation to blockchain transactions, etc., in relation to the distribution and sale of NFT-related data. As a result, it is possible to execute a process of distributing and remitting part of the selling price of the NFT-related data, for example, to the provider of the vehicle 10 that performed the shooting or the installer of the drive recorder, in virtual currency, for example. Become.

The processing in the seventeenth control example is executed at the transfer destination of the video data connected to the processing device 108, for example, the facility terminal 105, during or after the transfer of the video data using the processing device 108 described above. may be

Eighteenth Control Example Input example: images that can identify passengers, reservation information 421, 521, and the like.
Example output: Controlling a virtual character according to the occupants.

When the control unit 303 identifies that the occupant, particularly the driver, is a specific user (S930, S1020), the control unit 303 uses the settings and parameters assigned to the occupant to select the imaging device 101 (101F, 101R) or the imaging device. A virtual character displayed by a device cooperating with the device 101 (101F, 101R) is controlled (S820).

In such a configuration, the vehicle 10 displays a virtual character in a state of cooperating with the photographing equipment 101 (101F, 101R), particularly in a state of receiving control from the control unit 303 of the photographing equipment 101 (101F, 101R). Equipment is installed.

The control unit 303 may be configured to display different virtual characters, or to display the same virtual character with different settings or parameters, depending on the person who is currently riding.

A virtual character is displayed by, for example, illustration, animation, CG, 3DCG, etc., and is used by the user as a virtual drive assistant, a virtual drive companion, a virtual passenger, a virtual trainer, a virtual personal trainer, a virtual secretary, etc. is a recognized character.

With such a configuration, even in a situation where a plurality of persons use the same vehicle 10 equipped with the same virtual character display device, the control unit 303 causes the virtual character display device to display, for each person, Different virtual characters or identical virtual characters with different personalities, such as personalities, can be distinguished and displayed.

The control unit 303 further updates the latest settings and parameters of the virtual character updated by the current use of the vehicle 10, particularly by driving, to the control unit 303 of another vehicle 10 or another terminal outside the vehicle 10, particularly is preferably configured so that it can be output to another virtual character display device.
With such a configuration, even if the user uses a different vehicle 10, in addition to being able to recognize the virtual characters riding together as the same person (same personality), the user can also use the vehicle at home or the like. Even with the virtual character display device installed in the virtual character display device, the virtual characters of the same person (same personality) can be displayed while sharing the experience.

With such a configuration, it is possible to effectively prevent the virtual character common to the vehicle 10 from reflecting the different driving experiences of a plurality of people in common. For example, when a user arrives at a certain destination for the first time, it is possible to more effectively prevent the virtual character from outputting a reaction that is different from the user's perception, such as "It's been a long time since I've been here." .
Thereby, the uniqueness of the relationship between individual users and individual virtual characters can be further improved.

Furthermore, a virtual character display device installed at a location different from the current location of the user or crew member, such as a home, has a virtual character control unit, and the control unit 303 of the photographing equipment 101 (101F, 101R) Such a virtual character display device may communicate with a virtual character using information acquired via the network 103 or the user terminal 106, such as a smartphone or smartwatch.

It is preferable that the control unit 303 is configured to acquire information from different virtual character display devices for each crew member.
With such a configuration, the control unit 303 can provide support according to the current driving situation and the like via virtual characters with which each crew member communicates on a regular basis at home.

FIG. 11 is an example of another control flow 1100 for the imaging equipment 101 (101F, 101R).
In another control flow 1100 of the imaging device 101 (101F, 101R), the control unit 303 of the imaging device 101 (101F, 101R) has been described using the control flow 800 of the imaging device 101 (101F, 101R) in FIG. As with various identifications, a first identification regarding the state or action of a person is performed (S1110), and the state of the vehicle 10, the situation inside or outside the vehicle 10, the action of the vehicle 10, the reservation details of the vehicle 10, the vehicle 10 (S1120), and control the imaging equipment 101 (101F, 101R) based on the first and second specifications (S1130). ).

Another control flow 1100 includes, in addition to the control flow 800 of the photographing device 101 (101F, 101R), the state of the vehicle 10, the situation inside or outside the vehicle 10, the operation of the vehicle 10, the reservation contents of the vehicle 10, service content, includes a second identification step S1120 of identifying at least one of them.

In another control flow 1100 of FIG. 11, the control unit 303 performs the first identification step S1110 prior to the second identification step S1120. The second identification step S1120 may precede the first identification step S1110.
Furthermore, when the control unit 303 simultaneously performs the first identification (S1110) and the second identification (S1120), particularly when both are continuously performed, the control unit 303 can determine the person in the vehicle each time. It is preferable that the photographing equipment 101 (101F, 101R) can be controlled according to the state of the vehicle 10 and the like.

In the second identification step S1120, the control unit 303 obtains, for example, information identified in the flow 1200 for identifying the state of the vehicle 10 in FIG. etc., at least one of the state of the vehicle 10, the situation inside or outside the vehicle 10, the operation of the vehicle 10, the content of the reservation for the vehicle 10, and the content of the service is specified. It should be noted that the flow 1200 for identifying the state of the vehicle 10 in FIG. 12 and the flow 1300 for cooperation with the reservation system in FIG. is.

Another control flow 1100 in FIG. 11 is a simplified flow of control based on the first specification and the second specification, and the control unit 303 performs a step ( S1110) and the step of performing a plurality of second identifications (S1120) may be performed in a different order or in parallel.
Furthermore, in addition to the step of performing the first identification (S1110) and the step of performing the second identification (S1120), the control unit 303 adds a step of performing another identification and a step of obtaining other information. It is better if it is a configuration that runs.

Before specifically describing another control flow 1100 of the photographing device 101 (101F, 101R) in FIG. 11, a flow 1200 for specifying the state of the vehicle 10 in FIG. 12 and a flow 1300 for cooperation with the reservation system in FIG. will be explained.

FIG. 12 is an example of a state identification flow 1200 of the vehicle 10 .
The control unit 303 of the imaging device 101 (101F, 101R) receives image data captured by the imaging device 101 (101F, 101R), various sensors mounted on the imaging device 101 (101F, 101R), such as an acceleration sensor 305 and a GNSS sensor. 307, a GPS sensor, and other sensors installed in devices connected to the imaging equipment 101 (101F, 101R), in particular, various sensors installed in the vehicle 10 itself, a storage device incorporated in the control unit 303, and , a storage device external to the control unit 303, etc., the state information of the vehicle 10 is acquired or detected (S1210).

The control unit 303 identifies the state of the vehicle 10 from the acquired or detected state information of the vehicle 10 (S1220). The control unit 303 outputs information about the specified content in the form of data, signal, or the like (S1230).

Although only an example of the flow 1200 for specifying the state of the vehicle 10 is illustrated in this specification, the control unit 303 performs the same flow as the example of the flow 1200 for specifying the state of the vehicle 10 in FIG. In order to specify the situation inside or outside the vehicle, the operation of the vehicle 10, the content of the reservation of the vehicle 10, and the content of the service, similar operations can be performed.

As a result, the control unit 303 can, for example, determine the state related to the position, speed, time period, distance, etc., the maintenance state, the loading state of the load, the state of the outside of the vehicle 10 before and after use, and the interior of the vehicle before and after use and during use. Circumstances surrounding the parking position of the vehicle 10, operations related to steering, braking, acceleration, stopping, etc., and reservations for use of the vehicle 10 when the vehicle 10 is used alternately or alternately by a plurality of users. For example, the waiting time from the previous use to the next use, the frequency of use for each user, and when the vehicle 10 is used for providing a service or business, the content of the service or business, such as the purpose of use, It is possible to carry out specifications related to the scope of use, the suitability of the service provided and the content of the business, etc.
Furthermore, when the vehicle 10 is used alternately or alternately by a plurality of users, the control unit 303 can classify and execute these identifications for each user.

FIG. 13 is an example of a cooperation flow 1300 with a reservation information system.
The control unit 303 of the photographing equipment 101 (101F, 101R) can be used, for example, in the above-described separate flow 1000 (FIG. 10) for specifying the state or action of a person or the flow 1200 (FIG. 12) for specifying the state of the vehicle 10. In order to acquire the reservation information 421, the cooperation flow 1300 with the reservation information system is executed. The reservation system is a system implemented in the reservation management server 104 described using FIG. 4, for example. In the following description, the term "reservation system" may be read as "reservation management server 104".

The control unit 303 executes the step of connecting with the reservation information system (S1310), and if the connection with the reservation information system is not established (No in S1320), starts the step of connecting with the reservation information system again.
When the control unit 303 establishes the connection with the reservation information system (Yes in S1320), it acquires the necessary reservation information 421 from the reservation information system (S1330). If the necessary reservation information 421 is not acquired (No in S1340), the control section 303 executes the acquisition step of the reservation information 421 again. After acquiring the necessary reservation information 421 (Yes in S1340), the control unit 303 disconnects from the reservation information system (S1350).

In one embodiment, the reservation information system is a system that manages information about predetermined services and operations provided using the vehicle 10, and the control unit 303 of the imaging equipment 101 (101F, 101R) In cooperation with the photographing device cooperation module 511 on the terminal side, according to the cooperation flow 1300 described above, it connects with the reservation information system and acquires the reservation information 421 .

Information related to prescribed services and operations includes, for example, information related to driving schools, kindergartens/nursery schools, day care, taxis, rental cars, car sharing, dispatch, sightseeing, limousine cruises, etc., transportation, transport, and work site information. It is information related to movement, business, attendance and leaving, and the like.
Specifically, information related to prescribed services and operations will be associated with individual persons, including drivers, fellow passengers, driving routes, destinations, places of stay, length of stay, shift and break times of drivers, and information of fellow passengers. It is preferable to have a ride history and the like.

In another embodiment, the reservation information system may be configured separately from the facility terminal 105 . Further, the photographing equipment 101 (101F, 101R) may acquire the reservation information 421 directly from the reservation management server 104. FIG.

In the above explanation, cooperation between the photographing equipment 101 (101F, 101R) and the reservation system has been explained. The cooperation between reservation systems can be executed in the same way.

In another control flow 1100 of the photographing equipment 101 (101F, 101R) of FIG. A second identification of at least one of the situation, vehicle behavior, vehicle reservation content, service content, etc. is performed (S1120). Based on these specific contents, the situations and states listed below are specified, and control corresponding to these is executed (S1130).
Whether the vehicle 10 has left the predetermined service provision area or business area,
whether the vehicle 10 has stayed at a predetermined point;
Whether the vehicle 10 was used outside of the predetermined usage time,
Did you forget something in the car?
Whether the vehicle 10 is scheduled to be used next time (a system that copies the data of a vehicle that has passed the deadline of the reservation time and has no next lesson in the timetable).
whether the vehicle 10 has driven in an extreme manner,
Whether the opening/closing part of the vehicle 10 has been operated,
whether the vehicle 10 condition is being checked;
what kind of weather the vehicle 10 is under;
Whether there is an abnormality in the vehicle 10,
whether the drive unit (for example, engine, motor, etc.) of the vehicle 10 is off;
Is there a change in the weight of the load on the vehicle 10?

The predetermined service provision area or business area is, for example, a travel range, a travel route, or the like scheduled during service provision or business.
The predetermined point is, for example, a destination related to the service or work, a facility or place unrelated to the service or work, or a facility or place to avoid staying in relation to the service or work.
The predetermined use time is, for example, service provision time, work time, vehicle use time permitted for service or work, and the like.

Note that the control unit 303 may be configured to execute each control described below in combination with another specification, or to execute each control in combination.
Further, in the following description, for the purpose of simplification of expression, even if the configuration is simply described as “image capturing equipment 101 (101F, 101R)” if technically possible, “image capturing equipment 101 (101F , 101R) and the vehicle interior photographing cameras 102 (102F, 102R).

In the following control example, as described above, the control unit 303 performs the first identification step (S1110) and the second identification step (S1120) in the different control flow 1100 of FIG. , and a configuration in which the first identification step (S1110) and the second identification step (S1120) are performed multiple times. The step of performing the first identification (S1110) and the step of performing the second identification (S1120) of the control flow 1100 of .

Note that the control unit 303 executes the control in each control example described below in combination with another specific content, executes the individual control examples in combination, or executes or stops only an arbitrary control example. It is better to have a function to
For example, with respect to the control examples described below, the control unit 303 performs at least one control step (S1130) of another control example in addition to the identification steps (S1110, S1120, S1220) described for one control example. may be combined.

In the following description, each control example is executed by the control unit 303 of the imaging device 101 (101F, 101R) while the vehicle 10 is in use. Other examples of control that can be executed, such as control for processing video data, can be similarly executed by each module of the facility terminal 105, the user terminal 106, the external management server 107, and the processing device 108, or , each module can be executed cooperatively.
For example, control related to image and sound processing of video data can be executed by the control unit 303 of the imaging equipment 101 (101F, 101R) while the vehicle 10 is in use, or the data processing module of the facility terminal 105 can be executed. 517, the data processing module 617 of the user terminal 106, the data processing module 717 of the external management server 107, and the data processing module 2217 of the processing device 108 independently or in cooperation with each other after receiving corresponding video data. can also

A specific control example will be described below.
Nineteenth Control Example Input example: information that can identify the occupant, information about the set travel area of the vehicle 10 , information about the travel position of the vehicle 10 .
Output example: Control based on information about the vehicle 10 leaving a predetermined area.

Control unit 303 may identify that vehicle 10 is traveling or has traveled outside a predetermined travel area (S1120, S1220).
The predetermined travel area may be, for example, a travel range or a travel route scheduled during service provision or business, for example, for each passenger, for each vehicle 10, for each service provided using the vehicle 10, Alternatively, a travel area or the like that is set for each task performed using the vehicle 10 is preferable.

19-1 Control Example When the above identification is performed (S1120, S1220), the control unit 303 sends a message to the occupants that the vehicle 10 is traveling outside the predetermined area. 101F, 101R) (S1130), or output from an external speaker or monitor connected to the imaging device 101 (101F, 101R) (S1130).

As a result, the user can flexibly set the driving area for each crew member, for example, for each driving school instructor 1910, for each driving school student 1920, and for each area in charge of an employee who conducts sales or pick-up service. Even when used by a plurality of users, it becomes easier for each user to travel in an appropriate travel area.
For example, the control unit 303 has a function of registering a training course at a driving school as a predetermined area. should be done. The control unit 303 may output this at the timing of the deviation, but it also outputs the fact that the imaging device 101 (101F, 101R) is activated next time, or outputs the deviated date and time range. may
It should be noted that the configuration in which a message to be notified to the passenger is output may be configured to output by another method such as displaying a red mark.

19-2 Control Example When the above identification is performed (S1120, S1220), the control unit 303 records information indicating that the vehicle 10 has traveled outside the predetermined area in association with the video data ( S1130).
As a result, the user can easily manage video data for each crew member, for example, for each driving school instructor 1910, for each driving school student 1920, and for each employee who conducts sales, transportation, etc., when driving outside the area. Become.
For example, the control unit 303 has a function of registering a training course of a driving school as a predetermined area. It is best to record them separately.

19-3 Control Example When the above identification is performed (S1120, S1220), the control unit 303 captures video data recording that the vehicle 10 has traveled outside the predetermined area. ), such as the SD card 306, and another storage medium accommodated in the accommodation space 110 of the vehicle 10 (S1130).
As a result, the user can more reliably capture video data for each crew member, for example, for each driving school instructor 1910, for each driving school student 1920, and for each employee in charge of sales, transportation, etc., when driving outside the area. easier to secure.

19-4 Control Example When the above identification is performed (S1120, S1220), the control unit 303 transmits video data recorded as an event that the vehicle 10 has traveled outside a predetermined area by wireless communication, particularly It is transmitted to predetermined external terminals such as the facility terminal 105, the user terminal 106, the external management server 107, the processing device 108, etc. via the wireless LAN (S1130).
Especially after the use of the vehicle 10 is finished, the control unit 303 can be used for wireless LAN communication provided by a company or organization that owns the vehicle 10 or by a company or organization with which the vehicle 10 is affiliated. It is preferable that the video data is transmitted after being returned to a point within the possible area. The wireless LAN communicable area may be a communicable area formed within the facility of the driving school.

When the vehicle 10 is located outside the communicable area, the control unit 303 connects to the network 103 via the communication connection function of the user terminal 106 in the vehicle, and transmits part of the video data and the vehicle data. 10 has a function of transmitting information that an event has occurred in which the vehicle 10 has traveled outside the communication coverage area to the company or organization that owns the vehicle 10, or to companies or organizations affiliated with the vehicle 10. Better.
As a result, the user can more quickly inform the outside of the vehicle 10 of the occurrence of the above event with the minimum required amount of data communication.

It is preferable that the control unit 303 is configured to set whether or not to transmit the video data to be transmitted to the external terminal for each crew member. Furthermore, the control unit 303 determines whether or not to transmit the video data to be transmitted to the external terminal for each event included in the video data in addition to or instead of the fact that the vehicle 10 has traveled outside the predetermined area. , is better.

It is preferable that the control unit 303 is configured to transmit the video data to the external terminal according to the priority assigned to the video data.
As a result, the user can more reliably secure video data for each crew member, for example, for each driving school instructor 1910, for each driving school student 1920, and for each employee who conducts sales or transportation, etc., when driving outside the area. easier to do.

In the above control examples 19-1 to 19-4, the vehicle 10 has traveled outside the predetermined area. It is preferable to be able to perform similar operations for staying at a point, entering another predetermined area of the vehicle 10, and the like.

Although the predetermined area and the other predetermined area have been described above, they may correspond to the first range 1820, the second range 1825, etc. described using FIG.
The above predetermined points correspond to the first point 1870, the second point 1880, the third point 1890, etc., which will be described with reference to FIG.

For example, based on the reservation information 421 directly obtained from the reservation management server 104 and the reservation information 521 obtained from the facility terminal 105, the control unit 303 determines that there is no reservation for the next lesson in the timetable for the vehicle 10 and It is preferable that the data is transferred to the external terminal after specifying that the deadline for accepting the reservation for the lesson has passed.

Twentieth Control Example Input example: information that can identify the reservation status of the vehicle 10, and an image that can confirm that the confirmation work outside the vehicle 10 is being executed.
Output example: Start of photographing work for checking the exterior of the vehicle 10 .

When the control unit 303 determines that the current time is the reserved use time of the vehicle 10 (S1120) and that a person around the vehicle 10 is checking the exterior of the vehicle 10 (S1110). , start capturing image data outside the vehicle 10 (S1130).
In particular, the control unit 303 starts capturing image data of the exterior of the vehicle 10 with higher quality.

As a result, the user can secure video data more reliably, particularly with higher image quality, even before the passenger gets into the vehicle 10 .
When the user operates the vehicle 10 at, for example, a driving school or a taxi office, it is necessary to confirm whether or not appropriate training is being conducted and to properly check the vehicle before departing from the taxi office. This is good because it will make it easier to check whether it was broken or not.

Twenty-first control example Input example: information and images that can identify the driving environment of the vehicle 10, and information and images that can identify the occupant.
Output example: Start shooting video data and improve quality.

21-1 Control Example When the control unit 303 identifies that the vehicle 10 is under a specific driving environment (S1120, S1220), it starts shooting video data of the vehicle 10 and improves the quality ( S1130).
The specific driving environment of the vehicle 10 includes, for example, a night time environment, a rainy environment, a rough road environment, a narrow alley environment, a dangerous downtown area environment, and the like.

21-2 Control Example When the vehicle 10 has specified a specific driving environment and the difficulty level assigned to the specified driving environment (S1120, S1220), the control unit 303 determines whether the , and when the driving skill assigned to the person is specified (S1110), the image data of the vehicle 10 is started to be photographed and the quality is improved according to the relationship between the difficulty level and the driving skill (S1130).

With such a configuration, the control unit 303 can finely change the conditions for high-quality video recording according to the driving skill of the driver. For example, the control unit 303 reduces the quality of the video data and saves the capacity of the storage medium if the driver is driving in a problem-free environment. If the driver is not good at driving in an environment, the control unit 303 improves the quality of the video data. Video data can be created.

In another example, for example, when the vehicle 10 is used for lessons at a driving school or for taxi business, the trainee 1920 and the passengers are women, and the control unit 303 controls that harassment is more likely at night than during the day. It is possible to improve the quality of video data in a situation where problems such as actions are likely to occur, and to create high-quality video data that allows more detailed verification by the user when a problem occurs.

In yet another example, for example, when the user uses the vehicle 10 for taxi business, the control unit 303 specifies that the passenger is drunk and the passenger's boarding point is in a dangerous downtown area. It is possible to improve the quality of video data and create high-quality video data that allows a more detailed verification by the user if a problem occurs.

The control unit 303 is preferably capable of acquiring information such as the driving skill of the driver and the degree of danger in the downtown area from the facility terminal 105, the external management server 107, etc., and updating the information.
The data processing module 517 of the facility terminal 105 and the data processing module 717 of the external management server 107 perform the above-described analysis based on analysis and analysis of image data related to the plurality of vehicles 10 and the plurality of passengers, particularly the plurality of drivers. It is preferable that the driving skill, the degree of danger in the downtown area, etc. are calculated and transmitted to the control unit 303 of the photographing device 101 (101F, 101R).

Twenty-Second Control Example Input example: video or information that can identify that a crew member is a passenger, and video that can identify an item left behind in the vehicle 10 .
Output example: Output of information notifying that there is something left behind.

When the control unit 303 identifies that the occupant is a passenger, for example, a passenger of a taxi or the like from the reservation information or the video data (S1110), the control unit 303 determines the in-vehicle image from the in-vehicle video when the passenger gets on and off the car. (S1120), the control unit 303 outputs information notifying that there is an item left behind in the vehicle (S1130).

For example, the control unit 303 outputs a message, image, or message notifying that there is an item left behind from the speaker or monitor of the imaging device 101 (101F, 101R) or from the speaker or monitor connected to the imaging device 101 (101F, 101R). Output the video.

The control unit 303 further has a function of alternately displaying an image of the inside of the vehicle before the passenger gets on and an image of the inside of the vehicle after the passenger gets off, and a function of displaying the image of the inside of the vehicle before the passenger gets on and the image of the inside of the vehicle after the passenger gets off. It is better to have a function of capturing a high-quality image of the inside of the car later, a function of trimming and displaying the range where the left-behind is shown, and the like.

As a result, the user can more easily recognize where and what has been forgotten by comparing the images displayed on the displays of the imaging devices 101 (101F, 101R).
With such a configuration, for example, when a passenger in a taxi leaves an item, the driver can more quickly determine the presence or absence of the item and the details on the monitor. It becomes easier to stop calling.
Note that, in another control example, the control unit 303 may output information notifying that there is an item left behind in the vehicle before or while the passenger gets off the vehicle 10 .

Twenty-third control example Input example: video and information that can identify an abnormality in the vehicle 10, and video that can identify the driver.
Example output: Control based on driver changes before and after identifying anomalies.

When the control unit 303 identifies that an abnormality has occurred in the vehicle 10 from the detection signal of the in-vehicle sensor or image data (S1120), and identifies that the driver changed before and after the identification of the abnormality (S1110). ), the operation mode is changed according to the driver who took over (S1130).
The "abnormality of the vehicle 10" includes, for example, an abnormal noise generated from the vehicle 10, particularly an abnormal noise generated by attaching a foreign object such as a plastic bottle near the tire of the vehicle 10, or the like.

With such a configuration, the control unit 303 changes the operation mode of the imaging device 101 (101F, 101R) when the driver changes from a registered driver to an unregistered driver before and after the abnormality is identified. can be changed to the crime prevention mode, or the driving mode of the vehicle 10 can be shifted to the crime prevention mode.

The crime prevention mode of the imaging device 101 (101F, 101R) is an operation mode for communicating the position information of the vehicle 10 to the outside and executing the silent mode described in the control example 5-4.
The crime prevention mode of the vehicle 10 is a drive mode in which the driving function of the vehicle 10 is stopped, restricted, or unlocked.

As a result, the vehicle 10 is in a state of generating an abnormal noise due to, for example, a foreign object being attached to the vehicle 10, and the driver keeps the power of the vehicle 10 turned on in order to confirm the cause of the abnormal noise. Even if a criminal who intends to steal the vehicle 10 tries to drive the vehicle 10 after leaving the vehicle with the engine or motor running, the driving of the vehicle 10 may be stopped or restricted, or the criminal may enter the vehicle. Being able to remain confined allows the user to operate the vehicle 10 more safely.

Twenty-Fourth Control Example Input example: Information that can identify the state of the drive unit of the vehicle 10, passenger reservation information, and an image that allows confirmation of the presence or absence of passengers in the vehicle.
Output example: Activation of outside shooting mode.

The control unit 303 determines that the current time is the time when the passenger has reserved the use of the vehicle 10 (S1110), and the drive unit of the vehicle 10, such as the engine or the motor, is turned off. (S1120), and when it is determined that there is no passenger in the vehicle (S1110), the outside shooting mode is activated (S1130).

In the vehicle exterior photography mode, the control unit 303 performs photography by increasing the quality of image data mainly for photographing the exterior of the vehicle compared to the quality of image data mainly for photographing the interior of the vehicle.
Further, in the outside photographing mode, the control unit 303 starts photographing or recording before the start time of the use time of the vehicle 10 specified from the reservation information 421, and after the end time of the use of the vehicle 10. It is preferable to have a function to end the
With such a configuration, the user can easily determine whether the reserved vehicle 10 has been used appropriately, for example, whether the reservation for use has been made for an unnecessarily long period of time.

Twenty-fifth control example Input example: information that can identify the schedule of loading/unloading of the vehicle 10 , video that can identify the content of loading/unloading of the vehicle 10 , video that can identify people near the vehicle 10 .
Output example: Output of information related to loading and unloading.

The control unit 303 specifies a schedule for loading and unloading packages and products using the vehicle 10 (S1120), specifies the current status of loading and unloading from the video data (S1120), and When a person is identified (S1110), information on loading/unloading is output (S1130).

The control unit 303 specifies, for example, the carry-in amount at the carry-in point and the carry-out amount at the carry-out point from the carry-in/carry-out schedule information included in the reservation information 421 of the reservation management server 104 and the reservation information 521 of the facility terminal 105. do. Further, for example, at the unloading point, the control unit 303 reads the label attached to each loading platform from the video data, and specifies whether the scheduled cargo has been unloaded, or whether the scheduled amount of cargo has been unloaded.
This makes it easier for the user to reduce the occurrence of erroneous delivery by the delivery person.

For example, while the vehicle 10 is stopped at the unloading point, the control unit 303 sends information such as "there are 5 remaining unloading vehicles" and "the item to be unloaded is different" to the unloading person identified from the video data. Output. When the control unit 303 identifies from the video data that a person other than the unloading person has approached the stopped vehicle, it outputs information such as "currently unloading work" and "currently filming the unloading work".
This makes it easier for the user to reduce unauthorized shooting of people other than the unloading person. Furthermore, it becomes easier to deter mischief, theft, etc. during loading and unloading.

The control unit 303 may execute the above-described control as the loading/unloading operation mode, and the user can activate the loading/unloading operation mode as necessary, or can additionally use it by updating or purchasing. should be

Programs for executing individual functions such as control, specification, processing, etc. described with reference to FIGS. Alternatively, it is preferable that the configuration is such that it can be deactivated. With such a configuration, the user can actually experience the functions necessary for him/herself, and then customize them by reflecting the usage method and usage environment of the vehicle 10, the user's own preferences, and the like.

The user may retrofit the operation modes of the photographing equipment 101 (101F, 101R) described in connection with the above control example in terms of software by updating or adding an operating system (OS), firmware, or applications.
In particular, the photographic equipment 101 (101F, 101R) is a general-purpose photographic equipment 101 (101F, 101R) manufactured and sold for general users or general vehicles, and various operation modes can be retrofitted in software. It is better if the manufacturing company, the sales company, etc., or the end user updates the firmware of the general-purpose imaging device 101 (101F, 101R).

In this way, while the hardware configuration of the general-purpose photographing device 101 (101F, 101R) remains the same, it is suitable for various drive modes, particularly when mounted on the vehicle 10 that is used alternately by a plurality of people. drive modes, etc., can be added to the photographing equipment 101 (101F, 101R) as needed.
As a result, the manufacturing company can reduce the manufacturing cost and man-hours of the imaging equipment 101 (101F, 101R) when manufacturing the imaging equipment 101 (101F, 101R) for various purposes, so that the cost to the end user can be reduced. We can provide high performance products.

In addition to or alternatively to the above-described configuration in which various operation modes can be retrofitted by software, the photographing equipment 101 (101F, 101R) is preloaded with or preinstalled with various operation modes. may be In particular, it is more preferable that the user can purchase the right to use each operation mode at the timing desired by the user and make it available.

Note that the photographing equipment 101 (101F, 101R) may be manufactured exclusively for services such as driving school and car sharing. A configuration that can receive a switching input by the user to a general-purpose mode, for example, a mode for general users, is better because the user can use it properly.
The general-purpose mode may be configured to stop executing some or all of the functions specific to the driving school mode, or may execute functions different from the driving school mode.

For example, the photographing devices 101 (101F, 101R) are configured to be switchable between the driving school mode and the general-purpose mode. For example, when in general-purpose mode, it is better not to do this.

The control unit 303 of the imaging device 101 (101F, 101R) controls various operation modes and functions of the imaging device 101 (101F, 101R) based on user input from the input/output unit 315 of the imaging device 101 (101F, 101R). It is recommended to set on/off etc.
The control unit 303 of the imaging device 101 (101F, 101R) displays a checklist of various operation modes and functions on the display, which is the input/output unit 315, and the user's input thereto, for example, whether or not a check box is checked. It is good to receive information about and accept the on/off setting.

In the above-described configuration, the user can change the operation mode of the photographing equipment 101 (101F, 101R) experienced in the vehicle 10 used alternately by a plurality of persons to the photographing equipment mounted in the vehicle 10 owned by the user himself/herself. 101 (101F, 101R) and the photographing equipment 101 (101F, 101R) mounted on the vehicle 10 owned by the user's family, such as parents.
The control unit 303 of the photographing devices 101 (101F, 101R) controls the photographing devices 101 (101F, 101R) installed in the vehicle 10 owned by the family, for example, after the trainee 1920 of the driving school graduates from the driving school and obtains a driver's license. , 101R), it is preferable that the operation mode that is familiar during the training at the driving school can be added by performing an update or purchase procedure.

Furthermore, the control unit 303 of the photographing equipment 101 (101F, 101R) uses the passcode and password provided by the driving school to set personalized settings for the student 1920 during the training, using the facility operated by the driving school. Personalized settings of the terminal 105 and the imaging equipment 101 (101F, 101R) can be obtained from the external management server 107 operated by the manufacturer or sales company of the imaging equipment 101 (101F, 101R), and can be inherited. Even better.

As a result, a user who is a driving beginner who was a trainee 1920 until recently can use the photographing device 101 (101F, 101R) and the vehicle 10 in a state similar to the training environment at the driving school. For example, it becomes possible to use more personalized safety support functions, etc., so that a novice user can be provided with a more familiar and therefore safer driving environment.

In still another embodiment, the control unit 303 of the imaging equipment 101 (101F, 101R) is stored in advance in the imaging equipment 101 (101F, 101R) as individual operation modes and functions of the imaging equipment 101 (101F, 101R). It is preferable to have a configuration in which it is possible to perform a combination of making available the existing ones individually and making them available later by updating or the like.
In such a configuration, the user can use the operation modes and functions that are pre-stored in the general-purpose imaging device 101 (101F, 101R) and determined to be necessary for the user through a purchase procedure or the like. Therefore, the introduction cost of the photographing equipment 101 (101F, 101R) can be suppressed. Furthermore, individual operation modes and functions of the imaging equipment 101 (101F, 101R) experienced in driving schools, taxis, transportation, car sharing, etc. can be individually updated or purchased and made available later. .

Apart from the above embodiments, the imaging equipment 101 (101F, 101R) may be dedicated to various services and businesses. The control unit 303 of the imaging equipment 101 (101F, 101R) dedicated to them preferably has a function to stop a function that is executed only during service or business according to the operation mode.

For example, if the user is a taxi driver, the control unit 303 selects the operation mode of the dedicated photographing device 101 (101F, 101R) depending on whether it is for business use or private use. It is good to be able to use it properly in the general-purpose mode.
In the private use mode or the general-purpose mode, the control unit 303 may stop executing some or all of the functions specific to the taxi service mode, or may execute a function different from the functions specific to the taxi service mode. good.

In the above embodiment, an example in which the user uses the vehicle 10 for taxi business has been described. It may be a limousine cruise, home delivery/delivery/mail/transportation, sales, or the like. In particular, it is better if the vehicle 10 is a vehicle 10 that is used alternately or alternately by a plurality of persons.

FIG. 14 shows an example of facility terminal 105 connected to processing device 108 .
In the embodiment of FIG. 14, the processing device 108 is connected to the facility terminal 105 described with reference to FIG.
A plurality of storage media, such as SD cards 306, of the imaging devices 101 (101F, 101R) can be inserted into the processing device 108. FIG. The plurality of storage media are, for example, storage media used at the same time in each of the photographing devices 101 (101F, 101R) installed in different vehicles 10 .

In the embodiment of FIG. 14, processing unit 108 has ten slots 1401-1410, slots 1401-1410. Therefore, the user uses the processing device 108 to transfer video data from the storage media of up to ten photographing devices 101 (101F, 101R) mounted on the vehicle 10 to the auxiliary storage device 702 of the processing device 108. or at least one of the work of transferring video data to an auxiliary storage device of a device other than the processing device 108, for example, the work of transferring video data to the auxiliary storage device 502 of the facility terminal 105. be able to.

At least some of the functions of the processing device 108 that are executed by modules stored in the main storage device 2201 of the processing device 108 are performed by the facility terminal 105 connected to the processing device 108. It can also be performed by each module.
In such a configuration, the system to which processing unit 108 is connected, as a whole, is capable of performing the functions described below.

The data reading module 2210 of the processing device 108 reads the data when the storage medium of the photographing device 101 (101F, 101R), such as the SD card 306, is inserted from the slot 1401 to the slot 1410, or during the nighttime period after the insertion. For example, transfer of video data may be started sequentially one by one from ten SD cards 306 inserted in slots 1401 to 1410 .
As a result, the user does not have to execute the transfer operation for each storage medium, so that when transferring a large amount of video data that takes a long time to transfer, the user can save the trouble of starting the transfer each time. Especially good.

Further, the data reading module 2210 of the processing device 108 has a function of transferring only the video data during the driving school's training time based on the reservation information 2221, for example, and based on the video information 2224, for example, the driving school's training time during the vehicle. 10, a function to transfer only the video data of the time period when the instructor 1910 and the trainee 1920 (see FIG. 20) are on board, a function to extract and transfer only the above time period from the video data over a long period of time, It is even better to have a function to selectively execute those functions.

In such an embodiment, transfer or duplication of video data during times when no one is in the car, such as breaks between lessons or meals, which is not desired by the user, is not performed. Therefore, the capacity of the auxiliary storage device 2202 of the processing device 108 can be saved, and the time required for transferring and duplicating video data can be shortened.

When a target input from the user, which will be described later, is received, the data management module 716 of the processing device 108 executes transfer of video data according to information such as a person, a vehicle 10, a time zone, or the like. It is preferable to discriminate the video data to be used.

Regarding the above transfer, the data management module 2216 of the processing device 108, the data management module 516 of the facility terminal 105, etc. determine the order of transfer, the video data to be transferred, and the storage medium to be transferred by the user. It may be configured to be executed according to possible criteria or preset criteria.

As a result, for example, even when the same person rides in a plurality of vehicles 10, the user can view the image data of the person without checking the individual image data for each individual storage medium. can be obtained collectively.

The data management module 2216 of the processing device 108, the data management module 516 of the facility terminal 105, and the like are configured to collectively manage video data for each passenger, for example, for each trainee 1920, for example, for storage and integration. good.
As a result, the user can reorganize the information of the video data when collectively confirming or processing the video regarding a specific crew member, for example, when providing collectively the video data of the entire training course of one trainee 1920. This saves a lot of time because you don't have to.

When the data reading module 2210 of the processing device 108 detects that a storage medium has been inserted from the slot 1401 to the slot 1410 , it outputs information regarding the inserted storage medium to the data management module 516 of the facility terminal 105 .

Based on the acquired information about the storage medium, the data management module 516 of the facility terminal 105 cooperates with the display control module 515 to display, for example, viewer operation screens 1500 and 1600 described with reference to FIGS. is used to display a list of storage media, accept the time zone in which the video data to be transferred was shot, and accept the order in which the transfer of the video data is to be started from which storage medium.

When the data management module 2216 of the processing device 108 receives the information about the end of the transfer of the video data in the storage medium from the processing device cooperation module 518 of the facility terminal 105, the data management module 2216 performs the It is preferable that at least two storage media for which transfer has been completed are safely removed from the slots 1401 to 1410 at the same time.

In another embodiment, some or all of the functionality of processing unit 108 described above may be incorporated into facility terminal 105 . By doing so, it is possible to provide a configuration in which the storage capacity of video data and the like can be individually determined in accordance with the user's usage state. Customize the information management system as needed.
In particular, it is better if the user can select and increase the data capacity of the transfer destination of the video data from the storage medium of the imaging device 101 (101F, 101R).

In still another embodiment, part or all of the functions of the above-described processing device 108 are incorporated in the facility terminal 105, and images from the storage media of the photographing devices 101 (101F, 101R) in the vehicle 10 to the facility terminal 105 Data transfer may be performed via a network 103 such as a wireless LAN while the storage medium is inserted into the imaging equipment 101 (101F, 101R) in the vehicle 10. FIG.

In such a configuration, each module of the processing device 108 described above is stored in the main storage device 501 of the facility terminal 105 as required.
In the following description, each module of the processing device 108 stored in the main storage device 501 of the facility terminal 105 will also be described using the same reference numerals as in the above description.

The data reading module 2210 of the facility terminal 105 is configured to read video data and the like transferred by the control unit 303 of the imaging device 101 (101F, 101R) via the network 103 such as a wireless LAN during a predetermined time period. good.
Predetermined time period means, for example, night time period, time period outside service provision hours, time period outside business hours of service provision facilities, and from the point in time when the provision of the service operation ends to the point in time when the provision starts again. The time zone between and the like.

Furthermore, the data reading module 2210 of the facility terminal 105 loads the vehicle 10 next to the timetable based on the reservation information 421 acquired from the reservation management server 104 and the reservation information 521 stored in the auxiliary storage device 502 of the facility terminal 105 . After specifying that there is no reservation for the next training and that the deadline for accepting reservations for the next training has passed, transfer of video data etc. to the control unit 303 of the imaging device 101 (101F, 101R) is started. It is better to have a function to output an instruction to

The data reading module 2210 of the processing device 108 reads video data and the like from the storage media of the imaging devices 101 (101F, 101R) mounted on the vehicle 10, and the cooperation module 2211 and the data management module 2216 of the processing device 108 read the data from the storage media. 108 or the auxiliary storage device 502 of the facility terminal 105. FIG.

In addition, the data management module 516 and data processing module 517 of the facility terminal 105 and the data management module 2216 and data processing module 2217 of the processing device 108 are configured as follows.
A function that analyzes video data and determines the occurrence of a predetermined event,
A function that analyzes video data and records the values of predetermined parameters and their changes over time,
A function of managing video data based on information about events determined as a result of analysis of video data, recorded parameter values, and their temporal changes; A function that manages video data based on the values of parameters and information about their changes over time,
It is better to have at least one function among

Predetermined events include various types of harassment such as power harassment, moral harassment, sexual harassment, maternity harassment, gender harassment, and problem driving such as sudden braking, sudden steering, and meandering.

Predetermined parameters include, for example, the distance between passengers, the vehicle interior volume 1760a, the vehicle exterior volume 1760b, the vehicle travel route 1830 to 1860, the travel range 1820, the vehicle stop points 1870 to 1890, and the distance to other vehicles ahead. These include the timing and strength of braking, the timing and strength of handling with other vehicles around the vehicle, and the extreme behavior of each passenger.

The data management module 516 and data processing module 517 of the facility terminal 105 and the data management module 2216 and data processing module 2217 of the processing device 108 perform the above-described analysis processing in parallel during a predetermined period of time or when video data is transferred. and run it.

Predetermined time period means, as described above, for example, night time period, time period outside service provision time period, time period outside business hours of service provision facility, service operation is provided again from the time of completion. It is the time period until the start time, and the like.

The data management module 516 and data processing module 517 of the facility terminal 105 and the data management module 2216 and data processing module 2217 of the processing device 108 have the function of executing analysis processing to be executed based on user's selection input. and the computational load can be adjusted as needed. Further, it is preferable that the user can set such that a specific analysis process is performed on video data associated with a specific subject, such as a specific instructor 1910 .

14, the facility terminal 105 and the processing device 108 are connected via the connection line 1420, but the processing device 108 connects the facility terminal 105 and the external management server 107 via the network 103. to, simultaneously or alternatively.

With such a configuration, the user can more easily back up video data to the external management server 107 .
Alternatively, the user saves all or most of the video data in the auxiliary storage device 702 of the external management server 107, selects video data to be saved in the auxiliary storage device 502 of the facility terminal 105 from the video data, and saves it. If the configuration allows, the storage capacity of the auxiliary storage device 502 of the facility terminal 105 can be saved.

FIG. 15 is an example of an operation screen 1500 of the facility terminal viewer.
FIG. 16 is an example of another operation screen 1600 of the facility terminal viewer.

The operation screen 1500 in FIG. 15 and another operation screen 1600 in FIG. 16 will be described below.
The operation screen 1500 and another operation screen 1600 are screens for executing, for example, transferring, managing, processing, duplicating, writing, etc. of video data, setting of the imaging devices 101 (101F, 101R), etc., respectively. The display control module 515 of the facility terminal 105 is, for example, a function or program for displaying a viewer for the operation terminal. display.

The display control module 515 of the facility terminal 105 cooperates with the data management module 516 to display various types of information on the operation screen 1500 and another operation screen 1600 in association with each other.

For example, if the user is a manager of a driving school, etc., the data management module 516 of the facility terminal 105 may store course IDs, training routes, information on training contents, etc. in association with each other in advance. In addition, according to the operation of the input/output unit 315 of the photographing equipment 101 (101F, 101R), information on the training route and training content is set, and the set information is transmitted via the network 103 or via the storage medium. It is preferable to have a function to read the data from the data, store it in the auxiliary storage device 502, and display it.

In the operation screen 1500 of FIG. 15, one-month calendar display is selected, and in another operation screen 1600 of FIG. 16, one-week timetable display is selected.
In addition, FIG. 16 shows, as an example, a timetable of services provided using a vehicle 10 such as a driving school, particularly frames. However, the timetable display is not limited to this, and may be a display divided by hours or minutes, or a display based on the shift time zone of the person providing the service or service.

The display control module 515 can switch the display between the operation screen 1500 and another operation screen 1600 by receiving a selection of either the timetable display or the calendar display from the user through the display switching unit 1520 .
An example assuming use in a driving school will be described below.

A target selection unit 1530 in the operation screen 1500 of FIG. 15 can receive an input of a selection of a storage target of video data to be stored from the user who is the administrator of the driving school.
In the operation screen 1500 of FIG. 15, SD01-SD10 are input to the target ID input section 1540. FIG. Note that SD01-SD10 are storage media inserted into slots 1401-1410 of the processor 108 in FIG. 14, for example. Then, as the storage method, all storage, which stores all video data contained in those storage media, such as the SD card 306, is selected.

Alternatively, "Instructor (DI)" and "Trainee (Tr)" may be selected and the ID of a particular instructor 1910 or the ID of a particular trainee 1920 may be entered to enable display control module 515 and data management. A module 516 picks up video data obtained by photographing a state in which a specific instructor 1910 or a specific trainee 1920 who is input as a target is riding along with the video data recorded in a plurality of storage media. It is desirable to have a function that can be saved as
It should be noted that the descriptions of "the display control module 515 and the data management module 516" in the above description are equivalent to "the display control module 515,""the data management module 516," and "the display control module 516," as long as there is no technical inconsistency. The module 515 cooperates with the data management module 516,""the data management module 516 cooperates with the display control module 515," and "a program or the like having the display control module 515 and/or the data management module 516" This point also applies to the following description.

In such a configuration, when selective storage is selected as the storage method, the display control module 515 of the facility terminal 105 cooperates with the data management module 516 to display a list of the picked-up video data and It is also possible to accept a selection input and preferentially execute storage of desired video data.

Furthermore, the display control module 515 and the data management module 516 have a function of linking the video data with the ID of the instructor 1910 and the ID of the trainee 1920 recorded in the video data, and the data of the reservation system of the instructor 1910. It is preferable to have a function to import the

In the operation screen 1500 of FIG. 15, a day 1501 displayed in white and days 1502 to 1505 highlighted in different colors are displayed in the monthly calendar display portion.
a day highlighted in a first color 1502, a day highlighted in a second color 1503, a day highlighted in a third color 1504, and a day highlighted in a fourth color 1505; , the display control module 515 and the data management module 516 of the facility terminal 105 can display, with very good visibility, that the video data contains predetermined video content assigned to each color. It is desirable to have a function that can
Predetermined video contents include, for example, the type and total number of captured events, whether events of high importance are recorded, and the like.

Thereby, the user can, for example, if more events are being filmed or more important events are being filmed, the highlighting colors will be less bright or saturated accordingly. A setting can be applied that provides a higher or higher display, thus providing greater visibility to the event in question.
For example, video data in which multiple events are recorded or video data in which an event of high importance is recorded can be displayed in a reddish color, especially a reddish color with a lower brightness, so that the user can visibility and warning against

The display control module 515 and the data management module 516 of the facility terminal 105 change the type of color according to the user's input, and instead of highlighting in a different color, display information such as the content of the event in text. A configuration in which the display is changed by doing so is more preferable because it is possible to provide an easy-to-see display state for each user.

These configurations are advantageous because they facilitate the identification of characteristic outlines of the video data for each day, regardless of whether the video data is transferred or not, without the user having to actually reproduce and check the video data.
In particular, the display control module 515 and the data management module 516 of the facility terminal 105 are configured to read the event information associated with each video data before transferring the video data. It is good because it can quickly provide information related to the event being filmed.

The event information associated with each piece of video data is information about an event specified during the shooting of the video data by the shooting device 101 (101F, 101R), and may be information attached to each piece of video data. It is preferable that the information can be read separately from the video data.

The display control module 515 and the data management module 516 of the facility terminal 105 may be configured to display thumbnails 1510 of the video data on each day, for example, when transfer or storage of the video data is completed. This makes it easier for the user to confirm that the video data for the date on which the thumbnail 1510 was displayed has been transferred.

In another embodiment, the display control module 515 and the data management module 516 of the facility terminal 105 may be configured to first acquire thumbnail information in relation to video data for each day.

The display control module 515 and the data management module 516 of the facility terminal 105 display the image of the thumbnail 1510 selected by the user on the preview portion of the operation screen 1500 in FIG.
Note that the display control module 515 and the data management module 516 of the facility terminal 105 may have a function of displaying the preview portion in a window separate from the operation screen 1500 . Doing so is better because the user can check the video on a larger screen.

In the example of FIG. 15, the display control module 515 and data management module 516 of the facility terminal 105 display event information, more specifically, a list of events that have occurred and their occurrence times, next to the preview portion.
When the display control module 515 and the data management module 516 of the facility terminal 105 receive a selection input from the user for at least one of the events displayed in these list items, the occurrence time of the selected event is displayed in the preview portion. to play the video.

In the example of another operation screen 1600 of the facility terminal viewer in FIG. 16, in addition to the example of the operation screen 1500 of the facility terminal viewer in FIG. it's shown.
In the example of FIG. 16, the user selects video data in which an instructor 1910 with an instructor ID of DI0012 is on board, in which events such as "sudden braking", "forgotten item", "off-route travel", and "harassment" are recorded. You have selected video data.

It is preferable that the display control module 515 and the data management module 516 of the facility terminal 105 are configured to receive event addition and deletion by the user. As a result, the user can customize the display to make it easier for the user to select an event with a high degree of importance from among multiple events.

In the example of FIG. 16, the display control module 515 and the data management module 516 of the facility terminal 105 display the names of the respective events in the frames of the timetable in which the video data recording the selected event was shot. .
From there, the user can select an event in a desired frame on a desired date, and the display control module 515 and data management module 516 of the facility terminal 105 transfer video data in accordance with the selection input by the user. Execute.
The example of FIG. 16 shows a state in which transfer of video data has not started, and no video data is displayed in the preview portion.

In both the embodiments of FIGS. 15 and 16, the data management module 516 of the facility terminal 105 acquires data for preview display of each piece of video data before transferring each piece of video data. It is preferable that data such as an image at the start of shooting by the device 101 (101F, 101R) or an image at the time of event occurrence, etc., is acquired, the data having a smaller capacity than individual video data.
Such a configuration may provide additional display customization possibilities to the user.

The display control module 515 and the data management module 516 of the facility terminal 105 display checklists of various operation modes and functions of the photographing equipment 101 (101F, 101R) on the operation screens 1500 and 1600 of FIGS. User input for them, for example, information on whether or not a check box is checked is received, and the photographing device cooperation module 511 of the facility terminal 105 receives information about user input, for example, information on whether or not a check box is checked. It is preferable to transmit to at least one imaging device 101 (101F, 101R).

In particular, the display control module 515 and the data management module 516 of the facility terminal 105 share information about user input to the control units 303 of the different imaging devices 101 (101F, 101R) mounted on the plurality of vehicles 10. It is desirable to have a function that can be sent as
Thereby, the user can perform setting for a plurality of vehicles 10 with a single setting operation. In particular, in a driving school or a taxi company, settings independently optimized by the driving school or taxi company can be executed for a plurality of vehicles 10 with a single setting operation. , the time cost required for setting can be significantly reduced.

Furthermore, the display control module 515 and the data management module 516 of the facility terminal 105 are provided by the manufacturer or sales company of the photographing equipment 101 (101F, 101R), for example, in the best mode suitable for each service, each business type, each usage condition, etc. It is preferable to have a function of setting preset settings and various setting sets for the photographing equipment 101 (101F, 101R) as a setting for the vehicle 10. It is better to have a function that can be set by operation.
As a result, the user can more easily set the imaging equipment 101 (101F, 101R) by using not only the input/output unit 315 of the imaging equipment 101 (101F, 101R) but also the input unit 504 of the facility terminal 105 or the like with which the user is familiar. It can be carried out.

The display control module 515 and the data management module 516 of the facility terminal 105 have a function of transmitting settings related to the control example 5-5 above to the control unit 303 of the imaging equipment 101 (101F, 101R). Better to have.

The display control module 515 and the data management module 516 of the facility terminal 105, for example, control examples such as 5-5-1 "Today is the nth lesson, isn't it?" "Let's put on", "Today is a slope starting lesson", "Today is a road course", etc., or "This month's customer service target is ○○", "This month's sales target is ○○ to the control unit 303 of the imaging equipment 101 (101F, 101R). On the other hand, it is better to have a function to set by one setting operation.

In another embodiment, the display control module 515 and the data management module 516 of the facility terminal 105 control the settings of the control unit 303 of at least one imaging device 101 (101F, 101R), particularly a plurality of imaging devices 101 (101F, 101R). ) of the control unit 303 can be changed by updating the information in the storage medium of the imaging device 101 (101F, 101R) inserted into the processing device .

As a result, even if the imaging device 101 (101F, 101R) is not in a communication connection state, for example, the imaging device 101 (101F, 101R) itself does not have a communication connection function, or the imaging device 101 (101F, 101R) 101F, 101R) has a communication connection function, but even if the communication connection function cannot be used, the user can return the updated storage medium to the imaging device 101 (101F, 101R), Compared to the case of directly inputting settings for individual imaging devices 101 (101F, 101R) in the vehicle 10, the settings of the imaging devices 101 (101F, 101R) can be changed more efficiently.

The display control module 515 and the data management module 516 of the facility terminal 105 additionally or alternatively to the operation screen 1500 in FIG. 15 and another operation screen 1600 in FIG. Among the information, a function of presenting a first table with time periods as columns and vehicle IDs as rows, a function of presenting a second table with time periods as columns and instructor IDs as rows, and It is preferable to have a function to switch the display of the first table and the second table.

The display control module 515 and the data management module 516 of the facility terminal 105 preferably have a function of displaying at least two pieces of information of each field of the CSV file in each cell of the table. It is preferable to have a function to display all information.

The display control module 515 and the data management module 516 of the facility terminal 105 display a plurality of images read from a plurality of storage media in addition to or instead of the operation screen 1500 in FIG. 15 and another operation screen 1600 in FIG. The data may be grouped by individual and stored or transferred to another storage medium or an external storage device.
As a result, even if the service is provided multiple times using different vehicles, the user can provide the service user with the entire service provision period or a plurality of video data requested by the service user. can be recorded on a DVD or the like and provided.

For example, if the user is an operator or a manager of a driving school, by collecting a plurality of video data for each trainee, for example, when a trainee 1920 causes an accident after graduation, what kind of training student 1920 should be treated? It is also possible to easily trace whether such training was given. Similarly, when a problem is found in the training content of a certain instructor 1910, for example, it is possible to easily trace a plurality of past training content of that instructor 1910. FIG.
For example, if the user is an operator or a manager of a taxi company, by collecting a plurality of video data for each driver, for example, when a problem is recognized in the content of customer service by a certain driver, it is possible to It is also possible to easily trace the details of customer service.

FIG. 17 is an example of a preview screen 1700 of the facility terminal viewer.
The display control module 515 of the facility terminal 105 cooperates with the data management module 516 to display the preview screen 1700 in, for example, the preview portion 1550 in FIGS. can be displayed in a window different from the separate operation screen 1600 .

The display control module 515 of the facility terminal 105 displays the image of the image data read by the data management module 516 on the image display section 1710 of the preview screen 1700 .
The video reproduced on the video display unit 1710 may be the same as or similar to the video reproduced on the monitor or the like, which is the input/output unit 315 of the imaging device 101 (101F, 101R).

The display control module 515 and the data management module 516 of the facility terminal 105 display the map information of the video data, particularly the travel route information, on the map display portion 1720 of the preview screen 1700 .
The display control module 515 and the data management module 516 of the facility terminal 105 receive an input from the user to the map display section 1720 and display, for example, an image of image data of a selected travel route on the image display section 1710. good.

In particular, the display control module 515 and the data management module 516 of the facility terminal 105 relate to image data captured by the image capturing devices 101 (101F, 101R) mounted on different vehicles 10 and image data recorded on different storage media. It is preferable that at least two pieces of map information are collectively displayed.
These configurations will be described in more detail using FIG.

The display control module 515 and the data management module 516 of the facility terminal 105 transfer the image data to the map display section 1720 of the preview screen 1700 in FIG. map information, particularly travel route information, on which the image data stored in is displayed.

The display control module 515 and the data management module 516 of the facility terminal 105 display a list of video data on the list display section 1730 of the preview screen 1700 in FIG.
The display control module 515 and the data management module 516 of the facility terminal 105 can, for example, determine the file name of the video data shot on the date selected by the user or the video data in which the person or event selected by the user is shot. Display file names as a list.
The user can select a file name displayed in the list, and the display control module 515 and the data management module 516 of the facility terminal 105 display the video data having the file name selected by the user on the video display unit 1710. It is preferable that it is a configuration that reproduces the

The display control module 515 and the data management module 516 of the facility terminal 105 associate the information related to the event recorded in the video data with the shooting time in the event display portions 1740a and 1740b of the preview screen 1700 in FIG. displayed.
The display control module 515 and the data management module 516 of the facility terminal 105 display the information on the distance between the passengers in the form of a graph in the event display section 1740a, and the volume of the sound in the vehicle 10 in the event display section 1740b. and information on the volume of the sound outside the vehicle 10 is displayed in a graph.

The user can select any point in the graph, and the display control module 515 and the data management module 516 of the facility terminal 105 display an image corresponding to the point in the graph selected by the user on the image display unit 1710. It is preferable that the configuration is for reproduction.

The display control module 515 and the data management module 516 of the facility terminal 105, in the event display section 1740a of FIG. A first distance 1750a and a second distance 1750b are shown schematically.
In the following description, the dotted line representing the intermediate position M corresponds to, for example, the intermediate position between the driver's seat and the front passenger seat. However, the position corresponding to the dotted line representing the intermediate position M can be set by the user. good too. Furthermore, the control unit 303 of the photographing device 101 (101F, 101R) may be set to a different position for each passenger in the vehicle 10. FIG.

A first distance 1750a indicates a distance D between an occupant sitting in the driver's seat and an intermediate position M between the driver's seat and the passenger's seat. More specifically, for example, in the case of a right-hand drive vehicle 10, the distance D between the position of the left shoulder or left elbow of the occupant holding the steering wheel and the intermediate position M between the driver's seat and the passenger's seat is showing.
From the graph of the first distance 1750a shown in FIG. 17(a), it can be seen that the first distance 1750a changes within a certain range based on the shaking of the body caused by the driving motion and the vibration of the vehicle 10. It can be seen that it is not approaching M.

A second distance 1750b indicates a distance D between an occupant in the passenger seat and an intermediate position M between the driver's seat and the passenger's seat. More specifically, in the case of a right-hand drive vehicle 10, for example, the distance D between the position of the right shoulder, right elbow, or right hand of the occupant sitting in the front passenger seat and the intermediate position M between the driver's seat and the front passenger seat. is shown.
The graph of the second distance 1750b shows that the occupant in the passenger seat passes the intermediate position M and approaches the driver's side at two points in time, a first point in time T1 and a second point in time T2. .

In the example of FIG. 17, the display control module 515 and the data management module 516 of the facility terminal 105 display graphs of the distances from the intermediate position M of each passenger in the event display sections 1740a and 1740b. The distance between passengers may simply be displayed.

The user can select time points such as the first time point T1 and the second time point T2 at which characteristic information is displayed in the event display portion 1740a. For example, when the user places the mouse cursor near the first time point T1 or the second time point T2 on the graph of the second distance 1750b and clicks, the display control module 515 and the data management module 516 of the facility terminal 105 cause the user It is preferable that the video at the first time point T1 or the second time point T2 of the graph selected by is reproduced on the video display unit 1710 .

Accordingly, the user can easily confirm under what circumstances the occupant in the front passenger seat approached the driver's seat side at the first time point T1 and the second time point T2.
In such a configuration, the data processing module 517 of the facility terminal 105, the control unit 303 of the imaging device 101 (101F, 101R), or the like detects a slight feature appearing in the graph as an event. However, it is particularly useful when the user wants to check video data in a situation where such a slight feature occurs.

The display control module 515 and the data management module 516 of the facility terminal 105 roughly display the time on the horizontal axis and the vehicle interior volume 1760a and the vehicle exterior volume 1760b on the vertical axis in the event display section 1740b of FIG. 17(b). there is
Each bar shown in the event display portion 1740b of FIG. 17(b) represents each time detected by the microphones of the photographing equipment 101 (101F, 101R) and other microphones mounted inside and outside the vehicle 10. , such as the integrated volume detected over a given period of time.
The predetermined time may be selectable or set by the user, for example between a few seconds and a few minutes.

In the event display portion 1740b of 17(b), the in-vehicle sound volume 1760a is increased at the third point in time T3. This corresponds, for example, to conversations of passengers in a car.
In the event display portion 1740b of 17(b), the outside sound volume 1760b is lowered at the fourth time point T4. This corresponds to, for example, a decrease in wind noise and tire rotation noise when the vehicle 10 stops.

In the event display portion 1740b of 17(b), both the vehicle interior volume 1760a and the vehicle exterior volume 1760b are increased at the fifth time point T5 and the sixth time point T6. This includes, for example, the sound of a rear-end collision of another vehicle with the own vehicle 10 or a rear-end collision between other vehicles in the vicinity of the own vehicle 10, and the state of the interior of the vehicle caused by the collision, for example, the sound of a scream or an utterance of "Dangerous!" , etc.

In another embodiment, the display control module 515 and the data management module 516 of the facility terminal 105 can display two or more pieces of event information in the event display portion 1740 of the preview screen 1700. FIG.
In such a configuration, the display control module 515 and the data management module 516 of the facility terminal 105 are configured to receive user input regarding a combination of information to be displayed on the event display section 1740 (1740a, 1740b, 1750a, 1750b). Better.

With such a configuration, it is possible to more accurately determine situations that are difficult to determine with only single event information.
For example, when the user confirms from the graph that a sudden approach or contact between passengers and a sudden increase in only the vehicle interior volume 1760a occur at the same time, there is a possibility that power harassment has occurred or a loud violence has occurred. It is possible to judge that there is a possibility, and play back the video at the corresponding point in time by intuitive operation.

As described above in connection with the second control example, etc., it is preferable that the control unit 303 of the photographing device 101 (101F, 101R) is also configured to execute the same determination.
In addition, the display control module 515 can highlight and display possible parts in the event display areas 1740a and 1740b, for example, or display them on the preview screen 1700 for confirmation of power harassment and accident events by the user. The user's confirmation work can be facilitated by displaying the part with the potential.

The data management module 516 and the data processing module 517 of the facility terminal 105 and the data management module 2216 and the data processing module 2217 of the processing device 108 display information, particularly It is preferable to collect and analyze, particularly statistically analyze, characteristic information, average information, and related information for each passenger or for all passengers. Furthermore, it is better if the characteristic information is compared and analyzed for each vehicle 10 .

Characteristic information includes, for example, the distance from fellow passengers, the volume of conversations in the car, the frequency of conversations, driving behavior such as the timing and strength of braking, the timing and strength of acceleration, Response speed to the environment, e.g., reaction speed to signal changes and pedestrians, frequency of occurrence of relaxed state, frequency of occurrence of stress state, change in vehicle state before and after use of vehicle 10 and frequency of occurrence thereof, e.g. frequency of forgetting things, Accuracy and appropriateness of driving behavior, for example, accuracy and appropriateness of handling and braking on curves, S-shaped cranks, and the like.

Furthermore, the data management module 516 and the data processing module 517 of the facility terminal 105 and the data management module 2216 and the data processing module 2217 of the processing device 108 collect, analyze, and compare various types of information, for example, in a driving school. that a particular instructor 1910 tends to behave more extreme than usual toward a particular person, such as approaching closer or speaking louder than average for that instructor 1910; It is preferable to provide the user with information such as the fact that the S-crank has many failures when using a specific vehicle 10 regardless of individual trainees 1920 .
As a result, the user can instruct the corresponding instructor 1910 and adjust the vehicle 10, such as alignment adjustment, at an earlier timing.

Extreme behavior is described in detail using FIG.
Note that the extreme behavior is an example of an extreme response.
In particular, in a driving school or a taxi business, video data shot under similar conditions, such as similar weather conditions, are likely to be collected at the same time. The data management module 2216 and data processing module 2217 of the processing unit 108 can perform the above analysis with greater accuracy.

The collection, analysis, comparison, etc. of the various types of information described above are performed by the control unit 303 of the photographing equipment 101 (101F, 101R), the data processing module 517 of the facility terminal 105, the data processing module 717 of the external management server 107, and the like. , the data processing module 2217 of the processing unit 108, etc., may be executed individually, but when they are executed cooperatively, it is advantageous to distribute the computational load.

For example, the control unit 303 of the imaging device 101 (101F, 101R) performs a rough analysis on the video data, and on the basis of the rough analysis, on the video data subjected to a more detailed analysis, The data processing module 517 of the facility terminal 105, the data processing module 717 of the external management server 107, the data processing module 2217 of the processing device 108, etc. may perform more detailed analysis.

Furthermore, the external management server cooperation module 513 of the facility terminal 105 distributes the analysis data thus performed and the video data used for the analysis to the manufacturer or sales company of the photographing equipment 101 (101F, 101R), or It may be configured to transmit to an external management server 107 operated by a research company or the like.
The data management module 716 and data processing module 717 of the external management server 107 further analyze the information received from the facility terminal 105 and combine the information received from the facility terminal 105 with information received from a terminal different from the facility terminal 105. It is advisable to carry out

FIG. 18 is an example of a map information screen 1800 of the facility terminal viewer.
A map information screen 1800 is a screen displayed on the map display section 1720 in FIG. 17, for example. The display control module 515 of the facility terminal 105 displays the map 1810 on the map information screen 1800 so that the scale can be changed and moved according to the input from the user.
Furthermore, the display control module 515 of the facility terminal 105 accepts a selection input of a specific range within the map 1810 by the user. The selection input is performed, for example, by directly selecting a specific range within the map 1810 using an input device such as a mouse, or by selecting from address information or the like.

In the map information screen 1800 of FIG. 18, the display control module 515 and the data management module 516 of the facility terminal 105 display a first range 1820 and a second range 1825 within the map 1810. FIG.
The number of ranges that the display control module 515 can display in the map 1810 can be set arbitrarily, and it is even better if the range to be displayed can be changed according to the user's input.

The display control module 515 of the facility terminal 105 cooperates with the data management module 516, and based on the user input, for example, sets the first range 1820 as a normal or recommended driving range, and the second range 1825 as a prohibited or non-restricted driving range. Recommended driving range, etc. can be set.

For example, if the vehicle 10 is a driving school vehicle 10, the first range 1820 is the normal on-road training range, or if the vehicle 10 is a transportation or delivery business vehicle 10, the first range 1820 is set. The area in charge of transportation or delivery of the vehicle 10 may be set.

Furthermore, on the map information screen 1800 of FIG. 1850 , displaying a fourth travel route 1860 .
A first travel route 1830, a second travel route 1840, a third travel route 1850, and a fourth travel route 1860 correspond to the travel routes of the vehicle 10 on which the video data was captured.
Note that the travel route is an example of a travel route.

The display control module 515 of the facility terminal 105 cooperates with the data management module 516, and based on the position information attached to the video data and the position information associated with each piece of video data, the vehicle where each video data was shot is displayed. It is preferable that the configuration displays 10 driving routes.
The location information is, for example, GPS information, base station information of mobile phones, smart phones, and the like.

For example, when the user moves the cursor to an arbitrary point on the travel route on the map information screen 1800, the display control module 515 cooperates with the data management module 516 to display the photographing equipment mounted on the vehicle 10 passing through that point. It is preferable to display a list of video data captured by 101 (101F, 101R) and information such as the number of video data.

Furthermore, in another embodiment, when the user places a cursor on an arbitrary point on the travel route on the map information screen 1800 and clicks it, the display control module 515 and the data management module 516 display images at that point. It is preferable to display the video data obtained on the preview screen 1700 .

In the map information screen 1800 of FIG. 18 , all of the first travel route 1830 to the fourth travel route 1860 start from the first point 1870 and return to the first point 1870 .
The first travel route 1830 and the fourth travel route 1860 are within the first range 1820, but the second travel route 1840 partially exits the first range 1820 and then travels to the first travel route. , and the third travel path 1850 exits the first range 1820, enters the second range 1825, and returns to the first range 1820.

Furthermore, on the map information screen 1800 of FIG. 18, the display control module 515 of the facility terminal 105 cooperates with the data management module 516 to display a first point 1870, a second point 1880, and a third point in the map 1810. 1890 is displayed.

The display control module 515 of the facility terminal 105 cooperates with the data management module 516, and based on the user input, for example, the first point 1870 is used as a base, such as a driving school, a business office such as a taxi service, a sales office, a transportation service, etc. The second point 1880 is set as a distribution center, delivery center, etc. for business, etc., and the second point 1880 is a place where stay is prohibited, a facility where stay is prohibited, a store where stay is prohibited, etc. A hotel, lodging facility, etc., may be set, and the third point 1890 may be set as a competitor, competitor, partner, or the like.

In such a configuration, when the user places the cursor on the second point 1880 or the third point 1890 on the map information screen 1800, the display control module 515 cooperates with the data management module 516 so that the vehicle 10 can It is preferable to display information such as staying time at the point.
Furthermore, when the user clicks a second point 1880 or a third point 1890 on the map information screen 1800 with a mouse or the like, it is preferable to display video data shot at those points on the preview screen 1700 .

In the above embodiment, the display control module 515 of the facility terminal 105 cooperates with the data management module 516. For example, if the second point 1880 is a hotel, the vehicle 10 stays at the second point 1880 for a short period of time. Alternatively, it may be determined that there is a suspicion of sexual harassment even if the vehicle 10 is just passing by, and a notification such as a warning may be output. It would be preferable to be able to set such that if the stay time at the second point is only a few minutes or if the user just passes by, it is determined that the event is not a problem event, and the output of notifications such as warnings is stopped.

Furthermore, in the above embodiment, the display control module 515 of the facility terminal 105 cooperates with the data management module 516, for example, if the third point 1890 is a competitor, the vehicle 10 stays at the second point 1880 for a short period of time. It would be better if it can be set to output a notification such as a warning if it is determined that there is a suspicion of information leakage even if the second point 1880 is a partner company. If the vehicle 10 stays at the third point 1890 for several minutes or if it just passes by, it is determined that it is not a problem event, and it may be possible to stop outputting notifications such as warnings. .

It is preferable that the display control module 515 and the data management module 516 are configured to be able to change the determination criteria and whether or not to execute the determination in accordance with the person associated with the video data. .

FIG. 19 is an example of a preview screen 1700 of the facility terminal 105 displaying video information 524 subjected to privacy protection processing.
In the preview screen 1700 of FIG. 19, the display control module 515 and the data management module 516 of the facility terminal 105 display the file name YYYYMMD1 of one image data in the list display section 1730. FIG. The display control module 515 displays the video data with the file name YYYYMMD1 acquired by the data management module 516 on the video display unit 1710 in a privacy-protected state.

For the sake of explanation, the video display section 1710 of the preview screen 1700 in FIG. , video data captured by the imaging devices 101 (101F, 101R) and the vehicle interior imaging cameras 102 (102F, 102R).

In the image display section 1710 of FIG. 19(a), the image data is the image data taken during the training at the driving school, the trainee 1920 is driving, and the instructor 1910 is in the passenger seat. The video data that is being played is being played.
A mask 1930 imitating an animal is superimposed on the face of the instructor 1910 by processing the video data by the display control module 515 .

In the image display section 1710 of FIG. 19(b), the image data is the image data obtained by shooting the image during the training at the driving school, and the trainee 1920 is driving as in the case of FIG. In the passenger seat, the video data of the instructor 1910 riding together is reproduced, but unlike FIG. It is

In the preview screen 1700 of FIG. 19, the display control module 515 cooperates with the data management module 516 to display, in an event display section 1740, in addition to event candidates that can be selected by the user, video processing that can be executed on video data. It is preferable that it is a configuration in which candidates such as are displayed. For example, the display control module 515 may display candidates for events, video processing, and the like acquired by the data management module 516 in the event display section 1740 in association with the display contents of the event selection section 1610 of the operation screen 1600 in FIG.

When "approach, contact" is further selected in the event display section 1740 of the preview screen 1700 of FIG. It is preferable that the configuration displays information about the distance between the occupants, as displayed in the event display section 1740a.

The display control module 515 and the data management module 516 of the facility terminal 105, when at least two persons are photographed in the video data to be subjected to privacy protection processing, display the image of at least one of them. It is preferable to perform processing that makes identification difficult, such as mask processing for the face and body, voice change processing for voice, and the like.

For example, if the trainee 1920 or a passenger desires to obtain a video during training at a driving school or a video inside a taxi during a trip, the instructor 1910 or the driver can directly provide the video data. There is a problem in terms of privacy protection of
Therefore, the data processing module 517 of the facility terminal 105 performs the above privacy protection processing on the face, body, voice, etc. of the instructor 1910 and the driver, and the user terminal cooperation module 512 of the facility terminal 105 performs It is preferable that the video data whose privacy is protected is transmitted to the trainee 1920 or the user terminal 106 owned by the passenger. As a result, the driving school and the taxi company can provide the trainee 1920 and passengers with video data that has undergone privacy protection processing for the instructor 1910 and the driver.

A preview screen 1700 in FIG. 19 illustrates an embodiment in which the display control module 515 and the data management module 516 of the facility terminal 105 execute privacy protection processing based on input from the user.
In another embodiment, for example, the data processing module 517 of the facility terminal 105 or the external management server 107 can be configured based on the input by the trainee 1920 when making a reservation for a driving school, the input by a passenger when making a reservation for a taxi, or when boarding a taxi. The data processing module 717 of the processor 108, the data management module 2216 and the data processing module 2217 of the processing device 108, etc. can also perform privacy protection processing on the video data.

In yet another embodiment, for example, the controller 303 of the photographing device 101 (101F, 101R) is controlled based on an input by the trainee 1920 when making a reservation for a driving school, an input by a passenger when making a reservation for a taxi, or when boarding a taxi. creates video data subjected to privacy protection processing, and transmits the video data to the user terminal 106 via the communication processing unit 314 of the imaging device 101 (101F, 101R), the in-vehicle network 103, or the like.
Such a configuration will be further described with reference to FIG.

FIG. 20 is an example of a display screen 2000 of the user terminal 106 displaying video information 524 subjected to privacy protection processing.
As described with reference to FIG. 19, in the video data subjected to privacy protection processing in FIG. 20, of the at least two persons in the vehicle, the instructor 1910 in the passenger seat is overlaid with a mask 1930 of an animal such as a tiger. video processing has been applied.
Also, among the voices in the video, the voice of the instructor 1910 may be subjected to voice change processing.

As described above, the video data subjected to privacy protection processing is processed by the control unit 303 of the photographing equipment 101 (101F, 101R), the data processing module 517 of the facility terminal 105, the data processing module 717 of the external management server 107, and the processing. It is created by data processing module 2217 of device 108 or the like.

The user terminal 106 of the trainee 1920 should be able to store this privacy-protected video data as the video information 624 in its auxiliary storage device 602 .
As a result, the trainee 1920 can review his/her own driving state outside of the lesson time, upload it to an SNS or the like via the network 103, and share his/her own driving state with others.

In the embodiment of FIG. 20, furthermore, for example, the facility terminal cooperation module 614 of the user terminal 106, for example, captures another The image data is acquired, and the display control module 615 of the user terminal 106 may be configured to display the image data, for example, in a picture-in-picture format.

In this way, for example, the trainee 1920 can review the contents of the lesson while confirming how he or she is driving and the conditions inside and outside the vehicle while driving, and remembering well the situation at that time. .
The operator of the driving school can protect the privacy of the instructor 1910, who is an employee, while providing the student 1920 with a more effective review opportunity, thereby improving the quality of the lesson. .

The privacy protection processing described with reference to FIGS. , the data processing module 2217 of the processing device 108, etc., or an information processing system combining them, etc., which can be applied to video data.

Privacy protection processing is performed by the control unit 303 of the photographing equipment 101 (101F, 101R), the data processing module 517 of the facility terminal 105, the data processing module 717 of the external management server 107, the data processing module 2217 of the processing device 108, and the like. , or a combination thereof.

In particular, by the control unit 303 of the photographing equipment 101 (101F, 101R), the data processing module 517 of the facility terminal 105, the data processing module 717 of the external management server 107, the data processing module 2217 of the processing device 108, or An information processing system or the like that combines them may be configured to transmit, receive, or share the results of various types of processing, particularly the results of analysis processing.

The user, for example, the manager of a driving school, further edits the video data based on the individual control and specific data, such as event data, described with reference to FIGS. It is also possible to set the photographing equipment 101 (101F, 101R) so as to pick up a situation in which the trainee 1920 could not deal calmly and collect the situation as one image data. In such a configuration, the user can provide the student 1920 with a more effective review opportunity by providing edited video data for each individually set event.

FIG. 21 is an example of a preview screen 1700 of the facility terminal 105 displaying different situations with the same distance between passengers.
In FIG. 21(a), the instructor 1910 extends his arm from the intermediate position M between the driver's seat and the front passenger seat toward the trainee 1920 by the distance D, and points to the outside of the vehicle 10. exemplifies the situation.
In FIG. 21(b), the instructor 1910 extends his arm from the middle position M between the driver's seat and the front passenger seat toward the trainee 1920 by the length of the distance D, and touches the trainee's 1920 arm. is exemplified.
At the times illustrated in FIGS. 21(a) and 21(b), the lengths of the distances D are equal.

FIG. 21 shows a preview screen 1700 when, for example, "approach/contact" is selected in event selection on another operation screen 1600 in FIG.
21A and 21B, the data management module 516 of the facility terminal 105 displays, on the preview screen 1700 of FIGS. , lists two files, "YYYYMMD1" and "YYYYMMD2".

In FIG. 21(a), the image data "YYYYMMD1" is being reproduced, and in FIG. 21(b), the image data "YYYYMMD2" is being reproduced. there is
The display control module 515 of the facility terminal 105 is configured to display information about crew members acquired by the data management module 516, such as the names and IDs of instructors 1910 and trainees 1920, in addition to or instead of file names. Better to have.
Thereby, the user can more easily understand the combination of the instructor 1910 and the trainee 1920 from the reproduced video.

For example, when the display control module 515 and the data management module 516 of the facility terminal 105 take in data having fields of instructor ID, student ID, training vehicle ID, and training time (for example, the CSV file described above), the target training It is preferable to have a function of displaying information based on the instructor ID or the student ID together with the video when reproducing the video of the time and the training car ID.

Note that it is preferable that the control unit 303 of the imaging device 101 (101F, 101R) can similarly display such information on the video reproduced during imaging by the imaging device 101 (101F, 101R).
The first distance 1750a, the second distance 1750b, and the intermediate position M are the same as those described using FIG.

In FIG. 21(a), in the event display section 1740c, from the seventh time point T7 to the eighth time point T8, the instructor 1910 moves beyond the intermediate position M indicated by the second distance 1750b to the driver's seat side. The state where the approach does not interfere with the movement of the student 1920 represented by the first distance 1750a, and more specifically the movement of the student 1920, before the seventh time T7 and from the seventh time T7. It is shown that there is no characteristic change during the eighth time T8 and after the eighth time T8.

Since there is no such characteristic change, the user such as the person in charge of the driving school can confirm that the behavior of the instructor 1910 from the seventh time point T7 to the eighth time point T8 was appropriate. Not only can it be determined subjectively from the reproduced data, but it can also be determined based on objective numerical data.

It should be noted that the determination based on this numerical data is already executed by the control unit 303 of the photographing equipment 101 (101F, 101R) at the time of photographing, or is performed by the data processing module 517 of the facility terminal 105 or the processing unit 517 of the facility terminal 105 as the image data is transferred. It may be configured to be executed by the data processing module 2217 of the device 108 or by the data processing module 717 of the external management server 107 that receives the video data from the facility terminal 105 .

Note that, for example, when the control unit 303 of the photographing device 101 (101F, 101R) specifies that the cloughs of the first distance 1750a and the second distance 1750b overlap, for example, from the seventh time point T7 to the eighth time point T8 During this period, it is preferable to shift the photographing equipment 101 (101F, 101R) to the high-quality sound recording mode.
As a result, the user can more accurately confirm the situation inside the vehicle, particularly the content of the conversation, between the seventh time point T7 and the eighth time point T8.

The data management module 516 of the facility terminal 105, for example, shifts to the above high-quality sound recording mode for each photographing device 101 (101F, 101R), for each vehicle 10 in which the photographing device 101 (101F, 101R) is mounted, and for each passenger. It is desirable to be able to change the settings for

Furthermore, it is preferable that the photographing device cooperation module 511 of the facility terminal 105 reflect such setting changes to the control units 303 of the plurality of photographing devices 101 (101F, 101R), for example, collectively.

In FIG. 21(b), in the event display portion 1740d, before and after the ninth point in time T9, the approach to the driver's seat side beyond the intermediate position M of the instructor 1910 represented by the second distance 1750b is shown by the first distance 1750a. The state of interfering with the movement of the student 1920 represented by , more specifically, the movement of the student 1920 undergoes a characteristic change after the ninth time point T9. there is

Since such a characteristic change has occurred, the user such as the person in charge of the driving school can confirm that the behavior of the instructor 1910 before and after the ninth time point T9 was appropriate. In the same way as in the case of (1), it is possible not only to make a subjective judgment from the reproduced content of the video data, but also to make a judgment based on objective numerical data.

As in the case of FIG. 21A, the determination based on the numerical data is already executed by the control unit 303 of the imaging equipment 101 (101F, 101R) at the time of imaging, or is performed along with the transition of video data. , the data processing module 517 of the facility terminal 105 or the data processing module 2217 of the processing device 108, or the data processing module 717 of the external management server 107 that receives the video data from the facility terminal 105. .

Note that, for example, when the control unit 303 of the photographing device 101 (101F, 101R) identifies that the cloughs of the first distance 1750a and the second distance 1750b overlap, , the photographing equipment 101 (101F, 101R) should be shifted to the high-quality sound recording mode.
As a result, the user can more accurately confirm the situation inside the vehicle, particularly the content of the conversation, during the time period before and after the ninth point in time T9.

When the user determines that there is a possibility that the instructor 1910 is touching or hitting the student 1920 in the state shown in FIG. , can be set as an event of higher importance than the state shown in FIG. 21(a).

The data management module 516 of the facility terminal 105 identifies the frequency of occurrence of events for each instructor 1910 according to the user's setting of importance, and identifies the number of students 1920 having specific attributes, such as female teens. For the female trainee 1920, it is preferable to specify whether or not the frequency of occurrence of events is extremely high.

21(a) and 21(b), the control unit 303 of the imaging equipment 101 (101F, 101R), the data processing module 517 of the facility terminal 105, the processing The data processing module 2217 of the device 108, the data processing module 717 of the external management server 107, and the like can be executed individually, but they may be executed cooperatively.

21(a) and 21(b), the user, the control unit 303 of the imaging device 101 (101F, 101R), the data processing module 517 of the facility terminal 105, The data processing module 2217 of the processing device 108, the data processing module 717 of the external management server 107, and the like detect a situation in which one person approaches the other person to the same degree, for example, by a distance D from an intermediate position M, can be distinguished more clearly.

Furthermore, the control unit 303 of the photographing equipment 101 (101F, 101R), the data processing module 517 of the facility terminal 105, the data processing module 2217 of the processing device 108, the data processing module 717 of the external management server 107, etc. value can be set by the user as an individual judgment or as a specific criterion, but it is better to apply a different value to each crew member, for example, the instructor 1910 or the trainee 1920 .

In the above embodiment, a state in which there are two people in the vehicle has been described. , can perform similar controls, functions and processes.

It should be noted that the scope of the present invention is not limited to the configurations or limitations expressly set forth herein, and encompasses within its scope any combination of the various aspects of the invention disclosed herein. While the claimed features of the invention are identified in the appended claims, any configuration not presently specified in the claims is disclosed herein. We intend to claim such configurations in the future.

The present invention is not limited to the configurations described in the above-described embodiments. The constituent elements of the above-described embodiments and modifications may be arbitrarily selected and combined. In addition, arbitrary constituent elements of each embodiment and modifications, arbitrary constituent elements described in Means for Solving the Invention, or constituent elements embodying arbitrary constituent elements described in Means for Solving the Invention and may be configured in any combination. We intend to acquire the rights for these as well in the amendment of the present application or in a divisional application. Even if there is a description of "in the case of" or "when", it is not described as a configuration limited to that case or that time. We disclose and intend to reserve these occasions and occasions. Moreover, the parts described with order are not limited to this order. It also discloses a configuration in which some parts are deleted and a configuration in which the order is changed, and there is an intention to acquire the right.

In addition, the applicant intends to acquire rights to the entire design or partial design by converting the design registration application. Although the entire device is drawn in solid lines in the drawing, the drawing includes not only the overall design but also the partial design claimed for a part of the device. For example, it is a drawing that includes a part of the device as a partial design regardless of the member, as well as a partial design of a part of the member of the device. The part of the device may be a part of the device or a part of the member. We intend to obtain rights not only for the overall design, but also for the partial design in which any part of the solid line part of the drawing is a broken line part. In addition, the modules, members, parts, etc. inside the housing of the device that are shown in the drawings are all subject to trade independently. It has the intention of making changes and obtaining rights.

Further, each of the above configurations, functions, processing units, processing means, and the like may be realized by hardware, for example, by designing them in an integrated circuit. Moreover, each of the above configurations, functions, etc. may be realized by software by a processor interpreting and executing a program for realizing each function. Information such as programs, tables, and files that implement each function can be stored in recording devices such as memories, hard disks, SSDs (Solid State Drives), or recording media such as IC cards, SD cards, and DVDs.

Further, the control lines and information lines indicate those considered necessary for explanation, and not all control lines and information lines are necessarily indicated on the product. In practice, it may be considered that almost all configurations are interconnected.
It should be noted that the above-described embodiments disclose at least the configurations described in the claims.

(1) An information processing system is provided that has a function of controlling a photographing device that creates video data of at least one of the interior and exterior of the vehicle based on the state or action of the person using the vehicle.

In this way, the photographing device can be controlled based on the state and motion of the person using the vehicle, and the user can use the function of controlling the photographing device based on the state and motion of the person using the vehicle. can do. Using this function makes it easier for the user to more flexibly reflect a person's state and motion in control of the photographing equipment.

(2) the photographing device is retrofitted or pre-installed with software for executing a predetermined operation mode used when it is installed in the vehicle that is used by a plurality of people in turn; The function may be controlled based on the state or action of the person using the vehicle when executing the predetermined operating mode.

In this way, when the imaging device is installed in a vehicle that is used by multiple people in shifts, it can be retrofitted or used in such a vehicle based on pre-loaded software. and the user can use functions based on the states or actions of each person who uses the vehicle operating on the premise of the operation mode. can be done. With this function, the user can control operating modes specific to a vehicle that is used alternately by multiple people based on the state or action of the person, so that even in such a vehicle, the person can It is possible to flexibly control the shooting equipment for each.

(3) The function may output different information based on the state of the person using the vehicle.

In this way, different information can be output based on the state of the person using the vehicle, and the user can more flexibly output various information corresponding to each state of the person using the vehicle. can be used. By using this function, the user can output, for example, information with a higher degree of interest for each person who uses the vehicle.

(4) The function preferably outputs the information at least one of when the photographing device is activated and when the motion of the person getting into the vehicle is detected.

In this way, different information based on the state of the person using the vehicle can be output when the photographing device is activated and when the person gets into the vehicle. You can use the function to output information when you get on. By using this function, the user can obtain a variety of different information corresponding to the state of each person using the vehicle, such as when the camera is activated or when a person gets into the vehicle. It is possible to more flexibly output information such as information that is of greater interest to the person using the vehicle.

(5) The function preferably outputs the information via the photographing device based on information stored in a storage area rewritable by the user.

In this way, various information corresponding to each state of the person using the vehicle can be output based on the information stored in the storage area rewritable by the user. It is possible to use a function for the user to set information suitable for the usage situation and environment of the vehicle, the condition and attributes of the person using the vehicle, and the like. By using this function, the user can further customize the information output by the imaging device according to the user's application, the passenger's needs and interests, and the like.

(6) The function stores information stored in either a first storage area configured to be unrewritable by the user or a second storage area configured to be rewritable by the user. It is preferable to output the information based on.

In this way, various information corresponding to each state of the person using the vehicle is output based on the information stored in the first storage area rewritable by the user, or , based on the information stored in the second storage area configured to be non-rewritable by the user, and the user can determine the usage status and usage environment of the vehicle, the state of the person who uses the vehicle, and the like. It is possible to use a function that allows the user to set information more suitable for attributes, etc. by himself/herself. By using this function, the user can customize the information to be output according to the user's purpose and the needs and interests of the passengers. easier to avoid.

(7) Preferably, the function performs the output based on the audio information selected from a plurality of stored audio information.

In this way, various information corresponding to each state of the person using the vehicle can be output based on the audio information selected from the plurality of stored audio information, and the user can use the vehicle It is possible to use the function of outputting more appropriate voice information each time based on the state of each person who uses the. By using this function, for example, even if the content of the notification is the same, the user can make a voice that is more suitable for the person who uses the vehicle, such as the state of tension, the state of relaxation, the state of proficiency in driving techniques, the state of use of services, etc. Information can be output.

(8) The function may produce an output based on a difference between the current state of the person using the vehicle and the state of the same person when using the vehicle in the past.

In this way, if there is a difference between the current state of the person using the vehicle while riding in the vehicle and the state of the person using the vehicle in the past, it is possible to output information based on the difference. The user can use the function for more appropriate output according to the information based on the difference. If this function is used, for example, if a driver who used to wear glasses in the past does not wear glasses now, the camera will send video and audio to confirm that the driver is okay without wearing glasses. Also, if a passenger who has taken a certain item on board multiple times in the past does not have that item this time, it will output video and audio to confirm such things as "Are there any items left behind?" By doing so, it is possible to follow the person using the vehicle more accurately.

(9) Preferably, the function records the video data based on the distance between the first person and the second person and the sound uttered by at least one of the first person and the second person. .

In this way, with respect to at least two persons using the vehicle, video data is generated based on the distance between the first person and the second person and the voices uttered by at least one of the first person and the second person. can be recorded, and the user can use the function of recording the video data in association with both the distance between the passengers and the voices uttered by the passengers. By using this function, the user can analyze the situation inside the vehicle in more detail by focusing on the distance between the passengers and the combination of sounds uttered by the passengers. , power harassment such as violence accompanied by yelling, sexual harassment contact and words that reject it, etc. can be analyzed with higher accuracy.

(10) The function determines the length of time until recording of the video data ends based on the opening/closing operation of at least one opening/closing portion of the vehicle by the person using the vehicle. It is preferable to extend the time length more than the above-described time length.

In this way, the length of time until the recording of the video data is completed, based on the operation of opening and closing the opening/closing portion, such as a door or hatchback, of the vehicle by the person who uses the vehicle, can be made shorter than the length of time before the opening/closing operation. can also be extended, and the user can use the function of recording the video data after the opening/closing operation for a longer period of time. By using this function, the user can, for example, open the door and get out of the vehicle, or open the hatchback to perform the work, compared to the configuration in which the recording of the video data ends at the timing when the occupant leaves the vehicle. You can secure a longer time to record the situation while you are in it.

(11) The function may perform the control differently for each person using the vehicle for a given state or action of the person.

In this way, different control can be executed for each person using the vehicle for a predetermined state or action of the person using the vehicle, particularly the same state or action, etc., and the user can Each person using the vehicle can take advantage of the ability to have customized controls based on that person's state and actions. With this feature, the user can provide a control environment for the photographic equipment that is more suitable for the individual using the vehicle.

(12) The function may output different information regarding the content of services provided using the vehicle for each person using the vehicle.

In this way, it is possible to output different information relating to the content of the service provided using the vehicle for each person using the vehicle, and the user can obtain information related to the content of the service for each person using the service. can provide more detailed information. By using this function, the user can change, for example, the startup sound, operation sound, notification sound, notification sound, driving assistance sound, etc. for each user of the reserved service. It is possible to provide an opportunity or an opportunity to relieve tension by outputting a voice accompanied by more familiar words at the time of activation.

(13) The function may output different information regarding the content of the service for each person using the vehicle based on the number of times the service provided using the vehicle is used.

In this way, different information can be output for each person using the vehicle based on the number of times the service provided using the vehicle has been used, and the user can use the service for each person using the service. More detailed information related to the number of uses can be provided. By using this function, for example, when the service content changes according to the number of times the service is used, the user can provide information corresponding to that time, such as when the service starts.

(14) The function may discriminate, from the video data, a braking operation of the vehicle by a first person using the vehicle and a braking operation of the vehicle by a second person using the vehicle.

In this way, the braking operation of the vehicle by the first person using the vehicle and the braking operation of the vehicle by the second person using the vehicle can be identified from the video data, and the user can determine whether the vehicle is To discriminate a braking operation of a vehicle by a first person and a braking operation of a vehicle by a second person who uses the vehicle from video data even in a configuration that does not have a dedicated device for detecting both braking operations. function can be used. By using this function, the user can detect the subject of the braking operation from the video data without newly adding a line for detecting the braking operation for a vehicle having a plurality of brake pedals, such as a vehicle for a driving school. can be identified.

(15) The function may distinguish between a braking operation of the vehicle by a first person using the vehicle and a braking operation of the vehicle by a second person using the vehicle as different braking operations.

In this way, the braking operation of the vehicle by the first person using the vehicle and the braking operation of the vehicle by the second person using the vehicle can be distinguished as different braking operations, and the user can similarly It is possible to use the function of distinguishing different braking actions depending on the person who performed the braking action even under the driving environment and driving conditions. By using this function, the user can, for example, know that in a driving environment in which a driver with high driving skills does not need to brake suddenly, if a student at a driving school brakes suddenly, that is a problem due to unfamiliarity. If the instructor brakes suddenly in a similar driving environment, it can be judged as a sudden brake with the possibility of a problem.

(16) The function may identify extreme correspondence between a first person using the vehicle and a second person using the vehicle.

In this way, the extreme correspondence between the first person using the vehicle and the second person using the vehicle can be identified, and the user is advised between the first person and the second person. The ability to identify extreme correspondences that occur in With this function, the user is more likely to respond more quickly and appropriately to such extreme responses. In response to complaints such as "I was caught by an instructor" or "I was very close to the instructor", was the instructor responding in the same way even in similar driving situations and learning environments when the instructor was riding with other students? It is possible to quickly and easily refer to objective data mechanically identified as to whether the response was extreme compared to the previous one.

(17) It is preferable that the function, when the person is present in the vehicle, is to shoot with a higher image quality than when the person is not present in the vehicle.

In this way, when there is a person in the vehicle, it is possible to shoot an image with higher quality than when there is no person in the vehicle. In some cases, you can take advantage of the ability to shoot higher quality video. By using this function, the user can shoot lower quality images when there is no one in the car, lengthen the shooting time of the camera, and start shooting when there are people in the car or when people are confirmed in the car. By shooting high-quality images with a greater amount of information, it is possible to acquire high-quality and high-quality video data that makes it easier to verify the conditions inside the vehicle and the situations of people inside the vehicle. Also, during travel, when there is no one in the car at a roadside station, etc., the quality of the video data is lowered, and when people return to the car after that, the video data is recorded with higher image quality and sound quality. The limited storage capacity of the photographing equipment can be effectively used.

(18) Preferably, the function changes the quality of the image data based on how the person using the vehicle is captured.

In this way, it is possible to change the quality of the image data and perform shooting based on the reflection condition of the person using the vehicle, and the user can select the image data based on the reflection condition of the person using the vehicle. You can use the function to shoot by increasing or decreasing the quality of the image. By using this function, the user can record video data in which people appear in the video in high image quality, making it easier to analyze and verify the facial expressions and postures of each person, the voice inside the car, etc. later. can be done. For example, in a configuration where there are multiple photographic devices in the car, the quality of the photographic device that can best photograph a person is improved, but compared to that, for example, it is only partially so that individual people cannot be distinguished. By lowering the image quality of the image data of the photographing device that does not show the person or shows a part of the person too large, the recording area of the photographing device can be effectively used.

(19) The function may change the sensitivity or quality of recording by the photographing device based on the voice uttered by the person using the vehicle.

In this way, it is possible to change the sensitivity or quality of sound recording by the photographing device based on the voice uttered by the person using the vehicle, and the user can change the sound recording by the photographing device based on the voice uttered by the person using the vehicle. You can use the function to shoot by increasing or decreasing the sensitivity or quality of the camera. By using this function, the user can record important conversations or fun conversations in the car with better sound quality by recording voices that focus more on conversations, making it easier to check the contents of the conversations or record memories. You can enjoy it as In addition, by setting the sensitivity and quality of the recording for each person, even if the person uses it for a person who has a loud and clear tone or a person who speaks in a low voice, the video data contains the appropriate sound quality for each person. can be obtained.

(20) The function may output based on the difference between the number of people who got into the vehicle and the number of people who got off the vehicle.

In this way, it is possible to output based on the difference between the number of people who got into the vehicle and the number of people who got out of the vehicle. You can use the function to output based on If this function is used, the user can especially warn the driver not to leave the vehicle even though the number of people getting out of the vehicle is less than the number of people getting into the vehicle. can. For example, after picking up a child from a kindergarten or kindergarten, while guiding the child to the nursery school, if the child enters the space between the seats, even if the driver or leading teacher does not notice it, all The warning can be given until the child gets out of the car. The user may give the warning by voice, but in addition to that, a display unit is provided inside the vehicle to display the number of passengers and the number of people getting off the vehicle, and the color of the display unit can be changed, lit, blinked, etc. It is even better if you let it be so that you can more effectively call attention to it.

(21) The function may output based on the difference between the number of people who got into the vehicle and the number of people recognized from the video data.

In this way, output can be performed based on the difference between the number of people who got into the vehicle and the number of people recognized from the video data. You can use the function to output based on the difference in the number of people recognized. With this function, if the number of people who can be recognized by the video data is smaller than the number of passengers in the vehicle, the user can determine that some of the passengers are located outside the shooting range of the video data. For example, it is possible to recognize an unforeseen situation in which the passenger is not seated while driving, thereby making it easier to prevent an accident or the like. When the User uses a vehicle to pick up and drop off at a kindergarten, kindergarten, etc., the child enters the space between the seats, etc., and confirms that the child has disappeared from the video. It becomes easier to immediately notify the driver or the teacher who leads the teacher.

(22) The persons using the vehicle are at least two persons, and the function preferably provides the image data processed for one person in the image data to the other person. .

In this way, in a situation where there are at least two passengers in the vehicle, it is possible to provide the video data obtained by processing one person in the video data to the other person. It is possible to use the function of providing the video data processed for one person in the video data to the other person. By using this function, the user can provide video data in which the passenger has been processed to a person who desires such video data. , it is possible to provide video data that protects the privacy of fellow passengers. Note that “one person” and “the other person” may each be a plurality of people.

(23) The function may obtain information about the person using the vehicle from a predetermined reservation system.

In this way, it is possible to obtain the information about the person using the vehicle from the predetermined reservation system, and the user can use the function of obtaining the information about the person using the vehicle stored in the predetermined reservation system. By using this function, the user can reflect the information acquired from the reservation system on the condition of the person using the vehicle, perform shooting in cooperation with the information stored in the reservation system, and record the shooting data. can be done in conjunction with the information stored in the reservation system. The information stored in the reservation system includes, for example, the characteristics of the person receiving the service (gender, age, physical characteristics, number of times the service was provided, visual characteristics of previous use, etc.), reservation time zone, reservation The information includes the person in charge of the service booked, details of the reserved service, options added at the time of reservation, planned movement range, planned movement route, month, date, day of the week, requests at the time of reservation, and the like. In addition, setting changes of the photographing device can be flexibly adapted to each of a person using the service, a person related to the provision of the service, and an organization providing the service, and the photographing device can be set more flexibly to control the photographing device. can be done. Reservation systems include, for example, reservation systems for driving schools, reservation systems for nursing care facilities, reservation systems for shuttle buses, reservation systems for limousine cruises, reservation systems for other aircraft, ships, trains (including sleeping cars), dispatch and car services. Application systems such as gearing, schedule systems for managing vehicle usage schedules in business, etc.

(24) The photographing device may be installed in the vehicle used for a predetermined service, and the function may perform the control based on data relating to the service.

In this way, it is possible to control, based on the service-related data, the photographing equipment mounted on the vehicle used for the predetermined service, and the user can operate the photographing equipment based on the service-related data. You can use the function to control. By using this function, the user can provide more appropriate services, identify whether the provided service is appropriate, improve the quality of the provided service, etc. The service-related data can be used to control the imaging equipment.

(25) The function records the video data during the usage period of the service, and the function is information indicating that a predetermined event occurring during the usage period of the service is recorded in the video data. should be output.

By doing so, it is possible to record the video data during the period of using the service, and output information indicating that a predetermined event that occurred during the period of using the service is recorded in the video data. A function of outputting information indicating that such a predetermined event is recorded in the video data can be used. By using this function, the user can recognize that a predetermined event has occurred from the output information indicating that the predetermined event is recorded in the video data before the user confirms the video data. can be done. Accordingly, the user can take action more quickly if the predetermined event requires action.

(26) The function records the video data during the usage period of the service, and the function associates the video data with information indicating that a predetermined event occurred during the usage period of the service. Good.

In this way, it is possible to record the video data during the usage period of the service, associate the video data with information about a predetermined event that occurred during the usage period of the service, and allow the user to record such a predetermined event in the video data. It is possible to use the function of associating information about the events of By using this function, the user can more efficiently manage and utilize a large amount of video data by referring to associations with predetermined events.

(27) The function controls the recording of the video data by the photographing device, or controls the recording of the video data from the photographing device, based on the relationship between the travel route of the vehicle based on the service-related data and the position of the vehicle. Output should be controlled.

In this way, it is possible to control the recording of video data in the photographic equipment or control the output from the photographic equipment based on the relationship between the travel route of the vehicle based on the service-related data and the position of the vehicle. , the user can use the function of controlling the recording of video data or controlling the output from the photographing device based on the relationship between the travel route and the position of the vehicle. With this function, the user can change the quality of the video data while the actual position of the vehicle deviates from the planned driving route, or the camera device warns about the deviation from the planned driving route. can be output or For example, if driving deviates from the prescribed driving route or driving range at a driving school, or if an employee deviates from the operating range during business hours, such a situation can be dealt with more seriously. It can be recorded in quality and made the occupant aware of the occurrence of such a situation.

(28) Preferably, the function performs the control based on reservation information obtained from a reservation system regarding provision of the service.

In this way, the photographing equipment can be controlled based on the reservation information obtained from the reservation system regarding service provision, and the user can use the function of performing control according to the reservation information obtained from the reservation system. By using this function, the user can specify the state of a person based on the reservation information obtained from the reservation system and control the photographic equipment, or compare the information included in the reservation information obtained from the reservation system with the state of the person specified in the vehicle. can control or cause the photographic equipment in combination with By specifying an individual, an attribute of the individual, a group to which the individual belongs, etc., from the information included in the reservation information, the user can provide more finely customized services.

(29) The function preferably records the captured image data during at least the usage time or the reservation time based on the reservation information regarding the service use time or the service reservation time.

In this way, it is possible to record video data captured at least during the usage time or the reservation time based on the reservation information regarding the service usage time or the service reservation time, and the user himself/herself can record the image data. It is possible to use the function of recording the captured image data at least during the usage time or during the reservation time based on the reservation information without setting the time zone for recording the image data each time. By using this function, the user can more reliably record the video data from the start to the end of the service utilization time or service reservation time. Furthermore, by stopping the recording of video data outside the above time, it is possible to save the storage capacity of the recording medium of the photographing equipment.

(30) the function, based on the reservation information regarding the usage time of the service or the reservation time of the service, in addition to the usage time or the reservation time of the service, before the usage time or the reservation time; It is preferable to record the captured video data during a period including at least one of the following.

In this way, at least during the usage time or between the reservation time, and at least one of before and after the usage time or the reservation time based on the reservation information regarding the service usage time or the service reservation time The captured image data can be recorded during the period, and the user can record the image data during the usage time or during the reservation time based on the reservation information without setting the time period for recording the image data by himself/herself. In addition to this, it is possible to use the function of recording captured image data during a period including at least one of before and after the usage time or the reservation time. By using this function, the user can obtain video data including at least one of the time period before and after the usage time or the reservation time in addition to the time period from the start to the end of the service usage time or the service reservation time. can be recorded more reliably. As a result, even during breaks between services, the user can easily record video data such as a situation in which the user of the service has arrived near the vehicle slightly earlier than the reserved time. Furthermore, by stopping the recording of video data outside the above time, it is possible to save the storage capacity of the recording medium of the photographing equipment.

(31) Based on the reservation information related to the reservation time period of the service, the function is configured to remove the video data in the reservation time period from the video data, or It is preferable to transmit the video data of the time period extended back and forth by a long amount to the first external device.

In this way, based on the reservation information about the reservation time period of the service, the video data of the reservation time period out of the video data, or the time extended forward or backward from the reservation time period by a predetermined length of time. The video data of the band can be transmitted to the first external device, and the user can select the video data of the reserved time band, or the video data before or after the reserved time band by a predetermined length of time. It is possible to use the function of transmitting the video data of the extended time period to the first external device. By using this function, the user can selectively transmit to the outside during the provision of the reserved service, for example, the time period of the lesson at the driving school and the state of several minutes before and after that, and the break time between services, etc. By avoiding or delaying the transmission of data during a time period in which the user is less interested, the time can be efficiently used to transmit the data to the outside for purposes such as copying the data. In addition, it is preferable that the transmission of the video data to the outside is performed wirelessly.

(32) Preferably, the function displays the video data recorded using the imaging device in association with date and time information when the video data was recorded and the reservation information.

In this way, it is possible to display the video data recorded using the photographing equipment in association with the recording date and time information of the video data and the reservation information. A function for displaying video data in association with information can be used. By using this function, the user can easily recognize the necessary information on the playback screen at a glance, even if the user is looking back at the video data later and there is no date information or reservation information at hand. In addition, by making it possible to read similar information from the video data played back on the screen of the photographic equipment while driving, people involved in the provision of the service can easily identify the name of the service user and the service to be provided at that time. , etc., can be confirmed with a slight movement of the line of sight, so that the quality of the service provided can be easily improved.

(33) It is preferable that the function receives a selection input for the date and time information or the reservation information, and outputs the video data corresponding to the selected date and time information or the reservation information.

In this way, it is possible to receive a selection input for date/time information or reservation information, and output video data corresponding to the selected date/time information or reservation information. You can use the function to output the video data to be used. By using this function, the user can more easily obtain video data corresponding to desired date and time information and reservation information from the video data of the shooting equipment. It is possible to more efficiently obtain collectively video data related to a reservation by a specific individual.

(34) The reservation information includes information relating to a time zone in which the vehicle is reserved by the reservation system, and the function is to transfer the video data recorded in the photographing device to a first It should be sent to an external device.

In this manner, the video data recorded in the photographing device is transmitted to the first external device during the time period when the vehicle has no reservation using the reservation information including the information regarding the time period in which the vehicle is reserved in the reservation system. The user can use the function of transmitting the video data recorded in the photographing device to the first external device during an unreserved time slot. By using this function, the user can effectively utilize the period when the vehicle is not scheduled to be used for services and the computational load associated with the transmission of video data from the photographing equipment is low, and can transmit the video data to an external device. allows the user to copy data efficiently using the time and computing power of the imaging equipment. For example, even if the video data is normally copied to an external storage device at night, after the reserved service is provided, the data of the camera equipment in the vehicle that has no next reservation is sent to the external device as soon as possible. be able to.

(35) After the person has finished using the vehicle, or after the person has finished using the service provided by using the vehicle, the function may be performed by the photographing device based on communication radio waves. The video data may be controlled to be transmitted to the first external device.

In this way, after the person has finished using the vehicle or has finished using the service provided by using the vehicle, the image data of the photographing device can be transferred to the first image data based on the communication radio wave. It can be controlled to transmit to an external device, and the user can, based on the communication radio waves, after the use of the vehicle by a person has ended, or after the use of the service provided using the vehicle has ended. , the function of transmitting the image data of the photographing device to the first external device can be used. By using this function, the user can transmit video data to an external device after using the vehicle or after using the service. To ensure the transmission of video data when the end time is delayed, or when the video data is to be secured immediately after the end time of using a vehicle or immediately after the end time of using a service.

(36) It is preferable that the function outputs based on the fact that the photographing device is in the process of photographing.

In this way, it is possible to perform an output based on the fact that the photographing device is in progress, and the user can use the function of performing an output based on the fact that the photographing is in progress. By using this function, the user can easily avoid a situation where the person's image is being recorded without the person's knowledge, thereby giving consideration to privacy. In addition, the above function can be used depending on the state of the person, for example, when the driver's seat or seat is changed in the vehicle, the person in the vehicle is not changed, or when a notification is received that shooting is in progress. It is better to control the photographing equipment so as to stop outputting similar notifications and avoid repeated notifications when the person who has already boarded the vehicle again within a certain period of time.

(37) It is preferable that the function changes the shooting that gives priority to the length of recordable time to the shooting that gives priority to video quality.

In this way, shooting that gives priority to the length of the recordable time can be changed to shooting that gives priority to the quality of the video, and the user can change the length of the recordable time based on the state or action of the person using the vehicle. You can use the function to change the shooting that prioritizes the length of the video to the shooting that prioritizes the quality of the video. By using this function, the user can record video data for as long as possible while giving priority to the length of recordable time, and according to the state or action of the person using the vehicle, , and shooting of higher-quality video can be made compatible. It is preferable that the above function can be changed to image taking with priority on quality for each person or for each combination of persons and for different states and actions.

(38) The function preferably sets different playback priorities for video and audio of the video data of at least two of the imaging devices.

In this way, different reproduction priorities can be set for video and audio of video data of at least two photographing devices, and the user can set different reproduction priorities for video and audio of such video data. Ability to set priorities. By using this function, the user can capture the same events and situations in the same vehicle captured by a plurality of image capturing devices without comparing the video data one by one. By reproducing the data with the highest reproduction priority, it is possible to preferentially reproduce the video data in which the best video and audio are recorded. It is preferable that the playback priority and the method for determining the playback priority are preset, but it is better if the user can set them by himself/herself via the main body of the photographing device, the viewer, or the like.

(39) The photographing device may include a first photographing device and a second photographing device, and the function may differ in control of photographing or recording of the video data between the first photographing device and the second photographing device. .

By doing so, it is possible to vary the control for photographing or video data recording between the first photographing device and the second photographing device, which are mounted in the vehicle. can use the function of differentiating the control of shooting or recording of video data between the first shooting device and the second shooting device. By using this function, in a configuration in which a plurality of photographing devices exist in a vehicle, the user can, for example, set appropriate settings for each photographing device according to the state and movement of the person each time, and change the storage area of the entire system. Video data can be recorded with settings that save power consumption. For example, for each different event, a camera that can optimally capture the event that occurred records the highest quality video data, while other camera devices record video data with the minimum necessary quality, lower quality. be able to. It is preferable that the above function can control three or more photographing devices differently.

(40) Preferably, the function performs common control for a plurality of photographing devices mounted on different vehicles.

In this way, it is possible to perform common control for a plurality of photographing devices mounted on different vehicles, and the user can obtain a function of performing common control for a plurality of photographing devices mounted on different vehicles. Available. By using this function, the user can apply the control applied to the photographing device mounted on the vehicle in which the user is currently riding to other vehicles as well. For example, in the driving state for determining the driving route of the vehicle by a person who has the authority to determine the driving route of the vehicle, if a section that is closed to traffic due to an accident or a section that is difficult to drive is specified, Applies control to output a notification that it is not recommended to travel in the relevant section to the camera mounted on the vehicle, and under conditions where communication connection with other vehicles is possible, the camera mounted on the other vehicle Similarly, it is possible to apply control for outputting a notification that travel in the section is not recommended.

(41) Preferably, the function performs the control according to the state or operation of the vehicle.

In this way, control can be performed according to the state or motion of the vehicle, and the user can use the function of performing control according to the state or motion of the person and the state or motion of the vehicle. This feature allows the user to implement controls for the imaging equipment that are assigned to various combinations of human states or actions and vehicle states or actions. For example, considering the driving proficiency level of the driver and the driving condition of the vehicle on rough roads, if the driving proficiency level of the driver is low, driving assistance information that supports driving is output and If the driving proficiency of the driver is high, it is possible to output performance information that makes driving more enjoyable.

(42) The function may output based on a difference between the state of the vehicle at the start of use of the vehicle and the state of the vehicle at the end of use of the vehicle.

In this way, the output can be made based on the difference between the vehicle state at the start of use of the vehicle and the state of the vehicle at the end of use of the vehicle. A feature is available that provides an output based on the difference in vehicle state between the time of day and the end of vehicle use. Using this function makes it easier for the user to recognize changes in the state of the vehicle, especially changes in the state inside the vehicle, before and after the vehicle is used. For example, when using a taxi, the existence of items such as mobile phones, earphones, wallets, umbrellas, etc. that were not present before the passenger boarded the passenger can be confirmed after the passenger gets off or when the passenger gets off. When the status is changed, it is possible to output a notification regarding such a status to the driver, for example, a voice such as "There is an item left behind by the customer".

(43) The function may create and transmit data relating to non-substitutable token data to a second external device of the person using the vehicle.

In this way, data relating to the non-fungible token data can be created and transmitted to the second external device of the person using the vehicle, and the user can create data relating to the non-fungible token data and use the vehicle. A person's ability to send to a second external device is available. With this function, the user can provide video data captured by the camera while using the vehicle as a non-fungible token or related data at the request of the person using the vehicle. can do.

(44) The function preferably transmits data regarding the non-alternative token data to the second external device via an external device different from the second external device.

In this way, the data regarding the non-substitutable token data can be transmitted to the second external device via an external device different from the second external terminal, and the user can transmit the data regarding the non-substitutable token data. , a function of transmitting to the second external device via an external device different from the second external terminal. By using this function, the user can use the photographing device or another external device in response to the request of the person who uses the vehicle, or the photographing device and another external device cooperate to operate the photographing device while using the vehicle. Captured video data can be provided as non-substitutable tokens and related data.

(45) The function may include the video data shot by at least two of the shooting devices in the data relating to the non-substitutable token data.

In this way, the data related to the non-substitutable token data can include the video data captured by at least two shooting devices, and the user can specify that the data related to the non-substitutable token data has been captured by at least two shooting devices. You can use the function to include the video data. Using this function, users can provide multi-angle video data as non-alternative tokens and related data. For example, create data that includes both video data that mainly captures the situation and people inside the vehicle and video data that mainly captures the situation and scenery outside the vehicle, and use non-substitutable tokens to create images of the scenery outside. It is possible to link the state of the car related to it.

(46) The function extracts, from the video data, the video data of a time zone in which the person using the vehicle exhibits a set emotional reaction, and converts the extracted video data into data relating to the non-substitutable token data. It is preferable that the video data is included.

In this way, the video data of the time zone in which the person using the vehicle exhibits the set emotional reaction is extracted from the video data, and the extracted video data is included in the data relating to the non-substitutable token data. , and the user can use the function of including the video data of the set emotional reaction in the data relating to the non-alternative token data. By using this function, the user can efficiently create data relating to non-alternative token data from video data edited based on set emotional reactions. For example, when using a limousine cruise or renting a car while traveling, the inside of the car becomes excited when it recognizes a situation where the user's facial expression, such as the degree of the corners of the mouth rising, shows a smile or laughter. It is possible to efficiently collect videos in a state of excitement and fun, and such videos in a happy state include many videos that are preferable to users' fans and followers. , can increase the value of non-fungible tokens.

(47) The function may receive a selection input by the person using the vehicle and set the selected emotional reaction.

In this way, it is possible to receive a selection input by the person who uses the vehicle and set the selected emotional reaction, and the user receives a selection input for the emotional reaction to be extracted and selects the emotional reaction. You can use the function to set the By using this function, the user can collect video data of emotional reactions desired by a person who requests provision of data related to non-substitutable token data, thereby providing more non-substitutable token data related to the request. Easier to provide data. For example, non-substitutable tokens can be created that display a list of pleasant or surprising emotional reactions and include video data with content more suited to the purpose of the service user. Pleasant emotional reactions can be determined, for example, from the degree of raising the corners of the mouth and features of laughter. be.

(48) The function stores the user of the service provided using the vehicle, the provider of the service, the installer of the photographing device, and the user of the photographing device in the data related to the non-substitutable token data. Data relating to contract information between at least two of the sellers may be included.

In this way, the data on the non-substitutable token data includes contract information between at least two parties of the service user and at least one of the service provider, the photographic equipment installer, and the photographic equipment seller. and the user can use the function of including the data about the contract information between at least two parties in the data about the non-substitutable token data. By using this function, the user will not have to go through a complicated process such as determining the receiving ratio of the sales amount (virtual currency, etc.) of the non-alternative token data to the service user or service provider each time. It is possible to provide an environment in which the process of distributing and remitting the sale amount can be easily executed.

(49) The image data of the photographing device is stored in a recording medium housed in a recording medium housing portion arranged outside the main body of the photographing device, and the recording medium housing portion is locked. It may be at least one of the state and the hidden state.

With this configuration, the video data of the photographing equipment is stored in the recording medium housed in the recording medium housing portion arranged outside the main body of the photographing equipment, and the recording medium housing portion is locked. and/or hidden, and the user is locked and/or hidden Video data of a photographing device can be recorded in a recording medium housed in a certain recording medium housing section. By adopting such a configuration, the user can store video data in the recording medium accommodated in the recording medium accommodation unit for each person, for each person's condition and action, based on the person's condition and action. Recording becomes possible. Furthermore, since the recording medium container is hard to find or is locked, it can be very difficult for unauthorized persons to access the recording medium contained in the recording medium container. For example, if a person using a vehicle behaves in violation of laws, regulations, or morals inside the vehicle, that person may discard, delete, or hide the video data in which such behavior is captured. easier to stop.

(50) It is preferable to provide a program for causing the information processing system to implement the above functions (1) to (49).

In this way, by providing a program to an existing information processing system, it is possible to provide the photographing equipment with the various functions described above.

The inventions shown in (1) to (50) above can be combined arbitrarily. For example, a configuration may be adopted in which at least part of the configuration of at least one of the following inventions (2) is added to all or part of the configuration of the invention shown in (1). In particular, the invention shown in (1) may be added with at least a part of the configuration of at least one invention after (2). Also, arbitrary configurations may be extracted from the inventions shown in (1) to (50) and the extracted configurations may be combined. The applicant of this application intends to obtain rights to inventions including these configurations. In addition, even if there is a description of "in the case of" or "when", it is not described as a configuration limited to that case or that time. These are examples of better configurations, and we intend to acquire configurations that are not in these cases or occasions. Moreover, the parts described with order are not limited to this order. It also discloses a configuration in which some parts are deleted or the order is changed, and there is an intention to acquire the right.

101 (101F, 101R) photographing equipment 102 (102F, 102R) vehicle interior photographing camera 103 network, 104 reservation management server, 105 facility terminal,
106... User terminal, 107... External management server, 108... Processing device

Claims (2)

A system having a function of specifying how many people can be confirmed inside the vehicle and outputting information about the number of people who can be confirmed inside the vehicle,
Equipped with a function to acquire information on the number of visitors to the facility and use that information to determine the occurrence of abandonment,
Even if the confirmed number of people getting off is less than the planned number of people getting off, if the number of people entering the facility corresponds to the planned number of people getting off, a function that does not notify of confirmation of being left behind, or a notification of confirmation of being left behind. A system characterized by having a function of notifying that a planned number of people have entered the facility afterward. A program for causing a computer to implement the functions of the system according to claim 1 .

Images