JP2023183511A - Occupant service providing device - Google Patents

Abstract

To enable a driver to concentrate on driving even when children such as infants are riding in a vehicle.SOLUTION: An occupant service providing device 10 provides services to occupants other than a driver of a vehicle from a user terminal 30 outside the vehicle. The occupant service providing device 10 includes: a camera 25 for photographing the occupants; cameras 14 and 15 for photographing subjects other than the occupants: and an output control unit 312 that controls a display 37 so that first video information output from the camera 25 and second video information output from the cameras 14 and 15 are displayed side by side on the display 37 of the user terminal 30.SELECTED DRAWING: Figure 4

Description

The present invention relates to an occupant service providing device that provides services to occupants of a vehicle or the like.

Conventionally, this type of device starts monitoring the infant when the mother or other guardian leaves the vehicle with the infant left in the vehicle, and if the infant starts crying or becomes violent, the guardian's mobile terminal is sent to the infant. A device that transmits a calling signal is known (for example, see Patent Document 1).

Japanese Patent Application Publication No. 2001-202580

However, when a child such as an infant is allowed to ride in a vehicle, the child may start crying or become violent, which may cause the driver to be unable to concentrate on driving.

A passenger service providing device, which is one aspect of the present invention, provides a service to a passenger other than the driver of a vehicle from a communication terminal external to the vehicle. The passenger service providing device includes a first imaging section that photographs the occupant, a second imaging section that photographs non-occupants, first video information outputted from the first imaging section, and second video information outputted from the second imaging section. The present invention is characterized by comprising a display control section that controls the display section so that the two video information are displayed side by side on the display section of the communication terminal.

According to the present invention, the driver can concentrate on driving even when a child such as an infant is riding in the vehicle.

1 is a diagram showing a schematic configuration of a passenger service providing system including a passenger service providing device according to an embodiment of the present invention. The figure which shows the installation example of the in-vehicle terminal. The figure which shows the installation example of the in-vehicle terminal. The figure which shows the usage example of a user terminal. FIG. 2 is a diagram showing a schematic configuration of the passenger service providing system of FIG. 1. FIG. 5 is a flowchart illustrating an example of a process executed by a calculation unit of the user terminal in FIG. 4. FIG. 5 is a flowchart showing an example of a process executed by a calculation unit of the in-vehicle terminal shown in FIG. 4. FIG. 5 is a flowchart illustrating an example of other processing executed by the calculation unit of the user terminal in FIG. 4. FIG. The figure which shows an example of the video displayed on the display of a user terminal. The figure which shows another example of the video displayed on the display of a user terminal. The figure which shows an example of the video displayed on the display of a user terminal.

Embodiments of the present invention will be described below with reference to FIGS. 1 to 9. The passenger service providing device according to the embodiment of the present invention constitutes a part of a passenger service providing system that provides services to passengers of vehicles, etc., particularly services for watching over children such as infants who ride together in vehicles.

FIG. 1 is a diagram showing a schematic configuration of a passenger service providing system including a passenger service providing device according to an embodiment of the present invention. As shown in FIG. 1, the passenger service providing system 1 according to the present embodiment includes an in-vehicle terminal 10 mounted on a vehicle 100, and a communication terminal installed in the cabin of the vehicle 100 (hereinafter referred to as an in-vehicle terminal). ) 20, a communication terminal outside the vehicle (hereinafter referred to as a user terminal) 30 that is communicably connected to the vehicle interior terminal 20 via the network 50, and a communication terminal for the driver of the vehicle 100 (hereinafter referred to as the driver's terminal). (referred to as a terminal) 40. The passenger service providing device according to this embodiment mainly includes an in-vehicle terminal 10, an in-vehicle terminal 20, and a user terminal 30. The network 50 includes not only public wireless communication networks such as the Internet and mobile phone networks, but also closed communication networks established for each predetermined management area, such as wireless LAN and Wi-Fi (registered trademark). , Bluetooth (registered trademark), etc.

FIG. 2A and FIG. 2B are diagrams showing an example of installation of the vehicle interior terminal 20. The in-vehicle terminal 20 is a communication terminal such as a tablet terminal having a speaker and a display. The in-vehicle terminal 20 is installed at a position where children such as infants riding in the vehicle 100 can view the video displayed on the display and the audio output from the speaker. As shown in FIG. 2A, when a child P2 such as an infant rides in the rear seat RS behind the front seat (for example, driver's seat) DS, the in-vehicle terminal 20 is connected to the vehicle 100 as shown in FIG. 2B. It is installed on the back side of the driver's seat DS. Note that the vehicle interior terminal 20 may be fixed to the front seat or may be removably installed.

FIG. 3 is a diagram showing an example of how the user terminal 30 is used. The user terminal 30 is a communication terminal such as a smartphone or a tablet terminal that has a speaker and a display. The user terminal 30 is capable of video calling, etc., with the child P2 who rides in the vehicle 100 via the in-vehicle terminal 20. The user terminal 30 is used by a person outside the vehicle (hereinafter referred to as a cooperator) P3 who acts as a sitter for the child riding in the vehicle 100. For example, when the driver P1 of the vehicle 100 is the mother of a child riding in the vehicle 100, the cooperator P3 is the mother's parents (the child's grandparents) who are outside the vehicle (for example, the house 300 in FIG. 1). etc. Although one user terminal 30 is illustrated in FIG. 3, a plurality of user terminals 30 may be connected to the network 50. In that case, multiple people linked to each user terminal 30 can be potential collaborators.

FIG. 4 is a diagram showing a schematic configuration of the passenger service providing system 1 of FIG. 1. As shown in FIG. As shown in FIG. 4, the in-vehicle terminal 10 includes a computer having an arithmetic unit 11 such as a CPU, a storage unit 12 such as ROM and RAM, and other peripheral circuits (not shown) such as an I/O interface. be done. Further, the in-vehicle terminal 10 includes a communication section 13 and cameras 14 and 15.

The communication unit 13 is configured to be able to communicate wirelessly with the in-vehicle terminal 20, the user terminal 30, and the driver terminal 40 via the network 50. The cameras 14 and 15 have imaging devices such as CCD and CMOS. The camera 14 is installed in the interior of the vehicle 100, for example, on the ceiling, so that at least the driver and the passenger are included in the imaging range. Camera 15 is installed indoors or outdoors of vehicle 100 and photographs the outside of vehicle 100. More specifically, the camera 15 photographs the outside of the vehicle 100 that the child P2 can see through the window from inside the vehicle.

The calculation unit 11 has an occupant detection unit 111, a determination unit 112, a registrant information acquisition unit 113, a connection control unit 114, and an information output unit 115 as functional components. The storage unit 12 stores registrant information, which will be described later.

The occupant detection unit 111 detects an occupant of the vehicle 100 based on image data obtained by the camera 14 (hereinafter referred to as captured image data or simply captured image).

The determining unit 112 determines whether a cooperator outside the vehicle needs to provide a monitoring service to the occupants (passengers) other than the driver P1 among the occupants detected by the occupant detecting unit 111. More specifically, the determination unit 112 recognizes the age of the fellow passenger through image recognition processing based on the captured image obtained by the camera 14. When the recognized age of the fellow passenger is included in a predetermined age group, the determination unit 112 determines that it is necessary to provide a monitoring service to the fellow passenger. An example of providing a monitoring service is the provision of images from a cooperator via a video call.

The determination unit 112 may recognize the body size of the fellow passenger in addition to the age of the fellow passenger through image recognition processing based on the captured image obtained by the camera 14, and if the recognized body size is a predetermined size. When it is less than the size, it may be determined that it is necessary to provide a monitoring service to the fellow passenger. Further, the determination unit 112 determines whether or not the passenger is seated in the child seat CS as shown in FIG. 2A by image recognition processing based on the captured image obtained by the camera 14. If it is determined that the passenger is seated, it may be determined that it is necessary to provide a monitoring service to the fellow passenger.

The registrant information acquisition unit 113 reads from the storage unit 12 information on a person who is registered in advance as a cooperator who provides the monitoring service (hereinafter referred to as registrant information). The registrant information includes information on the user terminal 30 associated with the collaborator (phone number, email address, etc.) and information on the collaborator. The information on the cooperator includes information indicating the name and nickname of the cooperator, and information indicating the date and time when the cooperator can provide the monitoring service (date, day of the week, time zone, etc.) (hereinafter referred to as "available date and time information"). ) is included. The registrant information is registered in advance in the storage unit 12 by the driver P1 of the vehicle 100 via the driver terminal 40, as will be described later.

The connection control unit 114 controls the connection between the in-vehicle terminal 20 and the user terminal 30 linked to the cooperator. When the determination unit 112 determines that video provision from the collaborator is necessary, the connection control unit 114 connects the in-vehicle terminal 20 to the user terminal 30 in a communicable manner. Specifically, the connection control unit 114 generates destination information based on the registrant information acquired by the registrant information acquisition unit 113, and transmits a connection instruction including the destination information to the in-vehicle terminal 20. Note that the identification information (MAC address, IP address, etc.) of the communication terminal to which the connection instruction is transmitted is stored in advance in the storage unit 12, and the connection control unit 114 controls the communication terminal ( A connection instruction is transmitted to the in-vehicle terminal 20). Further, the destination information includes the telephone number, IP address, etc. of the user terminal 30 that is connected to the in-vehicle terminal 20, that is, the cooperator.

Note that the connection control unit 114 determines that the registrant information acquired by the registrant information acquisition unit 113, more specifically, the available date and time indicated by the available date and time information does not include the departure time and arrival time of the vehicle 100. At this time, no connection instruction is transmitted to the in-vehicle terminal 20. At this time, the connection control unit 114 generates screen information indicating that the monitoring service is not available, and displays the screen information on a display device (not shown) mounted on the vehicle 100, such as a display of an in-vehicle navigation device. . Note that the connection control unit 114 acquires information regarding the departure time and arrival time of the vehicle 100 (hereinafter referred to as boarding time information) from the in-vehicle navigation device using wireless communication or the like. The riding time information may be acquired by other methods. For example, the driver P1 may transmit ride time information to the in-vehicle terminal 10 via a communication terminal such as his or her smartphone, and the connection control unit 114 may receive the ride time information transmitted by the driver P1. Further, when one of the departure time and the arrival time includes the available date and time, the connection control unit 114 allows the cooperator to provide the monitoring service for a part of the boarding time (time from departure to arrival). Screen information indicating that the information can be provided may be generated.

The information output unit 115 outputs (transmits) either the video information from the camera 14 or the video information from the camera 15 to the user terminal 30 via the communication unit 13. The video information from the camera 14 includes a captured image of the driver P1 obtained by the camera 14. The video information from the camera 15 includes a captured image of the exterior of the vehicle 100 obtained by the camera 15. The information output unit 115 transmits either the video information from the camera 14 or the video information from the camera 15 to the user terminal 30 in response to an instruction from the user terminal 30 (hereinafter referred to as a display switching instruction). Note that when the display switching instruction is not input, the information output unit 115 transmits either the video information from the camera 14 or the video from the camera 15 to the user terminal based on the preset instruction content. . Information display switching instructions will be described later.

As shown in FIG. 4, the vehicle interior terminal 20 includes a computer having a calculation unit 21 such as a CPU, a storage unit 22 such as a ROM or RAM, and other peripheral circuits (not shown) such as an I/O interface. configured. The vehicle interior terminal 20 also includes a communication section 23 , a microphone (hereinafter simply referred to as a microphone) 24 , a camera 25 , a display 26 , and a speaker 27 .

The communication unit 23 is configured to be able to communicate wirelessly with at least the in-vehicle terminal 10 and the user terminal 30 via the network 50. The microphone 24 inputs surrounding sounds as audio signals. The audio signal input by the microphone 24 is output to the calculation unit 21 as audio data via an A/D converter (not shown). The camera 25 has an imaging device such as a CCD or CMOS. The captured image obtained by the camera 25 is output to the calculation section 21. The display 26 displays an image based on the image data from the calculation unit 21. The speaker 27 outputs the audio data from the calculation unit 21 as an audio signal via a D/A converter (not shown).

The calculation unit 21 has a connection control unit 211 and an output control unit 212 as functional configurations. When the connection control unit 211 receives a connection instruction from the in-vehicle terminal 10 via the communication unit 23, it outputs a transmission signal via the communication unit 23 based on the destination information included in the connection instruction. For example, when the destination information includes the telephone number of the user terminal 30, a calling signal is output to the user terminal 30. When the user terminal 30 responds to this call signal, a connection with the user terminal 30 is established, and a video call can be made between the in-vehicle terminal 20 and the user terminal 30.

The output control unit 212 transmits the audio data acquired by the microphone 24 to the user terminal 30 via the communication unit 23. Further, the output control unit 212 transmits the captured image obtained by the camera 25 to the user terminal 30 via the communication unit 23. Further, the output control unit 212 outputs the audio data received from the user terminal 30 via the communication unit 23 to the speaker 28. Further, the output control unit 212 outputs the captured image received from the user terminal 30 via the communication unit 23 to the display 26.

As shown in FIG. 4, the user terminal 30 includes a computer having an arithmetic unit 31 such as a CPU, a storage unit 32 such as ROM and RAM, and other peripheral circuits (not shown) such as an I/O interface. be done. Further, the user terminal 30 includes a communication section 33, a microphone 34, a camera 35, an operation section 36, a display 37, and a speaker 38.

The communication unit 33 is configured to be able to communicate wirelessly with at least the in-vehicle terminal 10 and the in-vehicle terminal 20 via the network 50 . The microphone 34 inputs an external audio signal. The audio signal input by the microphone 34 is output to the calculation unit 31 as audio data via an A/D converter (not shown). The camera 35 has an imaging device such as a CCD or CMOS. The captured image obtained by the camera 35 is output to the calculation section 31. The operation unit 36 is composed of an input device such as a keyboard. The display 37 displays an image based on the image data from the calculation unit 31. Note that when the display 37 has a touch panel function, the operation section 36 may be configured by the display 37. The speaker 38 outputs the audio data from the calculation unit 31 as an audio signal via a D/A converter (not shown).

The calculation unit 31 has a connection control unit 311 and an output control unit 312 as functional configurations. When the connection control unit 311 receives a calling signal from the in-vehicle terminal 20 via the communication unit 33, it outputs a ringing tone via the speaker 38. When the user operates the operating unit 36 or the like to respond to the call using the ring tone, a connection with the vehicle interior terminal 20 is established, and a video call with the vehicle interior terminal 20 becomes possible.

The output control unit 312 transmits the audio data acquired by the microphone 34 to the in-vehicle terminal 20 via the communication unit 33. Further, the output control unit 312 transmits the captured image obtained by the camera 35 to the vehicle interior terminal 20 via the communication unit 33. Further, the output control unit 312 outputs the audio data received from the vehicle interior terminal 20 via the communication unit 33 to the speaker 38.

Furthermore, the output control unit 312 receives video information (hereinafter referred to as main video information) received from the in-vehicle terminal 20 via the communication unit 33 and video information (hereinafter referred to as main video information) received from the in-vehicle terminal 10 via the communication unit 33. The display 37 is controlled so that the information (hereinafter referred to as sub-video information) is displayed side by side on the display 37. Specifically, the output control unit 312 generates display information for displaying the main video information and the sub video information side by side on one screen, and outputs the display information to the display 37. Note that the video information received from the in-vehicle terminal 10 includes video information of the camera 14 and video information of the camera 15. Therefore, the output control unit 312 selects between the video information of the camera 14 and the video information of the camera 15 in response to an instruction (hereinafter referred to as a display switching instruction) from the user (cooperator P3) via the operation unit 36. Determine whether to use it as sub-video information. Further, when the output control unit 312 determines that the driver P1 has left the vehicle 100 based on the video information of the camera 14, the output control unit 312 converts the video information of the camera 15 into the sub video information without depending on a display switching instruction from the user. I decided to use it as a.

As shown in FIG. 4, the driver terminal 40 includes a computer having a calculation unit 41 such as a CPU, a storage unit 42 such as a ROM or RAM, and other peripheral circuits (not shown) such as an I/O interface. configured. Further, the driver terminal 40 includes a communication section 43, an operation section 44, and a display 45.

The communication unit 43 is configured to be able to communicate wirelessly with at least the in-vehicle terminal 10 via the network 50 . The operation unit 44 is composed of an input device such as a keyboard. Note that when the display 45 has a touch panel function, the operation unit 44 may be configured by the display 45.

The calculation unit 41 has a registration unit 411 as a functional configuration. The registration unit 411 transmits registrant information input by the driver P1 of the vehicle 100 via the operation unit 44 to the in-vehicle terminal 10 via the communication unit 43. Specifically, first, the registration unit 411 displays a screen for inputting registrant information (hereinafter referred to as a registration screen) on the display 45 based on an instruction from the user via the operation unit 44. When the user inputs registrant information on the registration screen via the operation unit 44, the input registrant information is stored in the storage unit 42. The registration unit 411 transmits the registrant information stored in the storage unit 42 to the in-vehicle terminal 10 via the communication unit 43.

FIG. 5 is a flowchart showing an example of a process executed by the calculation unit 41 (CPU) of the driver terminal 40 according to a predetermined program. The process shown in the flowchart of FIG. 5 is started when a registration screen display instruction is received via the operation unit 44 of the driver terminal 40. The instruction to display the registration screen may be given, for example, by activating an application for inputting registrant information (hereinafter referred to as a registration application) installed in advance on the driver terminal 40 via the operation unit 44. be exposed.

First, in step S11, a registration screen is displayed. In step S12, it is determined whether the input of registrant information is complete. Step S12 is repeated until the answer is affirmative. If the answer is yes in step S12, the registrant information input on the registration screen is transmitted to the in-vehicle terminal 10 via the communication unit 43 in step S13.

FIG. 6 is a flowchart showing an example of a process executed by the calculation unit 11 (CPU) of the in-vehicle terminal 10 according to a predetermined program. The process shown in the flowchart of FIG. 6 is started when it is detected that the driver P1 is seated in the driver's seat DS. Note that whether or not the driver P1 is seated in the driver's seat DS may be detected using a captured image obtained by the camera 14, or may be detected using other methods.

First, in step S21, it is determined whether a passenger other than the driver (passenger) has been detected. If the answer in step S21 is negative, the process ends. If the result in step S21 is affirmative, it is determined in step S22 whether or not the fellow passenger is a person who requires video provision from a cooperator. If the answer in step S22 is negative, the process ends. If the answer is yes in step S22, the registrant information stored in the storage unit 12 is acquired in step S23.

In step S24, it is determined whether there is a requestable collaborator. More specifically, based on the available date and time information included in the registrant information stored in the storage unit 12, the period from when the vehicle 100 departs from the current location until it arrives at the destination (from the departure time to the arrival time) ), it is determined whether there is a cooperator who can provide a monitoring service. Note that if multiple pieces of registrant information are stored in the storage unit 12 and multiple requestable collaborators are found, a screen for selecting one of the multiple collaborators ( (hereinafter referred to as a collaborator selection screen) may be displayed on a display device (not shown), for example, a display of an in-vehicle navigation device. The collaborator selection screen displays a list of the names and nicknames of each collaborator, as well as operation buttons for selecting one of the collaborators from the list.

In step S25, destination information including the telephone number of the user terminal 30 linked to the requestable collaborator is generated based on the registrant information corresponding to the requestable collaborator, and the generated destination information A connection instruction including this is transmitted to the in-vehicle terminal 20. As a result, a call signal is output from the in-vehicle terminal 20 to the user terminal 30 via the network 50, and when the user terminal 30 responds to this call signal, a video call is made between the in-vehicle terminal 20 and the user terminal 30. becomes possible.

FIG. 7 is a flowchart showing an example of another process executed by the calculation unit 21 (CPU) of the user terminal 30 according to a predetermined program. The process shown in the flowchart of FIG. 7 is repeated at a predetermined period while video information is being received from the in-vehicle terminal 10 via the communication unit 33.

First, in step S31, based on a display switching instruction input by the user via the operation unit 36, it is determined whether or not a video of the driver is to be displayed. If the answer is affirmative in step S31, it is determined in step S32 that the video information of the camera 14, that is, the video information that includes the driver P1 in the imaging range, is to be output as sub-video information. On the other hand, if the result in step S31 is negative, it is determined in step S33 that the video information of the camera 15, that is, the video information including the captured image of the outside of the vehicle 100, is to be output as sub-video information. In step S34, display information for displaying the main video information, that is, the video information from the in-vehicle terminal 20, and the video information selected as the sub video information in step S32 or S33 side by side on one screen is provided. generate. In step S36, the display information generated in step S35 is output to the display 37.

8A and 8B are diagrams showing examples of images displayed on the display 37 of the user terminal 30. FIG. 8A shows an example of a video in which video information including the driver P1 in the imaging range is output as sub-video information. FIG. 8B shows an example of a video in which video information including a captured image of the outside of the vehicle 100 is output as sub-video information.

The operation of the passenger service providing system including the passenger service providing device according to this embodiment is summarized as follows. First, when the mother P1 who is a driver gets in the vehicle 100 and sits in the driver's seat DS, it is determined whether or not a person who needs to provide a monitoring service is in the same vehicle (S21, S22). When a person (child P2 in FIG. 2A) who needs to be provided with a monitoring service is riding along with the child, a cooperator who can request the monitoring service is searched based on the registrant information stored in the storage unit 12. When a cooperator (grandmother P3 in FIG. 3) who can request the monitoring service is found, the in-vehicle terminal 20 installed in the vehicle 100 and the user terminal 30 linked to the grandmother P3 are connected to enable a video call. (S23, S24, S25). On the display 37 of the user terminal 30 of the grandmother P3, a captured image (video IM2 in FIG. 8A) of the child P2 acquired by the camera 25 of the in-vehicle terminal 20 is displayed. When the grandmother P3 makes a gesture to comfort the child P2 while checking the state of the child P2 displayed on the display 37, the state is captured by the camera 35, and the captured image is transmitted to the in-vehicle terminal 20. Further, when the grandmother P3 utters words to comfort the child P2, the voice of the grandmother P3 input through the microphone 34 is transmitted to the in-vehicle terminal 20 as audio data. As a result, a video of grandmother P3 cradling child P2 (video IM3 in FIG. 9) is displayed on display 26 of vehicle interior terminal 20, and grandmother P3's voice (child P2) is displayed from speaker 27 of vehicle interior terminal 20. (such as soothing words) are output. Note that, in addition to the captured image of the child P2, the display 37 of the user terminal 30 displays a captured image of the driver P1 (video IM11 in FIG. 8A), or , a captured image of the exterior of the vehicle 100 (video IM12 in FIG. 8B) is displayed. Thereby, grandmother P3 can confirm whether or not driver P1 has left vehicle 100 based on the captured image of driver P1. Further, when an object (building or vehicle) that the child P2 is likely to be interested in is found around the vehicle 100 based on the captured image of the exterior of the vehicle 100, the child can be informed of the existence of the object. Therefore, grandmother P3 can take care of child P2 more appropriately depending on the situation inside the vehicle and the surroundings of the vehicle. As a result, it is possible to prevent the child P2 from crying or becoming violent when he or she gets tired of riding the car, and the mother P1 can concentrate on driving even when the child P2, such as an infant, is in the car, and the mother P1 can safely reach the destination. You can head to

According to the embodiment of the present invention, the following effects can be achieved.
(1) The passenger service providing device is mainly composed of the in-vehicle terminal 10 and the in-vehicle terminal 20 of the vehicle 100, and the user terminal 30 external to the vehicle 100. The service is provided to passengers other than the driver P1 (child P2 in FIG. 2A). The passenger service providing device includes a camera 25 of the in-vehicle terminal 20 that photographs the passenger, cameras 14 and 15 of the in-vehicle terminal 10 that photographs non-occupants, and video information (main image) including the captured image of the passenger output from the camera 25. The display 37 is controlled so that the display section (display) 37 of the user terminal 30 displays the video information (video information) and the video information (sub video information) including captured images of people other than the occupant output from the cameras 14 and 15 side by side. An output control section 312 is provided. This allows the child inside the vehicle to be more appropriately monitored from outside the vehicle depending on the situation inside the vehicle and the surroundings of the vehicle. As a result, it is possible to prevent the child from crying or acting out due to boredom in the vehicle, and the driver can concentrate on driving even when the child is riding in the vehicle.

(2) The camera 14 photographs the driver P1. Camera 15 photographs the outside of vehicle 100. The sub-video information includes a captured image of the driver P1 obtained by the camera 14 or a captured image of the outside of the vehicle 100 obtained by the camera 15. The output control unit 312 determines which of the video information from the camera 14 and the video information from the camera 15 is to be acquired as sub-video information, in response to an instruction from the user terminal 30. This makes it possible to check from outside the vehicle whether the driver has left the vehicle or not. Furthermore, it is possible to check from outside the vehicle whether there are any objects (buildings or vehicles) that the child P2 may be interested in around the vehicle 100. As a result, the child can be cared for more appropriately depending on the child's situation.

The above embodiment can be modified in various forms. Modifications will be described below. In the embodiment described above, the determination unit 112 determines whether or not it is necessary for the collaborator to provide video to the occupant (passenger) detected by the occupant detection unit 111 based on the image data obtained by the camera 14. . However, the configuration of the determination section is not limited to this. For example, when the passenger service providing device 10 includes a seating sensor installed in a seat where a fellow passenger is seated (rear seat RS in FIG. 2A), the determination unit determines that the weight of the passenger detected by the seating sensor is determined by a predetermined value. When it is less than the value, it may be determined that it is necessary for the cooperator to provide the video to the fellow passenger.

Further, in the above embodiment, the camera 25 serving as the first image capturing unit that outputs the main video information including the captured image of the passenger (child 2 in FIG. 2A) as the first video information photographs the passenger. However, the camera 14 of the vehicle-mounted terminal 10 may photograph the occupant (child 2 in FIG. 2A) as the first photographing unit. In this case, the information output unit 115 of the in-vehicle terminal 10 transmits video information including the captured image to the user terminal 30 as first video information (main video information).

Further, in the above embodiment, the second camera 14 as the first camera that photographs the driver P1, and the camera 14 as the first camera that photographs the driver P1, and the camera 14 as the first camera that photographs the driver P1, and the camera 14 as the first camera that photographs the driver P1, and Although an example has been shown in which the camera 15 is included as a second camera for photographing. Either camera 14 or camera 15 may function as a first camera or a second camera. That is, the second photographing section may include either the camera 14 or the camera 15.

Further, in the above embodiment, the registrant information transmitted from the driver terminal 40 is stored in the storage unit 12 of the passenger service providing device 10, but the registrant information can be stored in the storage unit 12 of the passenger service providing device 10. You may make it memorize|store in the memory|storage part with which a server apparatus is provided. When a plurality of driver communication terminals (driver terminals) are connected to the network 50, the registrant information transmitted from each driver terminal is stored in the storage section of the server device. In this case, in order to make it possible to identify the source of the registrant information, the registrant information includes driver information (name, nickname, etc.) corresponding to each driver terminal and identification information (phone number, etc.) of each driver terminal. ) may be included. When the registrant information acquisition unit 113 of the in-vehicle terminal 10 acquires registrant information from the storage unit of the server device, the registrant information acquisition unit 113 of the in-vehicle terminal 10 acquires registrant information from the driver who is connected to the in-vehicle terminal 10 via short-range wireless communication such as Bluetooth (registered trademark). Registrant information corresponding to a terminal is acquired from among a plurality of registrant information stored in a storage unit of a server device.

Further, in the above embodiment, when it is detected that a child such as an infant is in the same vehicle (S22), the process of communicatively connecting the in-vehicle terminal 20 and the user terminal 30 so as to provide video (S23) is performed. , S24, S25). However, if there is another person (such as an adult) in the vehicle in addition to the child, that person can watch over the child. Therefore, even if it is detected that a child such as an infant is riding along, if it is detected that an adult or other person who does not require video provision from the collaborator is present, the video from the collaborator may be detected. You may decide that it is not necessary to provide it. In that case, the above processing (S23, S24, S25) is not executed. Further, when it is detected that a child such as an infant is riding along with the passenger (S22), it may be determined whether or not the child is sleeping through image recognition processing based on the captured image obtained by the camera 14. . If it is determined that the child is sleeping, the above process (S23, S24, S25) may be skipped as it is determined that there is no need for the video to be provided by the collaborator, or the child may wait until the child wakes up. It is also possible to wait for execution of the above processes (S23, S24, S25).

Furthermore, in the above embodiment, the driver P1 of the vehicle 100 inputs registrant information via the operation unit 44 of the driver terminal 40, that is, the driver P1 registers the cooperator P3 to the monitoring service. An example of how to perform the work was explained. However, the cooperator who acts as a watcher himself may register with the watch service via a registration app installed on the user terminal 30. As a result, people who are interested in participating in the monitoring service as a collaborator will be able to actively participate in the service, increasing the number of collaborators, and improving the convenience of the monitoring service. Can be done.

Furthermore, in the above embodiment, the case where the identification information of the communication terminal (in-vehicle terminal 20) to which the connection instruction is transmitted is stored in advance in the storage unit 12 is taken as an example, but the connection instruction can be transmitted based on the user operation. The identification information of the destination may be stored in the storage unit 12. For example, when a user (e.g., driver P1) operates the in-vehicle terminal 20 to establish a Bluetooth (registered trademark) connection with the passenger service providing device 10, the identification information of the in-vehicle terminal 20 is changed from the connection instruction. The information may be stored in the storage unit 12 as destination information. For example, the user (for example, the driver P1) inputs the identification information of the in-vehicle terminal 20 via the operation unit 44 of the driver terminal 40 and sends it to the in-vehicle terminal 10, so that the identification information is used as the connection instruction. may be stored in the storage unit 12 as a transmission destination.

Furthermore, in the above embodiment, the cooperation between the vehicle interior terminal 20 and the user terminal 30 is established by the cooperator P3 responding to the call signal outputted from the vehicle interior terminal 20 to the user terminal 30 via the network 50. An example of starting a video call was shown. However, when cooperator P3 is unable to respond to the call signal because he is doing other work, that is, when the call by the paging signal continues for more than a predetermined time, AI (artificial intelligence) is used in place of cooperator P3. An application for dialogue (hereinafter referred to as a dialogue application) may respond to a call from the in-vehicle terminal 20. Specifically, the output control unit of the user terminal 30 may start the dialogue application, and the dialogue application may respond to a call from the in-vehicle terminal 20 and operate in place of the cooperator P3. .

Furthermore, in the embodiment described above, the output control unit 312 as a display control unit determines which of the video information from the camera 14 and the video information from the camera 15 to use as sub-video information in response to a display switching instruction from the user. I tried to decide. However, the information output unit 115 of the in-vehicle terminal 10 converts either the video information from the camera 14 or the video information from the camera 15 into sub-video information in response to a display switching instruction from the user terminal 30 via the communication unit 13. It may also be output to the user terminal 30 as In this case, when a display switching instruction is input by the user via the operation unit 36, the output control unit 312 outputs the display switching instruction to the in-vehicle terminal 10 via the communication unit 33.

Further, in the embodiment described above, the output control unit 312 as a display control unit acquires either the video information from the camera 14 or the video information from the camera 15 as sub-video information in response to an instruction from the user terminal 30. I decided to do it. However, if the output control unit 312 determines that the driver P1 has left the vehicle based on the video information from the camera 14, it may decide to acquire the video information from the camera 15 as sub-video information.

Further, in the above embodiment, an example was shown in which one user terminal 30 and one in-vehicle terminal 20 are connected via the network 50 so as to be able to make a video call. A plurality of in-vehicle terminals 20 may be connected for video calling. Thereby, the cooperator P3 can take care of each of the plurality of children riding in the vehicle corresponding to each of the plurality of in-vehicle terminals 20 via the user terminal 30.

Furthermore, in the above embodiment, an example was shown in which the in-vehicle terminal 20 and the driver terminal 40 are configured as separate communication terminals, but the in-vehicle terminal 20 and the driver terminal 40 are configured as the same terminal. Good too. For example, a device to which a communication terminal such as a smartphone can be attached may be installed on the back side of the driver's seat DS in FIG. 2A, and the driver terminal 40 attached to the device may be used as the in-vehicle terminal 20.

The above description is merely an example, and the present invention is not limited to the above-described embodiments and modifications as long as the characteristics of the present invention are not impaired. It is also possible to arbitrarily combine the above embodiment and one or more of the modifications, and it is also possible to combine the modifications.

Reference Signs List 10 passenger service providing device, 20 vehicle interior terminal, 30 user terminal, 40 driver terminal, 11 calculation unit, 12 storage unit, 111 occupant detection unit, 112 determination unit, 113 registrant information acquisition unit, 114 connection control unit, 115 Information output section

Claims (5)

A passenger service providing device that provides a service to a passenger other than the driver of the vehicle from a communication terminal external to the vehicle,
a first photographing unit that photographs the occupant;
a second photographing unit for photographing people other than the occupant;
A display that controls the display unit so that the first video information output from the first image capturing unit and the second image information output from the second image capturing unit are displayed side by side on the display unit of the communication terminal. A passenger service providing device comprising: a control section; The passenger service providing device according to claim 1,
The second photographing unit photographs the driver;
The passenger service providing device, wherein the second video information includes a captured image of the driver obtained by the second imaging unit. The passenger service providing device according to claim 1,
The second photographing unit photographs the outside of the vehicle,
The passenger service providing device, wherein the second video information includes a captured image of the exterior of the vehicle obtained by the second imaging unit. The passenger service providing device according to claim 2 or 3,
The second camera includes a first camera that photographs the driver, and a second camera that photographs the outside of the vehicle.
The display control unit may determine which of video information from the first camera and video information from the second camera to acquire as the second video information in response to an instruction from the communication terminal. A passenger service providing device characterized by: The passenger service providing device according to claim 4,
When the display control unit determines that the driver has left the vehicle based on the video information from the first camera, the display control unit acquires video information from the second camera as the first video information. Crew service provision equipment.

Images