KR102428079B1 - School vehicle passenger management system and control method thereof - Google Patents

Abstract

The present invention provides a database for storing passenger information including first voice frequency information and personal information of a passenger, and vehicle information including interior structure information and vehicle operation information of the vehicle; a voice recognition unit including a plurality of microphones provided in the vehicle and collecting second voice frequency information of the occupant; and an occupant manager configured to identify the occupant's identity based on the passenger information and the second audio frequency information, and to determine the indoor location of the occupant in the vehicle based on the vehicle information and the second audio frequency information Provides a commuter vehicle occupant management system.

Description

School vehicle passenger management system and control method thereof

The present invention relates to a school vehicle occupant management system and a control method therefor.

In the case of educational facilities such as kindergartens, schools, and hagwons, transportation vehicles are operated as a means of transporting students on a certain course and then commuting to their destination.

The commuter vehicle is equipped with various safety devices to safely manage commuters, and one or two passengers ride together to guide and manage the commuters safely.

However, it is difficult for a small number of passengers to manage all of the many commuters due to the reason that the vehicle interior is narrow and visibility is not well secured due to objects such as vehicle seats and backrests.

As a result, safety accidents in school vehicles frequently occur even when a passenger is on board, and there is a need for a solution to this problem.

Korean Patent Publication No. 10-2017-0111837 (published date, 2017.10.12.)

An object of the present invention is to provide a school vehicle occupant management system capable of managing the occupants of the school vehicle using a voice frequency collected in the school vehicle, and a control method thereof.

In order to solve this problem, the school vehicle occupant management system according to an embodiment of the present invention provides passenger information including first voice frequency information and personal information of a passenger, and vehicle information including interior structure information and vehicle operation information of the vehicle. database to store; a voice recognition unit including a plurality of microphones provided in the vehicle and collecting second voice frequency information of the occupant; and an occupant manager configured to identify the occupant's identity based on the passenger information and the second audio frequency information, and to determine the indoor location of the occupant in the vehicle based on the vehicle information and the second audio frequency information do.

In addition, the occupant manager determines whether the first audio frequency information and the second audio frequency information match, and based on the personal information matched with the first audio frequency information matching the second audio frequency information The identity of the passenger may be identified.

In addition, the second audio frequency information includes information on a phase difference between second audio frequencies each collected through the plurality of microphones, and the occupant manager determines the first position of the occupant based on the phase difference information. The occupant's indoor location may be determined by matching the first location with a location for each vehicle seat included in the indoor structure information.

In addition, the communicator may further include a communication unit for communicating with a terminal device including at least one of a terminal of a guardian of the occupant, a terminal of a commuting institution of the occupant, and a terminal of a manager of the vehicle. In this case, each terminal device may communicate with the school vehicle occupant management system through an application driven.

The occupant manager may transmit whether or not the occupant whose identity has been identified and the indoor location of the occupant is transmitted to the terminal device through the communication unit.

In addition, the database further stores emergency frequency information, and when the frequency range of the second audio frequency information corresponds to the frequency range of the emergency frequency information, the occupant management unit transmits the second audio frequency information through the communication unit. It can be transmitted to the terminal device.

In addition, when the second audio frequency information is collected after the operation end time included in the vehicle operation information, the occupant management unit determines whether the first audio frequency information and the second audio frequency information match, depending on whether the vehicle operation At least one of information, whether the occupant is on board, and an indoor location of the occupant may be transmitted to the terminal device through the communication unit.

The vehicle may further include a voice output unit for outputting a voice into the vehicle, wherein the occupant manager controls the voice output unit to output a question message to the occupant based on a plurality of conversation scenarios pre-stored in the database, and The voice recognition unit may be controlled to collect the second voice frequency information based on the response message.

In addition, the vehicle location detection unit further includes a vehicle location determining unit for determining the location of the vehicle, wherein the occupant management unit, based on the list of boarding and disembarking passengers for each boarding location included in the vehicle operation information and the location of the vehicle, the occupants disembarking at each boarding location The voice output unit may be controlled to output a disembarkation guidance message to the user.

In addition, the vehicle further includes a passenger convenience unit provided for each vehicle seat in the vehicle, wherein the passenger management unit customizes the identity of the passenger among the contents stored in the database to the passenger when the indoor location of the passenger and the identity of the passenger are confirmed The occupant convenience unit may be controlled to provide the displayed content.

On the other hand, the control method of the school vehicle occupant management system according to an embodiment of the present invention includes passenger information including first voice frequency information and personal information of a passenger, and vehicle information including interior structure information and vehicle operation information of a vehicle database. saving to; collecting, by a voice recognition unit including a plurality of microphones provided in the vehicle, second voice frequency information of an occupant; and identifying, by an occupant manager, the identity of the occupant based on the passenger information and the second voice frequency information, and determining the indoor location of the occupant in the vehicle based on the vehicle information and the second voice frequency information. includes

The vehicle may further include a voice output unit for outputting a voice into the vehicle, wherein the occupant manager controls the voice output unit to output a question message to the occupant based on a plurality of conversation scenarios pre-stored in the database, and The voice recognition unit may be controlled to collect the second voice frequency information based on the response message.

In addition to the technical problems of the present invention mentioned above, other features and advantages of the present invention will be described below, or will be clearly understood by those skilled in the art from such description and description.

According to the present invention as described above, there are the following effects.

The present invention can effectively determine the indoor location of the occupant in the vehicle, such as the vehicle seat where the occupant is located and the identity of the occupant in the vehicle, using the voice frequency. Through the prior art such as a camera, it is possible to solve the problem that it is difficult to accurately determine the position of the occupant.

The present invention confirms the identity of the occupant using the unique voice frequency of each occupant, thereby preventing personal information leakage unlike the resident registration number and ID-PASSWORD method, and can omit complicated procedures for verifying the identity of the occupant, It can eliminate the inconvenience of having to always have a separate device to prove your identity, and there is no fear of hacking or loss, unlike in the case of carrying a separate device, and there is no need to periodically change passwords or devices. no convenient

The present invention detects the indoor location of the occupant in the vehicle and transmits it to the terminal of the guardian or the driver of the vehicle, so that the guardian can easily know whether the occupant is on board and whether the occupant is safely located in the vehicle interior, and the vehicle driver is the occupant Even when there is no passenger instructing the safety of the passengers, the vehicle can be operated by checking whether the passengers are seated.

The present invention determines an emergency situation occurring in the vehicle in which the occupant is boarded through an audio frequency, and transmits the sound inside the vehicle to a terminal device such as a guardian or a manager accordingly, so that the guardian of the occupant, the school institution, and the vehicle manager can control the inside of the vehicle. You can easily understand the situation and respond quickly to emergency situations.

According to the present invention, when a passenger is left in the vehicle after the vehicle operation is finished, the vehicle is used arbitrarily, or an accident occurs in the vehicle, it can be checked in real time, so that a quick response is possible.

According to the present invention, it is possible to prevent the passenger from passing the destination or being left in the vehicle by giving a disembarkation map to the passenger who has arrived at the destination through a voice message according to the artificial intelligence.

The present invention can easily confirm the identity of each passenger located in each vehicle seat using a voice frequency, and automatically provide content or services optimized for the identity of each passenger.

In addition, other features and advantages of the present invention may be newly recognized through embodiments of the present invention.

1 is a schematic block diagram of a school vehicle occupant management system according to an embodiment of the present invention.
FIG. 2 is a flowchart illustrating a process of collecting second voice frequency information of an occupant and identifying the occupant's identity in FIG. 1 .
3 (a), 3 (b) and 3 (c) are diagrams exemplarily showing the position of the occupant by collecting the second voice frequency information of the occupant in FIG. 1 .
4 is a block diagram schematically illustrating transmission/reception between the school vehicle occupant management system and the terminal device in FIG. 1 .
FIG. 5 is a block diagram schematically illustrating a school vehicle occupant management system including an audio output unit in FIG. 1 .
6 is a block diagram schematically illustrating a school vehicle occupant management system including a vehicle location determining unit in FIG. 5 .
7 is a block diagram schematically illustrating a school vehicle occupant management system including an occupant convenience unit in FIG. 1 .
8 is a flowchart illustrating a control method of a school vehicle occupant management system according to an embodiment of the present invention.
9 is a flowchart illustrating an audio output unit controlled by the occupant management unit in FIG. 8 .

In the present specification, it should be noted that, in adding reference numbers to the components of each drawing, the same numbers are used only for the same components even though they are indicated on different drawings.

On the other hand, the meaning of the terms described in this specification should be understood as follows.

The singular expression should be understood to include a plural expression unless the context clearly defines otherwise, and the scope of rights should not be limited by these terms.

It should be understood that terms such as “comprise” or “have” do not preclude the possibility of addition or existence of one or more other features or numbers, steps, operations, components, parts, or combinations thereof.

The term “at least one” should be understood to include all possible combinations from one or more related items. For example, the meaning of “at least one of the first, second, and third items” means each of the first, second, or third items as well as two of the first, second and third items. It means a combination of all items that can be presented from more than one.

Hereinafter, preferred embodiments of the present invention designed to solve the above problems will be described in detail with reference to the accompanying drawings.

In describing the present invention, detailed descriptions of related known technologies or configurations are omitted so as not to obscure the gist of the present invention.

1 is a schematic block diagram of a school vehicle occupant management system according to an embodiment of the present invention.

Referring to FIG. 1 , a school vehicle occupant management system 10 according to an embodiment of the present invention includes a database 100 , a voice recognition unit 300 , and an occupant management unit 200 .

The school vehicle occupant management system 10 stores passenger information of passengers commuting to school by using the school vehicle in advance, and compares and analyzes the passenger information and the second voice frequency information collected from the passengers riding the school vehicle to identify the passengers, That is, it is possible to determine which passenger the passenger is.

The database 100 , the voice recognition unit 300 , and the occupant management unit 200 of the school vehicle occupant management system 10 may be configured as one computer system or as separate computer systems.

The database 100 , the voice recognition unit 300 , and the occupant management unit 200 of the school vehicle occupant management system 10 may be provided in the vehicle or in a place other than the vehicle.

The database 100 stores passenger information including first voice frequency information and personal information of a passenger, and vehicle information including interior structure information and vehicle operation information of the vehicle.

The passenger information may be a school vehicle, that is, each information about a plurality of passengers riding in the vehicle. For example, in order for passengers to use a vehicle, the passengers may be each contracted with a school vehicle company in advance, or a school vehicle company may be contracted with the passenger's school institution. In this case, the school vehicle occupant management system 10 may receive passenger information from one or more of a server of a company server of a school vehicle or a server of a school institution.

The passenger information includes first voice frequency information of the passenger and personal information of the passenger.

The first voice frequency information of the passenger may be information about the passenger's voice stored in advance. The first voice frequency information of the passenger may include information about the first voice frequency of the passenger, and the first voice frequency may be information about the passenger's voice.

The passenger's first voice frequency information is information about the voice of each passenger using the vehicle, extracted from the passenger's voice input in advance, and includes specific vectors such as each passenger's unique waveform and frequency required to recognize the passenger. can For example, as for the specific vector, a specific vector capable of well expressing phonetic features may be extracted every predetermined time from a voice input through a microphone or the like. In addition, the first voice frequency information may include information about the driver's voice.

When extracting a specific vector included in each of the first and second voice frequency information from the first voice frequency and the second voice frequency to be described later, first, the MFCC (Mel Frequency Cepstral Coefficient) method is used to obtain the voice of the passenger or passenger. related feature values can be detected. MFCC is a method of detecting a spectrum-based effective feature value using the non-linear frequency characteristic of the human ear. In addition, the feature value related to the stored or collected voice is not limited to the MFCC method, and may be detected as a feature parameter value for a frequency sequence extracted from the voice.

Next, the speech signal may be classified using the detected feature value using an ergodic Hidden Markov Model (HMM). That is, the voice signal may be classified into a state corresponding to the voice category using the ergodic HMM. A voice category may be classified according to a voice characteristic, for example, a voice characteristic such as a frequency and a loudness. In addition, the voice signal may be classified using various methods without being limited to the ergodic HMM. It is possible to extract a feature vector for a voice frequency based on the detected feature value.

Passenger's personal information is information about the identity of each passenger using the vehicle, unique code, name, age, gender, address, school, grade, school, school hours, courses taken, course achievement, hobbies, special skills, It may include information about at least one of a product purchase history, a passenger's terminal, a guardian's terminal 30_1, a school terminal 30_2, a boarding/unloading date, boarding/unloading time, boarding/unloading location, and physique.

The vehicle information is information about a school vehicle that is operated for passengers to ride and can be received from the server of the company of the school vehicle, and includes information on the interior structure of the vehicle and vehicle operation information of the vehicle.

The vehicle interior structure information is information on the structure and location of the vehicle interior, and may include information on facilities such as a vehicle seat, a microphone, and a speaker, and information on each location such as an aisle and an entrance.

Vehicle operation information is information about the operation of the vehicle, from the manager's terminal (30_3), the driver, the driver's voice frequency, the operation start time, the operation end time, the operation schedule, the operation route, and the list of passengers by boarding and boarding locations. It may include information about at least one.

The voice recognition unit 300 collects second voice frequency information of the occupant from the voice of the occupant in the vehicle, and includes a plurality of microphones provided in the vehicle.

The second voice frequency information of the other passenger may include information about the passenger's second voice frequency, and the second voice frequency may be information about the passenger's voice.

The second voice frequency information of the occupant is information about the voice of the occupant getting on and off the vehicle, extracted from the occupant's voice in the vehicle, and may include a specific vector such as a waveform, frequency, etc., unique to each occupant required to recognize the occupant. . For example, as for the specific vector, a specific vector capable of well expressing phonetic features may be extracted every predetermined time from a voice input through a microphone or the like. In addition, the second voice frequency information is extracted from all sounds collected in the vehicle and may include a specific vector such as a frequency required to recognize the current situation in the vehicle or the current situation of the occupant.

A plurality of microphones are provided at respective predetermined positions in the vehicle interior, and collect voices of vehicle occupants. For example, the microphones may be provided in at least one of a front right corner, a front left corner, a rear right corner, a rear left corner, a middle right side, and an intermediate left side, respectively, in the vehicle interior. In addition, it can be installed at various heights of the installation location. For example, it may be provided in all of the upper, middle and lower sides at the front right corner position in the vehicle interior described above. As more microphones are installed in various locations, more detailed audio frequency information and information on the phase difference of audio frequencies can be derived.

The occupant management unit 200 may be a processor of the school vehicle occupant management system 10 , and may control both the database 100 and the voice recognition unit 300 included in the school vehicle occupant management system 10 .

The occupant manager 200 may determine the identity of the occupant based on the passenger information and the second audio frequency information, and determine the indoor location of the occupant in the vehicle based on the vehicle information and the second voice frequency information.

For example, the occupant management unit 200 uses the personal information of the occupant through the voice frequency information that matches the voice frequency information of the occupant collected from the inside of the vehicle among the passenger information stored in the database 100 and the matched personal information. identity can be identified. In addition, the position between the occupant and the microphones can be identified through the phase difference information included in the voice frequency information collected from the plurality of microphones, and this is matched with the interior structure information of the vehicle including the position of the microphones and the position of the vehicle seat. It is possible to determine the indoor location of the vehicle, such as the location of the vehicle seat where the occupant is located.

In addition, the school vehicle occupant management system 10 uses a camera installed inside and outside the vehicle, or biometric methods such as fingerprint recognition, vein recognition, iris recognition, voice recognition, face recognition and palm print recognition other than voice frequency information. It can be used to determine whether a passenger included in the passenger list is boarding.

In addition, the commuter vehicle occupant management system 10 uses a BLE tag (Bluetooth Low Energy Tag) and a locator, a Bluetooth connection between the occupant's mobile phone and the driver's mobile phone, or various in-cabin devices installed inside the vehicle. Indoor location can be identified.

As described above, according to an embodiment of the present invention, by identifying the identity of a occupant of the vehicle and the indoor location of the occupant in the vehicle using the audio frequency, the occupant management unit is located in any vehicle seat or position in the vehicle interior. It is possible to determine whether the occupant is located, thereby increasing the safety and management efficiency of the occupants. In the conventional case, it was difficult to manage many passengers with only a small number of passengers and drivers due to various facilities such as vehicle seats provided in the vehicle interior.

FIG. 2 is a flowchart illustrating a process of collecting second voice frequency information of an occupant and identifying the occupant's identity in FIG. 1 .

Referring to FIG. 2 , the occupant management unit 200 determines whether the first voice frequency information and the second voice frequency information match, and based on the personal information matched with the first voice frequency information matching the second voice frequency information. to identify the occupant's identity.

For example, passenger information including first voice frequency information and personal information about each passenger using the vehicle from a server of a school institution or a company server of a school vehicle is stored in the database 100 of the school vehicle occupant management system 10 is stored, and vehicle information including the vehicle interior structure information and vehicle operation information from the company server of the school vehicle is stored in the database 100 of the school vehicle occupant management system 10 (S110).

Then, the voice recognition unit 300 of the school vehicle occupant management system 10 collects the second voice frequency information of the occupant from the voice of the occupant boarding or riding in the vehicle ( S120 ).

Then, the occupant manager 200 receives passenger information and vehicle information from the database 100 ( S130 ), and receives second voice frequency information of the occupant from the voice recognition unit 300 ( S140 ). In this case, the passenger information and vehicle information and the second audio frequency information may be simultaneously transmitted, or the second audio frequency information may be transmitted first.

Then, the occupant management unit 200 determines whether there is first audio frequency information matching the second audio frequency information among the first audio frequency information included in each passenger information (S150).

And, when the first voice frequency information matching the second voice frequency information of the occupant is identified, the occupant management unit 200 checks the passenger's personal information stored in the database 100 by matching the first voice frequency to the occupant's identity to determine (S160).

For example, by comparing and analyzing the first voice frequency information about passengers A, B, and C stored in the database 100 and the second voice frequency information about the passenger D collected by the voice recognition unit 300, the second voice frequency information about the passenger D 2 When the voice frequency information matches the first voice frequency information about the passenger A stored in the database 100, the occupant management unit 200 determines the occupant as the passenger A, and transfers the personal information about the passenger A to the personal information about the passenger D. It is updated with the information, and the identity of the passenger D can be identified accordingly.

In the case of determining whether the first and second voice frequency information match, the speaker identification method of finding out whether there is voice frequency information of a passenger among the voice frequency information stored in the database 100 and the voice frequency information of which passenger; or The identity of the occupant may be verified using at least one method among speaker verification methods. The speaker identification is a method of finding the most matching speaker by comparing the registered passenger's voice frequency information with the passenger's voice frequency information. The speaker verification is a method of finding the speaker through a verification process that determines whether the registered passenger's voice frequency information is matched with the passenger's voice frequency information. In addition, the present invention is not limited thereto, and it may be determined whether the first and second voice frequency information match in various ways.

As described above, according to an embodiment of the present invention, the identity of the occupant in the vehicle may be confirmed using the passenger's own voice frequency. In this way, when verifying the identity of a passenger using voice frequency information, it is possible to solve the problem of personal information leakage, unlike the resident registration number and ID-PASSWORD method, because each individual's unique voice frequency information is used. In addition, complicated procedures for the passenger to prove their identity can be omitted. In addition, the inconvenience of having to always carry a separate device (eg, a smart tag), etc., for the passenger to prove their identity can be eliminated. In addition, since the identity is verified through the passenger's unique voice frequency information, there is no fear of hacking and loss, unlike in the case of carrying a separate device. In addition, it is convenient because there is no need to periodically change passwords or devices.

3(a), 3(b) and 3(c) are diagrams exemplarily showing the position of the occupant by collecting the second voice frequency information of the occupant in FIG. 1 .

3 (a), 3 (b) and 3 (c), the second voice frequency information includes information about the phase difference between the second voice frequencies each collected through a plurality of microphones, and , the occupant manager 200 may determine the first position of the occupant based on the phase difference information, and match the first position with the position for each vehicle seat included in the interior structure information to determine the indoor position of the occupant.

The voice recognition unit 300 may collect the second voice frequency information of the occupant through a plurality of microphones located at different positions inside the vehicle. That is, the plurality of microphones collect the voice generated from the occupant at each location. In this case, even if the voice of one occupant is collected, a phase difference (Ex. microphone arrival time difference) occurs due to the position difference of the microphones, and information on the phase difference between the second voice frequencies may be included in the second voice frequency. have.

The occupant manager 200 may identify information on the first position of the occupant through the phase difference information included in the second voice frequency information collected by the voice recognition unit 300 .

The first position of the occupant may be a position of the occupant in the vehicle.

The first position of the occupant may be a position of the occupant located between the plurality of microphones. That is, when voice is collected in a region surrounded by a plurality of microphones, the distance between the position of each microphone and the position of voice generation can be grasped by the phase difference, and through this, in the region surrounded by the plurality of microphones, the distance can be determined. The position of the occupant who generated the voice can be specified.

The vehicle interior structure information stored in the database 100 may include information on a position for each vehicle seat and a position of each of the plurality of microphones. That is, when the first position of the occupant in the area surrounded by the plurality of microphones is identified, the first position is matched to the interior structure information including the positions of the plurality of microphones and each vehicle seat to determine which vehicle seat the occupant is located in can In addition, a terminal device 30 including at least one of a terminal 30_1 of a guardian of the occupant, a terminal 30_2 of a commuting institution of the occupant, and a terminal 30_3 of a manager of a vehicle such as a vehicle driver for the identified indoor location of the occupant ) can be transmitted.

For example, as in FIG. 3A , the voice recognition unit 300 includes a first microphone 310_1 , a second microphone 310_2 , a third microphone 310_3 , and a fourth microphone 310_4 . do. When the occupant P of the vehicle generates a voice within the area surrounded by the four microphones, the voice recognition unit 300 collects second voice frequency information related thereto to each microphone, at this time according to the position of each microphone. Information on the generated phase difference is also collected by being included in the second audio frequency information, and the first position of the occupant P can be specified through this. For example, the first position of the occupant P is 2.5 m from the first microphone 310_1, 2 m from the second microphone 310_2, 2 m from the third microphone 310_3, and 1.5 m from the fourth microphone 310_4. It is located at a distance of

As shown in (b) of FIG. 3 , the interior structure information stored in the database 100 includes information about the position of each microphone and the positions of the plurality of vehicle seats 21_1 to 21_16 inside the vehicle 20 . In addition, information about the distance between each vehicle seat and each microphone is included. For example, the eleventh vehicle seat 21_11 of the vehicle 20 is 2.5m from the first microphone 310_1, 2m from the second microphone 310_2, 2m from the third microphone 310_3, and the fourth microphone 310_4 ) at a distance of 1.5 m.

As shown in (c) of FIG. 3 , the occupant management unit 200 matches the identified information on the first position of the occupant P with the indoor structure information stored in the database 100 to match the first position of the occupant P and The eleventh vehicle seat 21_11 of the matching vehicle 20 is identified, and the indoor location of the occupant P in the vehicle 20 is determined as the eleventh vehicle seat 21_11.

As described above, according to an embodiment of the present invention, it is possible to determine the indoor position of the occupant in the vehicle based on the voice frequency information of the occupant, and thus, it is possible to ensure the safety of the occupant by confirming whether the occupant is correctly positioned in the vehicle seat. In addition, when the identity of the occupant located in each vehicle seat is confirmed as described above, a customized service may be provided to each occupant through various facilities provided in each vehicle seat.

4 is a block diagram schematically illustrating transmission/reception between the school vehicle occupant management system and the terminal device in FIG. 1 .

4, the school vehicle occupant management system 10 may include a communication unit 400 that communicates with the terminal device 30 based on information about the terminal device 30 stored in the database 100, The terminal device 30 may include at least one of a terminal 30_1 of a guardian of an occupant, a terminal 30_2 of a commuting institution of the occupant, and a terminal 30_3 of a manager of a vehicle.

The occupant manager 200 may control the communication unit 400 to communicate with the terminal device 30 using a communication network. The type of communication network is not limited, and may include a mobile communication network, a wired Internet, a wireless Internet, and a broadcasting network as well as a short-range wireless communication network between terminals. For example, a communication network is a Personal Area Network (PAN), a Local Area Network (LAN), a Campus Area Network (CAN), a Metropolitan Area Network (MAN), a Wide Area Network (WAN), a Broad Band Network (BBN), the Internet, etc. It may include one or more arbitrary communication networks among the communication networks of the

The terminal 30_1 of the guardian of the occupant is a terminal possessed by the guardian of the occupant, the terminal 30_2 of the commuting institution is the terminal 30_2 of the commuting institution where the occupant goes to school, and the terminal 30_3 of the manager is the vehicle in which the occupant is boarded. It may be a terminal of a driver or a terminal of a manager of a school vehicle.

Information regarding the terminal 30_2 of the occupant's guardian and the terminal 30_2 of the commuting institution may be identified from matched personal information when the identity of the occupant is confirmed, and information regarding the terminal 30_3 of the manager may be identified from vehicle information.

In addition, the occupant management unit 200 may transmit whether the occupant whose identity has been identified and whether the occupant is on board and the indoor location of the occupant is transmitted to the terminal device 30 through the communication unit 400 .

In addition, the school vehicle occupant management system 10 may check the driving state of the vehicle through a device for checking vehicle driving information provided by an in-vehicle repeater or a communication company, check the moving speed, and transmit it to the terminal device 30 .

As such, according to an embodiment of the present invention, the guardian can easily know whether the occupant is on board and whether the occupant is safely positioned in the vehicle interior. In addition, the commuting institution can check whether the commuting student is properly commuting to school through the boarding of the occupant. In addition, even when there is no passenger instructing the safety of the passengers, the vehicle driver may check whether all passengers are seated in the seat to proceed with the vehicle operation.

In addition, the database 100 stores emergency frequency information, and when the frequency range of the second audio frequency information corresponds to the frequency range of the emergency frequency information, the occupant management unit 200 transmits the second audio frequency information to the communication unit 400 . It can be transmitted to the terminal device 30 through

For example, the emergency frequency information includes first emergency frequency range information of 400 to 500 Hz, second emergency frequency range information of 500 to 700 Hz, and a third emergency frequency range of 700 to 900 Hz, depending on the frequency range included in the second voice frequency information of the occupant. Information including at least one of emergency frequency range information.

When the second voice frequency information corresponding to the first emergency frequency range information is collected, the occupant management unit 200 determines that a minor problem has occurred to the occupant, and the occupant management unit 200 transmits the voice of the current occupant through the communication unit 400 . Alternatively, the second audio frequency information including all sounds in the vehicle interior is transmitted to the terminal 30_3 of the vehicle manager.

When the second audio frequency information corresponding to the second emergency frequency range information is collected, the occupant management unit 200 determines that a fight has occurred with the occupant, and the occupant management unit 200 communicates all sounds in the vehicle interior through the communication unit 400 . transmits the second voice frequency information including the to the terminal 30_1 of the occupant's guardian and the terminal 30_3 of the manager of the vehicle.

When the second voice frequency information corresponding to the third emergency frequency range information is collected, the occupant management unit 200 determines that an accident has occurred in the vehicle in which the occupant is boarded, and the occupant management unit 200 communicates through the communication unit 400 . The second audio frequency information including all sounds in the current vehicle interior is transmitted to the terminal 30_1 of the passenger's guardian, the terminal 30_2 of the school institution, and the terminal 30_3 of the manager of the vehicle.

As described above, according to an embodiment of the present invention, by transmitting a sound in the vehicle interior to a terminal device related to an occupant and an emergency situation occurring in the vehicle in which the occupant is boarded, the occupant's guardian, the school institution and the vehicle manager can situation can be easily understood. In the case of a commuter vehicle, even if an in-vehicle camera is provided, it is difficult to secure a view of the camera due to the back of the vehicle seat, etc. For this purpose, there is a difficulty in continuous observation regardless of the presence or absence of an emergency.

In addition, when the second audio frequency information is collected after the operation end time included in the vehicle operation information, the occupant management unit 200 determines whether the first audio frequency information and the second audio frequency information match, depending on whether the vehicle operation information and the occupant Information on at least one of whether the passenger is on board and the indoor location of the occupant may be transmitted to the terminal device 30 through the communication unit 400 .

The occupant management unit 200 collects second voice frequency information generated in the vehicle interior after vehicle operation is terminated based on vehicle information and passenger information including vehicle interior structure information and vehicle operation information stored in the database 100. You can check the current status of the vehicle.

The occupant manager 200 may check the current time. The school vehicle occupant management system 10 may include a time check unit that can check the in-vehicle time.

The occupant management unit 200 compares the vehicle operation information including the operation end time with the current time to determine whether the operation of the vehicle has ended, and through the voice recognition unit 300 , the vehicle interior after the operation of the vehicle is terminated. may collect the second voice frequency information of , and transmit information related to various current situations of the vehicle to the terminal device 30 through the communication unit 400 according to the collected second voice frequency information.

For example, if the first voice frequency information of the passenger of the passenger list is confirmed from the second voice frequency collected after the operation of the vehicle is terminated, the occupant management unit 200 determines that the occupant cannot get off and is trapped in the vehicle. , transmits the second voice frequency information including all sounds in the vehicle interior to at least one terminal device among the terminal 30_1 of the occupant's guardian and the terminal 30_3 of the manager.

When the driver's first voice frequency information is confirmed from the second voice frequency collected after the vehicle is driven, the occupant management unit 200 determines that the vehicle is arbitrarily used, and includes all sounds in the vehicle's interior. The second voice frequency information is transmitted to the terminal 30_3 of the manager of the school vehicle except for the driver.

When information about a person's voice that does not match the second voice frequency information is identified from the second voice frequency collected after the vehicle is driven, the occupant management unit 200 determines that the vehicle is stolen, The second voice frequency information including all the sounds of the driver is transmitted to the terminal 30_3 of the manager of the school vehicle except for the driver.

When a frequency of 700 Hz or higher is identified from the second audio frequency collected after the vehicle is driven, the occupant management unit 200 determines that an accident has occurred in the vehicle, and includes a second audio frequency including all sounds in the vehicle interior. The information is transmitted to the terminal 30_3 of the manager.

In addition, the school vehicle occupant management system 10 checks the presence or absence of a occupant in the vehicle by interworking with the vehicle's biometric device or boarding/unloading safety bell after the vehicle operation is finished, and outputs a voice message if there is a occupant. to the terminal device 30 including terminals such as a driver of the vehicle, a passenger of the vehicle, and a manager.

In addition, when the school vehicle occupant management system 10 detects that the vehicle is driven outside of normal operating hours, it may control or allow the vehicle to be operated exceptionally through the confirmation of the manager or driver.

In this way, it is possible to check the accident that occurs after the vehicle operation of the present invention is finished and inform the guardian and the manager. That is, it is possible to check in real time whether an occupant is left in the vehicle, the vehicle is used arbitrarily, or an accident occurs in the vehicle after the vehicle operation is finished, so that a quick response is possible.

5 is a block diagram schematically illustrating a school vehicle occupant management system including an audio output unit in FIG. 1 .

Referring to FIG. 5 , the school vehicle occupant management system 10 includes a voice output unit 500 for outputting voice into the vehicle, and the occupant management unit 200 is based on a plurality of conversation scenarios stored in advance in the database 100 . The voice output unit 500 may be controlled to output a question message to the occupant, and the voice recognition unit 300 may be controlled to collect second voice frequency information based on the occupant's response message.

The voice output unit 500 outputs the voice generated by the commuter vehicle occupant management system 10 to the inside of the vehicle, and may include a speaker that outputs the voice so that the occupant of the vehicle can recognize it.

The database 100 may store a plurality of dialogue scenarios suitable for each of various situations in order to identify the occupant's identity, induce the occupant to get off, or inform the occupants of an emergency situation.

According to the artificial intelligence learned based on a plurality of dialogue scenarios, the occupant management unit 200 generates a voice message for identification, getting off, and emergency guidance to the occupant based on the passenger information and vehicle information, and outputs the voice. A corresponding message may be output to the passenger through the unit 500 .

For example, when the vehicle is stopped at a specific boarding location, the occupant management unit 200 generates a question message for confirming whether a passenger scheduled to board at the corresponding boarding point has boarded, and controls the voice output unit 500 to output it. In this case, if the passenger's name is 'Hong Gil-dong', the question message is "Hong Gil-dong, are you on board?"

Then, before the vehicle starts moving, a question message for confirming whether or not the occupant is safely positioned in the vehicle seat is generated, and the voice output unit 500 is controlled to output it. In this case, the question message is "Have you been seated in Hong Gil-dong's seat and fastened your seat belt?"

After the question message is output through the voice output unit 500, the occupant management unit 200 controls the voice recognition unit 300 to collect response messages to the output question message, 2 You can collect audio frequency information.

For example, the response message to the question message "Have you boarded Hong Gil-dong?" is "Yes, I got on." or "I'm here." It is possible to collect the sound in the vehicle interior including the light as the second audio frequency information. In this case, the occupant management unit 200 may determine whether the respondent is actually 'Hong Gil-dong' by comparing the first voice frequency information and the second voice frequency information.

As such, according to an embodiment of the present invention, the second voice frequency information of the occupant may be collected by inducing the occupant to generate a voice.

6 is a block diagram schematically illustrating a school vehicle occupant management system including a vehicle location determining unit in FIG. 5 .

Referring to FIG. 6 , the school vehicle occupant management system 10 includes a vehicle location determining unit 600 for determining the location of the vehicle, and the occupant management unit 200 includes a list of boarding and disembarking passengers for each boarding location included in the vehicle operation information and Based on the location of the vehicle, the voice output unit 500 may be controlled to output a disembarkation guidance message to passengers disembarking at each boarding site.

The vehicle location determining unit 600 may communicate with a plurality of GPS satellites to obtain information about the current location of the vehicle in which the occupant is boarded. In addition, the vehicle location determining unit 600 may determine whether the vehicle is running or stopped by determining the vehicle location information at regular time intervals, calculating the changed location of the vehicle.

In addition, the commuter vehicle occupant management system 10 includes the driver's mobile phone and a GPS device installed in the vehicle, or the passenger's mobile phone GPS and smart communication device, or the passenger's mobile phone Wi-Fi and vehicle peripheral communication relay device, or a tripod using Bluetooth or Wi-Fi or Wi-Fi. The location of the vehicle or the indoor location of the occupant can be grasped using surveying or BLE, beacon, NFC tag, and the like.

In addition, the school vehicle occupant management system 10 may determine whether the vehicle is operated according to the operation schedule based on the location and operation time of the vehicle, and may transmit the information to a person in charge or a passenger.

In addition, the commuter vehicle occupant management system 10 confirms the location of the boarding site through the operation route inputted in advance, GPS, and a location recognition device, is included in the passenger list, and confirms the location of the mobile phone of the passenger boarding at the boarding location. It is possible to detect whether there is a waiting at the boarding point, and if it is not located at the boarding point, it can automatically send a guide message to wait at the boarding point.

In addition, the school vehicle occupant management system 10 may notify the driver and passengers of personal information of passengers getting on and off at the boarding point when the vehicle arrives at the boarding point.

When the vehicle is imminent or stopped at the boarding site, the passenger management unit 200 may output a disembarkation guide message to the passenger who alights at the corresponding boarding point through the voice output unit 500 .

For example, if it is confirmed through the vehicle location determining unit 600 that the vehicle has stopped at the boarding point A, and the passenger getting off at the boarding point A in the passenger list is 'Hong Gil-dong', the occupant management unit 200 is "Hong Gil-dong's destination" You have arrived. Please get off safely." and control it to be output through the voice output unit 500 . In addition, when it is confirmed through the vehicle location identification unit 600 that the vehicle has settled at the final destination, and there are still passengers who have not gotten off the vehicle, a disembarkation guidance message saying “This is the final destination. All passengers, please get off.” is generated and controlled to be output through the audio output unit 500 .

As described above, according to an embodiment of the present invention, it is possible to prevent the occupant from passing the destination or being left in the vehicle by giving a disembarkation map to the occupant who has arrived at the destination through a voice message according to the artificial intelligence.

7 is a block diagram schematically illustrating a school vehicle occupant management system including an occupant convenience unit in FIG. 1 .

Referring to FIG. 7 , the school vehicle occupant management system 10 includes a passenger convenience unit 700 provided for each vehicle seat in the vehicle, and the occupant management unit 200 determines the indoor location of the passenger and the identity of the passenger, The passenger convenience unit 700 may be controlled to provide the passenger with content customized to the identity of the passenger among the contents stored in the database 100 .

The passenger convenience unit 700 may be provided for each vehicle seat in the vehicle to provide customized content, services, and the like to passengers located in each vehicle seat.

For example, the passenger convenience unit 700 includes a display unit that is automatically reproduced in each vehicle seat, and the occupant management unit 200 includes the grade, course, and course course included in the personally identifiable information of the passenger. According to the achievement level, etc., customized content may be automatically provided to the passenger's grade level, course taken, and course achievement level through the display unit. The content may include online lectures, advertisements for recommended products, music, and the like.

In addition, the passenger convenience unit 700 includes a seat height adjustment unit capable of automatically adjusting each vehicle seat, a seat belt position adjustment unit and an airbag position adjustment unit, and the like, and the occupant management unit 200 includes the passenger convenience unit 700 . The seat height, seat belt position, and airbag position can be customized and automatically adjusted according to the physique included in the personally identifiable information of the occupant. That is, the passenger convenience unit 700 may automatically provide an optimized service customized to the identity of the passenger.

As described above, according to an embodiment of the present invention, it is possible to automatically provide content or service optimized for the identity of a passenger located in a vehicle seat using a voice frequency.

8 is a flowchart illustrating a control method of a school vehicle occupant management system according to an embodiment of the present invention, and FIG. 9 is a flowchart illustrating an audio output unit controlled by the occupant management unit in FIG. 8 .

8 and 9 , the control method of the school vehicle occupant management system according to an embodiment of the present invention includes passenger information including first voice frequency information and personal information of a passenger, interior structure information of the vehicle, and vehicle operation The vehicle information including the information is stored in the database (S210).

Then, the voice recognition unit including a plurality of microphones provided in the vehicle collects the second voice frequency information of the occupant (S220).

Then, the occupant manager identifies the identity of the occupant based on the passenger information and the second audio frequency information, and determines the indoor location of the occupant in the vehicle based on the vehicle information and the second audio frequency information (S230).

Here, between the step of storing the passenger information and vehicle information in the database ( S210 ) and the step of collecting the second voice frequency information ( S220 ), the occupant manager asks the occupant a question based on a plurality of dialogue scenarios pre-stored in the database. The voice output unit may be controlled to output a message (S215). That is, it includes a voice output unit for outputting a voice into the vehicle, and the occupant management unit controls the voice output unit to output a question message to the occupant based on a plurality of conversation scenarios pre-stored in the database, and a second response message based on the occupant's response message. The voice recognition unit may be controlled to collect voice frequency information.

The operation process related to the control method of the school vehicle occupant management system has already been described through the operation process of the school vehicle occupant management system, and thus a detailed description thereof will be omitted.

The present invention described above is not limited to the above-described embodiments and the accompanying drawings, and it is in the technical field to which the present invention pertains that various substitutions, modifications and changes are possible without departing from the technical spirit of the present invention. It will be clear to those of ordinary skill in the art.

10: school vehicle occupant management system 20: vehicle
30: terminal device 100: database
200: occupant management unit 300: voice recognition unit
400: communication unit 500: audio output unit
600: vehicle location identification unit 700: passenger convenience unit

Claims (12)

a database for storing passenger information including first voice frequency information and personal information of a passenger, and vehicle information including interior structure information and vehicle operation information of the vehicle;
a voice recognition unit including a plurality of microphones provided in the vehicle and collecting second voice frequency information of the occupant; and
and an occupant manager configured to determine the identity of the occupant based on the passenger information and the second audio frequency information, and determine the indoor location of the occupant in the vehicle based on the vehicle information and the second audio frequency information, ,
The second voice frequency information includes information about the phase difference between the second voice frequencies each collected through the plurality of microphones,
The occupant management unit,
The first position of the occupant is identified based on the phase difference information, and the indoor position of the occupant is determined by matching the first position and the position for each vehicle seat included in the interior structure information to the terminal of the vehicle driver. A school vehicle occupant management system, characterized in that it transmits. According to claim 1,
The occupant management unit,
It is determined whether the first voice frequency information and the second voice frequency information match, and the identity of the occupant is determined based on the personal information matched with the first voice frequency information matching the second voice frequency information school vehicle occupant management system. delete According to claim 1,
The school vehicle occupant management system further comprising a communication unit communicating with a terminal device including at least one of a terminal of the occupant's guardian, a terminal of the commuting institution of the occupant, and a terminal of a manager of the vehicle. 5. The method of claim 4,
The occupant management unit,
A school vehicle occupant management system for transmitting whether the occupant whose identity has been identified and whether the occupant is on board and the indoor location of the occupant is transmitted to the terminal device through the communication unit. 5. The method of claim 4,
The database further stores emergency frequency information,
The occupant management unit,
When the frequency range of the second audio frequency information corresponds to the frequency range of the emergency frequency information, the school vehicle occupant management system transmits the second audio frequency information to the terminal device through the communication unit. According to claim 1,
The occupant management unit,
When the second audio frequency information is collected after the operation end time included in the vehicle operation information, the vehicle operation information and the occupant's boarding are determined according to whether the first audio frequency information and the second audio frequency information match. A school vehicle occupant management system for transmitting at least one of whether or not and the indoor location of the occupant to a terminal device through a communication unit. According to claim 1,
Further comprising a voice output unit for outputting a voice into the vehicle,
The occupant management unit,
Controlling the voice output unit to output a question message to the occupant based on a plurality of conversation scenarios pre-stored in the database, and controlling the voice recognition unit to collect the second voice frequency information based on the occupant's response message School vehicle occupant management system. 9. The method of claim 8,
Further comprising a vehicle location determining unit for detecting the location of the vehicle,
The occupant management unit,
A school vehicle occupant management system for controlling the voice output unit to output a disembarkation guide message to the passengers disembarking at each boarding location based on a list of boarding and disembarking passengers included in the vehicle operation information and the location of the vehicle. According to claim 1,
Further comprising a passenger convenience unit provided for each vehicle seat in the vehicle,
The occupant management unit,
When the indoor location of the occupant and the identity of the occupant are confirmed, the school vehicle occupant management system controls the occupant convenience unit to provide the occupant with customized contents based on the occupant's identity from among the contents stored in the database. In the control method of a school vehicle occupant management system,
Storing, in a database, passenger information including first voice frequency information and personal information of a passenger, and vehicle information including interior structure information and vehicle operation information of the vehicle;
collecting, by a voice recognition unit including a plurality of microphones provided in the vehicle, second voice frequency information of an occupant; and
determining, by an occupant manager, the identity of the occupant based on the passenger information and the second voice frequency information, and determining the indoor location of the occupant in the vehicle based on the vehicle information and the second voice frequency information; including,
The second voice frequency information includes information about the phase difference between the second voice frequencies each collected through the plurality of microphones,
The occupant management unit,
The first position of the occupant is identified based on the phase difference information, and the indoor position of the occupant is determined by matching the first position and the position for each vehicle seat included in the interior structure information to the terminal of the vehicle driver. A control method of a school vehicle occupant management system, characterized in that the transmission. 12. The method of claim 11,
Further comprising a voice output unit for outputting a voice into the vehicle,
The occupant management unit,
Controlling the voice output unit to output a question message to the occupant based on a plurality of conversation scenarios pre-stored in the database, and controlling the voice recognition unit to collect the second voice frequency information based on the occupant's response message A control method for a school vehicle occupant management system.

Images