KR20230090544A - System for obtaining identity information for an object getting on and off of vehicle and the obtaining method thereof - Google Patents

Abstract

According to one embodiment of the present invention, a device for managing getting on and off, which is attached to a means of transportation and obtains information about an object getting on and off, comprising: a first sensor unit attached in an exterior direction of the means of transportation and sensing information on the object from an exterior of the means of transportation, wherein the first sensor unit includes a first sensor for sensing visible light entering the first sensor unit and a second sensor for sensing infrared light entering the first sensor unit; a second sensor unit attached in an interior direction of the means of transportation and sensing information on the object from an interior of the means of transportation, wherein the second sensor unit includes a third sensor for detecting visible light entering the second sensor unit and a fourth sensor for detecting infrared light entering the second sensor unit; a control unit acquiring information sensed by the first sensor unit and the second sensor unit; and a communication unit transmitting information, to a server, about the object acquired by the control unit based on the information sensed by the first sensor unit and the second sensor unit.

Description

System for acquiring identity information on an object when getting on and off a vehicle and method for acquiring the same

The present invention relates to an apparatus for managing getting on and off and a method therefor, and more particularly, to a device for obtaining boarding and alighting information including identification information or body temperature information of a user getting on and off a means of transportation by using a plurality of sensors. and its method.

Recently, while infants remain in the means of transportation even after the operation of the means of transportation has ended, safety problems for infants and young children are emerging.

In addition, due to the recent spread of infectious diseases, the need for continuous body temperature measurement in daily life is on the rise.

In recent years, safety problems have been solved by introducing a safety door system or an alarm bell that allows the door to be easily opened from the inside of the vehicle if the infant remains, but it is difficult to use for infants and toddlers who are not yet sufficiently developed. It was the case. In addition, in order to continuously measure body temperature, a thermal image camera is installed in a specific location such as a kindergarten or school, or the temperature is measured using a thermometer that must be used directly. Body temperature can be measured only after boarding the vehicle. There is still a risk of contagion.

Accordingly, the need for the introduction of a complex technology that solves the problem of staying in the means of transportation of infants and young children and at the same time unifies health management such as temperature measurement is increasing day by day.

An object of the present application is to provide a boarding and disembarking management device capable of managing boarding and alighting information of a vehicle occupant.

In addition, another object of the present application is to unitarily inspect and manage the body temperature of the occupants of the transportation means for health management of the occupants.

According to an embodiment of the present invention, in the boarding and disembarking management device for obtaining information on an object that is attached to a means of transportation and gets on or off, it is attached to an external direction of the means of transportation and is attached to the object from the outside of the means of transportation. A first sensor unit for detecting information about; The first sensor unit includes a first sensor for detecting visible light entering the first sensor unit and a second sensor for detecting infrared light entering the first sensor unit, and is attached to an inner direction of the moving means to perform the movement. a second sensor unit sensing information about the object inside the means; The second sensor unit includes a third sensor for detecting visible light entering the second sensor unit and a fourth sensor for detecting infrared light entering the second sensor unit, and a control unit that obtains sensed information; and a communication unit configured to transmit information about the object obtained based on information sensed by the first sensor unit and the second sensor unit by the control unit to a server. Including, getting on and off management device may be provided.

According to the embodiments of the present application, it is possible to identify a passenger through a personal identification method of a passenger of a means of transportation and collectively manage boarding and alighting information.

In addition, according to the embodiments of the present application, by measuring the body temperature of a vehicle occupant through a thermal sensor, the body temperature information of the vehicle occupant can be collectively managed.

In addition, according to the embodiments of the present application, it is possible to electronically manage whether or not the occupant of the means of transportation is present.

1 is a schematic diagram illustrating a getting on and off management device according to an embodiment.
2 is a view showing that a sensor unit is attached to the outside of a moving means according to an embodiment.
3 is a cross-sectional view showing that a sensor unit is attached to the inside of a moving means according to an embodiment.
4 is a block diagram illustrating a method in which a controller or a server obtains boarding information for an object, according to an exemplary embodiment.
5 is a block diagram illustrating a method in which a control unit or a server obtains alighting information for an object according to an exemplary embodiment.

The foregoing objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. However, the present invention can apply various changes and can have various embodiments. Hereinafter, specific embodiments will be illustrated in the drawings and described in detail.

In the drawings, the thickness of layers and regions is exaggerated for clarity, and elements or layers may be "on" or "on" other elements or layers. What is referred to includes all cases where another layer or other component is intervened in the middle as well as immediately above another component or layer. Like reference numerals designate essentially like elements throughout the specification. In addition, components having the same function within the scope of the same idea appearing in the drawings of each embodiment are described using the same reference numerals.

If it is determined that a detailed description of a known function or configuration related to the present invention may unnecessarily obscure the subject matter of the present invention, the detailed description will be omitted. In addition, numbers (eg, first, second, etc.) used in the description process of this specification are only identifiers for distinguishing one component from another component.

In addition, the suffixes "module" and "unit" for the components used in the following description are given or used together in consideration of ease of writing the specification, and do not have meanings or roles that are distinguished from each other by themselves.

According to an embodiment of the present invention, in the boarding and disembarking management device for obtaining information on an object that is attached to a means of transportation and gets on or off, it is attached to an external direction of the means of transportation and is attached to the object from the outside of the means of transportation. A first sensor unit for detecting information about; The first sensor unit includes a first sensor for detecting visible light entering the first sensor unit and a second sensor for detecting infrared light entering the first sensor unit, and is attached to an inner direction of the moving means to perform the movement. a second sensor unit sensing information about the object inside the means; The second sensor unit includes a third sensor for detecting visible light entering the second sensor unit and a fourth sensor for detecting infrared light entering the second sensor unit, and a control unit that obtains sensed information; and a communication unit configured to transmit information about the object obtained based on information sensed by the first sensor unit and the second sensor unit by the control unit to a server. Including, getting on and off management device may be provided.

According to another embodiment, the control unit operates the first sensor when boundary information about the object among the information sensed by the second sensor becomes greater after a predetermined time, and the control unit detects the detection from the first sensor. Among the received information, facial recognition is performed on the object to obtain identification information on the object, and after the control unit acquires the identification information on the object based on the information detected by the first sensor, the fourth Obtaining riding information on the object when information on the object is obtained from a sensor, wherein the riding information includes the identification information and temperature information of the object obtained from the second sensor.

A getting on and off management device may be provided.

According to another embodiment, the controller operates the third sensor when boundary information about the object among the information sensed by the fourth sensor becomes greater after a predetermined time, and the controller detects the information from the third sensor. Among the detected information, facial recognition is performed on the object to obtain the identity information on the object, and the control unit acquires the identity information on the object based on the information detected by the third sensor, and then the second When information on the object is obtained from a sensor, getting off information on the object is obtained, and the getting off information includes the identification information and temperature information of the object obtained from the fourth sensor. It can be.

According to another embodiment, the identification information includes contactable terminal information, and the control unit transmits at least one of the boarding information and the getting off information as the contactable terminal information through the communication unit or the server. A management device may be provided.

According to another embodiment, when the boarding information of the object is obtained but the getting off information is not obtained, the control unit transmits that there is no getting off information as the contactable terminal information through the communication unit or the server. A device may be provided.

According to another embodiment, the identification information includes contactable terminal information, and the control unit, when the boundary information for the object is obtained from among the information sensed by the fourth sensor after the operation of the means of transportation is terminated, , A boarding and disembarking management device may be provided that transmits a notification to the contactable terminal information through the communication unit or the server.

According to another embodiment, when the means of transportation travels back and forth from a first destination to a second destination, and the control unit acquires the boarding information at the first destination and obtains the getting off information at the second destination, When school arrival information is transmitted to the server through the communication unit, and the controller obtains the boarding information at the second destination and the getting off information at the first destination, dismissal information is transmitted to the server through the communication unit. A boarding and disembarking management device that transmits may be provided.

According to another embodiment, the identification information includes contactable terminal information, and the control unit transmits the school attendance information and the dismissal information as the contactable terminal information through the communication unit or the server. It can be.

According to another embodiment, in the method for managing getting on and off the object through a boarding and disembarking management device for obtaining information on an object attached to a moving means and getting on or off the object, a first object attached to the outer direction of the moving means is provided. 1 detecting information about the object from the outside of the moving means by a sensor unit; The first sensor unit includes a first sensor for detecting visible light entering the first sensor unit and a second sensor for detecting infrared light entering the first sensor unit, and is attached to the inner direction of the moving means. detecting, by a sensor, information about the object inside the moving means; The second sensor unit includes a third sensor for detecting visible light entering the second sensor unit and a fourth sensor for detecting infrared light entering the second sensor unit, and a control unit includes the first sensor unit and the second sensor. obtaining sensed information from the unit; and transmitting, by a communication unit, information about the object obtained on the basis of information detected by the first sensor unit and the second sensor unit in the control unit to a server. The controller operates the first sensor when boundary information about the object among the information detected by the second sensor becomes greater after a predetermined time, and the controller operates the information detected by the first sensor. facial recognition is performed on the object to obtain identification information about the object, and the control unit acquires the identification information about the object based on the information detected by the first sensor, and then, from the fourth sensor When the information on the object is acquired, ride information on the object is obtained, the ride information includes the identity information and temperature information of the object obtained from the second sensor, and the control unit is configured to obtain ride information on the fourth sensor. When the boundary information on the object among the information sensed from the above becomes larger after a predetermined time, the third sensor is operated, and the control unit performs face recognition on the object among the information sensed by the third sensor, The identification information of the object is obtained, and the control unit obtains the identification information of the object based on the information sensed by the third sensor, and when the information about the object is obtained from the second sensor, the object Obtaining getting off information for , wherein the getting off information includes the identification information and temperature information of the object obtained from the fourth sensor.

The present invention relates to an apparatus and method for detecting getting on and off in a moving means using a sensor.

Here, the means of transportation may include school vehicles, commuter vehicles, commuter trains, etc., but is not limited thereto, and all means of transportation that regularly operate toward a specific destination may be included. For example, in the case of a school vehicle, it may refer to a vehicle that is regularly operated for the attendance and departure of students or graduate students, such as kindergartens, schools, and academies.

Also, the sensor may be a device that detects electromagnetic waves, sound waves, or ultrasonic waves. That is, the sensor may be a device that detects visible light or infrared rays included in electromagnetic waves. The sensor is described in more detail in the relevant sections below.

Hereinafter, the getting on/off management device 1 will be described.

1 is a schematic diagram showing a getting on and off management device 1 according to an embodiment.

Referring to FIG. 1 , the getting on and off management device 1 may include a control unit 10, a communication unit 20 and a sensor unit 30, and the getting on and off management device 1 communicates with a server 40 by wire or wirelessly. can be connected

Here, the sensor unit 30 may be composed of a plurality of sensor units 30 . For example, the sensor unit 30 may include a first sensor unit 32 attached to the outside of the moving means and a second sensor unit 34 attached to the inside of the moving means.

At this time, the first sensor unit 32 is attached to the outside of the means of transportation and can detect information about an object in the direction outside of the means of transportation, and the second sensor unit 34 is attached to the inside of the means of transportation to Information about an object can be sensed in an inward direction. Attached here may mean a state of being physically coupled to a means of transportation.

In this case, the object may be a user using a means of transportation.

Here, the first sensor unit 32 and the second sensor unit 34 may have the same function as each other. That is, information that can be detected by the first sensor unit 32 and information that can be detected by the second sensor unit 34 may be the same.

More specifically, the first sensor unit 32 and the second sensor unit 34 may include a plurality of sensors. Here, the plurality of sensors may be configured as sensors for detecting waves flowing into the sensor unit 30 .

For example, some of the plurality of sensors constituting the first sensor unit 32 and the second sensor unit 34 may be sensors for detecting visible light. That is, some of the plurality of sensors may be sensors for obtaining images in the visible light wavelength range. At this time, the control unit 10 may obtain RGB information and acquisition location information of the RGB information from the corresponding sensor, and the controller 10 may obtain image information based on the corresponding RGB information and acquisition location information of the RGB information. In other words, the controller 10 may obtain image information based on information sensed from a corresponding sensor.

For another example, some of the plurality of sensors constituting the first sensor unit 32 and the second sensor unit 34 may be sensors for detecting infrared rays. That is, some of the plurality of sensors may be sensors for obtaining an image of an infrared wavelength range. At this time, the controller 10 may obtain infrared wavelength information and acquisition position information of the infrared wavelength information from the corresponding sensor, and the controller 10 may obtain thermal image information based on the infrared wavelength information and acquisition position information of the infrared wavelength information. can be obtained In other words, the controller 10 may obtain thermal image information based on information sensed by a corresponding sensor.

Hereinafter, for convenience of explanation, among the sensors included in the first sensor unit 32, a sensor that detects visible light is referred to as a first sensor, a sensor that detects infrared rays is referred to as a second sensor, and the second sensor unit 34 Among the sensors included in ), a sensor for detecting visible light is referred to as a third sensor, and a sensor for detecting infrared rays is referred to as a fourth sensor.

For another example, some of the plurality of sensors constituting the first sensor unit 32 and the second sensor unit 34 may be sensors for detecting ultrasonic waves. That is, some of the plurality of sensors may be ultrasonic sensors. At this time, the getting on and off management device 1 may further include an ultrasonic generator in addition to the sensor unit 30 .

For another example, some of the plurality of sensors constituting the first sensor unit 32 and the second sensor unit 34 may be sensors for detecting electromagnetic waves used for short-range communication such as Bluetooth, zigbee, or z-wave. can That is, some of the plurality of sensors may detect the electromagnetic waves generated by the short-range communication means and the strength of the electromagnetic waves. Accordingly, the controller 10 may obtain electromagnetic wave information or electromagnetic wave strength information from some of the plurality of sensors, and the controller 10 may obtain distance information or information about distances from the plurality of sensors to an object based on the electromagnetic wave information and electromagnetic wave strength information. Personal identification information, etc. may be obtained.

However, it is not limited to the examples presented above, and some of the plurality of sensors constituting the first sensor unit 32 and the second sensor unit 34 may be sensors using sound wave and ultraviolet information.

Here, the control unit 10 may obtain information detected by the sensor unit 30 and may obtain a plurality of pieces of information based on the information detected by the sensor unit 30 .

In this case, the plurality of pieces of information may include image information, thermal image information, personal identification information, or distance information acquired by the control unit 10 based on information sensed by the sensor unit 30 obtained from the sensor unit 30. there is.

In addition, the controller 10 may obtain identification information about an object through an object identification method including face recognition based on the obtained image information. Here, the identity information may include contents related to the object's personal information, such as the object's name, age, and affiliation information, and information on a mobile communication terminal possessed by the object or a contactable terminal possessed by the object's family and acquaintances. information may be included. In this case, the terminal information may include information on a phone number through which the terminal can be contacted.

At this time, the identity information may be pre-stored in the control unit 10, and the control unit 10 may obtain identity information of the object through comparison with pre-stored identity information based on the obtained image information. .

Also, the controller 10 may obtain boundary information of an object so as to determine an object within a thermal image based on the acquired thermal image information. Here, the boundary information may be information formed along an area occupied by an object or an area occupied by an object in a thermal image. That is, the controller 10 may obtain information about a location and a range of an object in the thermal image information.

At this time, acquiring boundary information of the object so that the controller 10 can determine the object in the thermal image based on the obtained thermal image information is to determine the color value or intensity value of the thermal image in the obtained thermal image. When the values obtained for pixels are not continuous, it may mean that the boundary values of the non-continuous pixels are obtained as boundary information. For example, if the ambient temperature in the thermal image is 25 degrees and the color obtained for the pixel in the thermal image is blue, and the temperature of the object is 37 degrees and the color obtained for the pixel in the thermal image is orange, the orange color occupies Boundary information may be obtained along the perimeter of the area or the area occupied by the orange color.

That is, boundary information may be obtained through a software algorithm previously stored in the controller 10 or a boundary information acquisition model using artificial intelligence.

Also, the controller 10 may obtain temperature information of the object based on the obtained thermal image information. Here, the temperature information may include information about the body temperature of the object according to thermal image information. At this time, the body temperature may be expressed in a temperature display method commonly used to indicate the body temperature, such as Celsius, Fahrenheit, and absolute temperature.

In addition, the controller 10 may obtain personal identification information and distance information of the object when the object possesses a device used for short-range communication and the sensor unit 30 includes an electromagnetic wave detection sensor. Here, the personal identification information may be the same as or included in the identification information previously obtained by the control unit 10 based on the image information. Also, the controller 10 may obtain information about whether the object is approaching the means of movement based on the distance information acquired by the controller 10 .

Here, the control unit 10 may control the communication unit 20 to transmit information acquired by the control unit 10 to the server 40 through the communication unit 20 .

Here, the communication unit 20 may be connected to enable data exchange with the server 40 . That is, the communication unit 20 may be connected to the server 40 by wire or wirelessly.

Here, the server 40 may be a server 40 of a mobile communication company or may mean a separate server 40 for processing and storing calculations.

At this time, when the server 40 transmits the information acquired by the control unit 10 through the sensor unit 30 to the server 40 through the communication unit 20, the control unit 10 transmits the sensor unit 10 to the sensor unit 30. Information obtained based on information obtained through the unit 30 may be obtained identically. In other words, the server 40 may perform the same operation as the control unit 10 .

2 is a view showing that the sensor unit 30 is attached to the outside of a moving means according to an embodiment.

Referring to FIG. 2 , the first sensor unit 32 of the sensor units 30 is attached near a door through which a means of transportation can enter and exit, and can sense an external situation.

Here, the reason why the first sensor unit 32 is attached near the door through which the means of transportation is accessible is that the control unit 10 obtains information about the object based on the sensing information obtained from the first sensor unit 32. This may mean that the first sensor unit 32 is attached within an appropriate distance range.

3 is a cross-sectional view showing that the sensor unit 30 is attached to the inside of a moving means according to an embodiment.

Referring to FIG. 3 , among the sensor units 30, the second sensor unit 34 is attached near a door through which the means of transportation can enter and exit, and can sense the situation inside the means of transportation.

Here, the reason why the second sensor unit 34 is attached near the door through which the means of transportation is accessible is that the control unit 10 obtains information about the object based on the sensing information obtained from the second sensor unit 34. This may mean that the second sensor unit 34 is attached within an appropriate distance range.

2 and 3, the first sensor unit 32 and the second sensor unit 34 may be attached to the outside and inside of the moving means, and a plurality of first sensor units (not just a single one) 32) and the second sensor unit 34 may be attached to the outside and inside of the moving means.

In addition, the second sensor unit 34 may be attached to a plurality of arbitrary positions inside the moving means as well as near a door through which the moving means can enter and exit.

4 is a block diagram illustrating a method in which the control unit 10 or the server 40 acquires riding information about an object, according to an exemplary embodiment.

Referring to FIG. 4 , the method in which the control unit 10 or the server 40 obtains riding information about an object includes increasing the size of the object boundary detected by the first sensor unit 32 (S1000), The operation of the first sensor of the first sensor unit 32 (S1200), the operation of the second sensor unit 34 recognizing an object (S1400), and the obtaining of riding information (S1600) may be included.

The step of increasing the size of the object boundary detected by the first sensor unit 32 (S1000) is a thermal image acquired by the controller 10 or the server 40 from the second sensor included in the first sensor unit 32. Among the information, boundary information about an object may include increasing in a thermal image. In other words, the increase in the boundary information of an object means that the area of the object in the thermal imaging image acquired at the first time point corresponds to the object in the thermal imaging image acquired at the second time point when a predetermined time elapses from the first time point. It can mean smaller than the area for . That is, it may mean that the area of the object in the thermal image acquired at the second viewpoint is larger than the area of the object in the thermal image obtained at the first viewpoint.

According to an embodiment, the control unit 10 or the server 40 may obtain distance change information of an object for a predetermined time by using a distance sensor included in the first sensor unit 32, Velocity information of the object may be obtained through the distance change information of the object. Accordingly, the controller 10 or the server 40 may determine whether or not the object intends to board the means of transportation based on whether the object is approaching the means of transportation and the speed at which it approaches the means of transportation.

According to another embodiment, the control unit 10 or the server 40 may obtain size information of an object based on the amount of change in the area occupied by the speed information obtained in the previous embodiment and the boundary information of the object in the thermal image. . Accordingly, the controller 10 or the server 40 may identify whether the size information of the object is equal to or less than a predetermined size, and as a result of the identification, determine whether the object is a person. For example, the control unit 10 or the server 40 may not proceed with the decision to board the vehicle when the size of the object is less than or equal to a preset size. As a specific example, when the object approaching the means of transportation is an animal such as a dog, the controller 10 or the server 40 determines the size information of the object, determines that the means of transportation will not proceed with boarding, and determines subsequent boarding and The ride management method may not be performed.

An increase in boundary information of an object in the thermal image may occur when the object approaches the first sensor unit 32 attached to the outside of the moving means. That is, when boundary information of an object increases in the thermal image, it may mean that distance information of the object approaches the first sensor unit 32 attached to the moving means. Alternatively, a decrease in boundary information of an object in thermal image information may mean that distance information of an object moves away from the first sensor unit 32 attached to the moving means.

In operation of the first sensor of the first sensor unit 32 (S1200), when the boundary information of the object in the thermal image obtained based on the information detected by the second sensor increases, the corresponding object is located in the moving means. In order to prepare for boarding, a step of acquiring identification information about the object may be included. That is, when an object approaches by means of movement, the controller 10 or the server 40 uses image information acquired based on detection information obtained from the first sensor to perform object identification through an object identification method such as facial recognition of the object. It is possible to obtain identity information about.

According to an embodiment, the size information of the object acquired by the controller 10 or the server 40 is identified as greater than or equal to a preset size, and the speed information of the object approaching the moving means is within a preset range (exceeds the preset range). If it is detected as not identified as a person) and the boundary information of the object in the thermal image information acquired through the second sensor is greater than a predetermined level (if the boundary information is less than or equal to a predetermined level, the identification information is transmitted through the first sensor). is difficult to secure), the first sensor may operate to obtain identification information.

Here, when the boundary information of the object increases to a predetermined level or higher, it may mean that the control unit 10 or the server 40 is close enough to the first sensor unit to obtain identification information on the object through the first sensor. there is. That is, based on the image obtained through the first sensor, an image sufficient for the controller to perform the object identification method may be acquired. Through the above embodiment, there is an effect that identification information can be checked only for objects clearly identified as being human among numerous objects actually detected by the thermal imaging camera.

Specifically, the first sensor may be driven to obtain identification information about an object when a score according to the following equation is greater than or equal to a preset score S.

At this time, the S value may be obtained by the equation below.

Each of W1, W2, and W3 is a weight value and may be preset.

In this case, 1 < W1, W2, W3 < 2, and 3 < W1 + W2 + W3 < 6.

Further, OT > OT1, where OT (Object Territory) is a size value sensed for an object, and OT1 is a preset size value, which may be, for example, 750 cm ² .

Also, if V<V1, in this case, V (Velocity) is a sensed speed value of the object, and V1 is a preset speed value, which may be, for example, 30 km/h.

Further, LT > LT1, in this case, LT (Line Territory) is a size value of boundary information detected for an object, and LT1 is a preset size value, which may be, for example, 500 cm ² .

According to an embodiment of the present invention, the first sensor may operate when the S value is greater than or equal to S1 to obtain identity information of the object. In this case, 3 < S1 < 6 may be 4, but is not limited thereto.

According to this embodiment, the user of the first sensor prevents the first sensor from operating even if the size value detected with respect to the object, the detected speed value, and the size value of the boundary information detected with respect to the object all exceed the reference value. Values of the first to third weights W1 to W3 may be adjusted.

By adjusting the weight value and the S1 value as described above, there is an effect that object identification information can be set so that object identity information can be obtained by selecting a value that can be reflected relatively insensitively among OT, V, and LT values according to actual sensor use.

According to one embodiment of the present invention, the server 40 may receive information on the first to third weight values and the S1 value from the plurality of rising and falling hazard management devices 1, and the most frequent values for the received values may be obtained and transmitted to the plurality of getting on and off management devices 1.

The getting on/off management device 1 without user settings for the weight value and the S1 value may automatically apply the most frequent values received from the server 40 as the first to third weight values and the S1 value, respectively.

The step of detecting an object by the second sensor unit 34 (S1400) may include a step of detecting infrared information about the object by a fourth sensor included in the second sensor unit 34, and furthermore, the controller (10) or the server 40 may further include acquiring boundary information about the object in the thermal image based on the obtained infrared information about the object.

That is, when information about an object is detected by the fourth sensor after a predetermined time elapses after identification information about the object is obtained based on the information sensed by the first sensor, the object moves from the outside to the inside of the means of transportation. It can mean riding with .

For example, the predetermined time after the identification information is obtained may mean the time for the second sensor unit to detect an object within a range of 4 to 6 seconds. That is, when the vehicle is approached and the vehicle is not taken, the second sensor unit cannot detect an object inside the vehicle, so the controller 10 or the server 40 detects the second sensor unit within 4 to 6 seconds. If the object is not detected, the ride information determination may not be performed.

In step S1600 of obtaining boarding information, when the object has boarded inside the means of transportation, the control unit 10 or the server 40 obtains comprehensive information about the object, such as identification information, temperature information, or boarding time information of the object. Acquisition steps may be included.

That is, the riding information includes identification information obtained based on a detection result obtained from the first sensor, and temperature of the object obtained based on a detection result obtained from the second sensor or the fourth sensor for the object riding the vehicle. Information and boarding time information, which is information about the time the object boarded the vehicle, may be included.

5 is a block diagram illustrating a method in which the control unit 10 or the server 40 acquires getting off information for an object, according to an exemplary embodiment.

Referring to FIG. 5 , the method in which the control unit 10 or the server 40 obtains the getting off information for the object includes increasing the size of the object boundary detected by the second sensor unit 34 (S2000), The operation of the third sensor of the second sensor unit 34 (S2200), the operation of the first sensor unit 32 detecting an object (S2400), and the obtaining of getting off information (S2600) may be included.

In the step of increasing the size of the object boundary detected by the second sensor unit 34 (S2000), the thermal image acquired by the controller 10 or the server 40 from the fourth sensor included in the second sensor unit 34 Among the information, boundary information about an object may include increasing in a thermal image. As described above, an increase in the boundary information of an object within the thermal image information may mean that the object is approaching the second sensor unit 34 located near a door accessible to the inside of the moving means.

According to an embodiment, the control unit 10 or the server 40 may obtain distance change information of an object for a predetermined time period by using a distance sensor included in the second sensor unit 34, Velocity information of the object may be obtained through the distance change information of the object. Accordingly, the controller 10 or the server 40 determines whether the object is approaching the second sensor unit 34 and whether or not to get off the vehicle based on the speed approaching the second sensor unit 34. can

According to another embodiment, the control unit 10 or the server 40 may obtain size information of an object using at least one of the speed information obtained in the previous embodiment or boundary information of the object. Accordingly, the controller 10 or the server 40 may determine whether the object is a person by using the size information of the object, and if the size of the object is smaller than that of a person, the decision to get off the vehicle may not be performed. can

In the operation of the third sensor of the second sensor unit 34 (S2200), when the boundary information of the object in the thermal image obtained based on the information sensed by the fourth sensor increases, the corresponding object is removed from the moving means. In order to prepare for getting off, a step of acquiring identification information about the object may be included.

That is, when an object approaches an accessible door inside a means of transportation, the control unit 10 or the server 40 uses image information obtained based on detection information obtained from the third sensor to perform facial recognition of the object. Identity information on an object may be obtained through an identification method.

According to an embodiment, the size information of the object acquired by the controller 10 or the server 40 is recognized as a person, and the object gets off the moving means based on the speed information of the object approaching the second sensor unit 34. When it is determined that the object is to be performed, the third sensor may be operated according to an increase in boundary information of an object in thermal image information obtained through the fourth sensor to a predetermined level or higher.

Here, the fact that the boundary information of the object increases to a predetermined level or more means that the control unit 10 or the server 40 is close enough to the second sensor unit 34 to obtain identification information about the object through the third sensor. can mean That is, an image sufficient for the control unit to perform the object identification method may be acquired based on the image acquired through the third sensor.

The step of detecting an object by the first sensor unit 32 (S2400) may include a step of detecting infrared information about the object by a second sensor included in the first sensor unit 32, and furthermore, the control unit (10) or the server 40 may further include acquiring boundary information about the object in the thermal image based on the obtained infrared information about the object.

For example, when information about an object is detected by the second sensor after a predetermined time has elapsed since identification information about the object was obtained based on information detected by the third sensor, the object is detected inside the means of transportation. It can mean getting off to the outside from.

According to another embodiment, information about an object is sensed by the second sensor after a predetermined time has elapsed since identification information about the object was obtained based on information sensed by the third sensor, and the second sensor detects information about the object. If the boundary information of the object in the thermal image obtained on the basis becomes small, it may mean that the object has completely got off the moving means.

Acquisition of getting off information (S2600) may include obtaining comprehensive information including at least one of identification information, temperature information, and getting off time information of an object, like the step of obtaining boarding information described above. there is.

That is, the getting off information includes the identification information obtained based on the detection result obtained from the third sensor, the temperature of the object obtained based on the detection result obtained from the second sensor or the fourth sensor, with respect to the object getting off the means of transportation. Information and information about the time when the object gets off the means of transportation may be included.

According to an embodiment, the boarding information or getting off information obtained by the controller 10 or the server 40 may be transmitted as contactable terminal information included in the identity information of the object through the communication unit 20 or the server 40. there is.

Accordingly, a user possessing a contactable terminal can receive and check information on boarding and alighting of an object.

Also, according to an embodiment, when boarding information of an object is obtained but alighting information is not acquired, the control unit 10 or the server 40 includes information about the object remaining in the means of transportation in the identification information of the object. The contactable terminal information may be transmitted through the communication unit 20 or the server 40.

According to another embodiment, when boundary information about an object is detected by the fourth sensor included in the second sensor unit 34 even though the operation of the means of transportation on which the object rides has ended, the control unit 10 or the server 40 ) is contactable terminal information included in the identity information of the object, and may transmit information indicating that the object remains in the means of transportation through the communication unit 20 or the server 40.

Also, according to an embodiment, an electronic attendance system may be constructed based on the getting on and off management device 1 .

Specifically, when the means of transportation is a means of transportation that travels back and forth from a first destination to a second destination, the controller 10 or the server 40 obtains boarding information of an object at the first destination and provides information about getting off at the second destination. In this case, the control unit 10 or the server 40 may obtain information indicating that the object is present, and when obtaining boarding information of the object at the second destination and getting off information at the first destination, the object has a schedule. It is possible to obtain information that it has been terminated.

For example, when the first destination is near the object's home and the second destination is a school, the controller 10 or the server 40 obtains boarding information of the object at the first destination and provides alighting information at the second destination. If the information is obtained, school attendance information may be obtained as a result of attendance at school, and when boarding information is obtained at the second destination and alighting information is acquired at the first destination, dismissal information may be obtained as a school schedule ending.

In addition, the attendance information and schedule end information obtained by the controller 10 or the server 40 may be transmitted along with boarding information and alighting information as contactable terminal information included in object identification information.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program commands recorded on the medium may be specially designed and configured for the embodiment or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with limited examples and drawings, those skilled in the art can make various modifications and variations from the above description. For example, the described techniques may be performed in an order different from the method described, and/or components of the described system, structure, device, circuit, etc. may be combined or combined in a different form than the method described, or other components may be used. Or even if it is replaced or substituted by equivalents, appropriate results can be achieved.

Therefore, other implementations, other embodiments, and equivalents of the claims are within the scope of the following claims.

control unit 10 communication unit 20
sensor unit 30 server 40

Claims (8)

A boarding and disembarking management device for obtaining information on an object that is attached to a means of transportation and gets on or off,
a first sensor unit attached to an external direction of the moving means to sense information about the object from the outside of the moving means;
The first sensor unit includes a first sensor for detecting visible light entering the first sensor unit and a second sensor for detecting infrared light entering the first sensor unit,
a second sensor unit attached to an inner direction of the moving means to sense information about the object inside the moving means;
The second sensor unit includes a third sensor for detecting visible light entering the second sensor unit and a fourth sensor for detecting infrared rays entering the second sensor unit,
a controller that obtains information sensed by the first sensor unit and the second sensor unit; and
a communication unit configured to transmit information about the object obtained based on information sensed by the first sensor unit and the second sensor unit by the control unit to a server; including,
Boarding and disembarking management device.
According to claim 1,
The control unit operates the first sensor when boundary information about the object among the information sensed by the second sensor becomes greater after a predetermined time,
The control unit acquires identification information about the object by performing facial recognition on the object among the information sensed by the first sensor,
The control unit acquires riding information about the object when information about the object is obtained from the fourth sensor after the identification information about the object is obtained based on the information sensed by the first sensor;
The riding information includes the identification information and temperature information of the object obtained from the second sensor.
Boarding and disembarking management device.
According to claim 2,
The control unit operates the third sensor when boundary information about the object among the information sensed by the fourth sensor becomes greater after a predetermined time,
The control unit obtains the identity information of the object by performing facial recognition on the object among the information sensed by the third sensor,
The control unit obtains alighting information for the object when information on the object is obtained from the second sensor after obtaining the identification information on the object based on the information sensed by the third sensor,
The getting off information includes the identity information and temperature information of the object obtained from the fourth sensor.
Boarding and disembarking management device.
According to claim 3,
The identity information includes contactable terminal information,
The control unit transmits at least one of the boarding information and the getting off information as the contactable terminal information through the communication unit or the server.
Boarding and disembarking management device.
According to claim 4,
The control unit transmits that there is no getting off information as the contactable terminal information through the communication unit or the server when the boarding information of the object is obtained but the getting off information is not obtained.
Boarding and disembarking management device.
According to claim 3,
The identity information includes contactable terminal information,
The control unit transmits a notification to the contactable terminal information through the communication unit or the server when the boundary information for the object is obtained among the information detected by the fourth sensor after the operation of the means of transportation is terminated. ,
Boarding and disembarking management device.
According to claim 3,
The means of transportation travels back and forth from a first destination to a second destination,
When the controller acquires the boarding information at the first destination and the getting off information at the second destination, transmits school attendance information to the server through the communication unit;
The control unit obtains the boarding information at the second destination and transmits dismissal information to the server through the communication unit when obtaining the getting off information at the first destination.
Boarding and disembarking management device.
According to claim 7,
The identity information includes contactable terminal information,
The control unit transmits the school attendance information and the dismissal information as the contactable terminal information through the communication unit or the server.
Boarding and disembarking management device.

Images