KR102290376B1 - Occupant safety and convenience system using Control logic - Google Patents

Abstract

The present invention relates to a passenger safety and convenience system using control decision logic. An aspect of the present invention provides a method for controlling passenger safety using a decision logic, comprising: a first step of generating an emergency in an autonomous vehicle; a second step of transmitting, by the autonomous vehicle, the emergency situation to a control system; a third step of confirming, by the control system, the emergency situation that has occurred using the autonomous vehicle; a fourth step of extracting, by the control system, a corresponding emergency situation from among emergency situations stored in advance based on information collected from the autonomous vehicle; a fifth step of determining at least one scenario corresponding to the extracted emergency situation among accident countermeasure scenarios stored in advance by the control system; a sixth step of transmitting, by the control system, the determined scenario to the autonomous vehicle; a seventh step of controlling, by the autonomous vehicle, at least one of a vehicle speed, a destination, and opening/closing of a vehicle door according to the received scenario; an eighth step of transmitting, by the control system, information on the extracted emergency situation to a preset related organization; a ninth step of receiving, by the autonomous vehicle, scheduling information from the preset related organization; and a tenth step of driving the autonomous vehicle according to the scheduling information.

Description

Passenger safety and convenience system using control decision logic {Occupant safety and convenience system using Control logic}

The present invention relates to a passenger safety and convenience system using control decision logic.

Since autonomous public transportation vehicles are operated by unmanned or automatic operation, real-time vehicle status information is transmitted to the SCC (Smart Control Center) through smart control (SCC), wired and V2X wireless networks, and control information is transmitted to the vehicle. are doing

If an emergency situation (for example, if there is a molestation among passengers) occurs while the driver or other operator in the vehicle is not on board, such as self-driving public transportation There are problems that need to be addressed, and solutions are required.

In addition, when the autonomous vehicle is a bus, conventional bus information services can help with bus routes and bus arrival information, but it is possible to check status information such as congestion inside the bus, in particular, information about remaining seats at the previous bus stop. Because users have to get on the bus only with information on the estimated arrival time of the bus they want to board, the elderly, the disabled, pregnant women, parents with infants, etc. There was a problem that it was inconvenient because I did not know if a person was riding.

Accordingly, there is an increasing demand for a system and method capable of solving these problems.

(1) Korean Intellectual Property Office Application No. 10-2016-0054121 (2) Korean Intellectual Property Office Registration No. 10-1610544

An object of the present invention is to provide a passenger safety and convenience system using control decision logic to a user.

The present invention simplifies the system by transmitting the indoor situation information of the autonomous driving vehicle to the control system and delivering passenger safety information using the judgment logic system in the control, providing a method for situations in which the autonomous driving vehicle itself is difficult to determine, We would like to propose a system and method for promoting the safety and convenience of passengers in a vehicle.

Specifically, in the system according to the present invention, using the customer's mobile device, after installing the app in the mobile device in advance, press the button, and transmit the photo, video, and voice through the mobile device, and then the vehicle by the emergency signal in the control After confirming the information (location, amount), the video installed in the vehicle is checked once more, and the voice/video based on the collected emergency data can provide a method of analyzing the situation and providing a countermeasure using a pattern recognition algorithm. .

In addition, in the system according to the present invention, an emergency button in the autonomous vehicle is installed for each seat, and a reporting method using the emergency button can be proposed.

Additionally, the present invention is to provide a bus ride information providing system and method that can improve the convenience of users using public transportation in addition to emergency situations.

Specifically, in the present invention, a sensor and a camera inside a bus can sense the remaining seats, images, identification information, location information, etc., and provide and display it at a stop.

That is, the bus ride information providing system according to the present invention is a vehicle terminal that generates bus internal information including at least one of remaining seat information and image information of the bus, and generates bus riding information based on the bus internal information, An object of the present invention is to provide a central control server that provides the bus ride information to a bus stop on a route, and a bus stop terminal installed at the bus stop and displaying bus ride information for at least one bus arriving for each route.

On the other hand, the technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned are clearly to those of ordinary skill in the art to which the present invention belongs from the description below. can be understood

In order to achieve the above technical problem, a method for controlling passenger safety using decision logic, which is an aspect of the present invention, includes: a first step in which an emergency situation occurs in an autonomous vehicle; a second step of transmitting, by the autonomous vehicle, the emergency situation to a control system; a third step of confirming, by the control system, the emergency situation that has occurred using the autonomous vehicle; a fourth step of extracting, by the control system, a corresponding emergency situation from among emergency situations stored in advance based on information collected from the autonomous vehicle; a fifth step of determining at least one scenario corresponding to the extracted emergency situation among accident countermeasure scenarios stored in advance by the control system; a sixth step of transmitting, by the control system, the determined scenario to the autonomous vehicle; a seventh step of controlling, by the autonomous vehicle, at least one of a vehicle speed, a destination, and opening/closing of a vehicle door according to the received scenario; an eighth step of transmitting, by the control system, information on the extracted emergency situation to a preset related organization; a ninth step of receiving, by the autonomous vehicle, scheduling information from the preset related organization; and a tenth step of driving the autonomous vehicle according to the scheduling information.

In addition, between the first step and the second step, the step of executing an application associated with the control system on a mobile device in the autonomous vehicle; and acquiring at least one of an image, video, text and sound through the mobile device; further comprising, in the third step, the emergency situation using at least one of the image, video, text and sound can be checked

In addition, between the first step and the second step, the step of pushing at least one emergency button in the autonomous vehicle; further comprising, in the third step, based on the pushed at least one emergency button You can check the emergency situation.

In addition, the eleventh step of collecting image information obtained by photographing the state information of the inside of the bus by the vehicle terminal in the autonomous vehicle, and detecting whether or not seats are used to determine remaining seat information; a twelfth step of generating, by a central control server, bus arrival information including the arrival information of the bus in the received image information and remaining seat information, and transmitting the bus ride information to a bus stop on a route; and a thirteenth step of displaying, by the bus stop terminal, at least one of the image information, remaining seat information, and arrival information for at least one bus arriving for each route.

In addition, the thirteenth step may include: obtaining, by a bus recognition unit, unique identification information of the bus arriving at the bus stop through a wireless reader; Visually displaying the boarding information of the bus for each route by a touch screen unit using input/output means using a touch panel; aurally outputting the riding information by a speaker unit; and a central processing unit requesting, by a central processing unit, riding information for a bus of interest or a destination of interest to the central control server according to a user's request, and providing the received riding information accordingly; may further include.

In addition, the touch screen unit selectively displays at least one of bus arrival time, bus location information, remaining seat information, and internal image information of the bus for a plurality of buses of interest scheduled to arrive sequentially at the bus stop. The remaining seat information can be displayed by classifying the position and use of the seat.

The present invention can provide a user with a passenger safety and convenience system using control decision logic.

The present invention simplifies the system by transmitting the indoor situation information of the autonomous driving vehicle to the control system and delivering passenger safety information using the judgment logic system in the control, providing a method for a situation that is difficult to determine by the autonomous driving vehicle itself, It is possible to provide a system and method for promoting passenger safety and convenience in a vehicle.

In addition, in the system according to the present invention, using the customer's mobile device, after installing the app in advance in the mobile device, press the button, and transmit the photo, video, and voice through the mobile device, and then the vehicle by the emergency signal in the control After confirming the information (location, amount), the image installed in the vehicle is checked once more, and the voice/video based on the collected emergency data can provide situation analysis and countermeasures using a pattern recognition algorithm.

In addition, according to the configuration of the present invention, when an emergency situation (for example, if there is a mole among passengers) occurs in a state in which a driver or other operator in a vehicle such as self-driving public transportation is not on board, when an emergency situation occurs, the current It is possible to solve the current problem that needs to be reported by witnessing or personal experience.

In addition, the user can check the internal situation information of the scheduled arrival bus in advance, and the user can selectively use the bus, thereby improving the user's convenience.

However, the effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. will be able

1 is a block diagram for explaining the components of a passenger safety and convenience system using the control decision logic proposed by the present invention.
2 is a view for comparing the passenger safety and convenience system using the control decision logic proposed by the present invention and the conventional system.
3 is a flowchart illustrating a method for providing passenger safety and convenience using the control decision logic proposed by the present invention.
4 is a flowchart illustrating a process of acquiring emergency situation information through a passenger terminal and reporting it to control in relation to the present invention.
5 is a flowchart illustrating a process of confirming emergency situation information through an emergency button push and reporting it to control in relation to the present invention.
6 is a network configuration diagram schematically illustrating a system for providing ride information for an autonomous driving vehicle according to an embodiment of the present invention.
7 is a block diagram schematically illustrating the configuration of an autonomous vehicle stop terminal according to an embodiment of the present invention.
8 shows boarding information for a specific bus of interest displayed by the autonomous vehicle stop terminal according to an embodiment of the present invention.
9 is a plan view illustrating details of remaining seats of an autonomous vehicle of interest according to an embodiment of the present invention.
10 is a flowchart illustrating a method for providing ride information for an autonomous vehicle according to an embodiment of the present invention.
11 is a flowchart illustrating a method for an autonomous driving vehicle stop terminal to provide information on an autonomous driving vehicle at the request of a user according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail. This is not intended to limit the present invention to specific embodiments, it can be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention.

In describing the present invention, terms such as first, second, etc. may be used to describe various components, but the components may not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component.

When a component is referred to as being connected or connected to another component, it may be directly connected or connected to the other component, but it can be understood that other components may exist in between. . On the other hand, when it is mentioned that a certain element is directly connected to or directly connected to another element, it may be understood that the other element does not exist in the middle.

The terms used herein are used only to describe specific embodiments, and are not intended to limit the present invention. The singular expression may include the plural expression unless the context clearly dictates otherwise.

In this specification, the terms include or include are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, and includes one or more other features or numbers, It may be understood that the existence or addition of steps, operations, components, parts or combinations thereof is not precluded in advance.

In addition, unless otherwise defined, all terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. . Terms such as those defined in a commonly used dictionary may be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the present specification, it is interpreted in an ideal or excessively formal meaning. it may not be

A self-driving vehicle refers to a vehicle that detects the situation with various sensors of the vehicle, such as a precise map and a global positioning system (GPS), and finds a destination by itself without the driver operating the steering wheel, accelerator pedal, or brake.

The autonomous driving market is expected to enter full-fledged growth from 2020.

According to market research firm Navigant Research, the global autonomous vehicle market is expected to reach $1.2 trillion by 2035 after accounting for $200 billion, or 2% of the total car market in 2020.

Since autonomous public transportation vehicles are operated by unmanned or automatic operation, real-time vehicle status information is transmitted to the SCC (Smart Control Center) through smart control (SCC), wired and V2X wireless networks, and control information is transmitted to the vehicle. are doing

If an emergency situation (for example, if there is a molestation among passengers) occurs while the driver or other operator in the vehicle is not on board, such as self-driving public transportation There are problems that need to be addressed, and solutions are required.

In addition, when the autonomous vehicle is a bus, conventional bus information services can help with bus routes and bus arrival information, but it is possible to check status information such as congestion inside the bus, in particular, information about remaining seats at the previous bus stop. Because users have to get on the bus only with information on the estimated arrival time of the bus they want to board, the elderly, the disabled, pregnant women, parents with infants, etc. There was a problem that it was inconvenient because I did not know if a person was riding.

Therefore, in the present specification, in order to solve the above problems, it is an object of the present specification to provide a passenger safety and convenience system using a control decision logic to a user.

That is, the present invention simplifies the system by transmitting the indoor situation information of the autonomous driving vehicle to the control system and delivering passenger safety information using the judgment logic system in the control, thereby providing a method for a situation in which the autonomous driving vehicle itself is difficult to determine. and to propose a system and method for promoting the safety and convenience of passengers in the vehicle.

Specifically, in the system according to the present invention, using the customer's mobile device, after installing the app in the mobile device in advance, press the button, and transmit the photo, video, and voice through the mobile device, and then the vehicle by the emergency signal in the control After confirming the information (location, amount), the video installed in the vehicle is checked once more, and the voice/video based on the collected emergency data can provide a method of analyzing the situation and providing a countermeasure using a pattern recognition algorithm. .

In addition, in the system according to the present invention, an emergency button in the autonomous vehicle is installed for each seat, and a reporting method using the emergency button can be proposed.

Additionally, the present invention is to provide a bus ride information providing system and method that can improve the convenience of users using public transportation in addition to emergency situations.

Specifically, in the present invention, a sensor and a camera inside a bus can sense the remaining seats, images, identification information, location information, etc., and provide and display it at a stop.

That is, the bus ride information providing system according to the present invention is a vehicle terminal that generates bus internal information including at least one of remaining seat information and image information of the bus, and generates bus riding information based on the bus internal information, An object of the present invention is to provide a central control server that provides the bus ride information to a bus stop on a route, and a bus stop terminal installed at the bus stop and displaying bus ride information for at least one bus arriving for each route.

first embodiment

1 is a block diagram for explaining the components of a passenger safety and convenience system using the control decision logic proposed by the present invention.

Referring to FIG. 1 , the passenger safety and convenience system using the control decision logic proposed by the present invention may include a smart control system 1 , a safety-related institution 2 , and an infrastructure 3 .

Here, the safety-related organization 2 may include a police station, a fire department, and the like.

In addition, the infrastructure 3 may include all facilities related to operation and maintenance of the autonomous vehicle 100 .

In addition, the smart control system 1, the safety-related organization 2, and the infrastructure 3 may communicate with each other through short-distance communication or long-distance communication.

Here, the short-range communication may include ANT, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra-Wideband (UWB), and ZigBee technologies.

In addition, long-distance communication is CDMA (code division multiple access), FDMA (frequency division multiple access), TDMA (time division multiple access), OFDMA (orthogonal frequency division multiple access), SC-FDMA (single carrier frequency division multiple access) may include

With reference to FIG. 1, the configuration of the smart control system 1 proposed by the present invention will be described in detail.

1 shows a block diagram of a smart control system in relation to the present invention.

The smart control system 1100 according to the present invention includes a wireless communication unit 1110, an A/V (Audio/Video) input unit 1120, a user input unit 1130, a sensing unit 1140, an output unit 1150, a memory ( 1160 ), an interface unit 1170 , a control unit 1180 , a power supply unit 1190 , and the like. Since the components shown in FIG. 1 are not essential, the smart control system 1100 having more or fewer components may be implemented.

Hereinafter, the components will be described in turn.

The wireless communication unit 1110 may include one or more modules that enable wireless communication between the smart control system 1100 and the wireless communication system or between the smart control system 1100 and the network in which the smart control system 1100 is located. . For example, the wireless communication unit 1110 may include a mobile communication module 1112 , a wireless Internet module 1113 , a short-range communication module 1114 , and a location information module 1115 .

The mobile communication module 1112 transmits/receives wireless signals to and from at least one of a base station, an external smart control system 1100, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission/reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 1113 refers to a module for wireless Internet access, and may be built-in or external to the smart control system 1100 .

As the wireless Internet technology, WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. may be used.

The short-range communication module 1114 refers to a module for short-range communication. As the short-range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 1115 is a module for acquiring the location of the smart control system 1100 , and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the GPS module 1115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information, thereby generating a three-dimensional current according to latitude, longitude, and altitude. Location information can be accurately calculated. Currently, a method of calculating position and time information using three satellites and correcting errors in the calculated position and time information using another one satellite is widely used. Also, the GPS module 1115 may calculate speed information by continuously calculating the current location in real time.

Referring to FIG. 1 , an A/V (Audio/Video) input unit 1120 is for inputting an audio signal or a video signal, and may include a camera 1121 , a microphone 1122 , and the like. The camera 1121 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 1151 .

The image frame processed by the camera 1121 may be stored in the memory 1160 or transmitted to the outside through the wireless communication unit 1110 .

In this case, two or more cameras 1121 may be provided according to the use environment.

For example, the camera 1121 may be provided with first and second cameras 1121a and 1121b for capturing 3D images on the opposite surface of the smart control system 1100 on which the display unit 1151 is provided, and the A third camera 1121c for taking a self-portrait of the user may be provided in a portion of the surface on which the display unit 1151 of the smart control system 1100 is provided.

In this case, the first camera 1121a may be for capturing a left eye image, which is a source image of a 3D image, and the second camera 1121b may be for capturing a right eye image.

In addition, the camera 1121 applied to the present invention may include a unidirectional camera for photographing one side of the parking surface and an omnidirectional camera for photographing all directions.

The microphone 1122 receives an external sound signal by a microphone in a recording mode, a voice recognition mode, and the like, and processes it as electrical voice data. The processed voice data may be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 in the call mode and output. Various noise removal algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 1122 .

The user input unit 1130 generates input data for the user to control the operation of the smart control system 1100 .

The user input unit 1130 may receive, from the user, a signal for designating two or more contents among contents displayed according to the present invention. In addition, a signal for designating two or more contents may be received through a touch input or may be received through a hard key and a soft key input.

The user input unit 1130 may receive an input for selecting the one or more contents from the user. In addition, an input for generating an icon related to a function that the smart control system 1100 can perform may be received from a user.

As described above, the user input unit 1130 may include a direction key, a key pad, a dome switch, a touch pad (static pressure/capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 includes the opening/closing state of the smart control system 1100, the location of the smart control system 1100, the presence or absence of user contact, the orientation of the smart control system 1100, acceleration/deceleration of the smart control system 1100, etc. A sensing signal for controlling the operation of the smart control system 1100 is generated by detecting the current state of the smart control system 1100 . In addition, it is also possible to sense whether power is supplied to the battery 1190 , whether the interface unit 1170 is coupled to an external device, and the like. Meanwhile, the sensing unit 1140 may include a proximity sensor 1141 . The proximity sensor 141 will be described later in relation to the touch screen.

The output unit 1150 is for generating an output related to sight, hearing, or touch, and this may include a display unit 1151 , a sound output module 1152 , and the like.

The display unit 1151 displays (outputs) information processed by the smart control system 1100 . For example, a user interface (UI) or a graphic user interface (GUI) is displayed. When the smart control system 1100 is in or shooting mode, it displays the captured and/or received image, UI, or GUI.

Also, the display unit 1151 according to the present invention supports 2D and 3D display modes.

That is, the display unit 1151 according to the present invention may have a configuration in which the switch liquid crystal 1151b is combined with a general display device 1151a. In addition, the optical parallax barrier 50 is operated using the switch liquid crystal 1151b to control the propagation direction of the light, so that different lights can be separated to reach the left and right eyes. For this reason, when the image in which the image for the right eye and the image for the left eye are combined is displayed on the display device 1151a, from the user's point of view, images corresponding to each eye are shown and feel as if displayed in three dimensions.

That is, under the control of the controller 1180, the display unit 1151 drives only the display device 1151a without driving the switch liquid crystal 1151b and the optical parallax barrier 50 in the 2D display mode. Perform normal 2D display operations.

In addition, under the control of the controller 1180, the display unit 1151 drives the switch liquid crystal 1151b, the optical parallax barrier 50, and the display device 1151a in the 3D display mode to drive the display device ( 1151a) is driven to perform a 3D display operation.

Meanwhile, the display unit 151 as described above includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED). , a flexible display, and a three-dimensional display (3D display) may include at least one.

Some of these displays may be of a transparent type or a light-transmitting type so that the outside can be viewed through them. This may be referred to as a transparent display, and a typical example of the transparent display is a TOLED (Transparant OLED). The rear structure of the display unit 1151 may also be configured as a light-transmitting structure. With this structure, the user can see an object located at the rear of the body of the smart control system 1100 through the area occupied by the display unit 1151 of the body of the smart control system 1100 .

Two or more display units 1151 may exist according to an implementation form of the smart control system 1100 . For example, in the smart control system 1100 , a plurality of display units may be spaced apart or disposed integrally on one surface, or may be respectively disposed on different surfaces.

When the display unit 1151 and the sensor for sensing a touch operation (hereinafter, referred to as a 'touch sensor') form a layered structure (hereinafter referred to as a 'touch screen'), the display unit 1151 may be used in addition to the output device. It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 1151 or a change in capacitance generated at a specific portion of the display unit 1151 into an electrical input signal. The touch sensor may be configured to detect not only the touched position and area, but also the pressure at the time of the touch.

When there is a touch input to the touch sensor, a signal(s) corresponding thereto is sent to a touch controller (not shown). The touch controller processes the signal(s) and then transmits corresponding data to the controller 1180 . Accordingly, the controller 1180 can know which area of the display unit 1151 has been touched, and the like.

The proximity sensor 1141 may be disposed in an inner region of the smart control system 1100 covered by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity without mechanical contact using the force of an electromagnetic field or infrared rays. Proximity sensors have a longer lifespan than contact sensors and their utility is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is of a capacitive type, it is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of description, the act of bringing the pointer closer to the touch screen without making contact so that the pointer is recognized as being positioned on the touch screen is referred to as “proximity touch”, and the touch The act of actually touching the pointer on the screen is called "contact touch". The position at which a proximity touch is performed by the pointer on the touch screen means a position at which the pointer vertically corresponds to the touch screen when the pointer is touched in proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sound output module 1152 may output audio data received from the wireless communication unit 1110 or stored in the memory 1160 in a recording mode, a voice recognition mode, and a broadcast reception mode. The sound output module 1152 also outputs a sound signal related to a function performed in the smart control system 1100 . The sound output module 1152 may include a receiver, a speaker, a buzzer, and the like.

The memory 1160 may store a program for processing and control of the controller 1180 , and may perform a function for temporarily storing input/output data. The frequency of use of each of the data may also be stored in the memory 1160 . In addition, the memory unit 1160 may store data related to vibrations and sounds of various patterns output when a touch input on the touch screen is input.

In addition, the memory 1160 stores a web browser displaying a 3D or 2D web page according to the present invention.

The memory 1160 as described above may include a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (eg, SD or XD memory, etc.). ), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic It may include at least one type of storage medium among a memory, a magnetic disk, and an optical disk. The smart control system 1100 may operate in relation to a web storage that performs a storage function of the memory 1160 on the Internet.

The interface unit 1170 serves as a passage with all external devices connected to the smart control system 1100 . The interface unit 1170 receives data from an external device, receives power and transmits it to each component inside the smart control system 1100, or transmits data inside the smart control system 1100 to an external device. For example, wired/wireless headset ports, external charger ports, wired/wireless data ports, memory card ports, ports for connecting devices equipped with identification modules, audio input/output (I/O) ports, A video I/O (Input/Output) port, an earphone port, etc. may be included in the interface unit 170 .

The identification module is a chip storing various information for authenticating the right to use the smart control system 1100, and includes a User Identify Module (UIM), a Subscriber Identify Module (SIM), and a general-purpose user authentication module. (Universal Subscriber Identity Module, USIM) and the like. A device equipped with an identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Therefore, the identification device may be connected to the smart control system 1100 through the port.

When the smart control system 1100 is connected to an external cradle, the interface unit becomes a passage through which power from the cradle is supplied to the smart control system 1100, or various command signals input from the cradle by the user. It may be a passage through which the smart control system 1100 is transmitted. Various command signals or the power input from the cradle may be operated as signals for recognizing that the smart control system 1100 is correctly mounted on the cradle.

The controller 1180 typically controls the overall operation of the smart control system 1100 . For example, it performs related control and processing for voice calls, data communications, video calls, and the like. The controller 1180 may include a multimedia module 1181 for playing multimedia. The multimedia module 1181 may be implemented within the controller 1180 or may be implemented separately from the controller 1180 .

The controller 1180 may perform a pattern recognition process capable of recognizing a handwriting input or a drawing input performed on the touch screen as characters and images, respectively.

On the other hand, when the display unit 1151 is provided with an organic light-emitting diode (OLED) or a transparent OLED (TOLED), the controller 1180 controls the input through the camera 121 according to the present invention. When the size of the preview image is adjusted according to a user's manipulation while the preview image is pull-up displayed on the screen of the organic light-emitting diode (OLED) or the transparent OLED (TOLED), the size of the preview image is displayed on the screen By turning off driving of pixels in the remaining second area except for the first area in which the preview image is displayed, the consumption of power supplied from the power supply unit 1190 to the display unit 151 may be reduced.

The power supply unit 1190 receives external power and internal power under the control of the control unit 1180 to supply power required for operation of each component.

Various embodiments described herein may be implemented in a computer-readable recording medium using, for example, software, hardware, or a combination thereof.

According to the hardware implementation, the embodiments described herein are ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays, It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and other electrical units for performing functions. The described embodiments may be implemented by the controller 1180 itself.

According to the software implementation, embodiments such as the procedures and functions described in this specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. The software code may be implemented as a software application written in a suitable programming language. The software code may be stored in the memory 1160 and executed by the controller 1180 .

A method for providing passenger safety and convenience using the control decision logic proposed by the present invention based on the configuration of the system proposed by the present invention will be described in detail with reference to the drawings.

2 is a view for comparing the passenger safety and convenience system using the control decision logic proposed by the present invention and the conventional system.

Referring to Figure 2 (a), an example of the existing control system is shown.

As a general bus vehicle, the driver or other operator is on board, so the discomfort index is high, and the stability and convenience are poor.

Referring to (b) of FIG. 2 , the autonomous driving vehicle 100 according to the present invention is applied, and without a driver or other operator in the vehicle, the vehicle interior situation information is transmitted to the control system, and the in-control decision logic system It is possible to transmit passenger safety information using

In addition, it can be used as a judgment system for passenger safety and convenience information in the vehicle, which is a simplified in-vehicle system using a control system for a situation that is difficult to judge with the vehicle's own system.

In the case of (b) of FIG. 2 , the effect of increasing stability and convenience while lowering the discomfort index is also guaranteed.

Meanwhile, FIG. 3 is a flowchart illustrating a method of providing passenger safety and convenience using the control decision logic proposed by the present invention.

Referring to FIG. 3 , the first step ( S1 ) in which an emergency situation occurs in the autonomous vehicle 100 may occur.

At this time, the autonomous vehicle 100 transmits the generated emergency situation to the control system 1 (S2).

Thereafter, the control system 1 confirms the generated emergency situation using the autonomous vehicle 100 (S3).

In addition, the control system 1 extracts a corresponding emergency situation from the emergency situations stored in advance based on the information collected from the autonomous vehicle 100 (S4).

Thereafter, the control system 1 determines at least one scenario corresponding to the extracted emergency situation among the accident countermeasure scenarios stored in advance ( S5 ).

In addition, the control system 1 transmits (S6) the determined scenario to the autonomous vehicle 100, and the autonomous vehicle 100 controls at least one of vehicle speed, destination, and vehicle door opening and closing according to the received scenario. control (S7).

After step S7, the control system 1 transmits the information on the extracted emergency situation to the pre-set related organizations 2 and 3 (S8), and the autonomous vehicle 100 transmits the preset related organizations 2 and 3 Receives scheduling information from (S9).

Thereafter, the autonomous vehicle 100 stops the vehicle 100 at a predetermined point according to the scheduling information (S10), and performs additional operation according to the scheduling information (S11).

In connection with the application of the present invention, a specific example will be described.

A specific example is assumed to be the case of the appearance of a mole or an emergency situation among passengers.

You can notify the control system in a situation where you need to report it as a witness by the next passenger or your own experience.

Here, as the first method of notifying the control system of this fact, the passenger's mobile device is used. A method of pressing a button after installing an app in advance in a mobile device may be used.

4 is a flowchart illustrating a process of acquiring emergency situation information through a passenger terminal and reporting it to control in relation to the present invention.

Referring to FIG. 4 , first, a step ( S12 ) in which a passenger installs an application using a mobile device is performed.

After that, a step (S13) of executing the installed application and acquiring a picture, an image, an audio, etc. through a mobile device is performed.

In addition, the step (S2) of transmitting the acquired information to the control (1) and the information received in the control (1) and the information acquired from the device installed in the autonomous vehicle are used together to determine whether it is an emergency situation. Step S3 proceeds.

In addition, as a second method of notifying the control system 1 of the fact, an emergency button in the vehicle is installed for each seat, and a reporting method using this may be used.

5 is a flowchart illustrating a process of confirming emergency situation information through an emergency button push and reporting it to control in relation to the present invention.

Referring to FIG. 5 , first, the step (S14) in which an emergency button in the autonomous vehicle is installed for each seat proceeds.

Thereafter, when an emergency situation occurs, the passenger pushes the button to report the emergency situation to the control (S15), and information such as the report information and the passenger's mobile voice, video, and photo received from the passenger in the control (1) is transmitted. It is determined whether or not it is an emergency situation by using it (S3).

After that, the control (1) confirms the fact, and after checking the vehicle information (location, amount) by the emergency signal, the image installed in the vehicle is checked or the passenger's mobile data is transmitted to the control (voice, video, photo) If it is, a method of analyzing it and confirming it can be applied.

In addition, based on the collected emergency data, the voice/video analyzes the situation using a pattern recognition algorithm, and a number of predetermined accident countermeasure scenarios can be automatically derived through the results through automated analysis.

In addition, the automatically derived situation, scenario, and analysis result are transmitted to the control person in charge, and confirmation from the control person is received. can be connected to

In addition, in an emergency situation, the vehicle speed, destination, and opening and closing of the vehicle door are controlled by the control system, and after the emergency confirmation, video monitoring of the target vehicle is performed, scheduled with the person in charge of the relevant organizations (2, 3), The vehicle can be stopped at the stopping point.

At this time, the door of the autonomous vehicle 100 is closed, and when a manpower to solve the problem comes, the door opens and induces the problem to be solved.

However, in the event of a fire, the door is opened even in the above situation, and the evacuation situation can be notified.

Therefore, when the configuration of the present invention described above is applied, the present invention transmits the indoor situation information of the autonomous driving vehicle to the control system and transmits the passenger safety information using the judgment logic system in the control, so that it is difficult to determine the autonomous vehicle itself. It is possible to provide a system and method for simplifying the system by providing a solution to the situation, and promoting passenger safety and convenience in the vehicle.

In addition, in the system according to the present invention, using the customer's mobile device, after installing the app in advance in the mobile device, press the button, and transmit the photo, video, and voice through the mobile device, and then the vehicle by the emergency signal in the control After confirming the information (location, amount), the image installed in the vehicle is checked once more, and the voice/video based on the collected emergency data can provide situation analysis and countermeasures using a pattern recognition algorithm.

In addition, according to the configuration of the present invention, when an emergency situation (for example, if there is a mole among passengers) occurs in a state in which a driver or other operator in a vehicle such as self-driving public transportation is not on board, when an emergency situation occurs, the current It is possible to solve the current problem that needs to be reported by witnessing or personal experience.

second embodiment

A system for providing bus ride information according to an aspect of the present invention includes a vehicle terminal that generates bus internal information including at least one of remaining seat information and image information of a bus, and generates bus riding information based on the bus internal information, , a central control server that provides the bus ride information to a bus stop on a route, and a bus stop terminal installed at the bus stop and displaying bus boarding information for at least one bus arriving for each route.

In addition, the bus internal information includes at least one of unique identification information of the bus, location information, remaining seat information, and image information inside the bus, and the bus boarding information is provided until the bus arrives at the bus stop where the user is located. It may further include a required time required for bus arrival, which is an expected required time, and the number of bus stops passed to arrive at the bus stop.

In addition, the vehicle terminal includes a seat detection unit installed on each seat of the bus to detect a seated state of a occupant, a camera unit generating image information by photographing state information inside the bus, and the seated detection unit collected from A collection information processing unit that generates remaining seat information by counting the seated detection information, and generates the bus internal information including at least one of remaining seat information, image information, unique identification information, and location information of the bus, and the bus interior It may include a wireless communication unit for transmitting information to the central control server through a wireless repeater.

In this specification, for convenience of explanation, it is assumed that the autonomous vehicle 100 is a bus, but the content of the autonomous vehicle 100 of the present invention is not limited to the bus.

In addition, the collection information processing unit, based on the seat installation position and identification information of the seat detection unit may generate the remaining seat information in which the position and use of the seat (general / elderly seat) is distinguished.

In addition, the central control server uses a collection unit that analyzes the internal bus information received based on the unique identification information of the bus, the location information of the bus included in the bus internal information and the route information of the bus, It may include a bus location tracking unit for calculating the number of bus stops and the time required to arrive at the bus, and a control unit for generating the bus ride information using the bus internal information, the number of bus stops, and the time required to arrive at the bus.

In addition, the bus location tracking unit may calculate the time required for the arrival of the bus based on a statistical time in which at least one bus of the same route operated prior to the bus travels for each stop.

6 is a network configuration diagram schematically illustrating a system for providing ride information for an autonomous driving vehicle according to an embodiment of the present invention.

Referring to FIG. 6 , the bus ride information providing system includes a vehicle terminal 100 , a wireless repeater 200 , a central control server 300 , and a bus stop terminal 400 .

The vehicle terminal 100 transmits the bus internal information provided in the bus and grasped in real time to the wireless repeater 200 through a wireless communication means. Here, the bus internal information includes remaining seat information of the corresponding bus and image information captured inside the bus.

The wireless repeater 200 transmits the bus internal information received from the vehicle terminal 100 to the central control server 300 , and transfers the boarding information received from the central control server 300 to the bus stop terminal 400 .

The central control server 300 is a system that centrally manages overall information according to the operation of buses operated for each route. In particular, the central control server 300 according to an embodiment of the present invention receives the bus internal information from the vehicle terminal 100 of the bus in real time or for each designated time, and adds the bus internal information, the number of stops, and the time required to arrive at the bus. Bus ride information is generated and provided to the bus stop terminal 400 where the bus is scheduled to arrive.

Here, the number of stops is the number of stops existing on the route of the bus from the position of the bus to a predetermined bus stop where the user waits.

Here, the time required for bus arrival may be a time required for the bus to arrive at a predetermined bus stop waiting for the user.

The bus stop terminal 400 is fixedly installed at the bus stop and receives bus ride information for at least one bus arriving by route from the central control server 300, and receives one or more of the information included in the bus ride information accordingly. By displaying it, the user can refer to it when boarding the bus.

7 is a block diagram schematically illustrating the configuration of an autonomous vehicle stop terminal according to an embodiment of the present invention.

Referring to FIG. 7 , the bus stop terminal 400 according to an embodiment of the present invention includes a communication module 410 , a bus recognition unit 420 , a touch screen unit 430 , a speaker unit 440 , and a central processing unit 450 . ) is included.

The communication module 410 performs wireless communication with an external device, for example, a wireless repeater.

The bus recognition unit 420 includes a reader for recognizing the RF tag in the vehicle terminal 100 of the bus to obtain unique identification information of the bus arriving at the stop.

The touch screen unit 430 is an input/output means of the bus stop terminal 400 using a touch panel, and uses the bus boarding information received from the central control server 330 to display the bus arrival time and bus internal information for each route. display visually. In particular, the touch screen unit 430 may receive information on the user's specific interest bus, and visually display information corresponding to the request.

8 shows boarding information for a specific bus of interest displayed by the autonomous vehicle stop terminal according to an embodiment of the present invention.

Referring to FIG. 8 , in the current location of the bus stop terminal 400 according to an embodiment of the present invention, the bus location, expected arrival time, remaining seat information, image information, etc. for the buses 11 and 12 of interest of the user are displayed. Shows ride information. At this time, the first bus 11 and the second bus 12, which are buses of interest, may be vehicles of the same number (same conductor) or vehicles having different numbers but passing through the user's destination of interest.

That is, the touch screen unit 430 of the bus stop terminal 400 shows a plurality of buses of interest to the user according to the expected arrival order of the current location, thereby allowing the user to selectively board the bus based on the boarding information. have.

9 is a plan view illustrating details of remaining seats of an autonomous vehicle of interest according to an embodiment of the present invention.

Referring to FIG. 9 , detailed information of the remaining seats that can be checked when the remaining seat information of the second bus 12 of FIG. 8 is selected on the touch screen unit 430 according to an embodiment of the present invention is shown. That is, out of the remaining 11 seats, there are 7 general seats and 4 elderly seats, and the seats in use are colored and empty seats are colorless. In addition, economy seats are indicated by a solid line and the elderly seat is indicated by a dotted line to distinguish the use of the seat.

Furthermore, although omitted from the drawings, when image information is selected, an image taken inside the corresponding bus may be displayed to visually show not only the remaining seats but also the degree of congestion in the bus.

According to the embodiment of the present invention described above, it has been described that the input/output means of the bus stop terminal 400 is composed of a touch screen unit (touch panel), but is not limited thereto. That is, the touch screen unit 430 may be configured to include a manipulation unit including a plurality of input buttons separately from a display device such as an LCD.

10 is a flowchart illustrating a method for providing ride information for an autonomous vehicle according to an embodiment of the present invention.

Referring to FIG. 10 , the vehicle terminal 100 of the bus ride information providing system according to an embodiment of the present invention collects image information obtained by photographing state information inside the bus through a camera installed inside the bus, and includes a seat detection unit ( 110) detects the use of the seat to determine the remaining seat information (S101).

The vehicle terminal 100 generates bus internal information including the image information and the remaining seat information according to a preset reporting period when the number of recognized remaining seats is changed (S102, S103), and the central control server 300 ) to (S104). At this time, the transmitted bus internal information further includes unique identification information and location information of the bus, and although omitted from the drawing, it can be transmitted to the central control server 300 even during a stop or movement through the wireless repeater 200 .

The central control server 300 determines the number of bus stops to be sequentially stopped and the bus arrival at each bus stop based on the movement statistics time of the previously operated bus on the same route based on the location information and route information of the bus in operation. The required time is calculated (S105).

Then, the central control server 300 analyzes the bus internal information received from the vehicle terminal 100 and updates the remaining seat information and image information based on the unique identification information of the bus (S106).

Then, the central control server 300 generates bus ride information including the estimated time required to arrive at the bus stop where the user is, the bus arrival time for each bus stop, remaining seat information, image information, and bus location information, and (S107), the generated bus ride information is transmitted to the bus stop terminal 400 to which the bus is scheduled to arrive (S108).

The bus stop terminal 400 updates the bus ride information received from the central control server 300 (S109), and the bus ride including the location of the bus for each scheduled arrival route, the bus arrival time, remaining seat information and image information. Information is displayed (S110). In addition, the bus stop terminal 400 guides by outputting at least one of the displayed bus ride information by voice.

Meanwhile, FIG. 11 is a flowchart illustrating a method for an autonomous driving vehicle stop terminal to provide ride information for an autonomous driving vehicle at the request of a user according to an embodiment of the present invention.

Referring to FIG. 11 , since the bus stop terminal 400 according to an embodiment of the present invention includes a user input means such as a touch screen unit 430 and a user-based graphic user interface (GUI), a specific bus according to the user's request /Can provide detailed bus ride information for the route.

First, the bus stop terminal 400 selects a bus or destination of interest of the user (S201), and requests bus ride information according to the selected bus/destination of interest (S202). Here, the bus of interest may be a vehicle of the same number or a vehicle of a different number operating the same destination.

When the central control server 300 receives a request for bus ride information from the bus stop terminal 400, the estimated time required to arrive at the bus stop where the user for at least one of the bus of interest scheduled to arrive at the requested bus stop is The bus arrival time is calculated (S203). Here, the central control server 300 updates the remaining seat information and image information of the bus of interest (S204), and generates bus ride information for the bus of interest (S205).

Here, the central control server 300 is omitted in FIG. 8, but may further include the step of inquiring stored internal bus information received from the vehicle terminal 100 of the bus of interest through steps S101 to S104 of FIG.

The central control server 300 transmits the generated bus ride information for the bus of interest to the bus stop terminal 400 (S206). The transmitted bus ride information is information on a plurality of buses of interest as shown in FIG. 5 .

The bus stop terminal 400 updates the bus ride information for the bus of interest (S207), and displays the boarding information for a plurality of buses of interest (S208). At this time, the bus stop terminal 400 may display the bus location for the bus 11 and 12 of interest of the user at the current location, the time required to arrive at the bus, remaining seat information, image information, and the like.

Then, when the bus stop terminal 400 receives a detailed request for residual seat information or image information from the user (S209), it displays detailed residual seat information or provides image information in the bus (S210).

Therefore, according to an embodiment of the present invention, the user can confirm in advance that there are spare seats in the second bus 12 that arrives 4 minutes later, although there are no seats in the first bus 11 that the user is scheduled to arrive after 1 minute. 2 You may choose to use the bus 12 .

As described above, according to an embodiment of the present invention, the bus stop terminal 400 provides not only the location and expected arrival time of the bus of interest to the user, but also the remaining seat information and the internal image, thereby providing the user with the internal situation information about the scheduled arrival of the bus in advance. It has a verifiable effect.

In addition, the bus stop terminal 400 provides real-time boarding information for a plurality of buses of interest through two-way communication with the central control server 300 using a user graphic interface, so that the user can selectively use the bus, thereby increasing user convenience. An improved effect can be expected.

When the above-described technical features of the present invention are applied, when an emergency situation (eg, if there is a mole among passengers) occurs in a state in which a driver or other operator in a vehicle such as autonomous driving public transportation is not boarded, the present It is possible to solve the current problem that must be reported by sightings by nearby passengers or by one's own experience.

In addition, the user can check the internal situation information of the scheduled arrival bus in advance, and the user can selectively use the bus, thereby improving the user's convenience.

Meanwhile, the above-described embodiments of the present invention may be implemented through various means. For example, embodiments of the present invention may be implemented by hardware, firmware, software, or a combination thereof.

In the case of implementation by hardware, the method according to embodiments of the present invention may include one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), and Programmable Logic Devices (PLDs). , FPGAs (Field Programmable Gate Arrays), processors, controllers, microcontrollers, microprocessors, and the like.

In the case of implementation by firmware or software, the method according to the embodiments of the present invention may be implemented in the form of a module, procedure, or function that performs the functions or operations described above. The software code may be stored in the memory unit and driven by the processor. The memory unit may be located inside or outside the processor, and may transmit and receive data to and from the processor by various known means.

The detailed description of the preferred embodiments of the present invention disclosed as described above is provided to enable any person skilled in the art to make and practice the present invention. Although the above has been described with reference to preferred embodiments of the present invention, it will be understood by those skilled in the art that various modifications and changes can be made to the present invention without departing from the scope of the present invention. For example, those skilled in the art can use each configuration described in the above-described embodiments in a way in combination with each other. Accordingly, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The present invention may be embodied in other specific forms without departing from the spirit and essential characteristics of the present invention. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention. The present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein. In addition, claims that are not explicitly cited in the claims may be combined to form an embodiment, or may be included as new claims by amendment after filing.

Claims (6)

A first step in which an emergency situation occurs in the autonomous vehicle;
a second step of transmitting, by the autonomous vehicle, the emergency situation to a control system;
a third step of confirming, by the control system, the emergency situation that has occurred using the autonomous vehicle;
a fourth step of extracting, by the control system, a corresponding emergency situation from among emergency situations stored in advance based on information collected from the autonomous vehicle;
a fifth step of determining at least one scenario corresponding to the extracted emergency situation among accident countermeasure scenarios stored in advance by the control system;
a sixth step of transmitting, by the control system, the determined scenario to the autonomous vehicle;
a seventh step of controlling at least one of a speed of a vehicle, a destination, and opening/closing of a vehicle door according to the scenario received by the autonomous vehicle;
an eighth step of transmitting, by the control system, information on the extracted emergency situation to a preset related organization;
a ninth step of receiving, by the autonomous vehicle, scheduling information from the preset related organization; and
A tenth step of driving the autonomous vehicle according to the scheduling information;

Between the first and second steps,
executing an application related to the control system on a mobile device in the autonomous vehicle; and
Obtaining at least one of an image, video, text and sound through the mobile device; further comprising,
In the third step,
Check the emergency situation using at least one of the image, video, text and sound,

Between the first and second steps,
The step of pushing at least one emergency button in the autonomous vehicle; further comprising,
In the third step,
Check the emergency situation based on the pushed at least one emergency button,

The autonomous vehicle is a bus,
an eleventh step of collecting, by a vehicle terminal, image information obtained by photographing the state information of the inside of the bus, and detecting whether or not seats are in use to determine remaining seat information;
a twelfth step of generating, by the control system, bus arrival information including the arrival information of the bus in the received image information and remaining seat information, and transmitting the bus ride information to a bus stop on a route; and
A bus stop terminal displaying at least one of the image information, remaining seat information, and arrival information for at least one bus arriving for each route; a thirteenth step further comprising;

The thirteenth step is
obtaining, by a bus recognition unit, unique identification information of the bus arriving at the bus stop through a wireless reader;
Visually displaying the boarding information of the bus for each route by a touch screen unit using input/output means using a touch panel;
aurally outputting the riding information by a speaker unit; and
Further comprising; requesting, by the central processing unit, riding information on the bus of interest or the destination of interest to the central control server according to the user's request, and providing the received riding information accordingly;

The touch screen unit,
Selectively displaying at least one of bus arrival time, bus location information, remaining seat information, and internal image information of the bus for a plurality of buses of interest scheduled to arrive sequentially at the bus stop,
The passenger safety control method using a decision logic, characterized in that the remaining seat information is displayed by classifying the position and use of the seat. delete delete delete delete delete

Images