KR102121990B1 - Signage communicable with vehicle and method for controlling the signage - Google Patents

Abstract

The present invention relates to a signage and a method for controlling a signage that can communicate with a vehicle. Signage according to an embodiment of the present invention, a communication unit, a camera including a first camera and a second camera, a display unit and whether the transportation means enters the stop through the communication unit and is associated with the transportation means entering the stop Determining information, sensing information related to a user existing in a specific area of a stop using the first camera, and controlling the camera to sense a location of a transportation means entering the stop using the second camera Including a control unit, the control unit, based on at least one of whether the transportation means enters the stop, information related to the transportation means and the user, characterized in that for controlling the display unit in a preset manner do.

Description

SIGNAGE COMMUNICABLE WITH VEHICLE AND METHOD FOR CONTROLLING THE SIGNAGE}

The present invention relates to a signage and a method for controlling a signage that can communicate with a vehicle.

The vehicle is a device capable of moving in a desired direction by a user on board. A typical example is a car.

Meanwhile, for the convenience of a user using a vehicle, various types of sensors, electronic devices, and the like are provided. In particular, research on vehicle driver assistance systems (ADAS) has been actively conducted for user convenience. Furthermore, development of autonomous vehicles has been actively conducted.

Vehicles may be included in transportation. The means of transportation may mean means used by a person to move or to carry luggage, and for example, may include a car, a motorcycle, a bicycle, a train, a bus or a tram. The contents related to the vehicle described in this specification can be applied analogously/similarly to all types of transportation.

The means of transportation may stop at a designated place to get on and off a person (or luggage). The place where the transportation means is set to stop may be referred to as a stop or a stop.

Various types of signage (or digital signage) are installed at these stops. The signage installed at the stop may serve to provide various information related to the transportation method that usually stops at the stop, or to provide advertisements to people waiting at the stop.

On the other hand, in recent years, with the development of vehicle communication technology, communication between a vehicle and an external device can be smoothly performed, and accordingly, communication capable of smoothly transmitting various information related to a vehicle to an external device can be performed.

In addition, as the development of signage has been actively conducted in recent years, it is possible to output various information through signage.

Accordingly, development has been actively conducted to provide information desired by a user through a signage provided at a stop in an optimized manner through communication with a transportation means.

Republic of Korea Patent Registration No. 10-0826262 (Apr. 30, 2008)

One object of the present invention is to provide a signage and a control method capable of providing information related to transportation in an optimized manner.

Another object of the present invention is to provide a signage and a control method capable of informing a user located in a space obscured by a signage in an optimized manner of a transportation method approaching a stop.

The problems of the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, the signage according to the embodiment of the present invention, a communication unit, a camera including a first camera and a second camera, a display unit and whether the means of transportation enter the stop through the communication unit and the stop Determining information related to the transportation means entering, sensing information related to a user existing in a specific area of the stop using the first camera, and sensing the location of the transportation means entering the stop using the second camera It includes a control unit for controlling the camera.

In an embodiment, the control unit controls the display unit in a preset manner based on at least one of whether the transportation means enters a stop, information related to the transportation means, and information related to the user. do.

In an embodiment, the control unit controls the display unit in a first manner when the transportation means does not enter the stop, and when the transportation means enters the stop, in a second manner different from the first scheme. It characterized in that it controls the display unit.

In an embodiment, controlling the display unit in the first manner includes outputting first screen information to the display unit, and controlling the display unit in the second manner includes the first screen information. And outputting other second screen information to the display unit or changing the transparency of the display unit.

In an embodiment, the control unit determines, based on performing communication with a transportation means entering a stop through the communication unit, that the transportation means performing the communication enters a stop, and the traffic performing the communication It is characterized by receiving information related to the means.

In an embodiment, the first camera photographs a space located in a direction of the transportation means based on the signage, and is disposed on the front of the signage to photograph a specific area of the stop, and the second camera It is characterized in that it is arranged on the back of the signage to photograph the means of transportation entering the stop.

In an embodiment, the control unit determines whether a user exists in a specific area of the stop, based on an image received through the first camera, when a transportation means enters the stop, and the stop stops. When a user exists in a specific area of the vehicle, the image received through the second camera is output to the display unit, or a user who exists in a specific area of the stop passes through the signage to enter the stop. It is characterized in that it controls the transparency of the display unit for viewing.

In an embodiment, the control unit is characterized in that when the transportation means enters the stop, and a user exists in a specific area of the stop, outputs information related to the transportation means to the display unit.

In an embodiment, the controller senses a user's gaze existing in a specific area of the stop through the first camera, and based on the user's gaze and the location of the transportation means sensed through the second camera. , To determine an output location for outputting information related to the transportation means.

In an embodiment, when a plurality of users exist in a specific area of the stop, the control unit outputs information related to the transportation method in different ways based on a preset condition.

In an embodiment, the control unit may display an image received through the first camera on the back of the signage so that a driver of a transportation means entering the stop can identify a user existing in a specific area of the stop. It is characterized in that it is output to the disposed display unit or the transparency of the display unit is controlled.

In an embodiment, the beam output unit further includes a beam output unit configured to output information on the road surface of the stop, and the control unit determines a location at which the traffic entering the stop will stop based on information related to the traffic entering the stop. And controlling the beam output unit to output guided information to the road surface of the stop.

In an embodiment, the control unit determines a location of a signage of a user who wants to board a transportation means entering a stop through the communication unit, and based on the determined location of the signage, the location where the transportation means will stop. Characterized in that it determines the output position to which the information to guide the output.

Details of other embodiments are included in the detailed description and drawings.

According to an embodiment of the present invention, there are one or more of the following effects.

First, the present invention can provide a new signage and a control method thereof that can provide a user with information related to a transportation method entering a stop in an optimized manner.

Second, the present invention can provide an optimized UI/UX (User Interface/User Experience) that can provide information related to transportation to users located in places where the transportation means entering the stop is not visible by the signage. have.

Third, the present invention can provide a new signage that can guide the location of the transportation means entering the stop on the road surface of the stop.

Fourth, the present invention provides an optimized user interface capable of informing a user of information related to a plurality of means of transportation entered at a stop, even when it is difficult to identify the means of transportation located at the rear, as a plurality of means of transportation enter the line Can provide.

Fifth, the present invention can provide a user interface that can more intuitively and easily inform the user of the transportation means entering the stop by determining the location where information related to the transportation means is output based on the driver's gaze.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

1 is a view showing the appearance of a vehicle according to an embodiment of the present invention.
2 is a view of a vehicle according to an embodiment of the present invention viewed from various angles outside.
3 to 4 are views showing the interior of a vehicle according to an embodiment of the present invention.
5 to 6 are views referred to for describing an object according to an embodiment of the present invention.
7 is a block diagram referred to for describing a vehicle according to an embodiment of the present invention.
8 is a block diagram illustrating a signage according to an embodiment of the present invention.
9 is a conceptual diagram for explaining a signage installed in the stop of the present invention.
10 is a flowchart for explaining a method of controlling a typical signage of the present invention.
11, 12, 13, 14, 15, 16, and 17 are conceptual views for explaining the control method described in FIG. 10 and conceptual views for explaining various embodiments of the present invention.

Hereinafter, exemplary embodiments disclosed herein will be described in detail with reference to the accompanying drawings, but the same or similar elements are assigned the same reference numbers regardless of the reference numerals, and overlapping descriptions thereof will be omitted. The suffixes "modules" and "parts" for components used in the following description are given or mixed only considering the ease of writing the specification, and do not have meanings or roles distinguished from each other in themselves. In addition, in describing the embodiments disclosed in this specification, detailed descriptions of related known technologies are omitted when it is determined that the gist of the embodiments disclosed in this specification may be obscured. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed in the specification is not limited by the accompanying drawings, and all modifications included in the spirit and technical scope of the present invention , It should be understood to include equivalents or substitutes.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from other components.

When an element is said to be "connected" to or "connected" to another component, it is understood that other components may be directly connected to or connected to the other component, but may exist in the middle. It should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that no other component exists in the middle.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this application, the terms "comprises" or "have" are intended to indicate that there are features, numbers, steps, operations, components, parts or combinations thereof described in the specification, one or more other features. It should be understood that the existence or addition possibilities of fields or numbers, steps, operations, components, parts or combinations thereof are not excluded in advance.

The vehicle described herein may be a concept including an automobile and a motorcycle. Hereinafter, a vehicle is mainly described for a vehicle.

The vehicle described in this specification may be a concept including both an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source, and an electric vehicle having an electric motor as a power source.

In the following description, the left side of the vehicle means the left side of the driving direction of the vehicle, and the right side of the vehicle means the right side of the driving direction of the vehicle.

1 is a view showing the appearance of a vehicle according to an embodiment of the present invention.

2 is a view of a vehicle according to an embodiment of the present invention viewed from various angles outside.

3 to 4 are views showing the interior of a vehicle according to an embodiment of the present invention.

5 to 6 are views referred to for describing an object according to an embodiment of the present invention.

7 is a block diagram referred to for describing a vehicle according to an embodiment of the present invention.

1 to 7, the vehicle 100 may include a wheel rotated by a power source and a steering input device 510 for adjusting the traveling direction of the vehicle 100.

The vehicle 100 may be an autonomous vehicle.

The vehicle 100 may be switched to an autonomous driving mode or a manual mode based on a user input.

For example, the vehicle 100 may be switched from the manual mode to the autonomous driving mode or the autonomous driving mode to the manual mode based on the received user input through the user interface device 200.

The vehicle 100 may be switched to an autonomous driving mode or a manual mode based on driving situation information. The driving situation information may be generated based on object information provided by the object detection device 300.

For example, the vehicle 100 may be switched from the manual mode to the autonomous driving mode or from the autonomous driving mode to the manual mode based on the driving situation information generated by the object detection device 300.

For example, the vehicle 100 may be switched from the manual mode to the autonomous driving mode, or may be switched from the autonomous driving mode to the manual mode based on the driving situation information received through the communication device 400.

The vehicle 100 may be switched from a manual mode to an autonomous driving mode based on information, data, and signals provided from an external device, or may be switched from an autonomous driving mode to a manual mode.

When the vehicle 100 is operated in an autonomous driving mode, the autonomous vehicle 100 may be operated based on the driving system 700.

For example, the autonomous vehicle 100 may be driven based on information, data, or signals generated by the driving system 710, the exit system 740, and the parking system 750.

When the vehicle 100 is operated in the manual mode, the autonomous vehicle 100 may receive a user input for driving through the driving manipulation device 500. The vehicle 100 may be driven based on a user input received through the driving manipulation apparatus 500.

Overall length is the length from the front to the rear of the vehicle 100, width is the width of the vehicle 100, and height is the length from the bottom of the wheel to the roof. In the following description, the full-length direction L is a direction that is a reference for measuring the full-length of the vehicle 100, the full-width direction W is a direction that is a reference for the full-width measurement of the vehicle 100, and the front direction H is the vehicle It may mean a direction that is a reference for measuring the height of the (100).

As illustrated in FIG. 7, the vehicle 100 includes a user interface device 200, an object detection device 300, a communication device 400, a driving operation device 500, a vehicle driving device 600, and a driving system 700, a navigation system 770, a sensing unit 120, an interface unit 130, a memory 140, a control unit 170 and a power supply unit.

According to an embodiment, the vehicle 100 may further include other components in addition to the components described in this specification, or may not include some of the components described.

The user interface device 200 is a device for communication between the vehicle 100 and a user. The user interface device 200 may receive user input and provide information generated in the vehicle 100 to the user. The vehicle 100 may implement User Interfaces (UI) or User Experience (UX) through the user interface device 200.

The user interface device 200 may include an input unit 210, an internal camera 220, a biometric sensing unit 230, an output unit 250, and a processor 270.

According to an embodiment, the user interface device 200 may further include other components in addition to the components described, or may not include some of the components described.

The input unit 200 is for receiving information from a user, and data collected by the input unit may be analyzed by the processor 270 and processed by a user's control command.

The input unit 200 may be disposed inside the vehicle. For example, the input unit 200 includes a region of a steering wheel, a region of an instrument panel, a region of a seat, a region of each pillar, and a door One area of the door, one area of the center console, one area of the head lining, one area of the sun visor, one area of the windshield or one of the windows It can be arranged in one area or the like.

The input unit 200 may include a voice input unit 211, a gesture input unit 212, a touch input unit 213, and a mechanical input unit 214.

The voice input unit 211 may convert a user's voice input into an electrical signal. The converted electrical signal may be provided to the processor 270 or the control unit 170.

The voice input unit 211 may include one or more microphones.

The gesture input unit 212 may convert a user's gesture input into an electrical signal. The converted electrical signal may be provided to the processor 270 or the control unit 170.

The gesture input unit 212 may include at least one of an infrared sensor and an image sensor for sensing a user's gesture input.

According to an embodiment, the gesture input unit 212 may detect a user's 3D gesture input. To this end, the gesture input unit 212 may include a light output unit outputting a plurality of infrared light or a plurality of image sensors.

The gesture input unit 212 may detect a user's 3D gesture input through a time of flight (TOF) method, a structured light method, or a disparity method.

The touch input unit 213 may convert a user's touch input into an electrical signal. The converted electrical signal may be provided to the processor 270 or the controller 170.

The touch input unit 213 may include a touch sensor for detecting a user's touch input.

According to an exemplary embodiment, the touch input unit 213 may be integrally formed with the display unit 251 to implement a touch screen. The touch screen may provide an input interface and an output interface between the vehicle 100 and a user.

The mechanical input unit 214 may include at least one of a button, a dome switch, a jog wheel, and a jog switch. The electrical signal generated by the mechanical input unit 214 may be provided to the processor 270 or the control unit 170.

The mechanical input unit 214 may be disposed on a steering wheel, center fascia, center console, cock module, door, or the like.

The internal camera 220 may acquire an image inside the vehicle. The processor 270 may detect a user's state based on an image inside the vehicle. The processor 270 may acquire the user's gaze information from the image inside the vehicle. The processor 270 may detect a gesture of the user from the image inside the vehicle.

The biometric sensing unit 230 may acquire biometric information of the user. The biometric sensing unit 230 may include a sensor capable of acquiring biometric information of the user, and may acquire fingerprint information of the user, heartbeat information, and the like using the sensor. Biometric information may be used for user authentication.

The output unit 250 is for generating output related to vision, hearing, or tactile sense.

The output unit 250 may include at least one of a display unit 251, an audio output unit 252, and a haptic output unit 253.

The display unit 251 may display graphic objects corresponding to various information.

The display unit 251 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). display), a three-dimensional display (3D display), an electronic ink display (e-ink display).

The display unit 251 forms a mutual layer structure with the touch input unit 213 or is integrally formed, thereby realizing a touch screen.

The display unit 251 may be implemented as a head up display (HUD). When the display unit 251 is implemented as a HUD, the display unit 251 may include a projection module to output information through a wind shield or an image projected on the window.

The display unit 251 may include a transparent display. The transparent display can be attached to a wind shield or window.

The transparent display can display a predetermined screen while having a predetermined transparency. The transparent display, in order to have transparency, the transparent display is transparent TFEL (Thin Film Elecroluminescent), transparent OLED (Organic Light-Emitting Diode), transparent LCD (Liquid Crystal Display), transmissive transparent display, transparent LED (Light Emitting Diode) display It may include at least one of. The transparency of the transparent display can be adjusted.

Meanwhile, the user interface device 200 may include a plurality of display units 251a to 251g.

The display unit 251 includes one area of the steering wheel, one area of the instrument panel (521a, 251b, 251e), one area of the seat 251d, one area of each pillar 251f, and one area of the door ( 251g), one area of the center console, one area of the head lining, one area of the sun visor, or one area 251c of the wind shield or one area 251h of the window.

The audio output unit 252 converts and outputs an electrical signal provided from the processor 270 or the controller 170 into an audio signal. To this end, the sound output unit 252 may include one or more speakers.

The haptic output unit 253 generates a tactile output. For example, the haptic output unit 253 may operate by vibrating the steering wheel, seat belt, and seats 110FL, 110FR, 110RL, 110RR, so that the user can recognize the output.

The processor 270 may control the overall operation of each unit of the user interface device 200.

According to an embodiment, the user interface device 200 may include a plurality of processors 270 or may not include a processor 270.

When the processor 270 is not included in the user interface device 200, the user interface device 200 may be operated under the control of the processor or control unit 170 of another device in the vehicle 100.

Meanwhile, the user interface device 200 may be referred to as a vehicle display device.

The user interface device 200 may be operated under the control of the control unit 170.

The object detection device 300 is a device for detecting an object located outside the vehicle 100.

The object may be various objects related to the operation of the vehicle 100.

5 to 6, the object O is a lane OB10, another vehicle OB11, a pedestrian OB12, a two-wheeled vehicle OB13, traffic signals OB14, OB15, light, road, structure, It may include a speed bump, terrain, and animals.

The lane OB10 may be a driving lane, a lane next to the driving lane, or a lane in which the opposite vehicle travels. The lane OB10 may be a concept including left and right lines forming a lane.

The other vehicle OB11 may be a vehicle driving around the vehicle 100. The other vehicle may be a vehicle located within a predetermined distance from the vehicle 100. For example, the other vehicle OB11 may be a vehicle that precedes or follows the vehicle 100.

The pedestrian OB12 may be a person located around the vehicle 100. The pedestrian OB12 may be a person located within a predetermined distance from the vehicle 100. For example, the pedestrian OB12 may be a person located on a sidewalk or a road.

The two-wheeled vehicle OB12 may be located near the vehicle 100 and may move using two wheels. The two-wheeled vehicle OB12 may be a vehicle having two wheels positioned within a predetermined distance from the vehicle 100. For example, the two-wheeled vehicle OB13 may be a motorcycle or a bicycle located on a sidewalk or a road.

The traffic signal may include a traffic light OB15, a traffic sign OB14, a pattern or text drawn on the road surface.

The light may be light generated from a lamp provided in another vehicle. Light can be light generated from street lights. The light can be sunlight.

Roads may include slopes, such as road surfaces, curves, uphills, downhills, and the like.

The structure may be an object located around the road and fixed to the ground. For example, the structure may include street lights, street trees, buildings, power poles, traffic lights, and bridges.

Terrain can include mountains, hills, and the like.

Meanwhile, the object may be classified into a moving object and a fixed object. For example, the moving object may be a concept including other vehicles and pedestrians. For example, the fixed object may be a concept including traffic signals, roads, and structures.

The object detection device 300 may include a camera 310, a radar 320, a lidar 330, an ultrasonic sensor 340, an infrared sensor 350, and a processor 370.

According to an embodiment, the object detection apparatus 300 may further include other components in addition to the components described, or may not include some of the components described.

The camera 310 may be located at an appropriate location outside the vehicle in order to acquire an image outside the vehicle. The camera 310 may be a mono camera, a stereo camera 310a, an AVM (Around View Monitoring) camera 310b, or a 360 degree camera.

For example, the camera 310 may be disposed close to the front windshield, in the interior of the vehicle, to obtain an image in front of the vehicle. Alternatively, the camera 310 may be disposed around the front bumper or radiator grille.

For example, the camera 310 may be disposed close to the rear glass, in the interior of the vehicle, in order to acquire an image behind the vehicle. Alternatively, the camera 310 may be disposed around the rear bumper, trunk, or tail gate.

For example, the camera 310 may be disposed close to at least one of the side windows in the interior of the vehicle in order to acquire an image of the vehicle side. Alternatively, the camera 310 may be disposed around a side mirror, fender, or door.

The camera 310 may provide the obtained image to the processor 370.

The radar 320 may include an electromagnetic wave transmitting unit and a receiving unit. The radar 320 may be implemented in a pulse radar method or a continuous wave radar method in accordance with the principle of radio wave launch. The radar 320 may be implemented by a FMCW (Frequency Modulated Continuous Wave) method or a FSK (Frequency Shift Keyong) method according to a signal waveform among continuous wave radar methods.

The radar 320 detects an object based on a time of flight (TOF) method or a phase-shift method via electromagnetic waves, the position of the detected object, the distance from the detected object, and a relative speed Can be detected.

The radar 320 may be placed at an appropriate location outside the vehicle to detect objects located in the front, rear, or side of the vehicle.

The lidar 330 may include a laser transmitter and a receiver. The lidar 330 may be implemented by a time of flight (TOF) method or a phase-shift method.

The lidar 330 may be implemented in a driving type or a non-driving type.

When implemented in a driving type, the lidar 330 is rotated by a motor and can detect objects around the vehicle 100.

When implemented in a non-driven manner, the rider 330 may detect an object located within a predetermined range based on the vehicle 100 by optical steering. The vehicle 100 may include a plurality of non-driven lidars 330.

The lidar 330 detects an object based on a time of flight (TOF) method or a phase-shift method using laser light, and the position of the detected object, the distance to the detected object, and Relative speed can be detected.

The lidar 330 may be disposed at an appropriate location outside the vehicle in order to detect objects located in the front, rear, or side of the vehicle.

The ultrasonic sensor 340 may include an ultrasonic transmitter and a receiver. The ultrasonic sensor 340 may detect an object based on ultrasonic waves and detect a position of the detected object, a distance from the detected object, and a relative speed.

The ultrasonic sensor 340 may be disposed at an appropriate location outside the vehicle in order to sense an object located in front, rear, or side of the vehicle.

The infrared sensor 350 may include an infrared transmitter and a receiver. The infrared sensor 340 may detect an object based on infrared light, and detect a position of the detected object, a distance from the detected object, and a relative speed.

The infrared sensor 350 may be disposed at an appropriate location outside the vehicle to sense an object located in front, rear, or side of the vehicle.

The processor 370 may control the overall operation of each unit of the object detection device 300.

The processor 370 may detect and track an object based on the acquired image. The processor 370 may perform operations such as calculating the distance to the object and calculating the relative speed with the object through an image processing algorithm.

The processor 370 may detect and track the object based on the reflected electromagnetic wave from which the transmitted electromagnetic wave is reflected and returned. The processor 370 may perform operations such as calculating a distance from the object and calculating a relative speed with the object based on electromagnetic waves.

The processor 370 may detect and track the object based on the reflected laser light from which the transmitted laser is reflected and returned. The processor 370 may perform operations such as calculating the distance to the object and calculating the relative speed with the object, based on the laser light.

The processor 370 may detect and track the object based on the reflected ultrasonic waves from which the transmitted ultrasonic waves are reflected and returned. The processor 370 may perform operations such as calculating the distance to the object and calculating the relative speed with the object, based on ultrasound.

The processor 370 may detect and track the object based on the reflected infrared light from which the transmitted infrared light is reflected and returned. The processor 370 may perform operations such as calculating the distance to the object and calculating the relative speed with the object based on infrared light.

According to an embodiment, the object detection apparatus 300 may include a plurality of processors 370 or may not include a processor 370. For example, each of the camera 310, the radar 320, the lidar 330, the ultrasonic sensor 340, and the infrared sensor 350 may individually include a processor.

When the processor 370 is not included in the object detection device 300, the object detection device 300 may be operated under the control of the processor or control unit 170 of the device in the vehicle 100.

The object detection device 400 may be operated under the control of the control unit 170.

The communication device 400 is a device for performing communication with an external device. Here, the external device may be another vehicle, signage, or server.

The communication device 400 may include at least one of a transmitting antenna, a receiving antenna, a radio frequency (RF) circuit capable of implementing various communication protocols, and an RF element to perform communication.

The communication device 400 may include a short-range communication unit 410, a location information unit 420, a V2X communication unit 430, an optical communication unit 440, a broadcast transmission/reception unit 450, and a processor 470.

According to an embodiment, the communication device 400 may further include other components in addition to the components described, or may not include some of the components described.

The short-range communication unit 410 is a unit for short-range communication. The short-range communication unit 410 includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), and Wireless Wi-Fi It can support short-range communication by using at least one of -Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology.

The short-range communication unit 410 may form short-range wireless communication networks (Wireless Area Networks) to perform short-range communication between the vehicle 100 and at least one external device.

The location information unit 420 is a unit for obtaining location information of the vehicle 100. For example, the location information unit 420 may include a Global Positioning System (GPS) module or a Differential Global Positioning System (DGPS) module.

The V2X communication unit 430 is a unit for performing wireless communication with a server (V2I: Vehicle to Infra), another vehicle (V2V: Vehicle to Vehicle), or a pedestrian (V2P: Vehicle to Pedestrian). The V2X communication unit 430 may include an RF circuit capable of implementing communication (V2I) with an infrastructure, communication between vehicles (V2V), and communication with a pedestrian (V2P).

The optical communication unit 440 is a unit for performing communication with an external device via light. The optical communication unit 440 may include an optical transmitter that converts an electrical signal into an optical signal and transmits it to the outside, and an optical receiver that converts the received optical signal into an electrical signal.

According to an embodiment, the light emitting unit may be formed integrally with a lamp included in the vehicle 100.

The broadcast transmitting/receiving unit 450 is a unit for receiving a broadcast signal from an external broadcast management server through a broadcast channel or transmitting a broadcast signal to the broadcast management server. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal.

The processor 470 may control the overall operation of each unit of the communication device 400.

Depending on the embodiment, the communication device 400 may include a plurality of processors 470 or may not include a processor 470.

When the processor 470 is not included in the communication device 400, the communication device 400 may be operated under the control of the processor or control unit 170 of another device in the vehicle 100.

Meanwhile, the communication device 400 may implement a vehicle display device together with the user interface device 200. In this case, the vehicle display device may be referred to as a telematics device or an audio video navigation (AVN) device.

The communication device 400 may be operated under the control of the control unit 170.

The driving operation device 500 is a device that receives a user input for driving.

In the manual mode, the vehicle 100 may be driven based on a signal provided by the driving manipulation apparatus 500.

The driving manipulation device 500 may include a steering input device 510, an acceleration input device 530, and a brake input device 570.

The steering input device 510 may receive an input of a traveling direction of the vehicle 100 from a user. The steering input device 510 is preferably formed in a wheel shape to enable steering input by rotation. According to an embodiment, the steering input device may be formed in the form of a touch screen, a touch pad, or a button.

The acceleration input device 530 may receive an input for acceleration of the vehicle 100 from a user. The brake input device 570 may receive an input for deceleration of the vehicle 100 from a user. The acceleration input device 530 and the brake input device 570 are preferably formed in the form of a pedal. According to an embodiment, the acceleration input device or the brake input device may be formed in the form of a touch screen, a touch pad or a button.

The driving operation apparatus 500 may be operated under the control of the control unit 170.

The vehicle driving device 600 is a device that electrically controls driving of various devices in the vehicle 100.

The vehicle driving device 600 includes a power train driving part 610, a chassis driving part 620, a door/window driving part 630, a safety device driving part 640, a lamp driving part 650 and an air conditioning driving part 660. You can.

According to an embodiment, the vehicle driving apparatus 600 may further include other components in addition to the components described, or may not include some of the components described.

Meanwhile, the vehicle driving apparatus 600 may include a processor. Each unit of the vehicle driving apparatus 600 may individually include a processor.

The power train driver 610 may control the operation of the power train device.

The power train driving unit 610 may include a power source driving unit 611 and a transmission driving unit 612.

The power source driving unit 611 may control the power source of the vehicle 100.

For example, when the fossil fuel-based engine is a power source, the power source driving unit 610 may perform electronic control of the engine. Thereby, the output torque of an engine, etc. can be controlled. The power source driving unit 611 can adjust the engine output torque under the control of the control unit 170.

For example, when the electric energy-based motor is a power source, the power source driving unit 610 may perform control for the motor. The power source driving unit 610 may adjust the rotational speed, torque, and the like of the motor under the control of the control unit 170.

The transmission driver 612 may perform control of the transmission.

The transmission drive unit 612 can adjust the state of the transmission. The transmission drive unit 612 can adjust the state of the transmission to forward (D), reverse (R), neutral (N), or parking (P).

On the other hand, when the engine is a power source, the transmission drive unit 612 can adjust the engagement state of the gear in the forward (D) state.

The chassis driver 620 may control the operation of the chassis device.

The chassis driving unit 620 may include a steering driving unit 621, a brake driving unit 622, and a suspension driving unit 623.

The steering driving unit 621 may perform electronic control of a steering apparatus in the vehicle 100. The steering driving unit 621 may change the traveling direction of the vehicle.

The brake driving unit 622 may perform electronic control of a brake apparatus in the vehicle 100. For example, by controlling the operation of the brake disposed on the wheel, the speed of the vehicle 100 can be reduced.

Meanwhile, the brake driving unit 622 can individually control each of the plurality of brakes. The brake driving unit 622 may control braking forces applied to the plurality of wheels differently.

The suspension driving unit 623 may perform electronic control of a suspension apparatus in the vehicle 100. For example, the suspension driving unit 623 may control the suspension device to control vibration of the vehicle 100 when the road surface is curved, by controlling the suspension device.

Meanwhile, the suspension driving unit 623 can individually control each of the plurality of suspensions.

The door/window driving unit 630 may perform electronic control of a door apparatus or window apparatus in the vehicle 100.

The door/window driving unit 630 may include a door driving unit 631 and a window driving unit 632.

The door driving unit 631 may perform control of the door device. The door driver 631 can control opening and closing of a plurality of doors included in the vehicle 100. The door driver 631 may control opening or closing of a trunk or tail gate. The door driving unit 631 may control opening or closing of a sunroof.

The window driver 632 may perform electronic control of a window apparatus. The opening or closing of a plurality of windows included in the vehicle 100 may be controlled.

The safety device driver 640 may perform electronic control of various safety devices in the vehicle 100.

The safety device driving unit 640 may include an airbag driving unit 641, a seat belt driving unit 642, and a pedestrian protection device driving unit 643.

The airbag driving unit 641 may perform electronic control of an airbag apparatus in the vehicle 100. For example, the airbag driving unit 641 may control the airbag to be deployed when a danger is detected.

The seatbelt driving unit 642 may perform electronic control of a seatbelt appartus in the vehicle 100. For example, the seat belt driving unit 642 may control the passenger to be fixed to the seats 110FL, 110FR, 110RL, and 110RR using the seat belt when the danger is detected.

The pedestrian protection device driver 643 may perform electronic control of the hood lift and the pedestrian airbag. For example, the pedestrian protection device driving unit 643 may control a hood lift-up and a pedestrian airbag to be deployed upon collision detection with a pedestrian.

The lamp driving unit 650 may perform electronic control of various lamp apparatuses in the vehicle 100.

The air conditioning driving unit 660 may perform electronic control of an air cinditioner in the vehicle 100. For example, when the temperature inside the vehicle is high, the air conditioning driving unit 660 may control the air conditioning device to operate so that cold air is supplied into the vehicle.

The vehicle driving apparatus 600 may include a processor. Each unit of the vehicle driving apparatus 600 may individually include a processor.

The vehicle driving apparatus 600 may be operated under the control of the control unit 170.

The operation system 700 is a system that controls various operations of the vehicle 100. The driving system 700 may be operated in an autonomous driving mode.

The driving system 700 may include a driving system 710, an exit system 740, and a parking system 750.

Depending on the embodiment, the driving system 700 may further include other components in addition to the components described, or may not include some of the components described.

Meanwhile, the driving system 700 may include a processor. Each unit of the driving system 700 may individually include a processor.

Meanwhile, according to an embodiment, when the driving system 700 is implemented in software, it may be a sub-concept of the control unit 170.

Meanwhile, according to an embodiment, the driving system 700 may include at least one of the user interface device 200, the object detection device 300, the communication device 400, the vehicle driving device 600, and the control unit 170. It can be an inclusive concept.

The driving system 710 may perform driving of the vehicle 100.

The driving system 710 may receive navigation information from the navigation system 770 and provide a control signal to the vehicle driving device 600 to perform driving of the vehicle 100.

The driving system 710 may receive object information from the object detection device 300 and provide a control signal to the vehicle driving device 600 to perform driving of the vehicle 100.

The driving system 710 may receive a signal from an external device through the communication device 400 and provide a control signal to the vehicle driving device 600 to perform driving of the vehicle 100.

The unloading system 740 may perform unloading of the vehicle 100.

The unloading system 740 may receive navigation information from the navigation system 770 and provide a control signal to the vehicle driving apparatus 600 to perform the unloading of the vehicle 100.

The unloading system 740 may receive object information from the object detection device 300 and provide a control signal to the vehicle driving device 600 to perform the unloading of the vehicle 100.

The unloading system 740 may receive a signal from an external device through the communication device 400, provide a control signal to the vehicle driving apparatus 600, and perform the unloading of the vehicle 100.

The parking system 750 may perform parking of the vehicle 100.

The parking system 750 may receive the navigation information from the navigation system 770 and provide a control signal to the vehicle driving apparatus 600 to perform parking of the vehicle 100.

The parking system 750 may receive object information from the object detection device 300 and provide a control signal to the vehicle driving device 600 to perform parking of the vehicle 100.

The parking system 750 may receive a signal from an external device through the communication device 400, provide a control signal to the vehicle driving apparatus 600, and perform parking of the vehicle 100.

The navigation system 770 may provide navigation information. The navigation information may include at least one of map information, set destination information, route information according to the destination setting, information on various objects on the route, lane information, and current location information of the vehicle.

The navigation system 770 may include a memory and a processor. The memory can store navigation information. The processor can control the operation of the navigation system 770.

According to an embodiment, the navigation system 770 may receive information from an external device through the communication device 400 and update pre-stored information.

According to an embodiment, the navigation system 770 may be classified as a sub-component of the user interface device 200.

The sensing unit 120 may sense the state of the vehicle. The sensing unit 120 includes a posture sensor (for example, a yaw sensor, a roll sensor, a pitch sensor), a collision sensor, a wheel sensor, a speed sensor, and an inclination Sensor, weight sensor, heading sensor, yaw sensor, gyro sensor, position module, vehicle forward/reverse sensor, battery sensor, fuel sensor, tire sensor, handle It may include a steering sensor by rotation, a temperature sensor inside the vehicle, a humidity sensor inside the vehicle, an ultrasonic sensor, an illuminance sensor, an accelerator pedal position sensor, a brake pedal position sensor, and the like.

The sensing unit 120 includes vehicle attitude information, vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward/reverse information, battery Acquire sensing signals for information, fuel information, tire information, vehicle lamp information, vehicle interior temperature information, vehicle interior humidity information, steering wheel rotation angle, vehicle exterior roughness, pressure applied to the accelerator pedal, and pressure applied to the brake pedal. can do.

The sensing unit 120 includes, in addition, an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake air temperature sensor (ATS), a water temperature sensor (WTS), and a throttle position sensor (TPS), a TDC sensor, a crank angle sensor (CAS), and the like.

The interface unit 130 may serve as a passage with various types of external devices connected to the vehicle 100. For example, the interface unit 130 may be provided with a port connectable to the signage, and may be connected to the signage through the port. In this case, the interface unit 130 may exchange data with the signage.

Meanwhile, the interface unit 130 may serve as a passage for supplying electrical energy to the connected signage. When the signage is electrically connected to the interface unit 130, under the control of the control unit 170, the interface unit 130 may provide electrical energy supplied from the power supply unit to the signage.

The memory 140 is electrically connected to the control unit 170. The memory 140 may store basic data for the unit, control data for controlling the operation of the unit, and input/output data. The memory 140 may be various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, and the like in hardware. The memory 140 may store various data for the overall operation of the vehicle 100, such as a program for processing or controlling the control unit 170.

According to an embodiment, the memory 140 may be integrally formed with the control unit 170 or may be implemented as a lower component of the control unit 170.

The control unit 170 may control the overall operation of each unit in the vehicle 100. The control unit 170 may be referred to as an electronic control unit (ECU).

The power supply unit may supply power required for the operation of each component under the control of the control unit 170. In particular, the power supply unit may receive power from a battery or the like inside the vehicle.

One or more processors and controls 170 included in the vehicle 100 include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), FPGAs ( Field programmable gate arrays), processors, controllers, micro-controllers, microprocessors, and other electrical units for performing functions can be implemented.

Content related to the vehicle 100 described with reference to FIGS. 1 to 7 may be included in the transportation means 910 described below. That is, the transportation means 910 related to the present invention may include at least one of the components described in FIGS. 1 to 7.

Hereinafter, a signage capable of communicating with a vehicle (or transportation means) will be described in detail with reference to the accompanying drawings.

8 is a block diagram illustrating a signage according to an embodiment of the present invention.

The signage 800 includes a wireless communication unit 810, an input unit 820, a sensing unit 840, an output unit 850, an interface unit 860, a memory 870, a control unit 880, and a power supply unit 890 ) And the like. The components shown in FIG. 1A are not essential in implementing signage, so the signage described herein may have more or fewer components than those listed above.

More specifically, among the above components, the wireless communication unit 810 is between a signage 800 and a wireless communication system, between a signage 800 and another signage 800, or a signage 800 and an external server. It may include one or more modules that enable wireless communication between. In addition, the wireless communication unit 810 may include one or more modules connecting the signage 800 to one or more networks.

The wireless communication unit 810 may include at least one of a broadcast receiving module 811, a mobile communication module 812, a wireless Internet module 813, a short-range communication module 814, and a location information module 815. .

The input unit 820 is a camera 821 or video input unit for inputting a video signal, a microphone (microphone 822) for inputting an audio signal, or an audio input unit, a user input unit 823 for receiving information from a user, for example , A touch key, a mechanical key, and the like. The voice data or image data collected by the input unit 820 may be analyzed and processed by a user's control command.

The sensing unit 840 may include one or more sensors for sensing at least one of information in the signage, surrounding environment information surrounding the signage, and user information. For example, the sensing unit 840 includes a proximity sensor 841, an illumination sensor 842, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity G-sensor, gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor), fingerprint scan sensor, ultrasonic sensor , Optical sensor (e.g., camera (see 821)), microphone (see 822), battery gauge, environmental sensor (e.g. barometer, hygrometer, thermometer, radioactivity sensor, Thermal sensor, gas sensor, and the like), and a chemical sensor (eg, an electronic nose, a health care sensor, a biometric sensor, etc.). Meanwhile, the signage disclosed in the present specification may combine and use information sensed by at least two or more of these sensors.

The output unit 850 is for generating output related to vision, hearing, or tactile sense, and includes at least one of a display unit 851, an audio output unit 852, a hap tip module 853, and an optical output unit 854 can do. The display unit 851 may form a mutual layer structure with the touch sensor or may be integrally formed, thereby realizing a touch screen. The touch screen may function as a user input unit 823 providing an input interface between the signage 800 and the user, and at the same time, may provide an output interface between the signage 800 and the user.

The interface unit 860 serves as a passage with various types of external devices connected to the signage 800. The interface unit 860 connects devices equipped with a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port. In the signage 800, in response to an external device being connected to the interface unit 860, appropriate control related to the connected external device may be performed.

In addition, the memory 870 stores data supporting various functions of the signage 800. The memory 870 may store a number of application programs or applications that are driven by the signage 800 and data and instructions for the operation of the signage 800. At least some of these applications can be downloaded from external servers via wireless communication. In addition, at least some of these applications may exist on the signage 800 from the time of shipment for the basic functions of the signage 800 (eg, an incoming call, a calling function, a message reception, a calling function). Meanwhile, the application program may be stored in the memory 870 and installed on the signage 800 to be driven by the control unit 880 to perform an operation (or function) of the signage.

The control unit 880 generally controls the overall operation of the signage 800 in addition to the operations related to the application program. The controller 880 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 870.

In addition, the control unit 880 may control at least some of the components described with reference to FIG. 1A in order to drive the application program stored in the memory 870. Further, the control unit 880 may operate by combining at least two or more of the components included in the signage 800 for driving the application program.

Under the control of the control unit 880, the power supply unit 190 receives external power and internal power to supply power to each component included in the signage 800. The power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the components may operate in cooperation with each other to implement the operation, control, or control method of the signage according to various embodiments described below. Also, the operation, control, or control method of the signage may be implemented on the signage by driving at least one application program stored in the memory 870.

Hereinafter, before looking at various embodiments implemented through the signage 800 described above, the components listed above will be described in more detail with reference to FIG. 8.

First, referring to the wireless communication unit 810, the broadcast reception module 811 of the wireless communication unit 810 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more of the broadcast reception modules may be provided to the signage 800 for simultaneous broadcast reception or switching of broadcast channels for at least two broadcast channels.

The broadcast management server may refer to a server that generates and transmits broadcast signals and/or broadcast-related information or a server that receives previously generated broadcast signals and/or broadcast-related information and transmits them to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, as well as a TV broadcast signal or a radio broadcast signal combined with a data broadcast signal.

The broadcast signal may be encoded according to at least one of technical standards (or broadcast methods, for example, ISO, IEC, DVB, ATSC, etc.) for transmitting and receiving digital broadcast signals, and the broadcast receiving module 811 may be The digital broadcast signal may be received using a method suitable for the technical standard determined by the technical standards.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 812.

The broadcast-related information may exist in various forms, such as Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H). The broadcast signal and/or broadcast-related information received through the broadcast receiving module 811 may be stored in the memory 870.

The mobile communication module 812 includes technical standards or communication methods for mobile communication (eg, Global System for Mobile Communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), EV -Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (DO), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), LTE-A (Long Term Evolution-Advanced), etc.) to transmit and receive radio signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network.

The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 813 refers to a module for wireless Internet access, and may be built in or external to the signage 800. The wireless Internet module 813 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World) Interoperability for Microwave Access (HSDPA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), and the wireless Internet module ( 813) transmits and receives data according to at least one wireless Internet technology in a range including the Internet technology not listed above.

In view of the wireless Internet access through WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc., through the mobile communication network, the wireless Internet module 813 that performs wireless Internet access through the mobile communication network ) May be understood as a type of the mobile communication module 812.

The short-range communication module 814 is for short-range communication, Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, NFC (Near Field Communication), by using at least one of Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, Wireless USB (Wireless Universal Serial Bus) technology, it can support short-range communication. The short-range communication module 814 may include a signage 800 and a wireless communication system, a signage 800 and another signage 800, or a signage 800 through wireless area networks. ) And other signage (800, or an external server) is located between the network can support wireless communication. The short-range wireless communication network may be wireless personal area networks.

Here, the other signage 800 is a wearable device (e.g., a smartwatch) or smart glasses capable of exchanging data (or interlocking) with the signage 800 according to the present invention. (smart glass), HMD (head mounted display). The short-range communication module 814 may detect (or recognize) a wearable device capable of communicating with the signage 800 around the signage 800. Furthermore, when the detected wearable device is a device authenticated to communicate with the signage 800 according to the present invention, the control unit 880 may include at least a portion of the data processed by the signage 800, the short-range communication module ( 814) can be transmitted to the wearable device. Therefore, the user of the wearable device can use the data processed by the signage 800 through the wearable device. For example, according to this, the user performs a phone call through the wearable device when a call is received by the signage 800, or when a message is received by the signage 800, when the call is received through the wearable device It is possible to check the message.

The location information module 815 is a module for obtaining a location (or current location) of a signage, and a typical example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, if the signage uses a GPS module, the location of the signage can be obtained using a signal from a GPS satellite. As another example, when a signage is used, the location of the signage may be obtained based on information of a wireless access point (AP) that transmits or receives a wireless signal with the Wi-Fi module. If necessary, the location information module 815 may perform any function among other modules of the wireless communication unit 810 in order to substitute or additionally obtain data regarding the location of the signage. The location information module 815 is a module used to acquire the location (or current location) of the signage, and is not limited to a module that directly calculates or acquires the location of the signage.

Next, the input unit 820 is for input of image information (or signals), audio information (or signals), data, or information input from a user. For input of image information, the signage 800 is one Alternatively, a plurality of cameras 821 may be provided. The camera 821 processes a video frame such as a still image or video obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display portion 851 or stored in the memory 870. Meanwhile, the plurality of cameras 821 provided in the signage 800 may be arranged to form a matrix structure, and through the camera 821 forming the matrix structure, various angles or focuses may be applied to the signage 800. A plurality of image information may be input. Also, the plurality of cameras 821 may be arranged in a stereo structure to acquire left and right images for realizing a stereoscopic image.

The microphone 822 processes external sound signals as electrical voice data. The processed voice data may be used in various ways according to a function (or a running application program) being performed by the signage 800. Meanwhile, various noise cancellation algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 822.

The user input unit 823 is for receiving information from a user. When information is input through the user input unit 823, the control unit 880 may control the operation of the signage 800 to correspond to the inputted information. . The user input unit 823 is a mechanical input means (or a mechanical key, for example, a button located on the front or rear or side of the signage 800, a dome switch, a jog wheel, Jog switch, etc.) and a touch input means. As an example, the touch-type input means is made of a virtual key, a soft key or a visual key displayed on the touch screen through software processing, or a part other than the touch screen It may be made of a touch key (touch key) disposed on. Meanwhile, the virtual key or the visual key may be displayed on the touch screen while having various forms, for example, a graphic, text, icon, video, or the like. It can be made of a combination of.

Meanwhile, the sensing unit 840 senses at least one of information in the signage, surrounding environment information surrounding the signage, and user information, and generates a sensing signal corresponding thereto. The controller 880 may control driving or operation of the signage 800 based on the sensing signal, or perform data processing, functions, or operations related to an application program installed in the signage 800. Representative sensors among various sensors that may be included in the sensing unit 840 will be described in more detail.

First, the proximity sensor 841 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object in the vicinity using mechanical force or infrared light, etc., without mechanical contact. In the proximity sensor 841, the proximity sensor 841 may be disposed in the inner region of the signage surrounded by the touch screen as described above or near the touch screen.

Examples of the proximity sensor 841 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the proximity sensor 841 may be configured to detect the proximity of the object with a change in electric field according to the proximity of the conductive object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of description, the act of allowing the object to be recognized as being located on the touch screen without being touched on the touch screen is called a "proximity touch", and the touch The act of actually touching an object on the screen is called "contact touch". The location where an object is in close touch on the touch screen means a location where the object is vertically corresponding to the touch screen when the object is touched in close proximity. The proximity sensor 841 may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). have. Meanwhile, the control unit 880 processes the data (or information) corresponding to the proximity touch operation and the proximity touch pattern detected through the proximity sensor 841, and further visual information corresponding to the processed data. It can be output on the touch screen. Furthermore, the control unit 880 may control the signage 800 such that different operations or data (or information) are processed according to whether a touch on the same point on the touch screen is a proximity touch or a touch touch. .

The touch sensor uses a touch (or a touch input) applied to the touch screen (or display unit 851) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. Detect.

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific part of the touch screen or capacitance generated in the specific part into an electrical input signal. The touch sensor may be configured to detect a location, an area, a pressure when a touch is touched, a capacitance when a touch object is touched on the touch screen, and the like. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen or a stylus pen, a pointer, and the like.

As such, when there is a touch input to the touch sensor, the signal(s) corresponding to the touch is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the control unit 880. Accordingly, the control unit 880 can know which area of the display unit 851 has been touched. Here, the touch controller may be a separate component from the control unit 880, or may be the control unit 880 itself.

Meanwhile, the control unit 880 may perform different controls or perform the same control according to the type of the touch object that touches the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different control or the same control according to the type of the touch object, it may be determined according to an operating state of the current signage 800 or an application program being executed.

On the other hand, the touch sensors and proximity sensors described above are independently or in combination, such as short (or tap) touch on the touch screen, long touch, multi touch, drag touch ), flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, etc. You can sense the touch.

The ultrasonic sensor may recognize location information of a sensing target using ultrasonic waves. Meanwhile, the control unit 880 may calculate the position of the wave generating source through information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave generator can be calculated by using a property in which light is much faster than ultrasonic waves, that is, a time when light reaches the optical sensor is much faster than a time when ultrasonic waves reach the ultrasonic sensor. More specifically, the position of the wave generator may be calculated by using a time difference from the time at which the ultrasound reaches the light as a reference signal.

On the other hand, the camera 821, which is considered as the configuration of the input unit 820, includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor.

The camera 821 and the laser sensor are combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. The photo sensor may be stacked on a display element, which is configured to scan the movement of the sensing object close to the touch screen. More specifically, the photo sensor mounts photo diodes and TRs (transistors) in rows/columns to scan the contents placed on the photo sensor using electrical signals that change according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the sensing object according to the change amount of light, and through this, location information of the sensing object may be obtained.

The display unit 851 displays (outputs) information processed by the signage 800. For example, the display unit 851 may display execution screen information of an application program driven by the signage 800, or user interface (UI) or graphical user interface (GUI) information according to the execution screen information. .

In addition, the display unit 851 may be configured as a stereoscopic display unit displaying a stereoscopic image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glasses-free method), or a projection method (holographic method) may be applied to the stereoscopic display unit.

The audio output unit 852 may output audio data received from the wireless communication unit 810 or stored in the memory 870 in a call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, or the like. The sound output unit 852 may also output sound signals related to functions (for example, call signal reception sound, message reception sound, etc.) performed by the signage 800. The sound output unit 852 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 853 generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module 853 may be vibration. The intensity and pattern of vibrations generated in the haptic module 853 may be controlled by a user's selection or setting of a control unit. For example, the haptic module 853 may synthesize different vibrations and output them sequentially or sequentially.

In addition to vibration, the haptic module 853 can be used for stimulation such as pin arrangement that vertically moves with respect to the contact skin surface, jet or suction power of air through a jet or intake, grazing on the skin surface, electrode contact, and electrostatic force. Various tactile effects can be generated, such as an effect and an effect of reproducing a feeling of cold and warm using an element capable of absorbing heat or generating heat.

The haptic module 853 may not only deliver a tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through muscle sensations such as fingers or arms. Two or more haptic modules 853 may be provided according to a configuration aspect of the signage 800.

The light output unit 854 outputs a signal for notifying the occurrence of an event using the light of the light source of the signage 800. Examples of events generated by the signage 800 may include receiving messages, receiving call signals, missed calls, alarms, schedule notifications, receiving emails, and receiving information through applications.

The signal output from the light output unit 854 is implemented as the signage emits light of a single color or a plurality of colors to the front or rear. The signal output may be terminated by the signage detecting the user's event confirmation.

The interface unit 860 serves as a passage with all external devices connected to the signage 800. The interface unit 860 receives data from an external device, receives power, and transmits it to each component inside the signage 800, or allows data inside the signage 800 to be transmitted to the external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module (port), an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port may be included in the interface unit 860.

On the other hand, the identification module is a chip that stores various information for authenticating the usage rights of the signage 800, a user identification module (UIM), a subscriber identity module (SIM), universal user authentication It may include a module (universal subscriber identity module; USIM). The device provided with the identification module (hereinafter referred to as'identification device') may be manufactured in a smart card format. Accordingly, the identification device may be connected to the terminal 800 through the interface unit 860.

In addition, when the signage 800 is connected to an external cradle, the interface unit 860 becomes a passage through which power from the cradle is supplied to the signage 800 or is input from the cradle by a user. Various command signals may be passages to the signage 800. Various command signals or power inputted from the cradle may be operated as a signal for recognizing that the signage 800 is correctly mounted on the cradle.

The memory 870 may store a program for the operation of the control unit 880, and may temporarily store input/output data (eg, a phone book, message, still image, video, etc.). The memory 870 may store data related to various patterns of vibration and sound output when a touch is input on the touch screen.

The memory 870 includes a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), and a multimedia card micro type. ), card type memory (e.g. SD or XD memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EPMROM) It may include a storage medium of at least one type of -only memory (PROM), programmable read-only memory (PROM), magnetic memory, magnetic disk and optical disk. The signage 800 may be operated in connection with a web storage that performs a storage function of the memory 870 on the Internet.

On the other hand, as described above, the control unit 880 controls the operation related to the application program, and generally the overall operation of the signage 800. For example, if the state of the signage satisfies a set condition, the control unit 880 may execute or release a lock state that limits the input of a user's control command to applications.

In addition, the control unit 880 performs control and processing related to voice calls, data communication, video calls, or the like, and performs pattern recognition processing capable of recognizing handwriting input or drawing input on the touch screen as text and images, respectively. Can be. Furthermore, in order to implement various embodiments described below on the signage 800 according to the present invention, the control unit 880 may control any one or a combination of the above-described components.

The power supply unit 890 receives external power and internal power under the control of the control unit 880 and supplies power required for the operation of each component. The power supply unit 190 includes a battery, and the battery may be a built-in battery made to be rechargeable, and may be detachably coupled to a terminal body for charging and the like.

Further, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of the interface 160 to which an external charger that supplies power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery wirelessly without using the connection port. In this case, the power supply unit 190 uses one or more of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission device or a magnetic resonance coupling method based on an electromagnetic resonance phenomenon. Power can be delivered.

Meanwhile, various embodiments below may be implemented in a recording medium readable by a computer or a similar device using, for example, software, hardware, or a combination thereof.

Hereinafter, with reference to the accompanying drawings, a method for providing optimized information to a user by using a transportation means corresponding to a vehicle described in the present specification and a signage installed at a stop designated to stop the transportation means Take a look.

9 is a conceptual diagram for explaining a signage installed in the stop of the present invention.

First, the contents of the vehicle described in this specification can be applied analogously/similarly to a transportation means including a car, a motorcycle, a bicycle, a train, a bus, or a tram.

For convenience of description, in this specification, it will be described as an example that the transportation means is a bus.

Referring to FIG. 9, the transportation means 910 may stop at a stop 900 designated to get on and off a person or luggage.

The name of the stop 900 may be changed according to the type of the transportation 910, for example, a bus stop when the transportation 910 is a bus, or a train station when the transportation 910 is a train. Can be.

A signage 800 described in the present invention may be installed at the stop 900. At the stop 900, at least one (or a plurality of) signage 800 may be installed.

In addition, the signage 800 may have various shapes and may be installed at various locations.

For example, as illustrated in FIG. 9, the signage 800 may be installed in a partition form to divide a stop into a predetermined area.

When the signage 800 is installed in a partition, some of the users located at the stop 900 may not see the transportation means 910 entering the stop 900 by the signage 800. Can be.

This is because, based on the signage 800, a user located in a place opposite to the place where the transportation means 910 enters is obscured by the signage 800.

According to the present invention, even when the signage 800 is installed in a partition form at the stop 900, a user who is located at the stop 900 enters the stop 900 through the signage 800, the transportation means 910 It can provide a user interface that can be identified in an optimized way.

For this, the control method of the signage of the present invention will be described in more detail with reference to the accompanying drawings.

10 is a flowchart illustrating a method of controlling a typical signage of the present invention, and FIGS. 11, 12, 13, 14, 15, 16, and 17 are for explaining the control method shown in FIG. 10. It is a conceptual diagram and a conceptual diagram for explaining various embodiments of the present invention.

First, the signage related to the present invention includes a communication unit 810, a camera 821 including a first camera 821a and a second camera 821b, a display unit 851, and a control unit 880 formed to control them. It may include.

The communication unit 810 is a server (not shown) that manages (controls) transportation means, a mobile terminal (not shown) owned by a user located at the stop 900, or a transportation means 910 that enters the stop 900 And can be configured to perform communication.

For example, the communication unit 810 may communicate with a server, a mobile terminal, or a transportation means 910 using V2X (Vehicle to everything) communication technology.

For example, the communication unit 810 may communicate with the communication device 400 provided in the transportation means 910.

The signage 800 of the present invention may include at least one camera 821. For example, the camera 821 may include a first camera 821a disposed on the front of the signage 800 and a second camera 821b disposed on the rear of the signage 800. .

Referring to FIG. 11, in the present specification, the direction in which the transportation means 910 proceeds will be defined as a direction F toward the front of the signage 800. In addition, a direction opposite to the direction F facing the front surface may be defined as a direction R facing the rear surface of the signage 800.

The first camera 821a, based on the signage 800, photographs a space located in the direction of transportation 910, and signsage 800 to photograph a specific area 1100 of the stop 900 ).

The specific area 1100 of the stop 900 may be included in a space located in the direction of travel of the transportation means 910.

That is, in the specific area 1100 of the stop 900, the user 1110 located in the specific area 1100 can see the transportation means 910 that enters the stop 900 by the signage 800. It may mean a missing space (ie, a space that cannot be seen because the traffic sign 910 entering the stop 900 is blocked by the signage 800 ).

On the other hand, the second camera 821b is disposed on the back of the signage 800 to photograph the transportation means 910 entering the stop 900.

The rear of the signage 800, it can be seen that the transportation means 910 enters the stop.

Meanwhile, as shown in FIG. 11, the display unit 851 includes a front display unit 851a provided on the front of the signage 800 and a rear display unit 851b provided on the back of the signage 800. ).

The display unit 851 may be formed such that the front display unit 851a and the rear display unit 851b are separated, or may be integrally formed.

The display unit 851 may be formed to be able to change transparency by control of the control unit 880. For example, the display portion 851 may be a transparent display, and even though the front display portion 851a and the rear display portion 851b are formed to be separated, light passes through the signage through the display portion 851. Transparency can be adjusted to pass through.

Various information may be displayed on the display unit 851. For example, all types of screen information controlled to be displayed by the control unit 880 may be displayed on the display unit 851, and for example, information related to transportation means may be displayed.

The driver 1120 driving the transportation means 910 entering the stop 900 can see the rear display 851b provided on the back of the signage 800.

Returning to FIG. 10, in the present invention, a step of determining whether a transportation means enters a stop through a communication unit and information related to the transportation is performed (S1010).

Specifically, the control unit 880 may determine, through the communication unit 810, whether the transportation means 910 enters the stop 900 and information related to the transportation means 910 entering the stop 900.

For example, the transportation means 910 (or the control unit (processor) of the transportation means 910) enters the stop 900 where the signage 800 is installed, through the V2X communication of the signage 800. It may be connected to enable communication with the communication unit 810.

The means of transportation 910 is based on GPS information or location information received from a server, and the means of transportation 910 enters within a certain distance from the stop 900 where the signage 800 is installed, or the stop 900 When entering into an area having a predetermined radius based on, a signal may be transmitted to communicate with the communication unit 810 of the signage 800 or information related to the transportation means 910 may be transmitted.

The control unit 880 of the signage 800 may be connected to enable communication with the transportation means 910 based on receiving the signal or information related to the transportation means through the communication unit 810.

In this case, the control unit 880 may determine that the communication connected transportation means 910 enters the stop 900 based on performing communication with the transportation means 910 through the communication unit 810. .

As another example, the control unit 880, based on receiving a specific signal (for example, information related to the transportation method) from the transportation means 910 through the communication unit 810, the transportation means 910 is a stop ( 900).

Although not shown, the control unit 880 uses the image (preview image) received through the second camera 821b arranged to photograph the transportation means 910, and the transportation means 910 is connected to the stop 900. You can also decide whether to enter.

In addition, the control unit 880, based on the information associated with the transportation means 910 entering the stop 900 from the server is received through the communication unit 810, the transportation means 910 to the stop 900 You may decide to enter.

In addition, the control unit 880 may determine information related to the transportation means 910 based on receiving information related to the transportation means 910 from the transportation means 910 through the communication unit 810.

Here, the information related to the transportation means 910 includes a number (for example, a bus number, a train number, etc.) assigned to the transportation method, characteristics related to the transportation method (for example, color, size, etc.), and It may include the number of empty seats (or the number of passengers on board) remaining in the means of transportation, and route information of the means of transportation.

When there are a plurality of transportation means entering the stop, the control unit 880 may communicate with the plurality of transportation means through the communication unit 810 to sense information related to the plurality of transportation means.

Subsequently, in the present invention, a step of sensing information related to a user existing in a specific area of the stop using the first camera proceeds (S1020).

Specifically, the control unit 880 uses the first camera 821a provided on the front of the signage 800 to sense information related to a user existing (or located) in a specific area 1100 of the stop. can do.

For example, the control unit 880 may use the image received through the first camera 821a (or analyze it), and information related to the user (eg, a user existing in the specific area 1100) The number of, the user's gaze, the user's state (or behavior), etc. can be sensed.

Subsequently, in the present invention, a step of sensing a location (or information related to the transportation method) of the transportation means entering the stop using the second camera proceeds (S1030 ).

Specifically, the control unit 880 may photograph the transportation means 900 entering the stop 900 using the second camera 821b provided on the back of the signage 800. The controller 880, based on the image received through the second camera 821b formed to photograph the transportation means 910 entering the stop 900, the location of the transportation means 910 entering the stop (Or information related to transportation) can be sensed.

The images received through the first camera 821a and the second camera 821b may not be captured, and may be preview images or live images that are changed in real time.

Referring to FIG. 11, the control unit 880 senses information related to the user 1110 existing in a specific area 1100 of the stop using the first camera 821a provided on the front of the signage, and The camera 821 may be controlled to sense the location of the transportation means 910 entering the stop 900 using the second camera 821b provided on the back of the nige.

For example, the control unit 880, the first camera 821a and the second camera 821b based on the determination that the transportation means 910 enters the stop 900 through the communication unit 810. To activate (or turn on), the information related to the user and the location of the means of transportation (or information related to means of transportation) may be sensed.

However, the present invention is not limited thereto, and the controller 880 activates (or turns on) the first camera 821a and the second camera 821b even if the transportation means does not enter the stop or is determined to enter after a predetermined time. ), and sense the information related to the user and the location of the means of transportation (or information related to means of transportation).

Returning to FIG. 10, in the present invention, based on at least one of whether the transportation means enters the stop, information related to the transportation means and information related to the user, a step of controlling the display unit in a preset manner proceeds ( S1040).

Specifically, the control unit 880, whether or not the transportation means 910 enters the stop 900 determined through the communication unit 810, the specific area 1100 of the stop sensed through the first camera 821a Based on at least one of the information related to the existing user 1110 and information related to the transportation sensed through the second camera 821b (and the communication unit 810) (or the location of the transportation), the display unit 851 ) Can be controlled in a preset manner.

Hereinafter, various methods of controlling the display unit 851 of the present invention in a preset manner will be described in more detail with reference to the accompanying drawings.

The control unit 880 may determine whether a transportation means enters the stop through the communication unit 810, and control the display unit 851 in different ways based on whether the transportation means enters the stop. have.

For example, the control unit 880 may control the display unit 851 in a first manner when a transportation means does not enter the stop, as illustrated in FIG. 12A.

Here, controlling the display unit 851 in the first manner may include outputting the first screen information 1210 to the display unit 851.

The first screen information is information irrelevant to transportation, and may be, for example, advertisement information.

As another example, the control unit 880, as shown in Figure 12 (b), when the transportation means 910 enters the stop, the display unit 851 in a second manner different from the first method Can be controlled.

For example, controlling the display unit 851 in the second manner may include outputting second screen information 1230 different from the first screen information to the display unit or transparency of the display unit 851 It may include changing (adjusting).

The second screen information 1220 is, for example, a preview image received through the second camera 821b provided on the back side of the signage 800, capable of photographing the transportation means 910 entering the stop. It may include. Also, the second screen information 1220 may mean a preview image received through the second camera 821b.

In addition, the preview image included in the second screen information 1220 may include a graphic object 1230 corresponding to the transportation means 910. The graphic object 1230 may be moved (or the display position may be changed) based on the movement of the transportation means 910 entering the stop.

In addition, information related to transportation means 1240 may be further output on the second screen information 1220. The information 1240 related to the transportation means may be output superimposed on the preview image.

In addition, the second screen information 1220 may further output information (or advertisement information) 1250 about a place that can be accessed through the transportation means 910 entering the stop.

As illustrated in FIG. 12, the control unit 880 may output information 1202 informing an arrival time of all means of transportation stopping at the corresponding stop 900 in an area of the display unit 851.

In this case, a portion controlled by the first and second methods may be a region other than the one region of the display unit 851.

That is, the information 1202 informing the arrival time of the transportation means is always output to one area of the display unit 851, and the remaining areas except for one area of the display unit 851 are the transportation means 910. It can be controlled in a first or second way, based on whether or not it enters the stop.

The government 1202 informing the arrival time of the transportation means may be output on a separate display unit. In this case, the portion controlled by the first and second methods may correspond to the entire area of the display portion 851 of the present invention.

The information 1240 related to the transportation means or the information 1250 related to the place may be output to the display unit 851 even when the transparency of the display unit 851 is changed to become transparent.

As described above, the controller 880, based on performing communication with the transportation means 910 entering the stop through the communication unit 810, the transportation means 951 that has performed the communication enters the stop. You can decide.

In addition, the control unit 880 may receive information related to the transportation means performing the communication from the transportation means, based on performing communication with the transportation means 910 entering the stop through the communication unit 810. have.

The information related to the transportation means output to the preview image 1230 received through the second camera 821b may change the output position output as the transportation means 910 is driven.

Specifically, when the transportation means 910 is moved from the stop, the display position of the graphic object 1230 corresponding to the transportation means included in the preview image 1220 is changed.

Accordingly, the controller 880 outputs information 1240 related to the transportation means based on the display position of the graphic object 1230 corresponding to the transportation means included in the preview image 1220 being changed. The position can also be changed.

The control unit 880 may change the display position on which the information 1240 related to the transportation means is displayed, depending on the display position of the graphic object 1220 corresponding to the transportation means 910.

For example, the information 1240 related to the transportation means may be output on the graphic object 1220 or in a peripheral area of the graphic object 1220.

The information 1240 related to the transportation means includes a number (for example, a bus number) assigned to the transportation means 910, a color of the transportation means, and route information (for example, a start stop-end stop or a next stop) ), information such as the number of passengers (or the number of empty seats) and time remaining until the stop. The information 1240 related to the transportation means may be formed to have a color corresponding to the color of the transportation means (or may be formed to have a color corresponding to the color of the transportation background). Further, the information 1240 related to the transportation means may be formed such that various information described above is included in a text or image format in a graphic object formed to have a color corresponding to the transportation means.

On the other hand, as shown in Figure 13, the control unit 880, while the first screen information 1210 is being output as the transportation means does not enter the stop, the transportation means 910 through the communication unit 810 When the entering situation is detected (or if the transportation means 910 is determined to enter), the first screen information 1210 and the second screen information 1220 may be controlled in a preset manner.

For example, as illustrated in (a) of FIG. 13, when it is determined that a transportation means enters a stop while the first screen information 1210 is being output, the control unit 880 may display a pop-up window 1300. Output on the first screen information 1210, and output second screen information 1220 (images received through a second camera photographing a transportation means and information related to transportation means) on the pop-up window 1300. can do.

As another example, as illustrated in (b) of FIG. 13, when it is determined that a transportation means enters a stop while the first screen information 1210 is being output, the control unit 880 may display the first screen information. 1210 may be changed to second screen information 1220. In this state, the control unit 880 may output the pop-up window 1300 on the second screen information 1220 and output the first screen information 1210 on the pop-up window 1300.

At this time, the controller 880 determines or changes the output position of the pop-up window 1300 based on the position of the graphic object 1230 corresponding to the transportation means 910 included in the second screen information 1220. You can.

For example, the controller 880 may identify an area where the graphic object 1230 is not blocked by the pop-up window 1300 and output the pop-up window 1300 to the identified area.

In other words, the control unit 880 identifies the area where the graphic object 1230 overlaps by the pop-up window 1300, and the graphic object 1230 is not overlapped by the pop-up window 1300. The pop-up window 1300 may be displayed in an area other than the identified area.

As another example, the control unit 880 may display the pop-up window 1300 as second screen information 1220 so that the information 1240 and the pop-up window 1300 related to the transportation means output around the graphic object 1230 do not overlap. It can also be printed on.

When the transportation means starts from the stop and exits (or there is no transportation to enter the stop), the controller 880 may output the first screen information to the display unit 851.

Through this configuration, the present invention provides a signage and a control method for providing optimized information at a stop by outputting advertisement information or outputting information related to the traffic according to whether or not a means of transportation enters the stop. can do.

Hereinafter, various embodiments of the present invention will be described in more detail.

As described above, the first camera 821a provided in the signage 800 of the present invention photographs a space located in the direction F of the transportation method based on the signage 800, and a specific area of the stop It may be disposed on the front of the signage 800 to photograph (1100).

In addition, the second camera 821b provided in the signage 800 may be disposed on the back of the signage 800 to photograph the transportation means 910 entering the stop.

When the transportation means 910 enters the stop 900, the control unit 880 determines whether a user exists in a specific area 1100 of the stop based on the image received through the first camera 821a. Can decide.

The specific area 1100 of the stop 900 may be included in a space located in a direction F of the transportation means 910.

That is, in the specific area 1100 of the stop 900, the user 1110 located in the specific area 1100 can see the transportation means 910 that enters the stop 900 by the signage 800. It may mean a missing space (ie, a space that cannot be seen because the traffic sign 910 entering the stop 900 is blocked by the signage 800 ).

Since the first camera 821a is provided on the front of the signage 800 to photograph the moving direction F of the transportation means 910, the control unit 880 is received through the first camera 821a. The preview image may be used to determine whether the user 1110 exists in the specific region 1100.

When a user exists in a specific area 1100 of the stop, the control unit 880 displays the image received through the second camera 821b disposed on the back of the signage to photograph the transportation means entering the stop. It can be output to the unit 851. Accordingly, the user 1110 existing in the specific area 1100 of the stop may grasp the transportation means entering the stop through the image.

In addition, the control unit 880, when a user exists in a specific area 1100 of the stop, the user 1100 existing in a specific area 1100 of the stop 1100 penetrates the signage 800 and stops. The transparency of the display portion 851 may be controlled so that the transportation means 910 entering the vehicle may be viewed (ie, the display portion 851 may be changed transparently).

The controller 880 may determine the location of the transportation means entering the stop, based on the image received through the second camera 821b, and control the transparency based on the location of the transportation means.

For example, when the distance between the transportation means and the signage corresponds to the first distance, the control unit 880 controls to have a first transparency, and the distance between the transportation means and the signage is closer than the first distance. If it corresponds to the second distance, the display unit 851 may be controlled to have a second transparency different from the first transparency.

For example, the control unit 880 may control the display unit 851 to become opaque as the distance of the transportation means increases, and to become transparent as the distance to the transportation means approaches.

On the other hand, the control unit 880, when the transportation means 910 is entering the stop, and the user 1110 exists in a specific area 1100 of the stop, the display unit 1240 related to the transportation means (display) ( 851).

As described above, the information 1240 related to the transportation means may be superimposed on the preview image received through the second camera 821b, or may be output on the display unit 851 whose transparency has been changed. .

Referring to FIG. 14, a method of controlling a display in a state in which the transparency of the display unit 851 is changed (ie, a transparent state) is illustrated.

That is, in FIG. 14, the transparency of the display unit so that a user 1110 existing in a specific area 1100 of the stop can see the transportation means entering the stop through the signage 800 (or the display portion 851 ). The adjusted state is shown.

The control unit 880 of the present invention may sense the gaze 1400 of the user 1110 existing in the specific area 1100 of the stop through the first camera 821a. Specifically, the control unit 880, when the transportation means 910 is entering the stop, and the user 1110 exists in a specific area 1100 of the stop, activates the first camera (821a), the Based on the image received through the first camera 821a, the gaze 1400 of the user 1110 may be sensed.

Here, sensing the user's gaze 1400 may include sensing a point (or place, area, or object) viewed by the user or sensing a direction viewed by the user.

Sensing a user's gaze using a camera is a general technique, so a detailed description is omitted.

In addition, the control unit 880 may sense the location of the transportation means entering the stop through the second camera 821b, based on the transportation means entering the stop.

The control unit 880, based on the location of the transportation means sensed through the user's gaze 1400 and the second camera 821b sensed through the first camera 821a, information related to transportation means (1240) ) To determine the output location (or area) for output.

That is, the control unit 880 may output information 1240 related to the transportation means to different locations (areas) based on the user's gaze 1400 and the location of the transportation means.

For example, as shown in (a) of FIG. 14, the control unit 880, as the user is located at the first location in a specific area 1100 of the stop, the user desires the transportation means 910 When the viewing user's gaze 1400 penetrates the first area 1410a (or its surroundings) of the display portion 851, the information 1240 related to the transportation means is transferred to the first area 1410a (or the same). Output).

As another example, as shown in (b) of FIG. 14, when a user is located in a second location different from the first location in the specific area 1100, the user's gaze of the user looking at the transportation means 910 The 1400 passes through the second area 1410b (or its surroundings) of the display portion 851.

That is, even if the location of the transportation means 910 is fixed, if the user's location is changed, the area through which the user's gaze 1400 passes in the display portion 851 is changed.

The second region 1410b may be a region different from the first region 1410a.

The control unit 880, as the user is located in the second position in a specific area 1100 of the stop, the user's gaze 1400 that the user looks at the transportation means 910 is the second of the display unit 851 When passing through the area 1410b (or its surroundings), information related to the transportation means 1240 may be output to the second area 1410b or its surroundings.

On the other hand, the user 1110 is located in a specific location of the specific area 1100, but when the transportation means 910 is moved, the area of the display unit through which the user's gaze looking at the transportation means passes may vary.

In this case, the control unit 880 is based on the area of the display unit 851 through which the user's gaze 1400 passing through the transportation means changes according to the movement of the transportation means 910, and the transportation means. It is possible to change (or decide) the output position for outputting related information.

The contents related to this may be analogously and similarly applied to the display unit 851 even when a preview image received through the second camera 821b is output.

For example, if the position of the graphic object 1230 corresponding to the transportation means changes as the transportation means 910 moves, the control unit 880 changes the output location for outputting information related to the transportation means 910. Can be. At this time, the information related to the transportation means may be moved depending on the position of the graphic object 1230.

Through such a configuration, the present invention can provide a signage and a control method for outputting information related to transportation in an optimized manner according to the user's gaze and the location of the transportation.

Meanwhile, a plurality of users may exist (location) in a specific area of the stop.

When a plurality of users 1110a and 1110b are present in a specific area 1100 of the stop, the control unit 880 may output information related to transportation in different ways based on preset conditions.

For example, as illustrated in (a) of FIG. 15, the control unit 880 uses the first camera 821a to control a plurality of users 1110a and 1110b existing in a specific area 1100 of the stop. I can sense it. Also, the controller 880 may sense the gaze 1500a, 1500b of each of the plurality of users 1110a, 1110b based on the image received through the first camera 821a.

At this time, the control unit 880, the plurality of users 1110a, 1110b, based on whether or not looking at the transportation means 910 entering the stop, the information related to transportation means (1240) in different ways (851).

For example, as illustrated in (a) of FIG. 15, the first user 1100a is a transportation means 910 entering a stop (or a preview image 1220 received through the second camera 821b). The second user 1100b may be in a state of viewing the transportation means 910 (or preview image 1230) entering the stop.

In this case, the controller 880, based on the gaze 1500b of the user 1110b looking at the transportation means 910 (or preview image 1230) entering the stop among a plurality of users, and the transportation means The output location 1510 to which related information 1240 is to be output may be determined.

The output location 1510 may be an area (or a surrounding area) 1510 through which the gaze 1500b of the user 1110b looking at the transportation means entering the stop among a plurality of users penetrates through the display portion 851. Can be.

As another example, as illustrated in (b) of FIG. 15, a transportation means 910 (or a second camera 821b) in which a plurality of users 1110a and 1110b existing in a specific area 1100 of a stop enters the stop. When viewing the preview image 1220 received through ), the controller 880 includes regions (or surrounding regions) through which the eyes 1500a and 1500b of each of the plurality of users penetrate the display portion 851. Fields 1510a and 1510b may output information 1240a and 1240b related to transportation, respectively.

That is, the control unit 880, a plurality of users 1110a, 1110b present in a specific area 1100 of the stop looking at the display unit 851, or through the display unit 851, traffic to enter the stop When looking at the means, information related to a plurality of transportation means 1240a and 1240b may be output so as to correspond to each user's gaze.

The information 1240a and 1240b related to the plurality of transportation means may be the same information about the transportation means entering the stop, or may be different information.

For example, when specific request information related to a transportation method is transmitted to a signage from any one of the mobile terminals possessed by a plurality of users, a display through which the eyes of the user possessing the mobile terminal outputting the specific request information penetrates Other information may be output in the negative area.

The contents described with reference to FIG. 15 may be similarly or analogously applied when the display unit 851 is in a transparent state or when a preview image received through the second camera 821b is output to the display unit 851. .

For example, in a state in which a preview image is output to the display unit 851, the control unit 880 determines an area of the display unit 851 to which a user's gaze is directed, and transmits information related to transportation to the determined area. Can print The same/similar analogy can be applied even when multiple users exist.

Through this configuration, the present invention optimizes information related to transportation, based on the user's gaze and the location of the transportation, in a space (a specific area of a stop) where the transportation is not seen by signage. It can provide a signage that can be provided in a prescribed way and a control method thereof.

On the other hand, as shown in FIG. 16, the driver 1600 driving the transportation means 910 also does not recognize a user existing in a specific area of the stop (that is, a space hidden by the signage 800). Exists.

In order to solve this, in the present invention, it is necessary to enable the driver 1600 of the transportation means 910 entering the stop to identify the user 1110 existing in the specific area 1100 of the stop. To this end, the control unit 880 receives the image (preview image) received through the first camera 821a (that is, the camera disposed on the front of the signage to photograph the specific region 1100) of the signage. It is possible to output to the display portion 851 disposed on the back side, or to control the transparency of the display portion 851.

That is, the control unit 880, the image received through the first camera 821a so that the driver of the transportation means entering the stop can identify a user existing in a specific area of the stop, the back of the signage 800 The display unit 851 may be output to the display unit 851 or the transparency of the display unit 851 may be controlled to allow the display unit 851 to pass light.

If not shown, the control unit 880 may provide a user interface that enables the driver 1600 of the transportation means 910 entering the stop to determine whether the user in the specific area 1100 is boarding or not. have.

To this end, the control unit 880 may receive information that a specific transportation means will be boarded from the mobile terminal of the user existing in the specific area. At this time, if the transportation means entering the stop corresponds to the specific transportation means, the control unit 880 outputs an image received through the first camera on the back of the display unit 851, or the display unit 851 ) Can be controlled transparently. In addition, the controller 880 displays the notification information indicating that the user 1110 existing in the specific area 1100 will board the transportation means when the transportation means entering the stop corresponds to the specific transportation means. It can be output to the unit 851.

At this time, when the display unit 851 is transparent, the control unit 880 senses a driver's gaze through the second camera 821b and a specific area through the first camera 821a. Sensing the location of the user 1110 existing at 1100, and outputting the notification information to an area (or surrounding area) passing through the display unit when the driver 1600 gazes at the user 1110. You can.

In addition, the control unit 880, if the image received through the first camera 821a is being output to the display unit 851, the user included in the image received through the first camera 821a The notification information is output to be superimposed on the graphic object corresponding to, the notification information is output to the peripheral area of the graphic object corresponding to the user, or the notification is displayed in the area (or the peripheral area) where the driver's gaze is directed. Information can be output.

Through such a configuration, the present invention can provide a signage and a control method thereof so that a driver driving a transportation means can not miss a passenger.

Meanwhile, referring to FIG. 17, the signage 800 of the present invention may further include a beam output unit 1700 formed to output information (or light) to a road surface of a stop.

The controller 880 outputs a beam so as to output information 1710a, 1710b that guides the location where the means of transportation entering the stop will stop to the road surface 1702 of the stop based on the information related to the means of transportation entering the stop. The unit 1700 can be controlled.

The beam output unit 1700, for example, is provided on one side (for example, front, rear or side) of the signage, and may be formed to output information on the road surface of the stop.

The beam output unit 1700 may be referred to as a projector, a light output unit, or the like.

The controller 880 may output, on the road surface of the stop, information that guides the location where the traffic means 910a that is entering the stop will stop according to a preset condition.

For example, the control unit 880 communicates with the mobile terminal 1730 possessed by the user 1720 existing at the stop through the communication unit 810, and the transportation means to board from the mobile terminal 1730 You can receive information.

The control unit 880, based on the point where the user 1720 is located, when the user 1720 carrying the mobile terminal 1730 enters the stop when the transportation means 910a to be boarded enters the stop, the transportation means ( 910a) may determine a region in which information 1710a that guides a location to stop is output.

For example, the control unit 880 may determine the location of the mobile terminal 1730 carried by the user 1720 who wants to board the transportation means 910a entering the stop through the communication unit 810.

In this case, the control unit 880, when receiving the information of the transportation means to board from the mobile terminal 1730, the mobile terminal transmits the information using the ultra-wideband module or Wi-Fi module of the communication unit 810 The location of 1730 can be determined.

In addition, the control unit 880 determines the location of the mobile terminal 1730 based on the Wi-Fi location positioning technology, or the mobile terminal 1730 determined through an acceleration sensor, a gyro sensor, etc. included in the mobile terminal 1730. The location information may be received from the mobile terminal to determine the location of the mobile terminal.

Also, the control unit 880 may determine the location of the mobile terminal 1730 based on low-power communication such as iBeacon.

In addition, when the information of the transportation means to board is received from the mobile terminal 1730, the controller 880 activates at least one of the first and second cameras 821a and 821b, and the first and second Based on the preview image received through at least one of the cameras 821a and 821b, a location (or a user's location) of the mobile terminal 1730 may be determined.

The control unit 880 may receive information of a transportation means to be boarded from the mobile terminal 1730 through the communication unit 810.

Thereafter, when the transportation means 910a that the user 1720 wants to board at the stop enters the stop, the control unit 880 stops the transportation means 910a based on the determined location of the mobile terminal. It is possible to determine an output location where information 1710a for guiding the location is output.

For example, the control unit 880 may output the information 1710a so that the transportation means 910a stops in a space corresponding to the location of the mobile terminal (or within a predetermined area from the location of the mobile terminal). One area of the road surface can be determined.

Thereafter, the control unit 880 may control the beam output unit 1700 so that the information 1710a is output to an area of the road surface.

The number of information 1710a, 1710b that guides the location where the means of transportation will stop may correspond to the number of means of transportation entering the stop. In addition, the order in which the information 1710a, 1710b for guiding the location where the means of transportation stops is output may correspond to the sequence of means of transportation entering the stop.

The controller 880 may determine an order of entry of a plurality of means of transportation entering the stop, based on the order of communication performed through the communication unit 810 or information related to means of transportation.

Subsequently, the control unit 880 determines the size of each of the plurality of transportation means through the information related to the transportation means, and based on the size of the transportation means, guides the location where the plurality of transportation means will stop. It is possible to determine the location (or spacing, etc.) for outputting (1710a, 1710b).

In addition, the control unit 880 may determine the color of the transportation means entering the stop, based on the image received through the second camera 821b.

Thereafter, the control unit 880 may output information on the road surface of the stop to guide the location where the means of transportation will stop to have a color corresponding to the color of the means of transportation entering the stop.

Through this configuration, the present invention, by outputting the information on the road surface of the stop using the signage to guide the location of the means of transportation to enter the stop, the user waiting at the stop can board the transportation without congestion. Can provide a new stop system.

On the other hand, the signage 800 of the present invention, using the image received through the second camera (821b), determines the color information of the transportation means 910 entering the stop, and the determined transportation means (910) The color information of can be transmitted through the communication unit 810 to the mobile terminal possessed by the user existing at the stop.

In addition, when the transportation means 910 enters the stop, the control unit 880 outputs the image received through the second camera 821b to the display 851, and the transportation means 910 enters the stop. ) Related information may be output to the image.

At this time, information related to the transportation means 910 may be output with a color corresponding to the color information of the transportation means 910 as a background.

In this case, the user determines that the transportation means for the user has entered the stop, based on the color of the transportation means 910 received at the mobile terminal and the background color of the information related to the transportation means 910 displayed in the image. can do.

On the other hand, the signage 800 of the present invention may provide a user interface capable of providing contents related to a user present at a stop when a specific transportation method is called.

For example, a mobile terminal existing at a stop may transmit information calling a specific transportation method to a signage or server based on a user's request.

In addition, the server may transmit information related to the specific transportation method to the signage 800.

For example, the information related to the specific transportation means, the time it takes for the specific transportation to reach the stop, the route information of the specific transportation means and the image of the current location of the specific transportation means, after boarding the specific transportation means It may include the time it takes to get to the destination.

The control unit 880 of the signage 800 may output information related to the specific transportation method from a server to an area of the display unit 851.

At this time, the control unit 880 may determine the location of the mobile terminal, and output information related to the specific transportation means on the front or rear of the display unit 851 based on where the mobile terminal is located.

The server may transmit information indicating that it has been called by the specific transportation means and user information of the called mobile terminal.

Thereafter, when the specific transportation means enters the stop, the control unit 880 outputs a preview image received through the second camera 821b to the front or rear of the display unit 851 where the mobile terminal is located or displays transparency. It is possible to adjust and output information related to the specific transportation means to the front or rear of the display unit 851 to inform that the specific transportation means has arrived.

All functions/operations/controls of the signage 800 described in this specification can be applied as a control method of the signage.

Further, all functions/operations/controls of the signage 800 described herein may be performed by the control of an external server or a mobile terminal existing at a stop.

According to an embodiment of the present invention, there are one or more of the following effects.

First, the present invention can provide a new signage and a control method thereof that can provide a user with information related to a transportation method entering a stop in an optimized manner.

Second, the present invention can provide an optimized UI/UX (User Interface/User Experience) that can provide information related to transportation to users located in places where the transportation means entering the stop is not visible by the signage. have.

Third, the present invention can provide a new signage that can guide the location of the transportation means entering the stop on the road surface of the stop.

Fourth, the present invention provides an optimized user interface capable of informing a user of information related to a plurality of means of transportation entered at a stop, even when it is difficult to identify the means of transportation located at the rear, as a plurality of means of transportation enter the line Can provide.

Fifth, the present invention can provide a user interface that can more intuitively and easily inform the user of the transportation means entering the stop by determining the location where information related to the transportation means is output based on the driver's gaze.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

The above-described present invention can be embodied as computer readable codes on a medium on which a program is recorded. The computer-readable medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include a hard disk drive (HDD), solid state disk (SSD), silicon disk drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage device. There is this. Also, the computer may include a processor or a control unit. Accordingly, the above detailed description should not be construed as limiting in all respects, but should be considered illustrative. The scope of the invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

Claims (12)

Communication department;
A camera including a first camera and a second camera;
Display unit; And
Through the communication unit determines whether the transportation means enters the stop and information related to the transportation entering the stop,
And a control unit for sensing information related to a user existing in a specific area of the stop using the first camera, and controlling the camera to sense a location of a transportation means entering the stop using the second camera,
The control unit,
Characterized in that the display unit is controlled in a preset manner based on at least one of whether the transportation means enters a stop, information related to the transportation means, and information related to the user,
The first camera photographs a space located in a moving direction of the means of transportation based on a signage, and is disposed on the front of the signage to photograph a specific area of the stop,
The second camera is characterized in that it is arranged on the back of the signage to photograph the transportation means entering the stop,
The control unit,
When a transportation means enters the stop, it is determined whether a user exists in a specific area of the stop, based on an image received through the first camera,
When a user exists in a specific area of the stop, the image received through the second camera is output to the display unit, or a user present in the specific area of the stop enters the stop through the signage Signage characterized in that to control the transparency of the display unit to see the means.
According to claim 1,
The control unit,
When the transportation means does not enter the stop, the display unit is controlled in the first manner,
A signage characterized in that when the transportation means enters the stop, the display unit is controlled in a second manner different from the first scheme.
According to claim 2,
Controlling the display unit in the first manner includes outputting first screen information to the display unit,
The control of the display unit in the second method is characterized in that it comprises outputting second screen information different from the first screen information to the display unit or changing the transparency of the display unit.
According to claim 1,
The control unit,
On the basis of performing communication with the transportation means entering the stop through the communication unit, it is determined that the transportation means performing the communication enters the stop, and receiving information related to the transportation means performing the communication. Signage to do.
delete delete According to claim 1,
The control unit,
A signage characterized in that when the transportation means enters the stop and a user exists in a specific area of the stop, information related to the transportation is output to the display unit.
The method of claim 7,
The control unit,
Sensing the user's gaze existing in a specific area of the stop through the first camera,
A signage characterized by determining an output location for outputting information related to the transportation means, based on the user's gaze and the location of the transportation means sensed through the second camera.
The method of claim 7,
The control unit,
When a plurality of users exist in a specific area of the stop, a signage characterized by outputting information related to the transportation method in different ways based on a preset condition.
According to claim 1,
The control unit,
The image received through the first camera is output to the display unit disposed on the back of the signage so that the driver of the transportation means entering the stop can identify a user existing in a specific area of the stop, or the A signage characterized by controlling the transparency of the display unit.
According to claim 1,
Further comprising a beam output unit formed to output information to the road surface of the stop,
The control unit,
A signage characterized by controlling the beam output unit to output, on the road surface of the stop, information that guides a location to be stopped by the means of traffic entering the stop, based on information related to the means of traffic entering the stop.
The method of claim 11,
The control unit,
Determine the location of the mobile terminal of the user who wants to board the transportation means entering the stop through the communication unit,
A signage characterized in that, based on the determined location of the mobile terminal, an output location where information for guiding a location to be stopped by the transportation means is output is output.

Images