KR102531722B1 - Method and apparatus for providing a parking location using vehicle's terminal - Google Patents

Abstract

A parking location guidance service method using a vehicle terminal according to an embodiment includes obtaining first parking location information from a GPS receiver of the vehicle terminal when the vehicle is parked, and interlocking with the vehicle terminal when parking the vehicle. Photographing the identification information displayed in the parking area from one camera, extracting the second parking location information from the photographed identification information, and based on the obtained first parking location information and the extracted second parking location information, the vehicle is parked. Determine parking information.

Description

Method and apparatus for providing a parking location using vehicle terminal

Embodiments relate to a parking location guidance service method and apparatus using a vehicle terminal.

Most of the conventional parking control systems are focused on automation of license plate shooting and recognition, parking lot entry time, parking time and settlement, etc. Rapid settlement by mobile banking is insufficient.

Prior Art 1 discloses a parking control system capable of photographing a QR code installed in a parking lot using a smartphone and checking the location of a vehicle, vehicle status, etc. in real time using a parking management application of a smartphone. . However, in this case, the inconvenience of having to take a QR code with a smartphone directly after the driver parks still exists.

[Prior art document number]

Prior Art 1: Korean Patent Publication No. 2017-0000111

Prior Art 2: Korean Patent Publication No. 2020-0009301

Embodiments are to provide a parking location guidance service method and apparatus using a vehicle terminal. In addition, it is to provide a computer-readable recording medium recording a program for executing the method on a computer. The technical problem to be solved is not limited to the technical problems described above, and other technical problems may exist.

As a technical means for achieving the above-described technical problem, in the parking location guidance service method using a vehicle terminal according to an embodiment, obtaining first parking location information from a GPS receiver of the vehicle terminal when the vehicle is parked. ; When the vehicle is parked, photographing identification information displayed in a parking area from at least one camera provided in the vehicle in conjunction with the vehicle terminal; Extracting second parking location information from the photographed identification information; and determining parking information in which the vehicle is parked based on the obtained first parking location information and the extracted second parking location information.

The parking location guidance service method using the vehicle terminal may further include transmitting the determined parking information to a user terminal through a communication network.

The photographing step may include recognizing identification information included in each image frame from a plurality of image frames photographed by the at least one camera when the vehicle is parked; And extracting the second parking location information, which is text corresponding to a parking location, from the recognized identification information.

The vehicle terminal is characterized in that it is a black box.

The parking location guidance service method using the vehicle terminal is characterized in that, when a predetermined application is executed in the user terminal, a location display corresponding to the parking information is displayed on a map.

The parking information may include image information corresponding to a parking area captured by the at least one camera when the vehicle is parked, and the image information may be displayed on the map.

The parking location guidance service method using the vehicle terminal includes at least one of a parking building, a parking location, a parking time, and a parking fee corresponding to the parking information in the user terminal when a predetermined application is executed in the user terminal. Characterized in that text information is displayed.

As a technical means for achieving the above-described other technical problem, in the parking location guidance service apparatus using a vehicle terminal according to another embodiment, the vehicle terminal including a GPS receiver and a communication network; at least one camera provided in a vehicle in conjunction with the vehicle terminal; and a processor;

The processor obtains first parking location information from the GPS receiver when the vehicle is parked, and captures identification information displayed in a parking area from the at least one camera when the vehicle is parked. Second parking location information is extracted, and parking information in which the vehicle is parked is determined based on the obtained first parking location information and the extracted second parking location information.

The processor is characterized in that for transmitting the determined parking information to the user terminal through the communication network.

When the vehicle is parked, the processor recognizes identification information included in each image frame from a plurality of image frames photographed by the at least one camera, and text corresponding to the parking position from the recognized identification information. Characterized in that the second parking location information is extracted.

The vehicle terminal is characterized in that it is a black box.

The parking location guidance service device using the vehicle terminal is characterized in that, when a predetermined application is executed in the user terminal, a location display corresponding to the parking information is displayed on a map.

The parking information may include image information corresponding to a parking area captured by the at least one camera when the vehicle is parked, and the image information may be displayed on the map.

When a predetermined application is executed in the user terminal, the parking location information service device using the vehicle terminal includes at least one of a parking building, a parking location, a parking time, and a parking fee corresponding to the parking information in the user terminal. Characterized in that text information is displayed.

As a technical means for achieving another technical problem described above, it includes a recording medium recording a program for executing a parking location guidance service method using a vehicle terminal according to another embodiment in a computer.

1 is a block diagram of the interior of a vehicle;
FIG. 2 is a block diagram of the vehicle driving assistance system (ADAS) shown in FIG. 1;
3 is a schematic diagram of a parking location guidance service apparatus 300 using a vehicle terminal according to an embodiment.
4 to 6 are exemplary diagrams for explaining a parking location guidance service method using a vehicle terminal according to an embodiment.
FIG. 7 is a schematic diagram of the user terminal 350 shown in FIG. 3 .
8 and 9 are exemplary diagrams for explaining a parking location guidance service method using a vehicle terminal according to another embodiment.
10 is a flowchart illustrating a parking location guidance service method using a vehicle terminal according to another embodiment.

The appearances of phrases such as “in some embodiments” or “in one embodiment” in various places in this specification are not necessarily all referring to the same embodiment.

Some embodiments of the present disclosure may be represented as functional block structures and various processing steps. Some or all of these functional blocks may be implemented as a varying number of hardware and/or software components that perform specific functions. For example, functional blocks of the present disclosure may be implemented by one or more microprocessors or circuit configurations for a predetermined function. Also, for example, the functional blocks of this disclosure may be implemented in various programming or scripting languages. Functional blocks may be implemented as an algorithm running on one or more processors. In addition, the present disclosure may employ prior art for electronic environment setting, signal processing, and/or data processing. Terms such as “mechanism”, “element”, “means” and “composition” may be used broadly and are not limited to mechanical and physical components.

In addition, connecting lines or connecting members between components shown in the drawings are only examples of functional connections and/or physical or circuit connections. In an actual device, connections between components may be represented by various functional connections, physical connections, or circuit connections that can be replaced or added.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

1 is an internal block diagram of a vehicle according to an exemplary embodiment.

Referring to FIG. 1 , a vehicle 100 includes a communication unit 110, an input unit 120, a sensing unit 125, a memory 130, an output unit 140, a vehicle driving unit 150, and a vehicle driving assistance system (ADAS). , 160), a control unit 170, an interface unit 180, and a power supply unit 190.

The communication unit 110 may include a short-range communication module, a location information module, an optical communication module, and a V2X communication module.

The input unit 120 may include a driving control unit, a camera, a microphone, and a user input unit.

The driving control unit receives a user input for driving the vehicle 100 . The driving control unit may include a steering input unit, a shift input unit, an acceleration input unit, and a brake input unit.

The acceleration input unit receives an input for acceleration of the vehicle 100 from a user. The brake input unit receives an input for decelerating the vehicle 100 from a user.

The camera may include an image sensor and an image processing module. The camera may process still images or moving images obtained by an image sensor (eg, CMOS or CCD). The image processing module may process a still image or video obtained through an image sensor, extract necessary information, and deliver the extracted information to the controller 170 .

Meanwhile, the vehicle 100 may include a front camera for capturing an image in front of the vehicle, an around view camera for capturing an image around the vehicle, and a rear camera for capturing an image behind the vehicle. Each camera may include a lens, an image sensor and a processor. The processor may computer-process the photographed image to generate data or information, and transmit the generated data or information to the controller 170 . A processor included in the camera may be controlled by the controller 170 . In an embodiment, the camera captures a QR code attached to the parking area of the collective building or around the parking area, for example, the floor or pillar of the parking area.

The camera may include a stereo camera. In this case, the processor of the camera may use a disparity difference detected in the stereo image to detect a distance to the object, a relative speed to the object detected in the image, and a distance between a plurality of objects.

The camera may include a Time of Flight (TOF) camera. In this case, the camera may include a light source (eg, infrared or laser) and a receiver. In this case, the processor of the camera detects the distance to the object, the relative speed to the object, and the distance between the plurality of objects based on the time (TOF) until infrared rays or lasers emitted from the light source are reflected and received by the object. can do.

Meanwhile, the rearview camera may be disposed near the rear license plate or trunk or tailgate switch, but the rearview camera is not limited thereto.

Each image captured by the plurality of cameras is transmitted to a processor of the camera, and the processor may synthesize the respective images to generate an image around the vehicle. In this case, the image around the vehicle may be displayed through the display unit as a top view image or a bird's eye image.

The sensing unit 125 senses various conditions of the vehicle 100 . To this end, the sensing unit 125 includes a collision sensor, a wheel sensor, a speed sensor, an inclination sensor, a weight sensor, a heading sensor, a yaw sensor, and a gyro sensor. , position module, vehicle forward/backward sensor, battery sensor, fuel sensor, tire sensor, steering sensor by steering wheel rotation, vehicle internal temperature sensor, vehicle internal humidity sensor, ultrasonic sensor, illuminance sensor, radar, lidar, etc. can include

Accordingly, the sensing unit 125 provides vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward/backward information, and battery information. , Fuel information, tire information, vehicle lamp information, vehicle internal temperature information, vehicle internal humidity information, steering wheel rotation angle, vehicle external illuminance, and the like.

The memory 130 is electrically connected to the controller 170 . The memory 130 may store basic data for the unit, control data for controlling the operation of the unit, and input/output data. The memory 130 may be a variety of storage devices such as ROM, RAM, EPROM, flash drive, hard drive, etc. in terms of hardware. The memory 130 may store various data for overall operation of the vehicle 100, such as a program for processing or control by the control unit 170.

The output unit 140 is for outputting information processed by the controller 170 and may include a display unit, a sound output unit, and a haptic output unit.

The display unit may display information processed by the controller 170 . For example, the display unit may display vehicle-related information. Here, the vehicle-related information may include vehicle condition information indicating a current state of the vehicle or vehicle driving information related to driving of the vehicle. For example, the display unit may display information about the speed (or speed) of the current vehicle, the speed (or speed) of nearby vehicles, and the distance between the current vehicle and nearby vehicles.

Meanwhile, the display unit may include a cluster so that the driver can check vehicle state information or vehicle driving information while driving. Clusters can be located above the dashboard. In this case, the driver can check the information displayed on the cluster while keeping his/her gaze in front of the vehicle.

The sound output unit converts the electrical signal from the control unit 170 into an audio signal and outputs it. To this end, the sound output unit may include a speaker or the like.

The vehicle driving unit 150 may control the operation of various vehicle devices. The vehicle driving unit 150 may include a power source driving unit, a steering driving unit, a brake driving unit, a lamp driving unit, an air conditioning driving unit, a window driving unit, an airbag driving unit, a sunroof driving unit, and a suspension driving unit.

The power source driver may perform electronic control of the power source in the vehicle 100 . For example, when a fossil fuel-based engine (not shown) is the power source, the power source driver may perform electronic control of the engine. This makes it possible to control the output torque of the engine and the like. When the power source driver is an engine, the speed of the vehicle may be limited by limiting engine output torque according to the control of the control unit 170 .

The brake driver may perform electronic control of a brake apparatus (not shown) in the vehicle 100 . For example, the speed of the vehicle 100 may be reduced by controlling the operation of brakes disposed on wheels. As another example, the driving direction of the vehicle 100 may be adjusted to the left or right by differentiating the operation of the brakes respectively disposed on the left and right wheels.

The lamp driving unit may control turning on/off of lamps disposed inside or outside the vehicle. In addition, the intensity and direction of the light of the lamp can be controlled. For example, control of direction indicator lamps and brake lamps may be performed.

The controller 170 may control overall operations of each unit in the vehicle 100 . The controller 170 may be referred to as an Electronic Control Unit (ECU). The aforementioned accident determination device may be driven by the controller 170 .

The control unit 170, in terms of hardware, includes application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors ( It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions.

In one embodiment, the controller 170 extracts an identification image from an identification code photographed by a camera, and when the extracted identification image is recognizable, extracts information corresponding to the photographed identification code, and transmits the extracted information to a communication network. transmitted to the user terminal through Here, the extracted information may include location information about the parking area where the vehicle is parked, guide information about the collective building, parking payment information, or reservation and payment information in the collective building.

The interface unit 180 may serve as a passage for various types of external devices connected to the vehicle 100 . For example, the interface unit 180 may have a port connectable to a mobile terminal (not shown), and may be connected to a mobile terminal (not shown) through the port. In this case, the interface unit 180 can exchange data with the mobile terminal.

The power supply unit 190 may supply power required for operation of each component according to the control of the control unit 170 . In particular, the power supply unit 190 may receive power from a battery (not shown) inside the vehicle.

FIG. 2 is a block diagram of the vehicle driving assistance system (ADAS) shown in FIG. 1;

The ADAS 200 is a vehicle driving assistance system that assists a driver in order to provide convenience and safety.

The ADAS 200 includes an automatic emergency braking module (hereinafter referred to as AEB: Autonomous Emergency Braking) 210, a forward collision avoidance module (hereinafter referred to as FCW: Forward Collision Warning) 211, a lane departure warning module (hereinafter referred to as LDW: Lane Departure Warning) (212), Lane Keeping Assist (LKA) (213), Speed Assist System (SAS) (214), Traffic Sign Detection Module (TSR) Recognition) (215), adaptive high beam control module (hereinafter, HBA: High Beam Assist) (216), blind spot monitoring module (hereinafter, BSD: Blind Spot Detection) (217), automatic emergency steering module (hereinafter, AES: Autonomous Emergency Steering (218), Curve Speed Warning System (CSWS) (219), Adaptive Cruise Control (ACC) (220), Smart Parking System (220) , SPAS: Smart Parking Assist System (SPAS) 221, a traffic congestion support module (hereinafter referred to as TJA: Traffic Jam Assist) 222, and an around view monitor module (hereinafter referred to as AVM: Around View Monitor) 223 may be included. .

Each of the ADAS modules 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, and 223 may include a processor for controlling vehicle driving assistance functions.

A processor included in each of the ADAS modules 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223 may be controlled by the controller 270. .

Each of the ADAS modules (210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223) processors, in terms of hardware, ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), processors, controllers, micro-controllers, microprocessors microprocessors) and electrical units for performing other functions.

The AEB 210 is a module that controls automatic braking in order to prevent a collision with a detected object. The FCW 211 is a module that controls a warning to be output in order to prevent a collision with an object in front of the vehicle. The LDW 212 is a module that controls a warning to be output to prevent lane departure while driving. The LKA 213 is a module that controls to maintain a driving lane while driving. The SAS 214 is a module that controls driving at a set speed or less. The TSR 215 is a module that detects a traffic signal while driving and provides information based on the detected traffic signal. The HBA 216 is a module that controls the irradiation range or amount of high beam light according to driving conditions. The BSD 217 is a module that detects an object outside the driver's visual field while driving and provides detection information. AES (218) is a module that automatically performs steering in an emergency. The CSWS 219 is a module that controls to output a route when driving at a preset speed or higher during curve driving. The ACC 220 is a module that controls the driving vehicle to follow the preceding vehicle. The SPAS 221 is a module that detects a parking space and controls to park in the parking space. The TJA 222 is a module that controls automatic operation in case of traffic congestion. The AVM 223 is a module that provides an image around the vehicle and controls to monitor the surroundings of the vehicle.

The ADAS 200 provides a control signal for performing each vehicle driving assistance function to the output unit 250 or the vehicle driving unit 260 based on the data acquired by the input unit 230 or the sensing unit 235. can do. The ADAS 200 may directly output the control signal to the output unit 250 or the vehicle driving unit 260 through in-vehicle network communication (eg, CAN). Alternatively, the ADAS 200 may output the control signal to the output unit 250 or the vehicle driving unit 260 via the control unit 270 .

3 is a schematic diagram of a parking location guidance service apparatus 300 using a vehicle terminal according to an embodiment.

Referring to FIG. 3 , a parking location guidance service device 300 , a communication network 340 and a user terminal 350 are shown. The parking location guidance service device 300 obtains first parking location information from a GPS receiver when the vehicle is parked, and photographs identification information displayed in a parking area from at least one camera when parking the vehicle, and captures the captured identification information. Second parking location information is extracted from, and parking information in which the vehicle is parked is determined based on the obtained first parking location information and the extracted second parking location information. The parking location guidance service device 300 may be the ADAS described with reference to FIGS. 1 and 2, but is not limited to its name, and may be a black box, a navigation device, an IVI device, or a telematics terminal.

The parking location guidance service device 300 includes a GPS 305, a photographing unit 310, a processor 320 and a communication unit 330.

The GPS 305 receives current vehicle location information, for example latitude and longitude data, from a plurality of satellites. GPS includes INS, GNSS schemes, and the like. GNSS is a method of determining my current location by receiving position signals from satellites, and INS may use a method of monitoring vehicle acceleration and integrating speed and distance from the acceleration.

Each has pros and cons. GNSS has problems with GPS reception sensitivity falling in high-rise building areas, basements, tunnels, etc., or when signals reflected from buildings are incorrectly input, my current location or direction of movement is wrongly twisted, and INS is an acceleration integration method Calculating the distance with , there is a problem that errors accumulate due to the integral constant C.

In the embodiment, the location of the vehicle can be determined by combining GNSS and INS data, and the location of the vehicle can be more accurately corrected by adding image data. Since the camera is accurately calibrated, the length from the bonnet to the camera, the height from the vehicle floor are fixed, and the angle for shooting the front is also fixed. can do. That is, as the vehicle gets closer to the feature point, the feature point continues to go down in each frame. For example, when a vehicle is currently running on a highway, it recognizes a feature point, for example, a road sign on the road, a specific condition of the road, etc. A way to calculate the distance traveled. That is, the actual moving distance of the vehicle may be more precisely corrected by using image recognition data in combination with INS and GNSS.

The photographing unit 310 includes at least one camera inside the vehicle, and photographs the surroundings of the vehicle while the vehicle enters and parks in the parking area. Here, the camera may be provided on the front or rear, or left and right sides of the vehicle.

When the vehicle is parked, the processor 320 obtains first parking location information from the GPS 305, and when the vehicle is parked, the photographing unit 310 photographs the identification information displayed in the parking area, and from the photographed identification information. Second parking location information is extracted. Here, the first parking location information may be a current location based on the latitude and longitude data received from the GPS 305, and the second parking location information is information about a parking area where a camera is photographed, such as "B3 D22". It may be parking area information.

The processor 320 determines parking information in which the vehicle is parked based on the first parking location information and the extracted second parking location information. For example, since GPS reception is impossible or less accurate indoors or underground, weight can be placed on the second parking location information. If the image does not exist, a weight may be placed on the first parking location information. The processor 320 determines a more accurate current parking location based on the two pieces of parking location information.

The processor 320 recognizes identification information included in each image frame from a plurality of image frames photographed by the photographing unit 310, and second parking location information, which is text corresponding to the parking location, from the recognized identification information. extract As shown in FIGS. 4A to 4D, when parking in a wide outdoor or complex indoor parking lot, the photographing unit 310 obtains a plurality of image frames through a front or rear camera as shown in FIGS. 4E and 4F during the parking process. do. As shown in FIGS. 5A and 5B , parking area information, that is, identification information 510 is recognized in any one frame 500 among a plurality of captured image frames. For example, the image shown in FIG. 5A is an image captured by a DVRS or a built-in cam, and the image shown in FIG. 5B is an image captured by a black box.

For example, when the vehicle arrives at its destination and the engine is turned off, the electronic device inside the vehicle, such as the ECU, AVN, or other vehicle electronic devices, displays the frame of the part where the parking area is expected to be marked among the images until parking is completed. can also be extracted.

As shown in FIG. 6A, only text information indicating a parking area is extracted from the recognized identification information 510. As shown in FIG. 6B, information 511 indicating that the currently parked parking lot is on the 3rd basement level and information 512 indicating the parking location are extracted. It is confirmed that the second parking location information, that is, the 3rd basement floor, is F09.

In addition, the checked parking location information may be corrected or changed according to the location of the camera of the currently captured image. For example, in a parked state, when the images captured by the front camera are B3 and F09, the current parking position of the vehicle may be estimated from B3 and F09 and determined to be B3 and E09.

Also, the processor 320 may transmit the determined parking information to the user terminal 350 through the communication network 340 . The user terminal may be a portable terminal or a smart phone owned by the driver of the vehicle, which will be described later with reference to FIG. 7 .

In the parking location guidance service device according to the embodiment, when the vehicle is parked in a wide and complicated place, the vehicle recognizes its own location and notifies the user's mobile phone or wearable device without the user's attention, so that the user can easily You can check the current location of your vehicle.

FIG. 7 is a schematic diagram of the user terminal 350 shown in FIG. 3 .

Referring to FIG. 7 , the user terminal may include a control unit 700 , a communication unit 710 and an output unit 740 . However, not all illustrated components are essential components. A user terminal may be implemented with more components than the illustrated components, or a user terminal may be implemented with fewer components.

For example, a user terminal according to an embodiment includes a user input unit 740, a sensing unit 750, an A/V input unit 760, and a memory ( 770) may be further included.

Hereinafter, the above components are examined in turn.

The control unit 700 typically controls the overall operation of the user terminal. For example, the control unit 700 executes programs stored in the memory 770, thereby enabling the communication unit 710, the output unit 730, the user input unit 740, the sensing unit 750, and the A/V input unit 760. ) and the memory 770, etc. can be overall controlled.

The communication unit 710 may include one or more components that allow communication between a user terminal and a server (not shown). For example, the communication unit 710 may include a short-distance communication unit 711, a mobile communication unit 712, and a broadcast reception unit 713.

The short-range wireless communication unit 721 includes a Bluetooth communication unit, a Bluetooth Low Energy (BLE) communication unit, a Near Field Communication unit, a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, and an infrared ( It may include an infrared data association (IrDA) communication unit, a Wi-Fi Direct (WFD) communication unit, an ultra wideband (UWB) communication unit, an Ant+ communication unit, etc., but is not limited thereto. The mobile communication unit 712 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the radio signal may include a voice call signal, a video call signal, or various types of data according to text/multimedia message transmission/reception. The broadcast receiver 713 receives a broadcast signal and/or broadcast-related information from the outside through a broadcast channel. Broadcast channels may include satellite channels and terrestrial channels. Depending on the implementation example, the user terminal may not include the broadcast receiving unit 713.

The output unit 730 displays information related to the stress indicator.

The output unit 730 is for outputting an audio signal, video signal, or vibration signal, and may include a display unit 731, a sound output unit 732, a vibration motor 733, and the like. The display unit 731 includes a key pad, a dome switch, a touch pad (contact capacitance method, pressure resistive film method, infrared sensing method, surface ultrasonic conduction method, integral tension measurement method, A piezo effect method, etc.), a jog wheel, a jog switch, etc. may be included, but are not limited thereto.

Meanwhile, the display unit 731 may be configured as a touch screen by forming a layer structure of a touch pad. The display unit 731 includes a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a 3D display ( 3D display) and at least one of electrophoretic display. Also, depending on the implementation form of the user terminal, the user terminal may include two or more display units 731 .

The audio output unit 732 outputs audio data received from the communication unit 710 or stored in the memory 770 . In addition, the sound output unit 731 outputs sound signals related to functions performed by the user terminal (eg, call signal reception sound, message reception sound, and notification sound). The sound output unit 732 may include a speaker, a buzzer, and the like.

The vibration motor 733 may output a vibration signal. For example, the vibration motor 733 may output a vibration signal corresponding to an output of audio data or video data (eg, call signal reception sound, message reception sound, etc.). Also, the vibration motor 733 may output a vibration signal when a touch is input to the touch screen.

The user input unit 740 means a means through which a user inputs data for controlling the user terminal 110 . For example, the user input unit 740 includes a key pad, a dome switch, a touch pad (contact capacitance method, pressure resistive film method, infrared sensing method, surface ultrasonic conduction method, integral type tension measuring method, piezo effect method, etc.), a jog wheel, a jog switch, and the like, but are not limited thereto.

The sensing unit 750 may detect a state of the user terminal or a state around the user terminal, and transmit the sensed information to the control unit 700 .

Meanwhile, the sensing unit 750 includes a magnetic sensor 751, an acceleration sensor 752, a temperature/humidity sensor 753, an infrared sensor 754, a gyroscope sensor 755, It may include at least one of a location sensor (eg, GPS) 756, an air pressure sensor 757, a proximity sensor 758, and an RGB sensor (illuminance sensor) 759, but is not limited thereto. Since a person skilled in the art can intuitively infer the function of each sensor from its name, a detailed description thereof will be omitted.

An audio/video (A/V) input unit 760 is for inputting an audio signal or a video signal, and may include a camera 761 and a microphone 762. The camera 761 may obtain an image frame such as a still image or a moving image through an image sensor in a video call mode or a photographing mode. An image captured through the image sensor may be processed through the controller 700 or a separate image processing unit (not shown).

An image frame processed by the camera 761 may be stored in the memory 770 or transmitted to the outside through the communication unit 710 . Two or more cameras 761 may be provided according to the configuration of the user terminal.

The microphone 762 receives external sound signals and processes them into electrical voice data. For example, the microphone 762 may receive a sound signal from an external device or a speaker. The microphone 762 may use various noise cancellation algorithms to remove noise generated in the process of receiving an external sound signal.

The memory 770 may store programs for processing and control of the control unit 700 or may store input/output data.

The memory 770 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg SD or XD memory, etc.), RAM (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk , an optical disk, and at least one type of storage medium. In addition, the device 100 may operate a web storage or cloud server that performs a storage function of the memory 170 on the Internet.

Programs stored in the memory 770 may be classified into a plurality of modules according to their functions, such as a UI module 771, a touch screen module 772, and a notification module 773. .

The UI module 771 may provide a specialized UI, GUI, and the like for each application to work with a user terminal. The touch screen module 772 may detect a user's touch gesture on the touch screen and transmit information about the touch gesture to the controller 700 . The touch screen module 772 according to an embodiment of the present invention may recognize and analyze a touch code. The touch screen module 772 may be configured as separate hardware including a controller.

Various sensors may be provided inside or near the touch screen to detect a touch or a proximity touch of the touch screen. There is a tactile sensor as an example of a sensor for detecting a touch of a touch screen. A tactile sensor refers to a sensor that detects a contact with a specific object to a degree or more than a human can feel. The tactile sensor may detect various information such as the roughness of a contact surface, the hardness of a contact object, and the temperature of a contact point.

In addition, there is a proximity sensor as an example of a sensor for sensing a touch of a touch screen.

A proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing nearby without mechanical contact by using the force of an electromagnetic field or infrared rays. Examples of the proximity sensor include a transmissive photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, an infrared proximity sensor, and the like. The user's touch gestures may include tap, touch & hold, double tap, drag, panning, flick, drag and drop, and swipe.

The notification module 773 may generate a signal for notifying occurrence of an event in a user terminal. Examples of events generated in the user terminal include call signal reception, message reception, key signal input, schedule notification, and the like. In addition, as an example of an event generated in the user terminal, a signal notifying that a user input is received may be generated based on a haptic signal generated based on a user input received by the display unit 731 .

The notification module 773 may output a notification signal in the form of a video signal through the display unit 731, output a notification signal in the form of an audio signal through the sound output unit 732, and may output a notification signal in the form of a vibration motor 733. A notification signal may be output in the form of a vibration signal through

8 and 9 are exemplary diagrams for explaining a parking location guidance service method using a vehicle terminal according to another embodiment.

When the parking location information service device 300 transmits the parking location of the vehicle confirmed during parking to the user terminal shown in FIG. 7, as shown in FIGS. 8A and 8B, it outputs the location of the currently parked vehicle as a guide message. . Here, information such as a parking building, a parking time, and a parking fee may be further displayed as well as the current parking location of the vehicle. In addition, information such as the current state of the vehicle, for example, a window open or a door open, may be further displayed.

When the parking location guidance service device 300 transmits the parking location of the vehicle confirmed during parking to the user terminal shown in FIG. 7, as shown in FIGS. 9A and 9B, in conjunction with a map application, etc., the current parking location is displayed on the map. may be displayed, or an image of a currently parked vehicle or a surrounding image captured by a black box of the vehicle may be displayed together on a map.

In an embodiment, if it is difficult to check a parking area with an image in a large outdoor parking lot such as an amusement park, if the GPS reception is in a good area, the vehicle's GPS data is transmitted to the user's mobile phone after the engine is turned off, and the user later When finding the parking location of a vehicle, it can be linked with MAP to precisely display the location where the vehicle is parked on the map.

10 is a flowchart illustrating a parking location guidance service method using a vehicle terminal according to another embodiment.

Referring to FIG. 10 , in step 1000, when the vehicle is parked, first parking location information is acquired from the GPS receiver of the vehicle terminal. In step 1002, when the vehicle is parked, identification information displayed in the parking area is photographed from at least one camera provided in the vehicle in conjunction with the vehicle terminal. In step 1004, second parking location information is extracted from the photographed identification information. In step 1006, parking information where the vehicle is parked is determined based on the obtained first parking location information and the extracted second parking location information.

In an embodiment, by transmitting the determined parking information to the user terminal, it is possible to provide various parking location guidance services.

In an embodiment, even if an image is taken with a black box during parking, the number of a nearby vehicle may not be recorded depending on the parking method and angle. At this time, even if the vehicle next to you in an unrecorded place crashes or escapes after impact, it is difficult to arrest unless there is a separate CCTV in the parking lot. The vehicle can be analyzed more clearly.

In an embodiment, in the case of a large outdoor park or a large event, the outdoor parking lot is very large, so even if the parking location is memorized, it is difficult to actually find the parking location later. Therefore, through the application of the user terminal, a record of the route the user has traveled on foot from the GPS data of the mobile phone for several minutes, for example, 10 minutes, 15 minutes, etc. You can also direct a walking route to get to this parked location.

The present embodiments may be implemented in the form of a recording medium including instructions executable by a computer, such as program modules executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, other data in a modulated data signal such as program modules, or other transport mechanism, and includes any information delivery media.

Also, in this specification, “unit” may be a hardware component such as a processor or a circuit, and/or a software component executed by the hardware component such as a processor.

The above description of this specification is for illustrative purposes, and those skilled in the art to which the content of this specification pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. There will be. Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present embodiment is indicated by the claims to be described later rather than the detailed description, and should be construed to include all changes or modifications derived from the meaning and scope of the claims and equivalent concepts thereof.

Claims (15)

In the parking location guidance service method using a vehicle terminal,
Obtaining first parking location information from a GPS receiver of the vehicle terminal when the vehicle is parked;
When the vehicle is parked, photographing first identification information displayed in a parking area from at least one camera provided in the vehicle in conjunction with the vehicle terminal;
Extracting second parking location information from the photographed first identification information;
determining parking information in which the vehicle is parked based on the obtained first parking location information and the extracted second parking location information; and
Transmitting the determined parking information to a user terminal through a communication network,
When the second parking location information is not extracted from the captured first identification information, recognizing second identification information included in each image frame from a plurality of image frames photographed by the at least one camera, Extracting the second parking location information, which is text corresponding to a parking location, from the recognized second identification information;
The step of judging is
A parking location guidance service method using a vehicle terminal, characterized in that setting different weights to the first parking location information and the second parking location information according to the parking environment of the vehicle and determining parking information in which the vehicle is parked. . delete delete According to claim 1,
The vehicle terminal,
A parking location guidance service method using a vehicle terminal, characterized in that it is a black box. According to claim 1,
When a predetermined application is executed in the user terminal, a parking location guidance service method using a vehicle terminal, characterized in that a location display corresponding to the parking information is displayed on a map. According to claim 5,
The parking information,
When the vehicle is parked, including image information corresponding to a parking area photographed by the at least one camera,
Parking location guidance service method using a vehicle terminal, characterized in that the image information is displayed on the map. According to claim 1,
When a predetermined application is executed in the user terminal, text information including at least one of a parking building corresponding to the parking information, a parking location, a parking time, and a parking fee is displayed on the user terminal. Parking location information service method using . A recording medium recording a program for executing the parking location guidance service method using the vehicle terminal according to any one of claims 1 and 4 to 7 in a computer. A vehicle terminal including a GPS receiver and a communication network;
at least one camera provided in a vehicle in conjunction with the vehicle terminal; and
contains a processor;
the processor,
When the vehicle is parked, first parking location information is acquired from the GPS receiver, and when the vehicle is parked, identification information displayed in a parking area is photographed from the at least one camera, and second information is obtained from the photographed first identification information. Extract parking location information, determine parking information in which the vehicle is parked based on the obtained first parking location information and the extracted second parking location information, and transmit the determined parking information to the user through the communication network. send to the terminal,
When the second parking location information is not extracted from the captured first identification information, recognizing second identification information included in each image frame from a plurality of image frames photographed by the at least one camera, Extracting the second parking location information, which is text corresponding to a parking location, from the recognized second identification information;
A parking location guidance service device using a vehicle terminal, characterized in that setting different weights to the first parking location information and the second parking location information according to the parking environment of the vehicle and determining parking information in which the vehicle is parked. . delete delete According to claim 9,
The vehicle terminal,
Parking location guidance service device using a vehicle terminal, characterized in that the black box. According to claim 9,
When a predetermined application is executed in the user terminal, a parking location guidance service device using a vehicle terminal, characterized in that a location display corresponding to the parking information is displayed on a map. According to claim 13,
The parking information,
Parking location guidance service device using a vehicle terminal, characterized in that when the vehicle is parked, the image information corresponding to the parking area captured by the at least one camera is included and the image information is displayed on the map. According to claim 9,
When a predetermined application is executed in the user terminal, text information including at least one of a parking building corresponding to the parking information, a parking location, a parking time, and a parking fee is displayed on the user terminal. Parking location guidance service device using.

Images