KR20210147410A - Method and apparatus for providing information using vehicle's camera - Google Patents

Abstract

According to an embodiment, an information providing service method using a vehicle camera photographs an identification code installed in a parking area of a collective building by at least one camera in a vehicle, extracts an identification image from the photographed identification code, extracts information corresponding to the photographed identification code If the extracted identification image is recognizable, and transmits the extracted information to a user terminal through a communication network.

Description

Information providing service method and apparatus using a vehicle camera

Embodiments relate to an information providing service method and apparatus using a vehicle camera.

Most of the conventional parking control systems focus on automation of license plate shooting and recognition, parking lot entry time, parking time, and settlement, etc., so that parking vehicle information can be checked only in a limited range through a parking manager or kiosk, and parking location confirmation and Fast settlement by mobile banking is insufficient.

Prior art 1 discloses a parking control system that can take a QR code installed in a parking lot using a smartphone and check the location of the vehicle and the vehicle status in real time using the parking management application of the smartphone. . However, in this case, the inconvenience of having to photograph the QR code with a smart phone directly after the driver parks the car still exists.

[Prior art literature number]

Prior art 1: Korea Patent Publication No. 2017-0000111

Prior art 2: Korean Patent Publication No. 2020-0009301

Embodiments provide an information providing service method and apparatus using a vehicle camera. Another object of the present invention is to provide a computer-readable recording medium in which a program for executing the method in a computer is recorded. The technical problem to be solved is not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above-described technical problem, the information providing service method using a vehicle camera according to an embodiment includes: photographing an identification code provided in a parking area of an assembly building by at least one camera in the vehicle; extracting an identification image from the photographed identification code, and when the extracted identification image is recognizable, extracting information corresponding to the photographed identification code; and transmitting the extracted information to a user terminal through a communication network.

The extracting step further comprises generating a converted identification image obtained by converting the size and angle of the extracted identification image, and extracting information corresponding to the identification code from the converted identification image.

If the information providing service method does not recognize the converted identification image, searching for another identification image corresponding to at least one other identification code installed around the parking area photographed while entering the parking area; and transmitting the retrieved other identification image to the user terminal through the communication network,

When user information input through an application installed in the user terminal is authenticated, the information providing service is executed in the user terminal based on the other transmitted identification image.

The extracted information is characterized in that it includes at least one of location information for a parking area in which the vehicle is parked, guide information for the assembly building, parking payment information, and reservation and payment information within the assembly building. .

The camera includes a front camera and a rear camera provided in the vehicle, wherein the identification code is a QR code provided on the floor of the parking area,

The photographing step is characterized in that the QR code is photographed with the rear camera while the vehicle enters the parking area in reverse.

The information providing service method displays a location where the vehicle is parked, a parking time and a parking fee, based on the extracted information, through an application installed in the user terminal, and based on the payment information input through the user terminal It is characterized in that the payment for the parking fee is made.

An information providing service apparatus using a vehicle camera according to another embodiment includes: a photographing unit for photographing an identification code provided in a parking area of an assembly building by at least one camera in the vehicle; and extracting an identification image from the photographed identification code, and when the extracted identification image is recognizable, extracting information corresponding to the photographed identification code, and transmitting the extracted information to a user terminal through a communication network includes a control unit.

The controller generates a converted identification image obtained by converting the size and angle of the extracted identification image, and extracts information corresponding to the identification code from the converted identification image.

The information providing service apparatus is mounted in the vehicle and is connected to the user terminal through a short-range communication network.

An information providing service apparatus according to another embodiment includes at least one camera; communication department; and a processor;

The processor captures the identification code provided in the parking area of the collective building through the at least one camera, extracts an identification image from the photographed identification code, and when the extracted identification image is recognizable, the photographed Extracting information corresponding to the identification code, and transmitting the extracted information to the user terminal through the communication unit.

It includes a recording medium in which a program for executing the information providing service method according to another embodiment in a computer is recorded.

1 is an internal block diagram of a vehicle;
FIG. 2 is a block diagram of the vehicle driving assistance system (ADAS) shown in FIG. 1 .
3 is a schematic diagram of an information providing service system using a vehicle camera according to an embodiment.
4 to 6 are exemplary views of an information providing service using a vehicle camera according to an embodiment.
7 is a schematic diagram of the user terminal shown in FIG.
8 is a flowchart illustrating an information providing service method using a vehicle camera according to another exemplary embodiment.

Phrases such as “in some embodiments” or “in one embodiment” appearing in various places in this specification are not necessarily all referring to the same embodiment.

Some embodiments of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented in various numbers of hardware and/or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors, or by circuit configurations for a given function. Also, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks may be implemented as an algorithm running on one or more processors. In addition, the present disclosure may employ prior art for electronic configuration, signal processing, and/or data processing, and the like. Terms such as “mechanism”, “element”, “means” and “configuration” may be used broadly and are not limited to mechanical and physical components.

In addition, the connecting lines or connecting members between the components shown in the drawings only exemplify functional connections and/or physical or circuit connections. In an actual device, a connection between components may be represented by various functional connections, physical connections, or circuit connections that are replaceable or added.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

1 is an internal block diagram of a vehicle according to an exemplary embodiment.

Referring to FIG. 1 , a vehicle 100 includes a communication unit 110 , an input unit 120 , a sensing unit 125 , a memory 130 , an output unit 140 , a vehicle driving unit 150 , and a vehicle driving assistance system (ADAS). , 160 ), a control unit 170 , an interface unit 180 , and a power supply unit 190 .

The communication unit 110 may include a short-range communication module, a location information module, an optical communication module, and a V2X communication module.

The input unit 120 may include a driving operation means, a camera, a microphone, and a user input unit.

The driving operation means receives a user input for driving the vehicle 100 . The driving operation means may include a steering input means, a shift input means, an acceleration input means, and a brake input means.

The acceleration input means receives an input for acceleration of the vehicle 100 from a user. The brake input means receives an input for decelerating the vehicle 100 from a user.

The camera may include an image sensor and an image processing module. The camera may process still images or moving images obtained by an image sensor (eg, CMOS or CCD). The image processing module may process a still image or a moving image obtained through an image sensor, extract necessary information, and transmit the extracted information to the controller 170 .

Meanwhile, the vehicle 100 may include a front camera for photographing an image of the front of the vehicle, an around-view camera for photographing an image around the vehicle, and a rear camera for photographing an image of the rear of the vehicle. Each camera may include a lens, an image sensor and a processor. The processor may computer-process the captured image to generate data or information, and transmit the generated data or information to the controller 170 . The processor included in the camera may be controlled by the controller 170 . In an embodiment, the camera captures a QR code affixed to a parking area or around a parking area of an aggregation building, for example on a floor or pole of a parking area.

The camera may include a stereo camera. In this case, the processor of the camera may detect a distance to an object, a relative speed to an object detected in the image, and a distance between a plurality of objects by using a disparity difference detected in the stereo image.

The camera may include a Time of Flight (TOF) camera. In this case, the camera may include a light source (eg, infrared or laser) and a receiver. In this case, the processor of the camera detects the distance to the object, the relative speed to the object, and the distance between the plurality of objects based on the time (TOF) until the infrared or laser emitted from the light source is reflected by the object and received. can do.

Meanwhile, the rear camera may be disposed in the vicinity of the rear license plate or the trunk or tailgate switch, but the position where the rear camera is disposed is not limited thereto.

Each image captured by the plurality of cameras may be transmitted to a processor of the camera, and the processor may synthesize the respective images to generate an image around the vehicle. In this case, the image around the vehicle may be displayed through the display unit as a top view image or a bird's eye image.

The sensing unit 125 senses various situations of the vehicle 100 . To this end, the sensing unit 125 includes a collision sensor, a wheel sensor, a speed sensor, an inclination sensor, a weight sensor, a heading sensor, a yaw sensor, and a gyro sensor. , position module, vehicle forward/reverse sensor, battery sensor, fuel sensor, tire sensor, steering sensor by steering wheel rotation, vehicle interior temperature sensor, vehicle interior humidity sensor, ultrasonic sensor, illuminance sensor, radar, lidar, etc. may include

Accordingly, the sensing unit 125 may include vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle inclination information, vehicle forward/reverse information, and battery information. , fuel information, tire information, vehicle lamp information, vehicle internal temperature information, vehicle internal humidity information, steering wheel rotation angle, and sensing signals for external illumination of the vehicle may be acquired.

The memory 130 is electrically connected to the control unit 170 . The memory 130 may store basic data for the unit, control data for operation control of the unit, and input/output data. The memory 130 may be various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, etc. in terms of hardware. The memory 130 may store various data for the overall operation of the vehicle 100 , such as a program for processing or controlling the controller 170 .

The output unit 140 is for outputting information processed by the control unit 170 , and may include a display unit, a sound output unit, and a haptic output unit.

The display unit may display information processed by the control unit 170 . For example, the display unit may display vehicle-related information. Here, the vehicle-related information may include vehicle state information indicating the current state of the vehicle or vehicle operation information related to the operation of the vehicle. For example, the display unit may display the current speed (or speed) of the vehicle, the speed (or speed) of the surrounding vehicle, and distance information between the current vehicle and the surrounding vehicle.

Meanwhile, the display unit may include a cluster so that the driver can check vehicle state information or vehicle operation information while driving. The cluster may be located above the dashboard. In this case, the driver may check the information displayed on the cluster while maintaining the gaze in front of the vehicle.

The sound output unit converts the electrical signal from the controller 170 into an audio signal and outputs the converted signal. To this end, the sound output unit may include a speaker or the like.

The vehicle driving unit 150 may control operations of various devices of the vehicle. The vehicle driving unit 150 may include a power source driving unit, a steering driving unit, a brake driving unit, a lamp driving unit, an air conditioning driving unit, a window driving unit, an airbag driving unit, a sunroof driving unit, and a suspension driving unit.

The power source driving unit may perform electronic control of the power source in the vehicle 100 . For example, when a fossil fuel-based engine (not shown) is the power source, the power source driving unit may electronically control the engine. Thereby, the output torque of an engine, etc. can be controlled. When the power source driving unit is the engine, the speed of the vehicle may be limited by limiting the engine output torque under the control of the controller 170 .

The brake driving unit may electronically control a brake apparatus (not shown) in the vehicle 100 . For example, the speed of the vehicle 100 may be reduced by controlling the operation of a brake disposed on the wheel. As another example, the moving direction of the vehicle 100 may be adjusted to the left or right by changing the operation of the brakes respectively disposed on the left wheel and the right wheel.

The lamp driver may control turning on/off of a lamp disposed inside or outside the vehicle. In addition, it is possible to control the intensity and direction of the light of the lamp. For example, control of a direction indicator lamp, a brake lamp, and the like may be performed.

The controller 170 may control the overall operation of each unit in the vehicle 100 . The control unit 170 may be referred to as an Electronic Control Unit (ECU). The above-described accident determination apparatus may be driven by the control unit 170 .

The control unit 170, in hardware, ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), processors ( processors), controllers, micro-controllers, microprocessors, and other electrical units for performing other functions may be implemented using at least one.

In one embodiment, the controller 170 extracts an identification image from the identification code photographed through the camera, and when the extracted identification image is recognizable, extracts information corresponding to the photographed identification code, and transmits the extracted information to the communication network transmitted to the user terminal through Here, the extracted information may include location information for a parking area in which the vehicle is parked, guide information for an assembly building, parking payment information, or reservation and payment information within the assembly building.

The interface unit 180 may serve as a passage with various types of external devices connected to the vehicle 100 . For example, the interface unit 180 may have a port connectable to a mobile terminal (not shown), and may connect to a mobile terminal (not shown) through the port. In this case, the interface unit 180 may exchange data with the mobile terminal.

The power supply unit 190 may supply power required for the operation of each component under the control of the control unit 170 . In particular, the power supply unit 190 may receive power from a battery (not shown) inside the vehicle.

FIG. 2 is a block diagram of the vehicle driving assistance system (ADAS) shown in FIG. 1 .

The ADAS 200 is a vehicle driving assistance system that assists the driver to provide convenience and safety.

The ADAS 200 includes an automatic emergency braking module (hereinafter, AEB: Autonomous Emergency Braking) 210, a forward collision avoidance module (hereinafter, FCW: Forward Collision Warning) 211, a lane departure warning module (hereinafter, LDW: Lane). Departure Warning) (212), Lane Keeping Assist Module (LKA: Lane Keeping Assist) (213), Speed Assist System Module (SAS: Speed Assist System) (214), Traffic Signal Detection Module (TSR: Traffic Sign) Recognition) (215), adaptive high beam control module (hereafter, HBA: High Beam Assist) (216), blind spot monitoring module (hereafter, BSD: Blind Spot Detection) (217), automatic emergency steering module (hereafter, AES: Autonomous Emergency Steering) (218), Curve Speed Warning System Module (hereinafter, CSWS: Curve Speed Warning System) (219), Adaptive Cruise Control Module (hereinafter, ACC: Adaptive Cruise Control) (220), Smart Parking System Module (hereafter) , SPAS: Smart Parking Assist System) 221 , a traffic jam assist module (hereinafter, TJA: Traffic Jam Assist) 222 , and an around view monitor module (hereinafter, AVM: Around View Monitor) 223 . .

Each of the ADAS modules 210 , 211 , 212 , 213 , 214 , 215 , 216 , 217 , 218 , 219 , 220 , 221 , 222 , 223 may include a processor for controlling a vehicle driving assistance function.

A processor included in each of the ADAS modules 210 , 211 , 212 , 213 , 214 , 215 , 216 , 217 , 218 , 219 , 220 , 221 , 222 , 223 may be controlled by the controller 270 . .

Each of the ADAS modules 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223 processor is, in hardware, ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), processors, controllers, micro-controllers, microprocessors ( microprocessors) and may be implemented using at least one of electrical units for performing other functions.

The AEB 210 is a module for controlling automatic braking in order to prevent a collision with a detected object. The FCW 211 is a module that controls to output a warning in order to prevent a collision with an object in front of the vehicle. The LDW 212 is a module that controls to output a warning to prevent lane departure while driving. The LKA 213 is a module that controls to maintain a driving lane while driving. The SAS 214 is a module that controls the vehicle to travel at a set speed or less. The TSR 215 is a module that detects a traffic signal while driving and provides information based on the detected traffic signal. The HBA 216 is a module that controls the irradiation range or irradiation amount of the high beam according to the driving situation. The BSD 217 is a module that detects an object outside the driver's field of view while driving and provides detection information. The AES 218 is a module that automatically performs steering in an emergency. The CSWS 219 is a module that controls to output a route when driving at a speed higher than a preset speed during curve driving. The ACC 220 is a module that controls to follow and drive a preceding vehicle. The SPAS 221 is a module that detects a parking space and controls to park in the parking space. The TJA 222 is a module that controls to automatically operate in case of traffic jam. The AVM 223 is a module that provides an image around the vehicle and controls to monitor the surroundings of the vehicle.

The ADAS 200 provides a control signal for performing each vehicle driving assistance function to the output unit 250 or the vehicle driving unit 260 based on the data obtained from the input unit 230 or the sensing unit 235 . can do. The ADAS 200 may directly output the control signal to the output unit 250 or the vehicle driving unit 260 through in-vehicle network communication (eg, CAN). Alternatively, the ADAS 200 may output the control signal to the output unit 250 or the vehicle driving unit 260 via the control unit 270 .

3 is a schematic diagram of an information providing service system using a vehicle camera according to an embodiment.

Referring to FIG. 3 , it includes an information providing service device 300 using a vehicle camera, a communication network 340 , and a user terminal 350 . The information providing service device 300 may be the ADAS described with reference to FIGS. 1 and 2 , but is not limited thereto, and may be a black box, a navigation device, an IVI device, or a telematics terminal.

The information providing service apparatus 300 includes a photographing unit 310 , a processor 320 , and a communication unit 330 .

The photographing unit 310 photographs the identification code provided in the parking area of the assembly building by at least one camera in the vehicle. Here, the camera may be a front or rear camera. A collective building refers to a building that can park hundreds or thousands of vehicles on several underground floors, such as apartments, department stores, and shopping malls. The identification code may be a QR code. A QR code (Quick Response code) is a matrix-type bar code that displays information in a black and white grid pattern. , QR code is a two-dimensional configuration that can record up to 7,089 numbers, 4,296 characters, and 1,817 Chinese characters by using horizontal and vertical characters. A QR code can contain a long sentence Internet address (URL), photo and video information, map information, business card information, etc. Recently, QR codes have been widely used both online and offline as they are commonly used as an important promotional and marketing tool for companies.

If the QR code is recognized through the QR code provided through the parking lot of the collective building, the currently parked location is displayed on the APP of the linked mobile phone or preset mobile phone, and the parking time, parking fee, and remaining time for free parking are displayed on the APP. It can be checked, and parking fee settlement can also be provided through the APP. In addition, you can check the remaining parking spaces in the corresponding parking lot by searching or favorites. In addition, in the case of an apartment, it is also possible to provide notice information such as event schedules, etc. In the case of large discount stores, functions such as flyers for discount items, available coupons, and store location search can be added. In the case of a movie theater, a service for pre-purchasing snacks and drinks and providing usable coupons may be included. In the case of lodging establishments, the unmanned payment system can provide confirmation, payment, and usable coupons for currently available accommodations, and a smart key can be provided with a smart phone so that it can be used without an admission procedure at a kiosk or information.

The processor 320 extracts the identification image from the photographed identification code, and when the extracted identification image is recognizable, extracts information corresponding to the photographed identification code, and transmits the extracted information to the user through the communication network 340 It is transmitted to the terminal 350 . In addition, the processor 320 may generate a converted identification image obtained by converting the size and angle of the extracted identification image, and extract information corresponding to the identification code from the converted identification image. As shown in Figures 4a and 4b, while the vehicle 400 is parked in reverse in the parking area (position 26), the QR code 410 located on the floor of the parking area is photographed. Here, as shown in FIG. 5 , when the driver of the vehicle shifts backward, the rear camera automatically takes a picture of the rear area, and the QR code 510 provided on the floor is automatically taken. In this case, as shown in FIG. 6 , when photographing a QR code located on the floor, an obliquely distorted QR code image 610 is photographed, and it may be difficult to identify the QR code. In this case, in the processor 320, the image conversion algorithm, for example, the pixel value through an affine conversion, and the QR code image 610 distorted through the size and angle conversion of the image through the square-shaped QR code image ( 620), it is possible to increase the QR code recognition rate.

Here, although it has been described as converting the photographed identification code in the processor 320 of the device 300, an identification image corresponding to the photographed identification code is transmitted to the user terminal 350, and the identification image in the user terminal 350 It is also possible to transform the size and angle of .

In addition, when the processor 320 does not recognize the converted identification image, it searches for another identification image corresponding to at least one other identification code installed around the parking area photographed while entering the parking area, and retrieves the other identification image. may be transmitted to the user terminal 350 through the communication network 340 . For example, if the QR code is not placed on the floor of the parking area, is difficult to photograph, or cannot be identified even after conversion, check whether there is another identification code that is automatically photographed while entering the parking area of the parking lot. It can also be searched and used as information.

In addition, when user information input through an application installed in the user terminal 350 is authenticated, the information providing service may be executed in the user terminal 350 based on another transmitted identification image.

The communication unit 330 transmits and receives data to and from the user terminal 350 through the communication network 340 . The communication network 340 may be short-range communication with the user terminal 350 carried by the driver in the vehicle, for example, Bluetooth, ZigBee, NFC, etc., but is not limited thereto.

The user terminal 350 receives the extracted information from the device 300, executes the application, and uses the extracted information to check parking-related information, for example, a parking location, etc., and may pay a parking fee. have.

7 is a schematic diagram of the user terminal shown in FIG.

Referring to FIG. 7 , the user terminal may include a control unit 700 , a communication unit 710 , and an output unit 740 . However, not all illustrated components are essential components. The user terminal may be implemented by more elements than the illustrated elements, and the user terminal may be implemented by fewer elements than that.

For example, the user terminal according to an embodiment includes a user input unit 740 , a sensing unit 750 , an A/V input unit 760 and a memory ( ) in addition to the control unit 700 , the communication unit 710 and the output unit 730 . 770) may be further included.

Hereinafter, the above components will be described in turn.

The controller 700 generally controls the overall operation of the user terminal. For example, the control unit 700 executes programs stored in the memory 770 , and thus the communication unit 710 , the output unit 730 , the user input unit 740 , the sensing unit 750 , and the A/V input unit 760 . ) and the memory 770 can be controlled in general.

The controller 700, while acquiring a plurality of images of the subject through a camera sensor and a built-in flash, records time information in each of the plurality of acquired images, extracts a pulse wave signal from the plurality of images, and records the The extracted pulse wave signal may be corrected using the time information, a heart rate variability may be calculated from the corrected pulse wave signal, and a stress index may be measured using the calculated heart rate variability.

In the embodiment, it has been described that the stress index is measured by the processor of the user terminal itself, but the present invention is not limited thereto, and the user terminal acquires only a finger image and transmits the image data to an external server (not shown) to calculate the stress index. of course there is

The communication unit 710 may include one or more components that allow communication between a user terminal and a server (not shown). For example, the communication unit 710 may include a short-range communication unit 711 , a mobile communication unit 712 , and a broadcast receiving unit 713 .

Short-range wireless communication unit 721, Bluetooth communication unit, BLE (Bluetooth Low Energy) communication unit, short-range wireless communication unit (Near Field Communication unit), WLAN (Wi-Fi) communication unit, Zigbee (Zigbee) communication unit, infrared ( It may include an IrDA, infrared Data Association) communication unit, a Wi-Fi Direct (WFD) communication unit, an ultra wideband (UWB) communication unit, an Ant+ communication unit, and the like, but is not limited thereto. The mobile communication unit 712 transmits/receives wireless signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text/multimedia message. The broadcast receiving unit 713 receives a broadcast signal and/or broadcast-related information from the outside through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. According to an implementation example, the user terminal may not include the broadcast receiver 713 .

The output unit 730 displays information related to the stress index.

The output unit 730 is for outputting an audio signal, a video signal, or a vibration signal, and may include a display unit 731 , a sound output unit 732 , a vibration motor 733 , and the like. The display unit 731 includes a key pad, a dome switch, a touch pad (contact capacitive method, pressure resistance film method, infrared sensing method, surface ultrasonic conduction method, integral tension measurement method, piezo effect method, etc.), a jog wheel, a jog switch, etc. may be included, but is not limited thereto.

Meanwhile, the display unit 731 may be configured as a touch screen by forming a layer structure of a touch pad. The display unit 731 includes a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display ( 3D display) and electrophoretic display (electrophoretic display) may include at least one. In addition, depending on the implementation form of the user terminal, the user terminal may include two or more display units 731 .

The sound output unit 732 outputs audio data received from the communication unit 710 or stored in the memory 770 . Also, the sound output unit 731 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, and a notification sound) performed in the user terminal. The sound output unit 732 may include a speaker, a buzzer, and the like.

The vibration motor 733 may output a vibration signal. For example, the vibration motor 733 may output a vibration signal corresponding to the output of audio data or video data (eg, a call signal reception sound, a message reception sound, etc.). Also, the vibration motor 733 may output a vibration signal when a touch is input to the touch screen.

The user input unit 740 means a means for a user to input data for controlling the user terminal 110 . For example, the user input unit 740 includes a keypad, a dome switch, and a touch pad (contact capacitive method, pressure resistance film method, infrared sensing method, surface ultrasonic conduction method, integral type). There may be a tension measurement method, a piezo effect method, etc.), a jog wheel, a jog switch, and the like, but is not limited thereto.

The sensing unit 750 may detect a state of the user terminal or a state around the user terminal, and transmit the sensed information to the controller 700 .

Meanwhile, the sensing unit 750 includes a magnetic sensor 751, an acceleration sensor 752, a temperature/humidity sensor 753, an infrared sensor 754, a gyroscope sensor 755, It may include at least one of a location sensor (eg, GPS) 756 , a barometric pressure sensor 757 , a proximity sensor 758 , and an illuminance sensor 759 , but is not limited thereto. Since a function of each sensor can be intuitively inferred from the name of a person skilled in the art, a detailed description thereof will be omitted.

The A/V (Audio/Video) input unit 760 is for inputting an audio signal or a video signal, and may include a camera 761 , a microphone 762 , and the like. The camera 761 may obtain an image frame such as a still image or a moving picture through an image sensor in a video call mode or a shooting mode. The image captured through the image sensor may be processed through the controller 700 or a separate image processing unit (not shown).

The image frame processed by the camera 761 may be stored in the memory 770 or transmitted to the outside through the communication unit 710 . Two or more cameras 761 may be provided according to the configuration of the user terminal. The camera 761 according to the embodiment may be provided on the rear side as shown in FIG. 6 .

The microphone 762 receives an external sound signal and processes it as electrical voice data. For example, the microphone 762 may receive an acoustic signal from an external device or a speaker. The microphone 762 may use various noise removal algorithms to remove noise generated in the process of receiving an external sound signal.

The memory 770 may store a program for processing and control of the controller 700 or may store input/output data.

The memory 770 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory), and a RAM. (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk , may include at least one type of storage medium among optical disks. In addition, the device 100 may operate a web storage or a cloud server that performs a storage function of the memory 170 on the Internet.

Programs stored in the memory 770 may be classified into a plurality of modules according to their functions, for example, may be classified into a UI module 771 , a touch screen module 772 , a notification module 773 , and the like. .

The UI module 771 may provide a specialized UI, GUI, and the like that is interlocked with the user terminal for each application. The touch screen module 772 may detect a touch gesture on the user's touch screen and transmit information about the touch gesture to the controller 700 . The touch screen module 772 according to an embodiment of the present invention may recognize and analyze a touch code. The touch screen module 772 may be configured as separate hardware including a controller.

Various sensors may be provided inside or near the touch screen to detect a touch or a proximity touch of the touch screen. A tactile sensor is an example of a sensor for detecting a touch of a touch screen. A tactile sensor refers to a sensor that senses a touch of a specific object to the extent or higher than that felt by a human. The tactile sensor may sense various information such as the roughness of the contact surface, the hardness of the contact object, and the temperature of the contact point.

In addition, as an example of a sensor for detecting a touch of a touch screen, there is a proximity sensor.

The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity without mechanical contact using the force of an electromagnetic field or infrared rays. Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. The user's touch gesture may include tap, touch & hold, double tap, drag, pan, flick, drag and drop, swipe, and the like.

The notification module 773 may generate a signal for notifying the occurrence of an event in the user terminal. Examples of events occurring in the user terminal include call signal reception, message reception, key signal input, schedule notification, and the like. In addition, as an example of an event occurring in the user terminal, a signal indicating that a user input is received may be generated based on a haptic signal generated based on a user input received from the display unit 731 .

The notification module 773 may output a notification signal in the form of a video signal through the display unit 731 , may output a notification signal in the form of an audio signal through the sound output unit 732 , and the vibration motor 733 . It is also possible to output a notification signal in the form of a vibration signal through

8 is a flowchart illustrating an information providing service method using a vehicle camera according to another exemplary embodiment.

Referring to FIG. 8 , in step 800, the identification code provided in the parking area of the assembly building is photographed by at least one camera in the vehicle. In step 802, an identification image is extracted from the captured identification code, and in step 804, the extracted identification image is recognized. In step 806, information corresponding to the captured identification code is extracted, and in step 808, the extracted information is transmitted to the user terminal. In an embodiment, the information extracted through the user terminal, for example, location information about the parking area where the vehicle is parked, guide information about the assembly building, parking payment information, or reservation and payment information in the assembly building is used. Although described, of course, the present invention is not limited thereto and may be used in a multimedia device in a vehicle. In addition, various information can be provided to the user by utilizing the information extracted through the execution of the application of the user terminal.

The present embodiments may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer-readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, other data in modulated data signals, such as program modules, or other transport mechanisms, and includes any information delivery media.

Also, in this specification, "unit" may be a hardware component such as a processor or circuit, and/or a software component executed by a hardware component such as a processor.

The above description of the present specification is for illustration, and those of ordinary skill in the art to which the content of this specification belongs can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. There will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a dispersed form, and likewise components described as distributed may be implemented in a combined form.

The scope of the present embodiment is indicated by the claims to be described later rather than the detailed description, and it should be construed to include all changes or modifications derived from the meaning and scope of the claims and their equivalents.

Claims (11)

In the information providing service method using a vehicle camera,
photographing the identification code provided in the parking area of the collective building by at least one camera in the vehicle;
extracting an identification image from the photographed identification code, and when the extracted identification image is recognizable, extracting information corresponding to the photographed identification code; and
and transmitting the extracted information to a user terminal through a communication network. The method of claim 1,
The extraction step is
Further comprising the step of generating a converted identification image by converting the size and angle of the extracted identification image,
Information providing service method, characterized in that extracting information corresponding to the identification code from the converted identification image. 3. The method of claim 2,
If the converted identification image is not recognized, searching for another identification image corresponding to at least one other identification code installed around the parking area photographed while entering the parking area; and
Transmitting the retrieved other identification image to the user terminal through the communication network,
When the user information input through the application installed in the user terminal is authenticated, the information providing service method, characterized in that the information providing service is executed based on the other transmitted identification image in the user terminal. The method of claim 1,
The extracted information is
An information providing service method, characterized in that it includes at least one of location information on a parking area in which the vehicle is parked, guide information for the assembly building, parking payment information, and reservation and payment information in the assembly building. The method of claim 1,
The camera is
Including a front camera and a rear camera provided in the vehicle,
The identification code is a QR code provided on the floor of the parking area,
The filming step is
While the vehicle enters the parking area in reverse, the information providing service method, characterized in that for photographing the QR code with the rear camera. The method of claim 1,
Through the application installed in the user terminal, on the basis of the extracted information, to display the location, parking time and parking fee of the vehicle,
An information providing service method, characterized in that the payment for the parking fee is made based on the payment information input through the user terminal. A recording medium recording a program for executing the information providing service method according to any one of claims 1 to 6 on a computer. In the information providing service device using a vehicle camera,
a photographing unit for photographing the identification code provided in the parking area of the collective building by at least one camera in the vehicle; and
A control unit that extracts an identification image from the photographed identification code, and when the extracted identification image is recognizable, extracts information corresponding to the photographed identification code, and transmits the extracted information to a user terminal through a communication network An information providing service device comprising a. 9. The method of claim 8,
The control unit is
An information providing service apparatus, characterized in that generating a converted identification image obtained by converting the size and angle of the extracted identification image, and extracting information corresponding to the identification code from the converted identification image. 9. The method of claim 8,
The information providing service device,
The information providing service device, characterized in that it is mounted in the vehicle and is connected to the user terminal through a short-distance communication network. at least one camera;
communication department; and
including a processor;
The processor is
The identification code provided in the parking area of the collective building is photographed through the at least one camera,
Extracting an identification image from the photographed identification code, extracting information corresponding to the photographed identification code when the extracted identification image is recognizable, and transmitting the extracted information to a user terminal through the communication unit An information providing service device, which is characterized.

Images