KR20190110838A - Method and System for Providing Vehicle related Service based on Recognition of Situation by using In-Vehicle Camera - Google Patents

Abstract

According to the present invention, a method for providing a vehicle-related service based on context awareness by using an in-vehicle camera, which is performed through a system including M (M >= 1) camera units provided inside a vehicle and oriented in directions designated to the outside of the vehicle, comprises: allowing an image acquisition unit to acquire M pieces of image information captured through the M camera units provided inside the vehicle and oriented in the directions designated to the outside of the vehicle; allowing a sign recognition unit to generate recognition information including n sign information in which n (1 <= n <= N) specific signs included in the m (1 <= m <= M) image information among N (N >= 1) signs designated for context awareness are recognized, by reading the acquired M image information; when the n specific signs are recognized, allowing a location confirmation unit to confirm location information corresponding to a vehicle location at a timepoint, at which the n specific signs are recognized, and allowing a state confirmation unit to confirm driving state information corresponding to a vehicle driving state for a predetermined time based on the timepoint at which the n specific signs are recognized; allowing a context awareness unit to recognize a specific situation for starting a designated vehicle-related service by linking and analyzing the recognition information, the location information, and the driving state information based on situation setting information set to start the designated vehicle-related service based on context awareness; and allowing a service providing unit to provide the started vehicle-related service when the specific situation is recognized. The present invention allows a user to receive service related to a vehicle corresponding to the specific situation.

Description

Method and System for Providing Vehicle related Service based on Recognition of Situation by using In-Vehicle Camera}

The present invention recognizes a specific mark by reading an image taken outside through a vehicle camera installed inside the vehicle, identification information identifying the vehicle, recognition information identified by recognizing the specific mark through the vehicle camera, and recognizes the specific mark The present invention relates to a method and system for providing an appropriate vehicle-related service by determining which vehicle-related service is required to start by using location information of one time point and driving state information at a time of recognizing a specific mark.

As more users use vehicles, various vehicle-related services (oiling, parking, payment, etc.) have emerged. In general, for vehicle-related services, the driver of the vehicle had to get off or open a window to request service.

Republic of Korea Patent Publication No. 10-2013-0110436 (released October 10, 2013) relates to a mobile fueling payment system, using a camera disposed at the gas station to describe the configuration of the fueling region and location have.

However, since the service is provided depending on an external camera such as a gas station, the driver inside the vehicle has to be passive, and it is difficult to use the service unless the user visits a gas station or the like equipped with a vehicle monitoring system such as an external camera. In addition, the cost of constructing the service system was not small from a gas station.

An object of the present invention for solving the above problems is to recognize a specific mark from the outside through one or more camera units installed inside the vehicle, and to check the vehicle position at the time when the specific mark is recognized, to provide a designated vehicle-related service. The present invention provides a method and a system for providing a context-based vehicle-related service using an in-vehicle camera to provide a vehicle-related service when it is recognized that the specific situation is disclosed.

According to the present invention, a method for providing a context-based vehicle-related service using an in-vehicle camera may be implemented through a system including M (M≥1) camera units provided in a vehicle in a direction specified to the outside of the vehicle. The first step of acquiring M image information obtained by directing a predetermined direction outside the vehicle through the M camera units provided in the vehicle, and the mark recognition unit reads the acquired M image information to recognize the situation. Recognition information including n mark information that recognizes n (1 ≦ n ≦ N) specific marks included in m (1 ≦ m ≦ M) image information among N (N ≧ 1) marks specified for When the second step of generating and the n specific marks are recognized, the position confirming unit checks the position information corresponding to the vehicle position at the time when the n specific marks are recognized, and the state checking unit checks the n A third step of confirming driving state information corresponding to the driving state of the vehicle for a predetermined time on the basis of the recognition time of the specific mark and the situation setting unit configured to start the vehicle related service based on the designated situation recognition unit. A fourth step of recognizing a specific situation for starting a specified vehicle-related service by linking and analyzing the recognition information, location information, and driving state information based on the reference; and if the specific situation is recognized, the service provider is configured to And a fifth step of performing a providing procedure.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the M camera units, the front camera unit facing the front direction of the vehicle, the rear camera unit facing the rear direction of the vehicle, And at least one camera unit among the side camera unit facing the side direction and the mirror camera unit provided in the side mirror of the vehicle.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, camera identification information for identifying M camera units provided in the vehicle and a direction for identifying the directions directed to the M camera units And storing the identification information in a designated storage area of the vehicle apparatus associated with the M camera units.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, at least one of the camera identification information and the direction identification information is confirmed in connection with the image information or included in the image information. do.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, at least one of the camera identification information and the direction identification information is confirmed in association with the recognition information or included in the recognition information. do.

In the context-based vehicle-related service providing method using the in-vehicle camera according to the present invention, the unique storage information for identifying the vehicle having the information storage unit M camera unit, the designated storage of the vehicle device associated with the M camera unit And storing the data in an area.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the unique identification information, the image information, recognition information, location information, driving state information from the vehicle device to the operation server through a communication network In the case of transmitting at least one of the information is characterized in that it is transmitted to the operating server with the transmitted information.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the unique identification information is a vehicle number, a unique identification value uniquely assigned to a vehicle separately for a vehicle-related service, and a signal connected to a cigar jack of the vehicle. And at least one of a unique identification value included in the wireless signal transmitted through the transmitter, and a unique identification value uniquely assigned to the vehicle apparatus.

In the context-aware vehicle-based service providing method using an in-vehicle camera according to the present invention, the unique identification information may be provided when the vehicle apparatus includes a user wireless terminal or a user wireless terminal is used for the vehicle-related service. And at least one of a unique identification number of the user wireless terminal and an app identification value uniquely assigned to the app installed in the user wireless terminal.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the information storage unit further comprises the step of registering and storing the unique identification information for identifying the vehicle having the M camera unit in the storage medium of the designated operation server It is characterized by comprising.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the unique identification information is used to identify the vehicle or provide the vehicle-related service in the operation server.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the N marks are a stop line, a parking line, a lane, a letter, a number, a symbol, a pattern, a pattern displayed on the floor surface. , Barcodes, 2D codes, letters, numbers, symbols, patterns on the panel attached or mounted on the floor, patterns, barcodes, 2D codes, characters on the walls, numbers, symbols, patterns, patterns, barcodes, 2D codes, Letters, numbers, symbols, patterns, patterns, barcodes, 2D codes, characters, numbers, symbols, patterns, patterns, barcodes, 2D codes, displayed on one side of the designated vehicle-targeted service device Characterized in that it comprises at least one of letters, numbers, symbols, patterns, patterns, barcodes, 2D code displayed on the panel attached to one surface of the designated vehicle target service device.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the vehicle target service apparatus, the gas station provided in the gas station, the charger provided in the charging station, the parking provided in the parking lot, provided on the road It characterized in that it comprises at least one device of the toll gate device.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the recognition information, the marker information including marker identification information for identifying a specific marker, the character information corresponding to the specific marker, numeric information, M of the marker information including at least one of the symbol information, the glyph information corresponding to the specific marker, the marker information including at least one of the design information, and the marker information encoded in the specific marker in the form of a barcode or 2D code. And n pieces of marker information recognized through pieces of image information.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the position information is linked to the M camera unit, the position information is located through the position location of the vehicle apparatus provided in the vehicle It is characterized by comprising.

In the context-based vehicle-related service providing method using the in-vehicle camera according to the present invention, the driving state information, the parking state information, the stop state information, the slow state information below the specified reference speed, road running state information, driving speed Characterized in that it comprises at least one of the information.

In the context-aware vehicle-based service providing method using an in-vehicle camera according to the present invention, the context setting information includes position region information for setting a specific position region related to a designated vehicle-related service and a position region related to a designated vehicle-related service Range setting information for setting the inside or outside of the vehicle, distance setting information for setting the distance from the reference position related to the specified vehicle-related service, boundary setting information for setting the distance away from the boundary of the location area related to the specified vehicle-related service, At least one position-related situation setting information of the driving condition information for setting the designated road driving condition, and at least one of a parking state, a stopping state, a slowing state, a road running state, and a driving speed range of the vehicle for starting the designated vehicle-related service; Driving-related situation setting information for setting It is characterized in that it comprises a marker-related context setting information for setting a specific situation corresponding to a specific marker recognized from the image information photographed in the designated direction through the camera unit inside the vehicle to start the switch.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the marker-related context setting information, the location information satisfies at least one position-related context setting information and the driving state information is at least one And the marker setting information set to determine that the specified specific situation has occurred when recognizing the specific mark from the image information photographed in the designated direction through the camera unit inside the vehicle in a situation where the driving related situation setting information is satisfied. It features.

In the method of providing a context-based vehicle-related service using an in-vehicle camera according to the present invention, in the fourth step, the situation recognition unit determines whether the location information satisfies at least one location-related context setting information, and the driving Determining whether the status information satisfies at least one driving-related situation setting information designated for initiating a designated vehicle-related service; and at least one driving state information while the position information satisfies at least one position-related situation setting information. Reading the n pieces of marker information included in the recognition information on the basis of the marker-related context setting information, and recognizing a specific situation for starting a specified vehicle-related service based on the marker-related context setting information. Characterized in that made.

In the method of providing a context-based vehicle-related service using an in-vehicle camera according to the present invention, in the fifth step, when the vehicle-related service includes a payment service, the service providing unit may correspond to the specific situation. Confirming payment information including a payment amount received from a service device and affiliated store information, and performing a payment process of processing a payment for the payment information by using the payment means information of a user registered in advance by the service provider; And providing, by the service providing unit, payment result information corresponding to the payment procedure to the vehicle target service device.

In the method of providing a context-based vehicle-related service using an in-vehicle camera according to the present invention, in the fifth step, when the vehicle-related service includes a payment service, the service provider is connected with the M camera units. Confirming payment information including a payment amount received from the vehicle apparatus provided in the vehicle and affiliated store information corresponding to the specific situation, and providing the payment information to the payment information using the payment means information of the registered user; And performing a payment procedure for processing a payment for the payment and providing the payment result information corresponding to the payment procedure to the vehicle apparatus by the service provider.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, when the vehicle-related service includes a payment service, the fifth step is received from an app of a user wireless terminal designated by the service provider. Confirming the payment information including the received payment amount and affiliated store information corresponding to the specific situation and performing a payment process for processing the payment information using the payment means information of the registered user of the service provider; And providing the payment result information corresponding to the payment procedure to the app of the user's wireless terminal.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the image acquisition unit, the marker recognition unit, the position confirmation unit, the state confirmation unit, the situation recognition unit and the service providing unit, the M camera unit It is characterized in that it is implemented through a vehicle device provided in the vehicle in conjunction with.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the image acquisition unit, the marker recognition unit, the positioning unit, the state confirmation unit and the situation recognition unit, the vehicle associated with the M camera unit It is implemented through a vehicle device provided therein, wherein the service provider is characterized in that it is implemented through an operation server to communicate with the vehicle device.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the image acquisition unit, the marker recognition unit, the position check unit and the state check unit is provided in the vehicle in association with the M camera unit The vehicle is implemented through a vehicle device, and the situation recognition unit and the service provider are implemented through an operation server communicating with the vehicle device.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the image acquisition unit, the marker recognition unit and the position determiner, in conjunction with the M camera unit through a vehicle device provided inside the vehicle The status checking unit, the situation recognizing unit, and the service providing unit may be implemented through an operation server communicating with the vehicle apparatus.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the image acquisition unit and the marker recognition unit is implemented through a vehicle device provided in the vehicle in association with the M camera unit, The location checking unit, the status checking unit, the situation recognizing unit, and the service providing unit may be implemented through an operation server communicating with the vehicle apparatus.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the image acquisition unit is implemented through a vehicle device provided in the vehicle in association with the M camera unit, and the mark recognition unit and The location checking unit, the status checking unit, the situation recognizing unit, and the service providing unit may be implemented through an operation server communicating with the vehicle apparatus.

In the context-based vehicle-related service providing method using an in-vehicle camera according to the present invention, the image acquisition unit, the marker recognition unit, the position confirmation unit, the state confirmation unit, the situation recognition unit and the service providing unit, the M camera unit It is characterized in that it is implemented through the operating server to communicate with the vehicle device provided in the vehicle in association with.

According to the present invention, a system for providing a context-based vehicle related service using an in-vehicle camera according to the present invention includes a M (M≥1) camera unit provided inside a vehicle in a direction specified to the outside of the vehicle. The image acquisition unit acquires M image information shot in a specified direction outside the vehicle through the M camera units provided in the vehicle, and the N image information obtained by reading the obtained M image information is designated N (N≥ 1) a mark recognition unit for generating recognition information including n mark information that recognizes n (1 ≦ n ≦ N) specific marks included in m (1 ≦ m ≦ M) image information among the marks; The positioning unit confirms the location information corresponding to the vehicle position at the time of recognizing the n specific marks and the vehicle driving state for a predetermined time based on the time at which the n specific marks are recognized. Linkage analysis of the identification information, the location information and the driving status information based on the status checking unit for checking the driving status information and the S (S≥1) situation setting information set to start a vehicle-related service based on the specified situation recognition. And a situation recognition unit for recognizing a specific situation for starting a specified vehicle related service and a service provider for performing a procedure for providing the vehicle related service.

According to the present invention, by recognizing an external specific mark through at least one camera unit installed inside the vehicle, and confirming the position of the vehicle at the time when the specific mark is recognized, by recognizing that it is a specific situation for starting a specified vehicle-related service Therefore, there is an advantage that can be more conveniently provided with the vehicle-related services corresponding to the specific situation.

1 is a diagram illustrating a configuration of a service providing system including a vehicle apparatus 100 and an operation server 105 according to an embodiment of the present invention.
2 is a diagram illustrating a process of providing a context-based vehicle related service using an in-vehicle camera according to an exemplary embodiment of the present invention.
3 is a diagram illustrating a configuration of a service providing system including a vehicle apparatus 100 according to another exemplary embodiment of the present invention.
4 is a diagram illustrating a process of providing a context-based vehicle related service using an in-vehicle camera according to another exemplary embodiment of the present invention.
5 is a diagram illustrating a configuration of a service providing system including a vehicle apparatus 100 and an operation server 105 according to another exemplary embodiment of the present invention.
6 is a diagram illustrating a process of providing a context-based vehicle-related service using an in-vehicle camera according to another exemplary embodiment of the present invention.
7 is a diagram illustrating a configuration of a service providing system including a vehicle apparatus 100 and an operation server 105 according to another exemplary embodiment of the present invention.
8 is a diagram illustrating a process of providing a context-based vehicle-related service using an in-vehicle camera according to another exemplary embodiment of the present invention.
9 is a diagram illustrating a configuration of a service providing system including a vehicle apparatus 100 and an operation server 105 according to another exemplary embodiment of the present invention.
10 is a diagram illustrating a process of providing a context-based vehicle related service using an in-vehicle camera according to another exemplary embodiment of the present invention.
11 is a diagram illustrating a configuration of a service providing system including a vehicle apparatus 100 and an operation server 105 according to another exemplary embodiment of the present invention.
12 is a diagram illustrating a process of providing a context-based vehicle related service using an in-vehicle camera according to another exemplary embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings and description will be described in detail the operating principle of the preferred embodiment of the present invention. However, the drawings and the following description shown below are for the preferred method among various methods for effectively explaining the features of the present invention, the present invention is not limited only to the drawings and description below.

That is, the following embodiments correspond to embodiments of the preferred union form among many embodiments of the present invention, and embodiments or omit specific configurations (or steps) in the following embodiments. An embodiment of dividing a function implemented in a specific configuration (or step), or an embodiment, a specific configuration (or step) incorporating a function implemented in two or more configurations (or steps) into one configuration (or step). Embodiments to replace the order of operation, etc., unless explicitly stated otherwise in the following examples will be apparent that all belong to the scope of the present invention. Therefore, it is to be noted that various embodiments corresponding to a subset or a filter based on the following examples may be divided retrospectively according to the filing date of the present invention.

In addition, in the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. Terms to be described later are terms defined in consideration of functions in the present invention, which may vary according to intentions or customs of users or operators. Therefore, the definition should be made based on the contents throughout the present invention.

As a result, the technical spirit of the present invention is determined by the claims, and the following examples are one means for efficiently explaining the technical spirit of the present invention to those skilled in the art to which the present invention pertains. It is only.

1 is a diagram illustrating a configuration of a service providing system including a vehicle apparatus 100 and an operation server 105 according to an embodiment of the present invention.

In more detail, Figure 1 recognizes a specific mark from the outside through one or more camera units installed inside the vehicle, checks the location of the vehicle at the time when the specific mark is recognized, and recognizes that it is a specific situation for starting a specified vehicle-related service. When a person having ordinary skill in the art to which the present invention pertains, the configuration of the service providing system is described with reference to and / or modification of the present invention. Various implementation methods (e.g., implementation methods in which some components are omitted, subdivided, or combined) may be inferred, but the present invention includes all the implementation methods inferred and shown in FIG. The technical features are not limited only to the implemented method.

The system of the present invention reads M image information acquired through the M camera units 110 in the vehicle to generate recognition information for a specific mark, and corresponds to the vehicle position at the time when the specific mark is recognized. The vehicle apparatus 100 checks the position information and the driving state information corresponding to the driving state of the vehicle for a predetermined time and transmits it to the operation server 105, the recognition information and the position information received from the vehicle apparatus 100, and If it is recognized that the specific situation for starting the specified vehicle-related service by using the driving state information may be provided with an operation server 105 for providing a vehicle-related service.

According to an exemplary embodiment of the present invention, the vehicle apparatus 100 may include at least one of a navigation apparatus, a black box apparatus, and an infotainment system for a vehicle, or may include a user wireless terminal temporarily mounted on a vehicle using a cradle. can do.

Referring to FIG. 1, the vehicle apparatus 100 includes M (M≥1) camera units 110, an image acquisition unit 115, a mark recognition unit 120, a position checking unit 125, , The status checker 130, the information storage unit 135, and the information transmission unit 140 may be provided.

The M camera units 110 include a front camera unit facing the front of the vehicle, a rear camera unit facing the rear of the vehicle, a side camera unit facing the side of the vehicle, and a mirror provided in the side mirror of the vehicle. One or more camera units of the camera unit may include one or more camera units, and may be provided inside the vehicle to direct-oriented photographing each designated direction of the outside of the vehicle.

Here, the M cameras 110 reveals that camera units (eg, cameras for photographing the inside of the black box device) that photograph the inside of the vehicle are excluded.

The information storage unit 135 may include camera identification information for identifying the M camera units 110 provided in the vehicle and direction identification information for identifying the direction in which the M camera units 110 are directed. It may be linked to and stored in the designated storage area of the vehicle apparatus 100 associated with the unit 100.

Here, at least one of the camera identification information and the direction identification information may be identified or included in the image information in association with the image information acquired by the image acquisition unit 115 through the camera unit 110 to obtain a direction.

Alternatively, at least one of the camera identification information and the direction identification information may be identified or included in the recognition information in association with the recognition information generated by the mark recognition unit 120.

The information storage unit 135 may store unique identification information for identifying a vehicle having the M camera units 110 in a designated storage area of the vehicle apparatus associated with the M camera units 110.

In addition, the information storage unit 135 may register and store unique identification information identifying a vehicle having the M camera units 110 in a storage medium of a designated operation server 105, and the operation server 105. The unique identification information may be used to identify the vehicle or provide a vehicle related service for the vehicle.

According to an embodiment of the present invention, the unique identification information is a vehicle identification number, a unique identification value uniquely assigned to a vehicle separately for a vehicle related service, and a unique identification value included in a wireless signal transmitted through a signal transmitter connected to a cigar jack of a vehicle. It may include at least one of a unique identification value uniquely assigned to the vehicle device.

According to another exemplary embodiment of the present invention, when the vehicle apparatus 105 includes a user wireless terminal or when the user wireless terminal is used for the vehicle related service, a unique identification number of the user wireless terminal is installed in the user wireless terminal. It may further include at least one of the app identification value uniquely assigned to the app.

According to the present invention, the unique identification information is transmitted when the vehicle apparatus 100 transmits at least one of the image information, the recognition information, the location information, and the driving status information to the operation server 105 through a communication network. It is preferable to be transmitted to the operation server 105 along with the information to be transmitted.

The image acquisition unit 115 may acquire M image information about a designated direction of the outside of the vehicle, which is oriented photographed through the M camera units 110 provided in the vehicle.

The marker recognition unit 120 reads M image information acquired through the image acquisition unit 115 and m (1 ≦ m ≦ M) images among N (N ≧ 1) marks designated for situation recognition. Recognition information including n pieces of marker information recognizing n (1 ≦ n ≦ N) specific marks included in the information may be generated.

According to the present invention, the N markers are displayed on the stop line, parking line, lane, floor, letters, numbers, symbols, patterns, patterns, barcodes, 2D codes, displayed on the bottom surface, or displayed on the panel mounted on the floor surface Letters, numbers, symbols, glyphs, patterns, barcodes, 2D codes, characters displayed on the wall, numbers, symbols, glyphs, patterns, barcodes, 2D codes, letters, numbers, symbols on the panels attached or mounted on the walls, Glyphs, patterns, barcodes, 2D codes, letters displayed on one side of the designated vehicle target service devices, numbers, symbols, glyphs, patterns, barcodes, 2D codes, characters displayed on the panel attached to one side of the designated vehicle target service devices, It may include one or more of numbers, symbols, patterns, patterns, barcodes, and 2D codes.

Here, the service device for a vehicle (not shown) may include at least one of a gas station at a gas station, a charger at a charging station (LPG charging station, an electric car charging station, etc.), a parking unit at a parking lot, and a toll gate device at a road. It may include a device of.

The vehicle target service device may include at least one of a terminal provided in the gas station, the charging station, the parking lot, the toll gate, and the drive-in affiliated store.

According to the present invention, the recognition information including the n pieces of marker information includes a marker information including marker identification information identifying a specific marker, a marker including at least one of character information, numeric information, and symbol information corresponding to the specific marker. N information recognized through m image information among the marker information including at least one of information, glyph information corresponding to a specific mark, and design information, and code information encoded in a specific mark in the form of a barcode or 2D code. May include marker information

When the n specific marks are recognized through the mark recognition unit 120 and the recognition information is generated, the position checking unit 125 checks the position information corresponding to the vehicle position at the time when the n specific marks are recognized. Can be.

According to the present invention, the position information corresponding to the vehicle position at the time of recognizing the n specific marks is linked to the M camera unit 110, the position location portion of the vehicle apparatus 100 provided in the vehicle (separately (Not shown) may include the location information.

If the position checking unit 130 confirms the location information corresponding to the vehicle position at the time of recognizing the n specific marks through the position checking unit 125, the state checking unit 130 is based on the time of recognizing the n specific marks. The driving state information corresponding to the driving state of the vehicle for a predetermined time can be checked.

According to the present invention, the driving state information may include at least one of parking state information, stop state information, slow state information below a designated reference speed, road running state information, and driving speed information.

The information transmitter 140 recognizes the recognition information recognized by the marker recognition unit 120, the position information confirmed by the position checker 125, and the driving state information checked through the state checker 130. The unique identification information identifying the vehicle may be transmitted to the operation server 105.

Referring to FIG. 1, the operation server 105 may include an information receiving unit 145, a situation recognition unit 150, a service providing unit 155, and a setting information storage unit 160. .

The setting information storage unit 160 may store one or more situation setting information set to start a vehicle related service based on a specified situation recognition on a designated storage medium.

According to the present invention, the context setting information includes location area information for setting a specific location area related to a specified vehicle related service, range setting information for setting an inside or outside of a location area related to a specified vehicle related service, and a designated vehicle related service. Distance setting information for setting the distance from the relevant reference position, boundary setting information for setting the distance from the boundary of the location area related to the specified vehicle-related services, and designated roads (highway, car-only road, national road, local road, two-sided road) Etc.) at least one of the position-related situation setting information of the driving condition information for setting the driving condition, and the parking state, the stopping state, the slowing state, the running state, the driving speed range of the vehicle for starting the designated vehicle-related service. Driving-related situation setting information for setting a vehicle and a vehicle for starting a specified vehicle-related service. Marker-related context setting information for setting a specific situation corresponding to the specific mark recognized from the image information photographed in the designated direction through the camera unit inside the amount.

According to the exemplary embodiment of the present invention, the marker related context setting information is a driving state in which the position information received from the vehicle apparatus 100 satisfies at least one position related context setting information and is received from the vehicle apparatus 100. When the information satisfies at least one piece of driving-related situation setting information, it is set to determine that the specified specific situation occurs when the specific mark is recognized from the image information photographed in the designated direction through the camera unit 110 inside the vehicle. Marker setting information may be included.

The information receiver 145 may receive recognition information, location information, driving state information, and unique identification information for identifying the vehicle from the vehicle apparatus 105.

When the situation recognition unit 150 receives the identification information, the location information, the driving state information and the unique identification information for identifying the vehicle from the vehicle apparatus 105 through the information receiving unit 145, The specific situation for starting a specified vehicle-related service may be recognized by linking and analyzing the recognition information, the location information, and the driving state information based on the context setting information set to start the vehicle-related service based on situation recognition.

According to the present invention, the situation recognition unit 150 determines whether the location information satisfies at least one location-related situation setting information, and at least one travel-related one designated to start a vehicle-related service to which the driving state information is designated. If the location information satisfies at least one location-related situation setting information and the driving state information satisfies at least one driving-related situation setting information, the marker-related situation setting information is determined. Based on this, the n pieces of marker information included in the recognition information may be read to recognize a specific situation for starting a specified vehicle related service.

When the specific situation is recognized through the situation recognition unit 150, the service provider 155 may perform a procedure for providing the disclosed vehicle-related service.

According to the exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service provider 155 may include a payment amount and merchant information received from a vehicle-targeted service device corresponding to the specific situation. Check the information, perform a payment procedure for processing payment for the payment information using previously registered payment means information of the user, and provide the payment result information corresponding to the payment procedure to the vehicle target service apparatus; have.

According to another exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service providing unit 155 is connected to the M camera units 110 and is provided in the vehicle apparatus 100. Confirming the payment information including the payment amount received from the merchant information corresponding to the specific situation and performing a payment procedure for processing the payment information using the payment means information of the registered user; The vehicle apparatus 100 may provide payment result information corresponding to the payment procedure.

According to another exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service provider 155 may provide a payment amount received from an app of a designated user wireless terminal and affiliated store information corresponding to the specific situation. Checking the payment information, including, and performing a payment procedure for processing the payment for the payment information by using the payment means information of the registered user, the payment result corresponding to the payment procedure with the app of the user wireless terminal Information can be provided.

2 is a diagram illustrating a process of providing a context-based vehicle-related service using an in-vehicle camera according to an exemplary embodiment of the present invention.

In more detail, FIG. 2 reads M image information acquired through M camera units 110 in a vehicle in the vehicle apparatus 100 to generate recognition information for a specific mark, and recognizes the specific mark. When the position information corresponding to the vehicle position at the time and the driving state information corresponding to the vehicle driving state for a predetermined time are checked and transmitted to the operation server 105, the operation server 105 receives the information from the vehicle apparatus 100. It is a process for providing a vehicle-related service when it is recognized that a specific situation for starting a designated vehicle-related service using the recognized recognition information, location information and driving state information, and having a general knowledge in the technical field to which the present invention belongs In this case, various implementation methods for a process of providing a context-based vehicle-related service using the in-vehicle camera by referring to and / or modifying the drawing 2 (For example, some steps may be omitted, or the order of implementation may be changed). However, the present invention includes all the implementation methods inferred above, and the technical features only by the implementation method shown in FIG. This is not limited.

Referring to FIG. 2, camera identification information for identifying M camera units 110 provided in a vehicle in the vehicle apparatus 100, direction identification information for identifying a direction that the M camera units 110 are directed to, and The in-vehicle camera may be stored in a process of associating and storing unique identification information for identifying a vehicle having the M camera units 110 in a designated storage area of the vehicle apparatus 100 associated with the M camera units 100. The used situation-aware vehicle-related service providing process may be started (200).

At least one of the camera identification information and the direction identification information may be identified or included in the image information in association with the image information.

Alternatively, at least one of the camera identification information and the direction identification information may be identified or included in the recognition information in association with the recognition information.

The unique identification information includes a vehicle number, a unique identification value uniquely assigned to a vehicle for a vehicle-related service, a unique identification value included in a wireless signal transmitted through a signal transmitter connected to a cigar jack of a vehicle, and uniquely assigned to a vehicle device. It may include at least one of the identification value.

In addition, the unique identification information is a unique identification number of the user wireless terminal, the app installed in the user wireless terminal when the vehicle device 105 includes a user wireless terminal or the user wireless terminal is used for the vehicle-related services. At least one of the uniquely assigned app identification value may be further included.

The vehicle apparatus 100 requests to store and store unique identification information identifying a vehicle having the M camera units 110 in a storage medium of a designated operation server 105 (205), and the operation server 105 ) Registers the unique identification information with a designated storage medium for identifying the vehicle or providing a vehicle related service for the vehicle (210).

In addition, the operation server 105 stores one or more context setting information, which is set to start a vehicle related service based on a specified context awareness, on a designated storage medium (215).

The context setting information includes location area information for setting a specific location area related to a specified vehicle related service, range setting information for setting an inside or outside of a location area related to a specified vehicle related service, and a reference location for a specified vehicle related service. Distance setting information for setting the distance, boundary setting information for setting the distance away from the boundary of the location area associated with the specified vehicle-related services, driving conditions of the specified road (highway, automobile road, national road, local road, rear road, etc.) At least one position-related situation setting information of the driving condition information to be set, and driving-related setting at least one of a parking state, a stop state, a slow state, a road running state, and a driving speed range of the vehicle for starting a specified vehicle-related service. Status setting information and the camera inside the vehicle to start the designated vehicle related service The via may comprise a marker relevant circumstances to set specific conditions setting information corresponding to the specific marker that is the basis of the image information taken in the chosen direction.

Here, the marker-related situation setting information is the position information received from the vehicle apparatus 100 satisfies at least one position-related situation setting information, the driving state information received from the vehicle apparatus 100 is at least one driving Includes marker setting information for setting to determine that the specified specific situation has occurred when recognizing the specific marker from the image information photographed in the specified direction through the camera unit 110 inside the vehicle in a situation that satisfies the relevant situation setting information. Can be.

Meanwhile, the vehicle apparatus 100 obtains M image information about a designated direction of the outside of the vehicle oriented by the M camera units 110 provided in the vehicle (220).

Herein, the M cameras 110 exclude a camera unit (eg, an internal photographing camera of a black box device) photographing the inside of the vehicle, and the front camera unit facing the front direction of the vehicle and the rear direction of the vehicle. At least one camera unit among at least one camera unit among a rear camera unit facing the side, a side camera unit facing the side of the vehicle, and a mirror camera unit provided at the side mirror of the vehicle; Shoots directed to each designated direction.

The vehicle apparatus 100 reads the obtained M pieces of image information and includes n (1 ≦ n) included in m (1 ≦ m ≦ M) pieces of image information among N (N ≧ 1) marks designated for situation recognition. Recognition information including n pieces of marker information recognizing ≤N) specific marks is generated (225).

Here, the N markers may be a stop line, a parking line, a lane, a letter, a number, a symbol, a pattern, a pattern, a bar code, a 2D code, or a letter displayed on a panel mounted or mounted on a floor. , Symbols, glyphs, patterns, barcodes, 2D codes, letters on the wall, numbers, symbols, glyphs, patterns, barcodes, 2D codes, letters on the wall or mounted panels, numbers, symbols, glyphs, patterns , Bar codes, 2D codes, letters, numbers, symbols, patterns on one side of designated vehicle target service devices, patterns, barcodes, 2D codes, letters, numbers, symbols on panels attached to one side of designated vehicle target service devices It may include one or more of a, pattern, pattern, barcode, 2D code.

The identification information including the n pieces of marker information may include marker information including marker identification information identifying a specific marker, marker information including at least one of character information, numeric information, and symbol information corresponding to the specific marker. N mark information recognized through m image information among mark information including at least one of a glyph information and a pattern information corresponding to the mark, and mark information encoded in a specific mark in the form of a barcode or 2D code. Can include

When the n specific marks are recognized and the recognition information is generated, the vehicle apparatus 100 checks the position information corresponding to the vehicle position at the time when the n specific marks are recognized (230).

Here, the position information corresponding to the vehicle position at the time when the n specific markers are recognized is located in the vehicle positioning device (100) not shown separately in connection with the M camera units 110. It may include the location information measured through).

When the position information corresponding to the vehicle position at the time when the n specific marks are recognized, the vehicle apparatus 100 corresponds to the vehicle driving state for a predetermined time based on the time at which the n specific marks are recognized. The driving state information (for example, parking state information, stop state information, slow state information below a specified reference speed, road running state information, driving speed information, etc.) is checked (235).

When the recognition information is recognized, and the position information and the driving state information are confirmed, the vehicle apparatus 100 includes the recognition information, the position information, and the driving state information together with the unique identification information for identifying the vehicle. (240).

When the operation server 105 receives the identification information, the location information, the driving status information and the unique identification information for identifying the vehicle from the vehicle device 105 (245), the location information is at least one location-related context setting It is determined whether the information is satisfied (250).

If the location information satisfies at least one piece of location-related situation setting information, the operation server 105 checks whether the driving state information satisfies at least one piece of driving-related situation setting information designated to start a designated vehicle-related service. Determine (255).

If the driving state information satisfies at least one piece of driving related situation setting information, the operation server 105 reads n pieces of marker information included in the recognition information based on the mark related situation setting information and designates the vehicle. Recognize a specific situation for initiating a related service (260).

When the specific situation is recognized as described above, the operation server 105 performs a procedure for providing the disclosed vehicle-related service (265).

Here, the vehicle-related service may include a payment service, the operation server 105 checks the payment information including the payment amount and merchant information received from the vehicle-targeted service device corresponding to the specific situation, By performing a payment procedure for processing payment for the payment information using payment means information of a registered user, payment result information corresponding to the payment procedure may be provided to the vehicle target service device.

Alternatively, when the vehicle-related service includes a payment service, the operation server 105 is connected with the M camera units 110 and the payment amount received from the vehicle apparatus 100 provided in the vehicle and the specific situation. Check payment information including affiliate store information corresponding to the payment information, and perform a payment procedure of processing payment for the payment information using previously registered payment means information of the user; Payment result information corresponding to may be provided.

Alternatively, when the vehicle-related service includes a payment service, the operation server 105 checks payment information including a payment amount received from an app of a designated user wireless terminal and affiliated store information corresponding to the specific situation, By performing a payment procedure for processing payment for the payment information by using the payment means information of the registered user, it is possible to provide the payment result information corresponding to the payment procedure to the app of the user wireless terminal.

3 is a diagram illustrating a configuration of a service providing system including a vehicle apparatus 100 according to another exemplary embodiment of the present invention.

In more detail, Figure 3 recognizes a specific mark from the outside through one or more camera units installed inside the vehicle, identifies the vehicle position at the time when the specific mark is recognized, and recognizes that it is a specific situation for starting a specified vehicle-related service. When a person having ordinary knowledge in the art to which the present invention pertains, the configuration of the service providing system is described with reference to and / or modification of the present invention. Various implementation methods (e.g., implementation methods in which some components are omitted, subdivided, or merged) may be inferred, but the present invention includes all the implementation methods inferred, as shown in FIG. The technical features are not limited only to the implemented method.

The system of the present invention reads M image information acquired through the M camera units 110 in the vehicle to generate recognition information for a specific mark, and corresponds to the vehicle position at the time when the specific mark is recognized. Checking the location information and the driving state information corresponding to the driving state of the vehicle for a predetermined time, and if it is recognized that the specific situation for starting the designated vehicle-related service using the identified recognition information, the position information and the driving state information, It may be configured with a vehicle device 100 for providing a service.

According to an exemplary embodiment of the present invention, the vehicle apparatus 100 may include at least one of a navigation apparatus, a black box apparatus, and an infotainment system for a vehicle, or may include a user wireless terminal temporarily mounted on a vehicle using a cradle. can do.

Referring to FIG. 1, the vehicle apparatus 100 includes M (M≥1) camera units 110, an image acquisition unit 115, a mark recognition unit 120, a position checking unit 125, , The status checker 130, the information storage unit 135, the situation recognition unit 150, and the service provider 155 may be provided.

The M camera units 110 include a front camera unit facing the front of the vehicle, a rear camera unit facing the rear of the vehicle, a side camera unit facing the side of the vehicle, and a mirror provided in the side mirror of the vehicle. One or more camera units of the camera unit may include one or more camera units, and may be provided inside the vehicle to direct-oriented photographing each designated direction of the outside of the vehicle.

Here, the M cameras 110 reveals that camera units (eg, cameras for photographing the inside of the black box device) that photograph the inside of the vehicle are excluded.

The information storage unit 135 may include camera identification information for identifying the M camera units 110 provided in the vehicle and direction identification information for identifying the direction in which the M camera units 110 are directed. It may be linked to and stored in a designated storage area of the vehicle apparatus 100 associated with the unit 100.

Here, at least one of the camera identification information and the direction identification information may be identified or included in the image information in association with the image information acquired by the image acquisition unit 115 through the camera unit 110 to obtain a direction.

Alternatively, at least one of the camera identification information and the direction identification information may be identified or included in the recognition information in association with the recognition information generated by the mark recognition unit 120.

The information storage unit 135 may store unique identification information for identifying a vehicle having the M camera units 110 in a designated storage area of the vehicle apparatus 100 associated with the M camera units 110. have.

According to an embodiment of the present invention, the unique identification information is a vehicle identification number, a unique identification value uniquely assigned to a vehicle separately for a vehicle related service, and a unique identification value included in a wireless signal transmitted through a signal transmitter connected to a cigar jack of a vehicle. It may include at least one of a unique identification value uniquely assigned to the vehicle device.

According to another exemplary embodiment of the present invention, when the vehicle apparatus 105 includes a user wireless terminal or when the user wireless terminal is used for the vehicle related service, a unique identification number of the user wireless terminal is installed in the user wireless terminal. It may further include at least one of the app identification value uniquely assigned to the app.

The information storage unit 135 may store one or more situation setting information set to start a vehicle related service based on a specified situation recognition in a designated storage area of the vehicle apparatus 100.

According to the present invention, the context setting information includes location area information for setting a specific location area related to a specified vehicle related service, range setting information for setting an inside or outside of a location area related to a specified vehicle related service, and a designated vehicle related service. Distance setting information for setting the distance from the relevant reference position, boundary setting information for setting the distance from the boundary of the location area related to the specified vehicle-related services, and designated roads (highway, car-only road, national road, local road, two-sided road) Etc.) at least one of the position-related situation setting information of the driving condition information for setting the driving condition, and the parking state, the stopping state, the slowing state, the running state, the driving speed range of the vehicle for starting the designated vehicle-related service. Driving-related situation setting information for setting a vehicle and a vehicle for starting a specified vehicle-related service. Marker-related context setting information for setting a specific situation corresponding to the specific mark recognized from the image information photographed in the designated direction through the camera unit inside the amount.

According to the exemplary embodiment of the present invention, the marker-related context setting information includes at least one position-related context setting information of a vehicle provided with the vehicle apparatus 100 and at least one driving state information of the vehicle. Marking setting information is set to determine that the specified specific situation has occurred when recognizing a specific mark from the image information photographed in the specified direction through the camera unit 110 inside the vehicle in a situation that satisfies the driving setting situation of It may include.

The image acquisition unit 115 may acquire M image information about a designated direction of the outside of the vehicle, which is oriented photographed through the M camera units 110 provided in the vehicle.

The marker recognition unit 120 reads M image information acquired through the image acquisition unit 115 and m (1 ≦ m ≦ M) images among N (N ≧ 1) marks designated for situation recognition. Recognition information including n pieces of marker information recognizing n (1 ≦ n ≦ N) specific marks included in the information may be generated.

According to the present invention, the N markers are displayed on the stop line, parking line, lane, floor, letters, numbers, symbols, patterns, patterns, barcodes, 2D codes, displayed on the bottom surface, or displayed on the panel mounted on the floor surface Letters, numbers, symbols, glyphs, patterns, barcodes, 2D codes, characters displayed on the wall, numbers, symbols, glyphs, patterns, barcodes, 2D codes, letters, numbers, symbols on the panels attached or mounted on the walls, Glyphs, patterns, barcodes, 2D codes, letters displayed on one side of the designated vehicle target service devices, numbers, symbols, glyphs, patterns, barcodes, 2D codes, characters displayed on the panel attached to one side of the designated vehicle target service devices, It may include one or more of numbers, symbols, patterns, patterns, barcodes, and 2D codes.

Here, the service device for a vehicle (not shown) may include at least one of a gas station at a gas station, a charger at a charging station (LPG charging station, an electric car charging station, etc.), a parking unit at a parking lot, and a toll gate device at a road. It may include a device of.

The vehicle target service device may include at least one of a terminal provided in the gas station, the charging station, the parking lot, the toll gate, and the drive-in affiliated store.

According to the present invention, the recognition information including the n pieces of marker information includes a marker information including marker identification information identifying a specific marker, a marker including at least one of character information, numeric information, and symbol information corresponding to the specific marker. N information recognized through m image information among the marker information including at least one of information, glyph information corresponding to a specific mark, and design information, and code information encoded in a specific mark in the form of a barcode or 2D code. May include marker information

When the n specific marks are recognized through the mark recognition unit 120 and the recognition information is generated, the position checking unit 125 checks the position information corresponding to the vehicle position at the time when the n specific marks are recognized. Can be.

According to the present invention, the position information corresponding to the vehicle position at the time of recognizing the n specific marks is linked to the M camera unit 110, the position location portion of the vehicle apparatus 100 provided in the vehicle (separately (Not shown) may include the location information.

If the position checking unit 130 confirms the location information corresponding to the vehicle position at the time of recognizing the n specific marks through the position checking unit 125, the state checking unit 130 is based on the time of recognizing the n specific marks. The driving state information corresponding to the driving state of the vehicle for a predetermined time can be checked.

According to the present invention, the driving state information may include at least one of parking state information, stop state information, slow state information below a designated reference speed, road running state information, and driving speed information.

The situation recognition unit 150 analyzes the recognition information, the location information and the driving state information based on the situation setting information set to start the vehicle related service based on the specified situation recognition, and starts to specify the specified vehicle related service. You can recognize the situation.

According to the present invention, the situation recognition unit 150 determines whether the location information satisfies at least one location-related situation setting information, and at least one travel-related one designated to start a vehicle-related service to which the driving state information is designated. If the location information satisfies at least one location-related situation setting information and the driving state information satisfies at least one driving-related situation setting information, the marker-related situation setting information is determined. Based on this, the n pieces of marker information included in the recognition information may be read to recognize a specific situation for starting a specified vehicle related service.

When the specific situation is recognized through the situation recognition unit 150, the service provider 155 may perform a procedure for providing the disclosed vehicle-related service.

According to the exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service provider 155 may include a payment amount and merchant information received from a vehicle-targeted service device corresponding to the specific situation. Check the information, perform a payment procedure for processing payment for the payment information using previously registered payment means information of the user, and provide the payment result information corresponding to the payment procedure to the vehicle target service apparatus; have.

According to another exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service provider 155 may display the payment amount received from the app of the designated user's wireless terminal and merchant information corresponding to the specific situation. Check the payment information to include, and performs a payment process for processing the payment for the payment information by using the payment means information of the registered user, the payment result information corresponding to the payment procedure to the app of the user wireless terminal Can be provided.

4 is a diagram illustrating a process of providing a context-based vehicle related service using an in-vehicle camera according to another exemplary embodiment of the present invention.

In more detail, FIG. 4 reads M image information acquired through M camera units 110 in a vehicle in the vehicle apparatus 100 to generate recognition information for a specific mark, and recognizes the specific mark. It is a process for providing a vehicle-related service when it is recognized that a specific situation for starting a specified vehicle-related service is confirmed by checking position information corresponding to a vehicle position at a time point and driving state information corresponding to a vehicle driving state for a predetermined time. For those of ordinary skill in the art to which the present invention pertains, various implementation methods (eg, some steps) regarding a process of providing a vehicle-based service based on context recognition using the in-vehicle camera by referring to and / or modifying the drawing 4 May be omitted, or the order of implementation may be changed), but the present invention is directed to all implementation methods inferred from the above. It is made, including, to which the technical feature that is not limited to the exemplary method shown in the figure 4.

Referring to FIG. 4, camera identification information identifying the M camera units 110 provided in the vehicle in the vehicle apparatus 100 and direction identification information identifying the direction in which the M camera units 110 are directed; The in-vehicle camera may be stored in a process of associating and storing unique identification information for identifying a vehicle having the M camera units 110 in a designated storage area of the vehicle apparatus 100 associated with the M camera units 100. The situation-based vehicle-related service providing process may be started (400).

At least one of the camera identification information and the direction identification information may be identified or included in the image information in association with the image information.

Alternatively, at least one of the camera identification information and the direction identification information may be identified or included in the recognition information in association with the recognition information.

The unique identification information includes a vehicle number, a unique identification value uniquely assigned to a vehicle for a vehicle-related service, a unique identification value included in a wireless signal transmitted through a signal transmitter connected to a cigar jack of a vehicle, and uniquely assigned to a vehicle device. It may include at least one of the identification value.

In addition, the unique identification information is a unique identification number of the user wireless terminal, the app installed in the user wireless terminal when the vehicle device 105 includes a user wireless terminal or the user wireless terminal is used for the vehicle-related services. At least one of the uniquely assigned app identification value may be further included.

In operation 405, the vehicle apparatus 100 stores one or more context setting information set to start a vehicle related service based on a specified context awareness on a designated storage medium.

The context setting information includes location area information for setting a specific location area related to a specified vehicle related service, range setting information for setting an inside or outside of a location area related to a specified vehicle related service, and a reference location for a specified vehicle related service. Distance setting information for setting the distance, boundary setting information for setting the distance away from the boundary of the location area associated with the specified vehicle-related services, driving conditions of the specified road (highway, automobile road, national road, local road, rear road, etc.) At least one position-related situation setting information of the driving condition information to be set, and driving-related setting at least one of a parking state, a stop state, a slow state, a road running state, and a driving speed range of the vehicle for starting a specified vehicle-related service. Status setting information and the camera inside the vehicle to start the designated vehicle related service The via may comprise a marker relevant circumstances to set specific conditions setting information corresponding to the specific marker that is the basis of the image information taken in the chosen direction.

Here, the marker-related situation setting information is the position information of the vehicle equipped with the vehicle device 100 satisfies at least one position-related situation setting information, the driving state information of the vehicle is at least one driving-related situation setting information In the situation that satisfies the information may be included in the setting information to set to determine that the specified specific situation occurs when a specific marker is recognized from the image information photographed in the designated direction through the camera unit 110 in the vehicle.

Meanwhile, the vehicle apparatus 100 obtains M image information about a designated direction of the outside of the vehicle, which is directionally photographed through the M camera units 110 provided in the vehicle, in operation 410.

Herein, the M cameras 110 exclude a camera unit (eg, an internal photographing camera of a black box device) photographing the inside of the vehicle, and the front camera unit facing the front direction of the vehicle and the rear direction of the vehicle. At least one camera unit among at least one camera unit among a rear camera unit facing the side, a side camera unit facing the side of the vehicle, and a mirror camera unit provided at the side mirror of the vehicle; Shoots directed to each designated direction.

The vehicle apparatus 100 reads the obtained M pieces of image information and includes n (1 ≦ n) included in m (1 ≦ m ≦ M) pieces of image information among N (N ≧ 1) marks designated for situation recognition. Recognition information including n pieces of marker information recognizing ≤N) specific marks is generated (415).

Here, the N markers may be a stop line, a parking line, a lane, a letter, a number, a symbol, a pattern, a pattern, a bar code, a 2D code, or a letter displayed on a panel mounted or mounted on a floor. , Symbols, glyphs, patterns, barcodes, 2D codes, letters on the wall, numbers, symbols, glyphs, patterns, barcodes, 2D codes, letters on the wall or mounted panels, numbers, symbols, glyphs, patterns , Bar codes, 2D codes, letters, numbers, symbols, patterns on one side of designated vehicle target service devices, patterns, barcodes, 2D codes, letters, numbers, symbols on panels attached to one side of designated vehicle target service devices It may include one or more of a, pattern, pattern, barcode, 2D code.

The identification information including the n pieces of marker information may include marker information including marker identification information identifying a specific marker, marker information including at least one of character information, numeric information, and symbol information corresponding to the specific marker. N mark information recognized through m image information among mark information including at least one of a glyph information and a pattern information corresponding to the mark, and mark information encoded in a specific mark in the form of a barcode or 2D code. Can include

When the n specific marks are recognized and the recognition information is generated, the vehicle apparatus 100 checks the position information corresponding to the vehicle position at the time when the n specific marks are recognized (420).

Here, the position information corresponding to the vehicle position at the time when the n specific markers are recognized is located in the vehicle positioning device (100) not shown separately in connection with the M camera units 110. It may include the location information measured through).

When the position information corresponding to the vehicle position at the time when the n specific marks are recognized, the vehicle apparatus 100 corresponds to the vehicle driving state for a predetermined time based on the time at which the n specific marks are recognized. The driving state information (eg, parking state information, stop state information, slow state information below a designated reference speed, road running state information, driving speed information, etc.) is checked (425).

The vehicle device 105 determines whether the location information satisfies at least one piece of location setting information (430).

If the location information satisfies at least one piece of location-related situation setting information, the vehicle apparatus 100 satisfies at least one piece of driving-related situation setting information designated for initiating a designated vehicle-related service. Determine (435).

If the driving state information satisfies at least one piece of driving related situation setting information, the vehicle apparatus 100 reads n pieces of marker information included in the recognition information based on the mark related situation setting information and designates the designated vehicle. A specific situation for initiating a related service is recognized (440).

When the specific situation is recognized as described above, the vehicle apparatus 100 performs a procedure for providing the disclosed vehicle-related service (445).

Here, the vehicle-related service may include a payment service, the vehicle device 100 checks the payment information including the payment amount and merchant information received from the vehicle-targeted service device corresponding to the specific situation, By performing a payment procedure for processing payment for the payment information using payment means information of a registered user, payment result information corresponding to the payment procedure may be provided to the vehicle target service device.

Alternatively, when the vehicle-related service includes a payment service, the vehicle apparatus 100 checks payment information including a payment amount received from an app of a designated user wireless terminal and affiliated store information corresponding to the specific situation. By performing a payment procedure for processing payment for the payment information by using the payment means information of the registered user, it is possible to provide the payment result information corresponding to the payment procedure to the app of the user wireless terminal.

5 is a diagram illustrating a configuration of a service providing system including a vehicle apparatus 100 and an operation server 105 according to another exemplary embodiment of the present invention.

In more detail, FIG. 5 recognizes an external specific mark through one or more camera units installed inside the vehicle, identifies a vehicle position at a time when the specific mark is recognized, and recognizes that the vehicle is a specific situation for starting a specified vehicle-related service. When a person having ordinary skill in the art to which the present invention pertains, the configuration of the service providing system is described with reference to and / or modification of the present invention. Various implementation methods (e.g., implementation methods in which some components are omitted, subdivided, or combined) may be inferred, but the present invention includes all the implementation methods inferred, as shown in FIG. The technical features are not limited only to the implemented method.

The system of the present invention reads M image information acquired through the M camera units 110 in the vehicle to generate recognition information for a specific mark, and corresponds to the vehicle position at the time when the specific mark is recognized. If it is recognized that the specific information for starting the designated vehicle-related service by checking the position information and the driving state information corresponding to the vehicle driving state for a predetermined time, the operation server 105 provides information for requesting to start the designated vehicle-related service. When the vehicle apparatus 100 for transmitting to the vehicle information and the information requesting to start the specified vehicle-related services from the vehicle apparatus 100 is received, it may be configured to include an operation server 105 for providing the specified vehicle-related services. .

According to an exemplary embodiment of the present invention, the vehicle apparatus 100 may include at least one of a navigation apparatus, a black box apparatus, and an infotainment system for a vehicle, or may include a user wireless terminal temporarily mounted on a vehicle using a cradle. can do.

Referring to FIG. 5, the vehicle apparatus 100 includes M (M≥1) camera units 110, an image acquisition unit 115, a mark recognition unit 120, a location checker 125, It may be configured with a status check unit 130, an information storage unit 135, an information transmission unit 140, a situation recognition unit 150.

The M camera units 110 include a front camera unit facing the front of the vehicle, a rear camera unit facing the rear of the vehicle, a side camera unit facing the side of the vehicle, and a mirror provided in the side mirror of the vehicle. One or more camera units of the camera unit may include one or more camera units, and may be provided inside the vehicle to direct-oriented photographing each designated direction of the outside of the vehicle.

Here, the M cameras 110 reveals that camera units (eg, cameras for photographing the inside of the black box device) that photograph the inside of the vehicle are excluded.

The information storage unit 135 may include camera identification information for identifying the M camera units 110 provided in the vehicle and direction identification information for identifying the direction in which the M camera units 110 are directed. It may be linked to and stored in a designated storage area of the vehicle apparatus 100 associated with the unit 100.

Here, at least one of the camera identification information and the direction identification information may be identified or included in the image information in association with the image information acquired by the image acquisition unit 115 through the camera unit 110 to obtain a direction.

Alternatively, at least one of the camera identification information and the direction identification information may be identified or included in the recognition information in association with the recognition information generated by the mark recognition unit 120.

The information storage unit 135 may store unique identification information for identifying a vehicle having the M camera units 110 in a designated storage area of the vehicle apparatus associated with the M camera units 110.

In addition, the information storage unit 135 may register and store unique identification information identifying a vehicle having the M camera units 110 in a storage medium of a designated operation server 105, and the operation server 105. The unique identification information may be used to identify the vehicle or provide a vehicle related service for the vehicle.

According to an embodiment of the present invention, the unique identification information is a vehicle identification number, a unique identification value uniquely assigned to a vehicle separately for a vehicle related service, and a unique identification value included in a wireless signal transmitted through a signal transmitter connected to a cigar jack of a vehicle. It may include at least one of a unique identification value uniquely assigned to the vehicle device.

According to another exemplary embodiment of the present invention, when the vehicle apparatus 105 includes a user wireless terminal or when the user wireless terminal is used for the vehicle related service, a unique identification number of the user wireless terminal is installed in the user wireless terminal. It may further include at least one of the app identification value uniquely assigned to the app.

According to the present invention, the unique identification information is transmitted together with the transmitted information when the vehicle apparatus 100 transmits information for requesting the designated situation-aware vehicle-related service to the operation server 105 through a communication network. It is preferable to be transmitted to the operation server 105.

The information storage unit 135 may store one or more context setting information set to start a vehicle related service based on a specified context awareness in a designated storage area of the vehicle apparatus.

According to the present invention, the context setting information includes location area information for setting a specific location area related to a specified vehicle related service, range setting information for setting an inside or outside of a location area related to a specified vehicle related service, and a designated vehicle related service. Distance setting information for setting the distance from the relevant reference position, boundary setting information for setting the distance from the boundary of the location area related to the specified vehicle-related services, and designated roads (highway, car-only road, national road, local road, two-sided road) Etc.) at least one of the position-related situation setting information of the driving condition information for setting the driving condition, and the parking state, the stopping state, the slowing state, the running state, the driving speed range of the vehicle for starting the designated vehicle-related service. Driving-related situation setting information for setting a vehicle and a vehicle for starting a specified vehicle-related service. Marker-related context setting information for setting a specific situation corresponding to the specific mark recognized from the image information photographed in the designated direction through the camera unit inside the amount.

According to the exemplary embodiment of the present invention, the marker related context setting information includes the position information of the vehicle provided with the vehicle apparatus 100 satisfying at least one position related context setting information, and the vehicle apparatus 100 is provided. In a situation where the driving state information of the vehicle satisfies at least one driving-related situation setting information, the specified specific situation occurs when the specific mark is recognized from the image information photographed in the designated direction through the camera unit 110 inside the vehicle. It may include the marker setting information to be set to determine.

The image acquisition unit 115 may acquire M image information about a designated direction of the outside of the vehicle, which is oriented photographed through the M camera units 110 provided in the vehicle.

The marker recognition unit 120 reads M image information acquired through the image acquisition unit 115 and m (1 ≦ m ≦ M) images among N (N ≧ 1) marks designated for situation recognition. Recognition information including n pieces of marker information recognizing n (1 ≦ n ≦ N) specific marks included in the information may be generated.

According to the present invention, the N markers are displayed on the stop line, parking line, lane, floor, letters, numbers, symbols, patterns, patterns, barcodes, 2D codes, displayed on the bottom surface, or displayed on the panel mounted on the floor surface Letters, numbers, symbols, glyphs, patterns, barcodes, 2D codes, characters displayed on the wall, numbers, symbols, glyphs, patterns, barcodes, 2D codes, letters, numbers, symbols on the panels attached or mounted on the walls, Glyphs, patterns, barcodes, 2D codes, letters displayed on one side of the designated vehicle target service devices, numbers, symbols, glyphs, patterns, barcodes, 2D codes, characters displayed on the panel attached to one side of the designated vehicle target service devices, It may include one or more of numbers, symbols, patterns, patterns, barcodes, and 2D codes.

Here, the service device for a vehicle (not shown) may include at least one of a gas station at a gas station, a charger at a charging station (LPG charging station, an electric car charging station, etc.), a parking unit at a parking lot, and a toll gate device at a road. It may include a device of.

The vehicle target service device may include at least one of a terminal provided in the gas station, the charging station, the parking lot, the toll gate, and the drive-in affiliated store.

According to the present invention, the recognition information including the n pieces of marker information includes a marker information including marker identification information identifying a specific marker, a marker including at least one of character information, numeric information, and symbol information corresponding to the specific marker. N information recognized through m image information among the marker information including at least one of information, glyph information corresponding to a specific mark, and design information, and code information encoded in a specific mark in the form of a barcode or 2D code. May include marker information

When the n specific marks are recognized through the mark recognition unit 120 and the recognition information is generated, the position checking unit 125 checks the position information corresponding to the vehicle position at the time when the n specific marks are recognized. Can be.

According to the present invention, the position information corresponding to the vehicle position at the time of recognizing the n specific marks is linked to the M camera unit 110, the position location portion of the vehicle apparatus 100 provided in the vehicle (separately (Not shown) may include the location information.

If the position checking unit 130 confirms the location information corresponding to the vehicle position at the time of recognizing the n specific marks through the position checking unit 125, the state checking unit 130 is based on the time of recognizing the n specific marks. The driving state information corresponding to the driving state of the vehicle for a predetermined time can be checked.

According to the present invention, the driving state information may include at least one of parking state information, stop state information, slow state information below a designated reference speed, road running state information, and driving speed information.

The situation recognition unit 150 analyzes the recognition information, the location information and the driving state information based on the situation setting information set to start the vehicle related service based on the specified situation recognition, and starts to specify the specified vehicle related service. You can recognize the situation.

According to the present invention, the situation recognition unit 150 determines whether the location information satisfies at least one location-related situation setting information, and at least one travel-related one designated to start a vehicle-related service to which the driving state information is designated. If the location information satisfies at least one location-related situation setting information and the driving state information satisfies at least one driving-related situation setting information, the marker-related situation setting information is determined. Based on this, the n pieces of marker information included in the recognition information may be read to recognize a specific situation for starting a specified vehicle related service.

When the specific situation is recognized through the situation recognition unit 150, the information transmitting unit 140 includes information for requesting to perform a specified situation recognition-based vehicle-related service together with the unique identification information for identifying the vehicle. It may be transmitted to the operation server 105.

Referring to FIG. 5, the operation server 105 may include an information receiver 145 and a service provider 155.

When the specific situation is recognized from the vehicle device 105, the information receiver 145 may receive information for requesting to perform a specified situation-aware vehicle-related service together with the unique identification information for identifying the vehicle. .

The service provider 155 may perform a procedure of providing the requested vehicle-related service when the information requesting to perform the designated situation-aware vehicle-related service is received through the information receiver 145.

According to the exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service provider 155 may include a payment amount and merchant information received from a vehicle-targeted service device corresponding to the specific situation. Check the information, perform a payment procedure for processing payment for the payment information using previously registered payment means information of the user, and provide the payment result information corresponding to the payment procedure to the vehicle target service apparatus; have.

According to another exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service providing unit 155 is connected to the M camera units 110 and is provided in the vehicle apparatus 100. Confirming the payment information including the payment amount received from the merchant information corresponding to the specific situation and performing a payment procedure for processing the payment information using the payment means information of the registered user; The vehicle apparatus 100 may provide payment result information corresponding to the payment procedure.

According to another exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service provider 155 may provide a payment amount received from an app of a designated user wireless terminal and affiliated store information corresponding to the specific situation. Checking the payment information, including, and performing a payment procedure for processing the payment for the payment information by using the payment means information of the registered user, the payment result corresponding to the payment procedure with the app of the user wireless terminal Information can be provided.

6 is a diagram illustrating a process of providing a context-based vehicle-related service using an in-vehicle camera according to another exemplary embodiment of the present invention.

In more detail, in FIG. 6, in the vehicle apparatus 100, M image information acquired through M camera units 110 inside a vehicle is read to generate recognition information for a specific mark, and the specific mark is recognized. If it is recognized that the specific situation for starting the designated vehicle-related service by checking the position information corresponding to the vehicle position at the time and the driving state information corresponding to the vehicle driving state for a predetermined time, the designated server to the operation server 105 Transmitting the request information for starting the related service and receiving the request information for starting the designated vehicle related service received from the vehicle apparatus 100 in the operation server 105, the vehicle related service is received. As a process of providing the present invention, those skilled in the art to which the present invention pertains may refer to and / or modify the present invention. However, various implementation methods (for example, some steps may be omitted or the order may be changed) may be inferred from the situation-based vehicle-related service providing process using the in-vehicle camera, but the present invention may infer all It is made, including the implementation method, the technical features are not limited only to the implementation method shown in FIG.

Referring to FIG. 6, camera identification information identifying M camera parts 110 provided in a vehicle in the vehicle apparatus 100, direction identification information identifying a direction that the M camera parts 110 are directed to, and The in-vehicle camera may be stored in a process of associating and storing unique identification information for identifying a vehicle having the M camera units 110 in a designated storage area of the vehicle apparatus 100 associated with the M camera units 100. The used context-aware vehicle-related service provision process may be initiated 600.

At least one of the camera identification information and the direction identification information may be identified or included in the image information in association with the image information.

Alternatively, at least one of the camera identification information and the direction identification information may be identified or included in the recognition information in association with the recognition information.

The unique identification information includes a vehicle number, a unique identification value uniquely assigned to a vehicle for a vehicle-related service, a unique identification value included in a wireless signal transmitted through a signal transmitter connected to a cigar jack of a vehicle, and uniquely assigned to a vehicle device. It may include at least one of the identification value.

In addition, the unique identification information is a unique identification number of the user wireless terminal, the app installed in the user wireless terminal when the vehicle device 105 includes a user wireless terminal or the user wireless terminal is used for the vehicle-related services. At least one of the uniquely assigned app identification value may be further included.

In operation 605, the vehicle apparatus 100 stores one or more context setting information set to start a vehicle related service based on a specified context awareness on a designated storage medium.

The context setting information includes location area information for setting a specific location area related to a specified vehicle related service, range setting information for setting an inside or outside of a location area related to a specified vehicle related service, and a reference location for a specified vehicle related service. Distance setting information for setting the distance, boundary setting information for setting the distance away from the boundary of the location area associated with the specified vehicle-related services, driving conditions of the specified road (highway, automobile road, national road, local road, rear road, etc.) At least one position-related situation setting information of the driving condition information to be set, and driving-related setting at least one of a parking state, a stop state, a slow state, a road running state, and a driving speed range of the vehicle for starting a specified vehicle-related service. Status setting information and the camera inside the vehicle to start the designated vehicle related service The via may comprise a marker relevant circumstances to set specific conditions setting information corresponding to the specific marker that is the basis of the image information taken in the chosen direction.

Here, the marker-related situation setting information is the position information of the vehicle equipped with the vehicle device 100 satisfies at least one position-related situation setting information, the driving state information of the vehicle is at least one driving-related situation setting information In the situation that satisfies the information may be included in the setting information to set to determine that the specified specific situation occurs when a specific marker is recognized from the image information photographed in the designated direction through the camera unit 110 in the vehicle.

In operation 610, the vehicle apparatus 100 obtains M image information about a designated direction of the outside of the vehicle, which is directionally photographed through the M camera units 110 provided in the vehicle.

Herein, the M cameras 110 exclude a camera unit (eg, an internal photographing camera of a black box device) photographing the inside of the vehicle, and the front camera unit facing the front direction of the vehicle and the rear direction of the vehicle. At least one camera unit among at least one camera unit among a rear camera unit facing the side, a side camera unit facing the side of the vehicle, and a mirror camera unit provided at the side mirror of the vehicle; Shoots directed to each designated direction.

The vehicle apparatus 100 reads the obtained M pieces of image information and includes n (1 ≦ n) included in m (1 ≦ m ≦ M) pieces of image information among N (N ≧ 1) marks designated for situation recognition. Recognition information including n pieces of marker information recognizing ≤N) specific marks is generated (615).

Here, the N markers may be a stop line, a parking line, a lane, a letter, a number, a symbol, a pattern, a pattern, a bar code, a 2D code, or a letter displayed on a panel mounted or mounted on a floor. , Symbols, glyphs, patterns, barcodes, 2D codes, letters on the wall, numbers, symbols, glyphs, patterns, barcodes, 2D codes, letters on the wall or mounted panels, numbers, symbols, glyphs, patterns , Bar codes, 2D codes, letters, numbers, symbols, patterns on one side of designated vehicle target service devices, patterns, barcodes, 2D codes, letters, numbers, symbols on panels attached to one side of designated vehicle target service devices It may include one or more of a, pattern, pattern, barcode, 2D code.

The identification information including the n pieces of marker information may include marker information including marker identification information identifying a specific marker, marker information including at least one of character information, numeric information, and symbol information corresponding to the specific marker. N mark information recognized through m image information among mark information including at least one of a glyph information and a pattern information corresponding to the mark, and mark information encoded in a specific mark in the form of a barcode or 2D code. Can include

When the n specific marks are recognized and the recognition information is generated, the vehicle apparatus 100 checks the position information corresponding to the vehicle position at the time when the n specific marks are recognized (620).

Here, the position information corresponding to the vehicle position at the time when the n specific markers are recognized is located in the vehicle positioning device (100) not shown separately in connection with the M camera units 110. It may include the location information measured through).

When the position information corresponding to the vehicle position at the time when the n specific marks are recognized, the vehicle apparatus 100 corresponds to the vehicle driving state for a predetermined time based on the time at which the n specific marks are recognized. The driving state information (for example, parking state information, stop state information, slow state information less than the specified reference speed, road running state information, driving speed information, etc.) is checked (625).

The vehicle device 105 determines whether the location information satisfies at least one piece of location-related context setting information (630).

If the location information satisfies at least one piece of location-related situation setting information, the vehicle apparatus 100 satisfies at least one piece of driving-related situation setting information designated for initiating a designated vehicle-related service. Determine (635).

If the driving state information satisfies at least one piece of driving related situation setting information, the vehicle apparatus 100 reads n pieces of marker information included in the recognition information based on the mark related situation setting information and designates the designated vehicle. Recognize a particular situation for initiating a related service (640).

When the specific situation is recognized as described above, the vehicle apparatus 100 transmits the information requesting to start the designated vehicle-related service to the operation server 105 (645).

Thereafter, when the operation server 105 receives the information requesting to start the designated vehicle related service from the vehicle apparatus 100 (650), the operation server 105 performs the procedure of providing the disclosed vehicle related service (655).

Here, the vehicle-related service may include a payment service, the operation server 105 checks the payment information including the payment amount and merchant information received from the vehicle-targeted service device corresponding to the specific situation, By performing a payment procedure for processing payment for the payment information using payment means information of a registered user, payment result information corresponding to the payment procedure may be provided to the vehicle target service device.

Alternatively, when the vehicle-related service includes a payment service, the operation server 105 is connected with the M camera units 110 and the payment amount received from the vehicle apparatus 100 provided in the vehicle and the specific situation. Check payment information including affiliate store information corresponding to the payment information, and perform a payment procedure of processing payment for the payment information using previously registered payment means information of the user; Payment result information corresponding to may be provided.

Alternatively, when the vehicle-related service includes a payment service, the operation server 105 checks payment information including a payment amount received from an app of a designated user wireless terminal and affiliated store information corresponding to the specific situation, By performing a payment procedure for processing payment for the payment information by using the payment means information of the registered user, it is possible to provide the payment result information corresponding to the payment procedure to the app of the user wireless terminal.

7 is a diagram illustrating a configuration of a service providing system including a vehicle apparatus 100 and an operation server 105 according to another exemplary embodiment of the present invention.

In more detail, Fig. 7 recognizes an external specific mark through one or more camera units installed inside the vehicle, identifies a vehicle position at a time when the specific mark is recognized, and recognizes that the vehicle is a specific situation for starting a specified vehicle-related service. When a person having ordinary knowledge in the art to which the present invention pertains, the configuration of the service providing system is described with reference to and / or modification of the present invention. Various implementation methods (e.g., implementation methods in which some components are omitted, subdivided, or combined) may be inferred, but the present invention includes all the implementation methods inferred, and is shown in FIG. The technical features are not limited only to the implemented method.

The system of the present invention reads M image information acquired through the M camera units 110 in the vehicle to generate recognition information for a specific mark, and corresponds to the vehicle position at the time when the specific mark is recognized. When the vehicle device 100 checks the location information and transmits it to the operation server 105, and the recognition information and the location information are received from the vehicle device 100, the driving state information corresponding to the vehicle driving state for a predetermined time is displayed. If it is recognized that the specific situation for starting the specified vehicle-related service is confirmed, it may be configured with an operation server 105 for providing a vehicle-related service.

According to an exemplary embodiment of the present invention, the vehicle apparatus 100 may include at least one of a navigation apparatus, a black box apparatus, and an infotainment system for a vehicle, or may include a user wireless terminal temporarily mounted on a vehicle using a cradle. can do.

Referring to FIG. 7, the vehicle apparatus 100 includes M (M≥1) camera units 110, an image acquisition unit 115, a mark recognition unit 120, a position checking unit 125, , An information storage unit 135 and an information transmission unit 140 may be provided.

The M camera units 110 include a front camera unit facing the front of the vehicle, a rear camera unit facing the rear of the vehicle, a side camera unit facing the side of the vehicle, and a mirror provided in the side mirror of the vehicle. One or more camera units of the camera unit may include one or more camera units, and may be provided inside the vehicle to direct-oriented photographing each designated direction of the outside of the vehicle.

Here, the M cameras 110 reveals that camera units (eg, cameras for photographing the inside of the black box device) that photograph the inside of the vehicle are excluded.

The information storage unit 135 may include camera identification information for identifying the M camera units 110 provided in the vehicle and direction identification information for identifying the direction in which the M camera units 110 are directed. It may be linked to and stored in a designated storage area of the vehicle apparatus 100 associated with the unit 100.

Here, at least one of the camera identification information and the direction identification information may be identified or included in the image information in association with the image information acquired by the image acquisition unit 115 through the camera unit 110 to obtain a direction.

Alternatively, at least one of the camera identification information and the direction identification information may be identified or included in the recognition information in association with the recognition information generated by the mark recognition unit 120.

The information storage unit 135 may store unique identification information for identifying a vehicle having the M camera units 110 in a designated storage area of the vehicle apparatus associated with the M camera units 110.

In addition, the information storage unit 135 may register and store unique identification information identifying a vehicle having the M camera units 110 in a storage medium of a designated operation server 105, and the operation server 105. The unique identification information may be used to identify the vehicle or provide a vehicle related service for the vehicle.

According to an embodiment of the present invention, the unique identification information is a vehicle identification number, a unique identification value uniquely assigned to a vehicle separately for a vehicle related service, and a unique identification value included in a wireless signal transmitted through a signal transmitter connected to a cigar jack of a vehicle. It may include at least one of a unique identification value uniquely assigned to the vehicle device.

According to another exemplary embodiment of the present invention, when the vehicle apparatus 105 includes a user wireless terminal or when the user wireless terminal is used for the vehicle related service, a unique identification number of the user wireless terminal is installed in the user wireless terminal. It may further include at least one of the app identification value uniquely assigned to the app.

According to the present invention, the unique identification information is transmitted when the vehicle apparatus 100 transmits at least one of the image information, the recognition information, the location information, and the driving status information to the operation server 105 through a communication network. It is preferable to be transmitted to the operation server 105 along with the information to be transmitted.

The image acquisition unit 115 may acquire M image information about a designated direction of the outside of the vehicle, which is oriented photographed through the M camera units 110 provided in the vehicle.

The marker recognition unit 120 reads M image information acquired through the image acquisition unit 115 and m (1 ≦ m ≦ M) images among N (N ≧ 1) marks designated for situation recognition. Recognition information including n pieces of marker information recognizing n (1 ≦ n ≦ N) specific marks included in the information may be generated.

According to the present invention, the N markers are displayed on the stop line, parking line, lane, floor, letters, numbers, symbols, patterns, patterns, barcodes, 2D codes, displayed on the bottom surface, or displayed on the panel mounted on the floor surface Letters, numbers, symbols, glyphs, patterns, barcodes, 2D codes, characters displayed on the wall, numbers, symbols, glyphs, patterns, barcodes, 2D codes, letters, numbers, symbols on the panels attached or mounted on the walls, Glyphs, patterns, barcodes, 2D codes, letters displayed on one side of the designated vehicle target service devices, numbers, symbols, glyphs, patterns, barcodes, 2D codes, characters displayed on the panel attached to one side of the designated vehicle target service devices, It may include one or more of numbers, symbols, patterns, patterns, barcodes, and 2D codes.

Here, the service device for a vehicle (not shown) may include at least one of a gas station at a gas station, a charger at a charging station (LPG charging station, an electric car charging station, etc.), a parking unit at a parking lot, and a toll gate device at a road. It may include a device of.

The vehicle target service device may include at least one of a terminal provided in the gas station, the charging station, the parking lot, the toll gate, and the drive-in affiliated store.

According to the present invention, the recognition information including the n pieces of marker information includes a marker information including marker identification information identifying a specific marker, a marker including at least one of character information, numeric information, and symbol information corresponding to the specific marker. N information recognized through m image information among the marker information including at least one of information, glyph information corresponding to a specific mark, and design information, and code information encoded in a specific mark in the form of a barcode or 2D code. May include marker information

When the n specific marks are recognized through the mark recognition unit 120 and the recognition information is generated, the position checking unit 125 checks the position information corresponding to the vehicle position at the time when the n specific marks are recognized. Can be.

According to the present invention, the position information corresponding to the vehicle position at the time of recognizing the n specific marks is linked to the M camera unit 110, the position location portion of the vehicle apparatus 100 provided in the vehicle (separately (Not shown) may include the location information.

The information transmitting unit 140 includes the identification information recognized through the marker recognition unit 120 and the location information identified through the location identifying unit 125 together with the unique identification information identifying the vehicle. ) Can be sent.

Referring to FIG. 7, the operation server 105 includes an information receiving unit 145, a state checking unit 130, a situation recognition unit 150, a service providing unit 155, and a setting information storing unit 160. It can be configured to have.

The setting information storage unit 160 may store one or more situation setting information set to start a vehicle related service based on a specified situation recognition on a designated storage medium.

According to the present invention, the context setting information includes location area information for setting a specific location area related to a specified vehicle related service, range setting information for setting an inside or outside of a location area related to a specified vehicle related service, and a designated vehicle related service. Distance setting information for setting the distance from the relevant reference position, boundary setting information for setting the distance from the boundary of the location area related to the specified vehicle-related services, and designated roads (highway, car-only road, national road, local road, two-sided road) Etc.) at least one of the position-related situation setting information of the driving condition information for setting the driving condition, and the parking state, the stopping state, the slowing state, the running state, the driving speed range of the vehicle for starting the designated vehicle-related service. Driving-related situation setting information for setting a vehicle and a vehicle for starting a specified vehicle-related service. Marker-related context setting information for setting a specific situation corresponding to the specific mark recognized from the image information photographed in the designated direction through the camera unit inside the amount.

According to the exemplary embodiment of the present invention, the marker-related context setting information may include location information received from the vehicle apparatus 100 that satisfies at least one position-related context setting information, and that the vehicle apparatus 100 is provided. When the driving state information satisfies the at least one driving-related situation setting information, to determine that the specified specific situation occurs when the specific marker is recognized from the image information photographed in the designated direction through the camera unit 110 inside the vehicle. It may include marker setting information to be set.

The information receiver 145 may receive recognition information, location information, and unique identification information for identifying the vehicle from the vehicle apparatus 105.

The state checking unit 130 may correspond to a vehicle driving state for a predetermined time based on the time when the vehicle apparatus 100 recognizes the n specific marks based on the recognition information received from the vehicle apparatus 105. The driving status information can be confirmed.

According to the present invention, the driving state information may include at least one of parking state information, stop state information, slow state information below a designated reference speed, road running state information, and driving speed information.

When the driving state information is confirmed through the status checking unit 130, the situation recognition unit 150 determines the recognition information and the location information based on the situation setting information set to start a vehicle related service based on a specified situation recognition. And it may be able to recognize the specific situation for starting the specified vehicle-related service by analyzing the driving state information.

According to the present invention, the situation recognition unit 150 determines whether the location information satisfies at least one location-related situation setting information, and at least one travel-related one designated to start a vehicle-related service to which the driving state information is designated. If the location information satisfies at least one location-related situation setting information and the driving state information satisfies at least one driving-related situation setting information, the marker-related situation setting information is determined. Based on this, the n pieces of marker information included in the recognition information may be read to recognize a specific situation for starting a specified vehicle related service.

When the specific situation is recognized through the situation recognition unit 150, the service provider 155 may perform a procedure for providing the disclosed vehicle-related service.

According to the exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service provider 155 may include a payment amount and merchant information received from a vehicle-targeted service device corresponding to the specific situation. Check the information, perform a payment procedure for processing payment for the payment information using previously registered payment means information of the user, and provide the payment result information corresponding to the payment procedure to the vehicle target service apparatus; have.

According to another exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service providing unit 155 is connected to the M camera units 110 and is provided in the vehicle apparatus 100. Confirming the payment information including the payment amount received from the merchant information corresponding to the specific situation and performing a payment procedure for processing the payment information using the payment means information of the registered user; The vehicle apparatus 100 may provide payment result information corresponding to the payment procedure.

According to another exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service provider 155 may provide a payment amount received from an app of a designated user wireless terminal and affiliated store information corresponding to the specific situation. Checking the payment information, including, and performing a payment procedure for processing the payment for the payment information by using the payment means information of the registered user, the payment result corresponding to the payment procedure with the app of the user wireless terminal Information can be provided.

8 is a diagram illustrating a process of providing a context-based vehicle related service using an in-vehicle camera according to another exemplary embodiment of the present invention.

In more detail, FIG. 8 reads M image information acquired through the M camera units 110 inside the vehicle in the vehicle apparatus 100 to generate recognition information for a specific mark, and recognizes the specific mark. When the position information corresponding to the vehicle position at the time point is checked and transmitted to the operation server 105, the operation server 105 checks the driving state information corresponding to the vehicle driving state for a predetermined time, and the vehicle apparatus 100 When it is recognized that the specific situation for starting the specified vehicle-related services using the recognition information, location information and driving state information received from the) is a process showing providing a vehicle-related services, it is common in the art Those skilled in the art can refer to and / or modify this drawing 8 to provide various examples of the process of providing context-based vehicle-related service using the in-vehicle camera. Although it is possible to infer an implementation method (for example, an implementation method in which some steps are omitted or the order is changed), the present invention includes all the implementation methods inferred above, and only the implementation method shown in FIG. The technical features are not limited.

Referring to FIG. 8, camera identification information for identifying M camera units 110 provided in a vehicle in the vehicle apparatus 100, direction identification information for identifying a direction that the M camera units 110 are directed to, and The in-vehicle camera may be stored in a process of associating and storing unique identification information for identifying a vehicle having the M camera units 110 in a designated storage area of the vehicle apparatus 100 associated with the M camera units 100. The context-based vehicle-related service providing process may be started (800).

At least one of the camera identification information and the direction identification information may be identified or included in the image information in association with the image information.

Alternatively, at least one of the camera identification information and the direction identification information may be identified or included in the recognition information in association with the recognition information.

The unique identification information includes a vehicle number, a unique identification value uniquely assigned to a vehicle for a vehicle-related service, a unique identification value included in a wireless signal transmitted through a signal transmitter connected to a cigar jack of a vehicle, and uniquely assigned to a vehicle device. It may include at least one of the identification value.

In addition, the unique identification information is a unique identification number of the user wireless terminal, the app installed in the user wireless terminal when the vehicle device 105 includes a user wireless terminal or the user wireless terminal is used for the vehicle-related services. At least one of the uniquely assigned app identification value may be further included.

The vehicle apparatus 100 requests to store and store unique identification information identifying a vehicle having the M camera units 110 in a storage medium of a designated operation server 105 (805), and the operation server 105 ) Registers the unique identification information to a designated storage medium for identifying the vehicle or providing a vehicle related service for the vehicle (810).

In operation 815, the operation server 105 stores one or more context setting information set to start a vehicle related service based on a specified context awareness on a designated storage medium.

The context setting information includes location area information for setting a specific location area related to a specified vehicle related service, range setting information for setting an inside or outside of a location area related to a specified vehicle related service, and a reference location for a specified vehicle related service. Distance setting information for setting the distance, boundary setting information for setting the distance away from the boundary of the location area associated with the specified vehicle-related services, driving conditions of the specified road (highway, automobile road, national road, local road, rear road, etc.) At least one position-related situation setting information of the driving condition information to be set, and driving-related setting at least one of a parking state, a stop state, a slow state, a road running state, and a driving speed range of the vehicle for starting a specified vehicle-related service. Status setting information and the camera inside the vehicle to start the designated vehicle related service The via may comprise a marker relevant circumstances to set specific conditions setting information corresponding to the specific marker that is the basis of the image information taken in the chosen direction.

Here, the marker-related situation setting information is the position information received from the vehicle apparatus 100 satisfies at least one position-related situation setting information, the driving state information confirmed by the operation server 105 is at least one driving Includes marker setting information for setting to determine that the specified specific situation has occurred when recognizing the specific marker from the image information photographed in the specified direction through the camera unit 110 inside the vehicle in a situation that satisfies the relevant situation setting information. Can be.

In operation 820, the vehicle apparatus 100 obtains M image information about a designated direction of the outside of the vehicle, which is oriented photographed through the M camera units 110 provided in the vehicle.

Herein, the M cameras 110 exclude a camera unit (eg, an internal photographing camera of a black box device) photographing the inside of the vehicle, and the front camera unit facing the front direction of the vehicle and the rear direction of the vehicle. At least one camera unit among at least one camera unit among a rear camera unit facing the side, a side camera unit facing the side of the vehicle, and a mirror camera unit provided at the side mirror of the vehicle; Shoots directed to each designated direction.

The vehicle apparatus 100 reads the obtained M pieces of image information and includes n (1 ≦ n) included in m (1 ≦ m ≦ M) pieces of image information among N (N ≧ 1) marks designated for situation recognition. Recognition information including n pieces of marker information recognizing ≤ N) specific marks is generated (825).

Here, the N markers may be a stop line, a parking line, a lane, a letter, a number, a symbol, a pattern, a pattern, a bar code, a 2D code, or a letter displayed on a panel mounted or mounted on a floor. , Symbols, glyphs, patterns, barcodes, 2D codes, letters on the wall, numbers, symbols, glyphs, patterns, barcodes, 2D codes, letters on the wall or mounted panels, numbers, symbols, glyphs, patterns , Bar codes, 2D codes, letters, numbers, symbols, patterns on one side of designated vehicle target service devices, patterns, barcodes, 2D codes, letters, numbers, symbols on panels attached to one side of designated vehicle target service devices It may include one or more of a, pattern, pattern, barcode, 2D code.

The identification information including the n pieces of marker information may include marker information including marker identification information identifying a specific marker, marker information including at least one of character information, numeric information, and symbol information corresponding to the specific marker. N mark information recognized through m image information among mark information including at least one of a glyph information and a pattern information corresponding to the mark, and mark information encoded in a specific mark in the form of a barcode or 2D code. Can include

When the n specific marks are recognized and the recognition information is generated, the vehicle apparatus 100 checks the position information corresponding to the vehicle position at the time when the n specific marks are recognized (830).

Here, the position information corresponding to the vehicle position at the time when the n specific markers are recognized is located in the vehicle positioning device (100) not shown separately in connection with the M camera units 110. It may include the location information measured through).

When the location information corresponding to the vehicle position at the time of recognizing the n specific marks is confirmed, the vehicle apparatus 100 includes the recognition information and the location information together with the unique identification information identifying the vehicle. (835).

When the operation server 105 receives the identification information, the location information and the unique identification information for identifying the vehicle from the vehicle device 105 (840), the operation server 105 for a predetermined time based on the time point at which the n specific markers are recognized. The driving state information corresponding to the vehicle driving state of the vehicle (for example, parking state information, stop state information, slow state information below the specified reference speed, road running state information, driving speed information, etc.) is checked (845).

When the driving state information is confirmed, the vehicle apparatus 100 determines whether the location information satisfies at least one piece of location-related context setting information (850).

If the location information satisfies at least one piece of location-related situation setting information, the operation server 105 checks whether the driving state information satisfies at least one piece of driving-related situation setting information designated to start a designated vehicle-related service. Determine (855).

If the driving state information satisfies at least one piece of driving related situation setting information, the operation server 105 reads n pieces of marker information included in the recognition information based on the mark related situation setting information and designates the vehicle. A specific situation for initiating a related service is recognized (860).

When the specific situation is recognized as described above, the operation server 105 performs a procedure for providing the disclosed vehicle-related service (865).

Here, the vehicle-related service may include a payment service, the operation server 105 checks the payment information including the payment amount and merchant information received from the vehicle-targeted service device corresponding to the specific situation, By performing a payment procedure for processing payment for the payment information using payment means information of a registered user, payment result information corresponding to the payment procedure may be provided to the vehicle target service device.

Alternatively, when the vehicle-related service includes a payment service, the operation server 105 is connected with the M camera units 110 and the payment amount received from the vehicle apparatus 100 provided in the vehicle and the specific situation. Check payment information including affiliate store information corresponding to the payment information, and perform a payment procedure of processing payment for the payment information using previously registered payment means information of the user; Payment result information corresponding to may be provided.

Alternatively, when the vehicle-related service includes a payment service, the operation server 105 checks payment information including a payment amount received from an app of a designated user wireless terminal and affiliated store information corresponding to the specific situation, By performing a payment procedure for processing payment for the payment information by using the payment means information of the registered user, it is possible to provide the payment result information corresponding to the payment procedure to the app of the user wireless terminal.

9 is a diagram showing the configuration of a service providing system including a vehicle apparatus 100 and an operation server 105 according to another embodiment of the present invention.

In more detail, FIG. 9 recognizes an external specific mark through one or more camera units installed inside the vehicle, identifies a vehicle position at a time when the specific mark is recognized, and recognizes that the vehicle is a specific situation for starting a specified vehicle-related service. If a person having ordinary skill in the art to which the present invention pertains, the configuration of the service providing system will be described with reference to FIG. 9 and / or modified. Various implementation methods (e.g., implementation methods in which some components are omitted, subdivided, or combined) may be inferred, but the present invention includes all the implementation methods inferred, as shown in FIG. The technical features are not limited only to the implemented method.

The system of the present invention reads M image information acquired through the M camera units 110 in the vehicle, generates recognition information for a specific mark, and transmits the generated recognition information to the operation server 105. When the vehicle apparatus 100 and the recognition information are received from the vehicle apparatus 100, the vehicle apparatus 100 checks the position information corresponding to the vehicle position at the time when the specific mark is recognized, and corresponds to the vehicle driving state for a predetermined time. If it is recognized that the specific state for starting the specified vehicle-related service by checking the driving state information, it may be configured with an operation server 105 for providing a vehicle-related service.

According to an exemplary embodiment of the present invention, the vehicle apparatus 100 may include at least one of a navigation apparatus, a black box apparatus, and an infotainment system for a vehicle, or may include a user wireless terminal temporarily mounted on a vehicle using a cradle. can do.

Referring to FIG. 9, the vehicle apparatus 100 includes M (M≥1) camera units 110, an image acquisition unit 115, a mark recognition unit 120, an information storage unit 135, It may be configured to include an information transmitting unit 140.

The M camera units 110 include a front camera unit facing the front of the vehicle, a rear camera unit facing the rear of the vehicle, a side camera unit facing the side of the vehicle, and a mirror provided in the side mirror of the vehicle. One or more camera units of the camera unit may include one or more camera units, and may be provided inside the vehicle to direct-oriented photographing each designated direction of the outside of the vehicle.

Here, the M cameras 110 reveals that camera units (eg, cameras for photographing the inside of the black box device) that photograph the inside of the vehicle are excluded.

The information storage unit 135 may include camera identification information for identifying the M camera units 110 provided in the vehicle and direction identification information for identifying the direction in which the M camera units 110 are directed. It may be linked to and stored in a designated storage area of the vehicle apparatus 100 associated with the unit 100.

Here, at least one of the camera identification information and the direction identification information may be identified or included in the image information in association with the image information acquired by the image acquisition unit 115 through the camera unit 110 to obtain a direction.

Alternatively, at least one of the camera identification information and the direction identification information may be identified or included in the recognition information in association with the recognition information generated by the mark recognition unit 120.

The information storage unit 135 may store unique identification information for identifying a vehicle having the M camera units 110 in a designated storage area of the vehicle apparatus associated with the M camera units 110.

In addition, the information storage unit 135 may register and store unique identification information identifying a vehicle having the M camera units 110 in a storage medium of a designated operation server 105, and the operation server 105. The unique identification information may be used to identify the vehicle or provide a vehicle related service for the vehicle.

According to an embodiment of the present invention, the unique identification information is a vehicle identification number, a unique identification value uniquely assigned to a vehicle separately for a vehicle related service, and a unique identification value included in a wireless signal transmitted through a signal transmitter connected to a cigar jack of a vehicle. It may include at least one of a unique identification value uniquely assigned to the vehicle device.

According to another exemplary embodiment of the present invention, when the vehicle apparatus 105 includes a user wireless terminal or when the user wireless terminal is used for the vehicle related service, a unique identification number of the user wireless terminal is installed in the user wireless terminal. It may further include at least one of the app identification value uniquely assigned to the app.

According to the present invention, the unique identification information is transmitted when the vehicle apparatus 100 transmits at least one of the image information, the recognition information, the location information, and the driving status information to the operation server 105 through a communication network. It is preferable to be transmitted to the operation server 105 along with the information to be transmitted.

The image acquisition unit 115 may acquire M image information about a designated direction of the outside of the vehicle, which is oriented photographed through the M camera units 110 provided in the vehicle.

The marker recognition unit 120 reads M image information acquired through the image acquisition unit 115 and m (1 ≦ m ≦ M) images among N (N ≧ 1) marks designated for situation recognition. Recognition information including n pieces of marker information recognizing n (1 ≦ n ≦ N) specific marks included in the information may be generated.

According to the present invention, the N markers are displayed on the stop line, parking line, lane, floor, letters, numbers, symbols, patterns, patterns, barcodes, 2D codes, displayed on the bottom surface, or displayed on the panel mounted on the floor surface Letters, numbers, symbols, glyphs, patterns, barcodes, 2D codes, characters displayed on the wall, numbers, symbols, glyphs, patterns, barcodes, 2D codes, letters, numbers, symbols on the panels attached or mounted on the walls, Glyphs, patterns, barcodes, 2D codes, letters displayed on one side of the designated vehicle target service devices, numbers, symbols, glyphs, patterns, barcodes, 2D codes, characters displayed on the panel attached to one side of the designated vehicle target service devices, It may include one or more of numbers, symbols, patterns, patterns, barcodes, and 2D codes.

Here, the service device for a vehicle (not shown) may include at least one of a gas station at a gas station, a charger at a charging station (LPG charging station, an electric car charging station, etc.), a parking unit at a parking lot, and a toll gate device at a road. It may include a device of.

The vehicle target service device may include at least one of a terminal provided in the gas station, the charging station, the parking lot, the toll gate, and the drive-in affiliated store.

According to the present invention, the recognition information including the n pieces of marker information includes a marker information including marker identification information identifying a specific marker, a marker including at least one of character information, numeric information, and symbol information corresponding to the specific marker. N information recognized through m image information among the marker information including at least one of information, glyph information corresponding to a specific mark, and design information, and code information encoded in a specific mark in the form of a barcode or 2D code. It may include marker information.

The information transmitter 140 may transmit the recognition information recognized through the marker recognition unit 120 to the operation server 105 together with the unique identification information for identifying the vehicle.

Referring to FIG. 9, the operation server 105 may include an information receiver 145, a location checker 125, a status checker 130, a situation recognizer 150, and a service provider 155. And the setting information storage unit 160.

The setting information storage unit 160 may store one or more situation setting information set to start a vehicle related service based on a specified situation recognition on a designated storage medium.

According to the present invention, the context setting information includes location area information for setting a specific location area related to a specified vehicle related service, range setting information for setting an inside or outside of a location area related to a specified vehicle related service, and a designated vehicle related service. Distance setting information for setting the distance from the relevant reference position, boundary setting information for setting the distance from the boundary of the location area related to the specified vehicle-related services, and designated roads (highway, car-only road, national road, local road, two-sided road) Etc.) at least one of the position-related situation setting information of the driving condition information for setting the driving condition, and the parking state, the stopping state, the slowing state, the running state, the driving speed range of the vehicle for starting the designated vehicle-related service. Driving-related situation setting information for setting a vehicle and a vehicle for starting a specified vehicle-related service. Marker-related context setting information for setting a specific situation corresponding to the specific mark recognized from the image information photographed in the designated direction through the camera unit inside the amount.

According to the exemplary embodiment of the present invention, the marker-related context setting information includes a vehicle in which the position information checked through the operation server 105 satisfies at least one position-related context setting information, and the vehicle apparatus 100 is provided. Is determined that the specified specific situation occurs when the specific mark is recognized from the image information photographed in the specified direction by the camera unit 110 inside the vehicle when the driving state information of the vehicle satisfies at least one driving related situation setting information. It may include marker setting information to be set to.

The information receiver 145 may receive recognition information and unique identification information for identifying the vehicle from the vehicle apparatus 105.

When the identification information is received from the vehicle apparatus 105, the location checker 125 may identify location information corresponding to the vehicle location at the time when the n specific marks are recognized based on the received recognition information. .

According to the present invention, the position information corresponding to the vehicle position at the time of recognizing the n specific marks is linked to the M camera unit 110, the position location portion of the vehicle apparatus 100 provided in the vehicle (separately (Not shown) may include the location information.

The state checking unit 130 may correspond to a vehicle driving state for a predetermined time based on the time when the vehicle apparatus 100 recognizes the n specific marks based on the recognition information received from the vehicle apparatus 105. The driving status information can be confirmed.

According to the present invention, the driving state information may include at least one of parking state information, stop state information, slow state information below a designated reference speed, road running state information, and driving speed information.

When the driving state information is confirmed through the status checking unit 130, the situation recognition unit 150 determines the recognition information and the location information based on the situation setting information set to start a vehicle related service based on a specified situation recognition. And it may be able to recognize the specific situation for starting the specified vehicle-related service by analyzing the driving state information.

According to the present invention, the situation recognition unit 150 determines whether the location information satisfies at least one location-related situation setting information, and at least one travel-related one designated to start a vehicle-related service to which the driving state information is designated. If the location information satisfies at least one location-related situation setting information and the driving state information satisfies at least one driving-related situation setting information, the marker-related situation setting information is determined. Based on this, the n pieces of marker information included in the recognition information may be read to recognize a specific situation for starting a specified vehicle related service.

When the specific situation is recognized through the situation recognition unit 150, the service provider 155 may perform a procedure for providing the disclosed vehicle-related service.

According to the exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service provider 155 may include a payment amount and merchant information received from a vehicle-targeted service device corresponding to the specific situation. Check the information, perform a payment procedure for processing payment for the payment information using previously registered payment means information of the user, and provide the payment result information corresponding to the payment procedure to the vehicle target service apparatus; have.

According to another exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service providing unit 155 is connected to the M camera units 110 and is provided in the vehicle apparatus 100. Confirming the payment information including the payment amount received from the merchant information corresponding to the specific situation and performing a payment procedure for processing the payment information using the payment means information of the registered user; The vehicle apparatus 100 may provide payment result information corresponding to the payment procedure.

According to another exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service provider 155 may provide a payment amount received from an app of a designated user wireless terminal and affiliated store information corresponding to the specific situation. Checking the payment information, including, and performing a payment procedure for processing the payment for the payment information by using the payment means information of the registered user, the payment result corresponding to the payment procedure with the app of the user wireless terminal Information can be provided.

10 is a diagram illustrating a process of providing a context-based vehicle-related service using an in-vehicle camera according to another exemplary embodiment of the present invention.

In more detail, in FIG. 10, the M apparatus 100 reads M image information acquired through the M camera units 110 in the vehicle, generates recognition information for a specific mark, and generates the recognition information. When the check is transmitted to the operation server 105, the operation server 105 confirms the location information corresponding to the vehicle position at the time when the specific mark is recognized, and the driving state information corresponding to the vehicle driving state for a predetermined time. As shown in FIG. 2, a process of providing a vehicle-related service when it is recognized that a specific situation for starting a designated vehicle-related service is recognized by using the recognition information, location information, and driving state information is illustrated. Those skilled in the art can refer to and / or modify this drawing 10 to provide a process for providing a context-based vehicle-related service using the in-vehicle camera. Various implementation methods may be inferred (e.g., some steps may be omitted or the order may be changed), but the present invention includes all the implementation methods inferred above, and only the implementation method illustrated in FIG. The technical features are not limited.

Referring to FIG. 10, camera identification information identifying M camera units 110 provided in a vehicle in the vehicle apparatus 100, direction identification information identifying a direction that the M camera units 110 are directed to, and The in-vehicle camera may be stored in a process of associating and storing unique identification information for identifying a vehicle having the M camera units 110 in a designated storage area of the vehicle apparatus 100 associated with the M camera units 100. The context-aware vehicle-related service providing process may be started (1000).

At least one of the camera identification information and the direction identification information may be identified or included in the image information in association with the image information.

Alternatively, at least one of the camera identification information and the direction identification information may be identified or included in the recognition information in association with the recognition information.

The unique identification information includes a vehicle number, a unique identification value uniquely assigned to a vehicle for a vehicle-related service, a unique identification value included in a wireless signal transmitted through a signal transmitter connected to a cigar jack of a vehicle, and uniquely assigned to a vehicle device. It may include at least one of the identification value.

In addition, the unique identification information is a unique identification number of the user wireless terminal, the app installed in the user wireless terminal when the vehicle device 105 includes a user wireless terminal or the user wireless terminal is used for the vehicle-related services. At least one of the uniquely assigned app identification value may be further included.

The vehicle apparatus 100 requests to store and store unique identification information identifying a vehicle having the M camera units 110 in a storage medium of a designated operation server 105 (1005), and the operation server 105 ) Registers the unique identification information with a designated storage medium for identifying the vehicle or providing a vehicle related service for the vehicle (1010).

In operation 1015, the operation server 105 stores one or more context setting information, which is set to start a vehicle related service based on a specified context awareness, on a designated storage medium.

The context setting information includes location area information for setting a specific location area related to a specified vehicle related service, range setting information for setting an inside or outside of a location area related to a specified vehicle related service, and a reference location for a specified vehicle related service. Distance setting information for setting the distance, boundary setting information for setting the distance away from the boundary of the location area associated with the specified vehicle-related services, driving conditions of the specified road (highway, automobile road, national road, local road, rear road, etc.) At least one position-related situation setting information of the driving condition information to be set, and driving-related setting at least one of a parking state, a stop state, a slow state, a road running state, and a driving speed range of the vehicle for starting a specified vehicle-related service. Status setting information and the camera inside the vehicle to start the designated vehicle related service The via may comprise a marker relevant circumstances to set specific conditions setting information corresponding to the specific marker that is the basis of the image information taken in the chosen direction.

Here, the marker-related situation setting information, the location information identified through the operation server 105 satisfies at least one location-related situation setting information, the driving state information confirmed by the operation server 105 is at least one driving Includes marker setting information for setting to determine that the specified specific situation has occurred when recognizing the specific marker from the image information photographed in the specified direction through the camera unit 110 inside the vehicle in a situation that satisfies the relevant situation setting information. Can be.

On the other hand, the vehicle apparatus 100 obtains M image information about a designated direction of the outside of the vehicle oriented by the M camera unit 110 provided in the vehicle (1020).

Herein, the M cameras 110 exclude a camera unit (eg, an internal photographing camera of a black box device) photographing the inside of the vehicle, and the front camera unit facing the front direction of the vehicle and the rear direction of the vehicle. At least one camera unit among at least one camera unit among a rear camera unit facing the side, a side camera unit facing the side of the vehicle, and a mirror camera unit provided at the side mirror of the vehicle; Shoots directed to each designated direction.

The vehicle apparatus 100 reads the obtained M pieces of image information and includes n (1 ≦ n) included in m (1 ≦ m ≦ M) pieces of image information among N (N ≧ 1) marks designated for situation recognition. Recognition information including n pieces of marker information recognizing ≤N) specific marks is generated (1025).

Here, the N markers may be a stop line, a parking line, a lane, a letter, a number, a symbol, a pattern, a pattern, a bar code, a 2D code, or a letter displayed on a panel mounted or mounted on a floor. , Symbols, glyphs, patterns, barcodes, 2D codes, letters on the wall, numbers, symbols, glyphs, patterns, barcodes, 2D codes, letters on the wall or mounted panels, numbers, symbols, glyphs, patterns , Bar codes, 2D codes, letters, numbers, symbols, patterns on one side of designated vehicle target service devices, patterns, barcodes, 2D codes, letters, numbers, symbols on panels attached to one side of designated vehicle target service devices It may include one or more of a, pattern, pattern, barcode, 2D code.

The identification information including the n pieces of marker information may include marker information including marker identification information identifying a specific marker, marker information including at least one of character information, numeric information, and symbol information corresponding to the specific marker. N mark information recognized through m image information among mark information including at least one of a glyph information and a pattern information corresponding to the mark, and mark information encoded in a specific mark in the form of a barcode or 2D code. Can include

When the n specific marks are recognized and the recognition information is generated, the vehicle apparatus 100 transmits the generated recognition information to the operation server 105 together with the unique identification information for identifying the vehicle (1030).

When the operation server 105 receives the identification information and the unique identification information for identifying the vehicle from the vehicle apparatus 105 (1035), at the time when the n specific marks are recognized based on the received recognition information. The location information corresponding to the vehicle location is checked (1040).

Here, the position information corresponding to the vehicle position at the time when the n specific markers are recognized is located in the vehicle positioning device (100) not shown separately in connection with the M camera units 110. It may include the location information measured through).

When the location information corresponding to the vehicle position at the time of recognizing the n specific marks is confirmed, the operation server 105 corresponds to the vehicle driving state for a predetermined time based on the time at which the n specific marks are recognized. The driving state information (eg, parking state information, stop state information, slow state information below a designated reference speed, road running state information, driving speed information, etc.) is checked (1045).

When the driving state information is confirmed, the vehicle apparatus 100 determines whether the location information satisfies at least one location-related situation setting information (1050).

If the location information satisfies at least one piece of location-related situation setting information, the operation server 105 checks whether the driving state information satisfies at least one piece of driving-related situation setting information designated to start a designated vehicle-related service. Determine (1055).

If the driving state information satisfies at least one piece of driving related situation setting information, the operation server 105 reads n pieces of marker information included in the recognition information based on the mark related situation setting information and designates the vehicle. A specific situation for initiating a related service is recognized (1060).

When the specific situation is recognized as described above, the operation server 105 performs a procedure for providing the disclosed vehicle-related service (1065).

Here, the vehicle-related service may include a payment service, the operation server 105 checks the payment information including the payment amount and merchant information received from the vehicle-targeted service device corresponding to the specific situation, By performing a payment procedure for processing payment for the payment information using payment means information of a registered user, payment result information corresponding to the payment procedure may be provided to the vehicle target service device.

Alternatively, when the vehicle-related service includes a payment service, the operation server 105 is connected with the M camera units 110 and the payment amount received from the vehicle apparatus 100 provided in the vehicle and the specific situation. Check payment information including affiliate store information corresponding to the payment information, and perform a payment procedure of processing payment for the payment information using previously registered payment means information of the user; Payment result information corresponding to may be provided.

Alternatively, when the vehicle-related service includes a payment service, the operation server 105 checks payment information including a payment amount received from an app of a designated user wireless terminal and affiliated store information corresponding to the specific situation, By performing a payment procedure for processing payment for the payment information by using the payment means information of the registered user, it is possible to provide the payment result information corresponding to the payment procedure to the app of the user wireless terminal.

11 is a diagram illustrating a configuration of a service providing system including a vehicle apparatus 100 and an operation server 105 according to another exemplary embodiment of the present invention.

More specifically, FIG. 11 recognizes a specific mark from outside through one or more camera units installed inside the vehicle, identifies a vehicle position at a time when the specific mark is recognized, and recognizes that the vehicle is a specific situation for starting a specified vehicle-related service. If a person having ordinary knowledge in the art to which the present invention pertains, the configuration of the service providing system will be described with reference to and / or modified with reference to FIG. Various implementation methods (e.g., implementation methods in which some components are omitted, subdivided, or combined) may be inferred, but the present invention includes all the implementation methods inferred, as shown in FIG. The technical features are not limited only to the implemented method.

The system of the present invention, the vehicle device 100 for transmitting the M image information obtained through the M camera unit 110 in the vehicle to the operation server 105, and the image information from the vehicle device 100 When received, the received image information is read to generate recognition information on a specific mark, and then the position information corresponding to the vehicle position at the time of recognizing the specific mark is checked, and corresponding to the vehicle driving state for a predetermined time. If it is recognized that the specific state for starting the specified vehicle-related service by checking the driving state information, it may be configured with an operation server 105 for providing a vehicle-related service.

According to an exemplary embodiment of the present invention, the vehicle apparatus 100 may include at least one of a navigation apparatus, a black box apparatus, and an infotainment system for a vehicle, or may include a user wireless terminal temporarily mounted on a vehicle using a cradle. can do.

Referring to FIG. 11, the vehicle apparatus 100 includes M (M≥1) camera units 110, an image acquisition unit 115, an information storage unit 135, and an information transmission unit 140. It may be provided with.

The M camera units 110 include a front camera unit facing the front of the vehicle, a rear camera unit facing the rear of the vehicle, a side camera unit facing the side of the vehicle, and a mirror provided in the side mirror of the vehicle. One or more camera units of the camera unit may include one or more camera units, and may be provided inside the vehicle to direct-oriented photographing each designated direction of the outside of the vehicle.

Here, the M cameras 110 reveals that camera units (eg, cameras for photographing the inside of the black box device) that photograph the inside of the vehicle are excluded.

The information storage unit 135 may include camera identification information for identifying the M camera units 110 provided in the vehicle and direction identification information for identifying the direction in which the M camera units 110 are directed. It may be linked to and stored in a designated storage area of the vehicle apparatus 100 associated with the unit 100.

Here, at least one of the camera identification information and the direction identification information may be identified or included in the image information in association with the image information acquired by the image acquisition unit 115 through the camera unit 110 to obtain a direction.

Alternatively, at least one of the camera identification information and the direction identification information may be confirmed in association with the recognition information generated through the operation server 105 or included in the recognition information.

The information storage unit 135 may store unique identification information for identifying a vehicle having the M camera units 110 in a designated storage area of the vehicle apparatus associated with the M camera units 110.

In addition, the information storage unit 135 may register and store unique identification information identifying a vehicle having the M camera units 110 in a storage medium of a designated operation server 105, and the operation server 105. The unique identification information may be used to identify the vehicle or provide a vehicle related service for the vehicle.

According to an embodiment of the present invention, the unique identification information is a vehicle identification number, a unique identification value uniquely assigned to a vehicle separately for a vehicle related service, and a unique identification value included in a wireless signal transmitted through a signal transmitter connected to a cigar jack of a vehicle. It may include at least one of a unique identification value uniquely assigned to the vehicle device.

According to another exemplary embodiment of the present invention, when the vehicle apparatus 105 includes a user wireless terminal or when the user wireless terminal is used for the vehicle related service, a unique identification number of the user wireless terminal is installed in the user wireless terminal. It may further include at least one of the app identification value uniquely assigned to the app.

According to the present invention, the unique identification information is transmitted when the vehicle apparatus 100 transmits at least one of the image information, the recognition information, the location information, and the driving status information to the operation server 105 through a communication network. It is preferable to be transmitted to the operation server 105 along with the information to be transmitted.

The image acquisition unit 115 may acquire M image information about a designated direction of the outside of the vehicle, which is oriented photographed through the M camera units 110 provided in the vehicle.

The information transmitter 140 may transmit the M pieces of image information acquired through the image acquirer 115 to the operation server 105 together with the unique identification information for identifying the vehicle.

Referring to FIG. 11, the operation server 105 includes an information receiving unit 145, a mark recognizing unit 120, a positioning unit 125, a state confirming unit 130, and a situation recognizing unit 150. And a service provider 155 and a setting information storage unit 160.

The setting information storage unit 160 may store one or more situation setting information set to start a vehicle related service based on a specified situation recognition on a designated storage medium.

According to the present invention, the context setting information includes location area information for setting a specific location area related to a specified vehicle related service, range setting information for setting an inside or outside of a location area related to a specified vehicle related service, and a designated vehicle related service. Distance setting information for setting the distance from the relevant reference position, boundary setting information for setting the distance from the boundary of the location area related to the specified vehicle-related services, and designated roads (highway, car-only road, national road, local road, two-sided road) Etc.) at least one of the position-related situation setting information of the driving condition information for setting the driving condition, and the parking state, the stopping state, the slowing state, the running state, the driving speed range of the vehicle for starting the designated vehicle-related service. Driving-related situation setting information for setting a vehicle and a vehicle for starting a specified vehicle-related service. Marker-related context setting information for setting a specific situation corresponding to the specific mark recognized from the image information photographed in the designated direction through the camera unit inside the amount.

According to the exemplary embodiment of the present invention, the marker-related context setting information includes a vehicle in which the position information checked through the operation server 105 satisfies at least one position-related context setting information, and the vehicle apparatus 100 is provided. Is determined that the specified specific situation occurs when the specific mark is recognized from the image information photographed in the specified direction by the camera unit 110 inside the vehicle when the driving state information of the vehicle satisfies at least one driving related situation setting information. It may include marker setting information to be set to.

The information receiver 145 may receive M pieces of image information and unique identification information for identifying the vehicle from the vehicle apparatus 100.

The marker recognizing unit 120 reads M image information received from the vehicle apparatus 100 to m (1≤m≤M) image information among N (N≥1) markers designated for situation recognition. Recognition information including n pieces of marker information recognizing the n (1 ≦ n ≦ N) specific markers included may be generated.

According to the present invention, the N markers are displayed on the stop line, parking line, lane, floor, letters, numbers, symbols, patterns, patterns, barcodes, 2D codes, displayed on the bottom surface, or displayed on the panel mounted on the floor surface Letters, numbers, symbols, glyphs, patterns, barcodes, 2D codes, characters displayed on the wall, numbers, symbols, glyphs, patterns, barcodes, 2D codes, letters, numbers, symbols on the panels attached or mounted on the walls, Glyphs, patterns, barcodes, 2D codes, letters displayed on one side of the designated vehicle target service devices, numbers, symbols, glyphs, patterns, barcodes, 2D codes, characters displayed on the panel attached to one side of the designated vehicle target service devices, It may include one or more of numbers, symbols, patterns, patterns, barcodes, and 2D codes.

Here, the service device for a vehicle (not shown) may include at least one of a gas station at a gas station, a charger at a charging station (LPG charging station, an electric car charging station, etc.), a parking unit at a parking lot, and a toll gate device at a road. It may include a device of.

The vehicle target service device may include at least one of a terminal provided in the gas station, the charging station, the parking lot, the toll gate, and the drive-in affiliated store.

According to the present invention, the recognition information including the n pieces of marker information includes a marker information including marker identification information identifying a specific marker, a marker including at least one of character information, numeric information, and symbol information corresponding to the specific marker. N information recognized through m image information among the marker information including at least one of information, glyph information corresponding to a specific mark, and design information, and code information encoded in a specific mark in the form of a barcode or 2D code. It may include marker information.

When the identification information including n mark information is generated through the mark recognition unit 120, the position checking unit 125 may check the position information corresponding to the vehicle position at the time when the n specific marks are recognized. have.

According to the present invention, the position information corresponding to the vehicle position at the time of recognizing the n specific marks is linked to the M camera unit 110, the position location portion of the vehicle apparatus 100 provided in the vehicle (separately (Not shown) may include the location information.

If the position checking unit 130 confirms the location information corresponding to the vehicle position at the time of recognizing the n specific marks through the position checking unit 125, the state checking unit 130 is based on the time of recognizing the n specific marks. The driving state information corresponding to the driving state of the vehicle for a predetermined time can be checked.

According to the present invention, the driving state information may include at least one of parking state information, stop state information, slow state information below a designated reference speed, road running state information, and driving speed information.

When the driving state information is confirmed through the status checking unit 130, the situation recognition unit 150 determines the recognition information and the location information based on the situation setting information set to start a vehicle related service based on a specified situation recognition. And it may be able to recognize the specific situation for starting the specified vehicle-related service by analyzing the driving state information.

According to the present invention, the situation recognition unit 150 determines whether the location information satisfies at least one location-related situation setting information, and at least one travel-related one designated to start a vehicle-related service to which the driving state information is designated. If the location information satisfies at least one location-related situation setting information and the driving state information satisfies at least one driving-related situation setting information, the marker-related situation setting information is determined. Based on this, the n pieces of marker information included in the recognition information may be read to recognize a specific situation for starting a specified vehicle related service.

When the specific situation is recognized through the situation recognition unit 150, the service provider 155 may perform a procedure for providing the disclosed vehicle-related service.

According to the exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service provider 155 may include a payment amount and merchant information received from a vehicle-targeted service device corresponding to the specific situation. Check the information, perform a payment procedure for processing payment for the payment information using previously registered payment means information of the user, and provide the payment result information corresponding to the payment procedure to the vehicle target service apparatus; have.

According to another exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service providing unit 155 is connected to the M camera units 110 and is provided in the vehicle apparatus 100. Confirming the payment information including the payment amount received from the merchant information corresponding to the specific situation and performing a payment procedure for processing the payment information using the payment means information of the registered user; The vehicle apparatus 100 may provide payment result information corresponding to the payment procedure.

According to another exemplary embodiment of the present invention, when the vehicle-related service includes a payment service, the service provider 155 may provide a payment amount received from an app of a designated user wireless terminal and affiliated store information corresponding to the specific situation. Checking the payment information, including, and performing a payment procedure for processing the payment for the payment information by using the payment means information of the registered user, the payment result corresponding to the payment procedure with the app of the user wireless terminal Information can be provided.

12 is a diagram illustrating a process of providing a context-based vehicle-related service using an in-vehicle camera according to another exemplary embodiment of the present invention.

In more detail, in FIG. 12, when the M apparatus 100 transmits M image information acquired through the M camera units 110 in the vehicle to the operation server 105, the operation server 105 transmits the image. Reads the information to generate recognition information on a specific mark, checks the generated recognition information, checks the position information corresponding to the vehicle position at the time when the specific mark is recognized, and responds to the vehicle driving state for a predetermined time. After confirming the driving state information, and when it is recognized that the specific situation for starting the specified vehicle-related service using the recognition information, location information and the driving state information, showing a process for providing a vehicle-related service, as the present invention Those skilled in the art may refer to and / or modify this drawing 12 to provide context-based vehicle-related services using the in-vehicle camera. Various implementation methods (e.g., some steps may be omitted or the order may be changed) for the provisioning process may be inferred, but the present invention includes all the implementation methods inferred, as shown in FIG. The technical features are not limited only to the implemented method.

12, camera identification information identifying M camera units 110 provided in a vehicle in the vehicle apparatus 100, direction identification information identifying a direction that the M camera units 110 are directed to, and The in-vehicle camera may be stored in a process of associating and storing unique identification information for identifying a vehicle having the M camera units 110 in a designated storage area of the vehicle apparatus 100 associated with the M camera units 100. The situation-aware vehicle-based service providing process may be started (1200).

At least one of the camera identification information and the direction identification information may be identified or included in the image information in association with the image information.

Alternatively, at least one of the camera identification information and the direction identification information may be identified or included in the recognition information in association with the recognition information.

The unique identification information includes a vehicle number, a unique identification value uniquely assigned to a vehicle for a vehicle-related service, a unique identification value included in a wireless signal transmitted through a signal transmitter connected to a cigar jack of a vehicle, and uniquely assigned to a vehicle device. It may include at least one of the identification value.

In addition, the unique identification information is a unique identification number of the user wireless terminal, the app installed in the user wireless terminal when the vehicle device 105 includes a user wireless terminal or the user wireless terminal is used for the vehicle-related services. At least one of the uniquely assigned app identification value may be further included.

The vehicle apparatus 100 requests to store and store unique identification information identifying a vehicle having the M camera units 110 in a storage medium of a designated operation server 105 (1205), and the operation server 105 ) Registers the unique identification information with a designated storage medium for identifying the vehicle or providing a vehicle related service for the vehicle (1210).

In operation 1215, the operation server 105 stores one or more context setting information that is set to start a vehicle related service based on a specified context awareness on a designated storage medium.

The context setting information includes location area information for setting a specific location area related to a specified vehicle related service, range setting information for setting an inside or outside of a location area related to a specified vehicle related service, and a reference location for a specified vehicle related service. Distance setting information for setting the distance, boundary setting information for setting the distance away from the boundary of the location area associated with the specified vehicle-related services, driving conditions of the specified road (highway, automobile road, national road, local road, rear road, etc.) At least one position-related situation setting information of the driving condition information to be set, and driving-related setting at least one of a parking state, a stop state, a slow state, a road running state, and a driving speed range of the vehicle for starting a specified vehicle-related service. Status setting information and the camera inside the vehicle to start the designated vehicle related service The via may comprise a marker relevant circumstances to set specific conditions setting information corresponding to the specific marker that is the basis of the image information taken in the chosen direction.

Here, the marker-related situation setting information, the location information identified through the operation server 105 satisfies at least one location-related situation setting information, the driving state information confirmed by the operation server 105 is at least one driving Includes marker setting information for setting to determine that the specified specific situation has occurred when recognizing the specific marker from the image information photographed in the specified direction through the camera unit 110 inside the vehicle in a situation that satisfies the relevant situation setting information. Can be.

In operation 1220, the vehicle apparatus 100 obtains M image information about a designated direction of the outside of the vehicle, which has been oriented photographed through the M camera units 110 provided in the vehicle.

Herein, the M cameras 110 exclude a camera unit (eg, an internal photographing camera of a black box device) photographing the inside of the vehicle, and the front camera unit facing the front direction of the vehicle and the rear direction of the vehicle. At least one camera unit among at least one camera unit among a rear camera unit facing the side, a side camera unit facing the side of the vehicle, and a mirror camera unit provided at the side mirror of the vehicle; Shoots directed to each designated direction.

The vehicle apparatus 100 transmits the obtained M pieces of image information to the operation server 105 together with the unique identification information identifying the vehicle (1225).

When the M image information is received from the vehicle apparatus 105 (1230), the operation server 105 reads the received M image information, and among the N (N≥1) marks designated for situation recognition. Recognition information including n marker information recognizing n (1 ≦ n ≦ N) specific markers included in m (1 ≦ m ≦ M) image information is generated (1235).

Here, the N markers may be a stop line, a parking line, a lane, a letter, a number, a symbol, a pattern, a pattern, a bar code, a 2D code, or a letter displayed on a panel mounted or mounted on a floor. , Symbols, glyphs, patterns, barcodes, 2D codes, letters on the wall, numbers, symbols, glyphs, patterns, barcodes, 2D codes, letters on the wall or mounted panels, numbers, symbols, glyphs, patterns , Bar codes, 2D codes, letters, numbers, symbols, patterns on one side of designated vehicle target service devices, patterns, barcodes, 2D codes, letters, numbers, symbols on panels attached to one side of designated vehicle target service devices It may include one or more of a, pattern, pattern, barcode, 2D code.

The identification information including the n pieces of marker information may include marker information including marker identification information identifying a specific marker, marker information including at least one of character information, numeric information, and symbol information corresponding to the specific marker. N mark information recognized through m image information among mark information including at least one of a glyph information and a pattern information corresponding to the mark, and mark information encoded in a specific mark in the form of a barcode or 2D code. Can include

When the n specific marks are recognized and the recognition information is generated, the operation server 105 checks the position information corresponding to the vehicle position at the time when the n specific marks are recognized (1240).

Here, the position information corresponding to the vehicle position at the time when the n specific markers are recognized is located in the vehicle positioning device (100) not shown separately in connection with the M camera units 110. It may include the location information measured through).

When the location information corresponding to the vehicle position at the time of recognizing the n specific marks is confirmed, the operation server 105 corresponds to the vehicle driving state for a predetermined time based on the time at which the n specific marks are recognized. The driving state information (eg, parking state information, stop state information, slow state information below a designated reference speed, road running state information, driving speed information, etc.) is checked (1245).

When the driving state information is confirmed, the vehicle apparatus 100 determines whether the location information satisfies at least one location-related context setting information (1250).

If the location information satisfies at least one piece of location-related situation setting information, the operation server 105 checks whether the driving state information satisfies at least one piece of driving-related situation setting information designated to start a designated vehicle-related service. Determine (1255).

If the driving state information satisfies at least one piece of driving related situation setting information, the operation server 105 reads n pieces of marker information included in the recognition information based on the mark related situation setting information and designates the vehicle. Recognize a specific situation for initiating a related service (1260).

When the specific situation is recognized as described above, the operation server 105 performs a procedure for providing the disclosed vehicle-related service (1265).

Here, the vehicle-related service may include a payment service, the operation server 105 checks the payment information including the payment amount and merchant information received from the vehicle-targeted service device corresponding to the specific situation, By performing a payment procedure for processing payment for the payment information using payment means information of a registered user, payment result information corresponding to the payment procedure may be provided to the vehicle target service device.

Alternatively, when the vehicle-related service includes a payment service, the operation server 105 is connected with the M camera units 110 and the payment amount received from the vehicle apparatus 100 provided in the vehicle and the specific situation. Check payment information including affiliate store information corresponding to the payment information, and perform a payment procedure of processing payment for the payment information using previously registered payment means information of the user; Payment result information corresponding to may be provided.

Alternatively, when the vehicle-related service includes a payment service, the operation server 105 checks payment information including a payment amount received from an app of a designated user wireless terminal and affiliated store information corresponding to the specific situation, By performing a payment procedure for processing payment for the payment information by using the payment means information of the registered user, it is possible to provide the payment result information corresponding to the payment procedure to the app of the user wireless terminal.

100: vehicle device 105: operating server
110: camera unit 115: image acquisition unit
120: mark recognition unit 125: position confirmation unit
130: status check unit 135: information storage unit
140: information transmitter 145: information receiver
150: situation recognition unit 155: service provider
`60: setting information storage unit

Claims (30)

A method executed by a system including M (M≥1) camera units provided inside a vehicle in a direction specified to the outside of the vehicle, the method comprising:
A first step of acquiring M image information obtained by directing a predetermined direction of the outside of the vehicle through the M camera units provided in the vehicle;
The mark recognition unit reads the obtained M pieces of image information, and includes n (1 ≦ n ≦ N) pieces of m (1 ≦ m ≦ M) pieces of image information among the N (N ≧ 1) marks designated for situation recognition. A second step of generating recognition information including n pieces of marker information recognizing a specific mark;
When the n specific marks are recognized, the location checker checks the location information corresponding to the vehicle position at the time when the n specific marks are recognized, and the state checker is fixed based on the point of time when the n specific marks are recognized. A third step of confirming driving state information corresponding to the driving state of the vehicle during the time;
A situation recognition unit for recognizing a specific situation for starting a specified vehicle-related service by linking and analyzing the recognition information, location information, and driving state information based on the situation setting information set to start a vehicle-related service based on the situation-aware situation specified 4 steps; And
And a fifth step of performing, by the service provider, a procedure of providing the disclosed vehicle related service when the specific situation is recognized.
The method of claim 1, wherein the M camera unit,
A front camera unit facing the front of the vehicle,
Rear camera unit facing the rear of the vehicle,
A side camera unit facing the side of the vehicle,
Method for providing a vehicle-related service based on situational awareness using an in-vehicle camera, characterized in that it comprises at least one camera unit of the mirror camera unit provided in the side mirror of the vehicle.
The method of claim 1,
The information storage unit stores the camera identification information for identifying the M camera units provided in the vehicle and the direction identification information for identifying the direction in which the M camera units are directed in a designated storage area of the vehicle apparatus associated with the M camera units. Method for providing a context-based vehicle-related service using an in-vehicle camera, characterized in that it further comprises the step of.
The method of claim 3, wherein at least one of the camera identification information and the direction identification information,
Method for providing a vehicle-related service based on context recognition using an in-vehicle camera, characterized in that it is confirmed in connection with the image information or included in the image information.
The method of claim 3, wherein at least one of the camera identification information and the direction identification information,
Method for providing a vehicle-related service based on situational awareness using an in-vehicle camera, characterized in that it is confirmed in connection with the recognition information or included in the recognition information.
The method of claim 1,
And storing the unique identification information for identifying the vehicle having the M camera units in a designated storage area of the vehicle apparatus associated with the M camera units. How to provide awareness-based vehicle-related services.
The method of claim 6, wherein the unique identification information,
In the case of transmitting at least one of the image information, recognition information, location information, driving state information from the vehicle device to the operation server through the communication network and the vehicle is characterized in that it is transmitted to the operation server A method of providing a vehicle related service based on context awareness using a camera.
The method of claim 6, wherein the unique identification information,
At least one of a vehicle identification number, a unique identification value uniquely assigned to the vehicle for a vehicle related service, a unique identification value included in a radio signal transmitted through a signal transmitter connected to the cigar jack of the vehicle, and a unique identification value uniquely assigned to the vehicle device Method for providing a context-based vehicle-related service using an in-vehicle camera, characterized in that made.
The method of claim 8, wherein the unique identification information,
When the vehicle device includes a user wireless terminal or when the user wireless terminal is used for the vehicle related service, at least one of a unique identification number of the user wireless terminal and an app identification value uniquely assigned to an app installed in the user wireless terminal. Method for providing a context-based vehicle-related service using an in-vehicle camera, characterized in that further comprises.
The method of claim 1,
Method for providing a service related to the situation-based vehicle using the in-vehicle camera, characterized in that the information storage unit further comprises the step of registering and storing the unique identification information for identifying the vehicle having the M camera unit in the storage medium of the designated operation server .
The method of claim 10, wherein the unique identification information,
The situation-based vehicle-related service providing method using an in-vehicle camera, characterized in that used to identify the vehicle or provide the vehicle-related services in the operation server.
The method of claim 1, wherein the N markers,
Stop lines, parking lines, lanes,
Letters, numbers, symbols, patterns, patterns, barcodes, 2D codes,
Letters, numbers, symbols, patterns, patterns, barcodes, 2D codes,
Letters, numbers, symbols, patterns, patterns, barcodes, 2D codes,
Letters, numbers, symbols, patterns, patterns, barcodes, 2D codes,
Letters, numbers, symbols, patterns, patterns, barcodes, 2D codes,
Service related to a situational awareness-based vehicle using an in-vehicle camera, comprising one or more of letters, numbers, symbols, patterns, patterns, barcodes, and 2D codes displayed on a panel attached to one surface of a designated vehicle target service device How to Provide.
The method of claim 12, wherein the vehicle target service device,
Providing a service related to a situation-based vehicle using an in-vehicle camera, characterized in that it comprises at least one device of a gas station at a gas station, a charger at a charging station, a parking machine at a parking lot, and a toll gate device provided at a road. Way.
The method of claim 1, wherein the recognition information,
Marker information including marker identification information identifying a particular marker,
Marker information including at least one of character information, numeric information, and symbol information corresponding to a specific marker,
Marker information including at least one of a glyph information and a pattern information corresponding to a specific mark,
Service related to a situation-based vehicle using a situational camera using an in-vehicle camera, characterized in that it comprises n marker information recognized through m image information among the marker information including code information encoded in a specific marker in the form of a barcode or 2D code. How to Provide.
The method of claim 1, wherein the location information,
Method for providing a context-based vehicle-related service using the in-vehicle camera, characterized in that the location information is located through the positioning unit of the vehicle apparatus provided in the vehicle in association with the M camera unit.
The method of claim 1, wherein the driving state information,
Method for providing a vehicle-related service based on situation recognition using an in-vehicle camera, characterized in that it comprises at least one of parking status information, stop status information, slow status information below a specified reference speed, road running status information, driving speed information.
The method of claim 1, wherein the situation setting information is
Location area information for setting a specific location area related to a specified vehicle-related service, range setting information for setting an inside or outside of a location area related to a specified vehicle-related service, and distance for setting a distance from a reference location related to a specified vehicle-related service Location-related situation setting information of at least one of setting information, boundary setting information for setting a distance spaced from a boundary of a location area associated with a specified vehicle-related service, and driving condition information for setting a specified road driving situation;
Driving related situation setting information for setting at least one of a parking state, a stopping state, a slowing state, a road running state, and a driving speed range of a vehicle for starting a specified vehicle related service;
In-vehicle camera, characterized in that it comprises a marker-related context setting information for setting a specific situation corresponding to a specific mark recognized from the image information photographed in the designated direction through the camera unit inside the vehicle to start the specified vehicle-related service Method for providing a vehicle-related service based on context awareness.
The method of claim 17, wherein the marker-related context setting information,
When the location information satisfies the at least one location-related situation setting information and the driving state information satisfies the at least one driving-related situation setting information, a specific mark is obtained from the image information photographed in a designated direction through a camera unit inside the vehicle. Method for providing a context-based vehicle-related service using the in-vehicle camera, characterized in that it comprises a marker setting information for setting to determine that the specified specific situation occurs when recognizing.
The method of claim 17, wherein the fourth step,
Determining, by the situation recognizing unit, whether the location information satisfies at least one location related situation setting information, and determining whether the driving state information satisfies at least one piece of driving related situation setting information designated to start a designated vehicle related service; ;
N when the location information satisfies at least one piece of position related situation setting information and the driving state information satisfies at least one piece of driving related situation setting information, n included in the recognition information based on the marker related situation setting information. Recognizing a specific situation for starting the designated vehicle-related service by reading the dog marker information, the situation-based vehicle-related service providing method using the in-vehicle camera, characterized in that it comprises.
The method of claim 1, wherein the fifth step is
If the vehicle-related service includes a payment service,
Confirming, by the service provider, payment information including payment amount and affiliated store information received from the vehicle-targeted service device corresponding to the specific situation;
Performing a payment procedure of processing the payment for the payment information by using the payment means information of the user which is previously registered by the service provider; And
And providing, by the service providing unit, payment result information corresponding to the payment procedure to the vehicle target service device.
The method of claim 1, wherein the fifth step is
If the vehicle-related service includes a payment service,
Confirming, by the service providing unit, payment information including payment amount received from a vehicle apparatus provided in the vehicle and affiliated store information corresponding to the specific situation in association with the M camera units;
Performing a payment procedure of processing the payment for the payment information by using the payment means information of the user which is previously registered by the service provider; And
And providing, by the service providing unit, payment result information corresponding to the payment procedure to the vehicle device.
The method of claim 1, wherein the fifth step is
If the vehicle-related service includes a payment service,
Confirming payment information including a payment amount received from an app of a designated user wireless terminal and affiliated store information corresponding to the specific situation;
Performing a payment procedure of processing the payment for the payment information by using the payment means information of the user which is previously registered by the service provider; And
And providing, by the service providing unit, payment result information corresponding to the payment procedure to the app of the user's wireless terminal.
The method of claim 1,
The image acquisition unit, the marker recognition unit, the position determination unit, the state confirmation unit, the situation recognition unit, and the service providing unit, the vehicle interior, characterized in that implemented through the vehicle device provided inside the vehicle in connection with the M camera unit A method of providing a vehicle related service based on context awareness using a camera.
The method of claim 1,
The image acquisition unit, the marker recognition unit, the position determination unit, the state confirmation unit, and the situation recognition unit are implemented through a vehicle apparatus provided in the vehicle in association with the M camera units,
The service providing unit, the situation-based vehicle-related service providing method using an in-vehicle camera, characterized in that implemented through the operation server to communicate with the vehicle device.
The method of claim 1,
The image acquisition unit, the marker recognition unit, the positioning unit and the state confirmation unit are implemented through a vehicle apparatus provided in the vehicle in association with the M camera units,
The situation recognition unit and the service providing unit, the situation-based vehicle-related service providing method using an in-vehicle camera, characterized in that implemented through the operation server to communicate with the vehicle device.
The method of claim 1,
The image acquisition unit, the marker recognition unit, and the positioning unit are implemented through a vehicle apparatus provided in the vehicle in association with the M camera units,
And the status checking unit, the situation recognizing unit, and the service providing unit are implemented through an operation server communicating with the vehicle apparatus.
The method of claim 1,
The image acquisition unit and the marker recognition unit is implemented through a vehicle device provided in the vehicle in association with the M camera units,
And the position checking unit, the state checking unit, the situation recognizing unit, and the service providing unit are implemented through an operation server communicating with the vehicle apparatus.
The method of claim 1,
The image acquisition unit is implemented through a vehicle device provided in the vehicle in association with the M camera units,
The marker recognition unit, the location check unit, the state check unit, the situation recognizer and the service provider, the situation-based vehicle-related service providing method using an in-vehicle camera, characterized in that implemented through the operating server to communicate with the vehicle device .
The method of claim 1,
The image acquisition unit, the marker recognition unit, the position determination unit, the state confirmation unit, the situation recognition unit, and the service providing unit are implemented through an operation server that communicates with the vehicle apparatus provided in the vehicle in association with the M camera units. Method for providing a vehicle related service based on situational awareness using an in-vehicle camera.
In the system comprising M (M≥1) camera unit provided in the vehicle in a direction directed toward the outside of the vehicle,
An image acquisition unit for acquiring M image information obtained by directing a predetermined direction of the outside of the vehicle through the M camera units provided in the vehicle;
M (1 ≦ n ≦ N) specific markers included in m (1 ≦ m ≦ M) image information among the N (N ≧ 1) markers designated for situation recognition by reading the obtained M image information. A marker recognition unit generating recognition information including recognized n marker information;
A position checking unit for checking position information corresponding to the vehicle position at the time when the n specific marks are recognized;
A state checking unit for checking driving state information corresponding to a driving state of the vehicle for a predetermined time based on the time point at which the n specific marks are recognized;
A specific situation for starting a specified vehicle related service by analyzing the recognition information, location information, and driving state information based on S (S≥1) context setting information set to start a vehicle related service based on a specified situation awareness. Situation recognizer for recognizing; And
And a service provider configured to perform a procedure for providing the vehicle related service.

Images