KR20200064387A - Apparatus for providing transportation passengers customized digital signage systems - Google Patents

Abstract

The present invention relates to a system for providing customized advertising to set a customer group based on information on passengers and efficiently provide information and content with high utility. In addition, the present invention relates to a customized digital signage system for passengers on a transport means enabling an advertiser to pay an advertising rate at no extra charge and a transport means owner, an advertising business owner, and an advertisement server manager to reasonably distribute paid costs.

Description

How digital signage systems customized for transportation passengers perform {Apparatus for providing transportation passengers customized digital signage systems}

The present invention relates to a method performed by a customer-customized digital signage system for a vehicle passenger, and more specifically, a disadvantage in focusing on unilaterally delivering a message to a consumer in delivering advertisements to a conventional vehicle passenger. However, the present invention relates to a method performed by a customer-customized digital signage system for a vehicle passenger that can easily provide a customized advertisement based on the information of the passenger when the passenger boards the vehicle.

With the advancement of science in wireless communication and data processing technology, mobile advertisement service technology using a wireless network function is developing at a rapid rate, and its frequency of use is also increasing. Accordingly, a digital signage technology that provides outdoor advertising using a digital information display has been developed and serviced.

Digital signage technology means a billboard that can control the content of advertisements in the control center through a communication network, and is divided into outdoor type and indoor type based on the installation location of the billboard.

In the past, technology for providing advertisements using digital signage technology has been developed and serviced to passengers of transportation such as buses, subways, taxis, railways, and airplanes.

However, conventional technologies have a problem in that the number of advertisements that can be screened is limited in repetitive screening of a video advertisement to an unspecified number of people according to a predetermined schedule or simultaneously.

In addition, the technology that is currently being serviced is designed to prepay the high priced advertisement fee when the advertisement fee is set based on the grade according to the location of the advertisement medium, the screening time, and the like, which increases the burden on the advertiser. For this reason, there is a problem in that it is difficult to expand the base for local advertisers.

In addition, there is a problem of inefficiently operating the advertisement providing system because the result of the advertisement is not active and specific feedback, such as the number of users of the advertisement, gender, age, etc.

In the domestic registration utility model No. 20-0207307 ("automobile display device", hereinafter, prior document 1), a vehicle display device capable of providing various information to a boarding passenger is disclosed. The prior document 1 includes a liquid crystal monitor formed on the rear surface of the front sheet, an image processing apparatus displaying an image on the liquid crystal monitor, and an image driving apparatus driving the liquid crystal monitor and the image processing apparatus, and has an expected effect. By installing a liquid crystal monitor mounted on the rear of the headrest of the front seat on a commercial vehicle, etc., it has the feature of providing corporate advertisements, recent news or weather or road training information to passengers on board.

In Korean Patent No. 10-1552277 ("Mobile Taxi-Based Real-Time Advertising System", hereinafter referred to as Reference Document 2), each passing through each area divided by administrative area through a driving taxi, unique festivals and special products belonging to that area, Through means of exposing the publicity of tourist attractions, cultural properties, shops, and manufacturers in the form of advertisements, it is possible to see countless pedestrians around taxis driving and has the characteristic of providing maximized advertising and promotion effects to local companies. .

However, even with the prior documents 1 and 2, it has not solved the problem of advertiser-oriented advertisement delivery, which provides advertisements to consumers unilaterally.

Domestic registered utility model No. 20-0207307 Domestic registered patent No. 10-1552277

An object of the present invention is to provide a customized advertisement to efficiently provide information and contents with high utility by setting a customer group based on information of a vehicle passenger.

In addition, the purpose of the present invention is to propose a method for a customer-friendly digital signage system for a vehicle occupant capable of reasonably distributing an advertisement fee by an advertiser and reasonably distributing the paid expenses by a vehicle operator, an advertisement operator, and an advertisement server manager. Is done.

A method of performing a digital signage system customized for a vehicle passenger according to an embodiment of the present invention includes: (a) performing image recognition through a camera; (b) setting a customer group according to image recognition; (c) matching pre-stored advertisements according to the set customer group; And (d) sending the matched advertisement to the display.

In addition, the step (b) includes: when recognizing two or more images, determining whether there are pre-stored images; And excluding the pre-stored image if it is found as a result of the determination.

In addition, the step (b): after the step of excluding, if there are two or more images as a result of recognition even after the step of excluding, separately distinguishing the customer group for each of the two or more images; Can be.

In addition, the step (b) further comprises: setting a customer group according to voice recognition, and when setting the customer group according to the image recognition, real-time face recognition technology robust against environmental changes using deep learning from the recognized image information Through, through the consideration of lighting, pose, facial expression, and accessories changes, including the step of recognizing the gender and age information of the passenger, or setting a customer group through voice recognition information including frequency and tone from the recognized voice information, Real-time face recognition technology that is robust against environmental changes using deep learning extracts at least 6 to 68 points from the recognized face to detect landmarks of image information, and processes the extracted landmark information through normalization, It may be characterized by extracting a CNN (Convolution Neural Network) feature based on the processed information.

In addition, step (c) includes: matching the region of interest and the service of interest estimated in correspondence with the customer group set in step (b); And releasing the matched region of interest and the service of interest if the current location is determined outside the predetermined administrative area as a result of the determination.

In addition. The step (c) is: For the customer group SET grouping two or more customer groups separately identified in the step (b), setting an optimal group customer group estimating the relationship between the two or more customer groups according to a predetermined relationship standard criterion step; And matching the pre-stored optimal interest service corresponding to the optimal group of customer groups.

In addition, after the step of sending, claiming the total amount of advertising costs per unit time according to the advertisement sent to the advertiser; And distributing the total amount of the advertised bill to the management server manager, the vehicle operator, and the advertiser.

In addition, the step (a) may be characterized in that the image recognition is performed only when a new image is received through the camera.

In addition, after the sending, displaying a QR code of the product or service of the sent advertisement for camera shooting when a touch signal is input for the product or service of the sent advertisement; And displaying a coupon or reservation service related to the product and service of the transmitted advertisement.

In addition, the step (c) may include: predicting a driving route of the transportation means in consideration of a driving direction of the transportation means, location and time information of the transportation means; And matching the pre-stored advertisement by searching for advertisements to be transmitted and scheduling in chronological order in consideration of the set customer group and the predicted driving route.

According to an embodiment of the present invention, a customized advertisement may be provided to efficiently provide information and contents having high utility by setting a customer group based on passenger information.

In addition, according to an embodiment of the present invention, the advertiser can pay the advertisement fee casually, and the paid operator can be reasonably distributed by the vehicle operator, the management server administrator, and the advertisement operator.

1 is a block diagram illustrating a method performed by a customer-customized digital signage system for a vehicle occupant of the present invention.
FIG. 2(a) is a block diagram showing a management server among components constituting a method performed by a customer-customized digital signage system for a vehicle occupant of the present invention.
FIG. 2(b) is a block diagram showing a vehicle terminal among components constituting a method performed by a customer customized digital signage system for a vehicle passenger of the present invention.
3 is a block diagram illustrating a determination module of a vehicle terminal among components constituting a method performed by a customer-customized digital signage system for a vehicle passenger of the present invention.
4 is a flowchart illustrating a method for providing customized advertisement in a method performed by a customer-customized digital signage system for a vehicle passenger of the present invention.
5 is a flowchart illustrating a method of distributing advertisement charges in a method performed by a customer-customized digital signage system for a vehicle occupant of the present invention.
6 is an embodiment of a method of determining a current location of a vehicle according to a location check module and matching advertisement content in a method performed by a method performed by a customer-customized digital signage system for a vehicle passenger of the present invention. .
7 is an embodiment of a method of presenting a customized advertisement to a vehicle passenger in a method performed by a customer-customized digital signage system for a vehicle passenger of the present invention.
8 is an embodiment showing a method of extracting information of a vehicle passenger using a real-time face recognition technology robust to environmental changes using deep learning in a digital signage system customized for a vehicle passenger of the present invention.
9 is a block diagram showing a determination module of a taxi terminal among components constituting a method performed by a customer customized digital signage system for a taxi passenger among the transportation means of the present invention.
10 is a flow chart showing a method of providing a customized advertisement in a method performed by a customer-customized digital signage system for taxi passengers among transportation means of the present invention.
11 is a flow chart showing a method of determining a customer group of passengers in order to provide a customized advertisement in a method performed by a customer-customized digital signage system for taxi passengers among transportation means of the present invention.

Other advantages and features of the present invention and methods for achieving them will be made clear by referring to embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only the present embodiments allow the disclosure of the present invention to be complete, and the common knowledge in the technical field to which the present invention pertains. It is provided to fully inform the holder of the scope of the invention, and the invention is only defined by the scope of the claims.

If not defined, all terms (including technical or scientific terms) used herein have the same meaning as generally accepted by universal technology in the prior art to which this invention belongs. Terms defined by general dictionaries can be interpreted as having the same meaning as related to the description and/or text of the present application, and are not conceptualized or over-formally interpreted, even if not explicitly defined herein. Will not.

The terminology used herein is for describing the embodiments and is not intended to limit the present invention. In the present specification, the singular form also includes the plural form unless otherwise specified in the phrase. As used herein,'includes' and/or various conjugations of this verb, such as'includes','includes','includes','includes', etc., refer to the mentioned composition, ingredients, components, The steps, operations and/or elements do not exclude the presence or addition of one or more other compositions, ingredients, components, steps, operations and/or elements. The term'and/or' in this specification refers to each of the listed configurations or various combinations thereof.

Meanwhile, terms such as'~ unit','~ group','~ block', and'~ module' used throughout this specification may mean a unit that processes at least one function or operation. For example, it can mean a hardware component such as software, FPGA or ASIC. However,'~bu','~gi','~block', and'~module' are not limited to software or hardware. The'~unit','~gi','~block', and'~module' may be configured to be in an addressable storage medium or may be configured to play one or more processors.

Accordingly, as examples,'~unit','~gi','~block', and'~module' are components such as software components, object-oriented software components, class components and task components. Fields, processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, database, data structures, tables, arrays and Includes variables. Components and functions provided in'~unit','~gi','~block', and'~module' have a smaller number of components and'~unit','~gi','~block It can be combined with','~modules', or can be further separated into additional components and'~units','~gi','~blocks', and'~modules'.

Hereinafter, embodiments of the present invention will be described in more detail with reference to the accompanying drawings.

1 is a block diagram illustrating a method performed by a customer-customized digital signage system for a vehicle occupant of the present invention.

As shown, an embodiment of a method performed by a customer-customized digital signage system for a vehicle occupant of the present invention includes a management server 100, an advertisement operator 200, an advertiser 300, and a vehicle operator 400, It is made of a vehicle terminal (500).

The management server 100 is a method of performing a digital signage system customized for a vehicle passenger, a management server that stores advertisement contents, customer group information, and administrative area information sent to the vehicle terminal and is operated by a management server administrator. At (100), the advertisement operator 200 may apply for advertisement to the management server manager, and deliver the advertisement content of the product or service to be advertised to the management server manager.

In addition, the vehicle operator 400 may receive information related to the operation of the vehicle from the management server 100 and, if desired, may request the vehicle management information from the management server administrator.

At this time, the vehicle operator 400 refers to a person who uses and operates transportation such as a bus, subway, taxi, or private vehicle, and the vehicle operator 400 is a vehicle terminal 500 from a vehicle terminal 500 Real-time location information, such as GPS (Global Positioning System) or a digital driving recorder (DTG) can be obtained through the transport operation information that can be obtained.

The transport operator 400 may obtain information by requesting the management server 100 manager if information other than information that can be obtained through a global positioning system (GPS) or a digital driving recorder (DTG) is required. have.

The vehicle terminal 500 may transmit matched advertisement information according to the customer group information to which the vehicle occupant belongs or the current location of the vehicle based on the information stored in the vehicle terminal and the information of the determination module.

The management server 100 is a computing device that can be connected to a network to send and receive data, and includes, for example, personal computers such as desktops and laptops, but is not limited thereto, and includes various types of terminal devices such as tablet PCs and smart devices.

The advertiser 200 is an entity that receives and receives advertisements from the advertiser 300 and operates and manages advertisements. The advertiser 200 is the type and advertisement of transmitted advertisements received by the management server 100 from the vehicle terminal 500 The number of times of delivery and the time of delivery can be received. The advertiser 200 may settle the advertisement cost so that the vehicle operator, the management server manager, and the advertisement operator can distribute the advertisement cost rationally based on the advertisement operation information received from the management server 100.

Advertiser 300 refers to a subject that inputs advertising content produced to promote their products or services, for example, local advertisers or local small and medium-sized businesses and small and medium-sized businesses, hospitals, and academies that aim to perform sales/marketing on a regional scale. Advertisement contents of the service industry such as the restaurant industry and various convenience facilities may be applied to the advertisement business owner 300 for advertisement operation. At this time, the advertisement content delivered to the advertiser 300 may be not only advertisements, but also video or audio contents such as entertainment broadcasts and movies.

The vehicle terminal 500 is installed inside the vehicle and uses transportation means or advertisements from the vehicle operator 400 or the management server 100 that uses and operates transportation vehicles such as buses, subways, taxis, and cars. You can receive relevant information.

In addition, the vehicle terminal 500 may transmit information such as transportation information of the vehicle, the number of passengers boarding, the number of advertisement reproduction, and the number of days of vehicle operation by company or region, to the vehicle operator 300 or the management server 100, In addition, GPS (Global Positioning System) or digital driving recorder (DTG) information, such as the vehicle's running speed, engines per minute, brake usage records, and location information, can also be transmitted.

For information such as the operation information of the transportation means transmitted to the management server 100, the number of passengers boarding, the number of advertisement reproduction, and the number of days of vehicle operation by company and region, the vehicle terminal 500 is the vehicle operator 400's garage. It can be sent to the management server 100 when wearing as. Operation information is transmitted to the management server 100 may be transmitted more than once a day.

Additionally, the vehicle terminal 500 may include at least one camera 501. It is possible to determine the overall degree of change of the image through the camera, and compares the image of the seat in the absence of a passenger with the image of the empty seat in the case of a passenger on a transportation vehicle to determine the degree of change in the seat image to determine the degree of change in the image. Based on, it can be determined whether the passenger has boarded.

In addition, based on the image information of the vehicle occupant obtained through the camera, it is possible to determine the age and gender of the vehicle occupant using real-time face recognition technology that is robust to environmental changes using deep learning.

The real-time face recognition technology that is robust against environmental changes using the deep learning can be applied to both general CCTV cameras and low-cost USB camera environments, and automatically detects faces of 1,000 domestic or foreign faces, gender and age recognition libraries, and source codes. Register and conduct learning.

The real-time face recognition technology that is robust to environmental changes using the deep learning is capable of real-time face detection and recognition of more than 1 to 5 frames per second in a computing environment with a general specification of 640x480 pixels, detecting a 68-point landmark and tracking gaze based on it This is possible.

Therefore, based on real-time face recognition technology that is robust against environmental changes using the deep learning, it is possible to automatically detect the inside and outside faces of passengers in transportation, and recognize gender and age.

2 (a) is an exemplary block diagram for explaining a management server 100 system according to an embodiment of the present invention.

Referring to FIG. 2 (a), the management server 100 includes a communication module 110, a processing module 120, an advertisement cost setting module 130, and a database 140.

The communication module 110 may transmit advertisement content to the vehicle terminal 500 installed in the vehicle, receive image information of the passenger from the vehicle terminal 500 and transmit the determined result based on the image information. have.

The processing module 120 may process information transmitted and received from the advertisement salesman 200, the vehicle salesman 400, and the vehicle terminal 500 to the management server 100 and store the information in the database 140. have.

Advertisement cost setting module 130, information such as the number of times the advertisement is played, the number of days of transportation operations by company, region, etc., for advertisement content or entertainment content sent from the advertisement matching module 530 of the vehicle terminal 500 to the vehicle passenger It is a module that sets the advertisement cost by receiving. The advertisement cost may be determined by the number of times the advertisement is sent, the duration of the advertisement, and the like, and the advertisement cost calculated based on the information is charged by the advertisement operator 200 to the advertiser 300, and the advertiser 300 is the advertisement operator You can settle for a postpay of (200).

In addition, the advertisement cost setting module 130 may distribute the advertisement cost at a predetermined rate by the management server manager, the vehicle operator, and the advertisement sales agent. For example, when the management server administrator distributes the advertisement fee at a constant rate of 10% of the total advertisement fee, 10% of the total advertisement fee by the transport operator, and 80% of the total advertisement fee by the advertisement operator, the advertisement fee is automatically allocated according to each specified rate. Advertising expenses revenue is distributed.

2 (b) is an exemplary block diagram for explaining a vehicle terminal 500 according to an embodiment of the present invention.

The vehicle terminal 500 includes a transmission/reception module 510, a determination module 520, an advertisement matching module 530, and a database 540.

The transmission/reception module 510 transmits advertisement information to the management server 100 and

The determination module 520 analyzes the image information to determine whether the passenger has boarded the vehicle, and uses the real-time face recognition technology robust to environmental changes using deep learning based on the image information to determine the age and gender of the vehicle passenger. And the passenger group to which the passenger is concerned can be determined.

In addition, the GPS information of the vehicle terminal can be used to grasp the real-time location of the vehicle, and to determine the administrative information of the area where the vehicle is currently operating.

In addition, the determination module 520 includes a location check module 521 and an image determination module 523.

The advertisement matching module 530 matches a customized advertisement to a vehicle passenger. The advertisement module or entertainment content suitable for the gender and age of the passenger is searched for and matched based on the customer group information of the vehicle passenger and the current time and location information determined through the determination module 520.

Additionally, in addition to searching and matching advertisement content or entertainment content suitable for the gender and age of the passenger, the advertisement matching module 530 designates an advertisement delivery schedule by designating the order and frequency of transmitting the corresponding advertisement content or entertainment content. You can also write.

3 is an exemplary block diagram for explaining the determination module 520 of the vehicle terminal 500 according to an embodiment of the present invention.

The location check module 521 can easily obtain current location information by using the GPS function of the vehicle terminal 500. The location check module 521 may monitor the current location of the vehicle in real time and transmit the information to the vehicle operator.

In addition, it is possible to determine the administrative area of the area where the vehicle is currently located according to the current location information obtained through the GPS. The administrative area information may be a criterion for matching advertisements when the advertisement matching module 530 provides a customized advertisement to a vehicle passenger.

In addition, the advertisement stored in the database 540 of the vehicle terminal 500 may be additionally matched according to the current location information obtained through the GPS to be transmitted or used as a criterion for increasing or decreasing the frequency of exposure.

The image discrimination module 523 can easily acquire image information through the camera 501 included in the vehicle terminal 500. The image discrimination module 523 acquires image information by photographing the vehicle in real time in real time, and compares the image information obtained in real time with the image obtained when there is no passenger and determines the degree of change in order to determine whether the vehicle is on board. do.

When the gradient is increased while acquiring the gradient in real time, the image discrimination module 523 determines that the vehicle has been boarded, and if the gradient is determined to be large and then again determined to be small, it may be determined that the passenger has got off.

In addition, when it is determined that the vehicle is on board, it is possible to determine the number of passengers using the image information of the passenger. When it is determined that one passenger is a passenger, it is possible to determine a customer group including the passenger by determining the age and gender of the passenger in the transportation means by using real-time face recognition technology that is robust to environmental changes using deep learning based on image information.

If there are more than two passengers, the age, gender, etc. of the passengers of the transportation means can be determined by using real-time face recognition technology that is robust to environmental changes using deep learning based on image information for each passenger in the transportation means. By determining, it is possible to determine the customer group in which each passenger is included.

4 is a flowchart illustrating a method for classifying customers using image information according to an embodiment of the present invention. Referring to Figure 4 will be described in detail a method performed by a customer-customized digital signage system for a vehicle passenger according to an embodiment of the present invention.

According to an embodiment of the present invention, a method of performing a digital signage system customized for a vehicle occupant according to an embodiment of the present invention includes image recognition (S110), customer group setting according to image recognition (S120), and set customer group Accordingly, the pre-stored advertisement may be matched (S130), advertisement transmission (S140), DB storage, and data transmission to the management server (S150).

To learn more about each step, the image recognition (S110) step acquires image information through the camera 501 of the vehicle terminal 500 and the image information in the image discrimination module 523 of the determination module 520. It is analyzed to determine whether the passenger is on board.

Here, the results of the image discrimination module 523 may be merged to more accurately determine whether a passenger is on board or not. In addition, when it is determined that the passenger has boarded the vehicle, the image recognition step S110 may analyze the image information of the passenger to determine information such as the age and gender of the passenger of the vehicle.

In the step of setting the customer group according to the image recognition (S120), the customer group of each passenger may be set based on the information of the passengers obtained in the step of the image recognition (S110).

The customer group is set based on information such as the passenger's age, gender, and boarding time. For example, the customer group may be divided into infants or students, college students, 30s and 40s, middle-aged, and older adults, and each age-specific customer group may be classified as female or male.

Each customer group can be classified by region in addition to age and gender, for example, Seoul, Daejeon, Gyeonggi-do, Gangwon-do, Chungcheong-do, Gyeongsang-do, Jeolla-do, and Jeju-do. In addition, each customer group may be classified by country in addition to age and gender, for example, Korea, the United States, China, Japan, and the like. In the setting of the customer group (S120), the customer group of the passenger is set according to the information of the passenger obtained through the video or voice recognition (S110) step among the customer group classification.

The step of matching pre-stored advertisements according to the set customer group (S130) matches pre-stored advertisements or entertainment contents for each customer group according to the customer group of passengers set in the customer group setting (S120).

For example, in the step of setting the customer group (S120), if the passenger is set as a female, middle-aged, Gangnam-gu, or lunchtime, food-related advertisement content such as a restaurant or foodstuff store registered in the database 550 in advance in the Gangnam-gu administrative area can be designated in advance. And match the advertisement content with advertisement content for transmission to the passenger.

The advertisement transmission (S140) step, the matching through the vehicle terminal 500 to the passenger through the step of matching (S130) the advertisement stored in the database 540 of the vehicle terminal 500 according to the set customer group Advertised content can be transmitted.

Information on the number of transmissions of the advertisements transmitted through the advertisement transmission (S140) step, the transmission period, and the like, is stored in the DB, and then transmitted to the management server through the data transmission (S150) step to the database 500 of the vehicle terminal 500 Is saved. Advertisement transmission information stored in the database 500 is transmitted at least once a day through the communication module 110 of the management server 100 when the vehicle is in the garage. The advertisement transmission information delivered to the management server 100 sets the advertisement cost by the advertisement setting module 130 and is stored in the database 140.

In the method performed by the customer-customized digital signage system for a vehicle occupant according to an embodiment of the present invention, the advertiser 200 charges and distributes the advertisement cost calculated by the advertisement cost setting module 130 to the advertiser 300 As shown in FIG. 5, when there is an advertisement transmission, post-billing (S210) the advertisement cost per unit time to the advertiser 300, managing the billed settlement advertisement cost as a server administrator, advertisement operator, and transportation operator It may be made of the step of distributing (S220) at a predetermined rate.

Specifically, for each step, in the case where the advertisement is transmitted, the step of charging the advertiser per unit hour for postpay (S210) is the number and time of advertisements transmitted through the vehicle terminal 500 to the passenger. The information is stored in the database 540 of the vehicle terminal, and when the vehicle is in the garage, the advertisement transmission information is transmitted to the management server 100 through the transmission/reception module 510 of the vehicle terminal 500. .

The transmitted advertisement transmission information is stored in the database 140 of the management server through the communication module 110 of the management server, and the advertisement cost per unit time is set in the advertisement cost setting module 130 of the management server based on the stored advertisement transmission information. Set. The advertiser 200 may charge the set advertisement cost to the advertiser 300.

In addition, in claiming the advertisement fee, the advertiser may pay the advertisement fee as a postpay in order to reduce the burden of the advertisement fee. In the case of using the above method, it is possible to ease the burden on the advertiser's advertising fee, thereby making it easier to expand the base for the advertiser.

The step of distributing the billed and settled advertising costs at a preset rate by the management server manager, the advertising sales operator, and the vehicle transport owner (S220) includes managing the advertising costs set through the step of setting the advertising costs per unit time when the advertisement is sent. It means the distribution by the business owner and the transportation business owner at a predetermined rate.

The predetermined ratio may be determined in advance by a management server manager, an advertising operator, and a vehicle owner, and the advertisement cost setting module 130 automatically adjusts an advertisement cost to each management server administrator, advertisement operator, and vehicle owner according to the determined ratio. Can be distributed.

In determining the current location of the vehicle according to the location check module 121 in the method performed by the customer-customized digital signage system for the vehicle passenger according to an embodiment of the present invention, and matching advertisement content, FIG. As illustrated, the advertisement content for transmission may be matched by reflecting the location information or the administrative area information where the transportation means is located.

6, in more detail, real-time location information of the vehicle can be easily obtained through the GPS function of the vehicle terminal 500, and using the acquired location information, Advertisements can be matched so that advertisements from advertisers located within a 5 km radius of the current location are sent to passengers currently in the transportation mode.

As the real-time location of the vehicle changes, the vehicle terminal 500 may continuously determine the location of the vehicle, and modify the advertisement content delivery schedule created by matching the existing vehicle.

Further, as shown on the right side of FIG. 6, if necessary according to the advertiser's advertisement target setting opinion, the advertisement content is only displayed within the selected administrative region so that the advertiser can separate and divide the administrative region by region to market to the desired consumer. It can be set to be able to transmit.

For example, when an advertiser selects'Seoul' as the advertisement content sending area, it is basically located within a range of 5 km from the current location using real-time location information of the vehicle obtained through the GPS function of the vehicle terminal 500 The advertisement is matched so that the advertiser's advertisement is sent to the passenger who is currently on the transportation means. When it is changed to, it is determined that it is located in the'Seoul', and among the matched advertisement contents, the advertisement contents set to be transmitted only within the'Seoul' can be excluded from the advertisement contents delivery schedule so that it is no longer transmitted.

A method of presenting a customized advertisement to a vehicle passenger in a method performed by a customer-customized digital signage system for a vehicle passenger according to an embodiment of the present invention is included in the vehicle terminal 500 as shown in FIG. Acquire video information through the camera and determine the number of passengers based on the video information.

After determining the age and gender of each passenger based on the determined number of passengers, the customer group is determined for each passenger. If there is only one passenger based on the determined customer group, the customer group is set as the final customer group to match advertisements according to the final customer group.

When the number of passengers is 2 or more, the optimal group group can be set for the customer group SET based on the determined customer group for each passenger, and the group customer group can be set as the final customer group to match advertisements previously stored in the corresponding customer group. have.

In a method of presenting a customized advertisement to a vehicle passenger in a method performed by a customer-customized digital signage system for a vehicle passenger according to an embodiment of the present invention, the location information or an administrative area information of the vehicle currently being reflected is reflected. The advertisement content for transmission may be matched.

Specifically, in matching and scheduling advertisement transmission information, after predicting a route through which the transportation means operates through the transportation route of the transportation means, the database 540 of the transportation terminal 500 is considered in consideration of the predicted route. The advertisement to be sent can be searched in advance.

The advertisement information retrieved by reflecting the predicted route may be searched by reflecting direction information, location information, and time information of a route for which a vehicle operation is predicted. Therefore, it is possible to schedule the advertisement searched in the database 540 of the vehicle terminal 500 by chronological matching according to the expected path of the vehicle.

In transmitting the advertisement according to the step of sending an advertisement (S140) in a method performed by a customer-customized digital signage system for a vehicle occupant according to an embodiment of the present invention, an advertisement product or service in real time while the vehicle occupant sees an advertisement In order to purchase or make a reservation, information of advertisement products or services may be transmitted through a QR code.

Specifically, in order to purchase or reserve the advertisement product or service, an image of the vehicle terminal 500 may be touched, and when a touch signal of a vehicle passenger is input, a QR code is exposed. After photographing the QR code with the camera of the electronic terminal held by the passenger in the transportation means, a link is provided to link the information entered in the QR code with the electronic terminal.

Additionally, a coupon or a reservation service may be separately provided to passengers of the transportation means in addition to the information of the advertisement product or service input in the QR code.

In the method performed by the customer-customized digital signage system for a vehicle passenger according to an embodiment of the present invention, the image discrimination module 523 uses real-time face recognition technology robust against environmental changes using deep learning based on the image information. By detecting the vehicle passenger's face in real time, it is possible to recognize the passenger's gender and age information in real time.

Specifically, the real-time face recognition technology that is robust to environmental changes using deep learning uses real-time face recognition technology, multi-faceted face registration method and gaze tracking technology, which is robust to environmental changes such as lighting, facial expression, pose, and accessory changes using deep learning. It is possible to recognize information such as gender and age of passengers in real time using a running-based Korean gender and age recognition technology.

As shown in FIG. 8, in order to recognize the vehicle occupant, image information is input through the camera 501 of the vehicle terminal 500 and a face portion is detected.

Landmarks of image information are detected by extracting at least 6 to 68 points from the detected face. In addition, the extracted landmark information is processed to analyze image information through normalization, and a convolution neural network (CNN) feature is extracted based on the processed information. The extracted feature information may be stored in big data, and based on the feature information, information of a vehicle passenger may be recognized.

As illustrated in FIG. 9, in one embodiment of the present invention, a customized advertisement may be provided to passengers of a taxi among transportation means. When providing a customized advertisement for taxi passengers, in particular, audio information may be additionally used in addition to the video information. As shown in FIG. 9, the taxi determination module 520` uses the voice discrimination module 525`. It may further include. The voice discrimination module 525` can easily obtain voice information through the microphone included in the vehicle terminal 500` installed in the taxi.

The voice discrimination module 525` acquires voice information inside the taxi in real time, and may be used as information for determining whether or not the passenger is riding. In addition, when two or more voices are included by analyzing the frequency, amplitude, etc. of the acquired voice information, it may be used as information for determining how many people have boarded.

In addition, when it is determined that the passenger is in the taxi, when the passenger is determined to be one using the voice information, information such as the age and gender of the passenger may be determined to determine the customer group including the passenger.

If it is determined that there are two or more passengers, the voice information of each passenger may be divided to determine information such as age and gender for each passenger, thereby determining a customer group including each passenger.

In addition, the voice information of the taxi driver may be extracted in advance, and the voice information of the taxi driver may be excluded and analyzed when determining whether the passenger is boarding. It is possible to perform more accurate analysis of voice information by using voice information from which the taxi driver's voice information is excluded.

As shown in FIG. 10, in one embodiment of the present invention, a customized advertisement may be provided to passengers of a taxi among transportation means. In the case of providing a personalized advertisement for taxi passengers, audio information may be additionally used in addition to video information.

As illustrated in FIG. 11, according to an embodiment of the present invention, a customized advertisement may be provided to passengers of a taxi among transportation means. In the case of providing a customized advertisement for taxi passengers, it is possible to set a customer group by using audio information in addition to video information.

As illustrated in FIG. 11, in detail, in the case of recognizing two or more voices, the pre-stored voice is excluded (S121`), and even when considering the excluded voice, each customer group is separately determined when recognizing two or more voices (S123`) It may consist of the step of setting the optimal group customer group corresponding to each determined customer group SET (S125`).

When the two or more voices are recognized, it is basically determined that the taxi driver and one passenger have boarded, and the voice information analysis is performed after removing the voice of the previously stored taxi driver from the voice information.

If two or more voices are recognized, and two or more voices are recognized even though voices of pre-stored taxi drivers and the like are excluded from the voice information, it is determined that two or more passengers have boarded and the number of passengers through video information and voice information. After determining, a customer group is separately determined for each passenger.

Furthermore, in order to provide advertisement content and broadcast content suitable for all passengers, the relationship between the customer groups is considered based on the set customer group for each passenger, and an optimal group customer group corresponding to the customer group SET is set.

For example, through the voice recognition (S110) step, through the voice information of the passenger, passenger 1 is set to the customer group as female, college student, Gangnam-gu, and lunch time, and passenger 2 is set as female, middle-aged, Gangnam-gu, lunch time as the customer group. In this case, considering the customer group relationship between the passenger 1 and the passenger 2, the optimal group customer group corresponding to the customer group SET may be set as the mother-daughter relationship group customer group. Finally, advertisements for transmission may be matched based on the group customer group.

The above detailed description is to illustrate the present invention. In addition, the above-described content is to describe and describe preferred embodiments of the present invention, and the present invention can be used in various other combinations, modifications and environments. That is, it is possible to change or modify the scope of the concept of the invention disclosed herein, the scope equivalent to the disclosed contents, and/or the scope of the art or knowledge in the art. The embodiments described describe the best state for implementing the technical idea of the present invention, and various changes required in specific application fields and uses of the present invention are possible. Accordingly, the detailed description of the invention is not intended to limit the invention to the disclosed embodiments. In addition, the appended claims should be construed to include other embodiments.

100: management server
110: communication module
120: processing module
130: advertising cost setting module
140: database on the management server
200: advertising operator
300: advertiser
400: transport operator
500: transportation terminal
501: Camera.
510: transmit/receive module
520: judgment module
530: ad matching module
540: database of the vehicle terminal
521: Position check module
523: image discrimination module
525: voice discrimination module

Claims (10)

A digital signage system tailored to customers for transportation passengers,
(a) performing image recognition through a camera;
(b) setting a customer group according to image recognition;
(c) matching pre-stored advertisements according to the set customer group; And
(d) transmitting the matched advertisement to a display; a method performed by a customer-customized digital signage system for a vehicle occupant. According to claim 1,
Step (b) is:
When recognizing two or more images, determining whether there are pre-stored images; And
A method of performing a digital signage system customized for a customer for a vehicle passenger, comprising a step of excluding a previously stored image if it is found as a result of determination. According to claim 2,
Step (b) is:
After the step of excluding,
A method of performing a digital signage system customized for a vehicle passenger, further comprising a step of separately identifying a customer group for each of the two or more images, if two or more images exist after the recognition result even after the exclusion. According to claim 1,
Step (b) is:
Further comprising the step of setting the customer group according to the speech recognition,
When setting the customer group according to the image recognition, through the real-time face recognition technology that is robust to environmental changes using deep learning from the recognized image information, the gender and age information of the passenger is recognized in consideration of changes in lighting, pose, expression, and accessories, or , Setting a customer group through voice recognition information including frequency and tone in the recognized voice information,
Real-time face recognition technology that is robust to environmental changes using the deep learning,
At least 6 to 68 points are extracted from the recognized face to detect landmarks of image information, processed the extracted landmark information through normalization, and based on the processed information, CNN (Convolution Neural Network) features A method of performing a digital signage system customized for a customer for a vehicle occupant characterized by extracting. The method of claim 4,
Step (c) is:
Matching the region of interest and the service of interest estimated in correspondence with the customer group set in step (b); And
If the current location is determined outside the pre-set administrative area as a result of the determination, the step of releasing the matched area of interest and service of interest; a method for performing a digital signage system customized for a vehicle occupant. According to claim 3,
Step (c) is:
Setting an optimal group customer group for estimating the relationship between the two or more customer groups according to a predetermined standard of relationship with respect to a customer group SET grouping two or more customer groups separately identified in the step (b); And
And matching the pre-stored optimal interest service corresponding to the optimal group of customer groups. According to claim 1,
After the sending step,
Billing the advertiser for the total advertisement cost per unit time according to the advertisement transmission; And
Distributing the total amount of the billed advertisements to a management server manager, a vehicle operator and an advertiser; a method performed by a customer-customized digital signage system for a vehicle occupant. According to claim 1,
Step (a) is,
A method of performing a digital signage system customized for a vehicle occupant, characterized in that the image recognition is performed only when a new image is received through the camera. According to claim 1,
After the sending step,
Displaying a QR code of the product or service of the sent advertisement for camera shooting when a touch signal is input for the product or service of the sent advertisement; And
And displaying a coupon or reservation service related to the product and service of the transmitted advertisement, further comprising a digital signage system customized for a vehicle passenger. According to claim 1,
Step (c) is,
Predicting a driving route of the transportation means in consideration of the driving direction of the transportation means, location and time information of the transportation means; And
Searching for advertisements to be transmitted considering the set customer group and the predicted driving route, and scheduling in chronological order to match pre-stored advertisements.

Images