KR20170050007A - Service providing device for recommending movie using BLE and face recognition technology, movie recommendation service system comprising the same, control method thereof and computer readable medium having computer program recorded thereon - Google Patents

Abstract

The present invention relates to a service providing apparatus for recommending movies by using BLE and a facial recognition technology, a movie recommendation service system comprising the same, a method for controlling the same, and a recording medium recording a computer program thereof. According to the present invention, identification information and so on of a device of at least one user who enters a place related to a ticket is collected by using a BLE communications method. A users face of the device of a relevant user who sits on a relevant seat is captured by at least one camera installed in the pace related to the ticket. Whether the relevant user focuses on a situation occurring in the relevant place or dozes by applying the facial recognition technology to the captured face of the user. Afterwards, identified information is linked to information of the situation, occurring in the relevant place, and then is stored, and then recommendation information is provided to the relevant user based on the stored information and the information of the situation occurring in the relevant place. Therefore, advanced targeting can be performed when movies are recommended to the user. Accordingly, users satisfaction can be increased.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a service providing apparatus for recommending movies using a BLE and a face recognition technology, a movie recommendation service system including the same, a control method thereof, and a recording medium on which a computer program is recorded. service system comprising the same, control method thereof and computer readable medium having computer program recorded thereon}

The present invention relates to a service providing apparatus for recommending a movie using BLE and a face recognition technology, a movie recommendation service system including the same, a control method thereof, and a recording medium on which a computer program is recorded, The user's face of the user device sitting on the seat is photographed through one or more cameras installed in a place related to the ticket, and the face of the user is photographed After recognizing whether the user is concentrating on the ongoing situation in the place or is sleeping by applying the recognition technology, the user checks the stored information and the situation information in progress in the corresponding place, Based on the status information in progress within the site, A service providing apparatus for recommending a movie using face recognition technology, a movie recommendation service system including the same, a control method thereof, and a recording medium on which a computer program is recorded.

In the case of movie recommendation, a user or another viewer analyzes feelings by a user or another viewer through a movie review, classifies a plurality of movies on the basis of an emotion ratio according to the analyzed emotion information, .

Such movie recommendation method may not properly reflect the user's preference because the movie recommendation function is performed by the user or other viewers to perform the movie recommendation function and the movie recommendation is made to the user based on the movie review made by other artificially created viewers .

Korean Patent No. 10-1465756 [Title: Apparatus and method for emotion analysis and recommendation method of movie using the same]

It is an object of the present invention to collect the identification information and the like of one or more user apparatuses entering a place related to a ticket through a BLE communication method and to provide a user of the corresponding user apparatus seated in the seat through one or more cameras installed in a place related to the ticket The face of the user is photographed and the facial recognition technology is applied to the photographed face of the user to check whether the user is concentrating on the ongoing situation in the place or is sleepy, And a service providing device for recommending movies using face recognition technology and BLE for providing recommendation information to the user device based on the stored information and the situation information in progress in the place after storing the context information in association with each other A movie recommendation service system, a control method thereof, and a computer program Recorded to provide a record medium.

The service providing apparatus according to the embodiment of the present invention may include identification information, collection date and time information of one or more user apparatuses collected for a user apparatus entering a place where the identification information collection apparatus transmitted from the identification information collection apparatus is located, A communication unit for receiving a plurality of pieces of image information photographed at preset time intervals, a photographing date and time information for each piece of image information, movie information being displayed at a place, and identification information of the identification information collection device; A storage unit for storing identification information of a plurality of user devices that have purchased a ticket in relation to a place; And determining whether or not a user enters a place on the basis of the identification information of one or more user apparatuses, calculating a seat occupancy rate of a user for each seat based on a plurality of pieces of image information, The user's concentration information of the user indicating whether the user is concentrating on the movie based on the information of the recognized face recognition of the user is calculated and information on the admission of the user device, the seat occupancy rate of the user by the calculated seat, A controller for selecting one or more recommended movie information based on the concentration of the star user, the accumulated entrance / exit information related to the user device, the sitting information of the user for each accumulated seat, and the cumulative concentration of each movie.

As an example related to the present invention, the control unit may store the location information previously stored in the storage unit, the identification information of a plurality of user apparatuses corresponding to the collection date and time information, and the identification information of one or more user apparatuses transmitted from the identification information collection apparatus The identification information of one or more user devices may be checked to confirm whether or not the user equipment has entered a place.

As an example related to the present invention, the controller can calculate a seat occupancy rate, which is a ratio of the number of image information occupied by a user to a seat purchased by the user apparatus among a plurality of image information on the number of image information.

As an example related to the present invention, the control unit may determine that the focus direction of the eyes that the user who is seated on the seat purchased by the user apparatus among the plurality of pieces of image information on the number of the plurality of pieces of image information is the image information Which is a ratio of the number

As one example related to the present invention, the selected recommended movie information includes at least one of a movie title, a movie genre, a movie opening date, a movie theater name, a movie theater name, a viewing age information (or viewing rating information), a publisher, And a main actor name.

A control method of a service providing apparatus according to an exemplary embodiment of the present invention is a control method of a service providing apparatus that acquires identification information of one or more user apparatuses collected for a user apparatus entering a place where an identification information collecting apparatus, Receiving date and time information, place information, and identification information of the identification information collection device; Confirming whether or not the user equipment enters a place with the identification information of the received one or more user devices through the control unit; A plurality of image information, place information, shooting date and time information for each image information, movie information being played at a place, and identification information of the identification information collecting apparatus, which are taken at predetermined time intervals transmitted from the identification information collecting apparatus, Receiving; Calculating a seat occupancy rate of a user for each seat based on a plurality of pieces of image information through a control unit; Calculating a degree of concentration of a user for each seat, which indicates whether the user is concentrating on the movie based on information of the user's face recognition recognized when the user is seated in the seat in the image information through the control unit; The control unit determines whether or not the user equipment is present or absent, the seat occupancy rate of the user by the calculated seat, the concentration of the user by the calculated seat, the accumulation admission information accumulated with respect to the user apparatus, Selecting at least one recommended movie information based on the concentration of each movie; And transmitting the selected one or more recommended movie information through the communication unit.

As an example related to the present invention, the step of confirming whether or not a user enters a place by a user device includes a step of storing location information previously stored in a storage unit, identification information of a plurality of user devices corresponding to collection date and time information, The identification information of one or more user apparatuses in which identification information of one or more user apparatuses is duplicated can be checked to confirm whether or not the user apparatus is allowed to enter a place.

The calculating of the seat occupancy rate of a user by seat according to the present invention may include calculating a seat occupancy rate of a user by a seat by counting the number of video information occupied by the user in a seat purchased by the first user apparatus among a plurality of pieces of image information, ; And calculating a first seat occupancy rate, which is a ratio of the number of image information occupied by the user to the number of seats purchased by the first user apparatus counting the number of the plurality of image information, through the control unit.

According to an embodiment of the present invention, the step of calculating the concentration of a user for each seat may include a step of calculating, by a controller, a focus direction of an eye of a first user who is seated in a seat purchased by the first user apparatus among a plurality of image information, Counting the number of screenings of the first seat as the number of image information facing the set screen area; And calculating a first concentration through the control unit, the first concentration being a ratio between the number of the plurality of image information and the number of screenings of the first seat.

A computer program for carrying out the method according to the above-described embodiment may be stored in the recording medium on which the computer program according to the embodiment of the present invention is recorded.

The movie recommendation service system according to an embodiment of the present invention includes identification information, collection date and time information of one or more user devices collected for a user device entering a place where the identification information collection device is located, place information, The identification information is provided, the entire seat in the place is photographed at a predetermined time interval, the image information including the entire seat taken, the place information, the shooting date and time information for each image information, and the identification information of the identification information collection device An identification information collection device for providing identification information; A seat occupancy rate of a user for each seat is calculated on the basis of a plurality of pieces of image information, and when the user is seated in the seat in the video information, Based on the information of the user's face recognition, information on whether or not the user device is present, information on the seat occupancy rate of the user per seat calculated, A service providing device for selecting at least one recommended movie information based on a user's concentration, cumulative admission information related to a user device, accumulated seating information of a user for each seat, and cumulative concentration of each movie; And a user device for displaying one or more recommended movie information provided from the service providing device.

The present invention collects identification information and the like of one or more user apparatuses entering a place related to a ticket through a BLE communication method and transmits the user's face of the user of the corresponding user apparatus seated in the seat through one or more cameras installed in a place related to the ticket And the facial recognition technology is applied to the photographed face of the user to confirm whether the user is concentrating on the ongoing situation in the place or whether he is sleeping. Then, after confirming the confirmed information and the progress status information And provides recommendation information to the user device based on the information stored in the future and the situation information in the corresponding place, thereby performing more advanced targeting in the case of recommending the movie to the user in the future, The user's satisfaction can be enhanced.

1 is a block diagram illustrating a configuration of a movie recommendation service system according to an embodiment of the present invention.
2 is a cross- FIG. 8 is a block diagram illustrating a configuration of a user apparatus according to an embodiment of the present invention.
3, FIG. 7 is a block diagram illustrating a configuration of a service providing apparatus according to an embodiment of the present invention.
4 to 5 FIG. 2 is a flowchart illustrating a method of controlling a movie recommendation service system using a BLE and a face recognition technology according to an embodiment of the present invention; FIG.
6 to 7 are views illustrating screens of a user apparatus according to an embodiment of the present invention.

It is noted that the technical terms used in the present invention are used only to describe specific embodiments and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be construed in a sense generally understood by a person having ordinary skill in the art to which the present invention belongs, unless otherwise defined in the present invention, Should not be construed to mean, or be interpreted in an excessively reduced sense. In addition, when a technical term used in the present invention is an erroneous technical term that does not accurately express the concept of the present invention, it should be understood that technical terms that can be understood by a person skilled in the art can be properly understood. In addition, the general terms used in the present invention should be interpreted according to a predefined or prior context, and should not be construed as being excessively reduced.

Furthermore, the singular expressions used in the present invention include plural expressions unless the context clearly dictates otherwise. The term "comprising" or "comprising" or the like in the present invention should not be construed as necessarily including the various elements or steps described in the invention, Or may further include additional components or steps.

Furthermore, terms including ordinals such as first, second, etc. used in the present invention can be used to describe elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or similar elements throughout the several views, and redundant description thereof will be omitted.

In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. It is to be noted that the accompanying drawings are only for the purpose of facilitating understanding of the present invention, and should not be construed as limiting the scope of the present invention with reference to the accompanying drawings.

1 is a block diagram showing a configuration of a movie recommendation service system 10 according to an embodiment of the present invention.

1, the movie recommendation service system 10 includes a user apparatus 100, a service providing apparatus 200, a payment server 300, and an identification information collecting apparatus 400. Not all of the components of the movie recommendation service system 10 shown in Fig. 1 are essential components, the movie recommendation service system 10 may be implemented by more components than the components shown in Fig. 1, The movie recommender service system 10 may also be implemented by fewer components.

The user device 100 performs a ticket purchase function for one or more tickets through a ticket advancement site provided by the service providing device 200. [ Then, the identification information collecting apparatus 400 collects the identification information of the user apparatus 100 entering the place, and transmits the collected information to the service providing apparatus 200. Then, the service providing apparatus 200 confirms the user apparatus 100 entering the place based on the collected information. Then, the identification information collecting apparatus 400 photographs the image information including all the seats in the place at predetermined time intervals, and acquires a plurality of photographed image information, place information, photographing date and time information per image information, To the service providing apparatus 200, movie information (or sports game information) that is being screened (or progressed), identification information of the identification information collection apparatus 400, and the like. Thereafter, the service providing apparatus 200 calculates a seat occupancy rate for whether or not a seat-based user is seated based on a plurality of pieces of image information. Further, the service providing apparatus 200 recognizes the face of the user who is seated in the seat based on the plurality of pieces of image information. Thereafter, the service providing apparatus 200 calculates the degree of concentration of whether or not the user is concentrating on the event occurring in the corresponding place, based on the information of the recognized face of the user. Thereafter, the service providing apparatus 200 determines whether or not the user device 100 is present, the seat occupancy rate of the user by the seat, the concentration level, the field information of the preset event, A seat occupancy rate, a concentration degree, and the like, selects one or more events from a plurality of events that are currently in progress or are scheduled to be performed in the future, and provides information on the selected one or more events to the user device 100.

The user device 100 may be a smart phone, a portable terminal, a mobile terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) terminal, a telematics terminal, A portable terminal, a navigation terminal, a personal computer, a notebook computer, a slate PC, a tablet PC, an ultrabook, a wearable device (for example, a watch type A smart TV, a digital broadcasting terminal, a television (TV), a digital television (TV), a digital television (TV) A home theater system, an AVN (Audio Video Navigation) terminal, an A / V (Audio / Video) system, a flexible terminal, and the like.

2, the user device 100 includes a user device communication unit 110, a user device storage unit 120, a user device display unit 130, a user device audio output unit 140, and a user device control unit 150 ). Not all of the components of the user device 100 shown in Fig. 2 are required, and the user device 100 may be implemented by more components than the components shown in Fig. 2, The user device 100 may be implemented.

The user device communication unit 110 communicates with any one of the internal components or external at least one terminal through a wired / wireless communication network. At this time, the external arbitrary terminal may include the service providing apparatus 200, the payment server 300, the identification information collecting apparatus 400, and the like. Here, the wireless Internet technology includes a wireless LAN (WLAN), a digital living network alliance (DLNA), a wireless broadband (Wibro), a world interoperability for a microwave (WiMAX), a high speed downlink packet access ), HSUPA (High Speed Uplink Packet Access), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS) And the user device communication unit 110 transmits and receives data according to at least one wireless Internet technology in a range including Internet technologies not listed above. In addition, the near field communication technology includes Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, Near Field Communication (NFC) , Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi, and Wi-Fi Direct. The wired communication technology may include a power line communication (PLC), a USB communication, an Ethernet, a serial communication, an optical / coaxial cable, and the like.

In addition, the user device communication unit 110 can transmit information to and from an arbitrary terminal through a universal serial bus (USB).

In addition, the user equipment communication unit 110 may be configured to communicate with a plurality of mobile communication systems, such as a mobile communication system, a mobile communication system, a mobile communication system, a mobile communication system, a mobile communication system, (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), LTE (High Speed Downlink Packet Access) The service providing apparatus 200, the payment server 300, the identification information collecting apparatus 400, and the like on a mobile communication network constructed in accordance with a service provider's name,

Also, the user device communication unit 110 accesses the ticket reservation site provided by the service providing apparatus 200 under the control of the user apparatus control unit 150. [ Here, the ticket advance site includes a movie ticket advance site, a sports event ticket advance site, and the like.

Also, under control of the user device controller 150, the user device communication unit 110 receives a user interface screen for ticket booking provided by the ticket booking site.

The user device storage unit 120 stores various user interfaces (UI), a graphical user interface (GUI), and the like.

Also, the user device storage unit 120 stores data and programs necessary for the user device 100 to operate.

That is, the user device storage unit 120 may store a plurality of application programs (application programs or applications) driven by the user device 100, data for operation of the user device 100, and commands. At least some of these application programs may be downloaded from the external service providing device via wireless communication. Also, at least some of these applications may reside on the user device 100 since the time of shipment for the basic functions (e.g., phone call incoming, outgoing, message receiving, originating functions) of the user device 100. The application program may be stored in the user device storage unit 120 and may be installed in the user device 100 and may be operated by the user device control unit 150 to perform the operation have.

The user device storage unit 120 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or A random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM) , And a programmable read-only memory (PROM). In addition, the user device 100 may operate web storage or operate in association with web storage to perform the storage function of the user device storage unit 120 on the Internet.

The user device storage unit 120 stores a user interface screen for ticket booking provided by the ticket reservation site received through the user device communication unit 110 under the control of the user device control unit 150. [

The user device display unit 130 may display various contents such as various menu screens by using the user interface and / or graphical user interface stored in the user device storage unit 120 under the control of the user device controller 150. [ Here, the content displayed on the user device display unit 130 includes various text or image data (including various information data) and a menu screen including data such as an icon, a list menu, and a combo box. Also, the user device display unit 130 may be a touch screen.

The user device display unit 130 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) And may include at least one of a flexible display, a 3D display, an e-ink display, and a light emitting diode (LED).

In addition, the user device display unit 130 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), a projection system (holographic system) can be applied.

The user device display unit 130 displays a user interface screen for ticket booking provided by the ticket reservation site received through the user device communication unit 110 under the control of the user device controller 150. [

The user device audio output unit 140 outputs audio information included in the signal processed by the user device control unit 150. Here, the user device audio output unit 140 may include a receiver, a speaker, a buzzer, and the like.

Also, the user device audio output unit 140 outputs the guidance audio generated by the user device control unit 150.

The user device audio output unit 140 outputs audio information corresponding to a user interface screen for ticket booking provided by the ticket reservation site received via the communication unit 110 under the control of the user device control unit 150 do.

The user device control unit 150 executes the overall control function of the user device 100. [

The user device controller 150 executes the overall control functions of the user device 100 using the programs and data stored in the user device storage unit 120. [ The user device controller 150 may include a RAM, a ROM, a CPU, a GPU, and a bus, and the RAM, the ROM, the CPU, and the GPU may be connected to each other via a bus. The CPU accesses the user device storage unit 120 and performs booting using the O / S stored in the user device storage unit 120. The CPU can access various programs stored in the user device storage unit 120, And the like.

In addition, the user device controller 150 performs the membership process for the user of the user device 100 by interlocking with the service providing device 200.

The user device control unit 150 must complete the authentication function using the authentication means (for example, a mobile phone, a credit card, an IP phone, an e-mail, etc.) The subscription process can be completed normally.

Also, the user device control unit 150 accesses the ticket reservation site provided by the service providing device 200 through the user device communication unit 110. [ At this time, the user device controller 150 (or the user of the user device 100) may be a member registered in advance in the service providing device 200. Here, the ticket advance site includes a movie ticket advance site, a sports event ticket advance site, and the like. At this time, the user device controller 150 provides identification information of the user device 100 to the corresponding service providing device 200. Here, the identification information of the user device 100 includes a mobile directory number (MDN), a mobile IP, a mobile MAC, a SIM (subscriber identity module) card unique information, and a serial number.

Also, the user device controller 150 receives a user interface screen for ticket booking provided by the ticket booking site through the user device communication unit 110.

In addition, the user device controller 150 displays a user interface screen for the received ticket reservation on the user device display unit 130. FIG.

In addition, the user device control unit 150 may determine whether the user wants to purchase a service by interlocking with the service providing apparatus 200 and the payment server 300 based on information such as a specific date, time, And performs a ticket purchase function for the ticket. At this time, the user device controller 150 may transmit the identification information of the user device 100 to the service providing device 200 in a background state.

When the ticket purchase function is normally completed, the user device control unit 150 receives the ticket purchase function execution result transmitted from the service providing apparatus 200 through the user device communication unit 110. [ Here, the result of performing the ticket purchasing function (or the result of performing the ticket purchasing information / ticket payment function) may include a place name (for example, a movie theater name, a sports arena name, The total payment amount, payment date and time information, payment card type, and the like. At this time, the payment card includes a credit card, a cash card (or a check card), a point card, a gift certificate, a coupon, and the like.

Also, the user device controller 150 outputs a result of performing the received ticket purchase function through the user device display unit 130 and / or the user device audio output unit 140.

When the user of the user device 100 purchasing the ticket enters a place (or a store) where the ticket can be used, the user device control unit 150 controls the user device communication unit 110, (BLE) communication system or the like. At this time, the communication method between the user apparatus 100 and the identification information collecting apparatus 400 may be any one of various communication methods other than BLE communication.

That is, when the user of the user device 100 purchasing the ticket enters a place (or a store) where the ticket can be used for the expiration date (for example, the reservation date and time information) Through the user device communication unit 110, an identification information request signal transmitted from the identification information collection device 400. [

In response to the received identification information request signal, the user device controller 150 transmits the identification information of the user device 100 to the identification information collection device 400 via the user device communication unit 110.

If there is an unused ticket among the one or more tickets purchased (or reserved) by the user device 100, the user device controller 150 may operate in cooperation with the service providing device 200 and the payment server 300 And performs a ticket cancellation function for the related ticket that needs to be canceled.

The user device control unit 150 receives the result of performing the ticket cancel function transmitted from the service providing apparatus 200 or the payment server 300 through the user apparatus communication unit 110. [ Here, the result of performing the ticket cancellation function (or the ticket cancellation information) includes a place name, place unique identification information, reservation date and time information, ticket number (or quantity), total payment amount, payment date and time information, Amount of money, settlement cancellation date and time information, refund method information, and the like. At this time, the refund method information includes a cancellation of the payment card, a refund to the deposit / point, and a transfer to the designated account.

Also, the user device controller 150 outputs the result of performing the received ticket cancel function through the user device display unit 130 and / or the user device audio output unit 140.

If there is an unused ticket among the one or more tickets purchased (or reserved) by the user device 100, the user device controller 150 may operate in cooperation with the service providing device 200 and the payment server 300 To change the ticket reservation date. At this time, when the ticket reservation date changing function is performed, the corresponding user device controller 150 may further settle the predetermined fee by interlocking with the service providing apparatus 200 and the payment server 300.

Also, the user device controller 150 receives the result of performing the ticket reservation date changing function transmitted from the service providing device 200 through the user device communication unit 110. Here, the result of performing the ticket reservation date changing function (or the ticket reservation date changing information) includes a place name, place unique identification information, reservation date and time information, ticket number (or quantity), total payment amount, payment date and time information, Type, change reservation date and time information, change date information, and the like.

Also, the user device controller 150 outputs the result of performing the received ticket reservation date changing function through the user device display unit 130 and / or the user device audio output unit 140.

After receiving the event, the user device control unit 150 receives information about one or more events transmitted from the service providing device 200 through the user device communication unit 110. [ Here, the information on one or more events may be either currently in progress or in the future based on information on whether or not the user device 100 is present, seating information of the user by the seat, concentration information on the movie, And may be information on a selected event among a plurality of events.

Also, the user device controller 150 outputs information about the received one or more events through the user device display unit 130 and / or the user device audio output unit 140.

In addition, the user device 100 may further include an interface unit (not shown) that serves as an interface with all the external devices connected to the user device 100. For example, the interface unit may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / Input / output (I / O) port, video I / O (input / output) port and earphone port. Here, the identification module is a chip that stores various information for authenticating the usage right of the user device 100, and includes a user identity module (UIM), a subscriber identity module (SIM) A Universal Subscriber Identity Module (USIM), and the like. In addition, a device provided with the identification module can be manufactured in a smart card format. Thus, the identification module can be connected to the user device 100 via the port. The interface unit receives data from an external device or receives power and transmits the data to each component in the user device 100 or data in the user device 100 is transmitted to an external device.

The interface unit may be a path through which power from the cradle is supplied to the user device 100 when the user device 100 is connected to an external cradle or various command signals input from the cradle by the user, (Not shown). The various command signals input from the cradle or the corresponding power source may be operated as a signal for recognizing that the user device 100 is correctly mounted on the cradle.

The user device 100 also includes an input unit (not shown) for receiving a command or a control signal generated by an operation such as a button operation by the user or a signal according to an arbitrary function selection or a touch / Not shown).

The input unit may include at least one of a command, a selection, data, and information of a user. The input unit may include a plurality of input keys and function keys for inputting numeric or character information and setting various functions.

The input unit may include a key pad, a dome switch, a touch pad (static / static), a touch screen, a jog wheel, a jog switch, a jog shuttle, a mouse, , A stylus pen, a touch pen, and the like can be used. Particularly, when the user device display unit 130 is formed as a touch screen, some or all of the functions of the input device can be performed through the user device display unit 130. [

In addition, each component (or module) of user device 100 may be software stored on the memory (or user device storage 120) of user device 100. The memory may be an internal memory of the user device 100 and may be an external memory or other type of storage device. Further, the memory may be a non-volatile memory. The software stored on the memory may include a set of instructions that, when executed, cause the user device 100 to perform certain operations.

3, the service providing apparatus 200 includes a communication unit 210, a storage unit 220, a display unit 230, an audio output unit 240, and a control unit 250. Not all of the components of the service providing apparatus 200 shown in FIG. 3 are essential components, and the service providing apparatus 200 may be implemented by more components than the components shown in FIG. 3, The service providing apparatus 200 may also be implemented by a component.

The communication unit 210 communicates with at least one external terminal or any internal component via a wired / wireless communication network. At this time, the external arbitrary terminal may include the user apparatus 100, the payment server 300, the identification information collection apparatus 400, and the like. The wireless Internet technology includes a wireless LAN (WLAN), a DLNA, a Wibro, a WiMAX, HSDPA, HSUPA, IEEE 802.16, Long Term Evolution (LTE), LTE- And the communication unit 210 transmits and receives data according to at least one wireless Internet technology in a range including internet technologies not listed above. Near field communication technologies may include Bluetooth, RFID, IrDA, UWB, ZigBee, NFC, Ultrasound (USC), Visible Light (VLC), WiFi and WiFi Direct. have. In addition, the wired communication technology may include a power line communication (PLC), a USB communication, an Ethernet, a serial communication, and an optical / coaxial cable.

In addition, the communication unit 210 can transmit information to and from an arbitrary terminal through a universal serial bus (USB).

The communication unit 210 performs a connection function with the user device 100 to the ticket advance site provided by the service providing apparatus 200 under the control of the control unit 250. [

Under the control of the control unit 250, the communication unit 210 transmits a user interface screen for ticket booking provided by the ticket booking site to the user device 100 connected to the ticket booking site.

The storage unit 220 stores various user interfaces (UI), a graphical user interface (GUI), and the like.

In addition, the storage unit 220 stores data and programs necessary for the service providing apparatus 200 to operate.

The storage unit 220 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (such as SD or XD memory), a magnetic memory, a magnetic disk, SRAM, a ROM, an EEPROM, and a PROM. In addition, the service providing apparatus 200 may operate in association with web storage or operate web storage that performs the storage function of the storage unit 220 on the Internet.

The storage unit 220 stores a user interface screen for ticket reservation, a user interface screen for ticket cancellation, a user interface screen for ticket change, etc. under the control of the control unit 250.

The display unit 230 can display various contents such as various menu screens by using the user interface and / or graphical user interface stored in the storage unit 220 under the control of the controller 250. [ Here, the content displayed on the display unit 230 includes various text or image data (including various information data) and a menu screen including data such as an icon, a list menu, and a combo box. Also, the display unit 230 may be a touch screen.

In addition, the display unit 230 may include at least one of a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), an organic light emitting diode (OLED), a flexible display, a three dimensional display,

Also, the display unit 230 displays a user interface screen for ticket reservation, a user interface screen for canceling a ticket, a user interface screen for changing tickets, etc. under the control of the control unit 250.

The audio output unit 240 outputs audio information included in the signal processed by the control unit 250. Here, the audio output unit 240 may include a receiver, a speaker, a buzzer, and the like.

Also, the voice output unit 240 outputs the guidance voice generated by the control unit 250.

The voice output unit 240 outputs voice information corresponding to a user interface screen for ticket reservation, a user interface screen for ticket cancellation, a user interface screen for ticket change, etc., under the control of the control unit 250. [

The control unit 250 executes the overall control function of the service providing apparatus 200. [

In addition, the control unit 250 executes the overall control function of the service providing apparatus 200 using the program and data stored in the storage unit 220. [ The controller 250 may include a RAM, a ROM, a CPU, a GPU, and a bus, and the RAM, the ROM, the CPU, and the GPU may be connected to each other via a bus. The CPU accesses the storage unit 220 and performs booting using the O / S stored in the storage unit 220. The CPU 220 performs various operations using various programs, contents, data stored in the storage unit 220, Can be performed.

In addition, the control unit 250 performs the membership registration procedure for the user of the user device 100 in cooperation with the user device 100, respectively.

In addition, the control unit 250 controls the connection function with the user device 100 to the ticket booking site provided by the service providing apparatus 200. [

In addition, the control unit 250 transmits a user interface screen for ticket booking provided by the ticket booking site to the user device 100 connected to the ticket booking site provided by the service providing apparatus 200, Lt; / RTI >

In addition, the control unit 250 controls the operation of the user device 100 and the payment server 300 based on information such as a specific date, time, and the number of tickets according to user input (or user selection) The user device 100 performs a ticket purchase function for a ticket to be purchased. At this time, the control unit 250 can receive the identification information of the user apparatus 100 transmitted from the corresponding user apparatus 100 through the communication unit 210 in the background state.

In addition, the controller 250 transmits the result of performing the ticket purchasing function to the user device 100 through the communication unit 210. [ Here, the result of performing the ticket purchasing function (or the result of performing the ticket purchasing information / ticket payment function) may include a place name (for example, a movie theater name, a sports arena name, The total payment amount, payment date and time information, payment card type, and the like. At this time, the payment card includes a credit card, a cash card (or a check card), a point card, a gift certificate, a coupon, and the like.

In the embodiment of the present invention, a place related to the purchase of a ticket is exemplified by a movie theater, a sports arena, and the like, but the present invention is not limited thereto. In the case where a seat number is set in a place according to purchase of a ticket, Technical configurations may be applied.

In addition, the controller 250 stores (or manages) the ticket purchase function execution result in the storage unit 220 according to the identification information of the user apparatus.

That is, the control unit 250 stores the result of performing the ticket purchase function for the identification information of the corresponding user equipment, which has purchased the ticket for each location (or store), date,

The control unit 250 may further include identification information of the at least one user device 100 transmitted from the identification information collection device 400, location information (or unique identification information for each place), collection date and time information, 400 via the communication unit 210. [0050]

In addition, the controller 250 may store identification information of a plurality of (or more than one) user apparatuses that have purchased a ticket in association with a corresponding place stored in advance in the storage unit 220, The identification information of the user device is compared with each other, and it is confirmed whether or not the user device 100 purchasing the ticket for the place is present.

That is, in order to confirm whether or not to use the purchased ticket on the use day (or the usage time) after purchasing the ticket, the control unit 250 stores the collected date and time information of the corresponding place stored in advance in the storage unit 220 Identifies identification information of one or more user devices in which identification information of the corresponding plurality of user devices and identification information of one or more user devices transmitted from the identification information collection device 400 are overlapped.

Accordingly, the control unit 250 confirms that each user apparatus corresponding to the identification information of one or more user apparatuses that are overlapped has entered the corresponding place.

In addition, the control unit 250 may store the identification information of one or more user apparatuses other than the previously identified identification information of the plurality of user apparatuses corresponding to the collection date and time information of the corresponding place previously stored in the storage unit 220, Check the identification information of the device.

In this case, the control unit 250 accesses each of the other user equipments corresponding to the identification information of the other user equipments excluding the identification information of the one or more user equipments, And confirm that it is not.

In addition, the control unit 250 may acquire a plurality of pieces of image information including all the seats in the corresponding place photographed at predetermined time intervals (or in the case where a preset event occurs) transmitted from the identification information collection device 400, (Or unique information for each place), shooting date and time information for each image information, movie information (or sports game information) being screened (or progressed) at the place, identification information of the identification information collection apparatus 400, ≪ / RTI >

In addition, the control unit 250 confirms seating information (or in / out information) of the user of each seat based on the received plurality of image information. At this time, the control unit 250 may calculate (or calculate) a seating rate (or a seat occupancy rate) of a user for each seat based on a plurality of pieces of image information. Here, the seating rate of the user (or the seat occupancy rate) may be the seat occupancy rate of the user with respect to a plurality of pieces of image information.

That is, the control unit 250 counts the number of image information (or the number of user seats per seat) occupied by the user in the seats purchased by the user apparatus 100 from a plurality of pieces of image information.

In addition, the controller 250 calculates a seat occupancy rate of a user for each seat, which is a ratio between the number of pieces of image information and the number of seated seats per seat.

In addition, when the user is seated in the seat within the photographed image information, the control unit 250 recognizes the face of the user for each seat occupied by the user. At this time, the controller 250 can recognize the face direction of the user, the focus direction of the user's eyes, and the like. Here, the control unit 250 can recognize the face of the user of each seat included in the corresponding image information through various known face recognition methods (or algorithms). Further, as the camera included in the identification information collection device 400 photographs the entire seat (or one or more seats in the place) at a preset position, the controller 250 stores the image information photographed within the predetermined position And may confirm (or recognize) the position information of each seat in the image information in advance.

In addition, the control unit 250 determines whether the user is concentrating on the event occurring in the corresponding place based on the information of the recognized face recognition of the user. Here, the event may be a movie being screened in the case of a movie theater, a sports game in progress in the case of a sports arena, and the like.

In addition, the controller 250 generates (or calculates) the concentration of the event of the user for each seat based on the captured image information. Here, the concentration of the event may be a concentration ratio of the user to the plurality of pieces of the image information.

That is, the control unit 250 determines the number of pieces of image information (or the number of pieces of image information) that the focus direction of the user who is seated in the seat purchased by the user apparatus 100 among the plurality of pieces of image information, The number of star screen candidates).

In addition, the controller 250 calculates the concentration of the user for each seat, which is a ratio between the number of the plurality of image information and the number of screen candidates counted by the seat.

In addition, the control unit 250 determines whether or not the user device 100 has been previously identified, whether the user seat 100 is seated, seating information of the user by the seated seat (or seat seating rate of the user by seat) The concentration of the user), field information of a preset event, and the like, one or more events are selected from a plurality of events that are currently in progress or are scheduled to be performed in the future. At this time, the control unit 250 determines whether cumulative admission information, cumulative seating information of the user, cumulative concentration of each movie, etc., which is observed in the user device 100, (Or a plurality of movies, sports games, and the like) that are currently being performed or are scheduled to be taken into consideration by taking into consideration the sitting information of the user for each seat, the focused degree of the selected movie, the field information of the preset event, Events (or one or more movies, sports events, etc.) may be selected.

In addition, the controller 250 transmits information about the selected one or more events (for example, recommended movie information, recommended sports game information, etc.) to the user device 100 through the communication unit 210. Here, the information about the event may include information such as a movie title, a movie genre, a movie opening date, a movie theater name, a movie theater to be screened, a viewing age information (or viewing rating information), a publisher, A name of the main actor, etc., and if the event is a sporting event, it may include a sports name, a home team and opponent team information, a scheduled game date, and a competition place.

When a ticket cancellation request based on user input (or user selection) of the user device 100 is transmitted from the user device 100, the control unit 250 performs an interlocking operation with the corresponding user device 100 and the payment server 300 The user terminal 100 performs a ticket cancellation function for a ticket whose usage period has elapsed since the user apparatus 100 purchased the ticket. At this time, the control unit 250 can receive the identification information of the user apparatus 100 transmitted from the corresponding user apparatus 100 through the communication unit 210 in the background state. Here, the control unit 250 may refund the remaining money to the user device 100, except for a certain fee.

The control unit 250 transmits the result of performing the ticket canceling function to the user device 100 through the communication unit 210. [ Here, the result of performing the ticket cancellation function (or the ticket cancellation information) includes a place name, place unique identification information, reservation date and time information, ticket number (or quantity), total payment amount, payment date and time information, Amount of money, settlement cancellation date and time information, refund method information, and the like. At this time, the refund method information includes a cancellation of the payment card, a refund to the deposit / point, and a transfer to the designated account.

In addition, the control unit 250 stores (or manages) the ticket canceling function execution result in the storage unit 220 according to the identification information of the user apparatus.

That is, the control unit 250 stores the result of performing the ticket cancellation function on the identification information of the corresponding user equipment whose ticket is canceled by the place (or store) where the ticket is used, in the storage unit 220.

The control unit 250 transmits the ticket reservation date change request to the user device 100 and the payment server 300 in response to a user's input (or user selection) And performs a ticket reservation date changing function for the related ticket requiring the reservation date change. At this time, when the ticket reservation date change function is performed, the control unit 250 may further settle (or request) a predetermined fee to the corresponding user device 100.

The control unit 250 also transmits a result of performing the ticket reservation date changing function to the user device 100 through the communication unit 210. [ Here, the result of performing the ticket reservation date changing function (or the ticket reservation date changing information) includes a place name, place unique identification information, reservation date and time information, ticket number (or quantity), total payment amount, payment date and time information, Type, change reservation date and time information, change date information, and the like.

In addition, the controller 250 stores (or manages) the result of performing the ticket reservation date changing function in the storage unit 220 according to the identification information of the user apparatus.

That is, the control unit 250 stores the result of performing the ticket reservation date change function for the identification information of the corresponding user apparatus that changed the reservation date of the ticket by the place (or store) where the ticket is used, in the storage unit 220.

In addition, the service providing apparatus 200 may be implemented in the form of a web server, a database server, a proxy server, or the like. In addition, the service providing apparatus 200 may be provided with at least one of a network load balancing mechanism, and various software for allowing the service providing apparatus 200 to operate on the Internet or another network, Can be implemented. The network may also be an http network, a private line, an intranet or any other network. Further, the connection of the service providing apparatus 200 and the user apparatus 100 can be connected to the secure network so that the data is not attacked by any hacker or other third party. In addition, the service providing apparatus 200 may include a plurality of database servers, and the database server may be implemented in a manner that is separately connected to the service providing apparatus 200 through any type of network connection including a distributed database server architecture .

Further, a processor mounted on the user apparatus 100 or the service providing apparatus 200 according to the present invention can process program instructions for executing the method according to the present invention. In one implementation, the processor may be a single-threaded processor, and in other embodiments, the processor may be a multi-threaded processor. Further, the processor is capable of processing instructions stored on a memory or storage device.

The payment server 300 communicates with the user device 100, the service providing apparatus 200, and the like.

The settlement server 300 may also be connected to the user device 100 and the service providing apparatus 200 based on information such as a specific date, time and ticket number in accordance with user input (or user selection) The user apparatus 100 performs the ticket purchase function for the ticket to be purchased.

In addition, the payment server 300 transmits the result of performing the ticket purchasing function to the user device 100 and / or the service providing device 200. Here, the result of performing the ticket purchasing function (or the result of performing the ticket purchasing information / ticket payment function) may include a place name (for example, a movie theater name, a sports arena name, The total payment amount, payment date and time information, payment card type, and the like. At this time, the payment card includes a credit card, a cash card (or a check card), a point card, a gift certificate, a coupon, and the like.

In addition, the payment server 300 stores (or manages) the result of performing the ticket purchasing function according to the identification information of the user apparatus.

In addition, the payment server 300 stores the result of performing the ticket purchasing function on the identification information of the corresponding user apparatus that has purchased the ticket by the place (or store), the date, and the number of times the ticket is used.

The payment server 300 can also be connected to the corresponding user device 100 and the service providing device 200 based on the ticket cancellation decision made by the user input (or user selection) And performs a ticket cancellation function for a ticket whose usage period has elapsed after purchasing the ticket at the terminal 100. [

In addition, the payment server 300 transmits the result of performing the ticket cancel function to the user device 100 and / or the service providing device 200. Here, the result of performing the ticket cancellation function (or the ticket cancellation information) includes a place name, place unique identification information, reservation date and time information, ticket number (or quantity), total payment amount, payment date and time information, Amount of money, settlement cancellation date and time information, refund method information, and the like. At this time, the refund method information includes a cancellation of the payment card, a refund to the deposit / point, and a transfer to the designated account.

In addition, the payment server 300 stores (or manages) the result of performing the ticket canceling function according to the identification information of the user apparatus.

That is, the payment server 300 stores the result of performing the ticket cancellation function for the identification information of the corresponding user equipment whose ticket is canceled by the place (or store) where the ticket is used.

The identification information collecting apparatus 400 communicates with the user apparatus 100, the service providing apparatus 200, and the like.

The identification information collection device 400 also collects identification information of the user device 100 that enters (or enters) a place (or a store) related to a ticket sold by the service providing device 200.

That is, the identification information collecting apparatus 400 is installed at the entrance of the corresponding place, and requests identification information requesting one or more user devices 100 entering (or entering) the corresponding place through the BLE communication method Broadcast (or transmit) the signal. At this time, the identification information collection device 400 can transmit the corresponding identification information request signal in consideration of the directivity so that the user device 100 located in the place only receives the identification information request signal.

The identification information collection device 400 collects identification information of the at least one user device 100, location information (or unique identification information by location), collection date and time information, identification information of the identification information collection device 400 And the like to the service providing apparatus 200. At this time, the identification information collecting apparatus 400 may transmit identification information of one or more user apparatuses 100 collected in advance sorted by location, date, and time, etc. to the service providing apparatus 200.

In addition, the identification information collection device 400 may be configured to acquire the identification information (for example, a preset event (for example, a preset event When a predetermined specific scene of a movie is outputted, when a whistling motion of a referee is detected in a sports event, etc.), the entire seat in the place is photographed. In this case, when a plurality of cameras are installed, the identification information collecting apparatus 400 divides all the seats in the place into a plurality of areas (or a plurality of areas by the number of cameras) And photographing one or more seats in the plurality of divided regions through a plurality of corresponding cameras.

In addition, the identification information collection device 400 collects image information including the entire seat taken, place information (or unique identification information according to each place), shooting date and time information per image information, identification information of the identification information collection device 400 And the like to the service providing apparatus 200. At this time, the identification information collection device 400 captures and temporarily stores a plurality of pieces of video information until the provision of the contents provided at the corresponding place is completed, and stores the contents provided at the corresponding places (for example, (Or a sporting event in progress in the case of a sporting event) is completed, a plurality of pieces of image information including the entire captured seats temporarily stored, place information (or unique identification information according to each place), shooting date and time (Or sports game information) screened (or progressed) at the corresponding place, identification information of the identification information collection apparatus 400, and the like to the service providing apparatus 200.

In this way, the identification information of one or more user apparatuses entering a place related to the ticket is collected through a BLE communication method, and the user of the corresponding user apparatus seated in the seat through one or more cameras installed in a place related to the ticket The face is photographed and the facial recognition technology is applied to the photographed face of the user to check whether the user is concentrating on the current situation in the place or whether he is sleeping, Information may be stored in association with each other, and recommendation information may be provided to the user device based on the stored information and the context information in progress in the corresponding place.

Hereinafter, a method of controlling the movie recommendation service system using the BLE and the face recognition technology according to the present invention will be described in detail with reference to FIGS. 1 to 7. FIG.

4 to 5 FIG. 2 is a flowchart illustrating a method of controlling a movie recommendation service system using a BLE and a face recognition technology according to an embodiment of the present invention; FIG.

First, the user device 100 accesses a ticket booking site provided by the service providing apparatus 200. [ At this time, the user apparatus 100 (or the user of the user apparatus 100) may be a member registered in advance in the service providing apparatus 200. Here, the ticket advance site includes a movie ticket advance site, a sports event ticket advance site, and the like.

Also, the user device 100 displays a user interface screen for ticket booking provided by the ticket advance site.

For example, the eleventh user device 100 accesses a movie ticket advancement site and displays a user interface screen for pre-registering a movie ticket provided by the movie ticket advancement site.

In another example, the twenty-first user device 100 accesses a movie ticket advancement site, and displays a user interface screen for purchasing a movie ticket provided by the movie ticket advance site (S410).

Thereafter, the user device 100 transmits a ticket (s) to be purchased by interlocking with the service providing apparatus 200 and the payment server 300 based on information such as a specific date, time, And performs a ticket purchasing function for the user. At this time, the user device 100 may transmit the identification information of the user device 100 to the service providing device 200 in a background state. Here, the identification information of the user device 100 includes an MDN, a mobile IP, a mobile MAC, a SIM (subscriber identity module) card specific information, a serial number, and the like.

For example, the eleventh user device may transmit an AA movie which is being screened at the ABCD movie theater according to user input, based on information such as 20:00 pm on Oct. 10, 2015, 11, 12, (Or a ticket payment function) for the two tickets by interlocking with the providing apparatus 200 and the payment server 300.

As another example, the twenty-first user device may determine that AA movies being played in the ABCD movie theater according to user input are based on information such as seat numbers 151, 152, 2 tickets, etc. at 20:00 pm on Oct. 10, A ticket purchase function (or a ticket payment function) for two tickets is performed by interlocking with the service providing apparatus 200 and the payment server 300 (S420).

Then, the service providing apparatus 200 transmits the result of performing the ticket purchasing function to the user apparatus 100. Here, the result of performing the ticket purchasing function (or the result of performing the ticket purchasing information / ticket payment function) may include a place name (for example, a movie theater name, a sports arena name, The total payment amount, payment date and time information, payment card type, and the like. At this time, the payment card includes a credit card, a cash card (or a check card), a point card, a gift certificate, a coupon, and the like.

Also, the user device 100 receives the result of performing the ticket purchase function transmitted from the service providing apparatus 200, and displays the result of performing the received ticket purchase function.

In addition, the service providing apparatus 200 stores (or manages) the result of performing the ticket purchasing function according to the identification information of the user apparatus.

That is, the service providing apparatus 200 stores the result of performing the ticket purchasing function on the identification information of the corresponding user apparatus that has purchased the ticket by the place (or store), the date, and the time of the place where the ticket is used.

For example, when the payment function for two movie tickets selected by the user of the eleventh user device is normally performed by interlocking with the eleventh user device, the service providing device 200, and the payment server 300, As shown in FIG. 6, the eleventh user apparatus displays a movie theater name (for example, ABCD movie theater) transmitted from the service providing apparatus 200, place unique identification information (for example, 001-002-003) Information (e.g., 10 October 2015 at 20:00 pm), tickets (e.g., 2 tickets), seating information (e.g., 11 and 12), total billing amount (e.g., 17,000 won) A ticket purchase function execution result 600 including payment date and time information (e.g., October 09, 2019, 09:09 am), a payment card type (for example, AA credit card) (S430).

The identification information collection device 400 then collects the identification information of the user device 100 that enters (or enters) the place (or store) related to the ticket sold by the service providing device 200.

That is, the identification information collection device 400 is installed at the entrance of the corresponding place, and the identification information collection device 400 is provided with identification information for requesting the identification information through the BLE communication method or the like to one or more user devices 100 entering (or entering) Broadcast (or transmit) the request signal. At this time, the identification information collection device 400 transmits the identification information request signal in consideration of the directivity so that the user device 100 located in the place only receives the identification information request signal.

The user device 100 entering the place receives the identification information request signal transmitted from the identification information collection device 400 through the BLE communication method or the like.

The user equipment 100 entering the place transmits the identification information of the corresponding user equipment 100 to the corresponding identification information collection unit 400 via the BLE communication system or the like in response to the received identification information request signal.

For example, the identification information collection device 400 installed at the entrance of the auditorium of the AA movie in the ABCD movie theater broadcasts an identification information request signal for requesting the identification information through the BLE communication method to the area in the entrance, (Or collects) the identification information of the plurality of user devices 100 transmitted from the plurality of user devices 100 including the eleventh user device, the twenty-first user device, and the like (S440).

Then, the identification information collection device 400 collects identification information of the collected one or more user devices 100, location information (or unique identification information by location), collection date and time information, identification information of the identification information collection device 400 And the like to the service providing apparatus 200. At this time, the identification information collecting apparatus 400 may transmit identification information of one or more user apparatuses 100 collected in advance sorted by location, date, and time, etc. to the service providing apparatus 200.

For example, the identification information collection device 400 may store identification information of 200 first to 200th user devices 100 collected, location information (e.g., ABCD movie theaters where AA movies are being screened), screened movie information Collection date and time information (for example, 19:45 to 20:30 pm on Oct. 10, 2015), identification information of the identification information collection apparatus 400, and the like, (S450).

Then, the service providing apparatus 200 collects identification information, place information (or unique identification information according to each place), collection date and time information of one or more user apparatuses 100 transmitted from the identification information collection apparatus 400, Identification information of the device 400, and the like.

In addition, the service providing apparatus 200 may store identification information of a plurality of (or more than one) user apparatuses that have purchased a ticket in association with a previously stored place and identification information of one or more user apparatuses transmitted from the identification information collection apparatus 400 Information is compared with each other, and it is confirmed whether or not the user device 100 purchasing the ticket for the place is present.

That is, in order to confirm whether or not the purchased ticket is used on the use day (or the usage period) after purchasing the ticket, the service providing apparatus 200 transmits a plurality of The identification information of one or more user apparatuses in which the identification information of the user apparatus and the identification information of one or more user apparatuses transmitted from the identification information collection apparatus 400 are overlapped. Also, the service providing apparatus 200 may store identification information of the remaining user equipments excluding the identification information of one or more user apparatuses that have been checked previously, among the identification information of the plurality of user equipments corresponding to the collection date and time information of the previously- . Also, the service providing apparatus 200 confirms that each user apparatus corresponding to the identification information of one or more user apparatuses that are overlapped has entered the corresponding place, and each of the other user apparatuses corresponding to the identification information of the remaining user apparatuses It is confirmed that they have not entered the place.

For example, the service providing apparatus 200 may store the collection date of the corresponding ABCD movie theater, which is transmitted from the identification information collecting apparatus 400, among the identification information of a plurality of user apparatuses by place / day / And the identification information of 220 user devices corresponding to the time information (for example, 19:45 to 20:30 pm on October 10, 2015) (or corresponding to the collected date and time information in October, 2015 The identification information of the 220 user devices that purchased the movie tickets screened at 20:00 pm on October 10). Also, the service providing device 200 confirms the identification information of the 200 first to 200th user devices transmitted from the identification information collection device 400 among the identification information of the 220 user devices that have been confirmed, in a state of entering the ABCD movie theater And enters into the corresponding ABCD movie theater, which is identification information of the remaining 200 user devices other than the identification information of the 200 first to 200th user devices transmitted from the identification information collection device 400 among the identification information of the identified 220 user devices (For example, 20 pieces of identification information of the 201th to the 220th user devices) of the user device without entering the ABCD movie theater (S460).

Then, the identification information collection device 400 acquires a preset event (for example, 1 minute) or a predetermined event (for example, a movie) through one or more cameras installed (or disposed) When a preset specific scene is outputted, when a whistling motion of a judge is detected in a sports game, etc.), the entire seat in the place is photographed. In this case, when a plurality of cameras are installed, the identification information collecting apparatus 400 divides all the seats in the place into a plurality of areas (or a plurality of areas by the number of cameras) And photographing one or more seats in the plurality of divided regions through a plurality of corresponding cameras.

In addition, the identification information collection device 400 collects image information including the entire seat taken, place information (or unique identification information according to each place), shooting date and time information per image information, identification information of the identification information collection device 400 And the like to the service providing apparatus 200. At this time, the identification information collection device 400 captures and temporarily stores a plurality of pieces of video information until the provision of the contents provided at the corresponding place is completed, and stores the contents provided at the corresponding places (for example, (Or a sporting event in progress in the case of a sporting event) is completed, a plurality of pieces of image information including the entire captured seats temporarily stored, place information (or unique identification information according to each place), shooting date and time (Or sports game information) screened (or progressed) at the corresponding place, identification information of the identification information collection apparatus 400, and the like to the service providing apparatus 200.

For example, the identification information collecting apparatus 400 may display the AA movie displayed at 20:00 pm on Oct. 10, 2015 at the ABCD movie theater through the first camera installed on the upper part of the screen at the center of the stage, (For example, the first to 120th video information) including all the seats in the ABCD movie theater in units of minutes set in advance by a predetermined time (for example, 20:00 pm to 22:00 pm on Oct. 10, 2015) Respectively.

As another example, the identification information collecting apparatus 400 may acquire the AA movie displayed at 20:00 pm on Oct. 10, 2015 at the ABCD theater through the individual cameras installed on the rear side of the front seat, (For example, October 10, 2015, from 20:00 pm to 22:00 pm), a plurality of pieces of image information including the corresponding seats corresponding to the individual cameras in the ABCD movie theaters are photographed in units of one minute set in advance.

Further, after the corresponding AA movie is ended, the identification information collecting apparatus 400 acquires a plurality of pieces of image information photographed in units of one minute, place information (for example, an ABCD movie theater displaying an AA movie) Visual information, and movie information (including, for example, the genre of the AA movie being screened, the production country, the screening time, the opening date, the viewing age information (or viewing rating information), the publisher, the distributor, Capturing date and time information for each image information, identification information of the identification information collecting apparatus 400, and the like to the service providing apparatus 200 (S470).

Thereafter, the service providing apparatus 200 displays a plurality of pieces of image information including all the seats in the corresponding place photographed at predetermined time intervals (or in the case where a preset event occurs) transmitted from the identification information collecting apparatus 400, (Or unique identification information for each place), shooting date and time information for each image information, movie information (or sports game information) being screened (or progressed) at the place, identification information of the identification information collection apparatus 400 do.

In addition, the service providing apparatus 200 confirms the seating information (or in / out information) of the user for each seat based on the received plurality of image information. At this time, the service providing apparatus 200 may calculate (or calculate) the seat occupancy rate (or the seat occupancy rate) of each seat based on the plurality of pieces of image information. Here, the seating rate of the user (or the seat occupancy rate) may be the seat occupancy rate of the user with respect to a plurality of pieces of image information.

That is, the control unit 250 counts the number of image information (or the number of user seats per seat) occupied by the user in the seats purchased by the user apparatus 100 from a plurality of pieces of image information.

In addition, the controller 250 calculates a seat occupancy rate of a user for each seat, which is a ratio between the number of pieces of image information and the number of seated seats per seat.

For example, the service providing apparatus 200 confirms whether or not a seat-based user is seated in an ABCD movie theater displaying an AA movie based on a plurality of pieces of image information transmitted from the identification information collecting apparatus 400.

That is, based on the plurality of pieces of image information transmitted from the identification information collecting apparatus 400, the service providing apparatus 200 transmits the user information of the user of the seats 11 and 12 corresponding to the two tickets purchased by the eleventh user apparatus Check whether you are seated.

In addition, the service providing apparatus 200 determines the eleventh seat occupancy rate (for example, the seat occupancy rate of the eleventh seat among the 120 video images is 120 times (For example, the eleventh seat occupancy rate corresponding to 120 * 100/120 = 100%), and calculates a twelfth seat occupancy rate for the seat 12 (for example, When a state is confirmed 120 times, the 12th seat occupancy rate corresponding to 120 * 100/120 = 100%) is calculated.

In another example, the service providing apparatus 200 may determine a seat occupancy rate of the 151st seat (for example, the seat occupied by the user in the 151st seat out of 120 pieces of video information) A seat occupancy rate of 151 seats corresponding to 90 * 100/120 = 75% when 90 times is confirmed), and calculates a seat occupancy rate of the 152th seat (for example, When the user is seated 90 times, a 152 seat occupancy rate corresponding to 90 * 100/120 = 75% is calculated (S480).

When the user is seated in the seat in the captured image information, the service providing device 200 recognizes the face of the user for each seat occupied by the user. At this time, the service providing apparatus 200 can recognize the face direction of the user, the focal direction of the user's eyes, and the like.

For example, when the eleventh user and the twelfth user are seated in the seats 11 and 12 corresponding to the two tickets purchased by the eleventh user apparatus, the service providing apparatus 200 displays the captured image information Recognizes the focus directions of the eyes of the eleventh user and the twelfth user who are seated in the seats 11 and 12 respectively.

In another example, when the 151st user and the 152th user are seated in the seats 151 and 152 corresponding to the two tickets purchased by the twenty-first user apparatus, respectively, the service providing apparatus 200 transmits the captured video The user recognizes the focus directions of the eyes of the 151st user and the 152th user sitting in the seats 151 and 152, respectively (S490).

Thereafter, the service providing apparatus 200 confirms whether the user is concentrating on an event occurring in the corresponding place, based on the information of the recognized face recognition of the user. Here, the event may be a movie being screened in the case of a movie theater, a sports game in progress in the case of a sports arena, and the like.

In addition, the service providing apparatus 200 generates (or calculates) a degree of concentration of the event of the user for each seat for the event based on the plurality of photographed image information. Here, the concentration of the event may be a concentration ratio of the user to the plurality of pieces of the image information.

That is, the control unit 250 determines the number of pieces of image information (or the number of pieces of image information) that the focus direction of the user who is seated in the seat purchased by the user apparatus 100 among the plurality of pieces of image information, The number of star screen candidates).

In addition, the controller 250 calculates the concentration of the user for each seat, which is a ratio between the number of the plurality of image information and the number of screen candidates counted by the seat.

For example, the service providing apparatus 200 determines whether the focus direction of the eyes of the eleventh user who is seated at the recognized seat 11 is facing the screen at the center of the stage where the AA movie is being screened. At this time, the service providing apparatus 200 determines that the focus direction of the eyes of the eleventh user who is seated in the seat 11 of the first to 120th image information is the ratio of the eyes toward the screen at the center of the stage, (For example, 110 * 100/120 = 91.7% when the number of image information in which the focus direction of the eye of the 11th user is directed to the screen is 110 among 120 pieces of image information) (The eleventh concentration degree).

In another example, the service providing apparatus 200 confirms that the focal direction of the eye of the user 151 seated in the recognized seat 151 is facing the screen at the center of the stage where the AA movie is being screened. At this time, the service providing apparatus 200 determines that the focus direction of the eyes of the 151st user who is seated in the corresponding seat 151 with respect to the first to 120th video information is the ratio of the eyes toward the center screen of the stage, (For example, if the number of pieces of image information in which the focus direction of the eye of the 151st user is facing the screen is 60 in 120 pieces of image information, 60 * 100/120 = 50% 151) is calculated (S500).

Thereafter, the service providing apparatus 200 determines whether or not the user apparatus 100 has been previously identified, whether or not the seating information of the user for each seat determined (or the seat seating rate of the user for each seat) The concentration of the user by the seat), the field information of the preset event, and the like, one or more events are selected from a plurality of events that are currently in progress or are scheduled to be performed in the future. At this time, the service providing apparatus 200 may notify accumulated information on whether or not the user device 100 has accumulated accumulated entrance information, seating information of the user by the accumulated seats, (Or a plurality of movies, sports games, and the like) that are currently being performed or are scheduled to be performed in the future, in consideration of the seating information of the identified seats, One or more events (or one or more movies, sports games, etc.) may be selected.

In addition, the service providing apparatus 200 transmits information on the selected one or more events (including, for example, recommended movie information, recommended sports game information, etc.) to the user device 100. Here, the information about the event may include information such as a movie title, a movie genre, a movie opening date, a movie theater name, a movie theater to be screened, a viewing age information (or viewing rating information), a publisher, A name of the main actor, etc., and if the event is a sporting event, it may include a sports name, a home team and opponent team information, a scheduled game date, and a competition place.

For example, the service providing apparatus 200 may determine whether or not the eleventh user apparatus is present, information on seating of the user by the identified seat (including, for example, the eleventh seat occupancy rate of 100% (E.g., 91.7%) of 11 users, genre information (for example, action) of a preset AA movie, a plurality of accumulated sitting information viewed from the 11th user apparatus, , Selects one or more recommended movies from a plurality of movies currently being screened or scheduled to be screened within a month, and displays information (e.g., movie title: BB movie, movie genre: action, movie To-be-released date: November 1, 2015, the name of the movie theater to be screened: ABCD movie theater, etc.) to the eleventh user device.

As another example, the service providing apparatus 200 may include information on the presence or absence of the 21st user device, seating information of the user for each confirmed seat (for example, including the seat occupancy rate of the 151st seat at 75%), (E.g., 50%) of the 151st user, genre information (for example, action) of the preset AA movie, a plurality of accumulated sitting information viewed from the 21st user device, , The 151th seat occupancy rate is lower than a preset seat occupancy rate reference value (for example, 80%, which is a reference value for seat occupancy rate), and the 151th concentration degree is a predetermined concentration reference value (for example, Is lower than the reference value of 75%), the movie of the corresponding action genre watched by the user 151 among the plurality of movies currently being screened or scheduled to be screened within one month (Eg, movie title: CC movie, movie genre: animation, movie release date: November 15, 2015), and selects one or more other recommended movies from among the plurality of movies , Movie theater name: ABCD movie theater, etc.) to the twenty-first user device (S510).

Thereafter, the user device 100 receives information on one or more events transmitted from the service providing apparatus 200,

In addition, the user device 100 displays and stores information about the received one or more events.

7, the user device 100 may acquire information about one or more recommended movies transmitted from the service providing apparatus 200 (for example, a movie title: BB movie, a movie genre: action, (Scheduled date: November 1, 2015, the name of the movie theater to be screened: ABCD movie theater, etc.) 700 (S520).

The apparatus for providing a service for recommending a movie using the BLE and the face recognition technology according to an embodiment of the present invention and the movie recommendation service system including the same can be formed as a computer program, and the codes and code segments constituting the computer program Can be easily deduced by a computer programmer. In addition, the computer program is stored in a computer readable medium readable by a computer and read by a computer, a user apparatus, a service providing apparatus, a payment server, an identification information collecting apparatus or the like according to an embodiment of the present invention A service providing device for recommending movies using BLE and face recognition technology, and a movie recommendation service system including the service providing device.

The information storage medium includes a magnetic recording medium, an optical recording medium, and a carrier wave medium. A service providing apparatus for recommending movies using the BLE and face recognition technology according to an embodiment of the present invention, a computer program implementing the movie recommendation service system including the same, a user apparatus, a service providing apparatus, a payment server, Lt; RTI ID = 0.0 > internal memory. ≪ / RTI > Alternatively, an external memory such as a smart card storing and installing a computer program implementing the movie recommendation service system including the BLE and the service providing device for movie recommendation using the face recognition technology according to the embodiment of the present invention, A service providing apparatus, a payment server, an identification information collecting apparatus, or the like.

The embodiment of the present invention collects identification information of one or more user apparatuses entering a place related to a ticket through a BLE communication method and transmits the identification information to the corresponding seat through one or more cameras installed in a place related to the ticket The face of the user of the seated user apparatus is photographed and the facial recognition technology is applied to the face of the photographed user to check whether the user is concentrating on the situation in progress in the place or is sleepy, And the situation information in progress in the corresponding place, and then provides the recommendation information to the user device based on the information stored later and the situation information in progress in the place, and when recommending the movie to the user in the future It is possible to perform sophisticated targeting, thereby increasing the satisfaction of the user.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or essential characteristics thereof. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

The present invention collects identification information and the like of one or more user apparatuses entering a place related to a ticket through a BLE communication method and transmits the user's face of the user of the corresponding user apparatus seated in the seat through one or more cameras installed in a place related to the ticket And the facial recognition technology is applied to the photographed face of the user to confirm whether the user is concentrating on the ongoing situation in the place or whether he is sleeping. Then, after confirming the confirmed information and the progress status information The recommendation information is provided to the user device based on the information stored later and the situation information in the place, so that the user can perform more advanced targeting in case of recommending the movie to the user in the future, It can increase the satisfaction of users, ticket booking / payment field, advertisement Etc. Marketing areas, like film sector, the service sector provides the device, the user device applications, billing server field can be widely used.

10: Movie recommendation service system 100: User device
200: service providing apparatus 300: payment server
300: identification information collection device 110: user device communication part
120: user device storage unit 130: user device display unit
140: User device voice output unit 150: User device control unit
210: communication unit 220:
230: Display section 240: Audio output section
250:

Claims (11)

A collection date and time information of one or more user apparatuses collected for a user apparatus entering a place where the identification information collection apparatus is located, a location information, and a plurality of A communication unit for receiving image information, shooting date and time information for each image information, movie information being displayed at the place, and identification information of the identification information collection apparatus;
A storage unit for storing identification information of a plurality of user devices that have purchased a ticket in association with the place; And
Determining whether a user enters a place based on the identification information of the one or more user apparatuses, calculating a seat occupancy rate of a user for each seat based on the plurality of image information, And the information on whether or not the user concentrates on the movie is calculated based on information on the face recognition of the user recognized during the middle of the session, A controller for selecting one or more recommended movie information based on the calculated rate of concentration of the user by seat, accumulated information of accumulated admission with respect to the user device, seating information of the user by accumulated seats, Service provider. The method according to claim 1,
Wherein the control unit is configured to store the location information previously stored in the storage unit and identification information of a plurality of user apparatuses corresponding to the collection date and time information and identification information of one or more user apparatuses transmitted from the identification information collection apparatus Confirms the identification information of the user apparatus, and confirms whether or not the user equipment enters the location. The method according to claim 1,
Wherein the control unit calculates the seat occupancy rate as a ratio of the number of pieces of image information occupied by the user to the seats purchased by the user apparatus among the plurality of pieces of image information for the number of pieces of image information. Device. The method according to claim 1,
Wherein the control unit is configured to determine whether the focus direction of the eye gazed by the user who is seated in the seat purchased by the user apparatus among the plurality of image information on the number of the plurality of image information is equal to the number of image information And the concentration calculating unit calculates the concentration degree. The method according to claim 1,
The selected recommended movie information includes at least one of a movie title, a movie genre, a movie opening date, a movie theater being screened, a movie theater to be screened, a viewing age information, a manufacturer, a distributor, The service providing apparatus comprising: Collection date and time information of one or more user apparatuses collected for a user apparatus entering the place where the identification information collection apparatus is placed from the identification information collection apparatus via the communication unit, Receiving identification information;
Confirming whether or not the user equipment enters a place with the identification information of the received one or more user devices through the control unit;
A plurality of pieces of image information photographed at predetermined time intervals transmitted from the identification information collection device, the place information, the shooting date and time information of each image information, the movie information being played at the place, Receiving identification information of the device;
Calculating a seat occupancy rate of a user for each seat based on the plurality of image information through the control unit;
Calculating a degree of concentration of a user by seat based on information on a face recognition of the user recognized when the user is seated in the seat in the image information through the control unit and indicating whether the user is concentrating on the movie;
Information on whether or not the user equipment is present, the calculated seat occupancy rate of the user by each seat, the calculated concentration information of the user by the seat, the accumulated entrance information related to the user device, Selecting at least one recommended movie information on the basis of the sitting information and the cumulative concentration of each movie; And
And transmitting the selected at least one recommended movie information through the communication unit. The method according to claim 6,
Wherein the step of verifying whether or not the user equipment enters a place comprises: storing the place information previously stored in the storage unit, identification information of a plurality of user equipments corresponding to the collection date and time information, and identification information of one or more users Wherein identification information of at least one user device in which identification information of the device is duplicated is checked to confirm whether or not the user equipment enters the place. The method according to claim 6,
The step of calculating the seat occupancy rate of the seat-
Counting the number of image information occupied by the user in a seat of the first user apparatus among the plurality of image information through the control unit; And
And calculating a first seat occupancy rate, which is a ratio between the number of the plurality of pieces of image information and the number of image information occupied by the user in the seat purchased by the counted first user apparatus through the control unit To the service providing apparatus. The method according to claim 6,
Wherein the step of calculating the concentration of the user for each seat comprises:
And a control unit for controlling the display unit so that the focus direction of the eyes of the first user who is seated in the seat purchased by the first user equipment out of the plurality of pieces of image information is the number of image information of the first seat A process of counting the number of screen candidates; And
And calculating a first concentration through the controller, the ratio being a ratio between the number of the plurality of image information and the number of screenings of the first seat. 10. A recording medium on which a computer program for performing the method according to any one of claims 6 to 9 is recorded. Acquiring identification information, collection date and time information of one or more user apparatuses collected for a user apparatus entering a place where the identification information collection apparatus is located, location information, and identification information of the identification information collection apparatus, The identification information collection device for photographing all seats in a place, providing identification information of the identification information collection device, image information including the captured entire seats, the place information, the photographing date and time information for each image information, and identification information of the identification information collection device;
Determining whether a user enters a place based on the identification information of the one or more user apparatuses, calculating a seat occupancy rate of a user for each seat based on the plurality of image information, And the information on whether or not the user concentrates on the movie is calculated based on information on the face recognition of the user recognized during the middle of the session, A service for selecting one or more recommended movie information based on the calculated rate of concentration of the user for each seat, accumulated admission information related to the user device, sitting information of the user for each accumulated seat, and cumulative concentration for each movie Device; And
And a user device for displaying the at least one recommended movie information provided from the service providing apparatus.

Images