KR102536526B1 - Method and apparatus for providing service based on terminal context - Google Patents

Abstract

The present invention relates to a service providing method based on terminal context information for improving user experience for various online services including user-customized services, and relates a user's response while using a service to terminal context information collected from the user device. based on real-time analysis and change the service content according to the change trend of the analyzed user response.

Description

Method and apparatus for providing service based on terminal context information {Method and apparatus for providing service based on terminal context}

In the present invention, in providing a predetermined service to a user device through a network, a user's reaction while using the service is analyzed in real time based on terminal context information collected from the user device to change the service content. It relates to a service providing method and device.

Due to the development of information and communication technology along with the performance improvement of user terminal devices, the use of various network-based online services is becoming common. Representative examples of the online service include an e-commerce service, a digital content sharing service, a search service, and a data backup service.

In addition, as these various online services and the amount of information provided through such online services increase exponentially, user-customized services that support users to more easily access desired information among the various information provided through them have emerged.

The user-customized service guesses information (products) that the user is interested in or needs, and provides related information to the user. Since the user can receive the information (products) he or she is interested in without extra effort, the above-mentioned user It is a service that can reduce the inconvenience of

In such a user-customized service, recommendation information provided to a user is usually extracted based on a user's context (circumstance information). Here, the context refers to information that defines the characteristics of a situation, such as a person, place, thing, object, time, etc., that affects interactions between a user and other users, systems, or applications on devices, and refers to the state of network connectivity. , communication bandwidth, and computing contexts such as printers, displays, and workstations, user contexts including user profile, location, and people around them, and physical conditions such as lighting, noise levels, traffic conditions, and temperature. (Physical context), and time context (time context) such as hour, week, month, and season.

For example, in the case of an online shopping mall, after analyzing the user's interest or preference by using information such as the user's purchase history, shopping cart or wish list information containing products of interest to the user, and search history, Accordingly, recommendation information is extracted.

However, conventionally used user context information is the user's past data and represents the user's past preference or interest. However, since the user's preference or interest can change, the reliability of the service provided through the user-customized service or the user's satisfaction There is a problem that is low.

Korean Patent Registration No. 10-0608645, registered on July 27, 2006 (Name: Apparatus and method for providing recommended content in real time)

The present invention is proposed to improve the user experience for various online services including user-customized services, and analyzes the user's response while using the service in real time based on terminal context information collected from the user device to provide service content. It is to provide a service providing method and apparatus based on changing terminal context information.

As a means to solve the above problems, the present invention provides a service providing method based on terminal context information performed by a service providing server that transmits service data to a user device through a network and provides a predetermined service.

A service providing method according to the present invention includes the steps of: collecting, from a user device receiving service data, service identification information corresponding to the service data and terminal context information related to an interaction between the user device and a user while using the service; analyzing terminal context information collected for each service identification information, and extracting user response information about service contents corresponding to the service identification information; extracting a trend of change in user response by analyzing user response information for each service identification information extracted over a certain period of time in a time series; and updating the service data based on a change trend of a user response according to a change in the service content.

The updating may include generating and providing update information of the service based on a change trend of the user response.

In addition, the present invention provides a service providing server as another solution to the above problems.

The service providing server may include a communication module for transmitting and receiving data with one or more user devices over a network; a service providing module providing service data to the user device through the communication module; and collecting, from the user device, service identification information for distinguishing the contents of the service being used by the user and terminal context information related to the interaction between the user and the user device while the user is using the service, and analyzing the terminal context information to After extracting user response information for the service contents corresponding to the service identification information, the user response information for each service identification information for a certain period of time is analyzed in time series to extract the change trend of the user response, and according to the change trend of the user response and a feedback processing module controlling to update the service data.

The feedback processing module generates update information of the service and outputs the update information based on a change in the content of the service or a change trend of a user's response to the content of a specific service over time.

In the present invention, the terminal context information includes at least one of a user image, a user voice, and one or more sensing signals, and the user reaction information is a user's emotional state extracted through at least one of video analysis and voice analysis. As information representing, it is defined as a value representing the degree of at least one of negative emotion and positive emotion, and the update information is service identification information corresponding to a section in which negative emotion or positive emotion is extracted above a preset threshold value and corresponding It may include update direction information including at least one of deletion, change, and addition of service contents included in the service interval.

The present invention relates to providing an online service to a user device connected to a network. In providing a non-face-to-face online service, terminal context information detected by the user device while providing the service is collected, and the terminal context information Based on this, the user's response is extracted, but by analyzing it in a time series, the change trend of the user's response according to the change in the service content or over time is extracted, and through this, the user's evaluation of the service content can be extracted more accurately, Through this, an improved user experience can be provided to the user by updating service contents.

1 is a diagram showing a service providing system to which the present invention is applied.
2 is a block diagram showing the configuration of a service providing server according to the present invention.
3 is a block diagram showing the configuration of a user device according to the present invention.
4 is a flowchart illustrating a process of providing a terminal context-based service according to an embodiment of the present invention.
5 is a flowchart illustrating the operation of a service providing server according to an embodiment of the present invention.
6 and 7 are exemplary views illustrating an example of providing a terminal context-based service according to an embodiment of the present invention.

In order to clarify the characteristics and advantages of the problem solving means of the present invention, the present invention will be described in more detail with reference to specific embodiments of the present invention shown in the accompanying drawings.

However, detailed descriptions of well-known functions or configurations that may obscure the gist of the present invention will be omitted in the following description and accompanying drawings. In addition, it should be noted that the same components are indicated by the same reference numerals throughout the drawings as much as possible.

The terms or words used in the following description and drawings should not be construed as being limited to a common or dictionary meaning, and the inventor may appropriately define the concept of terms for explaining his/her invention in the best way. It should be interpreted as a meaning and concept consistent with the technical idea of the present invention based on the principle that there is. Therefore, the embodiments described in this specification and the configurations shown in the drawings are only one of the most preferred embodiments of the present invention, and do not represent all of the technical ideas of the present invention. It should be understood that there may be equivalents and variations.

In addition, terms including ordinal numbers, such as first and second, are used to describe various components, and are used only for the purpose of distinguishing one component from other components, and to limit the components. Not used. For example, a second element may be termed a first element, and similarly, a first element may be termed a second element, without departing from the scope of the present invention.

Additionally, when an element is referred to as being “connected” or “connected” to another element, it means that it is logically or physically connected or capable of being connected. In other words, it should be understood that a component may be directly connected or connected to another component, but another component may exist in the middle, or may be indirectly connected or connected.

In addition, terms used in this specification are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In addition, terms such as "include" or "having" described in this specification are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or the other It should be understood that the above does not preclude the possibility of the presence or addition of other features, numbers, steps, operations, components, parts, or combinations thereof.

In addition, terms such as "~ unit", "~ group", and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software. there is.

Also, "a or an", "one", "the" and similar words in the context of describing the invention (particularly in the context of the claims below) indicate otherwise in this specification. may be used in the sense of including both the singular and the plural, unless otherwise clearly contradicted by the context.

In addition, embodiments within the scope of the present invention include computer-readable media having or conveying computer-executable instructions or data structures stored thereon. Such computer readable media can be any available media that can be accessed by a general purpose or special purpose computer system. By way of example, such computer readable media may be in the form of RAM, ROM, EPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage, or computer executable instructions, computer readable instructions or data structures. physical storage media such as, but not limited to, any other medium that can be used to store or convey any program code means in a computer system and which can be accessed by a general purpose or special purpose computer system. .

In the following description and claims, a "network" is defined as one or more data links that enable the transfer of electronic data between computer systems and/or modules. When information is transmitted or provided to a computer system over a network or other (wired, wireless, or combination of wired or wireless) communication connection, the connection may be understood as a computer-readable medium. Computer readable instructions include, for example, instructions and data that cause a general purpose or special purpose computer system to perform a particular function or group of functions. Computer executable instructions may be, for example, binary, intermediate format instructions, such as assembly language, or even source code.

In addition, the present invention relates to personal computers, laptop computers, handheld devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, mobile phones, PDAs, pagers In a network computing environment having various types of computer system configurations including a pager, etc., it can be applied to provide an image search service to the computer systems. The invention may also be practiced in distributed system environments where tasks are performed by both local and remote computer systems linked by wired data links, wireless data links, or a combination of wired and wireless data links through a network. In a distributed system environment, program modules may be located in local and remote memory storage devices.

First, a service system according to an embodiment of the present invention will be described.

1 is a diagram illustrating a service providing system according to an embodiment of the present invention.

Referring to FIG. 1 , the service providing system includes a service providing server 100 and a user device 200 connected through a network NW.

The service providing server 100 and the user device 200 may interoperate by transmitting and receiving data to each other through the network NW. For example, the network NW may include a wireless communication network such as wireless LAN (WLAN), Wi-Fi, Wibro, Wimax, High Speed Downlink Packet Access (HSDPA), Depending on the system implementation method, a wired communication network such as Ethernet, xDSL (ADSL, VDSL), HFC (Hybrid Fiber Coaxial Cable), FTTC (Fiber to The Curb), FTTH (Fiber To The Home) may be included.

In addition, the network NW used in the present invention may include a mobile communication network consisting of a plurality of access networks (not shown) and a core network (not shown) connecting them. Here, the access network is a network that is directly connected to a terminal and performs wireless communication. For example, a plurality of base stations such as BS (Base Station), BTS (Base Transceiver Station), NodeB, eNodeB, etc. , may be implemented as a base station controller such as a radio network controller (RNC). In addition, as described above, the digital signal processing unit and the radio signal processing unit, which were integrally implemented in the base station, are divided into digital units (hereinafter referred to as DUs) and radio units (hereinafter referred to as RUs), and a plurality of It may be configured by installing a plurality of RUs (not shown) in each area of , and connecting the plurality of RUs to a centralized DU In addition, the core network (not shown) constituting the mobile network together with the access network is Network, for example, serves to connect other communication networks such as the Internet network.

As described above, the core network is a network system that performs major functions for mobile communication services such as mobility control and switching between access networks, and performs circuit switching or packet switching. It manages and controls the flow of packets within it. In addition, the core network may manage inter-frequency mobility and perform a role for interworking with traffic in the access network and the core network and other networks, such as the Internet network. The core network may further include a Serving GateWay (SGW), a PDN GateWay (PGW), a Mobile Switching Center (MSC), a Home Location Register (HLR), a Mobile Mobility Entity (MME), and a Home Subscriber Server (HSS). may be

In addition, the network NW according to the present invention may include an Internet network. The Internet network refers to a common open communication network, that is, a public network in which information is exchanged according to the TCP/IP protocol.

Through this network (NW), the service providing server 100 and the user device 200 interwork with each other to form a service providing system according to the present invention.

At this time, the services provided through the service providing server 100 are various online services that are currently provided or expected to be provided in the future, for example, e-commerce services that support purchasing and selling products online; It can be a search service that searches for information from various sources accessible through a network, a digital content sharing service that supports sharing of various digital contents including user-generated video (UCC), and a personal broadcasting service.

The present invention can be applied to the service providing server 100 that provides these various online services, but for convenience of description below, it is assumed that an e-commerce service that supports the sale and purchase of products by connecting sellers and buyers is provided. Let's explain. Therefore, the following embodiments do not limit the present invention to e-commerce services, and the present invention can be applied to any other online services.

Specifically, the service providing server 100 transmits service data corresponding to the service requested by the user device 200 to the user device 200 . For example, in the case of providing an e-commerce service, the service providing server 100 transmits service data corresponding to the main screen of an e-commerce site to the user device 200 according to an access request from the user device 200. According to the user's selection on the main screen, a product list of a specific category may be provided to the user device 200, and data for payment for a specific product may be provided to the user device 200 according to the user's request. ) is provided.

The user device 200 constructs and outputs a predetermined user interface (UI) screen based on the service data provided by the service providing server 100, and sends a user selection or command for this to the service providing server 100. convey

In addition, the service providing server 100 may generate user-customized recommendation information based on user context information and provide it to the user device 200 of the corresponding user. To this end, the service providing server 100 collects and prepares various user context information about the user in advance. The user context information is information defining characteristics of a situation, such as a person, place, thing, entity, time, etc., that affects interactions between a user and another user, system, or device application, for example, It can be user's web use information, and after collecting the web use information through a browser, it can be classified or identified for each user using a cookie (Coolie). The web use information includes information on a site and/or page accessed by a user.

The service providing server 100 extracts the field of interest (or category) of the user based on the user context information collected as described above, and generates recommendation information consisting of a plurality of recommended items related to the field of interest of the extracted user. provided to the device 200.

Here, the recommendation information may be items that the user has a purchase history based on the user's past history or items that are highly related to the purchases. In addition, the recommendation information may include one or more recommended items such as product information, advertisement information, and digital content information, and the recommended items may be arranged or output in a priority order according to a user's preference.

In addition, the recommendation information is transmitted to the user device 200 in various ways. For example, a push method that transmits information unilaterally without a user's request, and information is transmitted according to a request from the user device 200. It can be provided in a pull method.

The user device 200 receiving these various online services provides various services to the user based on the service data received from the service providing server 100, but various terminal context information related to the user's response while the service is being provided. is collected and provided to the service providing server 100. Here, the terminal context information refers to situation data collected by the user device 100 itself, and includes, for example, a user image captured through a camera provided in the user device 200 and a microcomputer of the user device 200. It may include the collected user's voice, the physical change of the user device 200 collected by various sensors such as a gyroscope sensor, an acceleration sensor, and the like.

In the present invention, the user device 200 continuously collects terminal context information while a user uses a service. The collection of such terminal context information may be performed as a background operation.

The service providing server 100 provides service identification information indicating the contents of the service being used by the user at the time when the terminal context information transmitted from the user device 200 is collected by the user device 200 while providing the service. Match with and save. To this end, the service providing server 100 matches and manages service identification information corresponding to the contents of the service provided to the user device 200 with a service providing time, and obtains terminal context information from the user device 200. At the time of reception, the collection point of the corresponding terminal context information is received together, and the service identification information and the terminal context information are matched based on time.

The service providing server 100 can classify and manage terminal context information collected from an unspecified number of user devices 200 according to service identification information and service provision time, and can further manage them separately for each user.

As described above, when the service providing server 100 collects terminal context information from the user device 200 using the service for a certain period of time, the collected terminal context information is analyzed to extract user reaction information.

Specifically, the terminal context information may be one or more of a user image captured by a camera, a user voice collected through a microphone, and motion information measured by one or more sensors, and the user reaction information may include the above-described terminal context information. The information may be analyzed and extracted to become information representing the user's emotional state. The user reaction information may be defined as a value for one or more of negative emotion and positive emotion.

In addition, the service providing server 100 arranges the service identification information representing the service contents used by the user and the corresponding user reaction information in a time series to extract the change trend of the user response according to the change in the service contents, and based on this, the Create update information related to service contents.

The update information includes service identification information corresponding to a section in which negative emotions or positive emotions are extracted at a predetermined threshold or higher, and an update direction including at least one of deletion, change, and addition of service contents included in the corresponding service section. information may be included.

In this way, by organizing and providing user responses to the service provided by the service providing server 100, the service provider operating the service providing server 100 provides information provided by the service providing server 100 based on the updated information. You can update the contents of the service to be performed.

For example, through the above-described process, the service providing server 100 provides a main page of an e-commerce site, a plurality of category pages linked from the main screen to provide product information for each category, and event information for a specific period. Event page, payment page linked from a specific product page, best product service area that provides best product information based on product sales ranking within the main page, recommendation service area that displays recommended products based on user context, etc. By extracting and analyzing the reaction trend of multiple users for each service content to be provided, the appropriateness of each service content can be determined, and guide information on the part to be corrected, deleted, or added among the service contents can be provided. In addition, the present invention may provide different user experiences for each user by extracting the user's response trend for each service content described above.

For example, a service content candidate group is prepared for each service area, and appropriate service content is selected and provided to the user from among the service content candidate group according to the above-described user reaction trend, so that each user can have a different user experience. For example, while the response to the recommendation service is negative and the number of uses of the search service is low, the recommendation service area may not be provided for users who use the search service a lot, and each service according to the user's reaction trend analysis It is possible to change the layout of the access path of the area.

The service providing server 100 operating as described above is an entity connected to the network NW and implemented as a web server, a database server, and an application server. can According to a preferred embodiment, the service providing server 100 may be a server supporting a portal site including a search engine, and may be an online shopping mall server supporting electronic commerce.

In addition, the user device 200 describes a mobile communication terminal as a representative example, but the terminal is not limited to the mobile communication terminal, and all information communication devices, multimedia terminals, wired terminals, fixed terminals, and IP (Internet Protocol) terminals are used. It can be applied to various terminals. As an example, the terminal is a mobile phone having various mobile communication specifications such as a mobile phone, a portable multi-media player (PMP), a mobile internet device (MID), a smart phone, a tablet PC, a phablet PC, and an information communication device ( It can be advantageously used when it is a mobile) terminal. As another example, the terminal may be a laptop computer or a personal computer.

Next, detailed configurations of the above-described service providing server 100 and user device 200 will be described.

First, with reference to FIG. 2, the configuration of the service providing server 100 according to an embodiment of the present invention will be described.

2 shows the configuration of a service providing server according to the present invention.

Referring to FIG. 2 , the service providing server 100 includes a communication module 110 , a storage module 120 and a control module 130 .

The communication module 110 is for communication with the user device 200 . The communication module 110 accesses the network NW, and exchanges data including necessary information with the user device 200 when the user device 200 accesses the service providing server 100 through the network NW. to communicate in order to When receiving data to be transmitted from the control module 130 to the user device 200, for example, service data requested by the user, the communication module 110 forms packets and transmits them. In addition, the communication module 110 extracts data, that is, terminal context information, from a packet received from the user device 200 and transmits the extracted data to the control module 130 .

The storage module 120 serves to store programs and data necessary for the operation of the service providing server 100, and may be divided into a program area and a data area. The program area may store a program for controlling the overall operation of the service providing server 100, an operating system (OS) for booting the service providing server 100, an application for image search, and the like. The data area is an area where data generated according to the operation of the service providing server 100 and data necessary for the operation of the service providing server 100 are stored. For example, the storage module 120 stores service identification information and/or terminal context information classified and collected for each user, and also stores updated information generated through analysis of the terminal context information. Various types of data stored in the storage module 120 may be deleted, changed, or added according to a user's manipulation.

The control module 130 may control the overall operation of the service providing server 100 and signal flow between internal blocks of the service providing server 100, and may perform a data processing function of processing data. Preferably, the control module 130 is a microprocessor or a central processing unit (CPU). When classified according to their functions, the control module 130 includes a service providing module 131 and a feedback processing module 133. The service providing module 131 is a component for providing the requested service to the user device 200, and the feedback processing module 133 is the user device 200's response to the service provided by the service providing module 131. A component for extracting user response information for the provided service by receiving and analyzing terminal context information, and updating the service such as deletion, addition, or change based on this.

Specifically, when a service request is received from the user device 200 through the communication module 110, the service providing module 131 transmits service data corresponding to the requested service through the communication module 110 to the user device ( 200) is provided. The service data may be, for example, a web page made of HTML. Here, since the service provided through the service providing module 131 may vary depending on the business field of the service provider, a detailed description thereof will be omitted.

Next, the feedback processing module 133 is a service for distinguishing the service contents provided by the terminal context information that appears while providing the service from the user device 200 to which the service is provided by the service providing module 131. It is collected along with identification information and analyzed to support renewal of the service. Specifically, the feedback processing module 133 accumulates and analyzes the terminal context information received from the plurality of user devices 200 for each matched service identification information to extract a statistical response of users for each content of the provided service, By accumulatively analyzing the terminal context information received from the specific user device 200 over a predetermined period of time, it is possible to extract a change trend of a user response according to a change in service content of a specific user. Further, the feedback processing module 133 may generate updated information about the service based on the analysis result and provide the updated information to the service provider or service manager so that the service content is updated based on the user response.

Next, a detailed configuration of the user device 200 according to an embodiment of the present invention will be described.

3 is a block diagram showing the configuration of a user device according to the present invention.

Referring to FIG. 3 , the user device 200 according to an embodiment of the present invention includes a communication unit 210, an input unit 220, a display unit 230, a storage unit 240, a control unit 250, and a camera unit 260. , a sensor unit 270, and an audio processing unit 280.

The communication unit 210 is for communication with other devices including the service providing server 100, and performs communication through various communication connection methods. The communication unit 210 may communicate by selecting any one of communication functions of various communication connection methods. Such communication unit 210 may be implemented as one module or a plurality of modules. For example, the communication unit 210 is a broadband mobile communication method for accessing a network through a base station according to standards such as WCDMA, LTE, LTE-A, etc., and a wireless local area network (WLAN) method using Wi-Fi (wireless fidelity). A wireless short-distance communication method or the like that performs communication by accessing a network through an access point (AP) may be used. The communication unit 210 may include an RF transmitter for up-converting and amplifying the frequency of a transmitted signal, and an RF receiver for low-noise amplifying and down-converting the frequency of a received signal. Through this configuration, the communication unit 210 can convert data received from the control unit 250, for example, a user request or terminal context information, into a wireless signal and transmit it through a wireless channel. Also, the communication unit 210 may receive a radio signal including service data through a radio channel and transmit the received radio signal to the controller 250 .

The input unit 220 receives a user's key manipulation for controlling the user device 200, generates an input signal, and transmits it to the control unit 250. The input unit 220 may include any one of a power key for power on/off, a number key, and a direction key, and may be formed as a predetermined function key on one side of the user device 200. When the display unit 230 is made of a touch screen, the functions of various keys of the input unit 220 can be performed on the display unit 230, and when all functions can be performed only with the touch screen, the input unit 220 can be omitted. may be

The display unit 230 visually provides the menu of the user device 200, input data, function setting information, and other various information to the user. The display unit 230 performs a function of outputting various screens such as a booting screen, a standby screen, and a menu screen of the user device 200 . The display unit 230 may be formed of a Liquid Crystal Display (LCD), Organic Light Emitting Diodes (OLED), Active Matrix Organic Light Emitting Diodes (AMOLED), or the like. Meanwhile, the display unit 230 may be implemented as a touch screen. In this case, the display unit 230 includes a touch sensor, and the controller 250 can detect a user's touch input through the touch sensor. The touch sensor may be configured as a touch sensor such as a capacitive overlay, a pressure sensor, a resistive overlay, or an infrared beam, or a pressure sensor. . In addition to the above sensors, all types of sensor devices capable of detecting contact or pressure of an object may be used as the touch sensor of the present invention. The touch sensor senses a user's touch input, generates a detection signal, and transmits it to the controller 250 . These detection signals may include coordinate data of a user's touch input. When a user inputs a touch location movement operation, the touch sensor may generate a detection signal including coordinate data of a touch location movement path and transmit the detected signal to the controller 250 .

The storage unit 240 serves to store programs and data necessary for the operation of the user device 200, and may be divided into a program area and a data area. The program area may store a program for controlling the overall operation of the user device 200, an operating system (OS) for booting the user device 200, and an application program. The data area is an area where data generated according to the use of the user device 200 is stored. In addition, the storage unit 240 may store various kinds of data generated according to the operation of the user device 200 .

The control unit 250 may control overall operation of the user device 200 and signal flow between internal blocks of the user device 200, and may perform a data processing function of processing data. The control unit 250 may be a central processing unit (CPU), an application processor, a graphic processing unit (GPU), or the like. The control unit 250 controls the communication unit 210 according to the user input signal transmitted from the input unit 220 to access the service providing server 100, and provides the user with a predetermined value through interworking with the service providing server 100. provide a service

The user device 200 configured as described above may receive service data from the service providing server 100 through the communication unit 210 . The service data is provided at the request of the user and may be provided in a full manner. However, it is not limited thereto, and as another embodiment of the present invention, it may be transmitted from the service providing server 100 without a user request in a push method. In addition, the service data may be a web page composed of a language such as HTML.

When service data is received as described above, the controller 250 processes the received service data and outputs the processed data through the display unit 230 (S310). For example, in the case of a web page, the controller 250 randomizes the web page through a web browser and outputs the web page through the display unit 230 .

In addition, the controller 250 of the user device 200 according to the present invention does not stop at outputting service data to the user, and while a service screen corresponding to the service data is output, the camera unit 260 and the sensor unit ( 270), the audio processing unit 280, etc. collects terminal context information and transmits it to the service providing server 100.

Such terminal context information may be at least one of a user image captured by the camera unit 260, motion detected through one or more sensors provided in the sensor unit 270, and user voice collected through the microphone of the audio processing unit 280. includes

At this time, in the case of image data photographed by the camera unit 260, the amount of data may be large, and if the amount of data is large, it may not be smoothly transmitted in the network NW.

Therefore, the control unit 250 of the user device 200 according to the present invention does not transmit video data or audio data as it is, but extracts characteristic information through video analysis or voice analysis and then transmits only the characteristic information. . In addition, indiscriminate traffic generation can be reduced by sampling detection signals sensed from the plurality of sensors of the plurality of sensor units 270 at regular intervals or transmitting only when a change occurs.

The above-described terminal context information is situational information that can be collected from the user device 200 while a user uses a service, and may include the situation of the user using the user device 200 as well as the situation of the user device 200 itself. It can be used to extract user reaction information about the service provided by the service providing server 100.

Next, the camera unit 260 is a means for capturing an image, and usually captures a front image or a rear image of the user device 200 . In the present invention, an image of a user using the user device 200 may be captured through the camera unit 260, and the control unit 250 analyzes the user's image and provides image information among terminal context information related to the provided service. may be collected, and the image information may include a user's face image.

In addition, the sensor unit 270 is for detecting physical changes such as direction, position, moving speed, movement, ambient brightness, etc. of the user device 200, and includes a gyroscope sensor for detecting motion and direction/position detection. It may include a geomagnetic sensor for detecting a motion state, an acceleration sensor for detecting a motion state, a gravity sensor for detecting a direction of gravity, a light sensor/illuminance sensor for detecting ambient light, a proximity sensor for detecting a user's approach, and the like.

The sensor unit 270 may detect a change of the user device 200 according to the user's movement while the service is provided by combining detection signals from various sensors.

And the audio processing unit 280 is a component for processing the user's voice signal, including a speaker (SPK) and a microphone (MIC), outputs the voice signal as audible sound through the speaker, and generates audible sound through the microphone is collected and converted into an electrical audio signal.

The voice uttered by the user while the service is being provided can be collected through the audio processing unit 280, and through voice analysis, user response information indicating the degree of positive or negative response of the user to the service is obtained. can be extracted.

The present invention provides a predetermined service by linking the service providing server 100 configured as described above and the user device 200, but provides user experience by updating the service contents by feeding back users' reactions to the provided service. can improve

The detailed operation process will be described with reference to the flowcharts of FIGS. 4 and 5 .

4 is a message flow diagram between the service providing server 100 and the user device 200 for service provision according to the present invention.

In the present invention, the service providing server 100 provides a predetermined service to the user device 200 (S105). Here, service provision is made in the form of transmitting requested service data such as a web page. The user device 200 configures and outputs a user interface (UI) screen corresponding to a service based on the service data provided by the service providing server 100 (S110).

At this time, the service provided through the service providing server 100 is a service currently provided or expected to be provided in the future, and may include an e-commerce service, a search service, a digital content sharing service, a personal broadcasting service, and an electronic magazine service. can

For example, assuming that the service providing server 100 provides an e-commerce service, the service providing server 100, as shown in FIG. After the page is provided to the user device 200, information on a plurality of recommended items extracted from the main page according to the user's selection of recommended information may be sequentially received and displayed. In this case, the recommended items may be products that the user has purchased based on the user's context information, products contained in the user's shopping cart, and other products related to the user's pre-purchased products.

In addition, the service providing server 100 may return to the main page while displaying recommended items, select a specific category (eg, clothing) among product categories, and provide a detailed page of the selected category. there is.

In this way, while receiving service data from the service providing server 100 and outputting a corresponding UI screen, the user device 200 includes devices such as the camera unit 260, the sensor unit 270, and the audio processing unit 280. Based on the configuration provided in the terminal, situation information around the terminal, that is, terminal context information is collected (S115). The terminal context information includes the user's image captured by the camera unit 260, the motion information of the user device 200 according to the user's manipulation detected through the sensor unit 270, and the user's information collected from the audio processing unit 280. It may include one or more of the audio signals.

The user device 200 transmits the collected terminal context information to the service providing server 100 (S120). In this case, at least one of service identification information for distinguishing service contents provided to the user at the time the terminal context information is collected or time information at the time the terminal context information is collected may be transmitted together. In addition, in order to reduce the traffic load of the network NW, the user device 200 may extract and transmit only the characteristic information instead of transmitting the terminal context information as it is. For example, in the case of a user image, only characteristic information about a part of the user's face used to determine an emotional state, for example, nose, eyes, mouth, etc., may be extracted and transmitted. Only signals can be sampled at a certain size and transmitted.

As described above, the service providing server 100 analyzes the user context information transmitted from the user device 200 receiving the service data (S125), and updates the provided service according to the analysis result (S130). .

The service providing method according to the present invention will be described in more detail focusing on the service providing server 100 .

5 is a flowchart illustrating the operation of a service providing server according to an embodiment of the present invention.

The service providing server 100 collects terminal context information related to the service data to any user device 200 that has transmitted predetermined service data through the service providing module 131 and is using the service (S205). The collection of the terminal context information may be repeatedly performed while the corresponding user device 200 is connected to the service providing server 100, and the collection frequency and interval may vary depending on at least one of the type of terminal context information and the type of service. can The collection of the terminal context information may be performed in a form in which the user device 200 collects and/or processes and transmits the corresponding information.

In addition, the service providing server 100 converts the terminal context information transmitted from the user device 200 into service identification information indicating the contents of the service being used by the user at the time the terminal context information is collected by the user device 200 and Match and save. To this end, the service providing server 100 matches and manages service identification information corresponding to the contents of the service provided to the user device 200 with a service providing time, and receives terminal context information from the user device 200. At this time, time information on the collection point of the corresponding terminal context information or service identification information corresponding to service contents provided at the corresponding time is received together, and the service identification information and the terminal context information are matched. In addition, the service providing server 100 can classify and manage terminal context information collected from an unspecified number of user devices 200 according to service identification information and service provision time, and can further manage them separately for each user. .

Then, the service providing server 100 extracts user response information by analyzing the terminal context information collected as described above (S215). Here, the extracted user response information is information representing the user's emotional state, and more specifically, is defined as a value for one or more of negative emotions and positive emotions. For example, the user reaction information may be set to a numerical value in the range of +1 to 1, where + may be set to a positive emotional state and - may be set to a negative emotional state.

The user's emotional state as described above may be extracted through acoustic/phonetic analysis such as linguistic meaning, tone, and volume of the user's voice signal, which is obtained by analyzing the user's facial expression based on image processing. In addition, motion information of the user device 200 collected from the sensor unit 280 may be further referred to. More specifically, it is possible to detect whether the user is viewing the screen of the user device 200 based on sensor information such as a proximity sensor, a gravity sensor, and an acceleration sensor installed in the user device 200, and the sensor unit In step 280, the terminal context information can be used to distinguish whether the extracted emotional state of the user is related to provided service data or other external circumstances. That is, the service providing server 100 may remove noise from the user reaction information extracted from the user's video and voice by referring to the information of the sensor unit 280 .

In addition, the service providing server 100 accumulates user response information extracted for a certain period of time for each user and extracts a trend of change in user response (S220). At this time, the trend of change in user response may appear according to a change in service contents or may appear according to a change in the user's emotion according to a change in time. Here, the change trend of the user reaction may be a change trend of a user reaction of a specific user or a change trend of user reactions of a plurality of users. In the former case, it can be used to evaluate a specific user's customized service, and in the latter case, it can be used to evaluate a service commonly provided to all users as a trend of average reactions of multiple users to service contents. .

Then, the service providing server 100 generates update information related to the service contents based on the change in the extracted service contents or the change in user response over time (S225).

The update information includes service identification information corresponding to a section in which negative emotions or positive emotions are extracted at a predetermined threshold or higher, and an update direction including at least one of deletion, change, and addition of service contents included in the corresponding service section. information may be included.

Then, the service providing server 100 outputs the update information to the service provider or service manager (S230). According to this, with respect to the service provided by the service providing server 100, by analyzing and providing the trend of change in user response for each user in addition to each service content, the service providing server 100 based on this updated information, the service providing server 100 ) can update the contents of the service to be provided.

Specifically, by extracting and analyzing the response trend of multiple users for each service content that is differentiated from each other, the adequacy of each service content can be determined, and guide information on portions to be corrected, deleted, or added among service content can be provided.

In addition, although it is described as providing update information in the flowchart of FIG. 5, it is not limited thereto, and by changing service contents based on the update information, different user experiences may be provided for each user.

Specifically, a service content candidate group is prepared for each service area, and appropriate service content is selected and provided to users from among the service content candidate groups according to the trend of changes in user response, so that each user can have different user experiences or have the same user experience. It is possible to provide the user with dynamically variable service content according to the user's condition.

6 and 7 are exemplary views illustrating an example of providing a terminal context-based service according to an embodiment of the present invention.

It is assumed that a user accesses an e-commerce site and uses an e-commerce service, and the contents of the provided service change over time (t1 to t8) as shown in FIGS. 6(a) and 7(a). .

According to this, the user accesses the main page of the e-commerce site, selects recommendation information, checks recommended items 1, 2, and 3 that are customized for the user, returns to the main screen, and selects the "clothing" category. By selecting , products in the "Clothing" category were checked.

As a result of extracting the user emotional state by analyzing the terminal context information collected from the user device 200 while using the e-commerce site as described above, the corresponding user reaction, that is, the emotional state is shown in FIGS. 6(b) to 7 In the case of (b), looking at the trend of change in the user's response, the user preferentially selected and looked at the recommended information, but after checking some recommended items 1 to 3, the positive response decreased, and then again in the clothing category. It can be seen that there was a positive response after directly searching for the product.

From the user's response, it can be inferred that the corresponding user has expectations for the recommended service, but is not satisfied with the recommended items provided as recommendation information. Accordingly, in this case, since the user does not show a positive response to the contents of the recommendation service, it is determined that the extracted recommended items are inappropriate, and the recommended items recommended by the recommendation service may be changed.

In addition, the corresponding user shows a positive response in the clothing category, which can be identified as having high satisfaction with products provided in the clothing category. Accordingly, with reference to this, the recommended item may be changed to a product in the clothing category.

For example, while the response to the recommendation service is negative and the number of uses of the search service is low, the recommendation service area may not be provided for users who use the search service a lot, and each service according to the user's reaction trend analysis It is possible to change the layout of the access path of the area.

7 and 8 are exemplary diagrams illustrating an example of providing a recommendation service according to an embodiment of the present invention.

In the examples of FIGS. 7 and 8 , it is assumed that the user context information includes search and purchase histories for notebooks, shoes, clothing, and the like.

According to the user context information, the service providing server 100 may extract other types of laptop products, shoes products, or clothing products newly released or not purchased by the user as recommended items, and recommendations including these recommended items. Information is provided to the user device 200 .

Accordingly, as shown in FIG. 7 , the user device 200 sequentially displays the recommended items included in the recommended information on the screen and exposes them to the user.

The user can check a plurality of recommended items included in the recommended information while scrolling the recommended information display screen, and can check more detailed information by touching a recommended item of interest while scrolling.

When the user device 200 collects such user reaction information and transmits it to the service providing server 100 in real time, the service providing server 100 transmits update information for changing recommendation information according to the user device ( 200), the user device 200 can change and display the recommended information.

For example, if the user's reaction information on the laptop among the recommended items is positive and the interest in miscellaneous goods or clothing is negative or nonexistent, the service providing server 100 deletes the recommended items for miscellaneous goods or clothing and then , Another laptop product may be added to the recommended information as a recommended item and displayed, or other accessory information related to the laptop may be added as a recommended item and changed as shown in FIG. 8 .

Therefore, the present invention does not provide recommended information by vaguely guessing the interests of the user, but rather supplements or adds recommended items that the user is interested in at the present time among various recommended items and provides them to the user at the present time. It is possible to satisfy user needs in

As set forth above, while this specification contains many specific implementation details, they should not be construed as limiting as to the scope of any invention or claimables, but rather as may be specific to a particular embodiment of a particular invention. It should be understood as a description of the features. Certain features that are described in this specification in the context of separate embodiments may also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable subcombination. Further, while features may operate in particular combinations and are initially depicted as such claimed, one or more features from a claimed combination may in some cases be excluded from that combination, and the claimed combination is a subcombination. or sub-combination variations.

Similarly, while actions are depicted in the drawings in a particular order, it should not be construed as requiring that those actions be performed in the specific order shown or in the sequential order, or that all depicted actions must be performed to obtain desired results. In certain cases, multitasking and parallel processing can be advantageous. Further, the separation of various system components in the embodiments described above should not be understood as requiring such separation in all embodiments, and the program components and systems described may generally be integrated together into a single software product or packaged into multiple software products. You have to understand that you can.

Specific embodiments of the subject matter described herein have been described. Other embodiments are within the scope of the following claims. For example, the actions recited in the claims can be performed in a different order and still achieve desirable results. As an example, the processes depicted in the accompanying drawings do not necessarily require the particular depicted order or sequential order in order to obtain desirable results. In certain implementations, multitasking and parallel processing may be advantageous.

The present description presents the best mode of the invention and provides examples to illustrate the invention and to enable those skilled in the art to make and use the invention. The specification thus prepared does not limit the invention to the specific terms presented. Therefore, although the present invention has been described in detail with reference to the above examples, those skilled in the art may make alterations, changes and modifications to the present examples without departing from the scope of the present invention.

Therefore, the scope of the present invention should not be determined by the described embodiments, but by the claims.

The present invention relates to providing an online service to a user device connected to a network. In providing a non-face-to-face online service, terminal context information detected by the user device while providing the service is collected, and the terminal context information Based on this, the user's response is extracted, but by analyzing it in a time series, the change trend of the user's response according to the change in the service content or over time is extracted, and through this, the user's evaluation of the service content can be extracted more accurately, Through this, an improved user experience can be provided to the user by updating service contents.

100: service providing server 110: communication module
120: storage module 130: control module
131: service provision module 133: feedback processing module
200: user device 210: communication unit
220: input unit 230: display unit
240: storage unit 250: control unit
260: camera unit 270: sensor unit
280: audio processing unit

Claims (12)

A service providing server that provides a predetermined service by transmitting service data to a user device through a network,
collecting, from a user device that has received the service data, service identification information corresponding to the service data and terminal context information related to an interaction between the user device and a user while using the service;
analyzing terminal context information collected for each service identification information, and extracting user response information about service contents corresponding to the service identification information;
extracting a trend of change in user response by analyzing user response information for each service identification information extracted over a certain period of time in a time series;
Updating the service data based on the trend of change in user response according to the change in the service content;
The step of extracting the user response information,
When one or more recommended items are provided as the service content to the user device through the recommendation information provided as the service data, a value indicating the degree of at least one of negative emotion and positive emotion by analyzing the terminal context information for each recommended item. Further comprising the step of extracting user reaction information for the user's emotional state provided by
Updating the service data,
Based on the trend of changes in the user response extracted according to the change in the recommended item corresponding to the change in the service content, the recommended item corresponding to the section in which the positive emotion was extracted above a preset threshold value and another item belonging to the same category are recalled. Update information obtained by updating the recommendation information is generated by adding to the recommendation information or by deleting a recommendation item corresponding to a section in which the negative emotion is extracted at a preset threshold or higher from the recommendation information, and the update information is transmitted to the user device. A method of providing a service based on terminal context information, further comprising the step of providing. delete ◈Claim 3 was abandoned when the registration fee was paid.◈ According to claim 1,
The terminal context information includes at least one of a user image, a user voice, and one or more sensing signals. ◈Claim 4 was abandoned when the registration fee was paid.◈ According to claim 3,
The user reaction information is information representing an emotional state of a user extracted through at least one of image analysis and voice analysis. delete delete A communication module for transmitting and receiving data to and from one or more user devices over a network;
a service providing module providing service data to the user device through the communication module; and
From the user device, service identification information for distinguishing the contents of the service being used by the user and terminal context information related to the interaction between the user and the user device appearing while the user is using the service are collected, and the terminal context information is analyzed to determine the service After extracting user response information for the service contents corresponding to the identification information, the user response information for each service identification information for a certain period of time is analyzed in a time series to extract the change trend of user response, and according to the change trend of the user response, the user response information is analyzed in time series. A feedback processing module for controlling update of service data;
The feedback processing module,
When one or more recommendation items are provided as the service content to the user device through the recommendation information provided as the service data through the service providing module, at least one of negative emotion and positive emotion is analyzed by analyzing the terminal context information for each recommendation item. User response information on the user's emotional state, which is provided as a value representing the degree of , is extracted, and the positive emotion is determined based on the change trend of the user's response extracted according to the change in the recommended item corresponding to the change in the service content. A recommended item corresponding to a section extracted above a set threshold and another item belonging to the same category is added to the recommendation information, or a recommended item corresponding to a section in which the negative emotion is extracted above a preset threshold is added to the recommendation information. A service providing server characterized in that for generating updated information obtained by updating the recommended information by deleting the recommended information, and providing the updated information to the user device. delete delete delete delete delete

Images