KR102594094B1 - Method and Apparatus for Providing Recommended Contents - Google Patents

Abstract

The present invention relates to a method and device for providing recommended content, extracting factual information using sensor information and data analysis information of photos taken or captured by a user, and providing estimated information using contextual information obtained by analyzing the photos. By extracting and providing recommended information needed by the user based on the factual information and estimated information, and providing this to the user, the photos are managed more diversely and efficiently while providing customized content tailored to changes in the user's behavior and surrounding situations. can do.
In particular, one or more certain standards are set based on the extracted factual information and estimated information, and the photos are classified according to the set standards to provide one or more information including recommended information that can be extracted from the classified criteria or classified photos. Provides customized content tailored to the user's situation and provides third-party service providers with one or more information that can be extracted from classified criteria or classified photos to create effective marketing strategies based on age, gender, etc. We can help you do it.

Description

Method and Apparatus for Providing Recommended Contents}

The present invention relates to a method and device for providing recommended content, and more specifically, to extract factual information through sensor information and image analysis information of photos taken or captured by a user, and extract estimated information through context analysis information, It relates to a method and device for classifying a plurality of image data according to a certain standard based on the factual information and estimated information and providing customized recommended content specialized for the user.

The content described in this section simply provides background information for this embodiment and does not constitute prior art.

Thanks to the development of ICT (Information Communication Technology), various new industries are emerging based on ICT, and they are also making existing products and services more intelligent/networked.

In particular, in the recent ICT field, big data, mobile, and wearable technologies have become hot topics, and they replace all services with data to provide customized and personalized services, It becomes the technological foundation for moving from the era of mass to the era of personal.

Mobile technology becomes the basis for connecting and communicating anytime, anywhere, beyond the limitations of time and space, and wearable technology goes beyond the limitations of conventional square-shaped devices and provides devices of various shapes such as wearable, bendable, and draped devices. It is to implement.

Big data is a new service that acts as a catalyst to create a new paradigm in the ICT field. Big data refers to massive amounts of data that cannot be processed with existing management and analysis systems. There is a technology that can quickly analyze such big data. With the emergence of technology, big data began to attract attention in the social and economic fields, and research related to technologies and tools (collection, storage, search, sharing, analysis, visualization, etc.) related to large-scale data became active, leading to big data analysis technology. It has developed rapidly, and as we enter the smart era where ICT is becoming part of everyday life, the influence of big data has increased further by combining with social, objects, and data.

In addition, with the emergence of mobile, cloud, and SNS, changes have occurred in fundamental infrastructure and data, and thus the perspective on data has changed. In particular, response to data explosion and data analysis have emerged as important issues in ICT. Data is recognized as a key topic in the ICT market and technological development.

In particular, with the full-fledged spread of smart and mobile devices since 2010, the spread of use of SNS such as Facebook and Twitter and changes in communication methods have led to a further increase in the data generated through voluntary participation of users.

As a specific example, as the camera function of smartphones and SNS services are combined, users not only record their daily lives but also take pictures of various things around them (surrounding scenery, restaurants, signboards, schedules, products) as a concept of information and post them on SNS. Through this, sharing and keeping things with others is becoming more common.

Accordingly, the number of photo data taken and shared or stored by users is rapidly increasing, and an efficient management and storage system for them is needed.

In relation to this, there is an existing service that manages photos based on location by recording the location information at the time the photo was taken in the photo's metadata, but this simply sorts photos based on location, and is based on the concept of information. There was a problem that it was not appropriate for managing photos used as photos.

Therefore, in order to meet the needs of users in accordance with changes in user behavior, a storage platform and service from a new perspective that provides services tailored to changes in user behavior and surrounding situations has been required.

Korean Patent Publication No. 10-2007-0060617 (Name: Method and device for executing functions in a mobile terminal equipped with a camera, 2007.06.13)

In order to meet the above-described needs, the present invention provides a content providing server to receive and store a photo taken or captured by a user, extract factual information through sensor information and image analysis information of the received photo, and context of the photo. By analyzing the information, extracting estimated information based on this, and extracting recommended information tailored to the user's situation based on the extracted factual information and estimated information and providing it to the user, it is tailored to changes in the user's behavior and surrounding situations. We seek to provide a recommended content provision method and device that can provide customized content to users.

In particular, one or more certain standards are set based on the extracted factual information and estimated information, and the photos are classified according to the set standards to provide one or more information including recommended information that can be extracted from the classified criteria or classified photos. Recommended content tailored to the user's situation is provided to the user, and one or more information that can be extracted from the classified criteria or classified photos is provided to the third service provider to create an effective marketing strategy based on age, gender, etc. We intend to provide a content provision method and device that allows this to be done.

However, the object of the present invention is not limited to the above object, and other objects not mentioned may be clearly understood from the description below.

The content provision method according to the present invention for achieving the above-described object includes the steps of a content provision server receiving and storing at least one image data and sensor information corresponding to each image data from at least one terminal device; extracting image analysis information by analyzing characters or shapes included in each image data based on the image data; analyzing context information indicating a situation included in each image data based on the image data; extracting factual information for each of the image data based on image analysis information and the sensor information; extracting estimated information for each of the image data based on the analyzed context information; Classifying the at least one image data according to one or more criteria set based on at least one of factual information and estimated information, and providing at least one information related to the classified at least one image data to the at least one terminal device or It may include transmitting to a third service server.

At this time, the step of extracting one or more recommended information may be further included based on the factual information and estimated information of the classified image data, and the step of extracting the recommended information may be performed based on the extracted factual information and estimated information. It may include generating a recommendation list including one or more recommendation information and extracting the remaining recommendation information excluding the recommendation information corresponding to the image analysis information among the one or more recommendation information included in the recommendation list.

In addition, before the transmitting step, it may further include extracting characteristic information for each user from the classified image data based on at least one of the factual information and the estimated information, and the step of extracting characteristic information for each user from the classified image data based on at least one of the factual information and the estimated information. The method may further include providing at least one image data to the terminal device.

In addition, the classifying step includes first classifying related image data according to a certain standard based on the factual information, and secondly classifying the first classified image data into image data with certain characteristics based on the estimated information. It may include a classification step.

In addition, it may further include mapping and storing at least one of the factual information and the estimated information for each of the terminal devices with the image data, wherein the sensor information is stored at the time the terminal device generates image data. may include at least one of location information, date and time information, and weather information of the terminal device.

Meanwhile, the content providing method may be provided as a computer-readable recording medium on which a program for executing the content is recorded, or may be provided as a computer program implemented to execute the method and stored in a computer-readable recording medium.

The content providing server according to the present invention for achieving the above-described purpose includes a communication module that transmits and receives data with at least one terminal device and a third service server in conjunction with a communication network, and at least one terminal device received from the at least one terminal device. A storage module that stores image data and sensor information corresponding to each of the image data, and extracts image analysis information by analyzing characters or shapes included in each image data based on the image data stored in the storage module, Based on the image data, context information representing the situation included in each image data is analyzed, factual information is extracted based on the analyzed image analysis information and the sensor information, and estimated information is extracted based on the context information. , classifies the at least one image data based on at least one of the extracted factual information and recommendation information, and sends one or more information related to the classified at least one image data to the at least one terminal device through the communication module. Alternatively, it may include a control module that controls transmission to a third service server.

At this time, the control module may extract one or more recommendation information based on factual information and estimation information of the classified image data, and a recommendation including one or more recommendation information based on the extracted factual information and estimation information. A list may be created, and the remaining recommendation information excluding the recommendation information corresponding to the image analysis information may be extracted from one or more pieces of recommendation information included in the recommendation list.

In addition, the control module may extract characteristic information for each user from the classified image data based on at least one of the factual information and the estimated information, and the control module may extract the at least one user classified according to the same standard. Image data can be provided to the terminal device.

In addition, the control module first classifies related image data according to a certain standard based on the factual information, and secondarily classifies the first classified image data into image data with certain characteristics based on the estimated information. It can be controlled to map at least one of fact information and estimation information for each of the terminal devices with the image data and store it in the storage module.

Additionally, the sensor information may include at least one of location information, date and time information, and weather information of the terminal device at the time the terminal device generates image data.

According to the present invention, factual information is extracted using sensor information and data analysis information of a photo taken or captured by a user, and estimated information is extracted using context information obtained by analyzing the photo, and the factual information and estimate are extracted. By extracting the recommended information the user needs based on the information and providing it to the user, it is possible to manage photos more diversely and efficiently while providing customized content tailored to the user's changes in behavior and surrounding situations.

In particular, one or more certain standards are set based on the extracted factual information and estimated information, and the photos are classified according to the set standards to provide one or more information including recommended information that can be extracted from the classified criteria or classified photos. Provides customized content tailored to the user's situation and provides third-party service providers with one or more information that can be extracted from classified criteria or classified photos to create effective marketing strategies based on age, gender, etc. We can help you do it.

In addition, various effects other than the effects described above may be disclosed directly or implicitly in the detailed description according to embodiments of the present invention, which will be described later.

1 is a diagram showing the configuration of a content provision system according to an embodiment of the present invention.
Figure 2 is a block diagram showing the configuration of a terminal device in the present invention.
Figure 3 is a flowchart for explaining the operation process of a terminal device according to an embodiment of the present invention.
Figure 4 is a block diagram showing the configuration of a content providing server according to the present invention.
Figures 5 to 7 are flowcharts to explain the operation process of the content providing server according to an embodiment of the present invention.
Figures 8 to 11 are illustrative diagrams for explaining various embodiments of the present invention.
Figure 12 is a diagram illustrating an operating environment in a service system for providing content according to an embodiment of the present invention.

In order to make the characteristics and advantages of the problem-solving means of the present invention clearer, the present invention will be described in more detail with reference to specific embodiments of the present invention shown in the attached drawings.

However, detailed descriptions of known functions or configurations that may obscure the gist of the present invention are omitted in the following description and attached drawings. Additionally, it should be noted that the same components throughout the drawings are indicated by the same reference numerals whenever possible.

Terms or words used in the following description and drawings should not be construed as limited to their usual or dictionary meanings, and the inventor may appropriately define the concept of the term to explain his or her invention in the best way. It must be interpreted with meaning and concept consistent with the technical idea of the present invention based on the principle that it is.

Therefore, the embodiments described in this specification and the configuration shown in the drawings are only one of the most preferred embodiments of the present invention, and do not represent the entire technical idea of the present invention, so at the time of filing the present application, various alternatives may be used to replace them. It should be understood that equivalents and variations may exist.

In addition, terms containing ordinal numbers, such as first, second, etc., are used to describe various components, and are used only for the purpose of distinguishing one component from other components and to limit the components. Not used.

For example, the second component may be referred to as the first component without departing from the scope of the present invention, and similarly, the first component may also be referred to as the second component.

Additionally, the terms used in this specification are only used to describe specific embodiments and are not intended to limit the present invention.

Singular expressions include plural expressions unless the context clearly dictates otherwise. In addition, terms such as "comprise" or "have" used in the specification are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more of the features, numbers, steps, operations, components, parts, or combinations thereof described in the specification. It should be understood that this does not exclude in advance the presence or addition of other features, numbers, steps, operations, components, parts, or combinations thereof.

Additionally, terms such as “unit,” “unit,” and “module” used in the specification refer to a unit that processes at least one function or operation, and may be implemented as hardware, software, or a combination of hardware and software.

In addition, the terms "a or an", "one", "the", and similar related terms are used in the context of describing the invention (particularly in the context of the claims below) as used herein. It may be used in both singular and plural terms, unless indicated otherwise or clearly contradicted by context.

In addition to the terms described above, specific terms used in the following description are provided to aid understanding of the present invention, and the use of these specific terms may be changed to other forms without departing from the technical spirit of the present invention.

Additionally, embodiments within the scope of the present invention include computer-readable media having or transmitting computer-executable instructions or data structures stored on the computer-readable media.

Such computer-readable media may be any available media that can be accessed by a general-purpose or special-purpose computer system. By way of example, such computer-readable media may include RAM, ROM, EPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage, or in the form of computer-executable instructions, computer-readable instructions or data structures. It may be used to store or transmit certain program code means, and may include, but is not limited to, a physical storage medium such as any other medium that can be accessed by a general purpose or special purpose computer system. .

In addition, the present invention is applicable to personal computers, laptop computers, handheld devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, mobile phones, PDAs, and pagers. It can be implemented in a network computing environment with various types of computer system configurations including (pager) and the like.

The invention may also be practiced in distributed system environments where tasks are performed by both local and remote computer systems that are linked over a network via wired data links, wireless data links, or a combination of wired and wireless data links. In a distributed system environment, program modules may be located in local and remote memory storage devices.

Meanwhile, when describing the embodiment according to the present invention, it is assumed that the image or image data means a photo or photo data.

However, images or image data according to an embodiment of the present invention do not necessarily mean only photos or photo data, and any image other than a photo, such as a picture or shape that can be recognized as an image, can be used according to an embodiment of the present invention. It can be an image or image data.

Now, a device for providing content in a content providing system according to an embodiment of the present invention will be described in detail with reference to the drawings.

1 is a diagram schematically explaining the structure of a content provision system according to an embodiment of the present invention.

Referring to Figure 1, a content providing system according to an embodiment of the present invention may be configured to include a terminal device 200, a content providing server 300, and a third service server 400.

Here, the content providing server 300 is linked with the terminal device 200 and the third service server 400 through the communication network 100.

Next, each component will be briefly described with reference to Figure 1.

First, the communication network 100 serves to transmit data for data transmission and reception between the terminal device 200 and the content providing server 300 or between the third service server 400 and the content providing server 300, and implements the system. Depending on the method, wired communication methods such as Ethernet, xDSL (ADSL, VDSL), HFC (Hybrid Fiber Coaxial Cable), FTTC (Fiber to The Curb), and FTTH (Fiber To The Home) may be used, or WLAN ( Wireless communications such as Wireless LAN, Wi-Fi, Wibro, Wimax, HSDPA (High Speed Downlink Packet Access), LTE (Long Term Evolution), and LTE-A (Long Term Evolution Advanced) You can also use this method.

In addition, this communication network 100 includes, for example, a plurality of access networks (not shown) and a core network (not shown), and may be configured to include an external network, such as an Internet network (not shown).

Here, the access network (not shown) is an access network that performs wired and wireless communication with the terminal device 200, for example, a plurality of base stations such as BS (Base Station), BTS (Base Transceiver Station), NodeB, eNodeB, etc., and BSC. It can be implemented with a base station controller such as (Base Station Controller) or RNC (Radio Network Controller).

In addition, as described above, the digital signal processing unit and the wireless signal processing unit integrated in the base station are divided into a digital unit (hereinafter referred to as DU) and a radio unit (hereinafter referred to as RU), respectively. It can also be configured by installing multiple RUs (not shown) in multiple areas and connecting multiple RUs (not shown) with a centralized DU (not shown).

In addition, the core network (not shown) that constitutes the mobile network together with the access network (not shown) serves to connect the access network (not shown) with an external network, such as an Internet network (not shown).

As described above, this core network (not shown) is a network system that performs major functions for mobile communication services such as mobility control and switching between access networks (not shown), and is a network system that performs circuit switching or packet switching. switching) and manages and controls packet flow within the mobile network. In addition, the core network (not shown) manages mobility between frequencies and plays a role in linking traffic within the access network (not shown) and the core network (not shown) with other networks, such as the Internet network (not shown). It may be possible.

This core network (not shown) further includes Serving GateWay (SGW), PDN GateWay (PGW), Mobile Switching Center (MSC), Home Location Register (HLR), Mobile Mobility Entity (MME), and Home Subscriber Server (HSS). It may be configured to include.

In addition, the Internet network (not shown) refers to a typical open communication network, that is, a public network, in which information is exchanged according to the TCP/IP protocol. It is connected to the terminal device 200 and provides information from the terminal device 200. Information can be provided to the content providing server 300 through the core network (not shown) and the access network (not shown), and conversely, the information provided to the content providing server 300 can be provided to the core network (not shown) and the access network (not shown). It can also be provided to the terminal device 200 through a network. However, it is not limited to this, and the content providing server 300 may be implemented integrally with the core network (not shown).

In addition, in addition to the above-mentioned communication methods, it may include all other types of communication methods that are widely known or will be developed in the future.

The terminal device 200 of the present invention refers to a user's device that can transmit and receive various data through the communication network 100 according to the user's operation. This terminal device 200 can perform voice or data communication through the communication network 100, and can transmit and receive information through the content providing server 300 and the communication network 100.

For this purpose, the terminal device 200 of the present invention may be equipped with a memory for storing programs and protocols for transmitting, receiving and processing image data, and a microprocessor for calculating and controlling various programs.

This terminal device 200 is a service app that first connects to an app providing device (not shown) connected to the communication network 100, such as an app store, and analyzes image data from the app store to provide recommended content to the user. You can receive and install it. The user terminal device 200 executes this service app, transmits image data to the content provision server 300, and transmits content (e.g., user's situation) provided by the service app from the content provision server 300. (recommended content tailored to your needs, etc.) can be received and provided to the user.

According to an embodiment of the present invention, the terminal device 200 captures an image such as a photo upon a user's request, or captures a photo taken or created by another user or the user and uploaded to SNS, instant message, email, etc.

At this time, at the time the image was captured or created, sensor information such as location information, date and time information, and weather information at which the image was captured or created may be included in the image data, and in particular, may be included in the metadata of the image data. .

However, sensor information including location information, date information, and weather information is not included in the image data and may be generated and managed separately.

In addition, the location information can be obtained through the GPS (Global Positioning System) of the terminal device 200, and the time information is time information received by the terminal device 200 from a base station, etc. or managed within the terminal device 200. It can be acquired by a timer, etc., and weather information can be generated based on the sensing value measured by the illuminance sensor and temperature sensor mounted on the terminal device 200, and linked with the weather application installed on the terminal device 200. It can also be obtained from the weather application.

The terminal device 200, which has photographed or captured image data including location information, transmits the image data to the content providing server 300 along with user information using the terminal device 200.

If the sensor information is managed separately from the image data, the sensor information is also transmitted to the content providing server 300.

At this time, user information can be known through the MAC address, which is unique identification information of the terminal device 200, and through this, user information such as the user's age, gender, and residential area can be obtained.

Additionally, such user information may be stored in the content providing server 300, and the content providing server 300 may extract it through the unique identification information of the terminal device 200.

Afterwards, the terminal device 200 receives one or more recommended information from the content providing server 300.

The terminal device 200 of the present invention may be implemented in various forms. For example, the terminal device 200 described in this specification includes mobile terminals such as smart phones, tablet PCs, personal digital assistants (PDAs), portable multimedia players (PMPs), and MP3 players. Of course, fixed terminals such as Smart TVs, desktop computers, etc. may also be used.

In addition, the terminal device 200 of the present invention has so many variations of portable devices according to the convergence trend of digital devices that it is not possible to list them all, but units equivalent to the above-mentioned units are included in the present invention. Any device can be used as the terminal device 200 according to an embodiment of the present invention, as long as it is a device that can download and install the beacon service app according to the present invention.

The content providing server 300 manages the collected images, receives a service provision request from the terminal device 300, provides information corresponding to the service, and provides certain information required by the third service server 400. It is a device that

In particular, in the present invention, the content providing server 300 receives and stores at least one image data and sensor information corresponding to each of the at least one image data from the terminal device 200, and at this time, the content providing server 300 ) can further receive and store user information from the terminal device 200.

The content providing server 300 analyzes the image and context information included in the image data based on the received at least one image data, extracts factual information based on the analyzed image analysis information and the received sensor information, and , estimated information can be extracted based on the analyzed context information.

At this time, the sensor information includes location information, date and time information, weather information, etc. of the terminal device 200 at the time the image data was captured. This sensor information may be managed separately, but is included in the image data in the form of metadata. may be included.

Image analysis information is an analysis of various information included in images such as photos, and may include a store sign, a clothing brand, or the name of a specific building included in the image.

Context analysis information refers to situational information shown in an image, and is information that analyzes the behavior of a specific person included only in the image, the distance in the image, and the situation of the place.

Therefore, factual information is information about facts corresponding to the image obtained through sensor information and image analysis information, and information about facts that can be left as data about the location at the time the image was captured.

Meanwhile, the estimated information is information that estimates the situation in the image obtained through context analysis information, and may be information estimated about a special situation that is estimated to have occurred in the location where the image was taken at the time.

When the content providing server 300 extracts factual information and estimated information, at least one of the extracted estimated information, factual information, and user information and the corresponding image data can be mapped and stored, respectively.

And classifies at least one received image data according to one or more criteria set based on at least one of factual information and estimated information for each of the image data, and classifies the received image data according to the classified criteria or the at least one classified image data. One or more pieces of information can be transmitted to one or more terminal devices or a third service server.

In other words, classifying at least one image data according to one or more criteria set based on at least one of factual information and estimated information includes the location, time, weather, or place where the photos were taken, people, or estimates included in the factual information. This means grouping at least one received image data based on one or more of the surrounding situation, background, and scenery in the photo included in the information.

One or more recommended information is extracted based on the factual information and estimated information of the grouped, that is, classified, image data and provided to the user's terminal device 200.

In other words, if the classification criteria for the classified image data is travel location and the travel location is 'Jeju Island', the user can be recognized as traveling to Jeju Island, and recommended travel destinations or restaurants in Jeju Island can be extracted and provided as recommendation information. there is.

And when extracting this recommended information, recommended travel destinations can be provided by further utilizing the estimated information, where the estimated information is 'People are riding horses and walking through the meadows.' If so, you may be able to recommend travel or tourist spots where you can go horseback riding.

When extracting such recommendation information and providing it to the user, a recommendation list containing one or more recommendation information extracted based on factual information and estimated information is created, and the image analysis information is selected from among one or more recommendation information included in the recommendation list. You can exclude recommended information corresponding to .

In other words, if the classified travel location is 'Jeju Island' and there are photos taken around 'Manjanggul Cave' as a result of analyzing at least one image, it is determined that 'Manjanggul Cave' has already been visited by the user, and recommendations related to 'Manjanggul Cave' are made. Excluding the information, the remaining recommended information can be provided to the user.

In addition, after classifying at least one image data, that is, after grouping at least one image data, one or more image data is classified according to a certain standard, and classified according to the same standard according to the user's request or need. One or more image data may be provided to the user.

Meanwhile, when transmitting at least one classified image data to the third service server 400, characteristic information for each user is extracted from the at least one classified image data based on at least one of the extracted factual information and estimated information. The extracted characteristic information can be extracted and transmitted to the third service server 400.

That is, the travel taste of the user who transmitted the at least one image data to the content providing server 300 based on at least one of factual information and estimated information, for example, that the user likes walking trails, The user can extract preferences, such as enjoying a gastronomic trip, and transmit the extracted characteristic information for each user to the third service server 400.

Meanwhile, in the above classification, related image data is first classified according to a certain standard based on factual information, and then the primary classified image data is secondarily classified into image data with certain characteristics based on estimated information. You can.

In other words, first classify image data related to 'Jeju Island' based on factual information, and then secondarily classify crowded photos with many people among the image data related to 'Jeju Island' based on estimated information. You can.

The third service server 400 is a device that receives characteristic information for each user from the content providing server 300, collects, and stores the provided information for use in marketing, etc.

The content providing server 300 according to an embodiment of the present invention has the same hardware configuration as a typical web server or network server. However, software includes program modules implemented through languages such as C, C++, Java, Visual Basic, and Visual C.

Meanwhile, the memory mounted on each device of the present invention stores information within the device. In one implementation, the memory is a computer-readable medium. In one implementation, the memory may be a volatile memory unit, and in another implementation, the memory may be a non-volatile memory unit. In one implementation, the storage device is a computer-readable medium. In various different implementations, the storage device may include, for example, a hard disk device, an optical disk device, or some other mass storage device.

Although the specification and drawings describe example device configurations, implementations of the functional operations and subject matter described herein may be implemented in other types of digital electronic circuits, or may be implemented in the structures disclosed herein and their structural equivalents. It may be implemented as computer software, firmware, or hardware, or as a combination of one or more of these. Implementations of the subject matter described herein may relate to one or more computer program products, that is, computer program instructions encoded on a tangible program storage medium for controlling the operation of or execution by a device according to the invention. It can be implemented as the above modules. The computer-readable medium may be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter that affects a machine-readable radio wave signal, or a combination of one or more of these.

Above, the structure of the content provision system according to an embodiment of the present invention has been briefly described.

Hereinafter, among the configurations of the above system, the configuration and operation method of the terminal device 200 according to the present invention will be described.

Figure 2 is a block diagram showing the main configuration of the terminal device 200, and Figure 3 is a flowchart for explaining the operation method of the terminal device 200 according to an embodiment of the present invention.

First, referring to Figure 2, the terminal device 200 according to the present invention includes an input module 210, an output module 220, a storage module 230, a communication module 240, a GPS module 250, and a camera module. (260) and may be configured to include a control module (270).

The input module 210 receives various information such as number and character information, and transmits input signals related to setting various functions and controlling functions of the terminal device 200 to the control module 270. Additionally, the input module 210 may be configured to include at least one of a keypad and a touchpad that generate an input signal according to a user's touch or manipulation. At this time, the input module 210 is configured in the form of a touch panel (or touch screen) together with the output module 220 and can perform input and display functions simultaneously. Additionally, the input module 210 may use any type of input means that may be developed in the future in addition to input devices such as a keyboard, keypad, mouse, joystick, etc. In particular, the input module 210 according to the present invention detects input information input from the user and transmits it to the control module 270.

In particular, the input module 210 of the terminal device 200 according to the present invention receives a user's request to take or create an image, a request to capture an image, etc., and allows the control module 270 to take or capture an image. The input request can be transmitted.

The output module 220 displays information about a series of operation states and operation results that occur while the terminal device 200 performs its functions. Additionally, the output module 220 can display menus of the terminal device 200 and user data input by the user. Here, the output module 220 includes a liquid crystal display (LCD), an ultra-thin film liquid crystal display (TFT-LCD), a light emitting diode (LED), and an organic light emitting diode (OLED). Organic LED), active organic light emitting diode (AMOLED, Active Matrix OLED), Retina Display, flexible display, and 3 Dimensional display. At this time, when the output module 220 is configured in the form of a touch screen, the output module 220 may perform some or all of the functions of the input module 210.

In particular, in the present invention, recommendation information received from the content providing server 300 can be exposed to the user through the output module 220.

The storage module 230 is a device for storing data, includes a main memory and an auxiliary memory, and stores application programs necessary for the functional operation of the terminal device 200. This storage module 230 may largely include a program area and a data area. Here, when the terminal device 200 activates each function in response to the user's request, the terminal device 200 executes the corresponding application programs under the control of the control module 270 to provide each function.

In particular, the storage module 230 according to the present invention uses the operating system that boots the terminal device 200, various application programs, user information matching the terminal device 200, and the camera module 260 of the terminal device 200. Photographed or captured image data information, one or more recommendation information received from the content providing server 300, etc. may be stored.

The communication module 240 is for transmitting and receiving data with the content providing server 300 through the communication network 100.

In addition, the communication module 240 includes an RF transmitting means for up-converting and amplifying the frequency of the transmitted signal, an RF receiving means for low-noise amplifying the received signal and down-converting the frequency, and an RF receiving means for processing a communication protocol according to a specific communication method. Includes data processing means, etc. This communication module 240 may include at least one of a wireless communication module (not shown) and a wired communication module (not shown). Additionally, the wireless communication module is configured to transmit and receive data according to a wireless communication method, and when the terminal device 200 uses wireless communication, any one of a wireless network communication module, a wireless LAN communication module, and a wireless fan communication module is used. Thus, data can be transmitted and received with the content providing server 300.

Here, as mentioned above, the communication module 240 uses wireless communication methods such as WLAN (Wireless LAN), Wi-Fi, Wibro, Wimax, and HSDPA (High Speed Downlink Packet Access). Preferred, but not limited to this, and depending on the system implementation method, Ethernet, xDSL (ADSL, VDSL), HFC (Hybrid Fiber Coaxial Cable), FTTC (Fiber to The Curb), FTTH (Fiber To The Home), etc. You can also use a wired communication method.

The sensor module 250 is a device for sensing and obtaining various information that can be sensed around the terminal device 200.

A representative example of such a sensor module 250 is GPS (Global Positioning System). In the present invention, GPS receives a GPS signal, and when the terminal device 200 captures or generates image data such as a photo, the terminal device ( 200) location information is obtained so that the location where photos, etc. were taken can be known.

In addition, sensor information for extracting factual information may include date and time information, weather information, etc. in addition to location information where images such as photos were taken. The time and date information may include a timer installed in the terminal device 200, an external base station, etc. Weather information can be obtained through a temperature sensor, an illumination sensor, etc. mounted on the terminal device 200.

However, the weather or date information is not obtained by the sensor module 250, but can be obtained by linking with a weather or calendar application installed in the terminal device 200.

The camera module 260 is a device for photographing scenery, people, etc. of the area where the terminal device 200 is located.

In the present invention, a user can generate image data by taking a photo, etc. through the camera module 260 of the terminal device 200.

The control module 270 may be a process device that drives an operating system (OS) and each component.

Therefore, the control module 270 of the terminal device 200 controls the signal received through the input module 210 to be transmitted to the content providing server 300 through the communication module 240, and Information transmitted and received from the content providing server 300 can be controlled to be exposed through the output module 220, and such information or data can be controlled to be stored in the storage module 230.

In particular, in the present invention, the control module 270 can control the overall operation process of the terminal device 200 according to an embodiment of the present invention.

Now, let's look at the operation process of the terminal device 200, which is generally controlled by the control module 270, with reference to FIG. 3.

A user takes an image such as a photo through the camera module 260 of the terminal device 200 or captures an image stored in the content providing server 300 or another image storage server (not shown) (S101).

At this time, if the user takes a photo through the camera module 260, location information of the terminal device 200 at the time the photo was taken through the sensor module 250, date and time information at the time the photo was taken, Obtain sensor information such as weather information (S103).

This sensor information may be managed separately from the image data or may be included in the metadata of the image data.

The control module 270 of the terminal device 200 may control transmission of photographed or captured image data together with sensor information and user information to the content providing server 300 (S105).

After the control module 270 of the terminal device 200 transmits the above information to the content providing server 300 through the communication module 240, the terminal device 200 receives a communication module from the content providing server 300 ( One or more pieces of recommended information can be received through 240 (S107), and the one or more pieces of recommended information can be controlled to be provided to the user through the output module 220.

The overall operation process of the terminal device 200 according to the above-described embodiment of the present invention can be controlled and executed by the control module 270 of the terminal device 200, as described above.

Above, the configuration and operation method of the terminal device 200 according to the present invention have been described.

Hereinafter, the configuration and operation method of the content providing server 300 according to the present invention will be described.

Figure 4 is a diagram showing the main configuration of the content providing server 300 according to the present invention, and Figures 5 to 7 are flowcharts for explaining the operation process of the content providing server 300 according to an embodiment of the present invention.

Referring to Figure 4, the content providing server 300 according to the present invention may be configured to include a communication module 310, a storage module 330, and a control module 350.

The communication module 310 is for communicating with the terminal device 200, and the communication network for the communication module 310 to perform its function is WLAN (Wireless LAN), Wi-Fi, Wibro, and WiMAX ( It is desirable to use a wireless communication method such as Wimax) or HSDPA (High Speed Downlink Packet Access), but it is not limited to this, and depending on the system implementation method, Ethernet, xDSL (ADSL, VDSL), and HFC (Hybrid Fiber Coaxial) You can also use wired communication methods such as Cable, FTTC (Fiber to The Curb), and FTTH (Fiber To The Home).

In particular, in the present invention, the communication module 310 can receive image data, sensor information, user information, etc. from the terminal device 200 through the communication network 100, and sends one or more extracted recommendation information to the terminal device ( 200).

The storage module 330 is a device for storing data, includes a main memory and an auxiliary memory, and stores application programs necessary for the functional operation of the terminal device 200. This storage module 330 may largely include a program area and a data area. Here, when the terminal device 200 activates each function in response to the user's request, the terminal device 200 executes the corresponding application programs under the control of the control module 350 to provide each function.

In particular, in the present invention, the storage module 330 can classify image data according to one or more criteria set based on at least one of factual information and estimated information for each image data and store it in the form of an image grouping DB 331. .

Additionally, in order to provide one or more pieces of recommendation information based on factual information and estimated information, one or more pieces of recommended information can be stored in the form of a recommendation information DB 333.

The control module 350 extracts one or more personalized recommendation information for the user based on image data and sensor information received through the communication module 310, and sends the information to the terminal device 200 or the third service server 400. ) can be controlled to transmit to .

The control module 350 controls the overall operating process of the content providing server 300. Refer to FIGS. 5 to 7 for the overall operating process of the content providing server 300 controlled by the control module 250. Let me explain.

Referring to Figure 5, the content providing server 300 receives image data, user information, and sensor information corresponding to the image data from the terminal device 200, and stores them in the storage module 330 (S201).

And the received sensor information may include at least one of location information, date and time information, and weather information of the terminal device 200 that generated or captured the image data at the time the image data was generated or captured, Sensor information including the location information may be acquired by the sensor module 250 of the terminal device 200.

Thereafter, the content providing server 300 extracts image analysis information by analyzing characters or shapes included in the received image data, analyzes context information indicating the situation included in each image data (S203), and analyzes the image. Factual information is extracted based on the information and the received sensor information (S205).

Then, estimated information is extracted based on the analyzed context information (S207), and image data is mapped with at least one of the estimated information and factual information and stored in the storage module 330 (S209).

Now, referring to FIG. 6, looking at the process of providing recommendation information to the terminal device 200, the stored image data is divided into at least one image data according to one or more criteria set based on at least one of factual information and estimated information. Classification, that is, grouping (S301).

At this time, at least one image data may be first classified into related image data according to a certain standard based on factual information, and then image data with certain characteristics may be secondarily classified based on the estimated information.

The user's situation is analyzed based on the factual information and estimated information from the classified images (S303). In other words, based on the factual information and estimated information from the classified images, the user's situation is analyzed to determine which area the user is traveling to and which place is mainly located. Staying in a place or having a lot of photos taken in one place may mean that the user is very interested in that place, so the above information, that is, the user's situation, can be analyzed through classified image data.

One or more recommended information is extracted based on the user's situation analyzed in this way (S305), and the extracted recommended information can be transmitted to the terminal device 200 and provided to the user (S307).

At this time, the content providing server 300 generates a recommendation list including the extracted one or more recommendation information, and selects the remaining recommendations excluding the recommendation information corresponding to the image analysis information among the one or more recommendation information included in the recommendation list. Information can be extracted and provided to the user.

In other words, since the places included in the photos captured or taken by the user are likely to be travel destinations that the user has already visited, it may be more helpful to the user to recommend travel destinations other than the above travel destinations. Therefore, the user has already visited the destination. It is possible to provide users with information on travel destinations excluding places that are judged to have been visited travel destinations.

Meanwhile, in an embodiment of the present invention, the content providing server 300 may provide at least one image data classified according to the same criteria to the terminal device 200 according to the user's request or need.

Now, referring to FIG. 7, looking at the process of the content providing server 300 providing user-specific characteristic information to the third service server 400, image data provided by at least one user and stored in the storage module 330 is provided. Classifies based on one or more certain conditions set based on at least one of factual information and estimated information (S401), extracts characteristic information for each user based on the factual information and estimated information from the classified image data (S403), The extracted characteristic information can be transmitted to the third service server 400 (S405).

That is, characteristic information such as preferred travel destinations and preferred restaurants for each user is extracted from the classified image data and transmitted to the third service server 400, and the service provider managing the third service server 400 extracts this characteristic information. It can be used for marketing.

Above, the configuration and operation method of the content providing server 300 according to the present invention has been described.

Hereinafter, the process of extracting recommendation information by analyzing image data according to an embodiment of the present invention will be described.

Figures 8 to 11 are examples for explaining the process of extracting recommendation information according to an embodiment of the present invention.

Referring to FIG. 8, at least one photo ((a) to (f)) related to Jeju Island taken by at least one user while traveling to Jeju Island and sensor information corresponding to each photo are sent to the content providing server 300. When provided using (200), the content providing server 300 analyzes the image analysis information by analyzing the characters or shapes included in the image data based on each image data, and provides context information that is the situation of each image data. Analyze.

And based on the extracted image analysis information and sensor information, factual information about each image data is extracted. In Figure 8, the location information commonly included in the six photos included in the sensor information is 'Jeju Island', and the date information is 2015. It is assumed that it is August 3, and the weather information is recorded as 33 degrees Celsius and clear weather.

In addition, through image analysis information, information such as 'Abalone Porridge', 'Sanbangsan Mountain', 'Columnar Joints', 'Dol Hareubang', 'Gogi Noodles', and 'Seopjikoji' were obtained from each photo, and through context analysis, 'leisure scenery' Information such as 'looking at' or 'looking at food on the table', that is, estimated information, can be extracted.

Among the factual information extracted in this way, based on location information, the above six photos are classified according to the standard 'Jeju Island', and based on the estimated information, photos (b), (c), and (d) showing people walking around scenic spots are taken. , (f) and food photos (a) and (e) are classified into two categories, and based on this information, recommendation information including recommended travel destinations and recommended restaurants can be extracted and provided to the user.

Looking at an example of the above recommended information through Figure 9, Figure 9 shows recommended tourist courses centered on the photo classification criteria of (b), (c), (d), and (f), which have scenic attractions. It is provided to the user.

At this time, there is a high probability that (b), (c), (d), and (f) are places that the user has already traveled to, so choose the places (b), (c), (d), and (f) above. Recommended tourist courses can be provided to users based on the remaining places excluded.

Meanwhile, the content providing server 300 determines the user's characteristic information that the user 'likes to see leisurely scenery and enjoys gourmet travel' based on the extracted factual information and estimated information, and provides a third service server. By providing it to (400), a third-party service provider can use it for marketing.

When explaining another embodiment through FIGS. 10 and 11, FIG. 10 is image data uploaded by at least one user, and sensor information included in the six photos of FIG. 10 is different.

The content providing server 300 extracted common image analysis information called 'rock festival' from six photos through image analysis, and included images such as 'there are a lot of people', 'it is crowded', and 'a lot of lights are illuminating the stage'. Contextual information was extracted.

And the content providing server 300 extracts factual information based on the image analysis information and sensor information and extracts estimated information based on the context information.

In addition, among the factual information, 6 photos were first classified based on common image analysis information called 'Rock Festival', and based on the estimated information, (a) and (e), which are photos with many lights illuminating the stage, were classified into the remaining 4 photos. Categorize the eggplants separately from the photos.

And based on this classified information, one or more rock festival information that the user may be interested in can be extracted and provided to the user as shown in FIG. 11.

Referring to Figure 11, it shows that the poster and schedule of the 2016 rock festival that the user may be interested in are provided to the user based on the factual information and estimated information of at least one image data grouped and analyzed.

Meanwhile, as a result of analyzing the at least one image data, the content providing server 300 provides user-specific characteristic information such as 'the user wants to participate in a rock festival' and 'the user likes rock music'. can be extracted and transmitted to the third service server 400.

In addition, among the six photos classified in Figure 10, (a) and (e) classified according to the same standard as 'photos with many lights illuminating the stage' can be provided to the user at the user's request or need. there is.

Above, the process of extracting recommendation information by analyzing image data according to an embodiment of the present invention has been described.

FIG. 12 is a diagram illustrating an operating environment of a device for providing recommended content in a recommended content providing system according to an embodiment of the present invention.

Figure 12 and the description below are intended to provide a brief, general description of a suitable computing environment in which the present invention may be implemented. Although not required, the invention may be described in terms of computer-executable instructions, such as program modules, being executed by a computer system.

Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of program code means for carrying out the acts of the invention disclosed herein.

10, an exemplary computing system implementing the present invention includes a processing unit 11, a system memory 12, and various system components including the system memory 12 coupled to the processing unit 11. The device includes a computing device configured to include a system bus (10).

Processing unit 11 is capable of executing computer-executable instructions designed to implement features of the invention.

System bus 10 may be any of several types of bus structures, including a local bus, a peripheral bus, and a memory bus or memory controller using any of a variety of bus architectures.

The system memory 12 includes a read only memory (ROM) 12a and a random access memory (RAM) 12b. A basic input/output system (BIOS) 13a, which contains basic routines that help transfer information between components within a computing system, such as during startup, may typically be stored in ROM 12a.

The computing system may include storage means, for example, a hard disk drive 15 to read information from or write information to a hard disk, a hard disk drive 15 to read information from or write information to a magnetic disk. It may include a magnetic disk drive 16 that records, and an optical disk drive 17 that reads information from or writes information to an optical disk, such as, for example, a CD-ROM or other optical media. .

The hard disk drive 15, magnetic disk drive 16, and optical disk drive 17 are connected to the system by a hard disk drive interface 18, a magnetic disk drive-interface 19, and an optical drive interface 20, respectively. It is connected to the bus 10.

Additionally, the computing system may further include an external memory 21 as a storage means. The external memory 21 can be connected to the system bus 10 through the input/output interface 24.

The drives described above and associated computer-readable media read and written by the drives provide non-volatile storage of computer-executable instructions, data structures, program modules and other data. Exemplary environments described herein include hard disk 15, magnetic disk 16, and optical disk 17, but may also include magnetic cassettes, flash memory cards, DVDs, Bernoulli cartridges, and RAM. Other types of computer-readable media for storing data may be used, including ROM, etc.

Comprising an operating system (13b), one or more application programs (13c), other program modules (13d), and one or more program modules, which are loaded and executed by the processing unit (11), and program data (13c). Program code means may be stored in the hard disk 15, magnetic disk 16, optical disk 17, ROM 12a or RAM 12b.

In addition, the computing system can receive commands and information from the user through other input devices 22 such as a keyboard, pointing device, microphone, joy stick, game pad, scanner, etc.

These input devices 22 can be connected to the processing unit 11 via an input/output interface 24 connected to the system bus 10 . The input/output interface 24 may be very diverse, such as, for example, a serial port interface, a PS/2 interface, a parallel port interface, a USB interface, an Institute of Electrical and Electronics Engineers (IEEE) 1394 interface (i.e., a FireWire interface), etc. Any one of a variety of different interfaces can be logically represented, or even a combination of different interfaces can be logically represented.

In addition, the computing system to which the present invention is applied may further include a display device 26, such as a monitor or LCD, or an audio device 27, such as a speaker or microphone, which are connected through a video/audio interface 25. It is connected to the system bus 10.

Other peripheral output devices (not shown) may also be connected to the computer system, such as speakers and printers, for example. The video/audio interface unit 25 may include High Definition Multimedia Interface (HDMI), Graphics Device Interface (GDI), etc.

Additionally, a computing system implementing the invention may be connectable to a network, such as, for example, an office-wide or enterprise-wide computer network, a home network, an intranet, and/or the Internet. A computer system may exchange data with external sources, such as remote computer systems, remote applications, and/or remote databases, through such networks.

To this end, the computing system to which the present invention is applied includes a network interface 28 that receives data from an external source and/or transmits data to an external source.

In the present invention, this computing system can transmit and receive information with a device located remotely through a network interface 28. For example, when the computing system refers to the terminal device 200, information can be transmitted and received with the content providing server 300 through the network interface 28.

On the other hand, when the computing system refers to the content providing server 300, information can be transmitted and received with the terminal device 200 or the third service server 400 through the network interface 28. Network interface 28 may be represented as a logical combination of one or more software and/or hardware modules, such as, for example, a network interface card and a corresponding Network Driver Interface Specification (“NDIS”) stack.

Likewise, the computer system receives data from or transmits data to external sources through input/output interface 24. The input/output interface 24 may be connected to a modem 23 (e.g., a standard modem, a cable modem, or a digital subscriber line (“DSL”) modem) through which an external source may be connected. It may receive data from and/or transmit data to an external source.

12 represents an operating environment suitable for the present invention, the principles of the present invention may be employed in any system capable of implementing the principles of the present invention, with appropriate modifications if necessary. The environment depicted in Figure 12 is merely illustrative and does not represent even a small portion of the wide variety of environments in which the principles of the present invention may be implemented.

In addition, various information generated when determining whether to enter a store according to the present invention may be stored and accessed in any computer-readable medium related to a computing system. For example, some of these program modules and some of the associated program data may be stored in system memory 12 by operating system 13b, application programs 13c, program modules 13d, and/or program data. It can be included in (13e).

Additionally, when a mass storage device, such as a hard disk, is connected to the computing system, these program modules and related program data may be stored in the mass storage device. In a network environment, program modules related to the present invention or portions thereof may be stored in a remote computer system connected through the modem 23 of the input/output interface 24 or the network interface 25. Execution of these modules may be performed in a distributed environment as described above.

As described above, although this specification contains details of numerous specific implementations, these should not be construed as limitations on the scope of any invention or what may be claimed, but rather may be specific to particular embodiments of a particular invention. It should be understood as a description of features. Certain features described herein in the context of individual embodiments may also be implemented in combination in a single embodiment.

Conversely, various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination. Furthermore, although features may be described as operating in a particular combination and initially claimed as such, one or more features from a claimed combination may in some cases be excluded from that combination, and the claimed combination may be a sub-combination. It can be changed to a variant of a sub-combination.

Likewise, although operations are depicted in the drawings in a particular order, this should not be construed as requiring that those operations be performed in the specific order or sequential order shown or that all of the depicted operations must be performed to obtain desirable results. In certain cases, multitasking and parallel processing may be advantageous.

Additionally, the separation of various system components in the above-described embodiments should not be construed as requiring such separation in all embodiments, and the described program components and systems may generally be integrated together into a single software product or packaged into multiple software products. You must understand that it is possible.

Specific embodiments of the subject matter described herein have been described. Other embodiments are within the scope of the following claims. For example, the operations recited in the claims can be performed in a different order and still achieve desirable results. As an example, the process depicted in the accompanying drawings does not necessarily require the specific depicted order or sequential order to achieve desirable results. In certain implementations, multitasking and parallel processing may be advantageous.

The present description sets forth the best mode of the invention and provides examples to illustrate the invention and to enable any person skilled in the art to make and use the invention.

The specification prepared in this way does not limit the present invention to the specific terms presented. Accordingly, although the present invention has been described in detail with reference to the above-described examples, those skilled in the art may make modifications, changes, and variations to the examples without departing from the scope of the present invention.

Therefore, the scope of the present invention should not be determined by the described embodiments, but by the scope of the patent claims.

The present invention relates to a method and device for providing recommended content, and more specifically, to extract factual information through sensor information and image analysis information of photos taken or captured by a user, and extract estimated information through context analysis information, It relates to a method and device for classifying a plurality of image data according to a certain standard based on the factual information and estimated information and providing customized recommended content specialized for the user.

According to the present invention, factual information is extracted using sensor information and data analysis information of a photo taken or captured by a user, and estimated information is extracted using context information obtained by analyzing the photo, and the factual information and estimate are extracted. By extracting the recommended information the user needs based on the information and providing it to the user, it is possible to manage photos more diversely and efficiently while providing customized content tailored to the user's changes in behavior and surrounding situations.

In particular, one or more certain standards are set based on the extracted factual information and estimated information, and the photos are classified according to the set standards to provide one or more information including recommended information that can be extracted from the classified criteria or classified photos. Provides customized content tailored to the user's situation and provides third-party service providers with one or more information that can be extracted from classified criteria or classified photos to create effective marketing strategies based on age, gender, etc. We can help you do it.

Therefore, the present invention can contribute to the development of the big data analysis industry and the storage platform service industry through the above content provision method, and has industrial applicability because it not only has sufficient potential for commercialization or sales, but also can be clearly implemented in reality. .

100: Communication network 200: Terminal device 300: Content provision server
400: Third service server

Claims (18)

A content providing server receiving and storing at least one image data and sensor information corresponding to each image data from at least one terminal device;
extracting image analysis information by analyzing characters or shapes included in each image data based on the image data;
Analyzing context information indicating a situation included in each image data based on the image data;
extracting factual information about each of the image data based on the extracted image analysis information and the sensor information;
extracting estimated information for each of the image data based on the analyzed context information;
Classifying the at least one image data according to one or more criteria set based on factual information and estimated information for each of the image data; and
Transmitting at least one piece of information related to the at least one classified image data to the at least one terminal device or a third service server;
Includes,
The classification step is,
A step of first classifying image data related to a first classification standard set based on the factual information; and
Further comprising: secondary classifying one or more image data grouped through the primary classification using one or more secondary classification criteria set based on the estimation information for each of the grouped one or more image data,
The transmitting step is,
extracting one or more recommendation information associated with at least one of the one or more items of interest corresponding to the one or more secondary classification criteria while being associated with the topic of interest according to the primary classification criteria and transmitting the information to the at least one terminal device; A content provision method comprising: delete ◈Claim 3 was abandoned upon payment of the setup registration fee.◈ The method of claim 1, wherein extracting the one or more recommendation information and transmitting it to the at least one terminal device
generating a recommendation list including the one or more recommended information; and
Extracting the remaining recommendation information, excluding the recommendation information corresponding to the image analysis information, from one or more pieces of recommendation information included in the recommendation list and transmitting the remaining recommendation information to the at least one terminal device;
A content provision method comprising: ◈Claim 4 was abandoned upon payment of the setup registration fee.◈ The method of claim 1, before transmitting to the at least one terminal device or a third service server,
extracting characteristic information for each user from the classified image data based on at least one of the factual information and the estimated information;
A content providing method further comprising: delete delete ◈Claim 7 was abandoned upon payment of the setup registration fee.◈ According to paragraph 1,
mapping at least one of the factual information and the estimated information for each of the terminal devices with the image data and storing the information;
A content providing method further comprising: ◈Claim 8 was abandoned upon payment of the setup registration fee.◈ The method of claim 1, wherein the sensor information is
A content providing method comprising at least one of location information, date and time information, and weather information of the terminal device at the time the terminal device generates image data. delete ◈Claim 10 was abandoned upon payment of the setup registration fee.◈ A computer program implemented to execute the method according to any one of claims 1, 3, 4, 7, and 8 and stored in a computer-readable recording medium. A communication module that transmits and receives data with at least one terminal device and a third service server in conjunction with a communication network;
a storage module that stores at least one image data received from the at least one terminal device and sensor information corresponding to each of the image data; and
Based on the image data stored in the storage module, image analysis information is extracted by analyzing the characters or shapes included in each image data, and contextual information indicating the situation included in each image data is analyzed based on the image data. , extracting factual information based on the analyzed image analysis information and the sensor information, extracting estimated information based on the context information, and generating the at least one image data based on the extracted factual information and estimated information. a control module that classifies and controls to transmit one or more information related to the classified at least one image data to the at least one terminal device or a third service server through the communication module;
Includes,
The control module is,
Primary classification of image data related to the primary classification criteria set based on the factual information, and one or more image data grouped through the primary classification based on the estimation information of each of the grouped one or more image data Secondary classification based on one or more secondary classification criteria set, and one or more recommended information associated with at least one of the one or more items of interest corresponding to the one or more secondary classification criteria while being associated with a topic of interest according to the primary classification criteria. A content providing server, characterized in that extracting and transmitting to the at least one terminal device through the communication module. delete delete delete delete delete delete delete

Images