KR20220023735A - Apparatus for providing customized product information - Google Patents

Abstract

An embodiment of the present invention proposes a method for providing user-customized product information. According to an aspect of the present invention, an apparatus for providing user-customized product information comprises: a first information collecting unit which is configured to collect user information; a second information collection unit which is configured to collect user-related product information including a user's product search history, product inquiry history, and product purchase history; a third information collection unit which is configured to collect social network information based on a social network platform and account information received from the user; a storage unit which is configured to store information on a plurality of products classified according to a plurality of preset categories; and a control unit which is configured to provide information on a product of interest to the user by outputting the information on the product of interest stored in the storage unit.

Description

Device for providing customized product information {APPARATUS FOR PROVIDING CUSTOMIZED PRODUCT INFORMATION}

The present invention relates to an apparatus for providing user-customized product information.

Scientific analysis of customers is lacking due to customer segmentation at the level of frequency analysis of demographic characteristics and purchasing patterns of current shopping mall purchasers, and product recommendations tend to be recommended based on the intuition or past behavior of marketing managers, and scientific product recommendations There is a problem that it is not done. In order to solve this problem, it is necessary to shorten the search time of purchasing customers and develop an optimal shopping mall recommendation technology, which can enhance the competitiveness of shopping mall operators.

In the prior art, an apparatus and method for providing an artificial intelligence-based shopping mall product purchase prediction platform capable of predicting a shopping mall purchase customer’s product purchase by verifying the lifestyle of each purchasing customer based on the customer’s product purchase data using an artificial intelligence algorithm is disclosed. became (patent document 1).

However, since the prior art predicts a product purchase depending on the purchasing customer's product purchase data, there is a limitation in that reliability and accuracy of product purchase prediction cannot be guaranteed for a customer or a new subscriber who does not have much purchase history.

Therefore, it is necessary to develop a platform that can provide customized product information corresponding to customers by collecting various information as well as product purchase data.

Registered Patent Publication No. 10-2237399 (April 07, 2021)

The present invention has been devised to solve the above problems, and more particularly, relates to an apparatus for providing user-customized product information by utilizing various information about the user.

Other objects and advantages of the present invention may be understood by the following description, and will become more clearly understood by the examples of the present invention. In addition, it will be readily apparent that the objects and advantages of the present invention can be realized by means and combinations thereof indicated in the claims.

According to an aspect of the present invention, there is provided an apparatus for providing user-customized product information, comprising: a first information collecting unit configured to collect user information; a second information collection unit configured to collect user-related product information including the user's product search history, product inquiry history, and product purchase history; a third information collection unit configured to collect social network information based on the social network platform and account information received from the user; a storage unit configured to store information on a plurality of products classified according to a plurality of preset categories; and selecting one or more products of interest to the user from among the plurality of products based on the user information, the user-related product information, and the social network information, and outputting information on the products of interest stored in the storage unit. , may include a control unit configured to provide information on the product of interest to the user.

The control unit evaluates the degree of relevance to each of the plurality of categories based on the user information, the user-related product information, and the social network information, and selects one or more interest categories from among the plurality of categories according to the evaluated degree of relevance It may be configured to output information about the product of interest corresponding to the determined category of interest.

The controller may sequentially determine the plurality of categories as the interest categories in an order of increasing the evaluated relevance, wherein the sum of the relevance of the categories determined as the interest category is half of the total of the relevance of the plurality of categories. When the abnormality is reached, it may be configured to end the determination of the interest category.

The controller may be configured to determine the number of products of interest corresponding to the interest category in proportion to the evaluated degree of relevance.

The control unit determines the number of products of interest corresponding to the interest category by using the following equation,

[Equation]

Here, i is the index of the interest category, M _i is the number of interest products in the interest category i, M is the total number of interest products provided to the user, I _i is related to the interest category i, and I _sum is the It is the sum of the degree of relevance of the interest category determined by the controller, and α may be a weight value.

The third information collection unit may be configured to access a page corresponding to the account information on the received social network platform and collect a post stored on the page as the social network information.

The account information may include at least one of personal account information of the user and account information of a third party other than the user.

The third information collection unit may be configured to request access to the page from the user when the account information is the personal account information and the page is a private page.

The third information collection unit may be configured to, when the account information is the third-party account information, and the page is the private page, request the user other social network platform and account information for the third party there is.

The second information collection unit evaluates the degree of similarity between the user and the other user by comparing the product of interest selected by the control unit and provided to the user with the product of interest provided to another user, and the degree of similarity evaluated for the other user When is equal to or greater than a preset reference value, the product of interest provided to the other user may be further collected as the user-related product information for the user.

The first information collection unit may be configured to further collect the user's photo input from the user.

The controller may be configured to correct the picture so that the product selected by the user from among the plurality of products is reflected in the user's picture, and to provide the corrected picture to the user.

The control unit may be configured to correct the user's photo by determining an area matching the selected product in the user's photo, and reflecting a correction layer preset for the selected product in the determined area.

An embodiment of the present invention provides a method for operating an apparatus for providing user-customized product information, the method comprising: collecting user information; collecting user-related product information including the user's product search history, product inquiry history, and product purchase history; collecting social network information based on the social network platform and account information received from the user; storing information on a plurality of products classified according to a plurality of preset categories; And based on the user information, the user-related product information and the social network information, by selecting one or more products of interest to the user from among the plurality of products, and outputting information on the products of interest, to the products of interest providing information to the user; We propose a method including

An embodiment of the present invention provides a method for operating an apparatus for providing user-customized product information, the method comprising: collecting user information; collecting user-related product information including the user's product search history, product inquiry history, and product purchase history; collecting social network information based on the social network platform and account information received from the user; storing information on a plurality of products classified according to a plurality of preset categories; And based on the user information, the user-related product information and the social network information, by selecting one or more products of interest to the user from among the plurality of products, and outputting information on the products of interest, to the products of interest providing information to the user; It proposes a computer-readable recording medium recording a program for executing a method comprising a.

An embodiment of the present invention provides a method for operating an apparatus for providing user-customized product information, the method comprising: collecting user information; collecting user-related product information including the user's product search history, product inquiry history, and product purchase history; collecting social network information based on the social network platform and account information received from the user; storing information on a plurality of products classified according to a plurality of preset categories; And based on the user information, the user-related product information and the social network information, by selecting one or more products of interest to the user from among the plurality of products, and outputting information on the products of interest, to the products of interest providing information to the user; It proposes a program recorded on a computer-readable recording medium to execute a method comprising a.

According to an aspect of the present invention, there is an advantage in that a product suitable for a user can be recommended by providing user-customized product information by utilizing various information about the user.

Effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

Since the following drawings attached to the present specification serve to further understand the technical idea of the present invention together with the detailed description of the present invention, the present invention should not be construed as limited only to the matters described in such drawings.
1 is a diagram schematically illustrating an apparatus for providing user-customized product information according to an embodiment of the present invention.
2 is a diagram schematically illustrating a connection configuration between an apparatus for providing user-customized product information and a user terminal according to an embodiment of the present invention.
3 is a diagram schematically illustrating an operation configuration of an apparatus for providing user-customized product information according to an embodiment of the present invention.
4 is a diagram illustrating in more detail a configuration for selecting a product of interest among operation configurations of an apparatus for providing user-customized product information according to an embodiment of the present invention.
5 is a block diagram illustrating an electronic device and a network according to an embodiment of the present invention.
6 is a block diagram illustrating an electronic device according to an exemplary embodiment.
7 is a block diagram illustrating a program module according to an exemplary embodiment.
8 is a diagram illustrating an online platform implemented through an electronic device according to an embodiment of the present invention.

The terms or words used in the present specification and claims should not be construed as being limited to their ordinary or dictionary meanings, and the inventor may properly define the concept of the term in order to best describe his invention. Based on the principle that there is, it should be interpreted as meaning and concept consistent with the technical idea of the present invention.

Accordingly, the embodiments described in this specification and the configurations shown in the drawings are only the most preferred embodiment of the present invention and do not represent all the technical spirit of the present invention, so at the time of the present application, various It should be understood that there may be equivalents and variations.

In addition, in the description of the present invention, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

Terms including an ordinal number such as 1st, 2nd, etc. are used for the purpose of distinguishing any one of various components from the others, and are not used to limit the components by such terms.

Throughout the specification, when a part "includes" a certain element, it means that other elements may be further included, rather than excluding other elements, unless specifically stated otherwise.

In addition, throughout the specification, when a part is "connected" with another part, it is not only "directly connected" but also "indirectly connected" with another element interposed therebetween. include

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram schematically illustrating an apparatus 100 for providing user-customized product information according to an embodiment of the present invention. 2 is a diagram schematically illustrating a connection configuration between the user-customized product information providing apparatus 100 and the user terminal 200 according to an embodiment of the present invention.

Referring to FIG. 1 , the user-customized product information providing apparatus 100 includes a first information collection unit 110 , a second information collection unit 120 , a third information collection unit 130 , a storage unit 140 , and a control unit. (150). Also, referring to FIG. 2 , the user-customized product information providing apparatus 100 may be connected to one or more user terminals 200 by wire and/or wirelessly.

For example, in the embodiment of FIG. 2 , the first user terminal 201 , the second user terminal 202 , and the third user terminal 203 may be connected to the user-customized product information providing apparatus 100 through a network. That is, the first user accesses the user-customized product information providing apparatus 100 through the first user terminal 201 , and the second user accesses the user-customized product information providing apparatus 100 through the second user terminal 202 . , and the third user may access the user-customized product information providing apparatus 100 through the third user terminal 203 .

The first information collection unit 110 may be configured to collect user information.

Here, the user information is information required for membership registration, and may include information on at least one of the user's age, gender, preferred brand, and preferred style.

For example, when registering as a member, the user may input age and gender, and may select one or more preferred brands. In addition, the user may select a preferred style from among preset selectable styles (eg, a fashion style and a makeup style).

The second information collection unit 120 may be configured to collect user-related product information including the user's product search history, product inquiry history, and product purchase history.

Specifically, the second information collection unit 120 may collect a product search history in which the user searches for a product, a product inquiry history in which the user searches for a product, and a product purchase history in which the user has purchased the product.

For example, the second information collection unit 120 may obtain log information on the user's product search, product inquiry, and product purchase history, and collect user-related product information from the obtained log information.

The third information collection unit 130 may be configured to collect social network information based on the social network platform and account information received from the user.

Specifically, the account information may include at least one of personal account information of the user and account information of a third party other than the user. That is, when the user inputs social network information, he or she can select whether to use a personal account or a third-party account. For example, the user may input his/her social network information, or may input social network information of a celebrity or an influencer.

In addition, the social network platform is a platform of a social network service (SNS), and may be preset so that a user can select it. For example, the social network platform may include Facebook, Instagram, Twitter, Kakaostory, Weibo, and the like.

The third information collection unit 130 may be configured to access a page corresponding to the account information in the received social network platform, and collect posts stored in the accessed page as social network information.

For example, in the embodiment of FIG. 2 , it is assumed that the first user selects Instagram as the social network platform through the first user terminal 201 and inputs “ABC” as personal account information. The third information collection unit 130 may access the "ABC" account page on Instagram, and collect posts, hashtags, photos, and images posted by the user. In addition, the third information collection unit 130 may also collect comments on posts stored in the accessed page.

Thereafter, the third information collection unit 130 may extract meaningful words related to a plurality of products from the post by analyzing the syntax of the collected post. For example, the third information collection unit 130 may collect the post by decomposing it into token units using a parsing algorithm.

Also, the third information collection unit 130 may collect information corresponding to the objects included in the photos and images by analyzing the objects included in the collected photos and images. For example, when a picture of "B brand A's foundation" is posted on a page corresponding to account information, the third information collection unit 130 extracts an object for a foundation product from the picture, and "brand A", "foundation" " and "B Foundation" may be collected.

In addition, when the account information is personal account information and the page corresponding to the personal account is a private page, the third information collection unit 130 may be configured to request access to the page from the user.

That is, the page corresponding to the account information may be a private page that can be accessed only through an account having access to check the stored posts. In this case, the third information collection unit 130 may check whether a page corresponding to the account information is published, and in the case of a private page, may request access to the page from the user. After receiving the access right, the third information collection unit 130 may collect social network information from posts stored in the corresponding page.

As another example, when the account information is third-party account information and the page is a private page, the third information collection unit 130 may be configured to request other social network platforms and account information for the third party from the user. there is.

In this case, since the account information input by the user is not the user's own account information, but the account information of a third party, the third information collection unit 130 does not have access to the page corresponding to the third party account information. In this case (ie, if the page is a private page), the user may request account information of another social network platform for a third party.

The storage unit 140 may be configured to store information on a plurality of products classified according to a plurality of preset categories.

For example, the plurality of categories may be classified into a cosmetics category and a clothing category. In addition, the cosmetics category may include categories subdivided into FACE, LIP, EYE, NAIL, BODY&HAIR, TOOL, MAN, and PERFUME. Also, the clothing category may include categories subdivided into WOMEN, MEN, and KIDS. In addition, information on a plurality of products may be stored in each category.

The controller 150 may be configured to select one or more products of interest to the user from among a plurality of products based on user information, user-related product information, and social network information.

Specifically, the control unit 150 may be communicatively connected to the first information collection unit 110 , the second information collection unit 120 , the third information collection unit 130 , and the storage unit 140 . The control unit 150 obtains user information from the first information collection unit 110 , obtains user-related product information from the second information collection unit 120 , and social network information from the third information collection unit 130 . can be collected

Specifically, the controller 150 may select a product of interest corresponding to user information, user-related product information, and social network information from a plurality of products by using machine learning and/or an artificial neural network. there is.

For example, a keyword related to each of the plurality of products may be preset. By comparing these keywords with information collected by the first to third information collection units 110 , 120 , and 130 , a product of interest may be selected.

As a specific example, information on a plurality of products may be preset in the artificial neural network. Then, the control unit 150 inputs user information, user-related product information, and social network information to the input layer of the artificial neural network, and passes through the N-th hidden layer (where N is a natural number greater than or equal to 1), and includes user information and user-related product information. and a weight may be added to each of the social network information. In addition, a product of interest corresponding to the user may be selected and outputted from among a plurality of products through the output layer of the artificial neural network.

As another example, a machine learning model capable of selecting and outputting a product of interest from a plurality of products based on preset user information, user-related product information, and social network information may be trained in advance. The controller 150 may select a product of interest from among a plurality of products by inputting user information corresponding to the user, user-related product information, and social network information into the pre-trained machine learning model.

The controller 150 may be configured to provide information on the product of interest to the user by outputting information on the product of interest stored in the storage unit 140 .

For example, the control unit 150 may access the storage unit 140 to obtain detailed product information such as a brand, a product image, a price, and an ingredient for the selected product of interest. In addition, the controller 150 may provide the user with detailed product information on the acquired product of interest as a recommendation list, so that the user can check the recommended product (product of interest) corresponding to his/her various information.

That is, the user-customized product information providing apparatus 100 according to an embodiment of the present invention considers both the user's social network information and/or the social network information of a third party in addition to basic personal information such as the user's gender and age, It has the advantage of being able to recommend a suitable product to the user. Accordingly, even if the user does not check individual products individually, a customized product can be recommended based on the entered information, thereby saving time that may be wasted unnecessarily.

Meanwhile, the controller 150 uses a processor, an application-specific integrated circuit (ASIC), other chipsets, logic circuits, registers, communication modems, data processing devices, etc. known in the art to execute various control logics performed in the present invention. may optionally be included. Also, when the control logic is implemented in software, the controller 150 may be implemented as a set of program modules. In this case, the program module may be stored in the memory and executed by the controller 150 . The memory may be inside or outside the control unit 150 , and may be connected to the control unit 150 by various well-known means.

In addition, the storage unit 140 may store data necessary for each component of the user-customized product information providing apparatus 100 to perform an operation and function, or data generated in the process of performing a program or an operation and function, and the like. The storage unit 140 is not particularly limited in its type as long as it is a known information storage means capable of writing, erasing, updating and reading data. As an example, the information storage means may include RAM, flash memory, ROM, EEPROM, registers, and the like. Also, the storage unit 140 may store program codes in which processes executable by the control unit 150 are defined.

Hereinafter, a detailed operation configuration of the apparatus for providing user-customized information will be described in more detail with reference to FIGS. 3 and 4 .

3 is a diagram schematically illustrating an operation configuration of an apparatus 100 for providing user-customized product information according to an embodiment of the present invention. 4 is a diagram illustrating in more detail a configuration for selecting a product of interest among operation configurations of the apparatus 100 for providing customized product information according to an embodiment of the present invention.

In step S100 , the first information collection unit 110 may collect user information required for membership registration, such as the user's age, gender, preferred brand, and preferred style.

In step S200 , the second information collection unit 120 may collect user-related product information including the user's product search history, product inquiry history, and product purchase history.

In step S300 , the third information collection unit 130 may collect social network information based on the social network platform and account information received from the user.

However, in the embodiment of FIG. 3 , for convenience of explanation, an embodiment in which steps S100 , S200 , and S300 are sequentially performed according to a time sequence has been described, but the steps performed by the first information collection unit 110 Note that S100, step S200 performed by the second information collection unit 120, and step S300 performed by the third information collection unit 130 may be performed in a different order or may be performed in parallel.

In step S400 , the controller 150 may select a product of interest corresponding to the user from among a plurality of products based on the information collected in steps S100 , S200 and S300 .

In step S410, the control unit 150, based on the user information, user-related product information, and social network information, may be configured to evaluate the degree of relevance to each of the plurality of categories.

Specifically, the controller 150 may evaluate the degree of relevance for each of a plurality of categories from user information, user-related product information, and social network information by using a pre-trained machine learning model or artificial neural network.

For example, it is assumed that the user is a woman in her 20s and has a history of purchasing basic makeup products belonging to the FACE category and products belonging to the LIP category. In this case, the relevance of the FACE category and the LIP category among the plurality of categories may be relatively high compared to other categories. In addition, the relevance of the MEN category and the KIDS category, which are far from user information and user-related product information, may be evaluated relatively low.

In operation S420 , the controller 150 may be configured to determine one or more interest categories among a plurality of categories according to the evaluated degree of relevance.

Specifically, the controller 150 sequentially determines the plurality of categories as the interest categories in the order of the evaluated relevance, but the sum of the relevance of the categories determined as the interest category is at least half of the total of the relevance of the plurality of categories This may be configured to end the determination of the interest category.

For example, the sum of the degrees of relevance of the plurality of categories may be preset to 100%. In addition, the relevance of each interest category may be evaluated as any one of 0% to 100%.

That is, the controller 150 may sequentially determine a category having a high degree of relevance evaluated from among a plurality of categories as an interest category. In addition, if the determined sum of the relevance of the interest categories is more than half of the sum of the relevance of the plurality of categories, the additional interest category may not be determined. Through this, the control unit 150 may select the most suitable interest category for the user, thereby intensively providing information on the product of interest that the user may be interested in.

In step S430 , the controller 150 may be configured to output information about a product of interest corresponding to the determined interest category.

More specifically, the control unit 150 may be configured to determine the number of products of interest corresponding to the interest category to be proportional to the evaluated degree of relevance.

For example, the controller 150 may determine the number of products of interest corresponding to the interest category by using the following equation.

[Equation]

Here, i is the index of the interest category, M _i is the number of items of interest in the interest category i, M is the total number of items of interest provided to the user, I _i is related to the interest category i, and I _sum is the control unit ( 150) is the sum of the degree of relevance of the interest category determined by , and α is a weight value. For example, α may be 0.5.

For example, it is assumed that the first category, the second category, the third category, the fourth category, and the fifth category among the plurality of categories are determined as the interest category. In addition, the relevance (I ₁ ) of the first category is 8%, the relevance (I ₂ ) of the second category is 17%, the relevance (I ₃ ) of the third category is 10%, and the fourth category Assume that the degree of relevance (I ₄ ) is 12%, and the degree of relevance (I ₅ ) of the fifth category is 4%. Since the sum of the relevance of the plurality of categories is 100%, the total (51%) of the relevance of the first to fifth categories may be more than half of the total of the relevance of the plurality of categories.

Assuming that the total number of products of interest provided to the user is 200, the number of products of interest determined for each of the first to fifth categories is shown in the table below.

Interest Category (i) Relevance (I _i , %) I _i ÷ I _sum Items of Interest (M _i ) 1st category 8 0.1568 31 2nd category 17 0.3333 67 3rd category 10 0.1960 39 4th category 12 0.2352 47 5th category 4 0.0784 16

That is, among the first to fifth categories, the number of products of interest in the second category having the highest degree of relevance (I ₂ ) is determined to be 67, and the number of products of interest in the fifth category having the lowest degree of relevance (I ₅ ) is 16 may be determined. Through this process, the user-customized product information providing apparatus 100 has the advantage of being able to selectively provide the user with a product of interest in the user's interest category from among a plurality of preset categories. In addition, the user-customized product information providing apparatus 100 determines the number of products of interest corresponding to the interest category according to the degree of relevance evaluated for each interest category, thereby providing information on a product suitable for the user's field of interest. That is, the user-customized product information providing apparatus 100 has the advantage of being able to provide the user with customized product information in a customized category by comprehensively considering not only user information and user-related product information, but also social network information. There is this.

Meanwhile, the second information collection unit 120 may be configured to evaluate the similarity between the user and other users by comparing the product of interest selected by the controller 150 and provided to the user with the product of interest provided to other users.

That is, member information connectable to the user-customized product information providing apparatus 100 may be stored in advance in the storage unit 140 . And, by accessing the storage unit 140 , the second information collection unit 120 may acquire information about the interest item provided to the user as well as the interest item provided to another user. In addition, the second information collection unit 120 may evaluate the degree of similarity between the user and the other user with respect to the product of interest.

In this case, the second information collection unit 120 may evaluate the degree of similarity between the user and other users according to whether the product of interest is the same or whether the category to which the product of interest belongs is the same.

In addition, the second information collection unit 120 may be configured to further collect the product of interest provided to the other user as user-related product information for the user when the degree of similarity evaluated with respect to the other user is equal to or greater than a preset reference value.

That is, the user-related product information collected by the second information collection unit 120 includes not only the user's product search history, product inquiry history, and product purchase history, but also related product information of other users whose similarity is evaluated to be greater than or equal to the reference value. can

Therefore, the user-customized product information providing apparatus 100 can provide information on the product of interest suitable to the user by referring to information on the product of interest of another user whose similarity is highly evaluated, even for a user with relatively little activity. There are advantages.

On the other hand, the first information collection unit 110 may be configured to further collect the user's photo input from the user.

In this case, the user uploads a desired photo, and the first information collection unit 110 may collect the uploaded photo as the user's photo. Here, for convenience of explanation, although the user's uploaded photo is named the user's photo, it should be noted that the user's photo refers to the user's uploaded photo, and is not limited to only the user's own photo. In other words, users can upload not only their own photos, but also other people's photos.

The controller 150 may be configured to correct the picture so that the product selected by the user from among the plurality of products is reflected in the user's picture.

Specifically, the controller 150 may be configured to correct the user's photo by determining an area matching the selected product in the user's photo, and reflecting a correction layer preset for the selected product in the determined area.

For example, it is assumed that the picture obtained by the first information collection unit 110 is a picture including the user's face, and the product selected by the user is a lipstick. The controller 150 may divide the user's photo into regions for hair, forehead, ears, eyebrows, eyes, nose, cheeks, and mouth, respectively. In addition, a mouth region matching the selected product may be determined as a region of interest (ROI). In addition, the controller 150 may correct the user's photo by overlapping the preset correction layer for the selected product on the region of interest (mouth region) of the user's photo. That is, the user's photo may be corrected as if the selected lipstick is painted on the user's lips.

The controller 150 may be configured to provide the corrected photo to the user. Accordingly, there is an advantage in that the user can check the performance information of the product in advance by applying the product of interest provided from the controller 150 or the product directly searched for to the uploaded photo in advance.

Electronic devices according to various embodiments of the present disclosure may include, for example, a smartphone, a tablet PC, a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a PDA, and a PMP. It may include at least one of a portable multimedia player, an MP3 player, a medical device, a camera, and a wearable device. A wearable device may be an accessory (e.g., watch, ring, bracelet, anklet, necklace, eyewear, contact lens, or head-mounted-device (HMD)), a textile or clothing integral (e.g. electronic garment); It may include at least one of a body mountable (eg skin pad or tattoo) or bioimplantable circuit In some embodiments, the electronic device may include, for example, a television, a digital video disk (DVD) player; Audio, refrigerator, air conditioner, vacuum cleaner, oven, microwave oven, washing machine, air purifier, set-top box, home automation control panel, security control panel, media box (eg Samsung HomeSync ^TM , Apple TV ^TM , or Google TV ^TM ) , a game console (eg, Xbox ^TM , PlayStation ^TM ), an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame.

In another embodiment, the electronic device may include various medical devices (eg, various portable medical measuring devices (eg, a blood glucose monitor, a heart rate monitor, a blood pressure monitor, or a body temperature monitor), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), Computed tomography (CT), imagers, or ultrasound machines, etc.), navigation devices, global navigation satellite system (GNSS), event data recorder (EDR), flight data recorder (FDR), automotive infotainment devices, marine electronic equipment (e.g. navigation devices for ships, gyro compasses, etc.), avionics, security devices, head units for vehicles, industrial or home robots, drones, ATMs in financial institutions, point of sale (POS) in stores of sales) or IoT devices (eg, light bulbs, various sensors, sprinkler devices, fire alarms, thermostats, street lights, toasters, exercise equipment, hot water tanks, heaters, boilers, etc.). According to some embodiments, the electronic device is a piece of furniture, a building/structure or a vehicle, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (eg, water, electricity, gas, or a radio wave measuring device). In various embodiments, the electronic device may be flexible or a combination of two or more of the various devices described above. The electronic device according to the embodiment of the present document is not limited to the above-described devices. In this document, the term user may refer to a person who uses an electronic device or a device (eg, an artificial intelligence electronic device) using the electronic device.

In addition, the electronic device may include a bus, a processor, a memory, an input/output interface, a display, and a communication interface. In some embodiments, the electronic device may omit at least one of the components or may additionally include other components. A bus may include circuitry that connects components to each other and transmits communications (eg, control messages or data) between components. The processor may include one or more of a central processing unit, an application processor, and a communication processor (CP). The processor may, for example, execute an operation or data processing related to control and/or communication of at least one other component of the electronic device.

Memory may include volatile and/or non-volatile memory. The memory may store, for example, commands or data related to at least one other component of the electronic device. According to one embodiment, the memory may store software and/or programs. A program may include, for example, a kernel, middleware, an application programming interface (API), and/or an application program (or "application"), and the like. At least a portion of the kernel, middleware, or API may be referred to as an operating system. The kernel controls or controls system resources (eg, bus, processor, or memory, etc.) used to execute an operation or function implemented in, for example, other programs (eg, middleware, API, or application program). can manage In addition, the kernel may provide an interface for controlling or managing system resources by accessing individual components of the electronic device from middleware, API, or application programs.

The middleware may, for example, play an intermediary role so that an API or an application program can communicate with the kernel to send and receive data. In addition, the middleware may process one or more work requests received from the application program according to priority. For example, the middleware may give priority to at least one of the application programs to use a system resource (eg, a bus, a processor, a memory, etc.) of the electronic device, and process the one or more work requests. API is an interface for an application to control functions provided by the kernel or middleware, and includes at least one interface or function (eg, command) for, for example, file control, window control, image processing, or character control. can do. The input/output interface, for example, transmits commands or data input from a user or other external device to other component(s) of the electronic device, or receives commands or data received from other component(s) of the electronic device It can be output to the user or other external device.

The display may include, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, or a microelectromechanical system (MEMS) display, or an electronic paper display. there is. The display may, for example, present various content (eg, text, images, video, icons, and/or symbols, etc.) to the user. The display may include a touch screen, and may receive, for example, a touch input using an electronic pen or a part of the user's body, a gesture, a proximity, or a hovering input. The communication interface, for example, may establish communication between the electronic device and an external device (eg, a first external electronic device, a second external electronic device, or a server). For example, the communication interface may be connected to a network through wireless communication or wired communication to communicate with an external device (eg, a second external electronic device or a server).

Wireless communication, for example, LTE, LTE Advance (LTE-A), CDMA (code division multiple access), WCDMA (wideband CDMA), UMTS (universal mobile telecommunications system), WiBro (Wireless Broadband), or GSM (Global System for Mobile Communications) and the like may include cellular communication using at least one. According to an embodiment, wireless communication is, for example, wireless fidelity (WiFi), Bluetooth, Bluetooth low energy (BLE), Zigbee, near field communication (NFC), magnetic secure transmission, radio It may include at least one of a frequency (RF) or a body area network (BAN). According to one embodiment, the wireless communication may include GNSS. The GNSS may be, for example, a Global Positioning System (GPS), a Global Navigation Satellite System (Glonass), a Beidou Navigation Satellite System (hereinafter, “Beidou”) or Galileo, the European global satellite-based navigation system. Hereinafter, in this document, "GPS" may be used interchangeably with "GNSS". Wired communication may include, for example, at least one of universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard232 (RS-232), power line communication, or plain old telephone service (POTS). there is. The network may include at least one of a telecommunications network, eg, a computer network (eg, LAN or WAN), the Internet, or a telephone network.

Each of the first and second external electronic devices may be the same or a different type of electronic device. According to various embodiments, all or a part of operations executed by the electronic device may be executed by one or a plurality of other electronic devices (eg, electronic devices or servers. According to one embodiment, the electronic device may perform a certain function or service to be performed automatically or upon request, the electronic device may request from another device (eg, an electronic device or a server) for at least some functions related thereto, instead of or in addition to executing the function or service itself. Another electronic device (eg, an electronic device or a server) may execute the requested function or additional function and transmit the result to the electronic device The electronic device may process the received result as it is or additionally to perform the requested function For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

The electronic device includes one or more processors (eg, AP), communication modules, (subscriber identification module, memory, sensor module, input device, display, interface, audio module, camera module, power management module, battery, indicator, and motor) The processor may, for example, run an operating system or an application program to control a plurality of hardware or software components connected to the processor, and may perform various data processing and operations. For example, it may be implemented as a system on chip (SoC). According to an embodiment, the processor may further include a graphic processing unit (GPU) and/or an image signal processor. The processor may include other components (eg, : A command or data received from at least one of the non-volatile memory) may be loaded into the volatile memory for processing, and the result data may be stored in the non-volatile memory.

It may have the same or similar configuration to a communication module (eg, a communication interface). The communication module may include, for example, a cellular module, a WiFi module, a Bluetooth module, a GNSS module, an NFC module, and an RF module. The cellular module may provide, for example, a voice call, a video call, a text service, or an Internet service through a communication network. According to an embodiment, the cellular module may perform identification and authentication of an electronic device within a communication network using a subscriber identification module (eg, a SIM card). According to an embodiment, the cellular module may perform at least some of the functions that the processor may provide. According to one embodiment, the cellular module may include a communication processor (CP). According to some embodiments, at least some (eg, two or more) of a cellular module, a WiFi module, a Bluetooth module, a GNSS module, or an NFC module may be included in one integrated chip (IC) or an IC package. The RF module, for example, may transmit/receive a communication signal (eg, an RF signal). The RF module may include, for example, a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), or an antenna. According to another embodiment, at least one of a cellular module, a WiFi module, a Bluetooth module, a GNSS module, or an NFC module may transmit/receive an RF signal through a separate RF module. The subscriber identification module may include, for example, a card including a subscriber identification module or an embedded SIM, and may include unique identification information (eg, integrated circuit card identifier (ICCID)) or subscriber information (eg, international mobile (IMSI)). subscriber identity)).

The memory (eg, memory) may include, for example, an internal memory or an external memory. Built-in memory includes, for example, volatile memory (such as DRAM, SRAM, or SDRAM), non-volatile memory (such as one time programmable ROM (OTPROM), PROM, EPROM, EEPROM, mask ROM, flash ROM, flash memory). , a hard drive, or a solid state drive (SSD), the external memory may include a flash drive, for example, a compact flash (CF), secure digital (SD), Micro-SD, It may include a Mini-SD, extreme digital (xD), a multi-media card (MMC), a memory stick, etc. The external memory may be functionally or physically connected to an electronic device through various interfaces.

The sensor module, for example, may measure a physical quantity or sense an operating state of an electronic device, and may convert the measured or sensed information into an electrical signal. The sensor module may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor (eg, an RGB (red, green, blue) sensor), a biometric sensor , it may include at least one of a temperature/humidity sensor, an illuminance sensor, and an ultra violet (UV) sensor. Additionally or alternatively, the sensor module may include, for example, an olfactory (e-nose) sensor, an electromyography (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, an infrared (IR) sensor. ) sensor, an iris sensor and/or a fingerprint sensor. The sensor module may further include a control circuit for controlling at least one or more sensors included therein. In some embodiments, the electronic device may further include a processor configured to control the sensor module, as part of the processor or separately, to control the sensor module while the processor is in a sleep state.

The input device may include, for example, a touch panel, a (digital) pen sensor, a key, or an ultrasonic input device. The touch panel may use, for example, at least one of a capacitive type, a pressure-sensitive type, an infrared type, and an ultrasonic type. In addition, the touch panel may further include a control circuit. The touch panel may further include a tactile layer to provide a tactile response to the user. The (digital) pen sensor may be, for example, a part of a touch panel or may include a separate recognition sheet. The key may include, for example, a hardware button, an optical key, or a keypad. The ultrasound input device may detect the ultrasound generated by the input tool through the microphone, and check data corresponding to the sensed ultrasound.

The display may include a panel, a holographic device, a projector, and/or control circuitry for controlling them. The panel may be implemented, for example, to be flexible, transparent, or wearable. The panel may be composed of a touch panel and one or more modules. According to an embodiment, the panel may include a pressure sensor (or a force sensor) capable of measuring the intensity of the user's touch. The pressure sensor may be implemented integrally with the touch panel, or may be implemented as one or more sensors separate from the touch panel. The holographic device may display a three-dimensional image in the air using interference of light. A projector can display an image by projecting light onto a screen. The screen may be located inside or outside the electronic device, for example. The interface may include, for example, HDMI, USB, an optical interface, or a D-subminiature (D-sub) 278 . Additionally or alternatively, the interface may include, for example, a mobile high-definition link (MHL) interface, an SD card/multi-media card (MMC) interface, or an infrared data association (IrDA) standard interface.

The audio module may, for example, convert a sound and an electrical signal interactively. The audio module may process sound information input or output through, for example, a speaker, a receiver, an earphone, or a microphone. The camera module is, for example, a device capable of capturing still images and moving pictures, and according to one embodiment, one or more image sensors (eg, a front sensor or a rear sensor), a lens, an image signal processor (ISP), or a flash (eg, LED or xenon lamp, etc.). The power management module may manage power of the electronic device, for example. According to one embodiment, the power management module may include a power management integrated circuit (PMIC), a charger IC, or a battery or fuel gauge. The PMIC may have a wired and/or wireless charging method. The wireless charging method includes, for example, a magnetic resonance method, a magnetic induction method or an electromagnetic wave method, and may further include an additional circuit for wireless charging, for example, a coil loop, a resonance circuit, or a rectifier. there is. The battery gauge may measure, for example, the remaining amount of the battery, voltage, current, or temperature during charging. Batteries may include, for example, rechargeable cells and/or solar cells.

The indicator may display a specific state of the electronic device or a part thereof (eg, a processor), for example, a booting state, a message state, or a charging state. The motor may convert an electrical signal into mechanical vibration, and may generate vibration, a haptic effect, or the like. The electronic device is, for example, a mobile TV support device (eg, GPU) capable of processing media data according to standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or mediaFlo ^TM . may include Each of the components described in this document may be composed of one or more components, and the name of the component may vary depending on the type of the electronic device. In various embodiments, the electronic device (eg, electronic device) has some components omitted, additional components are further included, or some of the components are combined to form a single entity, but the corresponding components before the combination The functions of the components may be performed identically.

In various embodiments of the present disclosure, the electronic device (or electronic device) may include a housing including a front surface, a rear surface, and side surfaces surrounding a space between the front surface and the rear surface. A touch screen display (eg, a display) may be disposed in the housing and exposed through the front surface. A microphone is disposed within the housing and may be exposed through a portion of the housing. At least one speaker is disposed in the housing and may be exposed through another portion of the housing. A hardware button (eg, a key) may be disposed on another part of the housing or configured to be displayed on the touchscreen display. A wireless communication circuit (eg, a communication module) may be located in the housing. The processor (or processor) may be located in the housing and may be electrically connected to the touch screen display, the microphone, the speaker, and the wireless communication circuit. The memory (or memory) may be located in the housing and may be electrically connected to the processor.

In various embodiments of the present disclosure, the memory is configured to store a first application program including a first user interface for receiving a text input, and the memory, when executed, causes the processor to perform a first operation and instructions for causing a second operation to be performed, wherein the first operation comprises: receiving a first type of user input through the button while the first user interface is not displayed on the touch screen display; , after receiving the first type of user input, receive a first user utterance through the microphone, and send to an external server including an automatic speech recognition (ASR) and an intelligence system. at least one providing first data for a first user utterance, and after providing the first data, performing a task generated by the intelligent system in response to the first user utterance from the external server Receiving a command, the second operation is performed after receiving the first user input through the button while the first user interface is displayed on the touch screen display and receiving the first type of user input , receive a second user's utterance through the microphone, provide second data for the second user's utterance to the external server, and after providing the second data, from the server, the second user receiving data about the text generated by the automatic speech recognition from an utterance, but not receiving a command generated by the intelligent system, and inputting the text into the first user interface.

In various embodiments of the present disclosure, the button may include a physical key located on the side surface of the housing.

In various embodiments of the present disclosure, the first type of user input may be performed after pressing the button once, pressing the button twice, pressing the button 3 times, and pressing the button once. It can be one of a press and hold, or a double press and hold down on the button.

In various embodiments of the present disclosure, the instructions may further cause the processor to display the first user interface together with a virtual keyboard. The button may not be a part of the virtual keyboard.

In various embodiments of the present disclosure, the instructions may further cause the processor to receive, from the external server, data for text generated by an ASR from the first user utterance within the first operation. there is.

In various embodiments of the present disclosure, the first application program may include at least one of a note application program, an email application program, a web browser application program, and a calendar application program.

In various embodiments of the present disclosure, the first application program includes a message application, and the instructions are automatically executed via the wireless communication circuit when the processor, by the processor, exceeds a selected time period after inputting the text. may further cause the inputted text to be transmitted.

In various embodiments of the present disclosure, the instructions further cause the processor to perform a third operation, wherein the third operation includes: while displaying the first user interface on the touch screen display, the button Receives a second type of user input through , and after receiving the second type of user input, receives a third user utterance through the microphone, and sends a third response to the third user utterance to the external server After providing data and providing the third data, at least one command for performing a task generated by the intelligent system in response to the third user utterance may be received from the external server.

In various embodiments of the present disclosure, the instructions further cause the processor to perform a fourth operation, wherein the fourth operation is performed while the first user interface is not displayed on the touch screen display. Receives the second type of user input through a button, and after receiving the second type of user input, receives a fourth user utterance through the microphone, and receives fourth data for the fourth user utterance After providing to the external server and providing the fourth data, in response to the fourth user utterance, receiving at least one command for performing a task generated by the intelligent system from the external server, receiving a fifth user utterance through the microphone, providing fifth data on the fifth user utterance to the external server, and after providing the fifth data, in response to the fifth user utterance At least one command for performing the task generated by the intelligent system may be received from the external server.

In various embodiments of the present invention, the first type of user input and the second type of user input are different from each other, and a single press of the button, two presses of the button, three presses of the button , one of pressing and holding the button after pressing it once, or pressing and holding the press twice on the button.

In various embodiments of the present disclosure, the memory is further configured to store a second application program including a second user interface for receiving a text input, wherein the instructions, when executed, cause the processor to: further cause to perform an operation, wherein the third operation includes: receiving the first type of user input through the button while displaying the second user interface; After the first type of user input is received, a third user utterance is received through the microphone, and third data for the third user utterance is provided to the external server, and the third data is provided. After receiving the data for the text generated by the ASR from the third user utterance from the external server, the command generated by the intelligent system is not received, and the text is displayed on the second user interface. input, and input the text, and automatically transmit the entered text through the wireless communication circuit when the selected time period is exceeded.

In various embodiments of the present disclosure, the memory is configured to store a first application program including a first user interface for receiving a text input, and the memory, when executed, causes the processor to perform a first operation and instructions for causing to perform a second operation, the first operation comprising: Receive a first type of user input through the button, and after receiving the first type of user input, receive a first user utterance through the microphone, automatic speech recognition (ASR) and an external server including an intelligence system, providing first data for the first user utterance, and after providing the first data, in response to the first user utterance, to the intelligent system Receiving at least one command for performing the task generated by the external server, The second operation may include receiving a second type of user input through the button, receiving a second user utterance through the microphone after receiving the second type of user input, and sending the second type of user input to the external server. Second data for a second user utterance is provided, and after providing the second data, the server receives data about the text generated by the ASR from the second user utterance, while receiving the data for the text generated by the ASR from the second user utterance to the intelligent system. The command generated by the user may not be received, and the text may be input into the first user interface.

In various embodiments of the present disclosure, the instructions may further cause the processor to display the first user interface together with a virtual keyboard, wherein the button may not be part of the virtual keyboard.

In various embodiments of the present disclosure, the instructions may further cause the processor to receive, from the external server, data for the text generated by the ASR from the first user utterance within the first operation. .

In various embodiments of the present disclosure, the first application program may include at least one of a note application program, an email application program, a web browser application program, and a calendar application program.

In various embodiments of the present disclosure, the first application program includes a message application, and the instructions are automatically executed via the wireless communication circuit when the processor, by the processor, exceeds a selected time period after inputting the text. may further cause the inputted text to be transmitted.

In various embodiments of the present disclosure, the instructions may further cause the processor to perform the first operation independently of displaying on the display of the first user interface.

In various embodiments of the present disclosure, the instructions further cause the processor to perform the second operation when at least one of the electronic device is in a locked state or the touchscreen display is turned off can do.

In various embodiments of the present disclosure, the instructions may further cause the processor to perform the second operation while displaying the first user interface on the touch screen display.

In various embodiments of the present invention, the memory, when executed, causes the processor to receive a user utterance through the microphone, and perform automatic speech recognition (ASR) or natural language understanding (NLU) To an external server that performs at least one of, transmits information related to whether to perform the natural language understanding on the text obtained by performing the ASR on the data on the user utterance together with the data on the user utterance, , receive the text about data for the user utterance from the external server if the information indicates not to perform the natural language understanding, and if the information indicates that the natural language understanding will not be performed, the text from the external server An instruction for causing to receive a command obtained as a result of performing the natural language understanding may be stored.

According to an embodiment, a program module (eg, program) may include an operating system that controls resources related to an electronic device (eg, electronic device) and/or various applications (eg, application program) running on the operating system. there is. The operating system may include, for example, Android ^TM , iOS ^TM , Windows ^TM , Symbian ^TM , Tizen ^TM , or Bada ^TM . A program module may include a kernel (eg, a kernel), middleware (eg, middleware), an API (eg, an API), and/or an application (eg, an application program). At least a portion of the program module is located on the electronic device. It can be preloaded on the computer or downloaded from an external electronic device (eg, electronic device, server, etc.).

The kernel may include, for example, a system resource manager and/or device driver. The system resource manager may control, allocate, or reclaim system resources. According to an embodiment, the system resource manager may include a process manager, a memory manager, or a file system manager. The device driver may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, an audio driver, or an inter-process communication (IPC) driver. For example, the middleware may provide functions commonly required by applications or provide various functions to applications through APIs so that applications can use limited system resources inside the electronic device. According to an embodiment, the middleware is one of a runtime library, an application manager, a window manager, a multimedia manager, a resource manager, a power manager, a database manager, a package manager, a connectivity manager, a notification manager, a location manager, a graphics manager, or a security manager. It may include at least one.

The runtime library may include, for example, a library module used by the compiler to add a new function through a programming language while an application is running. The runtime library may perform I/O management, memory management, or arithmetic function processing. The application manager may, for example, manage the life cycle of the application. The window manager can manage GUI resources used in the screen. The multimedia manager may identify a format required to reproduce the media files, and may encode or decode the media files using a codec suitable for the format. The resource manager may manage the space of an application's source code or memory. The power manager may, for example, manage a capacity or power of a battery and provide power information required for an operation of an electronic device. According to an embodiment, the power manager may interwork with a basic input/output system (BIOS). The database manager may, for example, create, retrieve, or change a database to be used in an application. The package manager may manage installation or update of an application distributed in the form of a package file.

The connectivity manager may, for example, manage wireless connections. The notification manager may provide, for example, an event such as an arrival message, an appointment, and a proximity notification to the user. The location manager may manage location information of the electronic device, for example. The graphic manager may manage a graphic effect to be provided to a user or a user interface related thereto, for example. A security manager may provide, for example, system security or user authentication. According to an embodiment, the middleware may include a telephony manager for managing a voice or video call function of the electronic device or a middleware module capable of forming a combination of functions of the aforementioned components. According to an embodiment, the middleware may provide a specialized module for each type of operating system. Middleware can dynamically delete some existing components or add new ones. The API may be provided in a different configuration depending on the operating system, for example, as a set of API programming functions. For example, in the case of Android or iOS, one API set may be provided for each platform, and in the case of Tizen, two or more API sets may be provided for each platform.

Applications can be, for example, home, dialer, SMS/MMS, instant message (IM), browser, camera, alarm, contacts, voice dial, email, calendar, media player, album, watch, health care (eg exercise or measuring blood sugar) or environment information (eg, barometric pressure, humidity, or temperature information) providing application. According to an embodiment, the application may include an information exchange application capable of supporting information exchange between the electronic device and the external electronic device. The information exchange application may include, for example, a notification relay application for transmitting specific information to an external electronic device or a device management application for managing the external electronic device. For example, the notification delivery application may transmit notification information generated by another application of the electronic device to the external electronic device, or receive notification information from the external electronic device and provide it to the user. The device management application is, for example, a function of the external electronic device communicating with the electronic device (eg, turn-on/turn-off of the external electronic device itself (or some component) or the brightness (or resolution) of the display) adjustment), or an application running in an external electronic device may be installed, deleted, or updated. According to an embodiment, the application may include an application designated according to a property of the external electronic device (eg, a health management application of a mobile medical device). According to an embodiment, the application may include an application received from an external electronic device. At least some of the program modules may be implemented (eg, executed) in software, firmware, hardware (eg, a processor), or a combination of at least two or more thereof, and a module, program, routine, set of instructions for performing one or more functions. or processes.

In the above, although the present invention has been described with reference to limited embodiments and drawings, the present invention is not limited thereto and will be described below with the technical idea of the present invention by those of ordinary skill in the art to which the present invention pertains. Of course, various modifications and variations are possible within the scope of equivalents of the claims.

In addition, since the present invention described above can be various substitutions, modifications and changes within the scope that does not depart from the technical spirit of the present invention for those of ordinary skill in the art to which the present invention pertains, the above-described embodiments and attachments It is not limited by the illustrated drawings, and all or part of each embodiment may be selectively combined and configured so that various modifications may be made.

Claims (1)

How to provide customized product information.

Images