KR20210099739A - User Review Based Rating Re-calculation Apparatus and Method - Google Patents

Abstract

The present invention relates to a user review-based rating re-calculation apparatus capable of re-calculating a total rating based on ratings about details predicted through analysis on a user review, and a method thereof. The user review-based rating re-calculation apparatus includes a review data collection part collecting review data including a user review and a first rating, existing in an analysis target; a preprocessing part performing sentence separation and morpheme analysis on the user review among review text data collected by the review data collection part, to separate a sentence processed as a stop word into sets; a term dictionary processing part extracting modifiers for each of the sets separated by the preprocessing part to collect ratings of reviews in a database having the same modifier, and then, calculate its average; a review unit classification part classifying positives/negatives based on the average calculated by the term dictionary processing part; and a rating generation part generating a second rating based on the number of positives and negatives using positive/negative information classified by the review unit classification part.

Description

User Review Based Rating Re-calculation Apparatus and Method

The present invention relates to a user review-based rating recalculation technology, and in particular, to a user review-based rating recalculation apparatus and method that can recalculate the overall rating based on the ratings for detailed items predicted through analysis of user reviews will be.

The number of eating out is increasing as the income level improves, the five-day workweek system provides more time, and women's entry into society has become more common. The proportion of eating out expenses in national consumption is increasing, and in particular, the proportion of eating out in the national economy is increasing, and its importance is also greatly expanding.

Recently, an order delivery request application (hereinafter, 'delivery app') installed on a smartphone has been developed and popularized. Searching for nearby delivery restaurants, searching for food, and entering home addresses are now possible through the delivery app installed on the smartphone.

At this time, it is common to refer to reviews or ratings left by previous buyers as important information when using each restaurant. Therefore, in the case of delivery apps, other users' ratings and user reviews are provided to prospective restaurant users.

And recently, by automatically performing review mining on these user reviews, lexical information on positive/negative reviews is analyzed, and the ratings of each restaurant are automatically provided.

At this time, existing studies judged positive/negative opinions for the entire document or sentence by sentence along with the rating.

However, a user can write a positive review for a particular food or service, although the overall impression is negative for a particular food or service. For example, a user might write a review saying that a particular restaurant has a negative overall impression, but the restaurant has a lot of volume.

In addition, after a user writes an overall negative review, the rating may be mistakenly given a full five stars, contrary to the content of the review. Or, conversely, you can write a very positive review for everything, and then choose a bad rating of 1 star.

In addition, even when a review is written with the same degree of positive/negative, some users give 4 stars depending on the user who evaluates, and there are users who give 2 stars, so there is an equality between a review and a rating There may be a problem that this does not happen.

Due to these problems, it is very important to accurately connect the opinion of what, the evaluation target and the opinion.

In the case of the existing Korean Patent Publication No. 10-1319413 "System and method for generating summary information for reviews related to products and services", clue words related to the domain to which the product or service belongs are automatically extracted, and opinion information for each evaluation element By extracting , it discloses generating review summary information including opinion information for each evaluation element. However, there is a limitation in that the problem of errors between reviews and ratings cannot be solved because only the frequency of occurrence of words related to evaluation elements and words related to opinions in the review data is used at the same time.

In the case of the existing Korean Patent Application Laid-Open No. 10-2011-0044112 "Semi-automatic construction method of pattern database for mining review by product attribute", after constructing affirmative/negative of vocabulary used for each attribute of product in advance Through this, we are starting to build a product review pattern dictionary as a way to classify new sentences as positive/negative. However, it does not disclose the construction of opinions for each specific evaluation element for a product.

In addition, in the case of the existing paper "Method for extracting words in Korean product reviews using k-Structure," a k-Structure technique that enables automatic extraction of emotional words from Korean product reviews is proposed, but only direct expressions of "good/bad" It can only extract, but cannot find positive/negative expressions composed of collocations.

In the case of the thesis "Efficient Product Review Search Technique Using Opinion Mining Technology", the value of product reviews is judged by considering not only the user's search terms, but also the inclusion of subjective opinions in the product reviews and the entropy of emotional polarity, but reflects the meaning of positive and negative. The manual work was done to build a list of words to be used, and the relationship between evaluation factors and opinions could not be analyzed.

In the case of the paper "Automatic construction of positive/negative predicates for each characteristic for product review polarity classification", the initial positive/negative predicates are extracted for each domain by extracting product features from the product reviews, and then the initial positive/negative predicates are extracted for each domain. By analyzing predicates and access information, positive/negative dictionaries are built for each domain. However, this paper has limitations in that it uses user star points to extract keywords and is done manually.

Korean Patent Publication No. 10-1319413 (Registration Date 2013.10.11.) Korean Patent Publication No. 10-2011-0044112 (published on April 28, 2011)

Automatic extraction of Korean product reviews using k-Structure (Han-Hoon Kang, Seong-Jun Yoo, Dong-Il Han, Journal of the Korean Society of Information Sciences Software and Applications v.37 no.6, pp.470-479, 2010) Efficient product review search technique using opinion mining technology (Hong-Jun Yoon, Han-Jun Kim, Jae-Young Jang, Journal of the Korean Society of Information Sciences, Actual and Letter of Computing, v.16, no.2, pp.222-226, 2010) Automatic construction of positive/negative dictionary of predicates for each characteristic for product review polarity classification (Jongseok Song, Suwon Lee, Journal of the Korean Society of Information Sciences, Software and Applications, v.38, no3, pp.157-169, 2011)

Therefore, the present invention has been devised to solve the above problems, and provides a user review-based rating recalculation apparatus and method that can recalculate the overall rating based on the ratings for detailed items predicted through analysis of user reviews. but it has a purpose.

An object of the present invention is to provide an apparatus and method for recalculating user reviews based on user reviews so that a more accurate overall score can be derived in consideration of errors when a rating contrary to a user review written by a user is evaluated.

The objects of the present invention are not limited to the above-mentioned objects, and other objects and advantages of the present invention not mentioned may be understood by the following description, and will be more clearly understood by the examples of the present invention. Moreover, it will be readily apparent that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

A feature of the user review-based rating recalculation apparatus according to the present invention for achieving the above object is a review data collection unit for collecting review data including a user review and a first rating existing in an analysis target, and the review data Among the review text data collected in the collection unit, the preprocessor performs sentence separation and morphological analysis in the user review to separate the sentences that have been treated with stopwords into sets, and the preprocessor extracts modifiers for each set separated in the preprocessing unit and contains the same modifiers. After collecting the ratings of the reviews in the database, a term dictionary processing unit for calculating the average, a review unit classification unit for classifying positive/negative based on the average calculated by the term dictionary processing unit, and classification by the review unit classification unit It may include a rating generator for generating a second rating based on the number of positive and negative by using the positive / negative information.

Preferably, the user review-based rating recalculation device includes a rating extracting unit for extracting a first rating from among the review text data collected by the review data collection unit, and a second rating generated by the rating generating unit and the rating extracting unit. A rating processing unit that compares the extracted first ratings with each other and determines whether the difference is within a preset setting value, and if the difference between the first rating and the second rating is greater than or equal to a preset value, the glossary processing unit performs text analysis a relationship extracting unit for changing the range of the first reference value for determining the similarity to a wider set second reference value, and when the difference between the second rating and the first rating determined by the rating processing unit is determined to be less than the set value, the first The rating is calculated as the total rating, and when the difference between the second rating and the first rating determined by the rating processing unit is determined to be greater than or equal to a set value, a rating calculation unit for calculating the average of the second rating and the first rating as the total rating. can

The characteristics of the user review-based rating recalculation method according to the present invention for achieving the above object are (A) collecting review data existing in the analysis target using the review data collection unit, (B) using the pre-processing unit and performing sentence separation and morpheme analysis in the user review among the collected review text data to separate the sentences subjected to stopword processing into sets; After collecting the ratings of the reviews in the database containing the same modifier by extracting modifiers, calculating the average, (D) classifying positive/negative based on the average calculated using the review unit classification unit, ( E) generating a second rating by reflecting the number of positives and negatives based on the positive/negative information classified for each evaluation criterion by using the rating generator.

Preferably, after the step (E), (F) extracting the first rating evaluated by the user from the collected review text data using the rating extraction unit, and (G) the generated second rating using the rating processing unit. Comparing the 2 ratings and the extracted first rating with each other, (H) if the difference between the first rating and the second rating is greater than or equal to a set value as a result of the comparison in the step (G), using a relationship extracting unit to After changing the range of the first reference value for judging the similarity in the text analysis method to a wider second reference value, performing again from the step (C), (I) the comparison result of the step (G), the If it is determined that the difference between the first rating and the second rating is less than the set value, calculating the first rating as a total rating using a rating calculating unit, (J) the comparison result of the step (G), the first If it is determined that the difference between the rating and the second rating is equal to or greater than a set value, calculating an average value of the first rating and the second rating as a total rating using a rating calculating unit.

As described above, the user review-based rating recalculation apparatus and method according to the present invention have the following effects.

First, it basically uses sentence-by-sentence analysis, but by applying additional user ratings to selectively use sentences, there is an effect of showing superiority in terms of ease of analysis and reliability of results.

Second, a more accurate overall rating can be derived because the user does not have to input a cumbersome direct rating, and the artificial intelligence (AI) directly analyzes the positive/negative based on the content of the review to derive a star rating.

Third, since the overall rating is one of the important factors in determining whether a user will order food from a restaurant in the delivery app, an accurate overall rating can lead to better trust in the delivery app and user convenience.

Fourth, although it was introduced mainly on delivery apps, it is expected that it can be applied to the improvement of other shopping information sites, and furthermore, all sites that deal with user reviews. In particular, since it includes the process of automatically classifying existing reviews and deriving ratings, it can greatly contribute to the improvement of the review provision system of existing sites that do not have an evaluation standard for Byeoro.

In addition to the above-described effects, the specific effects of the present invention will be described together while describing specific details for carrying out the invention below.

1 is a block diagram showing the configuration of a user review-based rating recalculation apparatus according to an embodiment of the present invention.
2 is a flowchart illustrating a user review-based rating recalculation method according to an embodiment of the present invention.
3 is an embodiment showing a case in which the user who ordered through the delivery app among the errors shown in FIG. 2 evaluates the user with a rating contrary to the user review written by him or her.

Other objects, characteristics and advantages of the present invention will become apparent from a detailed description of the embodiments with reference to the accompanying drawings.

The terms used in the present invention have been selected as currently widely used general terms as possible while considering the functions in the present invention, but these may vary depending on the intention or precedent of a person skilled in the art, the emergence of new technology, and the like. In addition, in a specific case, there is a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term and the overall content of the present invention, rather than the name of a simple term.

When a part "includes" a certain element throughout the specification, this means that other elements may be further included, rather than excluding other elements, unless otherwise stated. In addition, terms such as "...unit" and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software. .

A preferred embodiment of the user review-based rating recalculation apparatus and method according to the present invention will be described with reference to the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but can be implemented in various different forms, and only this embodiment allows the disclosure of the present invention to be complete and to fully convey the scope of the invention to those of ordinary skill in the art. It is provided to inform you. Therefore, the configuration shown in the embodiments and drawings described in the present specification is only one of the most preferred embodiments of the present invention and does not represent all the technical spirit of the present invention, so various equivalents that can replace them at the time of the present application It should be understood that there may be water and variations.

Hereinafter, when it is described that a component is "connected", "coupled" or "connected" to another component, the components may be directly connected or connected to each other, but other components are "interposed" between each component. It is to be understood that “or, each component may be “connected,” “coupled,” or “connected” through another component.

1 is a block diagram showing the configuration of a user review-based rating recalculation apparatus according to an embodiment of the present invention. The user review-based rating recalculation device shown in FIG. 1 is according to an embodiment, and its components are not limited to the embodiment shown in FIG. 1, and some components may be added, changed, or deleted as necessary. can

As shown in FIG. 1 , the user review-based rating recalculation apparatus of the present invention includes a review data collection unit 100 , a pre-processing unit 200 , a term dictionary processing unit 300 , and a review unit classification unit 400 . ), a rating generating unit 500 , a rating extracting unit 600 , a rating processing unit 700 , a relationship extracting unit 800 , and a rating calculating unit 900 .

The review data collection unit 100 collects and stores review data existing in the analysis target. In addition, the review data collection unit 100 collects only the added review data when review data is added to the analysis target. In this case, the review data may include a review (user review) and a first rating (user star rating) left after using an analysis target such as a restaurant.

The preprocessor 200 separates sentences and morphemes from the user review among the review text data collected by the review data collection unit 100 and performs tagging accordingly. Sentence separation is performed based on punctuation marks such as periods, and morpheme analysis is performed using the Kookmin University Morphological Analyzer (http://nlp.kookmin.ac.kr/HAM/kor/index.html) with a total of 10 sets of parts of speech. This can be done using Language Technology (KLT). In this case, the morpheme analysis is only one embodiment, and is not limited thereto, and may be performed using various currently known morpheme analyzers or natural language sentiment algorithms.

Next, the pre-processing unit 200 processes stopwords among the tagged morphemes (there are morphemes ignored by the search engine, such as silver, e, e, g, b, b, etc.), and computer operation is performed. It slows down and removes stopwords that can be misleading for AI, then replaces them all with standard language. Next, the pre-processing unit 200 separates the stopword-processed sentence into sets of [modifier + verb/noun] or [verb/noun + modifier]. Each set must contain one evaluation element unconditionally. Otherwise, the set is ignored, except when a verb, adjective, or modifier directly implies the meaning of an evaluation element, it is maintained as a set.

The term dictionary processing unit 300 extracts modifiers for each set, collects the ratings of reviews in a database containing the same modifier, and calculates an average thereof. This work uses vectorized data using the bag of words technique. And the value obtained by converting the average to a minimum of -1 and a maximum of 1 based on 3 points is the positivity of the set, and that may be the negativity of the evaluation elements included in the set in the review. Unlike the existing method of unconditionally giving +1 for positive and -1 for negative, the present invention also uses the bag of words technique, so it has the advantage of being able to grasp the degree of positivity of words.

If the data identified in this way is used, the rating of the review becomes a value obtained by replacing the sum of all the positive degrees of each set with a star rating, and the positive degrees judged by each evaluation element are gathered to determine the positive degree of the restaurant's corresponding evaluation element. and the overall rating of the restaurant is the average of the positive ratings of the evaluation factors.

The review unit classifying unit 400 classifies positive/negative based on the average calculated by the term dictionary processing unit 300 . In this case, positive/negative is pre-stored in the learning data DB 10 as learning data, and positive or negative, etc. can be identified through similarity analysis with the learning data. And the evaluation criteria may include quantity, taste, price, delivery time, friendliness, packaging condition, service, etc. of food.

The rating generating unit 500 may generate a second rating based on the average of positive and negative by using the positive/negative information classified by the review unit classification unit 400 .

In general, the definition of the total rating is the final one that encompasses the overall rating of all the evaluation factors. Even if there are many positive evaluations for one judgment factor and very few positive evaluations for the other judgment factors, all evaluation factors will have the same total score should contribute to the calculation of Therefore, when the total score is calculated, for example, if there are 900 positive and 100 negative evaluations for taste, while there are 1 positive and 9 negative evaluations for hygiene, The overall score is 901:101, which is about 90% positive. In this way, the evaluation of poor hygiene will be completely buried. However, in reality, the overall rating that users want is a rating that evenly reflects the evaluation factors they are not aware of. Therefore, the rating generating unit 500 does not rate the ratio based on the number of positive or negative evaluations of all elements, but rather the average of each evaluation element, that is, in the example described above, the taste is 90% positive, and hygiene is 10%. Since it has a positive degree of , it is analyzed that it has a positive degree of 50% as an average of the total score.

The rating extractor 600 extracts a first rating (user star rating) from the review text data collected by the review data collection unit 100 .

The rating processing unit 700 compares the second rating generated by the rating generating unit 500 with the first rating extracted by the rating extracting unit 600 with each other, and determines whether the difference is within a preset setting value .

In this case, the second rating generated by the rating generating unit 500 is a rating generated based on the contents of the user review, and the first rating extracted by the rating extracting unit 600 is the rating evaluated by the user who wrote the user review am. Accordingly, if the difference between the second rating and the first rating is greater than the set value, it may be determined that there is a problem in the generated second rating or the rating evaluated by the user.

When there is a problem in the second rating, the rating generating unit 500 may determine that there is a problem in the classified positive/negative information when generating the rating. This may occur when the review unit classifying unit 400 classifies the positive/negative predicates, and there is an error in the classified words.

Alternatively, if there is a problem in the first rating, it is a case in which the user evaluates the rating with a rating contrary to the user review written by the user. For example, in a user review written with only very positive content without negative comments about the restaurant, the rating gives it a very bad 1 star. It may correspond to a case where, after writing only negative content, it is rated as a very good 5 stars in the rating.

However, if the user rated it as a rating that is contrary to the user review written by the user, there are cases where the user mistakenly evaluated the rating when selecting the rating. , there may be cases where the rating is high mentally. Therefore, another error may occur if it is determined that the user's rating is unconditionally incorrect even if the rating is contrary to the user's review.

The present invention is characterized in that it allows a more accurate overall score to be derived by taking these various errors into account.

In order to take this error into account, the relation extraction unit 800 analyzes the text in the term dictionary processing unit 300 when, as a result of the comparison in the rating processing unit 700 , the difference between the first rating and the second rating is equal to or greater than a set value. A second reference value in which the range of the first reference value for determining the degree of similarity is set to be wider may be used. Accordingly, the term dictionary processing unit 300 determines that the word is similar to a specific word through the text analysis method (BOW, Word2Vec, TF-IDF) when the degree of similarity is equal to or greater than the second reference value, and classifies the word as the determined corresponding evaluation standard. .

And the review unit classification unit 400 again extracts positive/negative predicates from the words classified by evaluation criteria using the second reference value in the term dictionary processing unit 300, and analyzes the extracted positive/negative predicates for each evaluation Reclassify positive/negative by criteria.

In addition, the rating generating unit 500 generates a third rating based on the average of positive and negative by using the positive/negative information reclassified for each evaluation criterion in the review unit classification unit 400 .

Then, the rating processing unit 700 compares the third rating generated by the rating generating unit 500 with the first rating extracted by the rating extracting unit 600 again, and whether the difference is within a preset setting value judge

When the difference between the second rating and the first rating determined by the rating processing unit 700 or the difference between the third rating and the first rating is within a set value, the rating calculation unit 900 calculates the first rating as a total rating. can In addition, the rating calculation unit 900 determines that the difference between the second rating and the first rating determined by the rating processing unit 700 or the difference between the third rating and the first rating is greater than or equal to a set value, the second rating and the first rating The average of the ratings or the average value of the third rating and the first rating may be calculated as the total rating.

As such, if the rating generated by the rating generator 500 and the rating evaluated by the user extracted by the rating extractor 600 are within the set value, the total rating calculated by the user is calculated as the total rating. Opinions can be actively reflected.

On the other hand, if the rating generated by the rating generating unit 500 and the rating evaluated by the user extracted by the rating extracting unit 600 are within the set value, the generated rating and By calculating the average value of the extracted ratings as the total rating, a more accurate total rating may be derived by compensating for errors in the calculated total rating.

The operation of the user review-based rating recalculation apparatus according to the present invention configured as described above will be described in detail with reference to the accompanying drawings. The same reference numerals as in FIG. 1 refer to the same members performing the same functions.

2 is a flowchart illustrating a user review-based rating recalculation method according to an embodiment of the present invention.

Referring to FIG. 2 , first, review data existing in an analysis target is collected using the review data collecting unit 100 ( S10 ).

In this case, when review data is added to the analysis target, the review data collection unit 100 may re-collect only the added review data. The review data may include a review (user review) and a first rating (user star rating) left after using an analysis target such as a restaurant.

Next, by using the preprocessor 200, sentence separation and morphemes are separated from the user review among the collected review text data, and tagging is performed accordingly (S20). Sentence separation is performed based on punctuation marks such as periods, and morpheme analysis is performed using the Kookmin University Morphological Analyzer (http://nlp.kookmin.ac.kr/HAM/kor/index.html) with a total of 10 sets of parts of speech. This can be done using Language Technology (KLT). In this case, the morpheme analysis is only one embodiment, and is not limited thereto, and may be performed using various currently known morpheme analyzers or natural language sentiment algorithms.

And the pre-processing unit 200 processes stopwords (there are morphemes ignored by the search engine, such as silver, e, i, g, b, b, etc.) among the tagged morphemes, and the computation speed of the computer. After slowing down and removing stopwords that give AI misunderstanding, it replaces all standard words. Next, the pre-processing unit 200 separates the stopword-processed sentence into sets of [modifier + verb/noun] or [verb/noun + modifier]. Each set must contain one evaluation element unconditionally. Otherwise, the set is ignored, except when a verb, adjective, or modifier directly implies the meaning of an evaluation element, it is maintained as a set.

Next, the modifiers for each set are extracted using the term dictionary processing unit 300 , and the ratings of the reviews in the database containing the same modifier are collected, and then the average is calculated ( S30 ). This work uses vectorized data using the bag of words technique. And the value obtained by converting the average to a minimum of -1 and a maximum of 1 based on 3 points is the positivity of the set, and that may be the negativity of the evaluation elements included in the set in the review.

If the data identified in this way is used, the rating of the review becomes a value obtained by replacing the sum of all the positive degrees of each set with a star rating, and the positive degrees judged by each evaluation element are gathered to determine the positive degree of the restaurant's corresponding evaluation element. and the overall rating of the restaurant is the average of the positive ratings of the evaluation factors.

Next, using the review unit classifying unit 400, positive/negative is classified based on the calculated average (S40).

In this case, positive/negative is pre-stored in the learning data DB 10 as learning data, and positive or negative, etc. can be identified through similarity analysis with the learning data. And the evaluation criteria may include quantity, taste, price, delivery time, friendliness, packaging condition, service, etc. of food.

Next, the second rating may be generated by reflecting the average of positive and negative based on the classified positive/negative information using the rating generating unit 500 ( S50 ).

When generating the second rating, reflecting the average of positive and negative ratings is that the definition of the total rating is the final one that encompasses the overall ratings of all judgment factors, and no matter how many positive evaluations for one judgment factor and for other judgment factors, Even if there are very few positive evaluations, all evaluation factors should contribute in the same proportion to the calculation of the total score. For example, if there are 900 positive and 100 negative evaluations for taste, but 1 positive and 9 negative evaluations for hygiene, the total score covering these two evaluation factors is 901:101, which is about 90 The positivity is close to %. In this way, there is a problem that the evaluation of poor hygiene is completely buried. However, the overall rating that users want is a rating that evenly reflects the evaluation factors that they do not know. Therefore, the ratio is not based on the number of positive or negative evaluations of all factors, but with the average of each evaluation factor. It would be desirable to analyze that it has a positive degree of 50% with an average total score.

Meanwhile, the first rating (user star rating) evaluated by the user from among the collected review text data is extracted using the rating extractor 600 (S60).

Then, using the rating processing unit 700, the generated second rating and the extracted first rating are compared with each other (S70).

In this case, the second rating generated by the rating generating unit 500 is a rating generated based on the contents of the user review, and the first rating extracted by the rating extracting unit 600 is the rating evaluated by the user who wrote the user review am. Accordingly, if the difference between the second rating and the first rating is greater than or equal to the set value, it may be determined that there is a problem in the generated second rating or the rating evaluated by the user.

When there is a problem in the second rating, it may be determined that there is a problem in the classified positive/negative information applied when the rating generating unit 500 generates the rating. This may occur when the review unit classifying unit 400 classifies the positive/negative predicates, when there is an error in the words classified by evaluation criteria.

Alternatively, if there is a problem in the first rating, it is a case in which the user evaluates the rating with a rating contrary to the user review written by the user. For example, in a user review written with only very positive content without negative comments about the restaurant, the rating gives it a very bad 1 star. It may correspond to a case where, after writing only negative content, it is rated as a very good 5 stars in the rating.

3 is an embodiment showing a case in which the user who ordered through the delivery app, among the errors shown in FIG. 2, evaluates the user with a rating contrary to the user review written by him or her.

As shown in Fig. 3, in the written user review (20), "How many times do you eat what you ordered and only use the toilet... What if you sell the spoiled thing?", writing a review with very negative content. However, in the evaluation, it is erroneously evaluated as a rating of 5 stars (30), which is the highest score.

This error occurs quite often, three or four times per restaurant due to user error. In this case, in particular, a restaurant with a small number of user reviews may cause a problem in that it inaccurately affects the total score 40, which is the biggest determining factor for users to choose a restaurant to order from the delivery app. In particular, since most users tend to check only the total score 40 rather than check the contents of each review over time, this problem may appear larger.

However, if the user rated it as a rating that is contrary to the user review written by the user, there are cases where the user mistakenly evaluated the rating when selecting the rating. , there may be cases where the rating is high mentally. Therefore, another error may occur if it is determined that the user's rating is unconditionally incorrect even if the rating is contrary to the user's review.

Accordingly, the present invention is characterized in that it allows a more accurate overall score to be derived by taking these various errors into account.

Accordingly, if the difference between the comparison result ( S60 ), the first rating, and the second rating is equal to or greater than the set value, the range of the first reference value for determining the similarity in the text analysis method is further increased by using the relationship extraction unit 800 . After changing to the widely set second reference value, repeat from step S30 again. Through this, the term dictionary processing unit 300 determines that the word is similar to a specific word through the text analysis method (BOW, Word2Vec, TF-IDF) when the degree of similarity is equal to or greater than the second reference value, and classifies the word as the determined evaluation standard. can

According to the comparison result ( S60 ), the number of repetitions from step S30 is at least once. However, as the number of repetitions increases, the accuracy of the recalculated total score may increase, but it may take more time to calculate the total score. Also, in the case of an error in the user evaluation, not an error in the device, the probability that the accuracy of the total score increases may not change significantly even when the number of errors increases. Therefore, in the present invention, the number of repetitions is limited to one. However, the number of repetitions is not limited thereto.

And when it is determined that the difference between the first rating and the second rating is within a set value according to the comparison result ( S60 ), the first rating may be calculated as a total rating using the rating calculating unit 900 ( S80 ).

As such, if the rating generated by the rating generator 500 and the rating evaluated by the user extracted by the rating extractor 600 are within the set value, the total rating calculated by the user is calculated as the total rating. Opinions can be actively reflected.

Also, if the difference between the first rating and the second rating is determined to be greater than or equal to the set value, the rating calculator 900 calculates the average value of the first rating and the second rating as a total rating using the rating calculator 900 . can be (S90).

As such, if the rating generated by the rating generating unit 500 and the rating evaluated by the user extracted by the rating extracting unit 600 are within the set value, the generated rating and By calculating the average value of the extracted ratings as the total rating, a more accurate total rating may be derived by compensating for errors in the calculated total rating.

On the other hand, the device according to the disclosed embodiment includes a processor, a memory for storing and executing program data, a permanent storage such as a disk drive, a communication port for communicating with an external device, a touch panel, a key, a button, etc. It may include the same user interface device and the like. Methods implemented as software modules or algorithms may be stored on a computer-readable recording medium as computer-readable codes or program instructions executable on the processor. Here, the computer-readable recording medium includes a magnetic storage medium (eg, read-only memory (ROM), random-access memory (RAM), floppy disk, hard disk, etc.) and an optically readable medium (eg, CD-ROM). ), and DVD (Digital Versatile Disc)). The computer-readable recording medium is distributed among computer systems connected through a network, so that the computer-readable code can be stored and executed in a distributed manner. The medium may be readable by a computer, stored in a memory, and executed on a processor.

All documents, including publications, patent applications, patents, etc., cited in the disclosed embodiments are the same as in the disclosed embodiment as if each cited document was individually and specifically expressed in combination or as a whole in the published embodiment. can be merged

In order to understand the disclosed embodiments, reference numerals have been given in the preferred embodiments shown in the drawings, and specific terms are used to describe the disclosed embodiments, but the disclosed embodiments are not limited by the specific terms, and the disclosed embodiments are not limited thereto. They may include all components commonly conceivable by those skilled in the art.

The disclosed embodiment may be represented in functional block configurations and various processing steps. These functional blocks may be implemented in any number of hardware and/or software configurations that perform specific functions. For example, the disclosed embodiment is an integrated circuit configuration, such as memory, processing, logic, look-up table, etc., capable of executing various functions by means of the control of one or more microprocessors or other control devices. can be hired Similar to how components of a disclosed embodiment may be implemented in software programming or as software elements, a disclosed embodiment may include various algorithms implemented in data structures, processes, routines, or combinations of other programming constructs, including C, C++ , Java, assembler, etc. may be implemented in a programming or scripting language. Functional aspects may be implemented in an algorithm running on one or more processors. In addition, disclosed embodiments may employ conventional techniques for electronic configuration, signal processing, and/or data processing, and the like. Terms such as “mechanism”, “element”, “means” and “configuration” may be used broadly and are not limited to mechanical and physical configurations. The term may include the meaning of a series of routines of software in association with a processor or the like.

The specific implementations described in the disclosed embodiments are only examples and do not limit the scope of the disclosed embodiments in any way. For brevity of the specification, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connection or connection members of the lines between the components shown in the drawings exemplarily represent functional connections and/or physical or circuit connections, and in an actual device, various functional connections, physical connections that are replaceable or additional may be referred to as connections, or circuit connections. In addition, unless there is a specific indication such as "essential" or "importantly", it may not be a necessary component for the application of the disclosed embodiment. In addition, those of ordinary skill in the technical field of the present invention will understand that various embodiments are possible within the scope of the technical spirit of the present invention. Therefore, the true technical protection scope of the present invention should be determined by the technical spirit of the appended claims.

10: Learning data DB 20: User reviews
30: Rating 40: Overall Rating
100: review data collection unit 200: pre-processing unit
300: term dictionary processing unit 400: review unit classification unit
500: rating generator 600: rating extractor
700: rating processing unit 800: relationship extraction unit
900: rating calculator

Claims (4)

A review data collection unit for collecting review data including user reviews and first ratings existing in the analysis target;
a pre-processing unit that performs sentence separation and morphological analysis in a user review among the review text data collected by the review data collection unit, and separates the sentences subjected to stopword processing into sets;
a term dictionary processing unit that extracts modifiers for each set separated by the preprocessor, collects the ratings of reviews in a database containing the same modifier, and calculates the average;
a review unit classification unit for classifying positive/negative based on the average calculated by the term dictionary processing unit;
and a rating generator for generating a second rating based on the number of positives and negatives by using the positive/negative information classified by the review unit classification unit.
The method of claim 1,
The user review-based rating recalculation device
a rating extracting unit for extracting a first rating from the review text data collected by the review data collecting unit;
a rating processing unit that compares the second rating generated by the rating generator with the first rating extracted by the rating extractor, and determines whether the difference is within a preset setting value;
a relationship extracting unit configured to change the range of the first reference value for determining the similarity for text analysis in the term dictionary processing unit to a wider second reference value when the difference between the first rating and the second rating is greater than or equal to a set value;
When the difference between the second rating and the first rating determined by the rating processing unit is determined to be less than the set value, the first rating is calculated as a total rating, and the difference between the second rating and the first rating determined by the rating processing unit is the set value If it is determined as above, the user review-based rating recalculation device further comprising a rating calculator for calculating the average of the second rating and the first rating as a total rating.
(A) collecting review data existing in the analysis target using the review data collection unit;
(B) performing sentence separation and morphological analysis in the user review among the collected review text data using the preprocessor, and separating the sentences subjected to stopword processing into sets;
(C) extracting modifiers for each set separated in the preprocessor using the term dictionary processing unit, collecting the ratings of reviews in a database containing the same modifier, and calculating the average;
(D) classifying positive/negative based on the average calculated using the review unit classification unit;
(E) a user review-based rating recalculation method comprising the step of generating a second rating by reflecting the number of positive and negative based on the positive / negative information classified for each evaluation criterion using the rating generator.
4. The method of claim 3,
After step (E),
(F) extracting the first rating evaluated by the user from the collected review text data using the rating extractor;
(G) comparing the generated second rating and the extracted first rating with each other using a rating processing unit;
(H) as a result of the comparison in step (G), if the difference between the first rating and the second rating is greater than or equal to a set value, the range of the first reference value for determining the similarity in the text analysis method is further added using a relationship extractor After changing to a widely set second reference value, performing again from step (C);
(I) when it is determined that the difference between the first rating and the second rating is less than a set value as a result of the comparison in step (G), calculating the first rating as a total rating using a rating calculator;
(J) As a result of the comparison in step (G), if the difference between the first rating and the second rating is determined to be greater than or equal to the set value, the average value of the first rating and the second rating is used as the total rating by using the rating calculation unit. A method for re-rating based on user reviews, comprising the step of calculating.

Images