KR101986153B1 - System and method for communication service using webtoon identification technology - Google Patents

Abstract

The present invention relates to a system for a communication service using a webtoon identification technology and a method thereof. More particularly, the present invention relates to the system for a communication service using webtoon identification technology and the method thereof, which identify a webtoon corresponding to a cut image of the webtoon used as an emoticon for communication between users and supports users to use various cut images having high preference in the webtoon related to various emotions or expressions in real time during using the communication related service, thereby extending the emoticon which can be used as means of emotion and expression to the webtoon.

Description

TECHNICAL FIELD The present invention relates to a communication service system using a Webtoon identification technology,

The present invention relates to a communication service system and method using a webtoon identification technology, and more particularly, to a webtoon corresponding to a cut image of a webtoon used as an emoticon for communication between users, A communication service system and method using a webtoon identification technology capable of expanding emoticons that can be used as emotional and physician expression means to a webtoon by supporting various cut images related to a doctoral expression to the user in real time while using the communication related service .

Currently, various communication services including a messenger service and a social networking service for communication between users are provided. In addition to simple communication using a message, such a communication service includes various emoticons capable of conveying user's emotions and expressions in an image form, The service is provided so that it can be used as an emotional and physician expressing means during use of the service, so that users can express various emotions and expressions which are difficult to be delivered only by a message through emoticons.

However, since these emoticons are generally produced for use in communication services, and a service provider that provides communication services services the emoticons according to a contract with a copyright holder who professionally produces such emoticons, And thus it is difficult to reflect the needs of various users.

Accordingly, recently, a communication service for capturing or clipping a cut associated with emotional expression in a cartoon, which is a cartoon that is served through a direct online user, and requesting insertion of an image at the time of registering a post, And the like, which means that existing emoticons have limitations in meeting the user's desires.

In addition, when the cut image extracted from the webtoon is used through the service supporting the communication between the users with the emoticon, the cut image used as the emoticon is related to the cut image used by the user among the many webtoons, In addition to the difficulty in searching for a webtoon, in a communication service that requires real-time communication such as messenger, emotional expression using a cutout image related to a user's webtoart, a webtoon related to a cut image that a user uses as an emoticon Since the time to search for and extract the cut image corresponding to the user's emotional expression is not guaranteed in the web toon, it is difficult to instantly respond to it. Therefore, realization of the emotional exchange using the webtoon based emoticon is guaranteed Do not have a problem there is a problem in the use of the Real Madrid-based emoticons that can not be activated.

In order to ensure such real-time performance, a service provider of a communication service has to make some cuts of a webtoon with emoticons through consultation with a copyright holder of a popular webtoon, but has difficulty in contracting a lot of cuts constituting a webtoon In order to improve this, some cuts are to be created as emoticons. However, there is no way to analyze cuts having high preference in communication services, and it is difficult to select cuts that can be used as emoticons.

Korean Patent Publication No. 10-2017-0074140

In the present invention, when a cut image extracted in a cut-through unit of a web tome is used as an emoticon in a communication service, a webtoon associated with the cut image is accurately identified to accumulate the frequency of use, and a cut image having high preference as an emoticon in the corresponding webtoon The present invention can provide various emoticon related contents by expanding the emoticons provided in the communication service between users to the webtoon, and at the same time, supporting the provision of various emoticon related contents, To provide a variety of cut-out images that can be used as emoticons, thereby ensuring diversity of contents related to emoticons.

In addition, in the present invention, a webtoon related to a cut image selected by an emoticon is discriminated in a communication service requiring real-time property, and a cut image for each expression type available in an emoticon related to the webtoon is provided in real time on a communication service The user can instantly respond to the expression of the other party by using the cut image of the same webtoon in response to the emotion or the doctor's expression through the cut image of the other party. Thus, real-time emotional exchange and communication using the cut- The purpose of this support is to support.

The communication service system using the webtoon identification technology according to the embodiment of the present invention provides a communication service for transmitting message information received from a user terminal to another user terminal or registering the message information in an account page which is a web page of a user corresponding to the user terminal A service server for receiving request information related to an image included in the message information from the other user terminal, and a service server for extracting a ROI from a plurality of different webtoons, And generates and stores cut information including reference minutia information generated by extracting minutiae points of the ROI and content information previously stored corresponding to a specific turn of a specific webtoon corresponding to the ROI, From the service server Extracting an image included in the message information corresponding to the request information as an identification target image upon receiving the request information, comparing the minutia information extracted from the identification target image with the reference minutia information according to the algorithm, And a search server for generating search result information based on the cut information including the reference minutia information and transmitting the search result information to the other user terminals.

As an example of the present invention, the content information may include specific WebtoTour related content identification information and information about a specific time difference of the specific webtoTun.

In one embodiment of the present invention, the search server sets area identification information for the ROI when extracting the ROI, and includes the ROI in the cut information.

The search server, when receiving the message information including the image in cooperation with the service server, compares minutia information of the image included in the message information with the reference minutia information and identifies And counts the number of times of using the cut information, and analyzes the preference of each webtoon according to the number of times of use per cut information.

In one embodiment of the present invention, the search server generates information on analysis results of each webtoon for each preference of the cut information, selects cut information having a preference higher than a preset reference value for each webtoon based on the information, Extracts a cut image corresponding to the selected cut information from the message information, sets the cut image as an emoticon, extracts a cut image corresponding to the cut information corresponding to the selected cut information in association with the service server, Generating and storing emoticon information including at least one cut image set as an emoticon for each webtoon, or transmitting the emoticon information to the service server.

As a related example of the present invention, a communication service system using the Webtoon identification technology may be configured in the user terminal to execute a messenger application for accessing a web page provided by the service server or for communication with one or more other user terminals, A service server, and provides a chat window provided by the messenger application, receives one or more to-do list related emoticon list information in which emoticon information is registered through the web page or the chat window from the service server, Related information to the service server and includes a cut image selected by the user among the one or more cut images included in the emoticon information corresponding to the selection information and received from the service server in the message information To the service server, and transmits the service request to the service server.

As an example related to the present invention, the service server may match any one of a plurality of different expression types related to emotion and physician and a cut image included in the emoticon information, When the emoticon information is displayed on the user terminal, the application unit displays the type information of the type of expression corresponding to the cut image by matching the cut image with the cut image for each of the cut images.

According to an embodiment of the present invention, when the service information includes a cut image used as an emoticon in the message information, the service server sets a preset time based on the reception time of the message information including the cut image Related message information accumulated in the range of the specific cut image, and learns the dialog-related text message included in the message information accumulated and stored in association with the specific cut image to identify the expression type related to the specific cut image, And automatically sets the expression type corresponding to the image.

A communication service method using a webtoon identification technology of a search server in which a plurality of different user terminals according to an exemplary embodiment of the present invention communicate with each other via a communication network and a plurality of different webtoons, Wherein the search server extracts the ROIs from the plurality of different WebTones in units of cuts, extracts the ROIs of the ROIs according to a preset algorithm, Generating and storing cut information including previously stored content information corresponding to a specific turn of the webtoon; and transmitting the cut information to the service server by transmitting the message information received from one of the user terminals to another user terminal, Account page, which is the user's web page The method comprising the steps of: providing a communication service for registering a service; receiving service request information related to an image included in the message information from another user terminal; Extracting the image included in the message information corresponding to the request information from the identification information as the identification target image, comparing the minutia information extracted from the identification target image with the reference minutia information according to the algorithm, And generating search result information based on the cut information including the matching reference minutia information and transmitting the search result information to the other user terminal.

The present invention supports other users to easily retrieve a specific sequence of a webtoon associated with a webtoon related image included in a message information of a user that is transmitted through a communication service and is used as an emoticon, The user can generate various emotions or emoticon related images related to the expression of the doctor through the WebtoTun related contents in addition to the images related to the webtoons based emoticons created by the user by accessing the page and support the emoticon related images to be used for communication services by other users. It is possible to guarantee various kinds of contents related to emoticons by continuously increasing the contents related to the emoticons by inducing the user to generate various cut images that can be utilized as emoticons.

In addition, the present invention can support sending a cut-out image of a webtoon by including emoticons in message information during real-time communication between users, and at the same time, supporting the transmission of a cut image used as an emoticon by another user, The emoticon information of the webtoont can be immediately downloaded and the user can select any one of the cutout images of the same webtoon as the cutout image related to the cut image used by the user as an emoticon and then support the message to be included in the message information to be transmitted to the user, In response to the type of expression in the emoticons of other users, other users can immediately respond in real time using emoticons, while supporting emotional exchanges and communication using emoticons created on the basis of webtoons. It has the effect of helping to boost the inter-emotional and communicative effect.

In addition, the present invention can select a cut image having a high frequency of use among the cut images produced from the Webtoon related contents and use the cut image together with a text message in real-time conversation so that the service operator in the existing communication service is limited to the use as an emoticon As the contents are produced, the problem of the slow increase of emoticon related contents is improved, so that various cut images that can be used as emoticons can be selected from the webtoons based on the user participation, and the production range of the emoticon related contents is extended to the webtoon, It is possible to induce various contents related to the emoticons to be generated in the communication service, so that the contents of the emoticons related to the communication service can be used in real time, It is possible to improve the user experience of using the bus.

1 is a block diagram of a communication service system using a webtoon identification technology according to an embodiment of the present invention;
2 is a diagram illustrating an operation example of a feature point extraction process for each cut image in the communication service system using the Webtoon identification technology according to the embodiment of the present invention.
3 is a diagram illustrating an operation example of a cut-image related webtoon identification process used as an emoticon on a communication service of a communication service system using the webtoon identification technology according to an embodiment of the present invention;
FIG. 4 and FIG. 5 are diagrams illustrating a process of selecting a cut image to be provided as an emoticon in a real-time communication service of a communication service system using the Webtoon identification technology according to an embodiment of the present invention;
FIG. 6 and FIG. 7 are diagrams illustrating an operation example of providing a webtoart-based emoticon among conversations among users using a real-time communication service of a communication service system using the Webtoon identification technology according to an embodiment of the present invention;
8 is a flowchart illustrating a communication service method using the Webtoon identification technology according to an embodiment of the present invention.

Hereinafter, detailed embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram of a communication service system using a webtoon identification technique according to an embodiment of the present invention. As shown in FIG. 1, the communication service system communicates with a plurality of different user terminals 10 through a communication network, A service server (200) for providing a communication service for transmitting message information to another user terminal or registering or storing the message information on a user's account page, which is a pre-stored web page related to the user corresponding to the specific user terminal And a search server 100 communicating with the service server 200 through a communication network and extracting feature points from the image included in the message information and identifying a webtoon corresponding to the image.

At this time, the service server 200 and the search server 100 may be configured as a single server.

The user terminal 10 may be a tablet PC, a laptop, a smart phone, or a smart phone having a communication function, an output function, and various interface functions. A portable terminal, a mobile terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) terminal, a personal computer, a wearable personal station, WPS), and the like.

In the present invention, webtoon, which is an online comic contents provided through an internet based web site, is taken as an example. However, various kinds of online comic contents provided through online are called webtoon The present invention is not limited thereto.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, detailed operation of the present invention will be described with reference to the drawings.

2, the search server 100 includes a ROI extracting unit 110, a minutiae extracting unit 120, a minutia extracting unit 120, A content registration unit 130, and a control unit 140. [

In addition, the search server 100 may include a content DB 101 in which a plurality of different WebTunes are stored with matching content information and one or more original images corresponding to each other matching each other at the same time, The title of the artist, the name of the artist, and the rotation information of any one of a plurality of different rotations constituting the webtoon.

At this time, the rotation information includes at least one image-by-original image identification information corresponding to (or matched with) any one of a plurality of different rotation times, and information about a creation date or a publication date of the original image corresponding to the rotation And the rotation information may be included in the content identification information.

In addition, the content identification information may include link information for a web page on which the specific times of the webtoons are displayed.

The interest region extracting unit 110 extracts a region of interest corresponding to a unit cut (or a unit panel, a unit frame, or a unit cell) from an original image corresponding to a specific turn of the webtoon For example, by scanning the original image in the horizontal and vertical directions to detect a boundary line, identifying an area of interest for a specific cut in the original image according to the boundary detection, The cut image can be extracted from the original image.

At this time, the region of interest may include a single scene (or a single cut) included in the original image, or a cartoon component such as a metabolism, a fingerprint, a simple word, and the like.

In addition, the area of interest described in the present invention may mean a cartoon image or an image area constituting the single cut, the single frame, the single panel or the single frame. Also, the original image may be composed of one or more cuts, squares, panels, or frames.

In addition, the ROI may be composed of a plurality of cuts according to the cut-out arrangement of the original image. In this case, the ROI extractor 110 may set a plurality of cuts as one ROI, You can also extract the cut image.

In addition, the ROI extracting unit 110 extracts an original image of the webtoon stored in the content DB 101 under the control of the controller 140, extracts an original image of the webtoon from the extracted original image, The cut image can be extracted.

In addition, the controller 140 may receive (or collect) content information and original images related to a plurality of different webtoons from an external server serving the webtoon and store the same in the content DB 101.

In addition, the ROI extractor 110 may normalize the cut image to a predetermined normalization size, and may provide the normalized cut image to the feature extraction unit 120.

In addition, the feature point extracting unit 120 generates feature point information based on feature points extracted according to an algorithm for extracting a predetermined feature point from the normalized cut image at the time of receiving the normalized cut image from the ROI extracting unit 110 And may provide the minutiae point information to the content register 130.

In addition, the content registration unit 130 may include an interest region extraction unit 110 and an interest region extraction unit 120. The interest region extraction unit 110 extracts interest regions corresponding to the cut images, The feature point extracting unit 120 extracts feature point information corresponding to a specific point of interest received from the feature point extracting unit 120 and sets the specific point of interest in the specific point of interest The cut information including the minutia information and the area identification information corresponding to the specific region of interest may be generated and stored in the minutia DB 102 included in the search server 100 by matching the region identification information with each other.

At this time, the content registration unit 130 may set minutia information extracted from the original image as reference minutia information, store the cut minutia information in the minutia information DB 102, and store the minutia information in the minutia DB 102.

In addition, the content registration unit 130 identifies an original image to which a specific region of interest belongs by interworking with the region of interest extraction unit 110, identifies an original image corresponding to the specific region of interest, Can be extracted from the content DB 101 and stored in the cut information of the specific region of interest.

Through the above-described configuration, the search server 100 can generate the cut information for each region of interest included in the original image for each original image of the webtoon and store the cut information in the minutia DB 102.

FIG. 3 is a configuration diagram and operation example of a service server 200 according to an embodiment of the present invention. As shown in FIG. 3, the service server 200 includes a user interface And receives the message information from the user terminal 10a connected to the service server 200 providing the communication service and transmits the message information to the other user terminal 10b. Or can support communication with other users by registering or storing message information in an account page which is a web page of the user corresponding to the user terminal.

In addition, a user using the communication service captures or downloads a part of a plurality of cuts constituting an original image of the webtoot for use as an emoticon for emotional or physician expression, clips the cutout image, And the cut image is included in the message information as an emoticon (including a purpose for preventing ripping (or deletion) of a post), the service server 200 transmits the message information including the cut image to another user terminal Or transmits the message information including the corresponding cut image to another user terminal that accesses the user's account page by registering on the account page of the user.

At this time, another user who is interested in the webtoon related cut image included in the message information selects various cuts from the webtoon including the cut image, and selects various cuts from the cutout image of the emoticon or the post The search server 100 searches for a webtoon related to the cut image used by the user by using the search server 100 in cooperation with the service server 200, Related content information related to the cut image to the other user terminal so that the other user terminal can access the web page displayed on the basis of the content information and browse the webtoon, You can induce users to use the webtoon, Lt; / RTI >

Accordingly, it is possible to legally distribute cuts selected through contracts with copyright holders with emoticons after selecting cuts having a high preference from cuts of various webtoons used in communication services between users, The contents related to the emoticons can be extended to the webtoon to provide a variety of contents, which will be described in detail with reference to the following drawings based on the above-described configuration.

3, the service server 200 receives message information from the user terminal 10a and transmits the message information to another user terminal 10b, which is a recipient specified in the message information, or registers the message information in the user's account page .

In addition, the service server 200 extracts the content related to the image from the other user terminal 10b of the other user who has the image generated by using the specific cut of the specific webtoart and is included in the message information and confirmed the image of the message information And can transmit request information for the search request to the search server 100 upon receiving the request information.

Meanwhile, the control unit 140 of the search server 100 may receive the request information from the service server 200. In response to the request information, the control unit 140 may operate in cooperation with the service server 200, An image can be received from the service server 200.

At this time, the service server 200 may store the message information in the service DB 201 included in the service server 200, and may transmit an image corresponding to the request information transmitted to the search server 100, Information to be transmitted to the search server 100 as an identification target image.

In addition, the control unit 140 of the search server 100 may extract an image from the message information corresponding to the request information in cooperation with the service server 200, and then set the extracted image as the identification target image have.

In addition, the control unit 140 of the search server 100 may extract (or control) the ROI excluding the meaningless background from the ID image by the ROI extracting unit 110 and the ROI extracting unit 120 Extracts and normalizes the feature point information, and then extracts feature points from the region of interest of the corresponding identification target image to generate feature point information.

At this time, the control unit 140 of the search server 100 may perform overall control functions of the search server 100, and may control the respective constituent units configured in the search server 100.

In addition, the control unit 140 compares the generated minutia information with the minutia information of the minutia DB 102 to obtain the minutia information corresponding to the minutia information of the identification target image The extracted cut information can be extracted from the feature point DB 102.

The control unit 140 of the search server 100 transmits the cut information extracted from the minutia DB 102 in response to the request information to the service server 200, Upon receiving the cut information from the search server 100, the search result information may be generated based on the cut information, and then the search result information may be transmitted to another user terminal 10b corresponding to the request information.

At this time, the service server 200 can transmit the search result information as a message, for example, as a push message or as a text message displayed in a dialog window.

Each of the user terminal 10a and the other user terminals 10b may be configured to include an application unit 11 communicating with the service server 200. The application unit 11 may be connected to the user terminal 10a, Or a terminal control unit configured to control a user input unit, a communication unit, a display unit, a storage unit, and the like configured in the other user terminal 10b, or configured as application-related data stored in the storage unit and executed by the terminal control unit .

The control unit 140 of the search server 100 and the application unit 11 of the user terminal 10a or the other user terminal 10b may include an MCU .

Accordingly, the application unit 11 of the other user terminal 10b selects the image included in the message information received from the service server 200, generates the request information, and transmits the request information to the service server 200 via the communication network The service server 200 can communicate with the service server 200 through the communication unit of the other user terminal 10b that communicates with the service server 200 via the communication unit of the other user terminal 10b, Upon receiving the search result information, specific WebtoTour related content identification information, turnover information, link information, and the like included in the cut information (or included) according to the search result information can be displayed through the display unit of the other user terminal 10b have.

Accordingly, the present invention allows other users of the other user terminal 10b to easily search for specific times of the webtoons related to the webtoon related images included in the message information of the user and used as emoticons, The user can access the posted web page through the other user terminal 10b to create various emoticon related images through the webtoons related contents in addition to the webtoon based emoticons related images generated by the user.

However, with the above-described configuration, when a user uses an image generated by an emoticon based on a WebToon in a communication service such as a real-time conversation to communicate with another user, the other user responds to the image of the user's emotions or doctors, When an image is to be used for emotional-based emotional exchange with a user or communication with a user, a web-to-do based image of a message transmitted by the user is transmitted to the other user who can interact (or respond to) Since the image related to the emotion or the doctor needs to be produced as an emoticon by another user directly from the webtoart, there is a problem that it is difficult to immediately react to the emoticon of the user used in the real-time conversation.

Accordingly, in a communication service requiring real-time communication such as user-to-user conversation, when one user includes a cut-out image of a webtoon as an emoticon in a message and transmits the same to another user, The various cut images generated by the emoticons based on the contents are provided to the terminals of other users during the real-time conversation according to the kinds of expressions, and in response to the emotions of the user, It is possible to embed selected cut image among various cut-out images of Webtoon by emoticons in real time so that it can express the emotion and intention of the user instantly. To increase at the same time supporting the fingers emoticon ease of use feeling transfer efficiency depending on the user using the emoticon between the same based Webtoon dramatically, there can be double the fun of conversation during communication, this will be described with reference to FIG. 4 to FIG.

4, the control unit 140 of the search server 100 transmits an image included in the message information received by the service server 200 to the identification target image 200 in cooperation with the service server 200, .

For example, the service server 200 may transmit corresponding message information to the control unit 140 of the search server 100 when receiving message information for conversation or account page registration between the users, The control unit 140 may extract an image included in the message information as an identification target image.

The control unit 140 of the search server 100 may generate the minutia information by extracting the minutiae from the identification target image by controlling the ROI extraction unit 110 and the minutia extraction unit 120, The feature point information is compared with a plurality of different reference feature point information stored in the feature point DB 102 to identify cut information including reference feature point information matching the feature point information of the identification target image in the feature point DB 102 .

In addition, the control unit 140 may cumulatively count the number of times of use of the cut information identified in association with the identification target image, and may use the cut information corresponding to a plurality of different images to be identified, The number of times can be cumulatively counted.

The control unit 140 may record usage counts for each piece of cut information stored in the minutia DB 102. The control unit 140 may analyze the preferences for each piece of cut information constituting the webtoon according to the usage count for each piece of cut information Can be calculated.

In addition, the controller 140 may generate analysis result information for each webtoon regarding the preference of each cut information.

For example, the analysis result information may include information on the number of times of use by each piece of cut information of a specific webtoTune, or information on the number of times of use for a predetermined period, and the controller 140 may use the number of times of use per cut information The preference for each cut information can be calculated and included in the analysis result information.

In addition, the control unit 140 identifies (or selects) cut information having a preference higher than a preset reference value on the basis of the analysis result information, and determines whether or not interest of the original image related to the webtoon corresponding to the cut information having the preference higher than the reference value An area can be extracted and created as a cut image, and then the cut image can be set as an emoticon.

At this time, the controller 140 may generate the cut image by normalizing the image extracted from the original image corresponding to the region of interest to a preset reference size.

In addition, the control unit 140 may be configured to classify each of the webtoons according to the cut information corresponding to the cut image at the time of generating the cut image, and to include a plurality of different pieces of webtoon related content identification information included in the search server 100 Identifies content identification information in the emoticon DB 103 that matches the webtoons related content identification information included in the cut information corresponding to the cut image, and then matches the cut image to the identified content identification information corresponding to the cut image And store it in the emoticon DB 103 as an emoticon.

The control unit 140 of the search server 100 transmits message information including an image corresponding to the cut information having the preference higher than the reference value to the service DB 200 of the service server 200, Extracts as the cut image an image corresponding to cut information having a preference value equal to or higher than the reference value from the message information, and matches the content identification information corresponding to the cut image to generate the emoticon DB 103 as an emoticon, .

That is, the control unit 140 may extract one or more cuts whose usage frequencies as emoticons are higher than a certain reference value for each webtoon, generate cut images usable as emoticons, and store the cut images in the emoticon DB 103. [

In addition, the control unit 140 identifies one or more cut images matching the content identification information of the specific webtoon in the emoticon DB 103, and then groups them to generate emoticon information including one or more different cut images for each webtoon And may transmit the emoticon information generated for each webtoon to the service server 200. [

In addition, the service server 200 may store the emoticon information in the service DB 201 when receiving the emoticon information from the search server 100, and distribute the emoticon information through the communication service.

Accordingly, the service operator of the service server 200 selects cuts whose usage frequencies as emoticons are higher than a predetermined standard value for each webtoon through the search server 100, and selects cuts from the copyright owners and webtoons of each webtoon A contract for distribution of the emoticons produced by the emoticons can be concluded and the cut image set as the emoticons in the emoticon information can be distributed in the communication service.

Accordingly, the present invention allows contracts for using emoticons to be used for cuts frequently used in webtoons to be signed with copyright holders, so that it is possible to provide a webtoart-based emoticons service, We can support contracts to be contracted only for limited cuts with high preference, so as to reduce the contract burden and provide a profit model for the copyright owners of WebtoTun.

5, the service server 200 may include a plurality of different expression types (or a plurality of different expression types, each matching a plurality of different expression types) in association with expression (or display) And the one or more different cut images included in the emoticon information of the specific webtoon may be set to match any one of the plurality of different expression types.

For example, the type of expression may include various emotional and physician related categories such as joy, sadness, depression, anger, anger, tears, whining,

At this time, the service server 200 may set any one of the plurality of different expression types for each cut image included in the emoticon information according to the external input, and may set the emoticon information, May be included in the emoticon information.

Also, the service server 200 may send a messenger application executed in the user terminal 10 or a web page of a web browser to connect the emoticon information to the communication service of the service server 200 The user terminal 10 may select at least one of the cut images included in the emoticon information to be included in the message information generated by the user terminal 10 as an emoticon .

At this time, if the service information includes a cut image used as an emoticon in the message information based on a machine learning or deep learning algorithm, Related message information within a predetermined time range and can accumulate and store the received conversation-related message information within a predetermined time range, and learn a dialog-related text message included in the message information cumulatively stored in association with the specific cut image, And then automatically sets a specific expression type corresponding to the specific cut image.

Accordingly, the service server 200 automatically sets any one of preset expression types for each cut image included in the emoticon information based on the machine learning or the deep learning algorithm, generates the setting information, Can be included.

Meanwhile, as shown in FIG. 6, the service server 200 may provide the communication service to a plurality of different user terminals 10 to support real-time user-to-user conversation, To the user terminal 10a or the other user terminals 10b in order to apply it to the user terminal 10a or the other user terminal 10b in real time in cooperation with the conversation message.

The user terminal 10a or the other user terminal 10b may be connected to a web page provided by the service server 200 or may execute a messenger application for conversation with one or more other user terminals 10b, And an application unit 11 connected to the server 200 and displaying a dialog window provided by the instant messenger application through the display unit of the user terminal 10a or the other user terminal 10b.

Accordingly, the application unit 11 can access the service server 200 and receive the emoticon list information from the service server 200 through the dialog window or the web page, And may extract the content identification information for the selected webtoart according to user input through the user input unit of the terminal 10a or the other user terminal 10b and transmit the extracted content identification information to the service server 200. [

At this time, the application unit 11 may generate selection information including the selected WebtoTour related content identification information from the emoticon list information according to the user input, and may transmit the generated selection information to the service server 200. [

Also, the application unit 11 may receive emoticon information corresponding to the content identification information (or selection information) from the service server 200 and display the emoticon information through the dialog window or the web page.

In this case, when the emoticon information is displayed on the user terminal 10a, the application unit 11 displays type information on the type of expression corresponding to the cut image for each cut image according to the setting information included in the emoticon information And can be displayed by matching with the cut image.

Accordingly, the application unit 11 generates message information according to a user input through the user input unit, and transmits the selected cut image as an emoticon in the message information according to the user input. At this time, It is possible to easily select a cut image corresponding to a type of expression related to the emotion or doctor according to the type information about the expression type displayed together with the image.

At this time, the message information may include a text message in addition to the cut image, and only the cut image may be included in the message information, or one or more cut images may be included in the message information.

In addition, the application unit 11 may include a cut image corresponding to the type of expression corresponding to the selected type information in the message information according to user input.

Meanwhile, the service server 200 transmits the message information received from the user terminal 10a to the other user terminal 10b of the other user specified in the message information, or transmits the message information of the user corresponding to the user terminal 10a The account page including the message information may be transmitted to another user terminal 10b that registers the account page and accesses the account page.

7, the application unit 11 of the other user terminal 10b displays the message information through the web page displayed on the dialog window or the web browser when receiving the message information, and stores the message information in the message information And can support other users to grasp the emotion or intention of the user through the cut image A used as the emoticon. In addition, the cut image of the same webtoon as the webtoon related to the cut image A contained in the message information When requesting a search for a webtoon related to a cut image (A) contained in the message information to respond to a user's emotion or pseudo-representation using one of the images, the request information is generated according to the other user input can do.

At this time, the application unit 11 may display an interface such as a button for generating the request information in a dialogue box in cooperation with the cut image included in the message information (linking or matching) 10b may generate request information for a search request of the webtoons related to the cut image A and transmit the generated request information to the service server 200 when the selection input of another user to the button is received.

Accordingly, when the service server 200 receives the request information and emoticon information including a cut image corresponding to the request information among the plurality of different emoticon information stored in advance in the service DB 201 exists, the service server 200 transmits the corresponding emoticon information The user terminal 10a may extract the service information from the service DB 201 and transmit the extracted service information to the application unit 11 of the other user terminal 10b, Can be included in the message information for transmission to the user terminal 10a and transmitted in any one of the cut images included in the emoticon information of the same webtoon as the related webtoe.

In this case, the emoticon information may include image identification information for each cut image, and the service server 200 may identify the image corresponding to the cut image of the request information based on the image identification information of the cut image included in the request information It is possible to identify the emoticon information including the information.

In addition, the search server 100 may set cut information corresponding to the cut image as image identification information corresponding to the cut image at the time of generating the cut image, and may include the cut information in the emoticon information, May transmit the request information including the image identification information corresponding to the cut image selected by the other user.

If the emoticon information related to the cut image corresponding to the request information does not exist in the service DB 201, the service server 200 identifies the image included in the message information corresponding to the request information It transmits the search result information to the search server 100 as a target image and generates search result information about the webtoons associated with the identification target image in cooperation with the search server 100 and transmits the search result information to the other user terminal 10b.

As described above, the present invention supports the sending of a cut-out image of the webtoon in the message information by emoticons during real-time communication between users, and at the same time, the other user who receives the message information of the user uses cut The emoticon information of the webtoons related to the image can be immediately downloaded and the user can select any one of the cutout images of the same webtoon as the webtoon related to the cut image used by the user as an emoticon, In this way, it enables other users to respond in real time using emoticons in response to the expression type expressed by the user's emoticons, while supporting emotional exchange and communication using emoticons created on the basis of the web toon To support emotional and communication effects between users.

At this time, the service server 200 may transmit the emoticon information of another webtoon different from the webtoon related to the cut image transmitted by the user in the message information, according to the selection of another user, It is needless to say that the cut image can be included in the message information to be transmitted to the user and transmitted.

In addition, the present invention can selectively use a cut image having a high frequency of use among cut images produced from Webtoons related contents and use the cut image together with a text message in a real-time conversation so that a service operator in an existing communication service is limited to use as an emoticon As the contents are produced, the problem of the slow increase of emoticon related contents is improved, so that various cut images that can be used as emoticons can be selected from the webtoons based on the user participation, and the production range of the emoticon related contents is extended to the webtoon, It is possible to induce various contents related to the emoticons to be generated in the communication service. In addition to the diversity of the contents related to the emoticons, the contents of the emoticons, which can be used in real time in the communication service, The user satisfaction can be enhanced using.

FIG. 8 illustrates a service server 200 that communicates with a plurality of different user terminals 10 through a communication network according to an exemplary embodiment of the present invention, and a search server 100 FIG. 2 is a flowchart of a communication service method using the Webtoon identification technology of FIG.

First, the search server 100 extracts a region of interest from a plurality of different WebTones in units of cuts, extracts feature points of the region of interest according to a predetermined algorithm, The cut information including the content information previously stored corresponding to the specific rotation of the specific webtoart corresponding to the region can be generated and stored (S1).

In addition, the service server 200 may provide a communication service for transmitting the message information received from one user terminal to another user terminal or registering the message information in an account page, which is a web page of the user corresponding to the user terminal S2).

In addition, the service server 200 may receive request information related to an image included in the message information from another user terminal (S3).

In addition, the search server 100 extracts an image included in the message information corresponding to the request information as an identification target image when receiving the request information from the service server 200 in cooperation with the service server 200, According to the algorithm, the feature point information extracted from the identification target image is compared with the reference feature point information, and the search result information is generated based on the cut information including the reference feature point information coinciding with the feature point information to be transmitted to the other user terminals (S4).

The various devices and components described herein may be implemented by hardware circuitry (e.g., CMOS-based logic circuitry), firmware, software, or a combination thereof. For example, it can be implemented utilizing transistors, logic gates, and electronic circuits in the form of various electrical structures.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or essential characteristics thereof. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

10: user terminal 11: application unit
100: search server 110: ROI extracting unit
120: feature point extracting unit 130:
140: control unit 200: service server

Claims (9)

A communication service for transmitting message information received from a user terminal to another user terminal or registering the message information in an account page which is a web page of a user corresponding to the user terminal, A service server for receiving request-related request information; And
Extracting feature points of the ROI according to a preset algorithm, extracting reference feature point information generated by extracting feature points of the ROI according to a predetermined algorithm, extracting a feature point of the specific WebToon corresponding to the ROI And stores the image included in the message information corresponding to the request information as an identification target image when the request information is received from the service server in cooperation with the service server Extracts feature point information from the identification target image, compares the feature point information extracted from the identification target image with the reference feature point information, generates search result information based on cut information including reference feature point information matching the feature point information, To a search server,
Wherein the search server cumulatively counts the number of times of use of the cut information identified in association with the identification target image and analyzes the preference of each cut information according to the number of times of use per cut information for each webtoon composed of one or more times, The cut-out information having preference higher than a preset reference value is selected for each webtoon based on the generated information, and the cut-out image is set as an emoticon, and one or more cut images set for the webtoon are included And transmits the emoticon information to the service server,
A messenger application for accessing a web page provided by the service server or for chatting with one or more other user terminals, accessing the service server, providing a chat window provided by the instant messenger application, Related web page, or one or more webtoon related emoticons list information in which emoticon information is registered through the dialog window, from the service server, and transmits the selected webtoTour related selection information to the service server to correspond to the selection information Further comprising an application unit that includes the cut image selected by the user among the one or more cut images included in the emoticon information received from the service server and transmits the cut image to the service server,
Wherein the service server matches any one of a plurality of different expression types related to an emotion and a doctor with a cut image included in the emoticon information to set a representation type corresponding to each of the cut images to the emoticon information,
When the emoticon information is displayed on the user terminal, the application unit displays the type information corresponding to the expression type corresponding to the cut image with the cut image for each of the cut images and displays the matching information. system.
The method according to claim 1,
Wherein the content information includes specific WebtoTour related content identification information and time information for a specific time difference of the specific WebtoTun.
The method according to claim 1,
Wherein the search server sets area identification information for the ROI when extracting the ROI and includes the ROI in the cut information.
delete delete delete delete The method according to claim 1,
If the message information includes a cut image used as an emoticon, the service server transmits the message related message information received within a preset time range based on the reception time of the message information including the cut image through a predetermined deep- And then learns a dialogue-related text message included in the message information accumulated and stored in association with the specific cut image, identifies a specific expression type related to the specific cut image, and recognizes the specific expression corresponding to the specific cut image A communication service system using the Webtoon identification technology.
A communication service method using a webtoon identification technique of a search server in which a plurality of different user terminals are communicated through a communication network and a plurality of different webtoons are stored with respective original image and content information,
Wherein the search server extracts the ROIs from the plurality of different WebTones in units of cuts, extracts the ROIs of the ROIs according to a preset algorithm, Generating and storing cut information including previously stored content information corresponding to a specific turn of the webtoon;
Providing a communication service in which the service server transmits message information received from one of the user terminals to another user terminal or registers in an account page that is a web page of a user corresponding to the user terminal;
The service server receiving request information related to a search request for an image included in the message information from another user terminal; And
The search server extracts an image included in the message information corresponding to the request information as an identification target image when receiving the request information from the service server in cooperation with the service server, Comparing the information with the reference minutia information and generating search result information based on cut information including reference minutia information matching the minutia information and transmitting the result information to the other user terminal,
The search server cumulatively counts the number of times of use of the cut information identified in association with the identification object image, analyzes the preference of each cut information according to the number of times of use per cut information, The cut-out information having preference higher than a preset reference value is selected for each webtoon based on the generated information, and the cut-out image is set as an emoticon, and one or more cut images set for the webtoon are included Generating emoticon information and storing the emoticon information or transmitting the emoticon information to the service server;
Accessing a web page provided by the service server to the user terminal or executing a messenger application for chatting with one or more other user terminals, accessing the service server, providing a chat window provided by the instant messenger application, Or one or more to-do list related emoticon list information in which the emoticon information is registered through the dialog window is received from the service server, and the selected selection information in the emoticon list is transmitted to the service server, Configuring an application unit that includes a cut image selected by a user among at least one cut image included in emoticon information received from a server and transmits the cut image to the service server;
Matching the cut image included in the emoticon information with any one of a plurality of different expression types related to the emotion and the doctor and setting the expression type corresponding to the cut image to the emoticon information;
When the application displays the emoticon information on the user terminal, displaying the emotion information corresponding to the cut image and the type information corresponding to the cut image with the cut image, Way.

Images