WO2016137132A1

WO2016137132A1 - Apparatus and method for generating user arbitrarily modified image, and computer-readable recoding medium having recorded thereon program for executing method for generating user arbitrarily modified image

Info

Publication number: WO2016137132A1
Application number: PCT/KR2016/001050
Authority: WO
Inventors: 김승익
Original assignee: 네이버 주식회사
Priority date: 2015-02-27
Filing date: 2016-02-01
Publication date: 2016-09-01
Also published as: KR101631636B1

Abstract

According to one embodiment of the present invention, disclosed is a method for generating, using an interface of a contents viewer who outputs an image, a user arbitrarily modified image, the method comprising: a frame display step of displaying, on the basis of attribute information of the image, a modification-allowed frame which is preset so as to be able to be arbitrarily modified, among frames included in the image; an editing screen output step of sensing an input of the modification-allowed frame and outputting an editing screen which allows the modification-allowed frame of which the input has been sensed to be edited; a user input reception step of receiving a user's input from the editing screen; and a user arbitrarily modified image generation step of, depending on the user's input, modifying the modification-allowed frame and generating a user arbitrarily modified image.

Description

A computer readable recording medium having recorded thereon an apparatus and method for generating a user modified image and a program for executing the method for generating a user modified image.

The present invention relates to a computer-readable recording medium having recorded thereon an apparatus, a method for generating a user modified image, and a program for executing the method for generating a user modified image.

Recently, due to the development of the Internet, an unlimited amount of contents are produced in one day, and the trend of the contents has been shifted from the existing text-oriented contents to video contents that can have a high degree of attention to a large number of people. Posts written in letters only on the portals of portals where many visitors come and go, regardless of the quality of the content contained in the posts, are not attracting attention and record low views. .

Jabangbang is an abbreviation for "anti-cut". Jatbang originated from uploading photos or videos that have nothing to do with content to prevent them from being deleted if they are not pictures or videos. Generalized to a degree. With the widespread use of tools for modifying images such as Photoshop on its own, even ordinary people who do not have expertise can easily modify images and produce a number of salvia.

However, in this case, even if the image is easily available on the Internet, there is a problem that it is possible to claim copyright infringement of the copyright holder of the image at the moment of modification and distribution.

While there are a number of tools for modifying images floating around the Internet, and a growing number of people can use them to modify images, the openness of the Internet increases the possibility of copyright infringement. You need a solution that will allow you to create your own image and still be free from copyright infringement.

The technical problem to be solved by the present invention is to distinguish and display the image that can be modified in advance, the user can create a new image by modifying only in the image that is distinguished, so that there is no possibility of copyright infringement user modification An object of the present invention is to provide a computer-readable recording medium having recorded thereon an apparatus, a method and a program for executing a method for generating a user-modified image.

According to an aspect of the present invention, there is provided a method for generating a user modified image according to an embodiment of the present invention, in the method for generating a user modified image using an interface of a content viewer for outputting an image. A frame display step of displaying a modification allowable frame preset to enable arbitrary modification among frames included in the image based on attribute information of the image; An editing screen output step of detecting an input for the correction allowable frame and outputting an edit screen for editing the correction allowable frame detected by the input; A user input receiving step of receiving a user input on the edit screen; And generating a user arbitrary modified image by modifying the correction allowable frame according to the user input.

According to another aspect of the present invention, there is provided an apparatus for generating a user modified image according to another embodiment of the present invention. The apparatus for generating a user modified image using an interface of a contents viewer for outputting an image includes: A frame display unit displaying a modification allowable frame preset to enable arbitrary modification among frames included in the image based on the attribute information of the image; An edit screen output unit for detecting an input for the correction allowable frame and outputting an edit screen for editing the correction allowable frame detected by the input; A user input receiver configured to receive a user input on the edit screen; And a user randomly modified image generator configured to generate a user randomly modified image by correcting the correction allowable frame according to the user's input.

According to a computer-readable recording medium having recorded thereon an apparatus, a method for generating a user modified image according to the present invention, and a program for executing the method for generating a user modified image, the user can freely modify the image while claiming a copyright infringement. Can be free.

1 is a diagram schematically illustrating an apparatus 100 for generating a user arbitrary modified image and a terminal 10 according to an exemplary embodiment.

2 is a flowchart illustrating a method for generating a user modified image according to another embodiment of the present invention.

3A, 3B, and 3C are diagrams illustrating an example of a web toon that is output through a content viewer in which the user arbitrary image generating apparatus 100 according to an embodiment of the present invention is implemented.

4A, 4B, and 4C are diagrams illustrating an example of an image output through a content viewer in which a user-modified image generating apparatus 100 according to another embodiment of the present invention is implemented.

5 is a diagram illustrating an edit screen operating in the simple edit mode among the edit screens output by the edit screen output unit 130.

6 is a diagram illustrating an example of an edit screen when an image output through a content viewer is a video.

7A and 7B illustrate an edit screen for generating a user-modified video with an advertisement inserted and a user-modified video with an advertisement inserted.

In the method, the correction allowable frame may be a frame previously designated by the copyright holder of the image.

In the method, the image may be at least one of a still image and a moving image.

The method may further include a button input sensing step of sensing an input for a user-modified video generation button included in the interface, wherein the frame display step includes detecting an input for the button. The correction allowable frame may be displayed.

In the method, the user arbitrarily modified image generation button, may be located in the interface of the content viewer and the frame to allow modification.

In the above method, the image is a web toon, and the editing screen outputting step includes displaying a border on a speech bubble in which the dialogue of the character of the web toon is input in the frame according to the attribute information of the editable frame in which the input is detected. And an edit screen for editing the contents included in the frame.

In the method, the image is a web toon, and the editing screen output step, in accordance with the attribute information of the correction allowable frame detected the input, in the frame to display the border of the character of the character, the web toon, It may be characterized by outputting an edit screen for editing the content included in the border.

In the method, the video is a video, the correction frame includes a plurality of consecutive frames, the step of generating a user arbitrary modification image, by modifying the correction allowable frame according to the user's input, It may be characterized by generating a user-modified video that changes according to the flow.

In the method, the image is a video, and the step of generating a user-modified image, by modifying the allowable frame according to the user's input, combining the modified frame and the pre-stored image over time It may be characterized by generating a user-modified video that changes.

In the above method, the step of generating a random user modified image, the portion of the user-adjustable image can be specified in the user-modified image according to the attribute information of the modification allowable frame, and the portion of the substitute advertisement is possible to the pre-stored advertisement item In addition, the user may be characterized by generating a user-modified image inserted with the advertisement.

In the apparatus, the modification allowable frame may be a frame previously designated by the copyright holder of the image.

The apparatus of claim 1, wherein the image is at least one of a still image and a moving image.

In the device, the device further comprises a button input detection unit for detecting an input for the user-modified image generation button included in the interface, the frame display unit, the correction is allowed when the input to the button is detected It may be characterized by displaying a frame.

In the device, the user arbitrarily modified image generation button may be located in the interface of the content viewer and the frame to allow modification.

In the apparatus, the image is a web toon, and the edit screen output unit displays a border in a speech bubble in which the dialogue of the character of the web toon is entered in the frame according to the attribute information of the editable frame in which the input is detected. And, it may be characterized in that for outputting the edit screen for editing the content contained in the border.

In the apparatus, the image is a web toon, and the edit screen output unit displays a border on the face of the character of the web toon in the frame according to the property information of the editable frame in which the input is detected, and the border It may be characterized by outputting an edit screen for editing the contents contained in.

In the apparatus, the image is a video, the correction allowable frame includes a plurality of consecutive frames, the user arbitrary image correction unit, by modifying the correction allowable frame according to the user's input, the flow of time It may be characterized by generating a user-modified video that changes according to.

In the apparatus, the image is a video, the user randomly modified image generating unit, the correction allowable frame according to the user's input, combining the modified frame and the pre-stored image is changed over time It may be characterized by generating a user arbitrary modified video.

In the apparatus, the user randomized video generation unit, the portion of the user-modified video based on the attribute information of the user-modified video specifying the possible portion of the alternative advertisement, the portion of the alternative advertisement is possible to the pre-stored advertising item In addition, the user may be characterized by generating a user-modified image inserted with the advertisement.

As the inventive concept allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. Effects and features of the present invention, and methods of achieving them will be apparent with reference to the embodiments described below in detail with reference to the drawings. However, the present invention is not limited to the embodiments disclosed below but may be implemented in various forms.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, and the same or corresponding components will be denoted by the same reference numerals, and redundant description thereof will be omitted. .

In the following embodiments, the terms first, second, etc. are used for the purpose of distinguishing one component from other components rather than a restrictive meaning.

In the following embodiments, the singular forms “a”, “an” and “the” include plural forms unless the context clearly indicates otherwise.

In the following embodiments, terms such as include or have means that the features or components described in the specification are present, and does not preclude the possibility of adding one or more other features or components in advance.

When a certain embodiment can be implemented differently, a specific process order may be performed differently from the described order. For example, two processes described in succession may be performed substantially simultaneously or in the reverse order of the described order.

The terminal 10 illustrated together with the user arbitrary modified image generating apparatus 100 according to an exemplary embodiment includes a display unit displaying a screen 11 and an input device for receiving data from a user. Means electronic device. The input device provided in the terminal 10 may include at least one of a keyboard, a mouse, a trackball, a microphone, a mechanical button, and a touch panel.

Referring to FIG. 1, the terminal 10 is illustrated in the form of a smart phone, but the terminal 10 when the present invention is implemented is not limited to a smart phone, and is located in a fixed position such as a general personal computer (PC). The device may be installed, a tablet PC, a portable terminal such as a netbook, or the like.

Referring to FIG. 1, the apparatus for generating a user-modified image 100 according to an embodiment of the present invention may correspond to at least one processor or may include at least one processor. Accordingly, the user arbitrary image generating apparatus 100 may be driven in a form included in another hardware device such as a microprocessor or a general purpose computer system. That is, the user arbitrary modified image generating apparatus 100 may be mounted on the terminal 10 as it is, or connected to the terminal 10 via a wired or wireless network to affect the contents displayed on the screen 11 of the terminal 10. It may be implemented in the form.

The apparatus 100 for generating a user-modified image shown in FIG. 1 illustrates only components for emphasizing only features of an exemplary embodiment of the present invention. Therefore, when the present invention is different from the embodiment shown in FIG. 1, it is understood by those skilled in the art that other general purpose elements may be further included in addition to the elements shown in FIG. 1. Could be.

The apparatus for generating a user-modified video according to an embodiment of the present invention 100 controls the content displayed on the screen 11 of the terminal 10.

More specifically, the apparatus 100 for generating a user-modified image 100 controls the content displayed on the screen 11 of the terminal 10 to be displayed differently according to a user's input, and the terminal 10 outputs an image by the user. The user's arbitrary modified image generated using the interface of the content viewer can be stored.

Referring to FIG. 1, the apparatus 100 for generating a randomized user image according to an embodiment of the present invention may include a frame display unit 110, an edit screen output unit 130, a user input receiver 150, and a user random image modification. The unit 170 is included.

The frame display unit 110 displays a modification allowable frame that is set to allow arbitrary modification among the frames included in the image, based on the attribute information of the image output from the contents viewer.

The terminal 10 may provide an image to the user through the screen 11, and the provided image includes a still image in which the contents of the image do not change with time, and the contents of the image change with time. You can include all the videos you say. The image provided to the user may be an image previously stored in a storage device (not shown) of the terminal 10, or may be a wired network such as a local area network (LAN), a Bluetooth, or a Wi-Fi (WIFI). It may be an image downloaded by a wireless network such as WiBro, satellite communication.

The content viewer is a program installed in the terminal 10 to output an image. The content viewer is a method of outputting an image through a user's mouse click or a touch input, or a graphic user interface for changing an output image. GUI, hereinafter, interface). The content viewer may include a component necessary for downloading and playing an image which is not stored in the terminal 10 by streaming through a wired or wireless network.

The interface of the content viewer may be provided to the user in a graphic form of a button so that the user can change the image or the method of outputting the image even if the user does not have expert knowledge such as a system command.

The attribute information of an image means all types of information included in the image. The attribute information of the image may include information such as a time point at which the image is created and changed, a standard and capacity of the image, color information and position information of pixels constituting the image. The image includes a plurality of frames, and each frame expresses the contents of the image separately.

When the image is a still image, one image may include frames of various sizes. Frames in still images can be understood in a similar sense to a cut that divides each page into various sizes in a comic book.

When the image is a video, one image may include frames of the same size. If the video is a video, the content viewer sequentially shows the moving pictures (pictures) recorded in the same size frames within a short time, allowing viewers to view the moving pictures (pictures) over time. You can make it recognized.

The frame included in the image may have unique attribute information for each frame. The attribute information of the frame is given a different value for each frame to distinguish each frame, and may include information such as color information and position information of pixels constituting a part of the image included in each frame, such as image attribute information. .

In addition, the attribute information of the frame may include information on whether the frame is preset to allow arbitrary modification. When the image is a video, the attribute information of the frame may include reproduction order information that may be used to determine the order of frames sequentially reproduced over time.

The attribute information of the image may include attribute information of a preset allowable frame to enable arbitrary modification among frames included in the image. The frame display unit 110 may determine and display which frame among the plurality of frames included in the image is the modification allowable frame through the attribute information of the modification allowable frame included in the attribute information of the image.

The frame display unit 110 regards the moment when the user is allowed to modify the frame on the content viewer screen based on the property information of the image while viewing the image through the content viewer, and distinguishes the frame from the other frame in the modification allowable frame. Can be applied.

The user may apply an input to the modification allowable frame to which the display is distinguished from other frames, and the modification allowance frame to which the user input is applied may be transferred to the object of the editing program.

The editable frame to which the user's input applied to the object of the editing program is applied may be modified by the user. The description of the editing program may be modified together with the description of the edit screen output unit 130. It will be described later.

As an optional embodiment, the attribute information of the frame may include information on whether the frame is a predetermined frame from the copyright holder of the image (hereinafter, copyright holder permission information). After the video is produced by the copyright holder, if an unauthorized person makes unauthorized modifications to the video and distributes the modified video, the unauthorized person infringes on the copyright of the copyright holder.

The frame display unit 110 distinguishes a frame that allows the copyright holder to arbitrarily modify (hereinafter, a modification allowable frame) through copyright holder permission information included in the attribute information of the frame, and allows the user to arbitrarily modify only the modification allowable frame. Special marks can be placed on the frames that can be modified. As an example of the special display that the frame display unit 110 can apply to the frame to be modified, the frame of the frame to be modified can be surrounded by a dotted line border, or the frame of the frame to be modified can be distinguished from the colors of the surrounding pixels. There may be something to paint. The present invention does not limit the special display method applied by the frame display unit 110 to the correction allowable frame, and the modification allowable frame is displayed without departing from the scope of the present invention even if the display permits the modification to another type of special display.

The frame display unit 110 determines whether the correction allowable frame is included in the image output through the content viewer through the attribute information of the image, and if the attribute information of the correction allowable frame is included in the attribute information of the image, the correction is allowed. Special markings may be applied to the frame which can be distinguished from other frames.

As another optional embodiment, the frame display unit 110 may display a frame allowing modification only when detecting a user's input to a user's arbitrary modified image generation button included in an interface of the content viewer. In order to implement this optional embodiment, the content viewer may include a user-modified image generation button.

When the user arbitrarily modified image generation button is pressed by the user's input, the frame display unit 110 determines which frame among the frames included in the image output through the content viewer is a frame to be modified based on the attribute information of the image. Thus, the frame to be corrected can be displayed to be distinguished from other frames.

As shown in the present exemplary embodiment, the frame display unit 110 displays a frame allowing modification only when a user's arbitrary modified image generation button is pressed due to a user's input (mouse click, touch, etc.). When viewing the video, it is possible to remove the discomfort felt by automatically displaying the correction allowable frame.

As another optional embodiment, the user arbitrarily modified image generation button may be located in the interface of the content viewer and the frame for modification. First, as described above, when the user arbitrarily modified image generation button is included in the interface of the content viewer, the user may input an input to the user arbitrarily modified image generation button to display a modification allowable frame.

According to this optional embodiment, the user may apply a special mark to input the user arbitrary modification image generation button located in the correction permission frame to distinguish it from other frames. This optional embodiment can increase the user's convenience by placing the user arbitrarily modified image generation button in the frame allowing modification without actively inputting a user input where the user randomly generated image generation button of the content viewer is located. .

The user may deactivate (delete) a user arbitrarily edited image generation button located in the correction allowable frame by changing a setting of the content viewer. In addition, the user may change the setting of the content viewer so that the user arbitrarily modified image generation button appears only when the user moves the mouse cursor or the like close to the frame for modification.

The edit screen output unit 130 detects an input for the correction allowable frame and outputs an edit screen for editing the correction allowable frame in which the input is detected. More specifically. The edit screen output unit 130 may detect a user's input for the correction allowable frame and may output an edit screen for editing the editable frame for which the input is detected through the screen 11 of the terminal 10. .

When the user arbitrary modified image generating apparatus 100 is mounted on the terminal 10 as it is, the edit screen output unit 130 may store and drive an editing program for editing a frame to be modified. When the user arbitrarily modified image generating apparatus 100 is connected to the terminal 10 through a wired or wireless network, the edit screen output unit 130 executes an editing program for editing the editable frame stored in the terminal 10. In this way, the edit screen can be output to the screen 11 of the terminal 10. The correction allowable frame output on the edit screen means a correction allowable frame to which the user inputs.

As an optional embodiment, it is assumed that the image output by the content viewer is a still image such as a web toon, and the web toon is composed of one large image. In the present embodiment, when a user input is applied to a modification allowable frame among various frames included in the web toon image, the modification allowable frame to which the input is applied may be separated from the web toon based on the attribute information of the web toon. The separated modification allowable frame may be received by the terminal 10 and edited by the user in the edit screen. According to this embodiment, the content providing server (not shown) may store a program that can separate each frame from the web toon and transmit it to the terminal 10.

As another optional embodiment, it is assumed that the image output by the content viewer is a still image such as a web toon, and the web toon is an image composed of a plurality of frames. In the present embodiment, when a user input is applied to the modification allowable frame among the various frames constituting the web toon, the modification allowable frame to which the input is applied may be copied to the terminal 10 as it is. In the present embodiment, the copy of the modification allowable frame includes not only a physical copy but also receives a Resource Locator (URL, Uniform Resource Locator) in which the modification allowance frame is stored, and then descends from the corresponding position of the content providing server (not shown). It may include the way of receiving.

The content providing server (not shown) may separately store a plurality of frames constituting the web toon as a high resolution image file, and transmit only the frames corresponding to the correction allowable frame to which the user input is applied to the terminal 10. In this case, the content providing server (not shown) may provide the user with a high resolution correction allowable frame as an editing target, thereby minimizing image quality deterioration caused by the user arbitrarily modifying the correction allowance frame.

The high resolution image file stored in the content providing server (not shown) may be either a vector image or a bitmap image. Vector images can maintain a consistent image quality even if the user arbitrarily enlarges or reduces the image due to the characteristics expressed through points and Bezier curves.

A bitmap image is an image represented by arranging a large number of pixels in a certain manner, each pixel having a unique single color. By subtle color arrangement on the pixels of the bitmap image, the user can maximize the feeling of seeing the real object in the user's arbitrary modified image, and can apply much more various special effects than the vector image. The content providing server (not shown) may output a selection screen through the screen 11 of the terminal 10 so that a user can selectively modify either a vector image or a bitmap image.

That is, when the above-described embodiments are combined, the correction allowable frame output on the edit screen may be the same frame as the frame included in the web toon, or may be a frame separately stored for generating a user's arbitrary modified image.

As an optional embodiment of the edit screen output unit 130, the image output through the content viewer is a web toon, and the edit screen output unit 130 may display the web toon character in the editable frame according to property information of the editable frame. Put a border around the speech bubble

You can output the edit screen to edit the contents included in the border. In this case, the attribute information of the modification allowable frame may include information on the speech bubble. The information on the speech bubble may include information on the position, shape, number, and dialogue lines included in the speech balloon in which the dialogue of the web toon character enters in the modification allowable frame. The information on the position of the speech bubble may be coordinates of pixels constituting the speech bubble in the modification allowable frame when the speech bubble is placed in the modification allowable frame.

According to the present embodiment, a border is displayed on a speech balloon in which the dialogue of the character of the web toon is displayed, and only the inside of the speech balloon is modified by the user, thereby facilitating the user's corrective action. For example, it is possible to prevent the portion of the modification allowance frame that does not need to be explicitly modified by the user's corrective action.

As another optional embodiment of the edit screen output unit 130, the image output through the content viewer is a web toon, and the edit screen output unit 130 is a web toon character in the editable frame according to property information of the editable frame. A border can be displayed on the face of the, and an edit screen for editing the contents contained in the border displayed on the face can be output. At this time, the attribute information of the modification allowable frame may include information about the character face. The information about the character face may include information about the position, size, thickness of the contour, and feature of the face of the web toon character in the modification allowable frame. The information on the position of the face of the web toon character may be coordinates of pixels constituting the character's face in the frame to be modified.

According to the present embodiment, the border is displayed on the face of the character of the web toon, and only the face part included in the border is modified by the user, so that the user can easily modify the correction allowable frame. For example, a part that does not need to be explicitly modified can be prevented from being modified by the user's corrective action. In addition, only the parts included in the border are modified by the user while the parts representing the unique characteristics of the character, such as the shape of the character's face or the horns attached to the face, remain intact. The user's arbitrary modified image can be generated.

The edit screen output by the edit screen output unit 130 may be switched between the detailed edit mode and the simple edit mode. The detailed edit mode can provide an interface for the user to directly modify all parts of the frame to be modified. The simple edit mode may provide an interface for allowing a user to modify only a predetermined portion of a frame to be modified. The predetermined portion of the modification allowable frame may vary according to the attribute information of the modification allowable frame, and may be a speech bubble or a character's face in which the dialogue of the character is entered according to the above-described embodiment. Further description of the detailed edit mode and the simple edit mode will be described later with reference to FIGS. 5 and 6.

The user input receiver 150 receives a user input on an edit screen. The user's input to the edit screen is an input made by the user to modify the editable frame through the edit screen. That is, the user's input to the editing screen means the user's input to the interface of the editing program displayed on the editing screen output through the screen 11 of the terminal 10. The user can click on the interface of the editing program with a mouse or touch with his finger to replace the face of the character included in the editable frame with the user's face, or replace the dialogue of the character included in the editable frame with the new dialogue. have.

The user arbitrarily modified image generating unit 170 generates a user arbitrarily modified image by modifying the allowable frame according to a user's input received by the user input receiving unit 150.

The user randomized video may be any one of a user modified still picture and a user randomized video. The user arbitrarily modified still image includes one correction allowable frame modified according to a user's input.

The user arbitrarily modified video may include at least two correction permission frames modified according to a user's input. The user arbitrarily modified video may be reproduced by sequentially outputting a plurality of modified allowable frames for a predetermined time by the video player. That is, the user arbitrary video may include content that changes over time. It is preferable that the plurality of correction allowable frames included in the user arbitrarily modified video are frames including continuous contents.

The user arbitrarily modified image generator 170 may further receive a frame rate from the user when generating the user arbitrary modified video by combining the modified allowable frame according to the user's input.

Frame rate is an indicator of the number of frames of each frame constituting a user modified video sequentially output every second, the unit of measurement is FPS (Frame Per Second). By appropriately setting the frame rate in the interface of the edit screen, the user can determine the image quality of the user's arbitrary modified video.

The user arbitrarily modified image generator 170 may generate a user arbitrarily modified video by combining the modified allowable frame and the pre-stored image according to the user's input.

The pre-stored image refers to an image previously stored in the terminal 10. The pre-stored image may be any one of a pre-stored still image and a pre-stored video. The pre-stored video may include at least two frames, such as a user modified video. The user arbitrarily modified image generating unit 170 inserts the user arbitrarily modified video in a manner of inserting the pre-stored still image as one frame or a plurality of consecutive frames among the allowable frames modified according to the user's input. Can be generated.

In addition, the user arbitrarily modified image generator 170 generates a user arbitrarily modified video in such a manner as to collectively or separately insert the frames constituting the pre-stored video among the allowable frames modified according to a user input. You may.

If there is no pre-stored image in the terminal 10, the user arbitrary modified image generating unit 170 may operate the camera program of the terminal 10 to induce a user to shoot either a still image or a video.

When the user shoots a still image or a moving image, the captured still image or the moving image may be used to generate a user arbitrary modified moving image.

As an optional embodiment, even if there is already a pre-stored image in the terminal 10, the user shoots a still image or video taken by operating the camera program, and then generates a video of the user to modify the still image or video Can be used to In order to implement the present embodiment, the user arbitrary modification image generation unit 170 may output a screen inquiring whether to operate the camera program through the edit screen before searching for the pre-stored image for the user arbitrary modification image. .

When the specifications of the pre-stored image and the correction allowable frame do not match, the user arbitrary modified image generation unit 170 may convert the pre-stored image into the specification of the correction allowable frame.

As another optional embodiment, the user arbitrary modification image generation unit 170 specifies a portion that can be replaced in the user arbitrary modification image according to the property information of the modified user arbitrary modification image according to the user's input, and the alternative advertisement is possible. The part may be replaced with a pre-stored advertisement item to generate a user-modified image inserted with the advertisement. In the present embodiment, the attribute information of the user modified image may include information on a portion that can be replaced in the user modified image.

More specifically, the attribute information of the user arbitrarily modified image may include location information of pixels constituting a replaceable advertisement portion of the user arbitrarily modified image. The position information of the pixels constituting the substitutable portion is information retained from the attribute information of the correction allowable frame when the correction allowable frame is modified by a user's input to generate a user arbitrarily modified image. In other words, since the attribute information of the correction allowable frame includes position information of pixels constituting a portion capable of replacing advertisements in advance, the correction allowable frame is applied to the attribute information of the user arbitrarily modified image generated by the user's input. Location information of the pixels constituting the alternative advertisement may be included.

For example, it is assumed that the crystal frame includes a character holding a glass bottle containing a drink, and that the glass bottle containing a drink is a part capable of alternative advertisement. In the above example, if the user arbitrary modified image generation unit 170 generates a user arbitrary modified image in which only the face of the character is replaced with the monkey's head in the correctable frame in response to the user's input, the user arbitrary modified image generating unit 170 is still present in the attribute information of the user modified image The location information of the pixels constituting the glass bottle containing the drink remains.

However, in the above example, if the user random modification image generation unit 170 receives a user input and generates a user random modification image in which the glass bottle containing the drink is replaced with a plate containing a cake in the correction allowable frame, the user random modification image The attribute information of may not include the position information of the pixels constituting the possible portion (glass bottle containing the drink) of the alternative advertisement. The user arbitrary modification image generation unit 170 according to the present exemplary embodiment specifies the position information of pixels constituting the glass bottle containing the beverage in the user arbitrary modification image according to the attribute information of the user arbitrary modification image, and the glass containing the beverage. You can replace the bottle with a Coca-Cola vial of coke.

The user arbitrary modified image generated by the user arbitrary modified image generating unit 170 may be stored in the terminal 10 or uploaded to a user's social network service account.

The flowchart illustrated in FIG. 2 includes steps that are processed in time series by the apparatus for generating a user-modified image 100 shown in FIG. 1. Therefore, in describing the flowchart of FIG. 2, even if the content described in FIG. 1 is omitted, the omitted content is applied as it is.

Referring to FIG. 2, in step 210, the frame display unit 110 displays a frame that is preset to allow arbitrary modification among frames included in the image, based on the attribute information of the image output from the contents viewer. do.

In operation 230, the edit screen output unit 130 detects an input for the correction allowable frame and outputs an edit screen for editing the correction allowable frame in which the input is detected.

In operation 250, the user input receiver 150 receives a user input on an edit screen.

In operation 270, the user arbitrarily modified image generation unit 170 generates a user arbitrarily modified image by modifying the correction allowable frame according to a user's input received by the user input receiver 150.

Since the image in the present invention is not limited to the web toon only, even if the image output through the content viewer is a cartoon, a novel, a graphic novel, an animation, or a movie described above, it still does not depart from the scope of the present invention.

3A illustrates an example of a web toon output through a content viewer including a user-modified image generation button 310a in an interface.

Referring to FIG. 3A, it can be seen that the web toon output through the content viewer includes a total of five frames.

The user arbitrarily modified image generation button 310a may be input by a user and display a preset allowable frame to enable arbitrary modification among five frames constituting the web toon.

The content control remote controller 330a may include a menu for providing convenience for the user to view the web toon through the content viewer.

The menu for providing convenience included in the content control remote controller 330a includes a portion for outputting simple information such as a title of the web toon, a subtitle of the web toon, and an end page number of the web toon.

It may include a part for changing the content output from the content viewer according to the user's input, such as the page number of the web toon being output, a list of other web toons, and moving the position within the web toon.

3B is a diagram illustrating an example of a web toon that is output through a content viewer after a user arbitrarily modified image generation button 310b is input by a user.

Referring to FIG. 3B, the web toon output through the content viewer is composed of five frames, and only two frames among the five frames are preset correction allowable frames.

The user arbitrarily modified image generation button 310b is input by the user. The frame display unit 110 detects an input of the user arbitrarily modified image generation button 310b and displays two correction allowable frames.

The outer frame of the first modification allowable frame 330b and the second modification allowable frame 350b is indicated by a dotted line by the frame display unit 110. Since the present invention does not limit a method of distinguishing a corrective frame from other frames by a specific method, the first correctable frame 330b and the second correctable frame 350b may be different from each other by the frame display unit 110. By being indicated by, it can be distinguished from the remaining three frames.

FIG. 3C is a diagram illustrating that the first modification allowable frame 330b illustrated in FIG. 3B is outputted on an edit screen in response to a user input.

3C shows an example of an edit screen operating in the detailed edit mode.

Referring to FIG. 3C, an edit screen for editing a correction allowable frame includes an external image import button 310c, an editing tool menu 320c, an edit target frame 330c, an edited image save button 340c, and an edited image. The upload button 350c and the edit screen close button 360c may be output.

The external image import button 310c may receive an input of a user and import an external image to be overlaid on a frame to be modified. As described with reference to FIG. 1, the external image may be an image stored in the terminal 10 or an image captured by a camera program stored in the terminal 10.

The editing tool menu 320c may provide various tools necessary to overlay the imported external image on the frame to be corrected. The editing tool menu 320c is output only in the edit screen operating in the detailed edit mode.

The editing target frame 330c is a frame including the same content as the frame for allowing modification received by the user and may be edited by the user.

As described with reference to FIG. 1, the editing target frame 330c may be a frame obtained by directly copying a modification allowable frame that receives a user input from a content viewer or may be a high resolution that is pre-stored for editing from a content providing server (not shown). It may be a frame that receives a file. That is, the present invention is not limited to a specific method for how the editing program receives a frame located in place of the editing target frame 330c.

When the edited image storage button 340c is input by the user, the user arbitrary modified image generation unit 170 generates the contents of the edited frame 330c at the time of input as a user arbitrary modified image, and then the terminal 10. Alternatively, the terminal 10 may be stored in a storage device (not shown) connected through a wired or wireless network.

When the edited image upload button 350c is input by the user, the user arbitrary modified image generation unit 170 generates the content of the edited frame 330c at the time of input as the user arbitrary modified image, and then the social network of the user. Upload to service account. The user arbitrarily modified image generator 170 may store information for accessing the social network service providing server through user login information in advance in order to upload the user arbitrarily modified image to the user's social network service account. .

When the edit screen close button 360c is input by the user, the edit screen close button 360c may close the edit screen output through the screen 11 of the terminal 10 and output the video output screen of the content viewer again.

FIG. 4A illustrates a user arbitrarily modified image generating button (hereinafter, referred to as an image generating button of the interface) 410a included in an interface of a content viewer and a user arbitrarily modified image generating button (hereinafter, referred to as an image generating button of a frame) located inside a frame to be edited. A diagram showing an embodiment of the 450a is shown.

The image generation button 410a of the interface is included in the interface of the content viewer, and the frame display 110 may make a special display on the frame to be modified by receiving a user input.

The modification allowable frame 430a is a frame preset to allow arbitrary modification. The image generation button 450a of the frame may be displayed inside the modification allowable frame 430a according to the attribute information of the modification allowable frame 430a.

The image generation button 450a of the frame is located inside the modification allowable frame 430a, and may receive a user input so that the frame display 110 may make a special display on the modification allowable frame so as to be distinguished from other frames.

As an optional embodiment, since the image allowable button 450a of the frame is immediately specified for modification due to the position of the image generation button 450a of the frame, the edit screen output unit 130 is modified by receiving a user input. An edit screen for editing the allowable frame 430a may be output.

4B illustrates another embodiment of an image generation button 410b of an interface and an image generation button 450b of a frame.

The image generation button 410b of the interface is included in the interface of the content viewer, and the frame display unit 110 may make a special display on the frame to be modified by receiving a user input.

The modification allowable frame 430b is a frame preset to allow arbitrary modification. The image generation button 450b of the frame may be displayed inside the modification allowable frame 430b according to the attribute information of the modification allowable frame 430b. In this case, the image generation button 450b of the frame is displayed based on the position of the mouse cursor only when the mouse cursor is positioned inside the frame allowing modification. Recognition of the position of the mouse cursor of the modification allowable frame 430b depends on the attribute information of the modification allowable frame 430b.

The image generation button 450b of the frame is located inside the correction permission frame 430b, and may receive a user input so that the frame display 110 may display a special mark on the correction permission frame so as to be distinguished from other frames.

Since the correction allowable frame 430b is immediately specified due to the position of the image generation button 450a of the frame, the image generation button 450a of the frame receives the user's input so that the edit screen output unit 130 receives the correction allowable frame ( It is also possible to output an edit screen for editing 430b).

Referring to FIG. 4B, while a user views an image through a content viewer, the user makes a special display on the modification allowable frame 430b without moving the mouse cursor and presses the image generation button 410b of the interface, or the modification allowable frame 430b. You can output the edit screen for editing).

4C is a diagram illustrating an embodiment of a user arbitrarily modified image generation button setting unit 410c and an image generation button 450c of a frame output to the content viewer.

The user arbitrarily modified image generation button setting unit 410c may set whether to automatically display the image generation button 450c of the frame on the modification allowable frame 430c.

If the user arbitrarily modified image generation button setting unit 410c is set to automatically display (ON) the image generation button 450c of the frame on the correction allowable frame 430c by the user's input, the image generation button of the frame 450c may be located inside the correction permission frame 430c, and may receive a user's input so that the frame display 110 may display a special mark on the correction permission frame so as to be distinguished from other frames.

According to an exemplary embodiment, since the image for editing button 450c of the frame is directly specified by the position of the image generating button 450c of the frame, the correction allowable frame 430c may be specified, thereby receiving an input of the user, thereby displaying the edit screen output unit 130. ) May output an edit screen for editing the modification allowable frame 430c.

If the user arbitrarily modified image generation button setting unit 410c is set to not automatically displaying (OFF) the image generation button 450c of the frame on the correction allowable frame 430c according to a user's input, Only when the cursor is positioned inside the correction permission frame 430c, the image generation button 450c of the frame may be displayed centering on the position of the mouse cursor.

Referring to FIG. 5, the edit screen operating in the simple edit mode may include an edit target frame 510, a speech balloon metabolic input field 520, a replacement face setting field 530, and an edit mode change button 540. .

The editing target frame 510 is a frame including the same content as the frame for allowing modification received by the user and may be edited by the user.

The editing target frame 510 includes a speech bubble 510a and a replacement face 510b. The speech bubble column 510a is a portion into which the dialogue of the character included in the editing target frame 510 is inserted, and the dialogue input by the user may be inserted.

The replacement face 510b is a part into which the face of the character included in the editing target frame 510 is inserted, and an image loaded by the user may be inserted.

The speech balloon metabolic input field 520 may insert the character received from the user into the speech bubble column 510a as a dialogue of the character.

The replacement face setting column 530 may insert an image received from the user into the replacement face 510b as the character's face.

The edit mode change button 540 switches the edit screen operating in the simple edit mode to the detailed edit mode. In the edit screen operating in the detailed editing mode, the user can modify not only the dialogue and the face of the character included in the editing target frame 510, but also the drinking water bottle and the hairstyle of the character.

As described above, the user may edit the edit target frame 510 using the edit screen operating in the simple edit mode, so that the user arbitrary modification image generation unit 170 may generate the user arbitrary modification image more quickly and easily. .

Referring to FIG. 6, an edit screen when an image output through a content viewer is a video includes an edit target frame 610, an external image import button 620, an instant image generation button 630, and an image playback speed setting column ( 640, an edit mode change button 650, and a frame order display bar 660.

The editing target frame 610 is a frame including the same content as the frame for allowing modification received by the user and may be edited by the user.

Referring to FIG. 6, the edit target frame 610 includes a total of 95 allowable frames.

The external image import button 620 may import an external image to be overwritten or inserted into a frame allowing modification by receiving a user input. As described with reference to FIG. 1, the external image may be an image stored in the terminal 10 or an image captured by a camera program stored in the terminal 10.

The external image import button 620 may include an area for selecting an external image standard change setting option for automatically changing the external image standard. If the external image standard change setting is turned on in the external image standard change setting option, the external image may be automatically changed to match the standard of the frame to be edited. If the external image standard change setting is turned OFF in the external image standard change setting option, the external image may be called while maintaining a unique standard according to the attribute information of the external image.

The external image import button 620 may include an area for selecting an external image size change setting option for automatically changing the size of the external image. If the external image resizing setting is turned on in the external image resizing setting option, the external image may be automatically resized according to the size of the frame to be edited. If the external image resizing setting is turned off in the external image resizing setting option (OFF), the external image may be called with its own size according to the property information of the external image.

The instant image generation button 630 drives a camera program that can generate an image immediately upon receiving a user input. The instant image generation button 630 may be activated when the camera is connected to the terminal 10 through a wired or wireless network. The user may use the still image or the moving image photographed by operating the camera program to generate the user's arbitrary modified moving image.

The video play rate setting field 640 may adjust the frame rate of the video when the user randomized video generator 170 generates a user-modified video that changes over time by combining edited editable frames. To be.

The edit mode change button 650 switches the edit screen operating in the detailed edit mode to the simple edit mode.

The frame order display bar 660 displays the order of frames included in the edit target frame 610 and may include a current frame display beacon 661 and an external image insertion display beacon 663.

The current frame display beacon 661 displays the number of frames when the editing target frame 610 composed of a plurality of correction allowable frames is composed of a moving picture. Referring to FIG. 6, the modification allowable frame included in the edit target frame 610 is a fourth frame.

The external image insertion display beacon 663 may intuitively display the external image inserted in the entire editing target frame 610 by the user on the frame order display bar 660. Referring to the external image insertion display beacon 663 of FIG. 6, it can be seen that the external image inserted into the entire editing target frame 610 by the user includes 25 frames.

6, the user inserts 25 frames in the middle of a video including 95 editable frames through an edit screen, and the user randomly edited image generator 170 includes 120 images. It can be understood that the user arbitrarily generated video.

FIG. 7A illustrates an edit screen for generating a user-modified video inserted with an advertisement.

Referring to FIG. 7A, an edit screen for generating a user-modified video inserted with an advertisement includes an edit target frame 710a, an external image import button 720a, a general save button 730a, and an advertisement insertion save button 740a. ) May be included.

The editing target frame 710a is a frame including the same contents as the frame to be edited by the user and may be edited by the user.

Referring to FIG. 7A, the editing target frame 710a is composed of a single frame to allow modification, and contains a content of a male character holding a beverage bottle talking through two speech bubbles. The external image import button 720a may import an external image to be overwritten or inserted into a frame allowing modification by receiving a user input.

When the general save button 730a is input by the user, the user arbitrary modified image generating unit 170 generates the content of the edit target frame 710a at the time when the general save button 730a is input as the user random modified image. Thereafter, the terminal 10 or the terminal 10 may be stored in a storage device (not shown) connected through a wired or wireless network.

When the advertisement insertion save button 740a is input by the user, the user arbitrary modified image generation unit 170 may replace the advertisement in the contents of the edit target frame 710a at the time when the advertisement insertion save button 740a is input. By inserting a replacement advertisement in the user can generate a user-modified image inserted with the advertisement.

By utilizing the contents of FIG. 7A, a member who uses a user-modified video generation service for a fee activates the general storage button 730a as a premium service, and a member inserts a save advertisement insertion button ( 740a may be activated to induce payment of the user. In addition, the alternative advertisement is inserted into the frame, there is an advantage that the basis for recruiting advertisers of PPL (Product PLacement) can be created.

FIG. 7B is a diagram illustrating an example of a user arbitrarily modified image in which an advertisement is inserted.

FIG. 7B is a still image of a user inserted with an advertisement, which is a still image, and contains a character of a male character holding a Coca-Cola bottle talking through two speech bubbles.

7b is compared with FIG. 7a, it can be understood that other parts except the beverage bottle, which was a possible part of the replacement advertisement, were replaced with Coca-Cola bottles, which contained the same contents.

Embodiments according to the present invention described above may be implemented in the form of a computer program that can be executed through various components on a computer, such a computer program may be recorded in a computer-readable medium. At this time, the media may be magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and ROMs. Hardware devices specifically configured to store and execute program instructions, such as memory, RAM, flash memory, and the like. Furthermore, the medium may include an intangible medium implemented in a form that can be transmitted on a network. For example, the medium may be a form of a software or an application that can be transmitted and distributed through a network.

On the other hand, the computer program may be specially designed and configured for the present invention, or may be known and available to those skilled in the computer software field. Examples of computer programs may include not only machine code generated by a compiler, but also high-level language code executable by a computer using an interpreter or the like.

Particular implementations described in the present invention are embodiments and do not limit the scope of the present invention in any way. For brevity of description, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connection or connection members of the lines between the components shown in the drawings by way of example shows a functional connection and / or physical or circuit connections, in the actual device replaceable or additional various functional connections, physical It may be represented as a connection, or circuit connections. In addition, unless specifically mentioned, such as "essential", "important" may not be a necessary component for the application of the present invention.

In the specification (particularly in the claims) of the present invention, the use of the term “above” and similar indicating terms may correspond to both singular and plural. In addition, in the present invention, when the range is described, it includes the invention to which the individual values belonging to the range are applied (if not stated to the contrary), and each individual value constituting the range is described in the detailed description of the invention. Same as Finally, if there is no explicit order or contrary to the steps constituting the method according to the invention, the steps may be performed in a suitable order. The present invention is not necessarily limited to the description order of the above steps. The use of all examples or exemplary terms (eg, etc.) in the present invention is merely for the purpose of describing the present invention in detail, and the scope of the present invention is limited by the examples or exemplary terms unless defined by the claims. It doesn't happen. In addition, one of ordinary skill in the art appreciates that various modifications, combinations and changes can be made depending on design conditions and factors within the scope of the appended claims or equivalents thereof.

An operator providing a web toon can apply the above-described embodiments of the present invention to produce and implement an application for providing a web toon to a user.

Claims

In the method for generating a user-modified image using the interface of the content viewer (output viewer) for outputting the image,

A frame display step of displaying a modification allowable frame preset to enable arbitrary modification among frames included in the image based on attribute information of the image;

An editing screen output step of detecting an input for the correction allowable frame and outputting an edit screen for editing the correction allowable frame detected by the input;

A user input receiving step of receiving a user input on the edit screen; And

And generating a user arbitrary modified image by modifying the corrected frame according to the user input.
The method of claim 1, wherein the modification allowable frame,

And a predetermined frame from the copyright holder of the image.
The method of claim 1, wherein the image,

Method for generating a user-modified image, characterized in that at least one of a still image and a video.
The method of claim 1, wherein

And a button input sensing step of sensing an input for a user arbitrary modified image generation button included in the interface.

In the frame displaying step, when the input of the button is detected, the modification-allowed frame is generated.
The method of claim 4, wherein the user arbitrarily modified image generation button,

And a method for generating a user-modified image, wherein the image viewer is located in an interface of the content viewer and the frame for allowing modification.
The method of claim 1, wherein the image is a web toon,

The edit screen output step,

Displaying a border on a speech bubble in which the dialogue of the character of the web toon is input, and outputting an edit screen for editing the contents included in the border according to the attribute information of the editable frame in which the input is detected. Characterized in that the user random image generation method.
The method of claim 1, wherein the image is a web toon,

The edit screen output step,

And displaying a border on the face of the character of the web toon in the frame and outputting an edit screen for editing the contents included in the border according to the property information of the editable frame in which the input is detected. How to create a user modified image.
The method of claim 1, wherein the video is a video,

The modification allowable frame includes a plurality of consecutive frames,

The user random image generation step,

And modifying the correction allowable frame according to the user's input to generate a user's arbitrary modified video that changes with time.
The method of claim 1, wherein the video is a video,

The user random image generation step,

And modifying the allowable frame according to the user's input, and combining the modified frame and the pre-stored image to generate a user's arbitrary modified video that changes with time.
The method of claim 1, wherein the generating of the user modified image is:

Specify a possible portion of the replacement advertisement in the user modified image in accordance with the attribute information of the correction allowable frame,

And generating a user-modified image in which an advertisement is inserted by replacing a portion in which the substitute advertisement is possible with a pre-stored advertisement item.
A computer-readable recording medium having recorded thereon a program for executing the method according to any one of claims 1 to 10.
In the device for generating a user-modified image using an interface of the content viewer (output viewer) for outputting the image,

A frame display unit displaying a modification allowable frame preset to enable arbitrary modification among frames included in the image based on the attribute information of the image;

An edit screen output unit for detecting an input for the correction allowable frame and outputting an edit screen for editing the correction allowable frame detected by the input;

A user input receiver configured to receive a user input on the edit screen; And

And a user arbitrary image modification unit configured to generate a user arbitrary modified image by modifying the correction allowable frame according to the user's input.
The method of claim 12, wherein the modification allowable frame,

Device for generating a user-modified image, characterized in that the predetermined frame from the copyright holder of the image
The method of claim 12, wherein the image,

Device for generating a user modified image, characterized in that at least one of a still image and a video.
The method of claim 12, wherein the device,

Further comprising a button input detection unit for detecting an input for the user arbitrary modified image generation button included in the interface,

And the frame display unit displays the correction allowable frame when an input to the button is detected.
The method of claim 15, wherein the user randomly generated image generation button,

And a user-modified image generation device, characterized in that located in the interface of the content viewer and the correction allowable frame.
The method of claim 12, wherein the image is a web toon,

The edit screen output unit,

Displaying a border on a speech bubble in which the dialogue of the character of the web toon is input, and outputting an edit screen for editing the contents included in the border according to the attribute information of the editable frame in which the input is detected. Characterized in that the user arbitrary modified image generating device.
The method of claim 12, wherein the image is a web toon,

The edit screen output unit,

And displaying a border on the face of the character of the web toon in the frame and outputting an edit screen for editing the contents included in the border according to the property information of the editable frame in which the input is detected. User arbitrary modified image generating device.
The method of claim 12, wherein the video is a video,

The modification allowable frame includes a plurality of consecutive frames,

The user arbitrary modified image generating unit,

The apparatus for generating a user-modified image according to the user's input by modifying the correction allowable frame to generate a user-modified video that changes over time.
The method of claim 12, wherein the video is a video,

The user arbitrary modified image generating unit,

And modifying the allowable frame according to the user's input, and combining the modified frame and the pre-stored image to generate a user's arbitrary modified video that changes over time.
The method of claim 12, wherein the user arbitrary image modification unit,

Specifying a possible portion of the replacement advertisement in the user modified image according to the attribute information of the user modified image,

And a user's arbitrary modified image into which an advertisement is inserted, by replacing a portion of the replaceable advertisement with a pre-stored advertisement item.