KR20220017068A - Methods for automatic generation and transformation of artificial intelligence content - Google Patents

Abstract

An automatic artificial intelligence content generating and transforming method is provided. To generate one-person content, which is increasing in recent years, the method allows a user to use artificial intelligence to process an image and a natural language in the image and text and extract and analyze metadata without help of a separate expert or tool in manufacturing a creative work, thereby automatically generating and transforming dynamic content, sketch-based image content, and illustrated content.

Description

Methods for automatic generation and transformation of artificial intelligence content

The present invention relates to a method for automatically generating and transforming artificial intelligence content, and more particularly, when a user creates a creative work, image processing and natural language are processed using artificial intelligence without the help of a separate expert or tool, and metadata is stored It relates to a method for extracting and analyzing to automatically generate content.

In the past, creation has been continued for a long time as the domain of experts, but it is expanding into the domain of fortune-telling individuals due to the development of information and communication technology, improvement of communication performance, and changes in content consumption culture.

Recently, the creative method is expanding to content with short but witty and connotative contents, such as vlogs using photos and videos, that is, a combination of video and blogs, webtoons, emoticons, and moving pictures. It is a trend that is being produced as content that can be shared and shared with one another.

In addition, with the spread of various social network service (SNS) platforms, unlike in the past, it has expanded to a one-person creative field, and an era has arrived where anyone can become a content producer through SNS platforms, such as game broadcasting and vlogs.

However, in order to create content, users have to go through all the processes from idea to sketch, image search, and editing themselves. It should be entrusted to a professional who can use the . However, it is difficult for general users who do not have professional training in these fields to use a professional editor, and the cost can come as a burden.

In addition, even if a professional editor is used, it takes a lot of time to produce the final content, and especially in the case of a video, the amount of work is very high because image frames need to be edited and then stitched together.

Unexamined Patent Publication No. 10-2019-0035502

In order to solve the above problems, an object of the present invention is to extract metadata of images and texts by inputting specific images and texts in content production or by analyzing texts input on SNS platforms based on artificial intelligence. And, by creating dynamic content, sketch-based image content, and illustration content through the extracted metadata, content with high perfection from the idea level is automatically created to support the creation of non-professionals, and high-quality content can be produced at low cost and time. is to make

The problems to be solved of the present invention are not limited to those mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

As a means for solving the above technical problem, according to an embodiment of the present invention, the method for automatically generating and transforming artificial intelligence content includes: (a) inputting text and images related to content to be generated by a user for content creation; ; (b) analyzing the metadata of the text input by the user and the image data input by the user based on artificial intelligence and recording the text metadata and image metadata, respectively; and (c) generating at least one creation of dynamic content, sketch-based image content, and illustration content by using the recorded metadata.

The image input by the user includes any one or more of a static image including a main object and a background, a sketch image created by the user, and an illustration image to convert an atmosphere, and the user inputs or An image uploaded or downloaded by the user on a social platform linked with the user terminal.

In the step (b), text analysis based on artificial intelligence for the text input by the user, paragraph analysis with multiple compound sentences, extracting the most important sentence among paragraph analysis, and complex analysis of multiple sentences a text analysis step of analyzing and extracting action information, object information, background information, emotion of writing, and atmosphere of writing to generate metadata and recording it as text metadata in a database according to a predetermined format; and separating the background and foreground of the image based on artificial intelligence with respect to the image input by the user, and analyzing the image of a person's whole body, human face, animal, character, etc. in the image to obtain background and foreground information and object feature points and an image analysis step of extracting and generating metadata and recording it as image metadata in a database according to a predetermined format.

In the image analysis step, if there is no image input by the user, an image related to the text metadata is detected from among images stored in a user terminal or uploaded by the user on a social platform linked to the user terminal or images stored in a database Separates the background and foreground of the detected image, analyzes the whole body of a person, a human face, an animal, a character, etc. in the image to extract background and foreground information and feature points of the object to generate metadata in a predetermined format according to the image metadata in the database.

In the step (c), when the image input by the user is a static image including a main object and a background, the motion of the background in the image metadata is moved according to the general action of the background or the atmosphere indicated in the text metadata. Create a background motion that changes to a dynamic image; and object motion generation for changing the body motion, facial expression, etc. of the object in the image metadata into a dynamic image to move according to the general action of the object or action information indicated in the text metadata; Dynamic content is created through one or more of these.

In step (c), when the image input by the user is a sketch image created by the user, the style change of changing the body motion, facial expression, etc. of the sketch among the image metadata according to the atmosphere and style shown in the text metadata. ; and a color change for changing the color of a part of the sketch among the image metadata according to text metadata or a user's selection. Sketch-based image content is created through one or more of these.

In the step (c), when the image input by the user is an illustration image to change the atmosphere, the background and the object in the image metadata are changed according to the atmosphere and the style indicated in the text metadata; and graphic overlays for changing the graphic effects of backgrounds and objects among image metadata according to the atmosphere and style shown in the text metadata; Through one or more of the above, the illustration content is generated.

When the creation created in step (c) is sketch-based image content or illustration content, after step (c), steps (b) and (c) are further performed, but in step (b) The image input by the user is the created creation, and in step (c), the background motion of the image metadata is changed to a dynamic image to move according to the general action of the background or the atmosphere indicated in the text metadata. motion generation; and object motion generation for changing the body motion, facial expression, etc. of the object in the image metadata into a dynamic image to move according to the general action of the object or action information indicated in the text metadata; Dynamic content is created through one or more of these.

Meanwhile, according to another embodiment of the present invention, a method for automatically generating and transforming artificial intelligence content includes the steps of: (a) inputting text and images related to content to be generated by a user for content creation; (b) based on artificial intelligence, the text input by the user through the input means of the user terminal or stored in the user terminal, the text inputted through the input means of the user terminal on the social platform interlocked with the user terminal, or the user terminal Analyzing the metadata of the text included in the image uploaded or downloaded by the user and the image data input by the user on a social platform linked with the user and recording the metadata as text metadata and image metadata, respectively; and (c) generating at least one creation of dynamic content, sketch-based image content, and illustration content by using the recorded metadata.

According to the present invention,

In content creation, input specific images and texts or text input on SNS platforms are analyzed based on artificial intelligence to extract image and text metadata, and dynamic content, sketch-based image content, and By automatically creating content from an idea level to a high-quality content by creating illustration content, it is possible to support the creation of non-professionals, and to produce high-quality content at low cost and time.

Effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is an exemplary diagram showing the main functions of the method for automatically generating and transforming artificial intelligence content according to an embodiment of the present invention;
2 is a flowchart of a method for automatically generating and transforming artificial intelligence content according to an embodiment of the present invention;
3 is a flowchart of a method for automatically generating and transforming artificial intelligence content according to an embodiment of the present invention;
4 is a flowchart of a method for automatically generating and transforming artificial intelligence content according to an embodiment of generating dynamic content of the present invention;
5 is a flowchart of a method for automatically generating and transforming artificial intelligence content according to an embodiment of the present invention for generating sketch-based image content;
6 is a flowchart of an artificial intelligence content automatic creation and transformation method according to an embodiment of the present invention for generating illustration content;
7 is a flowchart of a method for automatically generating and transforming artificial intelligence content according to an embodiment of generating sketch-based dynamic content of the present invention;
8 is a flowchart of a method for automatically generating and transforming artificial intelligence content according to an embodiment of generating dynamic illustration content of the present invention.

The above objects, other objects, features and advantages of the present invention will be easily understood through the following preferred embodiments in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments described herein and may be embodied in other forms. Rather, the embodiments introduced herein are provided so that the disclosed content may be thorough and complete, and the spirit of the present invention may be sufficiently conveyed to those skilled in the art.

In this specification, when terms such as first, second, etc. are used to describe components, these components should not be limited by these terms. These terms are only used to distinguish one component from another. The embodiments described and illustrated herein also include complementary embodiments thereof.

Further, when it is stated that any element, component, device, or system includes a component consisting of a program or software, even if not explicitly stated, that element, component, device, or system means that the program or software is executed. Alternatively, it should be understood to include hardware (eg, memory, CPU, etc.) necessary for operation or other programs or software (eg, drivers necessary for operating an operating system or hardware, etc.).

In addition, the terms used herein are for the purpose of describing the embodiments and are not intended to limit the present invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, the terms 'comprises' and/or 'comprising' do not exclude the presence or addition of one or more other components.

In addition, the '... wealth', '… Terms such as 'group' and 'module' mean a unit that processes at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software. In addition, articles such as 'a', 'a' and 'the' in the context of describing the present invention include both the singular and the plural unless otherwise indicated herein or clearly contradicted by the context in the context of describing the present invention. can be used

In describing the specific embodiments below, various specific contents have been prepared to more specifically describe the invention and help understanding. However, a reader having enough knowledge in this field to understand the present invention may recognize that the present invention may be used without these various specific details.

In some cases, it is mentioned in advance that parts that are commonly known and not largely related to the invention are not described in order to avoid confusion without any reason in describing the present invention in describing the invention.

Hereinafter, specific technical contents to be practiced in the present invention will be described in detail with reference to the accompanying drawings.

1 is an exemplary diagram illustrating main functions of a method for automatically generating and transforming artificial intelligence content according to an embodiment of the present invention.

1 , the method for automatically generating and transforming artificial intelligence content according to an embodiment of the present invention is mainly to have an automatic authoring function based on AI by analyzing metadata of text and images based on AI. do.

Here, metadata analysis extracts metadata based on text analysis to extract metadata such as object/background information, action information, and text emotion/atmosphere. Through this, key points such as human body motion, facial expression, and animal motion are extracted.

In addition, the automatic authoring function can be largely divided into three types: automatic creation of dynamic content, automatic creation of sketch-based characters, and automatic conversion of emotion-based illustrations.

Here, the dynamic content automatic generation can generate dynamic content with moving background by selecting a background from an image and generating a sequence of background motion through neural net-based prediction. By creating a sequence of object actions, you can create dynamic content in which objects move.

You can also of course create dynamic content in which both the background and the object move.

Here, in the automatic sketch-based character creation, when a user inputs a created sketch, a character model, a similar live-action image, etc. can be created through neural net-based transformation.

Here, the emotion-based illustration automatic conversion can change the input image into a style suitable for the atmosphere by converting the input image based on the neural net according to the atmosphere of the text detected in the input text, and change the input image to the atmosphere of the text detected in the input text. Accordingly, the image can be changed to a graphic effect suitable for the atmosphere through neural net-based effect selection and overlay.

Hereinafter, an embodiment of a method for automatically generating and transforming artificial intelligence content according to an embodiment of the present invention is shown.

2 is a flowchart of a method for automatically generating and transforming artificial intelligence content according to an embodiment of the present invention.

Referring to FIG. 2 , the method for automatically generating and transforming artificial intelligence content according to an embodiment of the present invention includes the steps of a user inputting text and images (S100), analyzing and recording artificial intelligence-based metadata (S200), and a creation and generating (S300).

In the inputting step ( S100 ), the user inputs text and images related to content to be created for content creation.

Here, the text input by the user may be a text input by the user directly through the input means of the user terminal, text stored in the user terminal, or text inputted through the input means of the user terminal on a social platform such as SNS linked to the user terminal, , or it may be text included in an image uploaded or downloaded by a user on a social platform such as SNS linked with such a user terminal.

Accordingly, such text may be a blog post written by a user, etc., a sentence used in a messenger conversation, or an article included in an e-book.

Here, the image entered by the user is a static image including the main object and background to create dynamic content, a sketch image created by the user to create sketch-based image content, and an artwork to transform the atmosphere to create the illustration content It may be any one or more of images.

These images may also include images that the user directly inputs through the input means of the user terminal or stored in the user terminal, images uploaded or downloaded by the user on social platforms such as SNS linked to the user terminal, and the like.

Accordingly, such an image may be a picture stored in the user terminal.

3 is a flowchart of a method for automatically generating and transforming artificial intelligence content according to an embodiment of the present invention.

3 is a detailed description of the step (S200) of analyzing and recording the metadata of FIG. 2 .

Here, in the step of analyzing and recording the metadata ( S200 ), based on artificial intelligence, the metadata of the text input by the user and the image data input by the user are analyzed and recorded as text metadata and image metadata, respectively.

Here, the step (S200) of analyzing and recording the metadata may include a text analysis step (S221) of analyzing the metadata of the text, and an image analysis step (S222) of analyzing the metadata of the image.

Here, in the text analysis step (S221), a sentence analysis based on artificial intelligence for the text input by the user, a paragraph analysis with several compound sentences, extracting the most important sentence among paragraph analysis, complex analysis of several sentences, etc. Through text analysis, metadata can be created by extracting action information, object information, background information, the emotion of the text, and the mood of the text.

Here, in the image analysis step (S222), the background and foreground of the image are separated based on artificial intelligence with respect to the image input by the user, and the whole body of a person, a human face, an animal, a character, a sketch, an illustration, etc. in the image are imaged. Metadata can be generated by analyzing and extracting background and foreground information and feature points of objects.

Here, the feature point of the object may be a body motion, a pose or facial expression, and the shape of the eyes, nose, and mouth in the face.

However, in the metadata analysis and recording step (S200), it is first checked whether image data exists among the data input by the user in the input step (S100) (S210), and if there is an input image among the input data, the AI-based The text/image metadata analysis step (S220), that is, the text analysis step (S221) and the image analysis step (S222) proceeds as it is.

However, if there is no input image, the metadata of the input text is first analyzed based on artificial intelligence (S211), and an image matching the input text is searched from the database according to the object and background information derived from the analysis result. The AI-based text/image metadata analysis step (S220), that is, the text analysis step (S221) and the image analysis step (S222) is performed by saving (S212), searching and viewing the saved image as the image input by the user.

That is, the text analysis step (S221) proceeds regardless of the presence or absence of an image, and if there is no image, the image analysis step (S222) proceeds based on the image loaded from the database according to the result of the metadata analyzed in the text analysis step (S221) do.

Here, you will have to collect images that do not have copyright issues in the database.

Here, information such as objects, backgrounds, and atmospheres collected in the database may be tagged.

Here, in the text analysis step S221 and the image analysis step S222 , the generated metadata may be recorded in the database as text metadata and image metadata, respectively, according to a predetermined format.

4 is a flowchart of a method for automatically generating and transforming artificial intelligence content according to an embodiment of generating dynamic content of the present invention.

4 is a detailed description of the creative creation step (S300) of FIG.

4 illustrates a case in which dynamic content is generated among creations.

Referring to FIG. 4 , a video is generated based on an image according to the metadata analyzed in the metadata analysis step S200 ( S300 ).

First, the background and the object are separated based on the image metadata.

Here, the background may be separated according to foreground separation information and object/background information among image metadata.

Here, the motion of the separated background is changed to a dynamic image to move according to the general action of the background or action information shown in the text metadata, the emotion of the text, and the atmosphere of the text to generate a background motion video (background motion) (S311) .

Here, the object may be divided according to action information and feature point information among image metadata.

Here, the body motion, facial expression, etc. of the separated object are changed to a dynamic image to move according to the general action of the object or the action information shown in the text metadata, the emotion of the text, and the atmosphere of the text, so that the object motion video (object motion) is generated. generated (S312).

Both of the background motion generation ( S311 ) and the object motion generation ( S312 ) may be performed or only one of them may be performed.

Through this generation process, dynamic content may be generated from the image (S313).

Accordingly, if you want to create a dynamic image suitable for an article analyzed in a messenger or e-book, etc., a motion video may be generated through the object of the article, the background of the article, action information, etc. displayed in the text metadata.

For example, if you input “I skipped the rope today” in the messenger (S100), the action information of “jumping the rope” is extracted from the text and recorded as text metadata (S211), and the user's photo in the user's cell phone storage space is recorded (S211). It can be called (S212) to create a video of jumping rope motion (S313).

Also, for example, a picture (image) and content (text) of a children's book are extracted from a children's book (e-book) (S100), and object information is extracted from the text (S220) to generate a moving picture of the object in the picture ( S313) can be done.

5 is a flowchart of a method for automatically generating and transforming artificial intelligence content according to an embodiment of the present invention for generating sketch-based image content.

5 is a detailed description of the step (S300) of creating a creative work of FIG.

5 illustrates a case of generating sketch-based image content among creations.

Referring to FIG. 5 , a sketch-based image is generated based on the sketch image according to the metadata analyzed in the metadata analysis step ( S200 ) ( S320 ).

In the embodiment of the present invention, when an image is not input, a step (S212) of loading an image from a database based on text metadata is usually included. Referring to FIG. 5 , this step is omitted in creating a sketch-based image can do.

This is because a user's sketch image is usually input to generate a sketch-based image.

However, even in the sketch-based image creation, the steps S211 and S212 in the case of not inputting an image are not completely excluded.

It can be changed to an image or character by receiving the user's sketch as input and fusion with the object information of the text.

Referring to FIG. 5 , when the image input by the user is a sketch image created by the user, after the AI-based metadata analysis and recording step (S200), the body motion, facial expression, and eyes, nose, and mouth of the sketch among the image metadata are analyzed. With reference to a shape, etc., a style change ( S321 ) of changing an image according to a style selected by a user or an atmosphere or style shown in text metadata may be performed ( S321 ).

In addition, after the AI-based metadata analysis and recording step (S200), a color change (S322) of changing the color of a part of the sketch among the image metadata according to the color selected by the user or the content shown in the text metadata may be performed. have.

Both the style change ( S321 ) and the color change ( S322 ) may be performed or only one of them may be performed.

Through this generation process, sketch-based image content may be generated from the sketch image (S323).

The sketch-based image content generated here is an object image related to a sketch, and the image may be similar to a real-life image or may be an image of various styles such as a cartoonized image. can

In addition, the desired drawing body can be selected by the user or automatically selected and reflected from the atmosphere of the text detected from the text, and it is possible to make more accurate changes by inferring what object the sketch is about from the text.

6 is a flowchart of a method for automatically generating and transforming artificial intelligence content according to an embodiment of generating illustration content of the present invention.

6 is a detailed description of the step (S300) of creating a creative work of FIG.

6 illustrates a case in which illustration content is generated among creations.

Referring to FIG. 6 , artwork content is generated based on the artwork image according to the metadata analyzed in the metadata analysis step ( S200 ) ( S330 ).

In this way, if you want to add an image suitable for a blog post, etc., you can change the style of the text or add graphic effects to the image input by the user or the image loaded from the database according to the emotion of the text among the text metadata.

Referring to FIG. 6 , if the image input by the user is an illustration image to change the atmosphere, the user selects the background and object of the illustration image among the image metadata after the AI-based metadata analysis and recording step (S200) A style change ( S331 ) of changing the image according to the style, style, or the like indicated in the style or text metadata may be performed.

In addition, after the AI-based metadata analysis and recording step (S200), the graphic effect of the background and object of the illustration image among the image metadata is changed according to the graphic effect selected by the user or the atmosphere, style, and foreground separation information shown in the text metadata. A graphic overlay (S332) may be performed.

Both the style change ( S331 ) and the graphic overlay ( S332 ) may be performed, or only one of them may be performed.

Through this generation process, the changed illustration content may be generated from the illustration image (S333).

As such, by detecting the atmosphere of the writing from the text, the emotion-based illustration is automatically converted (S331) in which the style of the image is changed according to the atmosphere.

In this case, the image may be an image retrieved from a database searched from an image input by the user or background/object information detected from text.

By selecting the dynamic graphic effect of the illustration according to the emotion, it can be overlaid on the entire image or main object (S332).

Also, in the creation step (S300), the automatic creation of dynamic content (S310), the automatic creation of a sketch-based image (S320), and the automatic conversion of an emotion-based illustration (S330) may be sequentially connected.

That is, after creating an image with a sketch, a moving image can be created by applying motion to the object.

You can also change the style of an illustration and create a video that gives a flowing effect to the background of the illustration.

7 is a flowchart of a method for automatically generating and transforming artificial intelligence content according to an embodiment of the present invention for generating sketch-based dynamic content.

FIG. 7 is a case in which sketch-based dynamic content is generated by analyzing text and image metadata again with respect to the sketch-based image generated in FIG. 5 .

Referring to FIG. 7 , after automatically generating a sketch-based image through sketch image and text metadata (S320), the metadata of the text and sketch-based image is analyzed again (S410) to give motion to the background and object (S411) , S412), and sketch-based dynamic content may be created (S413).

Here, the step (S410) of re-analyzing the metadata is the same as the step (S200) of analyzing and recording the metadata based on artificial intelligence, except that the sketch-based image content generated in the previous step instead of the image input by the user metadata is analyzed.

Here, the step (S413) of generating the sketch-based dynamic content is the same as the step (S310) of generating the dynamic content, and a background motion video of the sketch-based image content is generated (S411), and an object motion video is generated (S412) )can do.

Here, the background motion video generation ( S411 ) is performed in the same manner as the background motion video generation ( S311 ) in the dynamic content creation step ( S310 ).

Here, the object motion video generation (S412) is performed in the same manner as the object motion video generation (S312) in the dynamic content generation step (S310).

As a result, sketch-based dynamic content is generated (S413).

Here, for a sketch-based image, only image metadata is analyzed (S410) or background motion (S411) and/or object motion (S412) with previously stored metadata without going through text and image metadata analysis again (S410) to create sketch-based dynamic content (S413).

8 is a flowchart of a method for automatically generating and transforming artificial intelligence content according to an embodiment of generating dynamic illustration content of the present invention.

FIG. 8 is a case in which dynamic illustration content is generated by analyzing text and image metadata again for the illustration image generated in FIG. 6 .

Referring to FIG. 8, after automatically generating an illustration image changed through the illustration image and text metadata (S333), the metadata of the text and illustration image is analyzed again (S420) to give motion to the background and object (S421, S422), it is possible to create a dynamic illustration content (S423).

Here, the step of re-analyzing the metadata (S420) is the same as the step (S200) of analyzing and recording the metadata based on artificial intelligence, except that instead of the image input by the user, the illustration image content generated in the previous step is metadata is analyzed.

Here, the step (S423) of generating the dynamic illustration content is the same as the step (S310) of generating the dynamic content, and the background motion video of the illustration image content is generated (S421), and the object motion video is generated (S422). can

Here, the background motion video generation (S421) is performed in the same manner as the background motion video generation (S311) in the dynamic content generation step (S310).

Here, the object motion video generation (S422) is performed in the same manner as the object motion video generation (S312) in the dynamic content generation step (S310).

As a result, dynamic illustration content is generated (S423).

In addition, automatic creation of dynamic content (S310), automatic creation of sketch-based images (S320), and automatic conversion of emotion-based illustrations (S330) may be sequentially connected to create a final creation.

Here, background motion (S421) and/or object motion (S422) with previously stored metadata without analyzing only image metadata for illustration content (S420) or analyzing text and image metadata again (S420) It is also possible to generate dynamic illustration content by creating (S423).

Afterwards, the user can make detailed corrections through the user's editing.

Here, users can calibrate dynamic content, sketch-based image content, illustration content, etc. using the timeline, multi-layer function, etc.

Here, the user can add, delete, and change motion elements of background motion and object motion, as well as separate images or text, using functions such as timeline and multi-layer provided by the service providing server for the generated dynamic content. The final work can be created by adding new elements, deleting the background, and editing all or part of the object.

Here, the user may confirm the generated dynamic content as a final work without correction.

After that, the created work can be directly uploaded to SNS, etc. or linked so that it can be transmitted via messenger.

Here, you can save the work in a format that is easy to upload.

Here, storing the final work in a form that is easy to upload to a social platform linked with the user terminal, etc., and directly uploading the final work to the social platform or the like, or linking the user terminal to a network may include interworking with a network.

Here, the user can distribute and use the final work through SNS, etc.

Here, each of these steps may be installed and operated on a user's PC or the like or may be operated on a web-based basis.

It can also be operated on the user's PC or mobile.

Above, the embodiment of the present invention is not implemented only through the above-described apparatus and/or operation method, but through a program for realizing a function corresponding to the configuration of the embodiment of the present invention, a recording medium in which the program is recorded, etc. It may be implemented, and such an implementation can be easily implemented by an expert in the technical field to which the present invention pertains from the description of the above-described embodiments. Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improved forms of the present invention are also provided by those skilled in the art using the basic concept of the present invention as defined in the following claims. is within the scope of the right.

Claims (9)

In the method for automatically generating and transforming artificial intelligence content,
(a) inputting text and images related to content to be created by a user for content creation;
(b) analyzing the metadata of the text input by the user and the image data input by the user based on artificial intelligence and recording the text metadata and image metadata, respectively; and
(c) generating any one or more creations of dynamic content, sketch-based image content, and illustration content by using the recorded metadata;
Content automatic creation and transformation method comprising a. According to claim 1,
The image entered by the user is
A social platform that includes any one or more of a static image including a main object and a background, a sketch image created by a user, and an illustration image to convert an atmosphere, input by a user through an input means of a user terminal or linked with the user terminal Contents automatic creation and transformation method, characterized in that the image uploaded or downloaded by the user on the According to claim 1,
Step (b) is,
For the text input by the user, based on artificial intelligence, text analysis such as sentence analysis, paragraph analysis with multiple compound sentences, extraction of the most important sentence among paragraph analysis, and complex analysis of multiple sentences to provide action information and object information , a text analysis step of extracting background information, text emotion, and text atmosphere to generate metadata and recording it as text metadata in a database according to a predetermined format; and
With respect to the image input by the user, the background and foreground of the image are separated based on artificial intelligence, and background and foreground information and feature points of the object are extracted by analyzing the image of a person’s whole body, human face, animal, character, etc. in the image. an image analysis step of generating metadata and recording it as image metadata in a database according to a predetermined format;
Content automatic creation and transformation method comprising a. 4. The method of claim 3,
The image analysis step is,
If there is no image input by the user, an image related to the text metadata is detected from among images stored in a user terminal or uploaded by the user on a social platform linked to the user terminal or images stored in a database, and Separating the background and foreground, analyzing the image of a person’s whole body, human face, animal, character, etc. in the image, extracting background and foreground information and feature points of objects to generate metadata A method of automatically creating and transforming content, characterized in that it is recorded as data. According to claim 1,
Step (c) is,
If the image entered by the user is a static image containing the main object and background,
generating a background motion for changing the motion of the background among the image metadata to a dynamic image so as to move according to the general action of the background or the atmosphere indicated in the text metadata; and
object motion generation for changing an object's body motion and facial expression among image metadata into a dynamic image to move according to the general action of the object or action information indicated in text metadata;
A method for automatically generating and transforming content, characterized in that the dynamic content is created through one or more of the following. According to claim 1,
Step (c) is,
If the image entered by the user is a sketch image created by the user,
style change in which the body motions and facial expressions of the sketch among the image metadata are changed according to the mood and style shown in the text metadata; and
color change for changing the color of a part of the sketch among image metadata according to text metadata or a user's selection;
A method for automatically creating and transforming content, characterized in that the sketch-based image content is created through one or more of the following. According to claim 1,
Step (c) is,
If the image entered by the user is an illustration image to change the atmosphere,
Style change in which backgrounds and objects among image metadata are changed according to the atmosphere and style shown in text metadata; and
graphic overlays that change the graphic effects of backgrounds and objects among image metadata according to mood and style expressed in text metadata;
Content automatic creation and transformation method, characterized in that the artwork content is created through any one or more. According to claim 1,
If the creation created in step (c) is sketch-based image content or illustration content,
After the step (c), the step (b) and the step (c) are further performed,
The image input by the user in step (b) is the created creation,
The step (c) includes generating a background motion for changing the motion of the background among the image metadata to a dynamic image so as to move according to the general action of the background or the atmosphere indicated in the text metadata; and
object motion generation for changing an object's body motion and facial expression among image metadata into a dynamic image to move according to the general action of the object or action information indicated in text metadata;
Creating dynamic content through any one or more of
Content automatic creation and transformation method characterized by. In the method for automatically generating and transforming artificial intelligence content,
(a) inputting text and images related to content to be created by a user for content creation;
(b) based on artificial intelligence, the text input by the user through the input means of the user terminal or stored in the user terminal, the text inputted through the input means of the user terminal on the social platform interlocked with the user terminal, or the user terminal Analyzing the metadata of the text included in the image uploaded or downloaded by the user and the image data input by the user on a social platform linked with the user and recording the metadata as text metadata and image metadata, respectively; and
(c) generating any one or more creations of dynamic content, sketch-based image content, and illustration content by using the recorded metadata;
Content automatic creation and transformation method comprising a.

Images