KR20190094040A - A mobile terminal for generating a photographed image and a method for generating a photographed image - Google Patents

Abstract

The present invention relates to a mobile terminal for generating a photographed image, and a method for generating the photographed image. When generating a photographed image in an electronic device such as a mobile terminal or the like, a mobile terminal for generating the photographed image comprises an object image for synthesizing pre-photographed other persons to be overlapped on the rear surface of a real world object image to be photographed and generates the photographed image, thereby providing the same effect that users in different time and space shot together.

Description

A mobile terminal for generating a photographed image and a method for generating a photographed image}

The present invention relates to a mobile terminal for generating a photographed image and a method for generating a photographed image. More particularly, when generating a photographed image in an electronic device such as a mobile terminal, a synthesis of another person photographed beforehand. By creating a photographic image by including the dragon object image to overlap the back of the real-world object image of the shooting object, to create a photographic image that can provide the same effect as the users in different time-space A mobile terminal and a method for generating a photographed image.

Recent mobile terminals basically include a camera module, and digital cameras gradually include a communication module. Accordingly, the user posts a photographed image taken using a mobile terminal or a digital camera in real time on-line such as a social network service and shares it with other users.

The mobile terminal including the camera module and the digital camera capable of communication add various functions to expand the convenience of each, and one of them is a function of editing a photographed image. But image editing is nothing more than applying a filter to a captured image, simply correcting the image, or synthesizing a given icon. Accordingly, a function of generating a single photographing image by including a photographed image previously photographed by the same mobile terminal or another mobile terminal as a newly photographed real world image when the photographing is performed by the mobile terminal is not provided.

US Patent Publication No. US2015-0281591 (published on October 1, 2015) of IDEO LLC. Discloses a video editing system capable of editing video data that is a continuous image. Prior art 1 provides a video editing interface to a mobile terminal having a touch screen. Prior art 1 provides an editing interface that can apply a filter or the like to an output image (video data) using an input means such as touch or drag & drop, thereby allowing a user to take a video. Provides effects that make it easy to edit data.

However, the prior art 1 may perform editing such as applying a filter function to an image or video data stored in the mobile terminal itself, but there is a problem in that composition of a plurality of captured images or video data cannot be performed.

US Patent Publication No. US2007-0291338 (published Dec. 20, 2007) by Hewlett packard relates to a photo editing menu system for digital cameras, in which a user can edit an image taken with the digital camera using the photo editing menu of the digital camera. It is possible to remotely transmit an edited image added with a digital effect without using a PC. The prior art 2 may perform editing as well as photographing through a digital camera which is a photographing device. This solves the problem of transferring the captured photo files to the PC for editing. In addition, the ability to remotely transfer files through a communication network has the effect of easily uploading photos and edited photos to social network services.

Although there is an effect of editing a photographed image using the editing function included in the prior art 2 digital camera, an edit that represents an effect photographed at the same place by composing a plurality of different images which are photographed into one image. There is a problem that cannot be performed.

US Patent No. 9,792,883 (registered on October 17, 2017) by Samsung Electronics discloses a technology for synthesizing a user image captured at a predetermined position of a pre-stored background image as well as taking a photo using a mobile terminal. to provide. The prior art 3 synthesizes each image to generate one composite image, thereby providing a user with a composite image other than the captured image, thereby providing various effects of the captured image.

However, the related art 3 only provides a synthesis function of inserting a user image into a background image, which is each image photographed by a mobile terminal, and has a problem in that a user cannot apply a plurality of images photographed by the user to photographing.

Even in the case of using the technical features suggested in the above-described prior arts, an electronic device such as a mobile terminal and a digital camera provides a method of selectively including a person included in a plurality of captured images in a photographed image that is selectively captured in real time. Can not provide.

Patent Document 001 United States Patent Application Publication US2015-0281591 (2015.10.01 publication) Patent Document 002 United States Patent Application Publication US2007-0291338 (published Dec. 20, 2007) Patent Document 003 United States Patent Publication No. US9,792,883 (registered October 17, 2017)

In order to solve the above problem, the mobile terminal for generating a photographed image and the method for generating a photographed image according to the present invention, the mobile terminal including a camera module or a digital camera capable of communication, such as a digital camera The purpose of the present invention is to create a single photographing image by sharing the captured photo with the electronic device of one or more other users, and outputting the shared photo together with the real world image on the display to capture in real time.

According to the present invention, a mobile terminal for generating a photographed image and a method for generating a photographed image are different from the object image for synthesis in which a background is excluded from a photograph photographed by a user using a communicable electronic device such as a mobile terminal. Another object of the present invention is to easily synthesize a real-time photograph of another user and an object image for compositing as they are transmitted to a user's electronic device.

The mobile terminal for generating a photographed image and the method for generating a photographed image according to the present invention include real-time photographs performed on a mobile terminal by synthesizing an object image generated using a photograph taken on a mobile terminal or another mobile terminal. There is another purpose for generating a photographed image by including another background image in the synthesized photograph while outputting the photographed image to be generated together with the photographed image.

According to the present invention, a mobile terminal for generating a photographed image and a method for generating a photographed image are sequentially generated from any one terminal when a plurality of users generate a photographed image by using each mobile terminal. Create a photographed image including the composition object image to be transmitted. By sequentially transmitting the photographed image to the next mobile terminal so that the generated photographed image can be used as a composition object image, the composition object image received by each mobile terminal is sequentially synthesized to update the photograph. do. Thereafter, there is another purpose for the last updated photo shoot image to have the same effect as each user shot at the same time and place.

A mobile terminal for generating a photographed image and a method of generating a photographed image according to the present invention are synthesized after being output to a display according to a pose and a composition of a user included in the object image for synthesis, which is the first photographed photograph. Another object of the present invention is to induce a pose and a composition similar to that of a synthetic object image in a picture taken including a dragon object image, so that a consistently taken picture taken image including a synthesis object image can be provided.

In the mobile terminal for generating a photographed image and a method of generating a photographed image according to the present invention, a photograph taken and shared by the first user is used as a composition object image by other users and photographed by each user. Another purpose is to make the final photographed image received by the mobile terminal of the first user and the user who created the photographed image after being generated as a photographed image, so that users who have shared each photographed image can confirm the final photographed image. There is this.

The mobile terminal for generating a photographed image and the method for generating a photographed image according to the present invention, when receiving a synthesis object image from the mobile terminal of the previous user, and the real world image input from the camera module of the mobile terminal Another object is to output the combined object image on the display so that the composite object image can be used as a guide when generating a photographed image.

In order to solve the above problem, a method of generating a photographing image according to the present invention includes performing a following step by the processor in a mobile terminal including a camera module, a display, a communication module, a processor, and a memory. The method may further include outputting, in real time, a real world image including a real world object image generated by the camera module to continuously capture a real world scene in real time; Outputting a synthesis object image stored in the memory to the display; Disposing the composite object image and the real world object image on the display, wherein the composite object image is selected to be superimposed on a rear surface of the real world object image, wherein the real world object image is continuously output in real time. Including the composition object images superimposed on a rear surface; And generating a photographing image including the composition object image and the real world object image disposed on the display.

In the method for generating a photographed image according to an embodiment of the present invention, after the outputting of the real world image to the display, the real world object image to be disposed overlapping with the object image for the synthesis in the real world image The step of selecting; characterized in that it is performed further.

In the method for generating a photographed image according to an embodiment of the present invention, the composition object image is provided to be located in a first layer, and the real world object image is provided to be located in a second layer. In the disposing step, the synthesizing object image and the real world object image positioned on the first layer and the second layer are disposed on the display, and the synthesizing object image is located behind the real world object image. When the command is received, the first layer may be positioned on the rear surface of the second layer so that the composition object image is superimposed on the rear surface of the real world object image.

In the method of generating a photographed image according to an embodiment of the present invention, the real world object image is extracted from the real world image, and the extracted real world object image is positioned on the second layer.

In the method of generating a photographed image according to an embodiment of the present invention, transparent processing is performed on the remaining images other than the real world object image from the real world image, and the real world object image and the transparent processed image are positioned on the second layer. It is characterized by.

In the method for generating a photographed image according to an embodiment of the present invention, the real world background image excluding the real world object image extracted from the real world image is positioned on a third layer.

In the method of generating a photographed image according to an embodiment of the present invention, the photographed image is generated by further including the real world background image of the third layer.

In the method of generating a photographed image according to an embodiment of the present invention, in the generating of the photographed image, the memory includes one or more background images, and further comprising a selected background image among the background images. The photographing image is generated.

In the method for generating a photographed image according to an embodiment of the present invention, the size or position of the composition object image output on the display is controlled according to a control command input to the mobile terminal.

In the method of generating a photographed image according to an embodiment of the present invention, the composition object image is generated in the mobile terminal or generated in another mobile terminal, characterized in that provided through the communication module.

In the method of generating a photographed image according to an embodiment of the present invention, the object image for compositing includes only an object image without a background image.

In the method of generating a photographed image according to an embodiment of the present invention, when the synthesis object image is generated, the remaining images except the synthesis object image are generated as a background image.

In the method for generating a photographing image according to an embodiment of the present invention, the photographing image in which the composition object image and the real world object image are disposed is a composition object image, and another mobile terminal using the communication module. The method may further include transmitting the data to the mobile terminal, wherein the other mobile terminal is configured to take a picture including the composite object image received using the processor performing the same steps as the respective steps and the real world object image of the other mobile terminal. And generating an image.

A mobile terminal for generating a photographed image according to the present invention generates a photographed image using a camera module, a display, a communication module, a processor, a memory, and one or more programs stored in the memory and configured to be executed by the processor. A mobile terminal for performing the above, The one or more programs, Real-time image containing a real-world object image generated by the camera module in real-time continuous shooting of the real-time image on the display in real-time continuous and for synthesis stored in the memory Outputting an object image to the display and arranging the composition object image and the real world image on the display, wherein the composition object image is selected to be superimposed on a rear surface of the real world object image; Instructions for generating the composite object image is superimposed on the back of the real-world object image that is output continuously, and generating a photographing image including the composite object image and the real-world object image disposed on the display Characterized in that it comprises a mobile terminal.

In the mobile terminal for generating a photographed image according to an embodiment of the present invention, the one or more programs, after outputting the real-world image on the display, the real world to be disposed overlapping with the composition object image And selecting a further object image from the real world image.

In the mobile terminal for generating a photographing image according to an embodiment of the present invention, to provide the composition object image to be located on the first layer, and to provide the real world object image to the second layer The arrangement may include placing the composition object image and the real world object image positioned on the first layer and the second layer on the display, wherein the compositing object image is located at the rear of the real world object image. When received, the first layer is positioned on the rear surface of the second layer so that the composition object image is superimposed on the rear surface of the real-world object image.

In a mobile terminal for generating a photographed image according to an embodiment of the present invention, the mobile terminal extracts only the real-world object image from the real-world image, and places the extracted real-world object image on the second layer.

In the mobile terminal for generating a photographing image according to an embodiment of the present invention, transparent processing to the remaining images other than the real-world object image from the real-world image, and the real-world object image and the transparent processed image in the second layer It is characterized in that the position.

In the mobile terminal for generating a photographed image according to an embodiment of the present invention, the real world background image excluding the real world object image extracted from the real world image is located in a third layer.

In the mobile terminal for generating a photographing image according to an embodiment of the present invention, when the photographing image is generated, the photographing image is further generated by further including the real world background image of the third layer. It is done.

In a mobile terminal for generating a photographed image according to an embodiment of the present invention, when generating the photographed image, the memory includes one or more background images, and further includes a selected background image among the background images. To generate the photographing image.

In a mobile terminal for generating a photographed image according to an embodiment of the present invention, the size or position of the composition object image output on the display is controlled according to a control command input to the mobile terminal.

In the mobile terminal for generating a photographed image according to an embodiment of the present invention, the composition object image is characterized in that generated in the mobile terminal or generated in another mobile terminal and received through the communication module.

In the mobile terminal for generating a photographing image according to an embodiment of the present invention, the composition object image is characterized in that it comprises only the object image, the background image is excluded.

In the mobile terminal for generating a photographing image according to an embodiment of the present invention, when the composition object image is generated, the remaining images other than the composition object image are generated as a background image.

In the mobile terminal for generating a photographing image according to an embodiment of the present invention, the communication module is used so that the photographing image in which the composition object image and the real world object image are disposed may be used as a composition object image. To another mobile terminal, wherein the other mobile terminal receives the photographed image as a synthesis object image using the one or more programs including the same commands as the instructions, and the other mobile terminal. And generating a photographed image including the real world object image of the terminal.

According to the above configuration, a mobile terminal for generating a photographed image and a method for generating a photographed image according to the present invention, a mobile terminal including a camera module or a photograph taken by an electronic device such as a digital camera capable of communication Sharing the electronic device with one or more other users' electronic devices, and outputting the shared picture together with the real world image on the display to generate a single photographed image.

According to the present invention, a mobile terminal for generating a photographed image and a method for generating a photographed image are different from the object image for synthesis in which a background is excluded from a photograph photographed by a user using a communicable electronic device such as a mobile terminal. According to the transmission to the user's electronic device has a different effect that can easily be synthesized to the object image for synthesis on the real-time picture taken by another user.

The mobile terminal for generating a photographed image and the method for generating a photographed image according to the present invention include real-time photographs performed on a mobile terminal by synthesizing an object image generated using a photograph taken on a mobile terminal or another mobile terminal. It is possible to change the background of a photograph taken in real time without any editing by allowing the photographed image to be generated by including another background image in the synthesized photo while outputting it to the photograph to be generated as a photographed image together. It works.

According to the present invention, a mobile terminal for generating a photographed image and a method for generating a photographed image are sequentially generated from any one terminal when a plurality of users generate a photographed image by using each mobile terminal. Create a photographed image including the composition object image to be transmitted. By sequentially sending the photographed image to the next mobile terminal so that the generated photographed image can be used as a composition object image, the composition object image received by each mobile terminal is sequentially synthesized to update the photograph. do. Thereafter, there is another effect that allows each user to create a last updated photo shoot image such as the one shot at the same time and place.

A mobile terminal for generating a photographed image and a method for generating a photographed image according to the present invention are synthesized after being output to a display according to a pose and a composition of a user included in an object image for composing the first photographed photograph. In the photograph taken including the object image of the dragon, the composition and the composition of the photo similar to the synthetic object image is induced, and thus there is another effect of generating a consistently photographed photographed image including the object image for synthesis.

In the mobile terminal for generating a photographed image and a method of generating a photographed image according to the present invention, a photograph taken and shared by the first user is used as a composition object image by other users and photographed by each user. After the image is generated as a photographed image, the final photographed image is received at each mobile terminal of the first user and the user who created the photographed image. There are other effects that allow you to check the final photographed image used.

The mobile terminal for generating a photographed image and the method for generating a photographed image according to the present invention, when receiving a synthesis object image from the mobile terminal of the previous user, and the real world image input from the camera module of the mobile terminal By outputting the combined object image to the display, you can use the composite object image as a shooting guide when creating a photographed image, and check the expected composite shape in advance so that you can obtain a better photographed image. There is another effect.

1 is a configuration diagram of a mobile terminal for generating a photographed image according to the present invention;
2 is a flowchart illustrating a method of generating a photographed image using a mobile terminal according to the present invention;
3 is a flowchart illustrating a method of generating a photographed image using a layer in a mobile terminal according to the present invention;
4 is an exemplary view illustrating an embodiment of outputting a real world image by photographing a real world scene using a mobile terminal according to the present invention;
5 is an exemplary view illustrating an embodiment of a real world image output to a mobile terminal according to the present invention;
6 is an exemplary diagram illustrating an embodiment of outputting a real world image and a composition object image generated according to the present invention to a display.
7 is an exemplary diagram illustrating another embodiment of outputting a real world image and a composition object image generated in accordance with the present invention to a display.
8 is an exemplary diagram illustrating an embodiment of outputting a transparent-processed real-world object image and a composition object image to a display according to the present invention;
9 is an exemplary diagram illustrating another embodiment of outputting a transparent-processed real-world object image and a composition object image to a display according to the present invention;
10 is an exemplary diagram illustrating an embodiment for adjusting the position of a real-world object image using the movement of a mobile terminal according to the present invention;
11 is an exemplary diagram illustrating superposition of a real-world object image and a composition object image adjusted using a movement of a mobile terminal according to the present invention;
12 is an exemplary view illustrating an embodiment in which a real world object image and a composition object image are overlapped and disposed according to the present invention;
13 is an exemplary view illustrating an embodiment for adjusting the position of a real world object image by using a motion of a real world person photographed by a mobile terminal according to the present invention;
14 is an exemplary diagram illustrating the superposition of a real-world object image and a composition object image adjusted using positions of real-world characters according to the present invention;
15 is an exemplary view showing an embodiment for adjusting the position of the object image for synthesis in a mobile terminal according to the present invention,
16 is an exemplary diagram illustrating superposition of a position-synthesized object image and a real-world object image adjusted in a mobile terminal according to the present invention.

The terms or words used in this specification and claims are not to be construed as limiting in their usual or dictionary meanings, and the inventors shall refer to the principles on which terms and concepts may be defined in order to best explain their inventions. It should be interpreted as meanings and concepts corresponding to the technical spirit of the invention.

Therefore, the configuration shown in the embodiments and drawings described in this specification corresponds to a preferred embodiment of the present invention, and does not represent all of the technical spirit of the present invention, the configuration will be replaced at the time of filing of the present invention. There may be various equivalents and variations.

Throughout the specification, the description that a part “includes” an element means that the element may further include other elements, except for the absence of a special objection thereto. In addition, terms such as ".. parent", ".. part", ".. system" described in the specification means a unit for processing at least one function or operation, which is hardware or software or a combination of hardware and software It may be implemented as, may be included in one device or each other device.

Hereinafter, with reference to the drawings will be described a mobile terminal and the update shooting method for the picture update shooting according to the present invention.

The present invention relates to a processor 103 in a mobile terminal 100 that includes a camera module 101, a display 102, a communication module 105, a microprocessor 103 (hereinafter referred to as a “processor”) and a memory 104. Create a picture taken image by following these steps.

The processor 103 captures a real-world scene in the camera module 101 and outputs a real-world image including the real-world object image to the display 102; and displays the synthesis object image stored in the memory 104. And disposing the object image for synthesis and the real world image on the display 102. When the object image for synthesis is selected to be superimposed on the rear surface of the real world object image, the image included in the real world image is included. Including a composition object image superimposed on a rear surface of the real world object image; And generating a photographing image including the composition object image and the real world object image disposed on the display 102.

1 is a block diagram of a mobile terminal for generating a photographed image according to the present invention. As shown in FIG. 1, the present invention is stored in the camera module 101, the display 102, the communication module 105, the processor 103, the memory 104 and the memory 104, and stored in the processor 103. In the mobile terminal 100 including one or more programs configured to be executed by one or more programs, a photographed image is generated using the following command.

The at least one program captures a real world scene in the camera module 101, outputs a real world image including the real world object image to the display 102, and outputs a synthesis object image stored in the memory 104 to the display 102. Outputting and composing the composition object image and the real world image on the display 102, but when the composition object image is selected to be superimposed on the rear of the real world image, the composition is synthesized on the rear side of the real world object image included in the real world image. The dragon object image is superimposed and disposed, and includes a command for generating a photographing image including a synthetic object image and a real world object image disposed on the display 102.

The mobile terminal 100 captures a real-world scene and generates a camera module 101 capable of generating a real-world image including a real-world object image, a display 102 capable of outputting the generated real-world image, and a camera module 101. A processor 103 for driving and outputting the real-world image to the display 102, a memory 104 for storing the received or generated object image for synthesis, and an object image for synthesis or the generated photographic image. Communication module 105 that can receive or transmit from another mobile terminal (not shown).

The camera module 101 is provided with one or more, and generates a real world scene input through the camera module 101 as a real world image according to a command generated by the processor 103. The real world image includes at least one real world object image, and the real world object image is an image corresponding to the real world object included in the real world scene. In this case, the generated real world image may be stored in the memory 104.

The camera module 101 generates a real world image by real-time continuous shooting of a real world scene.

The camera module 101 may generate one of the real world images continuously input as a photographing image by using a photographing command generated and transmitted by the processor 103.

The camera module 101 may generate a plurality of consecutive frames from the real world images continuously input using the moving picture photographing command generated and transmitted by the processor 103 as the moving picture photographing image.

The display 102 outputs an image such as a picture, a video, or the like by a command transmitted from the processor 103. The display 102 includes a touch screen (not shown) including a touch module (not shown), and converts a user command input through the touch screen into an electrical signal and transmits it to the processor 103. The display 102 may be provided as a display instead of a touch screen, and the mobile terminal 100 may further include an input module (not shown) such as a keypad and a pointing device.

The size of the display 102 is not limited, but it is preferably made of a size that can be used in the mobile terminal 100.

The processor 103 interprets an electrical signal of a user command input using the display 102 or an input module to generate a control command for controlling the components included in the mobile terminal 100. The processor 103 may drive the camera module 101 through one or more generated control commands. In addition, other control commands may generate a photographed image or a video captured image. The processor 103 generates various control commands for controlling the mobile terminal 100.

The memory 104 is comprised of one or more and stores one or more programs driven by the processor 103. One or more programs may drive the camera module 101, drive the communication module 105, extract the real world object image from the real world image, and generate a photographic image using the composite object image and the real world object image. have. In addition, it stores basic data such as an operating system, an application, and user information for operating the mobile terminal 100.

The communication module 105 performs data communication with another external mobile terminal (not shown). The communication module 105 may receive a composition object image generated by another terminal or transmit the generated photographed image to another terminal. The communication module 105 may perform a telephone call or the like in addition to data communication.

The mobile terminal 100 may generally be a mobile phone, a smart phone, a smart pad, a notebook, a tablet PC, a digital camera, a portable multimedia player (PMP), etc., which an individual carries. The mobile terminal 100 includes a camera module, a display, a memory, a communication module, and the like.

2 is a flowchart illustrating a method of generating a photographed image using a mobile terminal according to the present invention. The processor 103 shown in FIG. 1 performs the following steps shown in FIG. 2 to generate a photographed image.

The processor 103 captures a real-world scene in the camera module 101 and outputs a real-world image including the real-world object image to the display 102 (S110); and synthesizes the object image stored in the memory 104. Outputting to the display 102 (S120); and placing the composition object image and the real world object image on the display (S130), wherein the composition object image is selected to be superimposed on the rear surface of the real world object image. A case where the composition object image is superimposed on the rear of the real world object image; And generating a photographing image including the composition object image and the real world object image disposed on the display 102 (S140).

In the present invention, "outputting the real world image including the real world object image to the display 102" may mean a step of outputting at least the real world object image among the real world scenes.

In the present invention, “outputting a synthesis object image to the display” means at least a step of outputting a synthesis object image, and may include outputting additional other images or information including the synthesis object image. Can be.

The step S130 of arranging a composition object image and a real world object image on the display may include selecting the composition object image to be overlapped with a rear surface of the real world object image.

According to an embodiment of the present disclosure, the method may include determining whether an operation of arranging the object image for synthesis is superimposed on the rear surface of the real world object image. According to an embodiment of the present disclosure, the method may include selecting a real world object image overlapping a rear surface of the real world image.

3 is a flowchart illustrating a method of generating a photographed image using a layer in a mobile terminal according to the present invention. In FIG. 3, a description will be given of a method of outputting each image output by the processor 103 to a plurality of layers and outputting the same to the display 102, which will be described with reference to FIG. 2.

Taking a real world scene using the camera module 101 and outputting the real world image including the real world object image generated on the display 102 (S110), the real world object image output to the display 102. Is provided to the second layer and output.

The second layer contains only information about the real-world object image, includes information about all the real-world images including the real-world object image, or includes information about the real-world object image and the background other than the real-world object image. can do.

4, the real world scene is photographed using the camera module 101, and a real world image is generated.

4 is an exemplary diagram illustrating an embodiment of outputting a real world image by photographing a real world scene using a mobile terminal according to the present invention. As shown in FIG. 4, real-time continuous shooting of a real-world scene is performed through the camera module 101 of the mobile terminal 100. The real world scene includes one or more objects such as a background 520 and a person 510 located in the real world. The real world scene photographed by the camera module 101 is continuously generated in real time as a real world image which is image data. Accordingly, the real world image 110 continuously output in real time on the display 102 includes a real world object image (object A) of the person 510 photographed from the camera module (not shown) and a real world background image of the background. Can be.

When the position of the person 510 is moved in the real world scene photographed by the camera module 101, the real world object image of the object A in the real world image is also displayed so that the position is moved in correspondence with the position of the person 510. In real time. In addition, the real world object image and the real world background image of the object A is changed according to the camera angle change through the rotation or movement of the camera module 101 changes the real world scene, the real world object image and the real world background image in the real world image 110 The position is shifted and output.

An embodiment in which a real world scene is photographed using the camera module 101 and a real world image corresponding to the captured real world scene is output to the display 102 is described with reference to FIG. 5.

5 is an exemplary view illustrating an embodiment of a real world image output to a mobile terminal according to the present invention. As illustrated in (a) of FIG. 5, the real world image 110, in which the real world scene is captured and output to the display 102, may include a real world object image (object A) and a real world background image.

The real world image of (a) may be configured to include both the real world object image and the real world background image in one image as shown in (c). Also, the real world image of (a) may be configured by combining a real world object image including the remaining transparent image as shown in (d) and a real world background image excluding the real world object image as shown in (e). Also, although not shown, the real world object image including only the object A excluding the remaining image and the real world background image without the real world object image as shown in (e) may be combined.

As shown in (b) of FIG. 5, the display 102 may output only a real world image 112 including a remaining image which is taken as a real world scene and is transparently processed as shown in (d). The output of the real world background image may be excluded.

Also, although not shown, a real world scene may be photographed, and only a real world object image including only the object A may be output, and the output of the remaining real world background image may be excluded.

In the case of the real world image 112 in which the output of the real world background image is excluded, a real world background image or another background image may be combined later.

The real world image 112 including the remaining transparent image as shown in (d) is transparent to the remaining images except the real world object image (object A) selected from the real world image 110 composed of one image as shown in (c). Can be generated by

Alternatively, as shown in (c), the output of the remaining images except for the selected real world object image (object A) may be excluded or deleted from the real world image 110 including one image.

In the present invention, the term “real world image” may be used to indicate an image that is eventually output to a display among real world scenes.

The step of selecting the real world object image (object A) from the real world image 110 may be performed before or after outputting the real world image 110 to the display. In particular, the output may be performed after the output. The selection of the real world object image (object A) is performed by the processor 103 recognizing the object A included in the real world image 110 and setting the recognized object A as the real world object image (object A).

Alternatively, the selection of the real world object image (object A) recognizes the object A corresponding to the object selection signal in the real world image 110 output to the display 102 using the object selection signal input from the user, and recognizes the recognized object. This is done by setting A to the real world object image (object A). In this case, the object selection signal may be input by the user through an input module (not shown) included in the mobile terminal 100 or a touch module included in the display 102. The input of the object selection signal using the touch module, when the user touches the position of the object to be selected as the object in the real world image 110 output to the display 102, the information of the touched position is recognized as the object selection signal The object at the touch position is set to the real world object image (object A). Alternatively, when the user touches and drags the contour of an object to be selected as an object in the real world image 110 output to the display 102, the input information of the touch and drag input is recognized as an object selection signal. , Objects corresponding to touch and drag are set to the real world object image (Object A).

Even when an object is selected using an input module (not shown) included in the mobile terminal 100, the object selected in the real world image 110 output to the display 102 according to the input information is selected from the real world object image ( Set to object A).

Display 102 outputs an image using one or more layers. The real world image 110 of (a) or real world image 112 of (b) shown in FIG. 5 is provided to the second layer and output to the display 102. The real world image 110 output to the display 102 is composed of a single image including both the real world object image (Object A) and the real world background image as shown in (a), or the real world object image of (d) and (e) The two images of the real world background image of) may be combined or the two images of the real world object image of which only object A exists and the real world background image of (e) may be combined.

In addition, as shown in (b), the real world image 112 is an image including a real world object image (object A) and an image in which transparent processing is performed on the remaining images as shown in (d). Alternatively, the image is a real world image (not shown) including only the object A. FIG.

Accordingly, the real world image 112 disposed on the second layer may include the object A, and may include the remaining image or the image on which the transparent process is performed on the remaining image as necessary.

On the other hand, when the real world image 110 combined with the extracted real world object image and the real world background image is output on the display 102, the real world object image is provided to the second layer, and the real world background image is provided to the third layer. Can be.

After step S110, in step S120 of outputting the synthesis object image stored in the memory 104 to the display 102, the synthesis object image output to the display 102 is provided and output to the first layer. In operation S120, the object image for synthesis is output together with the display 102 on which the real world image is output, and the object image for synthesis output on the display 102 is the same as the embodiment shown in FIGS. 6 and 7 or FIGS. 8 and 9. It may be output in the form of the same other embodiment.

6 is an exemplary diagram illustrating an embodiment of outputting a real world image and a composition object image generated in accordance with the present invention to a display. As shown in FIG. 6A, a real world image 110 generated by the camera module 101 photographing a real world scene is disposed on a second layer in the display 102 of the mobile terminal 100. Is output.

As shown in (b), the object image 210-1 (object B) for synthesis is an image in which only the image of the object B exists. The object image 210-1 (object B) for synthesis only includes image information about the object B, and does not include background information other than the object B. The object image 210-1 (object B) for synthesis is disposed on the first layer and output to the display 102.

When the real world image 110 including the real world object image (object A) of (a) and the object image 210-1 (object B) for composition of (b) are output together on the display 102, (c) As shown, the real world image 110 provided in the second layer and the composition object image (object B) provided in the first layer positioned in front of the second layer are included together and output to the display 102.

7 is an exemplary diagram illustrating another embodiment of outputting a real world image and a composition object image generated in accordance with the present invention to a display. As shown in FIG. 7A, a real world image 110 generated by the camera module 101 photographing a real world scene is disposed on a second layer in the display 102 of the mobile terminal 100. Is output.

As shown in (b), the image 210-2 for synthesis (object B) includes a composition object image (object B) and an image obtained by performing transparent processing on the remaining images. The composition image 210-2 (object B) also includes image information on the object B and transparent processing information on the remaining transparent images. The synthesis images 210-2 and B are disposed on the first layer and output to the display 102.

According to one embodiment, the term "synthesis image 210-2" used to represent a composition image including the object image for synthesis (object B) and the remaining transparent image is included in the object image for synthesis. Therefore, it may be expressed as "synthetic object image 210-2" or "synthetic object image 210-2 (object B)" as necessary.

When the real world image 110 including the real world object image (object A) of (a) and the composition image 210-2 (object B) of (b) are output together on the display 102, (c) and Similarly, the real world image 110 provided in the second layer and the composition object image (object B) provided in the first layer positioned in front of the second layer are included together and output to the display 102. In this case, since the image processed transparently to the other images other than the object image for synthesis of the image 210-2 for synthesis (B) is transparently output from the display 102, the image is synthesized from the real world image 110 located on the second layer. The area where the dragon object image (object B) is located is covered, and the real world object image (object A) and the real world background image, which are the remaining images except for the synthesis object image (object B), are normally output.

As shown in FIG. 6 and FIG. 7C, the real world image 110 photographed and output in real time and the object image 210-1 for synthesis or the image 210-2 for synthesis are displayed on the display 102 together. Is output to the mobile terminal 100 when a command for requesting generation of a photographed image is input, or the real-world image 110 and the composition object image 210-which are automatically output to the display 102 in real time in real time. 1) Alternatively, the combined image 210-2 is combined to generate the photographed images 130-1 and 130-2. The combined photographed images 130-1 and 130-2 may be any one frame or a plurality of frames of the real world image 110 and the object image for synthesis (object B).

6 and 7, the synthesis image 210-2 including the synthesis object image 210-1 or the synthesis object image is included in the real world image 110 illustrated in FIG. 5A. The output is described together.

In the present invention, the term “outputting a synthesis object image to the display” includes outputting a synthesis image to the display and consequently outputting a synthesis object image.

Meanwhile, the method of generating the synthesis object image 210-1 or the synthesis image 210-2 may be performed in the following three forms. First, in order to generate the synthesis object image 210-1 or the synthesis image 210-2, the mobile terminal 110 generates another real world image by synthesizing another real world scene, and generates the synthesized real world. You can extract the object image for compositing from the image. The extracted object image for synthesis (object B) may be composed of only the object image 210-1 for which the other images except for the object image (object B) for synthesis are excluded. Alternatively, the image may be generated as a synthesis image 210-2 including an object image for synthesis (object B) and an image in which transparent processing is performed on the remaining images.

Second, the real world image for synthesis, which can generate the object image for synthesis, is photographed on another mobile terminal (not shown), and the mobile terminal 100 receives the real world image for synthesis from another mobile terminal (not shown) for synthesis. You can extract the object image.

Third, the real world image for synthesis, which can generate the object image for synthesis, is captured by another mobile terminal (not shown). Another mobile terminal (not shown) extracts the object image for synthesis from the real world image for synthesis. Another mobile terminal (not shown) may transmit the extracted object image for synthesis to the mobile terminal 100, and the mobile terminal 100 may receive and use the object image for synthesis.

 FIG. 8 is an exemplary diagram illustrating an embodiment of outputting a real world image including a real world object image and a transparent processed background and an object image for synthesis to a display according to the present invention. As shown in (a) of FIG. 8, the display 102 of the mobile terminal 100 includes a real world object image and a transparent background of real world images generated by the camera module 101 photographing a real world scene. The real world image 112 is included. In (a) of FIG. 8, the output of the real-world image 112 is performed by performing transparent processing on the remaining images except for the real-world object image (object A) as shown in FIG. 5 (d). This is done by outputting only the generated real world image 112 to the display 102.

Alternatively, in another embodiment, the output of the real-world image (not shown) excludes the output of the remaining image except the real-world object image (object A) from the real-world image generated by photographing, thereby displaying only the real-world object image (object A) 102 By outputting

Accordingly, the real world image 112 including the object A and the remaining image subjected to the transparent processing shown in FIG. 8A or the real world image (not shown) including only the object A is disposed on the second layer and displayed. Is output to 102.

As shown in (b), the synthesis object images 210-1 and B are images in which only the image of the object B exists. The composition object images 210-1 and B only include image information of the object B, but do not include background information other than the object B. The object image 210-1 (object B) for synthesis is disposed on the first layer and output to the display 102.

When the real-world image 112 including only the real-world object image (object A) of (a) and the composition object image 210-1 (object B) of (b) are output together on the display 102, (c) As shown, the real world image 110 provided in the second layer and the composition object image (object B) provided in the first layer positioned in front of the second layer are included together and output to the display 102.

9 is an exemplary diagram illustrating another embodiment of outputting a real world image including a real world object image and a transparent processed background and a composition object image to a display according to the present invention. As shown in FIG. 9A, the display 102 of the mobile terminal 100 includes a real world object image and a transparent background of real world images generated by the camera module 101 photographing a real world scene. The real world image 112 including the same is disposed on the second layer and output. In (a) of FIG. 9, the output of the real-world image 112 is only a real-world image 112 generated by performing transparent processing on an image other than the object A as shown in FIG. By outputting to display 102.

Alternatively, the output of the real world image (not shown) according to another embodiment may exclude the output of the remaining images except for the real world object image (object A) from the real world image generated and photographed, or delete only the real world object image (object A). By outputting to display 102.

Accordingly, a real world image 112 including only the object A or the real world image 112 including the object A shown in FIG. 9A and the remaining images subjected to the transparent processing is disposed on the second layer to display the display ( 102).

As shown in (b), the composition image 210-2 includes a composition object image (object B) and an image obtained by performing transparent processing on the remaining images. The synthesis images 210-2 and B also include image information on the synthesis object image (object B) and transparent processing information on the remaining transparent images. The synthesis images 210-2 and B are disposed on the first layer and output to the display 102.

When the real world image 112 including the real world object image (object A) of (a) and the composition image 210-2 (object B) of (b) are output to the display 102 together, (c) and Similarly, the real world image 110 provided in the second layer and the synthesis image 210-2 (object B) provided in the first layer positioned in front of the second layer are included together and output to the display 102.

As shown in (c) of FIG. 8 and FIG. 9, the real world image 112 and the composition object image 210-1 including only the object A which is photographed and output in real time and the remaining image or the object A which has been transparently processed. Alternatively, the image is output to the display 102 together with the composition image 210-2 including the composition object image (object B) and the remaining transparent image, and the mobile terminal 100 requests generation of a photographed image. The real world image 112 and the composition object image 210-1 or the composition object image (object B) which are automatically output in real time continuously on the display 102 when the command is input, The photographing images 130-3 and 130-4 are generated by combining the synthesis image 210-2 including the image. The combined photographed images 130-1 and 130-2 may be any one frame or a plurality of frames of the real world image 110 and the composite object images 210-1 and 210-2, respectively.

8 and 9, the synthesis object image 210-1 or the synthesis image 210-2 is output together with the real world image 112 illustrated in FIG. 5B.

As used herein, the term “synthetic image” or “synthetic image 210-2” includes an object image for synthesis, and thus, “synthetic image 210-2” or “synthetic image 210-2, Object B) ”.

In operation S120, the composition object image is provided to the first layer, and after being output to the display 102, it is selected whether the output composition object image is disposed behind the real-world object image (S131).

In step S131, the rear layout selection of the composition object image is received from the user through an input module (not shown) of the mobile terminal 100, and the processor 103 generates the composition object image based on the input rear layout selection. Place it on the back of the image.

In this case, a process of selecting and extracting the real world object image, which is a reference for the rear layout, from the real world image output to the display 102 before or after the rear layout is selected in step S131 is performed.

Referring to FIG. 5A, at least one object present in the real world image 110 must be recognized in order to extract the real world object image (object A) from the real world image 110. Object A may exist in the real world image 110, but if more than one object exists, object A to be extracted from the real world image 110 should be selected. Alternatively, two or more objects may be selected.

The object selected from the real world image 110 may be selected by being automatically recognized by the processor 103 or may select an object designated by a user.

A method of automatically selecting an object from the real world image 110 may use an object recognition method among image processing methods. Object recognition extracts feature points of each pixel in the real world image 110. The outline of the object is determined using the extracted feature point set. There is a method of recognizing and extracting a set of feature points corresponding to the contour of the determined object as an object.

In addition, when the object to be extracted is a person, there is a method of extracting the outline of a person through face recognition, and recognizing and extracting the extracted image of the person outline as a person object.

In addition, a method of automatically recognizing an object in an image may use any of known image processing algorithms.

A method of selecting an object by the user to extract the real world object image 111 from the real world image 110 is as follows. The user selects an object to be selected within the real world image 110 output on the display 102 of the mobile terminal 100 through an input such as a touch. The processor 103 analyzes the selected object to recognize the outline of the object. Next, an object corresponding to the recognized cochlea may be extracted from the real world image 110.

At this time, when the user selects the object, the object of the touched position is selected by touching the position of the object output on the display 102. Alternatively, the object may be selected using a continuous touch input of a drag and drop method of the object to be selected from the user.

The processor 103 may recognize the object by using the selected object or the outline of the object, and extract the recognized object from the real world image 110.

In addition, a method other than the method of selecting the real-world object image in the real-world image 110 by the user may be used.

In addition, the size or position of the real world object image and the composition object image output on the display 102 may be adjusted before or after the rear layout is selected in operation S131.

In addition, either the real-world object image subjected to transparent processing to the background image shown in FIG. 8 or 9 or the real-world object image from which the output of the background image is excluded or the real-world object image from which the background image is deleted is combined with the object image for synthesis. If output, the background image to be included in the photographed image may be selected before or after the rear layout of step S131 is selected. The selected background image is disposed on the third layer and output to the display 102. The selected background image output to the display 102 is included in the photographed image.

10 is an exemplary view showing an embodiment for adjusting the position of the real-world object image using the movement of the mobile terminal according to the present invention, Figure 11 is a real-world object adjusted using the movement of the mobile terminal according to the present invention It is an example figure which shows the superposition of an image and the object image for compositing.

As shown in FIG. 10 and FIG. 11, when the real world object image (object A) is located at a specific position in the real world image 121 in which the composition object image (object B) is disposed, the user moves the mobile terminal 100. By rotating (changing the camera angle), the real world object image (Object A) can be placed at a specific position within the real world image.

That is, as shown in FIG. 10A, the real world image 110 including the composition object image (object B) and the real world object image (object A) is output to the display 102 of the mobile terminal 100. When the real world object image (object A) in the real world image 110 is located at the center of the road, the user may move the angle of the camera module 101 included in the mobile terminal 100 to the left. The real world object image (object A) and the background image in the real world image 110 output to the display 102 according to the angle moved to the left have the same effect as the movement to the right as shown in FIG. Indicates. There is no movement of the composition object image (Object B). Therefore, when the real world object image (object A) is moved to the right and outputted, the same effect as the distance from the synthesis object image (object B) disposed in the real world image 110 is separated.

Meanwhile, the user may move the angle of the camera module 101 provided in the mobile terminal 100 to the right. The real world object image (Object A) and the background image in the real world image 110 output to the display 102 according to the angle moved to the right have the same effect as the movement to the left as shown in FIG. Indicates. Moving and outputting the real world object image (object A) to the left has the same effect as the distance from the composition object image (object B) disposed in the real world image 110 is adjacent.

An embodiment in which the real world object image (object A) and the composition object image (object B) overlap with the camera angle of the mobile terminal 100 is illustrated in FIG. 11. When a command for superimposing the real-world object image (Object A) and the compositing object image (Object B) output on the display 102 is received, the processor 103 displays the image of one object more than the other object image. It can be located at the front or at the rear.

In step S131, when the rear layout selection is input to the mobile terminal 100 so that the synthesis object image (object B) is superimposed on the rear surface of the real world object image (object A), the processor 103 may be configured as shown in FIG. As shown in a), the composition object image (object B) provided in the first layer is disposed to overlap the rear surface of the real world object image (object A) provided in the second layer (S132).

Subsequently, when the arrangement of the real world object image and the composition object image is completed in step S132 and the adjustment of the size and position of the real world object image and the synthesis object image is completed, the mobile terminal 100 is output to the display 102. A photographing image is generated including the composition object image and the real world object image (S140).

FIG. 11A illustrates a composite object while the real world object image (object A) included in the real world image 143 disposed on the second layer and the composition object image (object B) disposed on the first layer overlap each other. In this embodiment, the image (object B) is disposed behind the real world object image (object A).

The composition object image (object B) is output to the display 102 of the mobile terminal 100 on which the real world image 143 is output. When the mobile terminal 100 is rotated, the camera angle is changed to overlap the object image for synthesis (object B) and the real world object image (object A). When the composition object image (Object B) is selected to be positioned behind the real world object image (Object A), the processor 103 may use the real world object provided to the second layer for the composition object image (Object B) provided in the first layer. Position it so that it is located behind the image (Object A).

Alternatively, first, the composition object image (object B) is selected to be positioned behind the real world object image (object A), and the composition object image (object B) provided in the first layer is provided in the real world object image (object) provided in the second layer. Place it so that it is located at the back of A). Next, the camera angle may be changed so that the composition object image (object B) and the real world object image (object A) overlap each other.

As illustrated in (c) of FIG. 8 or 9, when the real world object image (object A) and the composition object image (object B) are superimposed and output to the display 102, the processor 103 is included in the real world image. The real world background image may be provided to the third layer and output. Alternatively, another background image stored in the memory 104 may be provided to the third layer without being included in the real world background image, and may be output to the display 102. Alternatively, the background image of the object image for synthesis may be provided to the third layer and output to the display 102 without including the real world background image.

The background image of the real world background image provided to the third layer, another background image stored in the memory 104, or a composition object image is output to the display 102 and included in the generated photographic image.

In this case, the background image of the object image for synthesis is an image stored in the object image for synthesis is extracted from the real-world image photographed to generate the object image for synthesis, and set the remaining image as the background image. Alternatively, the object image for synthesis may be generated by graphics, animation, or the like.

If, in step S131, the rear layout selection is not input such that the composition object image (object B) is superimposed on the rear surface of the real world object image (object A) and outputted to the mobile terminal 100, the processor 103 may perform a diagram. As shown in (b) of FIG. 11, a photographing image is generated by using the composition object image (object B) provided in the second layer located in front of the real world object image (object A) provided in the second layer ( S140). Before generating the photographed image, the size and position of the real-world object image and the composition object image may be adjusted.

FIG. 11B illustrates that the composite object image (Object B) overlaps with the real world object image (Object A) and the composition object image (Object B) included in the real world image 144, thereby combining the real world object image (Object A). The embodiment is disposed in the front of the).

The composition object image (object B) is output to the display 102 of the mobile terminal 100 on which the real world image 144 is output. When the mobile terminal 100 is rotated, the camera angle is changed to overlap the object image for synthesis (object B) and the real world object image (object A). When the synthesis object image (object B) provided in the first layer is located in front of the real world object image (object A) provided in the second layer, the processor 103 may generate a photographed image in the disposed state. have.

If the real world object image (Object A) provided in the second layer is located behind the compositing object image (Object B), the composition of the object image provided in each layer (Object B) is changed so that the composite object image (Object B) becomes the real world. Reposition it to be in front of the object image (Object A).

Arrangement change of each object image is performed according to a command input to the mobile terminal 100 by the user.

12 is an exemplary view illustrating an embodiment in which a real world object image and a composition object image are overlapped and disposed according to the present invention. As shown in (a) of FIG. 12, when the composition object image 210 provided in the first layer is disposed on the rear surface of the real world image 112 provided in the second layer so as to overlap, (b) As shown, the object B of the synthesis object image 210 may be located behind the object A of the real world image 112. In this case, the generated photographic image may provide the same effect as photographing the object B while the object B is located behind the object A. FIG.

As shown in FIG. 12C, when the composition object image 210 provided in the first layer is disposed in front of the real world image 112 provided in the second layer, the composition object image 210 may be superimposed on (d). As shown, the object B of the synthesis object image 210 may be positioned in front of the object A of the real world image 112. The photographed image generated in this case may provide the same effect as photographing the object B in front of the object A.

According to the present invention, a real-world object image that is disposed when the position where each object is placed is overlapped while composing the real-world object image including each object A and the composition object image including the object B into one photographed image and You can adjust the size and position of the object image for compositing.

The real world object image is generated through a real world scene photographed through the camera module 101 of the mobile terminal 100, and by enlarging or reducing the real world image generated through the control of the zoom function of the camera module 101. You can control the size of the real-world object image.

The position adjustment of the real world object image is performed by changing a camera angle of the camera module 101 through a control device (not shown) that controls the movement of the user or the mobile terminal 100, and thereby changes the real world object image included in the real world scene. When the position of the corresponding person is adjusted, the position of the real world object image may be adjusted within the real world image output to the display 102.

The object image for compositing is an image stored in the memory 104 is output on the display 102. When the touch module is included in the display 102, the composing object image is output by performing a touch or drag input on the display 102. You can change the position of the object image.

In the case where the display 102 includes a touch module, enlargement and reduction of the composition object image is generally used in the mobile terminal 100 and is performed according to a change in the distance between two touched points. For example, when the distance between two points input to the display 102 is far, the processor 103 enlarges the output synthesis object image. If the distance between the two points is close, the processor 103 reduces the output synthesis object image.

The position and size adjustment of the object image for compositing has been described as being performed through a touch module provided in the display 102, but the object image for compositing is also available through a separate input module (not shown) provided in the mobile terminal 100. You can enter commands for positioning and scaling.

13 is an exemplary view showing an embodiment for adjusting the position of the real-world object image using the motion of the real-world person photographed in the mobile terminal according to the present invention, Figure 14 using the motion of the real-world person in accordance with the present invention Exemplary diagrams illustrating superposition of the adjusted real-world object image and the composition object image.

As shown in FIGS. 13 and 14, when the camera angle of the mobile terminal 100 is fixed in the real world image 110 in which the composition object image (object B) is disposed, the person in the real world corresponding to the object A ( When the 510 moves in the real world, the real world object image (object A) output from the display 102 may move around the composite object image (object B) output together with the display 102.

That is, the real-world object image (object A) and the synthesis object image (object B) are output as shown in (a) from the first real-world image 110 to be output. In this case, when the real world person 510 in the center of the real world surroundings 520 moves to the left side of the person in the real world scene as shown in FIG. 4, as shown in FIG. The object A in the real world image 151 is moved to the right in the real world image and is output so as to be spaced apart from the composition object image (object B) output on the left side of the display 102.

Also, as shown in (c), when the real world person 510 corresponding to the object A moves to the left in the real world, the object A in the real world image 152 is output adjacent to the output composite object image (object B). do.

An embodiment in which the real world object image (object A) and the synthesis object image (object B) overlap with the movement of the real world person 510 located in the real world is illustrated in FIG. 14. When the real-world object image (object A) and the composition object image (object B) output on the display 102 overlap, one object image may be positioned in front of or behind the other object image. have.

14A illustrates a composite object image (Object B) overlapping a real world object image (Object A) and a composition object image (Object B) included in the real world image 153 so that the composite object image (Object B) is a real world object image (Object A). The embodiment is disposed on the back of the).

The real world image 153 including the real world object image (object A) and the composition object image (object B) are output to the display 102 of the mobile terminal 100. The real-world person 510 corresponding to the real-world object image (object A) may move, and the composition object image (object B) and the real-world object image (object A) may overlap each other. When the composition object image (Object B) is selected to be positioned behind the real world object image (Object A), the processor 103 may use the real world object provided to the second layer for the composition object image (Object B) provided in the first layer. Position it so that it is located behind the image (Object A).

Alternatively, first, the composition object image (object B) is selected to be positioned behind the real world object image (object A), and the composition object image (object B) provided in the first layer is provided in the real world object image (object) provided in the second layer. Place it so that it is located at the back of A). Next, the real-world person moves to allow the composition object image (object B) and the real-world object image (object A) to overlap each other.

As illustrated in (c) of FIG. 8 or 9, when the real world object image (object A) and the composition object image (object B) are superimposed and output to the display 102, the processor 103 is included in the real world image. The real world background image may be provided to the third layer and output. Alternatively, another background image stored in the memory 104 may be provided to the third layer without being included in the real world background image, and may be output to the display 102. Alternatively, the background image for synthesis of the object image for synthesis may be provided to the third layer or the fourth layer without being output to the display 102.

FIG. 14B illustrates a composite object image (object B) overlapping with each other and the composite object image (object B) included in the real world image 154 and the composite object image (object B). The embodiment is disposed in the front of the).

The real world image 154 including the real world object image (object A) and the composition object image (object B) are output to the display 102 of the mobile terminal 100. In the real world scene, the real world person 510 may move to overlap the object image for synthesis (object B) and the real world object image (object A). When the composition object image (object B) provided in the first layer is located in front of the real world object image (object A) provided in the second layer, the photographed image may be generated in the disposed state.

If the real world object image (Object A) provided in the second layer is located behind the compositing object image (Object B), the composition of the object image provided in each layer (Object B) is changed so that the composite object image (Object B) becomes the real world. Reposition it to be in front of the object image (Object A).

15 is an exemplary view showing an embodiment for adjusting the position of the synthesis object image in the mobile terminal according to the present invention, Figure 16 is a position of the composite object image and the real-world object image adjusted in the mobile terminal according to the present invention It is an exemplary figure which shows superposition.

15 and 16, when the camera angle of the mobile terminal 100 is fixed in the real world image 110 in which the object image for synthesis (object B) is disposed, the object image for composition (object B) is arranged. ) Can be moved around the output real-world object image (Object A). In the real world scene of FIG. 4, when the real world person 510 located at the center of the real world surrounding background 520 is fixed, as shown in FIG. 15A, the real world image 110 is output.

At this time, as shown in (b) of FIG. 15, the composition object image (object B) is moved to the right side of the real world object image (object A) in the real world image 161, or as shown in (c), the real world image ( In operation 162, the composition object image (object B) may be moved to the left of the real world object image (object A).

As illustrated in FIG. 12, when the display 102 includes a touch module, the movement of the synthesis object image (object B) output to the display 102 is performed by performing a touch or drag input on the display 102. You can change the position of the output composite object image. Alternatively, the location may be changed by using an input module (not shown) provided in the mobile terminal 100.

An embodiment in which the real world object image (object A) and the synthesis object image (object B) overlap with each other as the position of the composition object image (object B) moves is illustrated in FIG. 16.

When the real world object image (object A) and the composition object image (object B) overlap with each other by the positional movement of the composition object image (object B) output on the display 102, one object image is changed to another one. It can be placed on the front or back of the object image.

FIG. 16A illustrates a composite object image (object B) overlapping a real world object image (object A) and a composition object image (object B) included in the real world image 163 so that the composite object image (object B) is a real world object image (object A). The embodiment is disposed on the back of the).

The real world image 163 including the real world object image (object A) and the composition object image (object B) are output on the display 102 of the mobile terminal 100, and the composition object image (object B) is moved. If it is selected so as to overlap with the real-world object image (object A) according to, and to place the composition object image (object B) on the back of the real-world object image (object A), the processor 103 is used for compositing provided in the first layer The object image (object B) is disposed to be located behind the real world object image (object A) provided in the second layer.

Alternatively, first, the composition object image (object B) is selected to be positioned behind the real world object image (object A), and the composition object image (object B) provided in the first layer is provided in the real world object image (object) provided in the second layer. Place it so that it is located at the back of A). Next, the composition object image (object B) may be moved to overlap the real world object image (object A).

As illustrated in (c) of FIG. 8 or 9, when the real world object image (object A) and the composition object image (object B) are superimposed and output to the display 102, the processor 103 is included in the real world image. The real world background image may be provided to the third layer and output. Alternatively, another background image stored in the memory 104 may be provided to the third layer and output to the display 102 without including the real world background image. Alternatively, the synthesized background image of the synthesis object image is provided to the third layer or the fourth layer without being included in the real world background image, and output to the display 102.

FIG. 16B illustrates a composite object image (object B) overlapping the real world object image (object A) and the composition object image (object B) included in the real world image 164, and the real world object image (object A). The embodiment is disposed in the front of the).

The real world image 164 including the real world object image (object A) and the composition object image (object B) are output to the display 102 of the mobile terminal 100. The composition object image (object B) may be moved to overlap with the real world object image (object A). When the composition object image (object B) provided in the first layer is located in front of the real world object image (object A) provided in the second layer, the photographed image may be generated in the disposed state.

If the real world object image (Object A) provided in the second layer is located behind the compositing object image (Object B), the composition of the object image provided in each layer (Object B) is changed so that the composite object image (Object B) becomes the real world. Reposition it to be in front of the object image (Object A).

As described above with reference to FIGS. 10 to 16, the real world image including the real world object image which is output in real time continuously to the display 102 of the mobile terminal 100 and the object image for synthesis output together with the real world image are used. A photographic image can be generated. In this case, the real world object image and the synthesis for different locations according to the change of the camera angle of the mobile terminal 100, the movement of the real world person corresponding to the real world object image or the position of the composition object image output together with the real world image The photographing image may be generated using the object image.

FIG. 15C is a result screen of performing further movement down the screen while moving the composition object image (object B) to the left side of the real world object image (object A), and FIG. This screen is the result of additional movement on the screen to emphasize perspective while placing the image (object B) on the back of the real object image (object A).

Alternatively, when it is determined that the real world object image (object A) is disposed at any one of the front side or the rear side of the synthesis object image (object B) as shown in (a) and (b) of FIG. By moving in the real world, the object may be moved to emphasize three-dimensional or perspective in the front or rear of the object image (object B).

Although not illustrated in each embodiment, when the real-world object image and the composition object image are overlapped and output, when one object image is disposed in the front and the other image is disposed in the rear, according to each arrangement type Each object image may be enlarged or reduced so that three-dimensional or perspective may be highlighted.

After the step S140, the mobile terminal 100 of the present invention is a composite object in a mobile terminal (not shown) that is different from the photographed image generated using the real-world object image (Object A) and the composition object image (Object B) Transfer the photographed image to another mobile terminal for reuse as an image.

The other mobile terminal that has received the photographed image may reuse the received photographed image as a composition object image. The other mobile terminal may generate another photographed image by using the photographed image, which is an output object image, and the real world image generated by the camera module of another mobile terminal.

If the background image is included in the photographed image transmitted from the mobile terminal 100 to another mobile terminal, the other mobile terminal uses the photographed image except for the background image as the object image for synthesis.

In addition, when the mobile terminal 100 receives the object image for synthesis from another mobile terminal to generate a photographed image, the mobile terminal 100 displays the photographed image generated to another mobile terminal that provides the object image for synthesis. By transmitting, the user of the other mobile terminal can check the generated photographed image.

In addition, when the mobile terminal 100 generates a final photographed image photographed by sequentially using photographed images sequentially generated through a plurality of different mobile terminals as a synthesis object image, the mobile terminal 100 provides a plurality of photographed images. The final photographed image generated by each of the other mobile terminals is transmitted to allow the user of each other mobile terminal to confirm the final photographed image.

The description of the invention herein describes the preferred embodiment, and the invention is not limited to this embodiment. Those skilled in the art to which the present invention pertains can make various changes and modifications to the above embodiments without departing from the technical spirit of the present invention, the technical idea of the present invention is to make all such various changes and modifications Include.

100: mobile terminal 101: camera module
102 display 103 processor
104: memory 105: communication module
110, 112, 141-144, 151-154, 161-164: Real world images
113: Real World Background Images
130-1, 130-2, 130-3, 130-4: Picture taken image
210-1: Synthetic object image 210-2: Synthetic image
510: Real World Figure 520: Real World Background
A: Object AB: Object B

Claims (26)

In a mobile terminal including a camera module, a display, a communication module, a processor, and a memory, the processor generates a photographed image by performing the following steps:
Outputting, in real time, a real world image including a real world object image generated by real-time continuous shooting of a real world scene by the camera module;
Outputting a synthesis object image stored in the memory to the display;
Disposing the composite object image and the real world object image on the display, wherein the composite object image is selected to be superimposed on a rear surface of the real world object image, wherein the real world object image is continuously output in real time. Including the composition object images superimposed on a rear surface; And
Generating a photographing image including the composition object image and the real world object image arranged on the display. The method of claim 1, wherein after outputting the real world image to the display,
And selecting the real world object image from the real world image for overlapping with the synthesis object image. The method of claim 1,
Providing the composition object image to be located in a first layer, and providing the real world object image to be located in a second layer,
In the disposing step,
When the composition object image and the real world object image located on the first layer and the second layer are disposed on the display, and a command for receiving the synthesis object image located behind the real world object image is received, Placing a first layer on a rear surface of the second layer such that the composition object image is superimposed on a rear surface of the real-world object image. The method of claim 3, wherein
Extracting only the real-world object image from the real-world image, and placing the extracted real-world object image on the second layer. The method of claim 3, wherein
And transparently processing the remaining images except for the real world object image in the real world image, and placing the real world object image and the transparent processed image on the second layer. The method of claim 4, wherein
The real world background image except for the real world object image extracted from the real world image is located on a third layer. The method of claim 6, wherein in the generating the photographed image,
And generating the photographed image by further including the real world background image of the third layer. The method of claim 1, wherein the generating of the photographed image comprises:
Wherein the memory includes one or more background images, the memory further comprising a selected background image of the background images to generate the photographed image. The method of claim 1,
And controlling the size or position of the composition object image output to the display according to a control command input to the mobile terminal. The method of claim 1,
The composition object image is characterized in that generated in the mobile terminal or generated in another mobile terminal and received through the communication module. The method of claim 10,
And the object image for compositing includes only an object image without a background image. The method of claim 10,
When the composition object image is generated, the remaining images other than the composition object image are generated as a background image. The method of claim 1,
The method may further include transmitting the photographed image in which the composition object image and the real world object image are disposed as a composition object image to another mobile terminal using the communication module.
The other mobile terminal generates a photographing image including the composite object image received and the real world object image of the other mobile terminal by using a processor performing the same steps as the above steps. . A mobile terminal for generating a photographed image using a camera module, a display, a communication module, a processor, a memory, and one or more programs stored in the memory and configured to be executed by the processor,
The one or more programs,
Real-time images including real-world object images generated by real-time continuous shooting of real-world scenes on the display are continuously output to the display,
Outputting the synthesis object image stored in the memory to the display,
The composite object image and the real world image are disposed on the display, and when the composition object image is selected to be superimposed on the rear surface of the real world object image, the composite object image is displayed on the rear surface of the real world object image which is continuously output in real time. Allows nested object images to overlap
And instructions for generating a photographing image including the composition object image and the real world object image disposed on the display. The method of claim 14, wherein the one or more programs,
And after the outputting of the real world image to the display, selecting the real world object image from the real world image to be overlapped with the synthesis object image. The method of claim 14,
Providing the composition object image to be located in a first layer, and providing the real world object image to be located in a second layer,
The arrangement is
When the composition object image and the real world object image located on the first layer and the second layer are disposed on the display, and a command for receiving the synthesis object image located behind the real world object image is received, And a first layer positioned at a rear surface of the second layer so that the composition object image is superimposed on a rear surface of the real world object image. The method of claim 16,
And extracting only the real world object image from the real world image and placing the extracted real world object image on the second layer. The method of claim 16,
And performing a transparent process on the remaining images except for the real world object image in the real world image, and placing the real world object image and the transparent processed image on the second layer. The method of claim 17,
And a real world background image excluding the real world object image extracted from the real world image in a third layer. The method of claim 19, wherein when generating the photographed image,
And generating the photographed image by further including the real world background image of the third layer. The method of claim 14, wherein when generating the photographed image,
And the memory includes one or more background images, and further comprising a selected background image of the background images to generate the photographed image. The method of claim 14,
And controlling the size or position of the composition object image output to the display according to a control command input to the mobile terminal. The method of claim 14,
The composition object image is a mobile terminal, characterized in that generated in the mobile terminal or generated in another mobile terminal provided through the communication module. The method of claim 23, wherein
The synthesis object image is a mobile terminal, characterized in that it comprises only the object image, the background image is excluded. The method of claim 23, wherein
And when the synthesis object image is generated, the remaining images other than the synthesis object image are generated as a background image. The method of claim 14,
By using the communication module to be transmitted to the other mobile terminal so that the composite image and the photographed image in which the real-world object image is placed, can be used as a composite object image,
The other mobile terminal may include the composition object image received from the photographed image as a composition object image and the real world object image of the other mobile terminal using one or more programs including the same instructions as the instructions. The mobile terminal, characterized in that for generating a photographing image.

Images