KR102133735B1 - Panorama chroma-key synthesis system and method - Google Patents

Abstract

The present invention is a technique for synthesizing an object image into a panoramic image such as a VR image that allows a user to observe a background through 360-degree rotation, thereby providing a natural chroma key composite image as if an object is actually present in the space of the image. For this purpose, in the present invention, a panoramic image storage unit for storing a 360-degree panoramic background image centered on a photographing point, an image input unit for receiving an image of an object, and a background from an image input from the image input unit An object image extracting unit for extracting a chroma back and removing the background chroma back to extract the object image of the object, and includes information on the distance and angle of the object from a shooting point of the panoramic image An object location information receiving unit that receives the object location information, sets a view window corresponding to the virtual gaze on the basis of virtual gaze information, and reproduces an image included in the set view window among the panoramic background images as a reproduction background image Based on the background image generation unit and the received object location information, size information of the object image and location information in the image where the object image will be located are generated in the reproduced background image, and the size information and the image of the object image are generated. Provided is a panoramic chromakey synthesis system including a synthesized image generator that synthesizes the reproduced background image and the object image based on location information to generate a synthesized image.

Description

Panoramic chroma-key synthesis system and method

The present invention is a technology related to a panoramic chroma key synthesis system and method, and an object image is synthesized in a panoramic image such as a VR image in which a user can observe a background through 360-degree rotation, so that the object is actually present in the space of the corresponding image. The present invention relates to a technique for providing a natural chroma key composite image.

The technology of chroma key synthesis, which started from news, weather forecasts, and election broadcasting, is currently spreading to movies, Internet broadcasting stations, small and medium-sized productions, in-house broadcasting stations, educational broadcasting stations, and private broadcasting stations.

As shown in FIG. 1, the chromakey compositing technology photographs an object such as a commentator appearing on the screen in a single color background, extracts the object by removing the corresponding color, and synthesizes the extracted object into a background image, thereby Is to provide the same effect as being together in the background image.

However, such a conventional chroma key synthesis system is merely an object showing an image as a background, and there is a problem in that it does not provide an immersive feeling as if an actual object exists in a corresponding space.

The prior art, Korean Patent Registration No. 10-1688926, “Augmented Reality Image Production Device and Method Using Chroma Key,” synthesizes objects on a simple background like this and solves the problem of spoiling immersion. Was synthesized to provide a more realistic image.

However, the background screen has been changed to a live video, and there is no way to take account of the location information between the live video background and the object, making it difficult to create a natural video. By making the decision, it was difficult to apply it to educational content, not live video.

Therefore, there is a need for a chroma key synthesis technology that allows objects to be naturally arranged in various images.

Korean Registered Patent No. 10-1688926

The present invention aims to maximize the immersion by providing a natural composition of objects on a 360-degree panoramic image.

In addition, an object of the present invention is to provide an effect of having an object in a corresponding space by resizing the composition position and size of an object according to a user's gaze movement command in a panoramic image.

In addition, the present invention synthesizes an object image based on information on a distance from a shooting point where a background photographed on a panoramic image is separated from a shooting point, and when the panoramic image is indoor shooting and outdoor The aim is to provide a natural composite image regardless of the shooting.

In addition, an object of the present invention is to provide an effect such that an actual object exists in a panoramic background image by providing the object image by changing it according to an angle at which the object is viewed in the panoramic image.

In order to achieve this object, the panoramic chroma key synthesis system according to an embodiment of the present invention includes a panoramic image storage unit for storing a 360-degree panoramic background image centered on a shooting point, and an image input unit for receiving an image of an object , An object image extraction unit that extracts a background chroma back from the image input from the image input unit and removes the background chroma back to extract the object image of the object, and the object from a shooting point of the panoramic image. An object location information receiving unit that receives object location information including information on a distance and an angle to be located, sets a view window corresponding to the virtual gaze based on virtual gaze information, and includes a view window set among the panoramic background images On the basis of the playback background image generation unit for generating a video as a playback background image and the received object location information, generate size information of the object image in the playback background image and location information in the image where the object image will be located, And a synthesized image generator for synthesizing the reproduced background image and the object image based on the size information of the object image and location information in the image.

In addition, further comprising a movement command receiving unit for receiving a movement command for the virtual gaze information from the user, the playback background image generation unit, in response to the movement command, moves and resets the view window, the reset view window It may be configured to be characterized by generating the image included in the playback background image.

In addition, the synthesized image generation unit regenerates location information in an image in which the object image is to be located in the reproduced background image, in response to a pre-movement command, and based on the reproduced image location information and the reproduced background image and the It may be configured to be characterized by synthesizing the object image.

In addition, the panoramic image storage unit stores distance information between the photographing point and the panoramic background image, and the composite image generation unit includes the distance information between the photographing point and the panoramic background image and the object from the photographing point. Generating size information of the object image and location information in the image where the object image will be located based on a distance, and synthesizing the playback background image and the object image based on the size information of the object image and location information in the image It can be configured as a feature.

In addition, the transformed object image generating unit further generates a transformed object image by transforming the object image based on the virtual gaze information and the angle information on which the object is located, and the synthesized image generating unit includes the reproduced background image and the transformed image. It may be configured to synthesize the object image.

In addition, the transformed object image generating unit generates a side image of the object using the stereoscopic shape information of the object, and adjusts the angle at which the object is viewed by using the side image according to the movement command to receive the modified object image. Can be configured to generate.

According to the present invention, it is possible to maximize the immersion by providing the object by naturally synthesizing it into a 360-degree panoramic image.

In addition, according to the present invention, the composite position and size of an object may be re-adjusted according to a user's gaze movement command within a panoramic image to provide a synthesized image, thereby providing the effect of having an object in the corresponding space.

In addition, according to the present invention, a background image photographed on a panoramic image is synthesized based on information on a distance from a shooting point and an object on a distance from a shooting point, and the panoramic image is taken indoors. A natural composite image may be provided regardless of the outdoor shooting.

In addition, according to the present invention, the object image is transformed and provided according to an angle at which the object is viewed in the panoramic image, thereby providing an effect as if an actual object exists in the panoramic background image.

1 is a diagram illustrating an example of an image synthesized in a conventional chromakey synthesis technique.
2 is a view showing the configuration of a panoramic chroma key synthesis system according to an embodiment of the present invention.
3 is a diagram illustrating an embodiment of a method of determining a view window and a composition position of an object in a panoramic chroma key composition system according to an embodiment of the present invention.
4 is a view showing an embodiment of a method for determining a composition position of an object according to a distance between an object and a photographing point in a panoramic chroma key composition system according to an embodiment of the present invention.
FIG. 5 is a diagram illustrating an embodiment of a method of generating another viewpoint image according to a user's virtual viewpoint movement command in a panoramic chroma key synthesis system according to an embodiment of the present invention.
6 is a diagram illustrating an embodiment of a method for generating a composite image according to a zoom-in or zoom-out command of a user in a panoramic chroma key composition system according to an embodiment of the present invention.
7 is a view showing an embodiment of a method for generating a modified object according to an angle at which an object is viewed in a panoramic chroma key composition system according to an embodiment of the present invention.
8 is a flowchart showing a flow of a method for synthesizing a panoramic chroma key according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In describing the present invention, when it is determined that a detailed description of related known configurations or functions may obscure the subject matter of the present invention, the detailed description will be omitted. In addition, in describing the embodiments of the present invention, specific numerical values are merely examples, and the scope of the invention is not limited thereby.

The panoramic chroma key synthesis system according to the present invention may be configured in the form of a server having a central processing unit (CPU) and a memory (memory, storage) and connectable to other terminals through a communication network such as the Internet. However, the present invention is not limited by the configuration of the central processing unit and memory. In addition, the panoramic chromakey synthesis system according to the present invention may be physically configured as a single device, or may be implemented in a distributed form over a plurality of devices, and the present invention is not limited by the configuration of such a physical device. No.

2 is a view showing the configuration of a panoramic chroma key synthesis system according to an embodiment of the present invention.

The panoramic chroma key synthesis system 200 according to the present invention includes a panoramic image storage unit 210, an image input unit 220, an object image extraction unit 230, an object location information receiving unit 240, and a playback background image generation unit ( 250), a composite image generator 260, a movement command receiver 270, and a modified object image generator.

The panoramic image storage unit 210 stores a 360-degree panoramic background image centered on a photographing point. The panoramic image includes a 360 degree horizontal image centered on the shooting point and an omnidirectional image vertical and horizontal direction centered on the shooting point, and various methods can be applied to store the panoramic image. have.

The panoramic image stored in the panoramic image storage unit 210 may be an image captured simultaneously using a plurality of cameras, and each camera may receive two-dimensional image data and connect them to each other to generate a panoramic image. . The panoramic image may be mapped to a predetermined format (such as a sphere or cube) and stored in a two-dimensional data format. Such a format is called a projection format.

As described above, the panorama image stored in the projection format may be reproduced as a two-dimensional image in conformity with a view window viewed by the user when the user plays it.

Meanwhile, the panoramic image storage unit 210 may store distance information between the photographing point and the panoramic background image, and a distance between the photographing point and the image may vary according to a photographing position of the panoramic image. For example, in the case of a panoramic image photographed indoors, the distance from the photographing point to the wall surface photographed on the image may be only a few meters, and when photographed outdoors, it may reach tens of meters to several kilometers.

As described above, depending on where the panoramic image stored in the panoramic image storage 210 is captured, it is possible to generate a more natural image in synthesizing the object image derived through chromakey in the future. The distance information between the photographing point and the panoramic background image may be information input by the photographer in m units at the time of photographing, and stored in correspondence with image information in a database, so that it can be used for natural image synthesis in the future.

The image input unit 220 receives an image of an object. In order to synthesize chromakeys, it is necessary to place an object against a wall of a single color in a studio or the like and receive an image of it. The image input unit 220 may receive such an image through image capturing equipment such as a camera and extract an object from it.

The image input unit 220 may simultaneously receive a plurality of camera images in order to provide a three-dimensional image from various angles, and it is also possible to receive a single camera image and generate an image based thereon. When multiple camera images are input at the same time, in synthesizing an object image to a panoramic image in the future, natural image synthesis may be possible using an object image of various angles.;

The object image extraction unit 230 extracts a background chroma back from the image received from the image input unit, and removes the background chroma back to extract the object image of the object.

The object image extractor 230 receives the image captured in the studio from the image input unit 220 and extracts an object image of the object except for the blue screen background chroma back, wherein the background image is chroma back) is mainly one of red, green, and blue, but a blue screen that is mainly blue is used.

The object image extractor 230 converts a pixel corresponding to a predetermined background chromaback color into a transparent pixel, so that it is possible to generate an object image in which only the object is visible and the background portion can be synthesized in another image.

The object location information receiving unit 240 receives object location information including information on a distance and an angle at which the object is located from a photographing point of the panoramic image.

The object location information received from the object location information receiving unit 240 may be input by a synthesized image producer synthesizing a chroma key image by deciding how to synthesize the object with a panoramic image. It can be input in units, and it is possible to enable natural image synthesis along with distance information from the panoramic image to the background image.

In addition, the angle information of the object location information received from the object location information receiving unit 240 may input a number of degrees of the angle from the reference point when the reference point is set by setting a specific portion to 0 degrees in the omnidirectional 360 degrees. , Through this, it is possible to fix the position of the object to a specific position, and to make it possible to create a natural image such as a real object at the corresponding position on the background.

The object location information receiving unit 240 may allow the composite image producer to input the distance information and angle information numerically, and provide a range of panoramic images in a circular shape, and click a desired location of the composite image producer within the circle. It is also possible to input the location.

The reproduction background image generation unit 250 sets a view window corresponding to the virtual gaze based on virtual gaze information, and generates an image included in the set view window among the panoramic background images as a reproduction background image.

As described above, the panoramic image is stored in the projection format. Among the images in the projection format, the user's current viewing position is set as the view window, and the part corresponding to the view window is extracted and the user's It can be provided to a screen or a VR terminal.

The reproduction background image generation unit 250 sets a view window for reproducing the panoramic image in this way, and generates an image included in the view window among the panoramic images as a reproduction background image. The view window can be moved according to the user's manipulation, and through such movement, the user can obtain an effect similar to looking around in the corresponding space.

The synthesized image generation unit 260 generates size information of the object image in the playback background image and location information in the image where the object image will be located, based on the received object location information, and size information of the object image And synthesizing the reproduction background image and the object image based on the location information in the image to generate a composite image.

The synthesized image generation unit 260 sets a virtual space bordering the panoramic image for natural image synthesis, determines a location of the object based on object location information in the virtual space, and then determines a location in the view window. In the range and size where the object is located can be determined, and based on this, the object can be synthesized in a playback background image.

The synthesized image generation unit 260 regenerates location information in an image in which the object image is to be located in a reproduction background image in response to a movement when a user's movement command is issued, and based on the location information in the regenerated image The reproduction background image and the object image may be synthesized. In this way, by generating a composite image in response to a user's movement command in real time, it is possible to generate a natural image as if an actual object exists in the corresponding space.

In addition, the synthesized image generation unit 260 based on the distance information between the photographing point and the panoramic background image and the distance the object is located from the photographing point, the size information of the object image and the image in which the object image will be located The location information may be generated, and the reproduction background image and the object image may be synthesized based on the size information of the object image and the location information in the image. Through this, when the background and the object of the panoramic image are close, when moving the image , The background and the object move at a similar speed, and when the background and the object are far apart, the background moves at a much higher speed, so that a natural effect such as the actual object is at the corresponding position can be obtained.

In addition, the composite image generation unit 260, for natural image synthesis, when an image is input through a plurality of cameras from the image input unit 220, photographs at a corresponding angle according to the angle of the object in the view window It is possible to proceed the synthesis using the old camera image. Through this, it is possible to naturally show both the situation in which the object is viewed from the front and the side from the side, and natural image generation is possible.

In addition, when an image is input from the image input unit 220 with a single camera, the input object image is transformed according to a visible angle to generate an image such as a side and synthesized corresponding to the angle at which the object is located in the view window. By doing so, it is possible to enable natural image generation.

The movement command receiving unit 270 receives a movement command for the virtual gaze information from a user.

As described above, the user's moving command received by the moving command receiving unit 270 may obtain an effect such as looking around the panoramic image space by moving the view window within the panoramic image.

The movement command receiving unit 270 may allow a user to input a movement command through an operation such as a keyboard, mouse, or touch for this effect, and when using a wearable device such as a VR headset, recognizes the user's movement By receiving a movement command, it is possible to provide an effect such as looking around naturally.

The deformed object image generating unit 280 generates a deformed object image by deforming the object image based on the virtual gaze information and the angle information where the object is located.

As described above, when an image is input from the image input unit 220 using a single camera, the front image is synthesized even when the side angle of the object is seen, thereby providing an unnatural image. Accordingly, the deformed object image generating unit 280 may deform an image photographed from the front to provide a shape such as viewing a side, so that a more natural image can be provided.

Even when only the front image of the object is photographed using a fixed camera, when the object is formed of a curved surface, the side image is partially photographed on the front image of the object. At this time, the image of the side is photographed in a compressed (distorted) form of the actual side according to the viewing angle. If the three-dimensional shape of the object can be grasped, the compressed (distorted) object Partial side images can be reconstructed.

That is, it is possible to generate a partially rotated image by restoring it to a 3D model up to the portion seen from the front image.

The deformed object image generating unit 280 may generate object stereoscopic shape information using a sensor that senses an object such as an infrared sensor and an image sensor.

In addition, the modified object image generation unit 260 may recognize a category of an object and estimate and generate a normal shape based on the object category. The object category includes a category of a person or an object that can be an object. For example, in a person category, information for each part such as face, body, arm, leg, hand, foot, etc. may be stored as category information. When the object is a human, it is possible to extract the object three-dimensional shape information by recognizing a portion or information necessary for generating the three-dimensional shape information and estimating the side surface of the object based on the category.

3 is a diagram illustrating an embodiment of a method of determining a view window and a composition position of an object in a panoramic chroma key composition system according to an embodiment of the present invention.

As shown in the figure, the panoramic image is an image taken around the periphery around the photographing point, and thus the photographed image is arranged in a portion corresponding to a circular border.

In the case of playing a panoramic image, since the entire image cannot be displayed at once, the user sets a virtual view point to be viewed within the panoramic image, sets a virtual view range as a view window, and transmits the image belonging to the view window to the user's terminal. Will play.

Since the object 310 is visible at the point of view of the first view window 320 shown in the drawing, in this case, the synthesized image generation unit 260 synthesizes and provides the object at the corresponding position of the background image. On the other hand, when looking at the second view window 330, since the object is not visible within the range of the field of view, it is not synthesized by including the object in the image seen by the composite image generation unit 260.

Accordingly, when the user views the virtual gaze by moving, it is possible to obtain an effect that the object looks as if it is actually present at a specific location.

4 is a view showing an embodiment of a method for determining a composition position of an object according to a distance between an object and a photographing point in a panoramic chroma key composition system according to an embodiment of the present invention.

As shown in (a) of the drawing, when the distance from the photographing point to the object is 10 m, and the distance from the photographing point to the background image is set to 20 m, the object 310 is disposed in the middle in the virtual space. As you can see, you can create an image.

In addition, as shown in (b) of the drawing, when the distance from the shooting point to the object is 10 m, and the distance from the shooting point to the background image is set to 100 m, the object is located at a point of 10% in the virtual space. As you can see, you can create an image.

By determining the placement position of the object as described above, when moving the image, the moving speed between the object and the background image may be differently displayed, and accordingly, an effect as if the actual object is at the corresponding location can be obtained.

FIG. 5 is a diagram illustrating an embodiment of a method for generating a different viewpoint image according to a user's virtual viewpoint movement command in a panoramic chroma key synthesis system according to an embodiment of the present invention.

As shown in the case where the user moves the viewpoint from (a) to (b) of the drawing, the object 310 synthesized in the center of the background image moves to the left of the background image. By naturally changing and setting the position at which the object is synthesized according to the movement command, it is possible to provide the user with a natural look around the panoramic image space.

In addition, when the object is located in the center as shown in (a) of the drawing, since the front of the object is visible from the camera, it is natural to provide a composite image of the object, and it is natural to view the object as shown in (b) of the drawing. When it is located on the side of the window, since the side of the real object is visible, it is natural to provide an image of the side of the object.

To this end, it is possible to receive an object image of various angles from the image input unit 220 and synthesize the image of the required angle in the composite image generation unit 260, as described above when shooting an object using only one camera. Similarly, by transforming the object as a side image through the deformed object image generating unit 280, it is possible to provide a natural image.

6 is a diagram illustrating an embodiment of a method for generating a composite image according to a zoom-in or zoom-out command of a user in a panoramic chroma key composition system according to an embodiment of the present invention.

In the panoramic image, the user can issue a zoom-in or zoom-out command as well as a move command. According to the zoom-in command and zoom-out command, the size of the view window is adjusted to enlarge or reduce the image. When enlarged to b), as shown in the drawing, the viewing angle of the view window displayed on the screen is narrowed to provide a larger image within the same screen. At this time, from the shooting point to the object, also from the shooting point to the background Depending on the distance to the image, an enlarged image is provided differently.

In other words, if the object is located very close to the camera as shown in the drawing, zooming in as shown in (b) will fill most of the image, so that the same effect can be obtained by actually shooting the object located near the camera. There will be.

7 is a view showing an embodiment of a method for generating a modified object according to an angle at which an object is viewed in a panoramic chroma key composition system according to an embodiment of the present invention.

The deformed object image generator 280 deforms the object image to generate a deformed object image. The side image of the object may be generated using the stereoscopic shape information of the object, and the angle at which the object is viewed may be adjusted using the side image of the object.

Even when only the front image of the object is photographed using a fixed camera, when the object is formed of a curved surface, the side image is partially photographed on the front image 710 of the object. At this time, the image of the side is photographed in a compressed (distorted) form of the actual side by the viewing angle. If the three-dimensional shape 740 of the object can be grasped, compression (distortion) is performed based on the three-dimensional shape information of the object. It is possible to partially reconstruct the side image of the object.

That is, it is possible to generate a partially rotated image by restoring it to a 3D model up to the portion seen from the front image.

The deformed object image generation unit 280 extracts the object image using the sensor that detects an object such as an infrared sensor and an image sensor from the object image extraction unit 230, then generates a side image of the object and uses the side image A deformed object image 720 may be generated by adjusting an angle at which the object is viewed.

8 is a flowchart illustrating a flow of a method for synthesizing a panoramic chroma key according to an embodiment of the present invention.

The method for synthesizing the panoramic chroma key according to the present invention is not limited to the following description, and all descriptions applied to the chroma key composition system 200 may be applied.

The panorama image storage step (S801) stores a 360-degree panoramic background image centered on a photographing point. The panoramic image includes a 360 degree horizontal image centered on the shooting point and an omnidirectional image vertical and horizontal direction centered on the shooting point, and various methods can be applied to store the panoramic image. have.

In the image input step (S802 ), an image photographing the object is received. In order to synthesize chromakeys, it is necessary to place an object against a wall of a single color in a studio or the like and receive an image of it. The image input unit 220 may receive such an image through image capturing equipment such as a camera and extract an object from it.

In the object image extraction step (S803 ), an image captured in the studio is input from the image input unit 220 to extract an object image of the object except for a blue screen background chroma back, wherein the background image is chroma. back) is mainly one of red, green, and blue, but a blue screen that is mainly blue is used.

In step S804 of receiving object location information, object location information including information on a distance and an angle at which the object is located is received from a photographing point of the panoramic image.

In the reproduction background image generation step (S805 ), a view window corresponding to the virtual gaze is set based on the virtual gaze information, and an image included in the set view window among the panoramic background images is generated as a reproduction background image.

As described above, the panoramic image is stored in the projection format. Among the images in the projection format, the user's current viewing position is set as the view window, and the part corresponding to the view window is extracted and the user's It can be provided to a screen or a VR terminal.

In step S806, the movement command reception step receives the movement command for the virtual gaze information from the user. As described above, the movement command of the user received in the movement command reception step (S806) may obtain an effect such as looking around in the panorama image space by moving the view window within the panorama image.

In step S807 of generating a deformed object image, the deformed object image is generated by deforming the object image based on the virtual gaze information and the angle information of the object.

As described above, when an image is input from the image input unit 220 using a single camera, the front image is synthesized even when the side angle of the object is seen, thereby providing an unnatural image. Accordingly, the deformed object image generating unit 280 may deform an image photographed from the front to provide a shape such as viewing a side, so that a more natural image can be provided.

The synthesized image generating step (S808) generates size information of the object image in the playback background image and location information in the image where the object image will be located, based on the received object location information, and size information of the object image And synthesizing the reproduction background image and the object image based on the location information in the image to generate a composite image.

As described above, the method for synthesizing a panoramic chroma key may be implemented as an application or may be recorded in a computer-readable recording medium by being implemented in the form of program instructions that can be executed through various computer components. The computer-readable recording medium may include program instructions, data files, data structures, or the like alone or in combination.

The program instructions recorded on the computer-readable recording medium are specially designed and configured for the present invention, and may be known and available to those skilled in the computer software field.

Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CDROMs, DVDs, and magneto-optical media such as floptical disks. And hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like.

Examples of program instructions include not only machine language codes produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform processing according to the present invention, and vice versa.

Although described above with reference to embodiments, those skilled in the art can variously modify and change the present invention without departing from the spirit and scope of the present invention described in the following claims.

200: panoramic chromakey synthesis system
210: panoramic image storage unit 220: image input unit
230: object image extraction unit 240: object location information receiving unit
250: playback background image generation unit 260: composite image generation unit
270: moving command receiving unit 280: transform object image generating unit

Claims (13)

A panoramic image storage unit for storing a 360-degree panoramic background image centered on a photographing point;
An image input unit for receiving an image of the object;
An object image extraction unit for extracting a background chroma back from the image input from the image input unit and removing the background chroma back to extract an object image of the object;
An object location information receiving unit receiving object location information including information on a distance and an angle at which the object is located from a photographing point of the panoramic image;
A playback background image generator configured to set a view window corresponding to the virtual gaze based on virtual gaze information and generate an image included in the set view window among the panoramic background images as a playback background image;
Based on the received object location information, size information of the object image and location information in the image where the object image will be located are generated in the playback background image, and based on the size information of the object image and location information in the image. A synthesized image generator for synthesizing the reproduced background image and the object image to generate a synthesized image;
A movement command receiving unit for receiving a movement command for the virtual gaze information from a user and
Based on the virtual gaze information and the angle information on which the object is located, a side image of the object is generated using the three-dimensional shape information of the object, and an angle at which the object is viewed is generated using the side image according to the movement command. Deformed object image generation unit to adjust and generate a deformed object image
Including,
The playback background image generation unit may reset and reset the view window by moving the view window in response to the movement command, and generate an image included in the reset view window as a playback background image,
The synthesized image generation unit synthesizes the reproduced background image and the modified object image generated by the modified object image generation unit
Panorama chroma key synthesis system, characterized by. delete According to claim 1,
The composite image generator
In response to the movement command, regenerating location information in an image in which the object image is to be located in the reproduced background image, and synthesizing the reproduced background image and the object image based on the regenerated location information in the image.
Panorama chroma key synthesis system, characterized by. According to claim 1,
The panoramic image storage unit
Storing distance information between the photographing point and the panoramic background image,
The composite image generator
Based on the distance information between the photographing point and the panoramic background image and the distance where the object is located from the photographing point, size information of the object image and location information in the image where the object image will be located are generated, and the object image Synthesizing the reproduced background image and the object image based on size information of the image and location information in the image
Panorama chroma key synthesis system, characterized by. delete delete A panoramic image storage step of storing a 360-degree panoramic background image centered on a photographing point in the panoramic image storage unit;
An image input step of receiving an image of the object captured by the image input unit;
An object image extraction step of extracting a background chroma back from an image input from the image input unit by an object image extraction unit and extracting an object image of the object by removing the background chroma back;
An object location information receiving step of receiving object location information including information on a distance and an angle at which the object is located from a photographing point of the panoramic image by an object location information receiving unit;
A reproduction background image generation step of setting a view window corresponding to the virtual gaze based on virtual gaze information in the reproduction background image generation unit and generating an image included in the set view window among the panoramic background images as a reproduction background image;
The synthesized image generating unit generates size information of the object image and location information in the image where the object image will be located in the reproduced background image, based on the received object location information, and generates the size information and the image in the object image. A composite image generating step of synthesizing the reproduced background image and the object image based on location information to generate a composite image;
A moving command receiving step of receiving a moving command for the virtual gaze information from a user in the moving command receiving unit;
The deformed object image generating unit generates a side image of the object based on the virtual gaze information and the angle information of the object, and generates a side image of the object, and uses the side image according to the movement command. Deformation object image generation step of generating a deformed object image by adjusting the viewing angle of the object
Including,
In the generating of the playback background image, in response to the movement command, the view window is moved to reset, and an image included in the reset view window is generated as a playback background image,
In the generating of the synthesized image, the transformed background image and the transformed object image generated by the transformed object image generator are synthesized.
Panorama chroma key synthesis method characterized in that. delete The method of claim 7,
The synthetic image generation step
In response to the movement command, regenerating location information in an image in which the object image is to be located in the reproduced background image, and synthesizing the reproduced background image and the object image based on the regenerated location information in the image.
Panorama chroma key synthesis method characterized in that. The method of claim 7,
The image storage step
Storing distance information between the photographing point and the panoramic background image,
The synthetic image generation step
Based on the distance information between the photographing point and the panoramic background image and the distance where the object is located from the photographing point, size information of the object image and location information in the image where the object image will be located are generated, and the object image Synthesizing the reproduced background image and the object image based on size information of the image and location information in the image
Panorama chroma key synthesis method characterized in that. delete delete A recording medium recording a program for executing the method of any one of claims 7, 9, and 10.

Images