KR20190061167A - Method and system for advertizing - Google Patents

Abstract

Disclosed are a method for providing an advertisement and a system therefor. The method comprises the steps of: determining a visual area confirmed by a user of a 360 degree image by the system; adding the visual area determined by the system as an advertising area where predetermined advertising content may be disposed; and disposing the predetermined advertising content in a current advertising area by the system.

Description

Method and system for advertising < RTI ID = 0.0 >

The present invention relates to a method and system for generating a matched image, and more particularly to a system and method for generating a matched image (e.g., a 360-degree image) that is relatively accurate and effective without professional equipment And to a system and method that can be used.

The invention also extends to methods and systems that can provide advertisements using a matched image or 360 images.

Attempts have been made to create a matching image to provide a virtual reality or a realistic simulation environment.

For example, a panoramic image may mean an image that can cover 180 to 360 degrees of horizontal viewing angle by combining a plurality of images horizontally (horizontally).

Also, a 360-degree image may mean an image that can be covered by both the user and the user, and can generally be obtained by placing a plurality of images on a sphere or a mercator.

However, professional equipment is required to obtain such panoramic images or 360-degree images. In recent years, a user has attempted to create a matched image (e.g., a panoramic image or a 360-degree image) by matching a photograph obtained by obtaining a plurality of photographs while rotating the mobile terminal while holding a mobile terminal There was an attempt.

However, in this case, since the viewing angle or the photographing direction of the plurality of photographs is not accurate, it takes a considerable amount of time to stitch the image, and the accuracy of the image stitching is low.

In addition, conventionally, when performing the advertisement using the generated matching image or 360 image, a method which is not different from the advertising method used in the simple image has been used. That is, a method in which characteristics of 360 images are not reflected is used.

Therefore, an advertising method suitable for the characteristics of 360 images is required.

Korean Patent Application Publication No. 10-2002-0078663 entitled " Digital Sculpture Image Matching Processing Method and Matching Processing Apparatus " which aligns a plurality of sculptural images in a digital mosaic image arrangement, Korean Patent Application Publication No. 10-2014-0147597 " Mobile terminal and control method thereof " Korean Patent Application Publication No. 10-2002-0026791 " Photo-based virtual reality e-mail and advertisement service system and method using real-time image synthesis "

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and it is an object of the present invention to provide a method and system for easily and relatively accurately generating a matching image using a terminal carried by a user.

In particular, the present invention provides a method and system capable of relatively accurately knowing the direction of an image to be matched by using a driving device capable of rotating the terminal, and capable of relatively fast and accurate image matching at the time of matching of images .

In addition, the terminal performs rotation for capturing images to be matched, that is, partial images. Instead of using only images obtained through one rotation for generation of a matched image, And to provide a method and system by which images can be acquired and partial images obtained from different rotations can be used together to generate a matched image.

It is also an object of the present invention to provide an advertising method suitable for the characteristics of 360 images or matched images and a system therefor.

According to another aspect of the present invention, there is provided a method of providing an advertisement, the method comprising the steps of: determining, by a system, a base region determined by a user among 360 images; Adding the advertisement content to the advertisement area, and placing the predetermined advertisement content in the current advertisement area.

The 360 images are images in which n partial images corresponding to a certain angle are directed to different directions, and the base area confirmed by the user is determined as the partial image unit.

The method of providing an advertisement using 360 images may further include the step of determining a placement position where the advertisement content is to be placed in the advertisement area and arranging the advertisement content at a determined placement position, Wherein the step of determining the placement position in which the advertisement contents are arranged is characterized in that the system recognizes an object position where an object corresponding to the predetermined advertisement contents is displayed and determines the placement position corresponding to the recognized object position .

The method of providing an advertisement using 360 images may further include the step of determining a placement position where the advertisement content is to be placed in the advertisement area and arranging the advertisement content at a determined placement position, The step of determining the placement position where the advertisement contents are to be arranged may determine the non-important area where the advertisement contents can be displayed, and the non-important area is determined based on the image complexity.

Wherein the 360 image is an image in which n partial images oriented in different directions corresponding to a certain angle are matched images and the step of determining a placement position in which the advertisement content is to be placed in the advertisement area comprises: (K-1) partial image before the partial image is taken (k is an integer from 2 to n).

Wherein the step of arranging predetermined advertisement contents in a current advertisement area of the system includes the steps of arranging the advertisement contents in an advertisement area that is not included in the field of view of the current user among the advertisement areas, And outputting a notification signal indicating that the advertisement contents are arranged after the advertisement contents are arranged in the advertisement area.

Another example of an advertisement providing method for implementing the technical idea of the present invention is a system including a step of starting displaying a 360 image to a user's terminal and displaying predetermined advertisement contents to the 360 Wherein the step of arranging the advertisement content at a predetermined placement position included in the 360 image includes placing the advertisement content in an area not included in the current view of the user, .

Another example of the advertisement providing method for realizing the technical idea of the present invention is characterized in that the system displays the matched image corresponding to a certain angle and the n partial images directed to different directions are matched with each other, (K-1) of the partial images before the shooting of the k-th partial image, wherein k is an integer from 2 to n, ) Start to determine the placement position included in the partial image.

The above method can be implemented by a computer program recorded on a computer-readable recording medium.

One example of a system for implementing the technical idea of the present invention includes a control unit including a processor and a storage medium on which a program executed by the control unit is recorded, and the program determines a base area confirmed by the user among 360 images , Adds the determined base region as an advertisement region in which predetermined advertisement contents can be placed, and arranges predetermined advertisement contents in the current advertisement region.

In addition, a system according to another example includes a control unit including a processor and a storage medium in which a program executed by the control unit is recorded, the program causing the system to start displaying 360 images on the user's terminal, A predetermined advertisement content is arranged at a predetermined placement position included in the 360 image while being displayed, and the placement position is an area not included in the current view of the user.

According to another aspect of the present invention, there is provided a system including a control unit including a processor and a storage medium on which a program to be executed by the control unit is recorded, (K is an integer from 2 to n) of the partial images, in order to determine a placement position at which the advertisement contents are to be placed, and to determine the placement position, (k-1) partial images.

According to the technical idea of the present invention, it is possible to easily and relatively accurately generate a matched image using a terminal carried by a user, so that anyone can easily and easily obtain a matching image (e.g., 360 images that can be utilized for VR) So that it can be utilized.

In addition, by using a driving device capable of rotating the terminal, the direction of the image to be matched can be relatively accurately known, and there is an effect that relatively fast and accurate image matching can be performed at the time of matching the images. The control of the direction (rotation angle) at the time of shooting of the image can be accurately performed. Therefore, instead of using only images obtained through one rotation to capture images to be matched, that is, partial images, There is an effect that partial images are obtained for each rotation through a plurality of rotations and a partial image obtained from different rotations is used together to generate a matching image.

For example, when there is an image difference between a partial image in which a specific direction (for example, a frontal direction) is photographed in the first rotation and a partial image in which the specific direction is photographed in the second rotation, It is possible to obtain a desired effect by matching with partial images. For example, in a partial image corresponding to a specific direction in the first rotation, there exists a feature that the user does not want (e.g., a specific object (e.g., a person or the like) is photographed) (E.g., a person or the like is not photographed) by combining the partial images of the specific direction in the second rotation with the images excluding the partial image in the specific direction in the first rotation, Images have the effect of preventing unwanted features from appearing.

In addition, by allowing an advertisement to be attached to 360 images in real time according to a user's action in 360 images, it is possible to prevent the user from inconveniencing the original image of 360 images.

In addition, since the advertisement can be arranged in real time in an area irrelevant to the scene being viewed, the user's usability can be enhanced.

In addition, since the location where the advertisement contents are to be arranged can be made in advance before the 360 images are generated after shooting the individual partial images in advance, the creation of the real time 360 images and the advertisement utilizing the real time 360 images can be effectively performed.

BRIEF DESCRIPTION OF THE DRAWINGS A brief description of each drawing is provided to more fully understand the drawings recited in the description of the invention.
1 is a block diagram of an apparatus for implementing a method of generating a matched image according to an embodiment of the present invention.
2 shows a schematic configuration of a terminal according to an embodiment of the present invention.
3 is a view for explaining a matching image and a partial image according to an embodiment of the present invention.
4 is a flowchart illustrating a method of generating a matching image according to an embodiment of the present invention.
5 is a view for explaining a concept of performing partial rotation by performing a plurality of rotations using the method of generating a registration image according to an embodiment of the present invention.
6 is a view for explaining a concept of generating a matching image by matching partial images obtained from each of a plurality of rotations through a matching image generating method according to an embodiment of the present invention.
7 to 9 are views for explaining a concept of generating a matching image by matching partial images obtained from each of a plurality of rotations through a matching image generating method according to another embodiment of the present invention.
FIG. 10 is a diagram for explaining an advertisement technique using an ephemeris according to an embodiment of the present invention. Referring to FIG.
11 is a view for explaining an arrangement position of advertisement contents according to an embodiment of the present invention.
12 is a diagram for explaining a concept that advertisement contents are arranged in 360 images in real time outside a user's view according to an embodiment of the present invention.

In order to fully understand the present invention, operational advantages of the present invention, and objects achieved by the practice of the present invention, reference should be made to the accompanying drawings and the accompanying drawings which illustrate preferred embodiments of the present invention.

Also, in this specification, when any one element 'transmits' data to another element, the element may transmit the data directly to the other element, or may be transmitted through at least one other element And may transmit the data to the other component. Conversely, when one element 'directly transmits' data to another element, it means that the data is transmitted to the other element without passing through another element in the element.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, the present invention will be described in detail with reference to the preferred embodiments of the present invention with reference to the accompanying drawings. Like reference symbols in the drawings denote like elements.

1 is a block diagram of an apparatus for implementing a method of generating a matched image according to an embodiment of the present invention.

Referring to FIG. 1, a terminal 100 may be provided to implement a matching image generating method according to the technical idea of the present invention.

The terminal 100 may include any type of data processing apparatus including an image sensor that can be carried by the user and can acquire an image. According to an example, the terminal 100 may be a user's cellular phone, but is not limited thereto. Also, it is to be understood that some of the technical ideas of the present invention may be implemented by a device that the user does not carry, and such a case may be included in the scope of the present invention.

The terminal 100 can take images (partial images) while performing a rotation. The terminal 100 may rotate 360 degrees around the terminal 100 or may not rotate 360 degrees. In any case, the terminal 100 may rotate as much as necessary to cover all angles (e.g., 360 degrees, 270 degrees, 180 degrees) to be covered by the matching image to be generated. Of course, the degree of rotation may vary depending on the viewing angle of the image sensor provided in the terminal 100.

The terminal 100 may be attached, fastened, or coupled to a predetermined driving device 200 for rotating the terminal 100. And the movement of the terminal 100 may be performed through the driving device 200. [

The terminal 100 may control the driving unit 200. According to an example, the terminal 100 may perform predetermined short range wireless communication (e.g., Bluetooth, NFC, Zigbee communication, WiFi, etc.) with the driving device 200. The terminal 100 can transmit a predetermined command to the driving apparatus 200 and the driving apparatus 200 can be driven in response to the transmitted command. Also, according to the embodiment, the driving apparatus 200 may transmit the driving result of the driving performed in response to the command to the terminal 100.

The driving device 200 may be a device that performs at least rotational motion. A rotator for the rotational motion may be provided in the driving device 200. In addition, the driving device 200 may include a predetermined fastening portion (not shown) for fastening the terminal 100.

According to an example, the driving device 200 may be a device capable of performing rotation in a predetermined reference angle unit, and may rotate in the command by a desired angle in response to a command received from the terminal 100 . In this way, the rotation angle of the driving device 200 and / or the terminal 100 can be controlled.

According to another embodiment, the driving device 200 can perform rotation in response to a command received from the terminal 100. [ The terminal 100 senses the degree of rotation of the driving device 200 (that is, the terminal 100), and transmits a command to stop the rotation of the driving device 200 when the required angle is sensed to be rotated have. In any case, the terminal 100 can control the rotation angle of the driving device 200 relatively accurately by controlling the rotation angle of the driving device 200.

The present invention is not limited only to the case where the driving apparatus 200 has a function of simply rotating the terminal 100 but the driving apparatus 200 may move, Or performing a function of changing the position of the terminal 100 up and down, and so on.

Meanwhile, the terminal 100 may be provided with a predetermined viewing angle magnifying device (e.g., a fish-eye lens or the like) 300 for enlarging a viewing angle in a specific direction (e.g., up and down direction). In this case, a viewing angle up to almost 180 degrees may be ensured by the viewing angle magnifying device. In this case, when the terminal 100 rotates so as to secure a viewing angle of 360 degrees on both sides, Image) can be generated.

As a result, according to the technical idea of the present invention, the terminal 100 controls the driving device 200 to relatively accurately rotate by a desired angle (i.e., rotate in a desired direction) to photograph an image, The image can be taken by performing the rotation. When the control of the rotation angle is performed relatively accurately by the terminal 100, the terminal 100 may know the rotation angle (viewing angle) of the adjacent image accurately, and in this case, the accuracy and speed of image registration There is an effect that can be improved.

Meanwhile, according to another embodiment, the terminal 100 does not merely perform a rotation enough to cover a desired angle and match a plurality of partial images obtained during the rotation to generate a matching image, At least one partial image may be obtained for each rotation and a partial image may be generated by matching the partial images obtained at different rotations.

This technical idea can provide a technical idea capable of generating a matched image by replacing a partial image in a specific direction obtained in a specific time interval with a partial image in the specific direction obtained in another time interval. This technical idea can be further enhanced when the rotation of the terminal 100 is accurately controlled through the driving device 200 as described above.

Also, the terminal 100 may provide advertisement contents as will be described later. For example, the terminal 100 may perform an advertisement method according to the technical idea of the present invention while displaying 360 images. Of course, according to another embodiment, a predetermined service server 400 may perform an advertisement method according to an embodiment of the present invention. Alternatively, the terminal 100 and the server 400 may be combined to perform an advertisement method according to the technical idea of the present invention.

The advertising method according to the technical idea of the present invention can provide a concept specific to an image in which an entire image (e.g., a 360 image or a 270 degree image, etc.) can not be displayed in one field of view. Hereinafter, although the concept of applying the advertisement method according to the technical idea of the present invention to 360 images will be described, it can be understood that the average of the technical field of the present invention Experts will be able to easily reason.

The advertisement method is characterized in that the base area is set as an advertisement area, that is, an area where advertisement contents can be placed. That is, the advertisement content is not placed in an area where the user has never confirmed the original image, so that at least the user can ensure that the original image is viewed once for the whole area of the image.

Also, because of this feature, the advertisement method may have a feature that the advertisement contents are placed in a part of the 360 image in real time while the user views the 360 image. Further, the advertisement content may be placed outside the user's view.

The configuration of the terminal 100 for implementing such a technical idea will be described with reference to FIG.

2 shows a schematic configuration of a terminal according to an embodiment of the present invention.

Referring to FIG. 2, the terminal 100 includes at least a controller 110, an audio / video (A / V) input module 120, and a storage medium 160. The terminal 100 may further include a communication module 130, a dispatch module 140, and an input module 150. The terminal 100 may communicate with a predetermined service server 400. In this case, the communication module 130 may include a wireless Internet device for communicating with the service server 400.

Further, the components shown in Fig. 2 are not essential, and a mobile terminal having more or fewer components may be implemented.

Refers to hardware (e.g., the control unit 110 and / or the storage medium 160) for performing the technical concept of the present invention and software for driving the hardware The above program for implementing ideas). For example, each of the above configurations may refer to a logical unit of a predetermined code and a hardware resource for executing the predetermined code, and may be a code physically connected to one another or a specific type of hardware May be easily deduced to the average expert in the field of the present invention. Accordingly, each of the above-described configurations refers to a combination of hardware and software that performs the functions defined in this specification, and does not mean a specific physical configuration.

The A / V (Audio / Video) input module 120 includes at least an image sensor 121. The A / V input module 120 may include a plurality of image sensors 121 according to an embodiment of the present invention. It is possible.

Also, according to an embodiment, the A / V (Audio / Video) input module 120 may further include another configuration (for example, a microphone) for inputting an audio signal or a video signal.

The communication module 130 includes a short-range communication module 131. In addition, as described above, a wireless communication apparatus (not shown) may be further provided to perform communication with an external wireless communication system if necessary.

The terminal 100 may communicate with the driving device 200 through the short-range communication module 131 included in the communication module 130. The local area communication protocol performed by the local area communication module 131 is, for example,

Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, WiFi, and the like.

The output module 140 may be a configuration for generating an output related to visual, auditory, or tactile. For example, a display device, an audio output device, an alarm device, and a haptic module may be included.

The terminal 100 may display a matching image or 360 images through the output module 140. Also, the control unit 110 can determine whether the area displayed by the output module 140 is the matching image or the 360 image. The area identified by the user as described above (the area corresponding to the area displayed through the output module 140 is referred to as a staring area in this specification).

The origin area may refer to the area actually displayed by the output module 140 (i.e., only a portion of the partial image may be the origin area) regardless of the registration image or the partial image that constitutes the 360 image, According to an embodiment, the predicated area may be determined for each partial image.

And the advertisement contents can be arranged at a predetermined arrangement position of the matched image or the 360 images using the identification result of the base area.

Of course, the arrangement of the panda and the advertisement contents in the base area may be performed in the service server 400 to which the terminal 100 to reproduce 360 images is connected.

The input module 150 is configured to receive a desired input signal from the terminal 100. For example, a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The storage medium 160 may be a device that can permanently or temporarily store data generated by the terminal 100 or input from the outside in order to implement the technical idea of the present invention.

According to an embodiment, the storage medium 160 may be divided into a plurality of different physical devices, and a part of the storage medium 160 may exist inside the controller 110 according to an embodiment. The storage medium 160 may be implemented as a hard disk, a solid state disk (SSD), an optical disk, a random access memory (RAM), and / or various other types of storage media according to embodiments, And may be detachably mounted on the terminal 100. [

According to an exemplary embodiment, the storage medium 160 may store a program for implementing the technical idea of the present invention. The program can be driven (executed) by the control unit 110, and the functions defined in the present invention can be performed by executing the program. Hereinafter, the functions defined in this specification may be performed by the program unless otherwise specified.

The controller 110 may include a processor and may control the overall operation of the terminal 100. The controller 110 may include a processor, a microprocessor, and the like, and may implement the technical idea of the present invention by driving a program stored in the storage medium 160 as described above.

In addition, the terminal 100 may include a predetermined sensing module (not shown), and the sensing module may determine whether the terminal 100 is open or closed, the position of the terminal 100, Direction of the terminal, acceleration / deceleration of the terminal, and the like. Also, the terminal 100 may be controlled based on the sensed information by sensing the rotation angle of the terminal 100 as described above.

According to an example, the terminal 100 may control the driving unit 200 to obtain partial images while performing rotation. The acquired partial images may be subjected to matching, and the matching of the partial images may be performed in the terminal 100. [ However, the matching of the partial images may be performed by the service server 400 performing communication with the terminal 100. In this case, the terminal 100 may transmit the partial images to the service server 400 Lt; / RTI > If necessary, the matching image can be received from the service server 400 and displayed on the terminal 100.

3 is a view for explaining a matching image and a partial image according to an embodiment of the present invention.

Hereinafter, unless otherwise explicitly stated otherwise, a matching image matched by terminal 100 or service server 400 may refer to a 360 degree image (sphere image). In addition, the terminal 100 rotates 360 degrees and rotates 360 degrees to photograph six different partial images. Also, the function of matching partial images is also exemplarily described as performed by the terminal 100, but the matching of partial images can be performed by the service server 400 as described above.

3A, the terminal 100 may capture n (e.g., 6) partial images (e.g., 10-1 through 15-1) to generate a matched image. For this, the terminal 100 may control the driving device 200 to rotate in n directions (for example, 10 to 15), and then take a partial image in each direction.

For example, the terminal 100 may photograph the first partial image 10-1 in the first direction 10 and control the driving device 200 to face the second direction. Then, the second partial image 11-1 can be photographed in the second direction 11. In this manner, the terminal 100 can sequentially acquire six partial images. In this case, it is preferable that the image sensor 121 of the terminal 100 has a viewing angle at least greater than 60 degrees. The terminal 100 can sequentially acquire partial images (e.g., 10-1 to 15-1) through rotation and photographing, so that it is possible to know what partial images are adjacent to each other. Further, since the direction of each partial image is accurately known, it is possible to easily determine the overlapping area between the partial images, and thus the image matching can be performed relatively quickly.

In order for the terminal 100 to perform the rotation, the terminal 100 may transmit a command to rotate the driving device 200 at a predetermined angle (for example, 60 degrees). Upon receiving a signal indicating that the rotation has been performed from the driving device 200 by the angle in response to the command, the terminal 100 can photograph a partial image.

According to another embodiment, the terminal 100 may output a command to rotate the driving apparatus 200 to the driving apparatus 200. When the driving device 200 rotates in response to the rotation, the terminal 100 may sense the rotation angle. If the rotation angle corresponds to a desired angle, the terminal 100 may output a command for stopping the rotation to the driving device 200. [ Then, the driving device 200 can stop the rotation, and the terminal 100 can shoot a partial image.

In any manner, the terminal 100 may perform a rotation by a desired angle to take a partial image at the angle (direction) performed.

However, the technical idea of the present invention does not necessarily require the terminal 100 to be rotated 360 degrees to the left and right, and may rotate only an angle necessary to generate a matched image covering a predetermined angle. Such an example may be as shown in FIG. 3B.

As shown in FIG. 3B, the terminal 100 can generate a matched image covering 180 degrees, and for this purpose, the terminal 100 sequentially moves n directions (for example, 12 directions including 21) It is possible to photograph n partial images (e.g., 12 partial images including 21-1) in the n direction while rotating. The partial images may be matched to produce a matched image covering 180 degrees.

The matching image generating method of the present invention can be summarized as shown in FIG.

4 is a flowchart illustrating a method of generating a matching image according to an embodiment of the present invention.

Referring to FIG. 4, the terminal 100 may acquire a partial image in a predetermined direction (S10). Then, the driving device 200 may be controlled to perform the rotation by a predetermined angle (S20). Then, the corresponding partial image can be obtained in the state where the rotation is performed (S30). Then, it is determined whether n partial images corresponding to the desired n directions have been acquired (S40). If it is determined that all of the n partial images have not been acquired (S40), the terminal 100 can control the driving device again to perform rotation and acquire a partial image (S20, S30).

If it is determined that all the n partial images have been acquired (S40), the terminal 100 may perform a matching process of matching the obtained partial images (S50). The matching process may be a process in which the terminal 100 directly performs image matching or the terminal 100 transmits partial images to the service server 400 and causes the service server 400 to match partial images The process can be referred to as described above.

Meanwhile, the technical idea of the present invention allows the terminal 100 to perform a plurality of rotations, as described above, so that partial images obtained through different rotations can be used to generate a single matched image.

Such an example will be described with reference to Figs. 5 to 6. Fig.

5 is a view for explaining a concept of performing partial rotation by performing a plurality of rotations using the method of generating a registration image according to an embodiment of the present invention. 6 is a view for explaining a concept of generating a matching image by matching partial images obtained from each of a plurality of rotations through a matching image generating method according to an embodiment of the present invention.

5A, the terminal 100 rotates to face n (e.g., six to six) directions (e.g., 10 to 15), and then, in each direction (for example, 10 to 15) (For example, 10-1 to 15-1). This rotation and photographing process are defined as basic rotation.

Then, the terminal 100 may perform the additional rotation, instead of generating the matching image by matching the partial images (e.g., 10-1 to 15-1) obtained through the basic rotation. And may obtain at least one partial image through further rotation. The additional rotation may be once or more, but for convenience of explanation, it is assumed herein that the additional rotation is once.

Further, the partial image obtained in the basic rotation is defined as the basic rotated partial image, and the partial image obtained through the additional rotation is defined as the additional rotated partial image.

Then, the technical idea of the present invention can generate a matched image by matching all or a portion of the additional rotated partial images with some of the basic rotated partial images. Thereby, a concept of generating a single matched image by matching images photographed in different time intervals (for example, a time interval corresponding to the basic rotation and a time interval corresponding to the additional rotation) is presented.

This concept is applicable to a case where a subject to be photographed is to photograph a subject (e.g., a landscape, a building or a real estate, etc.) which is static, that is, It is possible to provide the effect of replacing the basic rotation partial image with the additional non-rotation partial image when the corresponding basic rotation partial image has a feature that the user does not want. The additional rotated partial image to be replaced at this time may be a partial image (i.e., a partial image corresponding to the same direction) corresponding to the basic rotated partial image to be replaced.

For example, in FIG. 5A, there may be an unwanted feature (e.g., a particular object is photographed) in the third partial image 12-1 acquired in the third direction 12.

Then, if the terminal 100 performs an additional rotation as shown in FIG. 5B, for n same directions (e.g., 10 to 15) as the base rotation, n additional rotated partial images (e.g., 10-2 The additional rotation third partial image 12-2 can be obtained by replacing the basic rotation third partial image 12-1 in which the characteristic does not exist (for example, the specific object is not photographed) Can be used for registration.

That is, among the basic rotation partial images 10-1 to 15-1, the basic rotation matching target image to be matched is the basic rotation partial images excluding the third partial image 12-1 (e.g., 10- 1, 11-1, 13-1, 14-1, 15-1). And the additional rotated partial image to be matched may be the additional rotated partial image 12-2 corresponding to the basic rotated third partial image 12-1 which is the basic rotated partial image to be replaced.

6 (b), the basic rotation matching target images (e.g., 10-1, 11-1, 13-1, 14-1, and 15-1) and the additional rotation matching target images A matching image as shown can be generated.

If the feature is still present in the additional rotation third partial image (e.g., 12-2) obtained via an additional rotation (e.g., a second rotation), the terminal 100 may again perform an additional rotation (e.g., third rotation) Can be performed. In any case, the additional rotation third partial image in which the feature does not exist can be acquired irrespective of the number of additional rotations, and can be used as a registration target.

For example, it can be assumed that the feature is a feature in which a specific object (e.g., a person) is photographed as described above, and the terminal 100 excludes all of the basic rotated partial images in which the feature exists, . Then, partial images to be matched among the basic rotated partial images may all be images in which the feature does not exist. And the additional rotated partial images corresponding to each of the excluded basic rotated partial images may be partial images for which the feature does not exist. In this way, partial images in which the feature does not exist among the basic rotation partial images, that is, the additional rotation matching target image among the basic rotation matching target image and the additional rotation partial images are matched, Is not present.

For example, if it is assumed that the terminal 100 photographs a specific space, and that the characteristic is that a person is photographed, if a person is photographed from a partial image in a specific direction (for example, 12-1) (E.g., 12-2) that has not been photographed by the person for the particular direction and outputs the additional rotated partial image (e.g., 12-2) to the basic rotated partial image -1). When the replaced basic rotation partial images (e.g., 10-1. 11-1, 12-2, 13-1, 14-1, and 15-1) are matched, a matching image that covers the space in all directions is generated It is possible that a person can not be photographed in any direction.

Whether partial images having certain characteristics among the basic rotated partial images are excluded from the matching object may vary. For example, as described above, it may be the feature that the specific object is photographed, and conversely, the specific object is not photographed. According to the embodiment, various features can be defined, and according to the definition of the feature, it is possible to generate a matching image in which no feature exists in all directions covered by the matching image.

In addition, the matching images may have the effect of matching new partial images of different time periods to create new space-time.

On the other hand, while performing additional rotation, as shown in FIG. 5B, the terminal 100 is able to rotate n additional rotation partial images (e.g., 10- 2 to 15-2 may be photographed.

As described above, the basic rotation partial image in which the predetermined feature exists in the basic rotation partial image, i.e., the basic rotation partial image excluding the partial image to be excluded (e.g., 12-1) (for example, 10-1.11- Corresponding to the exclusion partial image (e.g., 12-1) among the n additional rotation partial images (e.g., 10-2 to 15-2) The additional rotational registration target image (e.g., 12-2) may be matched.

That is, even in the additional rotation, the terminal 100 can capture all the n images corresponding to each of the n defined directions.

In such a case, the terminal 100 may acquire the basic rotation partial images (e.g., 10-1 to 15-1) and the additional rotation partial images (e.g., 10 -2 to 15-2), thereby determining the partial image to be excluded.

For example, six basic rotated partial images may be obtained for six different directions in the base rotation, and six additional rotated partial images may be obtained for six different directions in the additional rotation. And the terminal 100 may compare the corresponding respective partial images (e.g., 10-1 and 10-2, 11-1 and 11-2, etc.) with each other. If the comparison result satisfies a predetermined criterion, the basic rotation partial image in the corresponding direction may be replaced with the additional rotation partial image.

For example, the terminal obtains a differential image of partial images corresponding to each other, and when the difference between the partial images is equal to or higher than a certain level using the difference image, the terminal may determine the basic rotated partial image as the excluding partial image have.

As a result, the embodiment for selecting the partial image to be excluded may be based on whether or not the partial image has the predetermined characteristic as described above, but may be determined by comparing the corresponding partial images, At least one of the image or additional rotated partial images may be selected as the partial image to be replaced (to be replaced). Various embodiments may be possible.

On the other hand, according to another embodiment, the terminal 100 may not necessarily acquire an additional rotated partial image for all of the n directions through the additional rotation. That is, according to the embodiment, only the additional rotated partial image corresponding to the partial image to be excluded from the basic rotated partial images may be obtained through additional rotation.

The determination of the exclusion target partial image is performed by the terminal 100 by analyzing each of the basic rotation partial images to determine which of the n directions (which direction is the partial image) satisfying (satisfying) the predetermined characteristic as described above . ≪ / RTI >

Or the user may be provided with basic rotated partial images, and in response, at least one of the basic rotated partial images may be selected. Then, the selected basic rotation partial image may be selected as the partial image to be excluded.

When the partial image to be excluded is determined (i.e., a direction corresponding to the partial image to be excluded out of n directions is determined), the terminal 100 causes the terminal 100 to rotate in the specific direction, Lt; RTI ID = 0.0 > a < / RTI > And the obtained additional rotated partial image may be the additional rotated target image to be used for generation of the registered image.

An example of the concept of selectively acquiring additional rotated partial images in only some of the n directions will be described with reference to Figs. 7 to 9. Fig.

7 to 9 are views for explaining a concept of generating a matching image by matching partial images obtained from each of a plurality of rotations through a matching image generating method according to another embodiment of the present invention.

Referring first to FIG. 7, the terminal 100 may provide the user with all (e.g., 10-1 through 15-1) or some of the basic rotated partial images. The user may select at least one of the provided basic rotation partial images as the exclusionary partial image (e.g., 12-1, 14-1). Alternatively, the terminal 100 may analyze each of the basic rotated partial images to select a partial image having a predetermined characteristic (e.g., 12-1, 14-1) as the partial image to be excluded.

Then, the terminal 100 may selectively rotate in each direction (e.g., 12, 14) corresponding to the partial image to be excluded, as shown in FIG. And only the additional rotated partial images 12-3 and 14-3 may be obtained in each of the rotated directions (e.g., 12 and 14). That is, in this case directions 10, 11, 13, and 15, an additional rotated partial image may not be captured.

Then, the basic rotation matching target images (10-1, 11-1, 13-1, 15-1) excluding the excluded target partial images (12-1, 14-1) The additional rotated partial images 12-3 and 14-3 corresponding to the additional rotation images 12-1 and 14-1 may be matched to generate a matched image.

9, in which the angle of coverage of the registration image is different from that of the registration image n, the partial images obtained in different rotations may be included in one registration image.

That is, in Fig. 9, the terminal 100 can acquire 12 partial images for 12 directions through the basic rotation. (E.g., 24-2, 29-2) corresponding to the exclusion target partial image among the basic rotation partial images, or all of the additional rotation partial images .

The basic rotation matching target images 21-1, 22-1, 23-1, 25-1, 26-1, 27-1, 28-1, 30-1, 31-1, The registration target images 24-2 and 29-2 are matched and a matching image can be generated.

As a result, according to the method of generating matching images according to the technical idea of the present invention, partial images of different time zones are included as components of one matching image, thereby creating a new space-time. That is, a part of the matched image represents a space of a first time zone (time zone), and the remaining space represents a space of a time zone different from the first time zone, thereby achieving various effects.

In addition, the method of generating a matched image having the effect of generating a new space-time is not necessarily the driving apparatus 200. That is, an average expert in the technical field of the present invention can readily deduce that the above-described technical idea can be achieved even when a person directly rotates the terminal 100 through a predetermined guide or interface. However, it is needless to say that the performance (quality and speed) of the image matching can be significantly increased by accurately controlling the rotation angle through the driving device 200.

The technical idea that the user can provide the advertisement to the user while consuming the matching image or 360 image matched in the above-described manner will be described with reference to FIG. 10 to FIG. 12. FIG. Of course, the advertisement method to be described later is not necessarily applied to the matching image generated in the above-described manner, but may be applied to the matching image or the 360 image generated by another method. You can do it.

Also, as described above, the advertising method according to the technical idea of the present invention may be performed in the terminal 100 or in the service server 400. That is, the determination of the base area, the determination of the placement position, and the placement of the advertisement content, which will be described later, may be performed in the terminal 100 or in the service server 400. Or by a completely different system that is independent of the generation of a matched image or a 360 image.

Therefore, in the following description, an apparatus capable of performing an advertisement method according to the technical idea of the present invention will be referred to simply as a system, and the system may be the terminal 100 and / or the service server 400, It will be readily apparent to one of ordinary skill in the art that the device may be a completely separate device.

Hereinafter, the case where the terminal 100 performs the advertisement method will be described for convenience of explanation.

FIG. 10 is a diagram for explaining an advertisement technique using an ephemeris according to an embodiment of the present invention. Referring to FIG.

Referring to FIG. 10, the system may receive a request to reproduce 360 images and reproduce (display) 360 images. The system (e.g., the output module 140 of the terminal 100) may display only a portion of the 360 images corresponding to a predetermined viewing angle.

According to an example, the displayed area may be treated as a user-confirmed area. As described above, the region visually confirmed by the user through the system will be defined as the base region in this specification.

The base area may refer to an area currently displayed on a display device connected to the system, that is, a view plane itself. However, the base region may be determined as a partial image unit constituting the 360 image.

In this case, the entire partial image must be displayed at least once to signify that the partial image can be judged as the visible region. Also, even if a specific region displayed by the system is actually displayed, if the entire partial image including the specific region is not displayed, the specific region may not be included in the base region.

In the case where the base area is determined as a partial image, that is, a matching target image unit before matching, the process can be performed on a partial image basis, thereby making it possible to efficiently perform an operation or a process.

The system can change the view field while rotating the 360 image according to a user's request, and thus can determine the base area in real time.

For example, FIG. 10A shows a case where the first partial image 10-1 is judged to be a predominant region, and FIG. 10B shows a case where the first partial image 10-1 and the second partial image 11-1 are divided into a predominant region As shown in FIG.

As described above, according to the technical idea of the present invention, the base region can be determined in real time, and accordingly, the advertisement can be arranged only in the base region. That is, it may mean that at least one of the regions included in the 360 image is disposed only at a portion identified by the user, thereby preventing the advertisement content from interfering with the user's space confirmation .

In addition, it may mean that the advertisement contents can be arranged in 360 images that are already being reproduced in real time while the user is playing 360 images by judging the base area in real time.

The system may add an area determined to be a predominant region in 360 images during playback to the advertisement area. That is, it can be treated as an area in which the advertisement contents can be placed. For this, the system (e.g., the control unit 110 of the terminal 100) can maintain / manage information about the advertisement area in real time. Of course, the list of the base area is the same as the list of the advertisement area, but the advertisement area is conceptually expressed in order to make it clear that the base area becomes the advertisement area.

Then, the system can arrange predetermined advertisement contents at a predetermined position in the advertisement area.

The system may arrange the advertisement contents at any position included in the advertisement area, but it is also possible to search for a position in the advertisement area that satisfies a predetermined criterion according to the embodiment of the present invention, The advertisement content may be placed in the advertisement content.

Such an example will be described with reference to FIG.

11 is a view for explaining an arrangement position of advertisement contents according to an embodiment of the present invention.

Referring to FIG. 11, a first partial image 10-1 may be included in an advertisement area (i.e., a base area), and the first partial image 10-1 may include an object , 40, 41, 42).

According to one example, the placement position corresponds to the location of the advertisement content to be placed (for example, the TV target image to be advertised), and the object (TV, 41 displayed in the 360 image) existing in the advertisement area . That is, the placement position may be the same as the position of the object, or may be a position that can be adjusted little by little according to an embodiment such as a wider area (or a narrower area, etc.) than the object.

In this case, the system eventually replaces the object (e.g., 41) existing in the 360 image with the advertisement content (e.g., the TV image that is the object of the advertisement).

For this, the system (e.g., the control unit 110) may perform a process of recognizing objects corresponding to predetermined advertisement contents in the 360 images. And object recognition may be possible through various embodiments. According to an example, various object recognition algorithms based on feature points have been known. In recent years, object recognition algorithms using deep running (e.g., TensorFlow) have been widely known. The average expert in the field of the present invention can easily deduce that various object recognition methods can be used to implement the technical idea of the present invention.

In addition, the system (e.g., the control unit 110) may maintain / manage information (e.g., image, object type, etc.) of advertisement contents in advance and perform object recognition using the information.

According to another embodiment, the placement position may be a non-critical area present in the advertisement area and determined by criteria according to the technical idea of the present invention.

The non-critical area may be an area where important information does not exist even if the advertisement content is overlapped with the corresponding area according to the embodiment of the present invention.

This way of determining non-critical areas can vary.

According to an example, the non-critical area may be an area that is determined by the system (e.g., controller 110) and whose image complexity is less than a predetermined value.

It is known that the image complexity can be measured in various ways such as a difference between a pixel value or a luminance value of a pixel, a difference between a specific pixel and neighboring pixels, and the like. And the relatively low image complexity can mean that there is not much visual change in the area, that is, the same or similar information exists in succession. For example, consecutive regions with small differences in pixel information may result in relatively low image complexity, such as sky, sea, surface of door 40, top of desk 42, and the like.

Accordingly, the system (for example, the control unit 110) searches the area having a relatively low image complexity (based on a predetermined reference value) using the image complexity, It can be judged.

For this, the system (for example, the control unit 110) may calculate the image complexity in macro-convex units included in the advertisement area, and search for the area in which blocks lower than the reference value are continuously arranged using the twisted image complexity. Of course, the non-critical areas can be searched using image complexity in various ways.

According to an example, the system (for example, the control unit 110) determines that the top surface of the table 42 included in the first partial image 10-1, which is an advertisement area, . The specific advertisement contents can be arranged on the upper surface of the table 42.

On the other hand, the system (for example, the control unit 110) may further provide a technical idea for efficiently performing the above-described methods of determining the placement position (the position or the non-critical area of the corresponding object).

According to one example, the system (e.g., the control unit 110) may include the excluded region 10-i, except for the stitching region (i.e., the overlapping region with the adjacent image, 10). ≪ / RTI > This excludes the stitching areas (e.g., 10-11, 10-12) because it is not desirable that the stitching areas (e.g., 10-11, 10-12) containing information that is important for stitching images are replaced or overwritten . Also, excluding the stitching area (for example, 10-11, 10-12) can be very effective because it is possible to search the placement position in advance.

That is, if the stitching area (for example, 10-11, 10-12) is excluded, the second partial image 11-1 may be photographed after the first partial image 10-1 is photographed as described above , The placement position of the advertisement contents can be set in advance even if the second partial image after the first partial image 10-1 is photographed or before the first partial image 10-1 is stitched with another image There is an effect that can be explored.

Meanwhile, the technical idea of the present invention is that the advertisement contents can be arranged in real time while the user is already viewing 360 images as described above. In this case, if the advertisement is artificially arranged in the area that the user is already viewing, that is, the area being displayed, it is very unnatural or may cause a problem of lowering the usability of the user's 360 image. An example for solving such a problem will be described with reference to FIG.

12 is a diagram for explaining a concept that advertisement contents are arranged in 360 images in real time outside a user's view according to an embodiment of the present invention.

Referring to Fig. 12, the current view may be the first partial image 10-1 as shown in Fig. Of course, the view may not be limited to a partial image unit, and a part of the second partial image 11-1 and a part of the sixth partial image 15-1 may be included in the visual field.

According to an exemplary embodiment of the present invention, the system (e.g., the control unit 110) may display an advertisement area (e.g., a third partial image (E.g., 50, 51, 52) may be placed in the first partial image 12-1, the fourth partial image 13-1, and the fifth partial image 14-1.

At this time, a notification signal (for example, a predetermined sound or a display) indicating that the advertisement contents are arranged in an area outside the user's view may be output to allow the user to recognize that the advertisement contents are arranged.

As a result, the advertising method according to the technical idea of the present invention is not limited to a 360-image or a 360-degree problem, in which a user has not previously confirmed the original image by arranging specific advertisement contents in a predetermined image Can be solved.

In addition, there is an effect that the advertisement placement can be performed in real time while the user is consuming the image, and the placement position of the advertisement can be searched for the effective placement position so that the advertising effect is excellent or the usability of the original image is not significantly deteriorated There is an effect.

The matching image generating method or the advertisement method according to the embodiment of the present invention can be implemented as a computer-readable code on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, hard disk, floppy disk, optical data storage, and the like. In addition, the computer-readable recording medium may be distributed over network-connected computer systems so that computer readable codes can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers skilled in the art to which the present invention pertains.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

Claims (12)

Determining a base region determined by a user from 360 images;
Adding the base area determined by the system as an advertisement area in which predetermined advertisement contents can be arranged;
Wherein the system includes the step of arranging predetermined advertisement contents in a current advertisement area.
The method of claim 1,
N partial images corresponding to a certain angle and pointing in different directions are matched images,
Wherein the base region determined by the user is determined by the partial image unit.
The method as claimed in claim 1,
Determining a placement position at which the advertisement content is to be placed in the advertisement area; And
And placing the advertisement content at a determined placement location,
Wherein the step of determining a placement position at which the advertisement content is to be placed in the advertisement area comprises:
Wherein the system recognizes an object position where an object corresponding to the predetermined advertisement content is displayed, and determines the placement position corresponding to the recognized object position.
The method as claimed in claim 1,
Determining a placement position at which the advertisement content is to be placed in the advertisement area; And
And placing the advertisement content at a determined placement location,
Wherein the step of determining a placement position at which the advertisement content is to be placed in the advertisement area comprises:
Determining a non-critical area in which the advertisement content can be displayed, the non-critical area being determined based on image complexity.
5. The method according to claim 3 or 4,
N partial images corresponding to a certain angle and pointing in different directions are matched images,
Wherein the step of determining a placement position at which the advertisement content is to be placed in the advertisement area comprises:
(K-1) partial image before the k-th partial image of the partial images is taken (k is an integer from 2 to n). Delivery method.
The method of claim 1, wherein the step of placing the predetermined advertisement content in a current advertisement area of the system comprises:
Placing the advertisement content in an advertisement area of the advertisement area that is not included in a current view of the user;
And outputting an advertisement signal indicating that the advertisement content is disposed after arranging the advertisement content in an advertisement area not included in the view of the user.
The system starting to display 360 images on the user's terminal;
Placing the predetermined advertisement content at a predetermined placement position included in the 360 image while the system is displaying the 360 image,
Wherein the step of arranging the advertisement contents at a predetermined placement position included in the 360 image comprises:
Wherein the advertisement contents are arranged in an area not included in the current view of the user.
Displaying a matched matched image in which n partial images corresponding to a certain angle and oriented in different directions of the system are displayed; And
The system comprising: determining a placement location at which the advertisement content is to be placed,
Wherein the step of determining the placement position comprises:
(K-1) partial image before the k-th partial image of the partial images is taken (k is an integer from 2 to n).
A computer program installed in a data processing apparatus and recorded on a computer-readable recording medium for performing the method according to any one of claims 1 to 8.
In the system,
A control unit including a processor; And
And a storage medium on which a program executed by the control section is recorded,
The program includes:
360 images, and adds the determined origin area to an advertisement area in which predetermined advertisement contents can be placed, and provides a predetermined advertisement content to the current advertisement area.
In the system,
A control unit including a processor; And
And a storage medium on which a program executed by the control section is recorded,
The program includes:
The system starts displaying 360 images on the user's terminal and arranges predetermined advertisement contents at predetermined placement positions included in the 360 images while displaying the 360 images,
The arrangement position is,
Is not included in the current view of the user.
In the system,
A control unit including a processor; And
And a storage medium on which a program executed by the control section is recorded,
The program includes:
N partial images corresponding to a certain angle and oriented in different directions display the matched matched image, determine the placement position at which the advertisement content is to be placed,
To determine the placement position, it is preferable to start to determine the placement position contained in the (k-1) -th partial image before k-th partial image of the partial images is taken (k is an integer from 2 to n) Characterized in that the system provides advertisements.

Images