KR101788005B1 - Method for generating multi-view image by using a plurality of mobile terminal - Google Patents
Method for generating multi-view image by using a plurality of mobile terminal Download PDFInfo
- Publication number
- KR101788005B1 KR101788005B1 KR1020160008734A KR20160008734A KR101788005B1 KR 101788005 B1 KR101788005 B1 KR 101788005B1 KR 1020160008734 A KR1020160008734 A KR 1020160008734A KR 20160008734 A KR20160008734 A KR 20160008734A KR 101788005 B1 KR101788005 B1 KR 101788005B1
- Authority
- KR
- South Korea
- Prior art keywords
- mobile terminal
- information
- mobile terminals
- view image
- subject
- Prior art date
Links
Images
Classifications
-
- H04N13/0282—
-
- H04N13/0207—
-
- H04N5/2258—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2625—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect
Abstract
The present invention relates to a multi-view image generation method using a plurality of mobile terminals, including: (a) selecting a reference mobile terminal among a plurality of mobile terminals; (b) generating position correction information for another mobile terminal based on the information about the reference mobile terminal; (c) generating a plurality of photographed images of a subject in a plurality of view directions by the plurality of mobile terminals; And (d) generating a multi-view image of the object based on the plurality of captured images.
Description
The present invention relates to a multi-view image generation method using a plurality of mobile terminals, and more particularly, to a multi-view image generation method using a plurality of mobile terminals (e.g., a smart phone, a tablet, a wearable device, Quot; multi-view image " representing a view at a time point.
The multi-view image refers to an image representing the appearance of the same object at a plurality of viewpoints. Such multi-view images are utilized in the process of producing various image contents such as movies, drama, and stereoscopic images because the external appearance of the subject can be stereoscopically and dynamically represented.
However, such multi-view images are generated only by professional photographic equipment. For example, as shown in FIG. 1, such a multi-viewpoint image is generated only by a professional photographing device composed of a fixed frame and a plurality of cameras installed in the fixed frame.
Therefore, it is difficult for the general public to create the multi-view image directly due to the lack of accessibility to the professional shooting equipment. Also, for the expert, it is necessary to separately install the special high- There were many inconveniences.
Accordingly, there is a demand for a technique capable of generating multi-view images without a professional photographic equipment.
The present invention has been accomplished on the basis of the above technical background, and it is an object of the present invention to provide an apparatus and a method for manufacturing the same, .
The present invention provides a technique for generating a multi-view image by using a plurality of terminals (for example, a smart phone, a tablet, a wearable device, etc.) other than a professional photographic equipment.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
According to another aspect of the present invention, there is provided a method for generating a multi-view image using a plurality of mobile terminals, including: (a) selecting a reference mobile terminal among a plurality of mobile terminals; (b) generating position correction information for another mobile terminal based on the information about the reference mobile terminal; (c) generating a plurality of photographed images of a subject in a plurality of view directions by the plurality of mobile terminals; And (d) generating a multi-view image of the object based on the plurality of captured images.
Also, the method of generating a multi-view image using a plurality of mobile terminals according to the present invention is characterized in that the step (b) includes the step of adjusting the size of a subject existing on the photographing screen of the other mobile terminal And a control unit.
In addition, the multi-view image generation method using a plurality of mobile terminals according to the present invention is characterized in that the size of the subject is adjusted by a zoom in operation, a zoom out operation or a movement of the other mobile terminal, And the size of the subject is adjusted so as to correspond to the size of the subject existing on the photographing screen of the reference mobile terminal.
Also, the multi-view image generation method using a plurality of mobile terminals according to the present invention may further include the steps of (a) setting minutiae points of the object by the reference mobile terminal; And position setting information for the other mobile terminal based on position information of the feature points existing on the photographing screen of the reference mobile terminal, position information of the feature points existing on the photographing screen of the other mobile terminal, Is generated.
Also, the multi-view image generation method using a plurality of mobile terminals according to the present invention is characterized in that the image pickup setting information includes the number information of mobile terminals participating in shooting of the multi-view image.
Also, the multi-view image generation method using a plurality of mobile terminals according to the present invention is characterized in that the position correction information includes parallel movement information or rotation movement information of the other mobile terminal.
Also, in the multi-view image generation method using a plurality of mobile terminals according to the present invention, sequential numbers corresponding to sequential positions among the plurality of mobile terminals are allocated to the plurality of mobile terminals, The point image is generated by arranging the plurality of photographed images on an image frame in the order corresponding to the numbers.
Also, the multi-view image generation method using a plurality of mobile terminals according to the present invention is characterized in that the position correction information or the multi-view image is transmitted to the reference mobile terminal, the other mobile terminal, . ≪ / RTI >
On the other hand, the multi-view image generation method using a plurality of mobile terminals as described above can be stored in a recording medium readable by an electronic device after being implemented in the form of a program, or distributed through a program providing server (download server) .
Next, a mobile terminal for solving the above problems is characterized by including a communication module, a photographing module, a memory, and a processor.
Further, a mobile terminal according to the present invention is characterized in that the processor is connected via wireless communication with a plurality of mobile terminals; Generate location correction information for a mobile terminal, not a reference mobile terminal, based on information about the reference mobile terminal; Receiving a plurality of photographed images of a subject in a plurality of view directions from the plurality of mobile terminals; And an arithmetic processing operation for generating a multi-view image of the object based on the image generated by the imaging module and the plurality of received imaging images.
In the mobile terminal according to the present invention, the position correction information may include position information of the feature points existing on the photographing screen of the reference mobile terminal; Position information of the feature points existing on the photographing screen of the mobile terminal other than the reference mobile terminal; And shooting setting information.
Next, a multi-view image generation server for solving the above problems includes a communication module, a memory, and a processor.
Also, the multi-view image generation server according to the present invention is characterized in that the processor exchanges data with a plurality of mobile terminals via wireless communication; Generating position correction information for another mobile terminal based on information of the reference mobile terminal among the plurality of mobile terminals; Receiving a plurality of photographed images of a subject in a plurality of view directions from the plurality of mobile terminals; Generating a multi-view image for the subject based on the plurality of captured images; And transmitting the generated multi-view image to one of the plurality of mobile terminals.
In the multi-view image generation server according to the present invention, the location correction information may include location information of the feature points existing on the photographed screen of the reference mobile terminal; Position information of the minutiae points existing on the photographing screen of the other mobile terminal; And shooting setting information.
The present invention can provide a technique of generating a multi-view image even without professional photographic equipment. Specifically, the present invention can provide a technique of generating a multi-view image using a plurality of mobile devices (e.g., a smart phone, a tablet, a wearable device, etc.) instead of a professional photographic equipment.
In addition, the present invention can position a plurality of mobile terminals at appropriate positions to generate multi-view images by utilizing position correction information. Specifically, the present invention sets a reference mobile terminal among a plurality of mobile terminals and generates position correction information for another mobile terminal (which refers to a mobile terminal other than the reference mobile terminal) based on the information about the reference mobile terminal , The plurality of mobile terminals may be arranged at a position suitable for generating a multi-view image.
In addition, the present invention can generate position correction information for a plurality of mobile terminals based on a 'subject size adjustment operation' and a 'subject feature point analysis operation' for a plurality of mobile terminals. Specifically, the present invention adjusts the size of a subject displayed on a photographing screen of a plurality of mobile terminals to be the same (or substantially the same), performs a feature point analysis operation on the plurality of mobile terminals, To generate position correction information for mobile terminals. Therefore, even when the plurality of mobile terminals include different types of mobile terminals or mobile terminals having different performance camera modules, the present invention can generate an integrated multi-view image.
The effects of the present invention are not limited to the above-mentioned effects, and various effects can be included within the scope of what is well known to a person skilled in the art from the following description.
FIG. 1 is a diagram illustrating an example of a conventional professional photography apparatus used for generating a multi-view image.
2 is a conceptual diagram schematically illustrating a multi-view image generation method using a plurality of mobile terminals according to the present invention.
3 is a flowchart illustrating a multi-view image generation method using a plurality of mobile terminals according to the present invention.
4 is a conceptual diagram illustrating position correction for mobile terminals other than the reference mobile terminal.
5 is a flowchart showing an example of generating position correction information based on size adjustment of a subject and feature point analysis of a subject.
FIG. 6 is an exemplary diagram illustrating an example of adjusting a size of a subject on a photographing screen of a mobile terminal.
7 is an exemplary diagram illustrating an example of analyzing feature points of a subject for a plurality of mobile terminals.
8 is an exemplary diagram showing a positional relationship among a plurality of mobile terminals.
9 is a diagram illustrating an example of generating a multi-view image based on a plurality of captured images generated by a plurality of mobile terminals.
Hereinafter, a method of generating a multi-view image using a plurality of mobile terminals and a recording medium, a server, and a mobile terminal related thereto will be described in detail with reference to the accompanying drawings. The present invention is not limited to the above-described embodiments, and various changes and modifications may be made without departing from the scope of the present invention. In addition, the matters described in the attached drawings may be different from those actually implemented by the schematic drawings to easily describe the embodiments of the present invention.
In addition, the expression " comprising " means that the elements are merely referred to as being open-ended representations, and should not be construed to exclude additional elements.
Hereinafter, a multi-view image generation method using a plurality of mobile terminals according to the present invention will be schematically described with reference to FIG.
As shown in FIG. 2, the multi-view image generation method using a plurality of mobile terminals according to the present invention can generate multi-view images using a plurality of mobile terminals. Specifically, the present invention can generate a multi-view image by using a plurality of captured images generated by the plurality of mobile terminals after arranging a plurality of mobile terminals around the subject.
The plurality of mobile terminals may include a smart phone, a tablet, a wearable device (smart clock, smart glasses, etc.), an IoT (Internet of Things) device, and the like. And the like.
In contrast, in contrast to conventional professional photography equipment that fixes the positions of a plurality of imaging devices using a fixed frame (fixed structure), the present invention utilizes a plurality of mobile terminals with 'mobility' There is a need for a technical process to move the plurality of mobile terminals to ' proper location ' around the subject.
In this regard, the present invention can generate 'position correction information' for moving the plurality of mobile terminals to an appropriate position, and generate a multi-view image of the plurality of mobile terminals using the position correction information As shown in FIG. (Details related to the generation of this 'position correction information' will be described in detail below.)
Hereinafter, a method of generating a multi-view image using a plurality of mobile terminals according to the present invention will be described with reference to FIG.
Referring to FIG. 3, a multi-view image generation method using a plurality of mobile terminals according to the present invention includes a step S1 of selecting a reference mobile terminal among a plurality of mobile terminals, A step S3 of generating a plurality of photographed images of a subject in a plurality of view directions by the plurality of mobile terminals, a step S3 of generating position correction information for another mobile terminal, And generating a multi-view image of the subject based on the plurality of captured images (S4).
The step S1 is a step of selecting a reference mobile terminal among a plurality of mobile terminals. Herein, the 'reference mobile terminal' means a terminal acting as a reference point of position correction.
The reference mobile terminal may include a host mobile terminal requesting multi-view image generation, a mobile terminal selected by user input among the plurality of mobile terminals, a mobile terminal located at a relatively middle position among the plurality of mobile terminals, After calculating the average value of the signal strengths received from mobile terminals other than the terminal itself (for example, for each mobile terminal, the mobile terminal with the smallest average value may be selected as the mobile terminal placed in the middle position) ), And the like.
In addition, the calculation operation in which the reference mobile terminal is selected may be performed by the plurality of mobile terminals, or a server connected to the plurality of mobile terminals.
Step S2 is a step of generating position correction information for another mobile terminal based on the information of the reference mobile terminal.
Here, 'other mobile terminal' means any mobile terminal that is not the reference mobile terminal among the plurality of mobile terminals.
The 'position correction information' refers to information for correcting the position of the other mobile terminal. More specifically, as shown in FIG. 4, it means information for correcting the position of the other mobile terminal when the other mobile terminal is not disposed at a proper position to generate a multi-view image. The position correction information may include various pieces of information such as parallel movement information and rotational movement information.
The 'position correction information' may be generated in various manners, but it may be generated by a method of 'adjusting the size of the subject' and 'analyzing the feature point of the subject'.
Hereinafter, a specific example of step S2 will be described with reference to FIGS. 5 to 8. FIG.
Referring to FIG. 5, in operation S2, the size of a subject existing on the photographing screen of the other mobile terminal is adjusted by the other mobile terminal (S21), the reference mobile terminal The method comprising the steps of: setting minutiae points (S22); determining, based on the location information of the minutiae points existing on the photographing screen of the reference mobile terminal, the location information of minutiae points existing on the photographing screen of the other mobile terminal, And generating position correction information for another mobile terminal (S23).
In the step S21, the size of the subject existing on the photographing screen of the other mobile terminal is adjusted by the other mobile terminal. Specifically, the size of the subject existing on the photographing screen of the other mobile terminal is adjusted (for example, adjusted to be the same or substantially the same) to correspond to the size of the subject existing on the photographing screen of the reference mobile terminal, .
Referring to FIG. 6, an example of step S21 may be described. 6, the size (B) of the subject existing on the photographing screen of the other mobile terminal is adjusted to correspond to the size (A) of the subject existing on the photographing screen of the reference mobile terminal, > A '). Here, the operation of adjusting the size of a subject existing on the photographing screen of the other mobile terminal may be implemented by a zoom in operation, a zoom out operation, an operation of moving the other mobile terminal itself, or the like May be implemented in various ways other than these examples. In addition, the size information of the subject existing on the photographing screen of each mobile terminal can be shared by direct communication between mobile terminals, relay of a server, and the like.
The reason why the size of the subject existing on the photographing screen of the other mobile terminal is adjusted to correspond to the size of the subject existing on the photographing screen of the reference mobile terminal is as follows: 1) The performance difference of the camera module that can be generated when the terminal is implemented in a device different from the reference mobile terminal can be canceled, and 2) by this adjustment, at least in the calculation process for generating the position correction information, The distance between the subject-reference mobile terminal and the subject-distance between other mobile terminals may be assumed to be substantially the same.
In step S22, minutiae points of the subject are set by the reference mobile terminal after step S21. Specifically, in step S22, after the size of the subject existing on the photographing screen of the other mobile terminal is adjusted to correspond to the size of the subject existing on the photographing screen of the reference mobile terminal, The feature points for the subject are set.
Herein, the minutia refers to representative points among the points representing the outline of the subject. In addition, the information about the minutiae set by the reference mobile terminal may be shared by the other mobile terminal through a communication network, and may be displayed on a subject existing on the photographing screen of the other mobile terminal.
Referring to FIG. 7, an example of feature points set by the reference mobile terminal and feature points shared and displayed with other mobile terminals can be examined.
In step S23, based on the location information of the minutiae points existing on the photographing screen of the reference mobile terminal, the location information of the minutiae points existing on the photographing screen of the other mobile terminal, and the photographing setting information, The position correction information is generated.
Specifically, the step S23 may include: 1) determining, based on the location information of the minutiae points existing on the photographing screen of the reference mobile terminal and the location information of the minutiae points existing on the photographing screen of the other mobile terminal, 'Virtual current location information (relative virtual current location information based on the reference mobile terminal)' is calculated, and 2) 'virtual target location information of the other mobile terminal (3) calculating 'position correction information' for the other mobile terminal through comparison between the virtual current position information and the virtual target position information, Is generated. (For reference, the reason why 'virtual' is used before the location information is that the location information is not generated on the basis of the actual distance information, and the 'distance between the object and the reference mobile terminal' Since the distance between the subject and the other mobile terminal is assumed to be substantially the same).
Here, the 'virtual current location information' may be obtained by comparing the location information of the minutiae points existing on the photographing screen of the reference mobile terminal and the location information of the minutiae points existing on the photographing screen of the other mobile terminal Quot; current rotational movement information of the other mobile terminal ". For example, the 'virtual current position information' may include current rotation movement information (for example, rotation movement information (θ) based on a spherical coordinate system, which can be obtained through minutia analysis as shown in FIG. , ϕ)). Since it can be assumed that the distance R between the object and the reference mobile terminal and the distance R 'between the object and the other mobile terminals are substantially equal to each other (R? R') in the step S21, If the current rotational movement information (?,?) Of the other mobile terminal is obtained through analysis, the 'virtual current position of the other mobile terminal' can be specifically calculated.
In addition, the 'virtual target position information' may be calculated by 'ideal rotation movement information of the other mobile terminal' that can be obtained based on the photograph setting information. As described above, it is assumed that the distance R between the object and the reference mobile terminal and the distance R 'between the object and the other mobile terminal are substantially the same (R? R') Since the virtual target position of the other mobile terminal can be calculated when the desired rotational movement information? Ideal ,? Ideal of the other mobile terminal is obtained. On the other hand, the photographing setting information may include information on the number of mobile terminals participating in photographing of multi-view images. In this case, a matching relationship between 'number of mobile terminals' and 'desirable rotational movement information' may be preset (for example, three terminals - (0 degrees, 120 degrees) 10 - (0 degrees, 36 degrees), etc.), and an operation may be performed based on this setting information.
The 'position correction information' for the other mobile terminal can be calculated by analyzing the difference between 'virtual current position information' and 'virtual target position information' for the other mobile terminal. The position correction information may include parallel movement information or rotation movement information for the other mobile terminal to move from the 'virtual current position' to the 'virtual target position' .
Meanwhile, the operation of generating the position correction information may be performed by various subjects including the reference mobile terminal, the other mobile terminal, the reference mobile terminal, a server connected to the other mobile terminal, and the like. For example, 1) the reference mobile terminal generates the position correction information after acquiring the positional information of the feature points existing on the photographing screen of the other mobile terminal and the photograph setting information, or 2) Generating the location correction information after acquiring the location information of the minutiae points existing on the photographed screen of the reference mobile terminal and the photographing setting information, and 3) the server connected to the reference mobile terminal and the other mobile terminal, The mobile terminal can generate the position correction information after acquiring the position information of the feature points existing on the photographing screen of the mobile terminal, the position information of the feature points existing on the photographing screen of the other mobile terminal, and the photograph setting information.
In the step S3, a plurality of photographed images are photographed by the plurality of mobile terminals, the photographed images being photographed in a plurality of view directions.
Specifically, in step S3, after the position correction for the plurality of mobile terminals is completed, the subject is photographed by a plurality of camera modules provided in the plurality of mobile terminals, and a plurality of A plurality of photographed images of the subject are generated in the viewpoint direction of the viewpoint.
In this case, the plurality of photographed images may be shared among the terminals or transmitted to the server through the communication network.
In step S4, a multi-view image of the subject is generated based on the plurality of captured images. Specifically, in step S4, a plurality of photographed images photographed in a plurality of viewing directions are sequentially arranged on an image frame, thereby generating a multi-view image of the photographed subject.
In this case, the images taken by the neighboring terminals must be similarly listed on the image frame. Accordingly, each terminal participating in the generation of the multi-view image can be assigned a sequential number corresponding to a sequential position of each terminal, and the assigned number information can be utilized in the multi-view image generation process have. For example, when five mobile terminals participate in the generation of multi-view images as shown in FIG. 9, sequential numbers (1 to 5) corresponding to sequential positions are assigned to each terminal, The number information of each terminal can be inserted into the data in the form of meta data. Based on this, the images (① image to ② image) captured by each terminal can be listed in the order of the numbers assigned on the image frame have.
In addition, the images captured by the neighboring terminals may preferably include an overlap region when neighboring images are arranged on the image frame. This is because the overlapped regions allow the images to be linked more seamlessly.
Meanwhile, the operation of generating the multi-view image may be performed by various entities including the plurality of mobile terminals, the server connected to the plurality of mobile terminals, and the like. For example, 1) a mobile terminal of one of the plurality of mobile terminals generates the multi-view image after receiving photographed images from mobile terminals other than itself, or 2) Point video after receiving the photographed images.
As described above, the multi-view image generation method using a plurality of mobile terminals can be realized in the form of a program (including an application), stored in a recording medium readable by an electronic device, or a program providing server Lt; / RTI >
Hereinafter, a mobile terminal according to an embodiment of the present invention will be described.
The 'mobile terminal' according to an embodiment of the present invention, which will be described below, may include substantially the same technical features as the multi-view image generation method using the plurality of mobile terminals, although the categories are different.
Therefore, although the detailed description will not be made in order to avoid redundant descriptions, the above-mentioned characteristics related to the 'multi-view image generation method using a plurality of mobile terminals' and the like are not limited to 'mobile terminal' according to an embodiment of the present invention Analogy can be applied.
The mobile terminal according to an embodiment of the present invention can be implemented in various mobile devices including a smart phone, a tablet, a wearable device (smart clock, smart glasses, etc.), an IoT (Internet of Things) , A photographing module, a memory, a processor, and the like.
Here, the communication module is a structure for transmitting / receiving data with an electronic device such as a mobile terminal, a server, etc. other than itself. Such a communication module may be implemented in various forms including a wireless transceiver and the like.
In addition, the imaging module may be implemented in various forms including a camera module as a configuration for generating visual image data by photographing a subject.
The memory may be configured to store various data. The memory may store data to be transmitted and received by the communication module, image data generated by the imaging module, data for arithmetic operation of the processor, Lt; RTI ID = 0.0 > and / or < / RTI >
In addition, the processor is configured to perform various processing operations related to generation of multi-view images. For example, the processor may be configured to generate location correction information for a mobile terminal that is not a reference mobile terminal based on information about a reference mobile terminal, an operation connected through wireless communication with a plurality of mobile terminals, An operation of receiving a plurality of photographed images obtained by photographing a subject in a plurality of view directions from the plurality of mobile terminals, an operation of receiving a plurality of photographed images from the plurality of mobile terminals, An operation for generating a multi-view image of a subject 'can be performed. Also, the processor may be configured to determine, based on the location information of the feature points existing on the photographing screen of the reference mobile terminal, the location information of the feature points existing on the photographing screen of the mobile terminal other than the reference mobile terminal, Operation of generating position correction information 'can be performed. In addition to these operations, various operation processing operations related to generation of a multi-view image can be performed.
Hereinafter, a multi-view image generation server according to an embodiment of the present invention will be described.
The multi-view image generation server according to an embodiment of the present invention, which will be described below, may include substantially the same technical features as the multi-view image generation method using the plurality of mobile terminals, although the categories are different .
Therefore, although it will not be described in detail in order to prevent duplication, the above-mentioned features related to the 'multi-view image generation method using a plurality of mobile terminals' Of course.
The multi-view image generation server according to an exemplary embodiment of the present invention may include a communication module, a memory, a processor, and the like.
The communication module is configured to transmit and receive data to and from an electronic device such as a plurality of mobile terminals. Such a communication module may be implemented in various forms including a wireless transceiver and the like.
The memory may store various data related to generation of a multi-view image including data transmitted and received by the communication module, data for arithmetic operation of the processor, and the like, .
In addition, the processor is configured to perform various processing operations related to generation of multi-view images. For example, the processor may be configured to perform operations such as' operation connected with a plurality of mobile terminals through wireless communication ',' position correction information for other mobile terminals based on information of the reference mobile terminal among the plurality of mobile terminals An operation of receiving a plurality of photographed images obtained by photographing a subject in a plurality of view directions from the plurality of mobile terminals, an operation of generating a plurality of photographed images from the plurality of mobile terminals, An operation for generating an image 'can be performed. In addition, the processor may further include position correction information on the basis of the position information of the feature points existing on the photographing screen of the reference mobile terminal, the position information of the feature points existing on the photographing screen of the other mobile terminal, Generating operation ', and in addition to these operations, various operation processing operations related to the generation of the multi-view image can be performed.
The embodiments of the present invention described above are disclosed for the purpose of illustration, and the present invention is not limited thereto. It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit and scope of the invention.
Claims (14)
(b) generating position correction information for another mobile terminal based on the information about the reference mobile terminal;
(c) generating a plurality of photographed images of a subject in a plurality of view directions by the plurality of mobile terminals; And
(d) generating a multi-view image of the subject based on the plurality of captured images,
The step (b)
Setting minutiae for the subject by the reference mobile terminal;
Obtaining current rotation movement information of the other mobile terminal by comparing the position information of the feature points existing on the photographing screen of the reference mobile terminal with the position information of the feature points existing on the photographing screen of the other mobile terminal;
Comparing the number of pieces of information of the mobile terminals participating in the capturing of the multi-view image in the photographing setting information with the desired rotational movement information of the other mobile terminal and the current rotational movement information of the other mobile terminal, comprising a step in which the position correction information has been created for shifting,
A multi-view image generation method using a plurality of mobile terminals.
The step (b)
And adjusting the size of a subject existing on the photographing screen of the other mobile terminal by the another mobile terminal.
A multi-view image generation method using a plurality of mobile terminals.
The size of the subject is controlled by a zoom in operation, a zoom out operation or a movement of the other mobile terminal,
Wherein the size of the subject is adjusted so as to correspond to a size of a subject existing on a photographing screen of the reference mobile terminal,
A multi-view image generation method using a plurality of mobile terminals.
Wherein the position correction information includes parallel movement information or rotation movement information of the other mobile terminal,
A multi-view image generation method using a plurality of mobile terminals.
Wherein the plurality of mobile terminals are assigned sequential numbers corresponding to sequential positions among the plurality of mobile terminals,
Wherein the multi-view image is generated by arranging the plurality of captured images on an image frame in an order corresponding to the numbers,
A multi-view image generation method using a plurality of mobile terminals.
The position correction information or the multi-
A second mobile terminal, a second mobile terminal, a second mobile terminal,
A multi-view image generation method using a plurality of mobile terminals.
(b) generating position correction information for another mobile terminal based on the information about the reference mobile terminal;
(c) generating a plurality of photographed images of a subject in a plurality of view directions by the plurality of mobile terminals; And
(d) generating a multi-view image of the subject based on the plurality of captured images,
The location correction information for the other mobile terminal may include:
The feature point of the subject is set by the reference mobile terminal and the position information of the feature points existing on the photographing screen of the reference mobile terminal is compared with the position information of the feature points existing on the photographing screen of the other mobile terminal When the current rotational movement information of the other mobile terminal is obtained,
Point mobile terminal according to the comparison result between the desired rotational movement information of the other mobile terminal and the current rotational movement information of the other mobile terminal matching the number information of the mobile terminals participating in the shooting of the multi- Generated to move
A program for implementing a multi-view image generation method using a plurality of mobile terminals, the program being readable on an electronic device.
(b) generating position correction information for another mobile terminal based on the information about the reference mobile terminal;
(c) generating a plurality of photographed images of a subject in a plurality of view directions by the plurality of mobile terminals; And
(d) generating a multi-view image of the subject based on the plurality of captured images,
The location correction information for the other mobile terminal may include:
The feature point of the subject is set by the reference mobile terminal and the position information of the feature points existing on the photographing screen of the reference mobile terminal is compared with the position information of the feature points existing on the photographing screen of the other mobile terminal When the current rotational movement information of the other mobile terminal is obtained,
Point mobile terminal according to the comparison result between the desired rotational movement information of the other mobile terminal and the current rotational movement information of the other mobile terminal matching the number information of the mobile terminals participating in the shooting of the multi- Generated to move
A program providing server for providing a program for implementing a multi-view image generation method using a plurality of mobile terminals in a downloadable form.
A communication module, a photographing module, a memory, and a processor,
The processor comprising:
Connected via a wireless communication with a plurality of mobile terminals;
Generate position correction information for another mobile terminal based on the information about the reference mobile terminal among the plurality of mobile terminals;
Receiving a plurality of photographed images of a subject in a plurality of view directions from the plurality of mobile terminals; And
An arithmetic processing operation for generating a multi-view image for the subject based on the image generated by the photographing module and the plurality of photographed images received,
The location correction information for the other mobile terminal may include:
The feature point of the subject is set by the reference mobile terminal and the position information of the feature points existing on the photographing screen of the reference mobile terminal is compared with the position information of the feature points existing on the photographing screen of the other mobile terminal When the current rotational movement information of the other mobile terminal is obtained,
Point mobile terminal according to the comparison result between the desired rotational movement information of the other mobile terminal and the current rotational movement information of the other mobile terminal matching the number information of the mobile terminals participating in the shooting of the multi- Generated to move
Mobile terminal.
A communication module, a memory, and a processor,
The processor comprising:
Exchange data with a plurality of mobile terminals via wireless communication;
Generating position correction information for another mobile terminal based on information of the reference mobile terminal among the plurality of mobile terminals;
Receiving a plurality of photographed images of a subject in a plurality of view directions from the plurality of mobile terminals;
Generating a multi-view image for the subject based on the plurality of captured images; And
Performing an operation processing operation to transmit the generated multi-view image to one of the plurality of mobile terminals,
The location correction information for the other mobile terminal may include:
The feature point of the subject is set by the reference mobile terminal and the position information of the feature points existing on the photographing screen of the reference mobile terminal is compared with the position information of the feature points existing on the photographing screen of the other mobile terminal When the current rotational movement information of the other mobile terminal is obtained,
Point mobile terminal according to the comparison result between the desired rotational movement information of the other mobile terminal and the current rotational movement information of the other mobile terminal matching the number information of the mobile terminals participating in the shooting of the multi- Generated to move
Multi - view image generation server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020160008734A KR101788005B1 (en) | 2016-01-25 | 2016-01-25 | Method for generating multi-view image by using a plurality of mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020160008734A KR101788005B1 (en) | 2016-01-25 | 2016-01-25 | Method for generating multi-view image by using a plurality of mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| KR20170088623A KR20170088623A (en) | 2017-08-02 |
| KR101788005B1 true KR101788005B1 (en) | 2017-10-19 |
Family
ID=59651888
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020160008734A KR101788005B1 (en) | 2016-01-25 | 2016-01-25 | Method for generating multi-view image by using a plurality of mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| KR (1) | KR101788005B1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11924397B2 (en) | 2020-07-23 | 2024-03-05 | Samsung Electronics Co., Ltd. | Generation and distribution of immersive media content from streams captured via distributed mobile devices |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102149004B1 (en) * | 2018-12-26 | 2020-08-28 | 포디리플레이코리아 주식회사 | Method and apparatus for generating multi channel images using mobile terminal |
-
2016
- 2016-01-25 KR KR1020160008734A patent/KR101788005B1/en active IP Right Grant
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11924397B2 (en) | 2020-07-23 | 2024-03-05 | Samsung Electronics Co., Ltd. | Generation and distribution of immersive media content from streams captured via distributed mobile devices |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20170088623A (en) | 2017-08-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101991080B1 (en) | Omni-stereo capture and rendering of panoramic virtual reality content | |
| US20200236280A1 (en) | Image Quality Assessment | |
| US10523919B2 (en) | Apparatus and method for adjusting stereoscopic image parallax and stereo camera | |
| KR102023587B1 (en) | Camera Rig and Stereoscopic Image Capture | |
| CN106797460B (en) | The reconstruction of 3 D video | |
| KR102013978B1 (en) | Method and apparatus for fusion of images | |
| US20110158509A1 (en) | Image stitching method and apparatus | |
| KR20150050172A (en) | Apparatus and Method for Selecting Multi-Camera Dynamically to Track Interested Object | |
| US10681272B2 (en) | Device for providing realistic media image | |
| KR20160090373A (en) | Photographing method for dual-camera device and dual-camera device | |
| JP2010250452A (en) | Arbitrary viewpoint image synthesizing device | |
| CN109361912A (en) | Multilayer camera apparatus for 3 D visual image capture | |
| US9288472B2 (en) | Image processing device and method, and image capturing device | |
| CN109495733B (en) | Three-dimensional image reconstruction method, device and non-transitory computer readable storage medium thereof | |
| CN108282650B (en) | Naked eye three-dimensional display method, device and system and storage medium | |
| KR101725024B1 (en) | System for real time making of 360 degree VR video base on lookup table and Method for using the same | |
| KR101788005B1 (en) | Method for generating multi-view image by using a plurality of mobile terminal | |
| JP2017229067A (en) | Method and apparatus for creating pair of stereoscopic images using at least one lightfield camera | |
| CN114287126A (en) | Video processing method and device, storage medium and electronic equipment | |
| CN109785225B (en) | Method and device for correcting image | |
| CN114095644B (en) | Image correction method and computer equipment | |
| JP2017103695A (en) | Image processing apparatus, image processing method, and program of them | |
| KR101919132B1 (en) | Apparatus, method for processing video and computer program for implementing the method | |
| CN117880480A (en) | Image generation method and electronic equipment | |
| CN116260955A (en) | Digital image stereoscopic shooting system with image space projection posture correction function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A201 | Request for examination | ||
| E902 | Notification of reason for refusal | ||
| E701 | Decision to grant or registration of patent right |