KR101515404B1 - Method and apparatus for controlling of virtual camera - Google Patents

Abstract

The present invention relates to an apparatus for controlling a virtual camera, and more specifically to a method and an apparatus for controlling a virtual camera which provides an image similar with the filmed image of an object at a certain point on a virtual diagonal line, from a first camera and a second camera individually arranged at both sides of the virtual diagonal line generated based on a horizontal line. The present invention includes: a camera unit, an input unit, a storing unit, a control unit, and an image signal output unit.

Description

TECHNICAL FIELD [0001] The present invention relates to a virtual camera control method and apparatus,

Embodiments of the present invention relate to a control apparatus for a virtual camera. For example, a control system for a virtual camera includes: a first camera that photographs the same object and is disposed at both ends of an imaginary oblique line with respect to a horizontal line; The present invention relates to a control apparatus and method for a virtual camera capable of providing an image similar to an image photographed on a subject.

Description of the Related Art [0002] A technology of a multi-user video conferencing system, which is a system capable of conducting a conference through audio and the like provided through video and audio devices displayed on respective display devices installed in a room, Development is increasing. The multi-party video conferencing system has an increasing difficulty in sensing the distance that the conference participants are meeting at a distance, and the development of technology for video and audio technology is increasing so that meeting attendees can have presence.

In the image technology of the conventional multi-party video conferencing system, a single camera is installed at the top of the display, and each participant performs the conference while watching the display. The meeting will be held with the other attendees watching the display of the attendees at each meeting. Unlike the participants in the actual space, conference attendees attending the multi-party video conference are unable to conduct the meeting with eye contact with each other. Multipurpose videoconferencing, which is difficult to contact with children, can reduce the concentration of conference participants and reduce the persuasiveness of the conference host.

Therefore, in a system for conversation based on images captured by a camera, it is required to develop a technology that enables each conversation party located at a remote location to keep an eye contact with each other, thereby increasing the concentration of conversation, .

KR 1008052090000 B1

An embodiment of the present invention is a system and method for controlling a virtual camera capable of providing a video with a gaze of a partner facing a camera regardless of the gaze of the opponent in a system for conversation based on a video captured by a camera to provide.

The embodiments of the present invention are also directed to a method of shooting an image of a same subject and photographing a subject photographed at a specific point on a virtual oblique line from a first camera and a second camera respectively disposed at both ends of a virtual oblique line with respect to a horizontal line, A virtual camera control apparatus and method capable of providing similar images are provided.

A control device of a virtual camera according to an embodiment of the present invention includes a first camera module and a second camera module which are disposed at both ends of a virtual slanting line and generate a first RGB video signal and a second RGB video signal, 2 camera module including a camera module; A storage unit in which at least one of the deviation fixing control value and the difference discrimination control table is stored in advance; A virtual camera video output unit for outputting a virtual camera composite video signal to a display unit; And a controller for receiving the first RGB video signal and the second RGB video signal, determining whether the deviation fixing control value is stored in advance in the storage unit, and if the deviation fixing control value is stored in advance, And generates the first virtual camera RGB image signal and the second virtual camera RGB image signal by reflecting the deviation fixed control value for the image signal and the second RGB image signal, respectively, and generates the virtual camera luminance signal correction value and the virtual camera color difference signal A first virtual camera luminance signal corrected from the virtual camera luminance signal correction value, the virtual camera color difference signal correction value, the first virtual camera RGB video signal, and the second virtual camera RGB video signal, The corrected first virtual camera color difference signal, and the corrected second virtual camera color difference signal Property to the virtual camera, a composite video signal to produce a control unit for controlling so that the output to the display unit by changing the CVBS, HDMI, at least one image of the VGA size from the virtual camera image signal output unit; . ≪ / RTI >

The controller of the virtual camera includes: a composite video output unit for outputting a composite video signal to the display unit; An input unit receiving a user input signal representing a selected composite video signal among the composite video signals to be output; And a control unit for generating an arbitrary deviation control value from the deviation discrimination control table when there is no previously stored deviation fixing control value and outputting the arbitrary deviation control value to the received first RGB video signal and the second RGB video signal The first RGB image signal and the second RGB image signal, respectively, and generates a luminance signal correction value and a color difference signal correction value, and outputs the luminance signal correction value, the color difference signal correction value, And generating a synthesized image signal by generating a first luminance signal, a corrected second luminance signal, a corrected first color difference signal, and a corrected second color difference signal from the second RGB video signal, The video signal output unit converts the video standard into at least one video standard of the CVBS, the HDMI, and the VGA, and outputs the video standard to the display unit, After receiving that determination, wherein the user input signal is received, the control unit which extracts the position error value and the deviation distance value corresponding to the composite video signal selected from said control piece discrimination table generating the deviation fixed control value; As shown in FIG.

Wherein the camera unit has an angle formed by a straight line connecting the center point of the image acquisition sensor of the first camera module and the center point of the subject and a horizontal line at an angle of 15 to 20 degrees and a center point of the image acquisition sensor of the second camera module, And the angle formed by the straight line connecting the center point of the center line and the horizontal line is 15 to 20 degrees.

The deviation fixed control value may include a distance deviation value and a position deviation value, which are parameter information for controlling the virtual camera.

Wherein the distance deviation value indicates a degree of distance of the virtual camera from the reference distance value of 0 and a distance between the first camera module and the second camera module, According to the same reduction distance deviation calculation equation,

DODR is the distance deviation value, D1 is the width of the image of the subject outputted by the RGB video signal output from the specific camera module, and n is the value of the subject of the virtual camera composite image. H1 is a point at which a position deviation value corresponding to a difference between the distance between the subject and the specific camera module and the distance between the subject and the remaining camera module becomes 0, The height and H2 of the image of the subject output by the RGB video signal output from the module may be defined as the height of the image of the subject output by the RGB video signals output from the remaining camera modules other than the specific camera module.

The distance deviation value is calculated by:

D2 is the width of the image of the subject outputted by the RGB video signal outputted from the remaining camera module, and n is the value of the size of the subject of the virtual camera composite image. The unit m is used as a unit, H1 denotes a point where a position deviation value according to a distance between the camera module and a distance between the subject and the remaining camera module becomes 0, And H2 may be a distance deviation value of the remaining camera module defined as the height of the image of the subject output by the RGB video signal output from the remaining camera module.

Wherein the distance deviation value represents a degree of distance of the virtual camera from a reference distance value of 0 and a distance between the first camera module and the second camera module, According to the same enlargement distance deviation calculation equation,

DODE is the distance deviation value, D2 is the width of the image of the subject outputted by the RGB video signal outputted from the specific camera module, and n is the size of the subject of the virtual camera composite image. H1 is a point at which a position deviation value corresponding to a difference between the distance between the subject and the specific camera module and the distance between the subject and the remaining camera module becomes 0, The height and H2 of the image of the subject output by the RGB video signal output from the remaining camera module may be defined as the height of the image of the subject output by the RGB video signal output from the specific camera module.

The distance deviation value is calculated by:

D1 is a width of an image of a subject outputted by the RGB video signal outputted from the remaining camera module, and n is a value indicating the size of a subject of a virtual camera composite image. The unit m is used as a unit, H1 denotes a point where a position deviation value according to a distance between the camera module and a distance between the subject and the remaining camera module becomes 0, And H2 may be a distance deviation value of the remaining camera module defined as the height of the image of the subject output by the RGB video signal output from the remaining camera module.

Wherein the positional deviation value represents an angle formed by a straight line connecting the center point of the image acquisition sensor of the first camera module and the center of the subject and a horizontal line, 2 It can be calculated from the angle formed by the straight line connecting the center point of the image acquisition sensor of the camera module and the center point of the subject and the horizontal line.

The control unit generates a first virtual camera luminance signal from the first virtual camera RGB image signal, generates a second virtual camera luminance signal from the second virtual camera RGB image signal, A virtual camera luminance signal difference value indicating a difference between the second virtual camera luminance signals may be generated and the virtual camera luminance signal correction value may be generated from the generated virtual camera luminance signal difference value.

The control unit generates a first virtual camera color difference signal from the first virtual camera RGB image signal, generates a second virtual camera color difference signal from the second virtual camera RGB image signal, A virtual camera color difference signal difference indicating a difference between the second virtual camera color difference signals is generated and the virtual camera color difference signal correction value may be generated from the generated virtual camera color difference signal difference.

Wherein the controller generates a first luminance signal from the first RGB video signal, generates a second luminance signal from the second RGB video signal, and generates a luminance signal representing a difference between the first luminance signal and the second luminance signal A difference signal value is generated, and the luminance signal correction value is generated from the generated luminance signal difference value.

The control unit generates a first color difference signal from the first RGB image signal, generates a second color difference signal from the second RGB image signal, and generates a color difference signal representing a difference between the first color difference signal and the second color difference signal And generates the color difference signal correction value from the generated color difference signal difference value.

A control method for a virtual camera according to an exemplary embodiment of the present invention includes a first camera module and a second camera module which are disposed at both ends of a virtual slanting line, And receiving a second RGB video signal; Determining whether a deviation fixing control value is stored in advance in the storage unit; When the deviation fixing control value is previously stored in the storage unit, the deviation control value is reflected on the first RGB video signal and the second RGB video signal so that the first virtual camera RGB video signal and the second virtual Generating a camera RGB video signal, respectively; Generating a virtual camera luminance signal correction value and a virtual camera color difference signal correction value; The corrected first virtual camera luminance signal, the corrected first virtual camera luminance signal, the corrected first virtual camera chrominance signal, and the corrected second virtual camera chrominance signal by reflecting the virtual camera luminance signal correction value and the virtual camera chrominance signal correction value, Generating virtual camera color difference signals; And generates a virtual camera composite video signal, which is a video signal obtained by combining the corrected first virtual camera luminance signal, the corrected second virtual camera luminance signal, the corrected first virtual camera color difference signal, and the corrected second virtual camera color difference signals ; And converting the virtual camera composite video signal into at least one video standard of CVBS, HDMI, and VGA and outputting the converted video standard to a display unit; . ≪ / RTI >

The control method of the virtual camera may further include: generating an arbitrary deviation control value when the deviation fixing control value is not stored in the storage unit in advance; Reflecting the arbitrary deviation control value on the first RGB video signal and the second RGB video signal, respectively; Generating a luminance signal correction value and a color difference signal correction value; Generating a corrected first luminance signal, a corrected second luminance signal, a corrected first color difference signal, and a corrected second color difference signal by reflecting the luminance signal correction value and the color difference signal correction value; Generating a synthesized image signal which is one image signal in which the corrected first luminance signal, the corrected second luminance signal, the corrected first color difference signal, and the corrected second color difference signals are synthesized; Converting the synthesized video signal into at least one video standard of the CVBS, the HDMI, and the VGA and outputting the video standard to the display unit; And through the input A position deviation value and a distance deviation value corresponding to the selected composite video signal indicated by the user selection signal are stored in the storage section according to the user selection signal, Generating the deviation-fixed control value, and storing the deviation-fixed control value in the storage unit; As shown in FIG.

The control method of the virtual camera may further include the steps of: when the user selection signal is not received, generating a new deviation control value different from the arbitrary deviation control value, and generating the first RGB video signal and the second RGB video signal To the step of reflecting them, respectively, and perform the corresponding step.

The deviation fixed control value may include a distance deviation value and a position deviation value, which are parameter information for controlling the virtual camera.

Wherein the distance deviation value indicates a degree of distance of the virtual camera from the reference distance value of 0 and a distance between the first camera module and the second camera module, According to the same reduction distance deviation calculation equation,

DODR is the distance deviation value, D1 is the width of the image of the subject outputted by the RGB video signal output from the specific camera module, and n is the value of the subject of the virtual camera composite image. H1 is a point at which a position deviation value corresponding to a difference between the distance between the subject and the specific camera module and the distance between the subject and the remaining camera module becomes 0, The height and H2 of the image of the subject output by the RGB video signal output from the module may be defined as the height of the image of the subject output by the RGB video signals output from the remaining camera modules other than the specific camera module.

The distance deviation value is calculated by:

D2 is the width of the image of the subject outputted by the RGB video signal outputted from the remaining camera module, and n is the value of the size of the subject of the virtual camera composite image. The unit m is used as a unit, H1 denotes a point where a position deviation value according to a distance between the camera module and a distance between the subject and the remaining camera module becomes 0, And H2 may be a distance deviation value of the remaining camera module defined as the height of the image of the subject output by the RGB video signal output from the remaining camera module.

Wherein the distance deviation value represents a degree of distance of the virtual camera from a reference distance value of 0 and a distance between the first camera module and the second camera module, According to the same enlargement distance deviation calculation equation,

DODE is the distance deviation value, D2 is the width of the image of the subject outputted by the RGB video signal outputted from the specific camera module, and n is the size of the subject of the virtual camera composite image. H1 is a point at which a position deviation value corresponding to a difference between the distance between the subject and the specific camera module and the distance between the subject and the remaining camera module becomes 0, The height and H2 of the image of the subject output by the RGB video signal output from the remaining camera module may be defined as the height of the image of the subject output by the RGB video signal output from the specific camera module.

The distance deviation value is calculated by:

D1 is a width of an image of a subject outputted by the RGB video signal outputted from the remaining camera module, and n is a value indicating the size of a subject of a virtual camera composite image. The unit m is used as a unit, H1 denotes a point where a position deviation value according to a distance between the camera module and a distance between the subject and the remaining camera module becomes 0, And H2 may be a distance deviation value of the remaining camera module defined as the height of the image of the subject output by the RGB video signal output from the remaining camera module.

Wherein the positional deviation value represents an angle formed by a straight line connecting the center point of the image acquisition sensor of the first camera module and the center of the subject and a horizontal line, 2 It can be calculated from the angle formed by the straight line connecting the center point of the image acquisition sensor of the camera module and the center point of the subject and the horizontal line.

According to the embodiments of the present invention, it is possible to provide a control apparatus and method for a virtual camera capable of providing an image of the other party's gaze toward the camera regardless of the gaze of the other party.

1 is a block diagram showing a control apparatus of a virtual camera according to an embodiment of the present invention.
FIG. 2 is an exemplary view showing the arrangement of a virtual camera when first and second camera modules according to an embodiment of the present invention are located on an oblique line; FIG.
FIG. 3 is a diagram illustrating an example of an image generated through a virtual camera and an image output from the first and second camera modules, respectively, when the first and second camera modules according to an embodiment of the present invention are located on a diagonal line. Degree.
4 is a diagram illustrating an example of a distance deviation generated when first and second camera modules according to an embodiment of the present invention are located on a diagonal line;
5 is a flowchart showing a control method of a virtual camera when a deviation fixing control value is stored in advance in a storage unit according to an embodiment of the present invention.
6 is a flowchart showing a control method of a virtual camera when the deviation fixing control value is not stored in advance in the storage unit according to an embodiment of the present invention.

Hereinafter, exemplary embodiments according to the present invention will be described in detail with reference to the contents described in the accompanying drawings. However, the present invention is not limited to or limited by the exemplary embodiments. Like reference numerals in the drawings denote members performing substantially the same function.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term, not on the name of a simple term, but on the entire contents of the present invention.

When an element is referred to as "including" an element throughout the specification, it is to be understood that the element may include other elements as well, without departing from the spirit or scope of the present invention. Also, the terms "part," " module, "and the like described in the specification mean units for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software .

Meanwhile, the camera unit according to the embodiment of the present invention may include at least two camera modules having image acquisition means such as a CCD sensor, a CMOS sensor, and the like.

The storage unit according to an embodiment of the present invention may include all kinds of recording media in which programs and data are stored so that the storage medium can be read by a computer system. For example, a punch card, a paper tape, a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a flash-EPROM, Read only memory (ROM), a random access memory (RAM), a compact disk (CD), a compact disk read-only memory (CD-ROM), a digital video disk (DVD) , A flexible disk, an optical data storage device, a hard disk drive (HDD), a solid state drive (SSD), a solid state hybrid drive (SSHD), and an embedded multimedia card (eMMC) . And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet).

First, in order to facilitate understanding of an apparatus and method for controlling a virtual camera according to an embodiment of the present invention, the following terms will be described.

The first camera module and the second camera module provided in the camera unit of the virtual camera control apparatus according to the embodiment of the present invention perform shooting on the same subject to generate a first RGB video signal and a second RGB video signal .

The first camera module and the second camera module according to the embodiment of the present invention photograph the same subject and can be disposed at both ends of a virtual oblique line with respect to a horizontal line. For example, the center point of the image acquisition sensor of the first camera module may be located on a virtual slant line connecting the center points of the image acquisition sensors of the second camera module. The hypothetical oblique line may extend upward in the direction of the horizontal line.

The angle of view of the image acquisition sensor of the first camera module according to the embodiment of the present invention and the angle of view of the second camera module are the same but the distances between the subject and the camera modules may be the same or different from each other .

A storage unit according to an embodiment of the present invention includes a distance value L1 between a subject and a first camera module, a distance value L2 between a subject and a second camera module, a center value of the image acquisition sensor of the first camera module, The angle formed by the straight line and the horizontal line, and the angle between the center point of the image acquisition sensor of the second camera module and the straight line connecting the subject and the horizontal line can be stored in advance.

In addition, the storage unit according to the embodiment of the present invention may previously store the deviation fixing control value, which is parameter information for controlling the virtual camera. The deviation lock control value may include a distance deviation value and a position deviation value.

In addition, the storage unit according to the embodiment of the present invention may previously store a difference discrimination control table which is arbitrary parameter information for controlling the virtual camera. The difference discrimination control table may include a distance table value and a position table value.

The distance table value according to an embodiment of the present invention may include a plurality of distance deviation values. The plurality of distance deviation values may be generated by reflecting the distance (L1) between the first camera module and the subject stored in advance in the storage unit, and the distance (L2) between the second camera module and the subject.

The position table value according to an embodiment of the present invention may include a plurality of position deviation values. The plurality of positional deviation values may be generated by reflecting an angle formed by a straight line and a horizontal line connecting the first camera module and the subject stored in advance in the storage unit and an angle formed by a straight line and a horizontal line connecting the second camera module and the subject, .

The reference distance value according to the embodiment of the present invention is 0 and the reference distance value 0 is a distance between the center point of the image acquisition sensor of the first camera module and the object L1 and the center point of the image acquisition sensor of the second camera module, Is a value indicating the position of the virtual camera disposed at the center point on a virtual slant line connecting the center point of the image acquisition sensor of the first camera module and the center point of the image acquisition sensor of the second camera module . The virtual camera located at the reference distance value 0 can acquire the frontal image of the subject.

The Deviation Of Distance (DOD) according to the embodiment of the present invention is a value indicating the degree of distance of the virtual camera from the reference distance value 0.

In addition, the distance deviation value according to the embodiment of the present invention may be calculated based on a Deviation Of Distance Reduction (DODR) calculating equation based on a specific camera module located at a close distance from a subject among the first camera module and the second camera module, Lt; / RTI >

The reduction distance deviation calculation equation (DODR) according to the embodiment of the present invention can be expressed as follows.

DODR is the distance deviation value, D1 is the width of the image of the subject outputted by the RGB video signal outputted from the specific camera module located close to the subject, and n is the size of the subject of the virtual camera composite image. m is used and is a point equal to the position of the virtual camera at a point where a position deviation value according to a distance between the subject and the specific camera module and a distance between the subject and the remaining camera module becomes zero, The height of the image of the subject outputted by the RGB video signal output from the specific camera module located close to the subject and H2 is the height of the image of the subject outputted by the RGB video signal output from the remaining camera module Height.

Further, the distance deviation value according to the embodiment of the present invention may be calculated by using a Deviation Of Distance Expansion (DODE) equation based on a specific camera module located at a distance from the subject, Lt; / RTI >

The enlargement distance deviation calculation equation (DODE) according to the embodiment of the present invention can be expressed as follows.

DODE is the distance deviation value, D2 is the width of the image of the subject outputted by the RGB video signal outputted from the specific camera module located at a distance from the subject, and n is the size of the subject of the virtual camera composite image. m is used and is a point equal to the position of the virtual camera at a point where a position deviation value according to a distance between the subject and the specific camera module and a distance between the subject and the remaining camera module becomes zero, Is the height of the image of the subject outputted by the RGB video signal outputted from the other camera module other than the specific camera module and H2 is the height of the image of the subject outputted by the RGB video signal output from the specific camera module.

The reference position value according to the embodiment of the present invention has a value of 0 and the reference position value 0 is an angle formed by a straight line connecting the central point of the image acquisition sensor of the first camera module and the central point of the subject, When the angle formed by the straight line connecting the center point of the image acquisition sensor of the second camera module and the center point of the subject and the horizontal line is 15 degrees to 20 degrees, the center point of the image acquisition sensor of the first camera module, Is a value indicating the position of the virtual camera disposed at the center point on the virtual slant line connecting the center point of the image acquisition sensor of the camera. The virtual camera located at the reference position value 0 can acquire the frontal image of the subject.

A deviation of position (DOP) according to an exemplary embodiment of the present invention is a value indicating the degree to which the position of the virtual camera is spaced from the reference position value 0. [

Further, the positional deviation value according to the embodiment of the present invention may increase in proportion to the angle formed by the straight line connecting the virtual camera and the subject and the horizontal line. For example, if the angle between the straight line connecting the virtual camera and the subject and the horizontal line is positive, the virtual camera is positioned on the first camera module side. On the other hand, if the angle formed by the straight line connecting the virtual camera and the subject and the horizontal line is a negative angle, the virtual camera is located on the second camera module side.

In addition, the positional deviation value according to the embodiment of the present invention may be determined by the angle formed by the straight line connecting the central point of the image acquisition sensor of the first camera module and the central point of the subject and the horizontal line, and the center point of the image acquisition sensor of the second camera module, Can be calculated from the angle formed by the straight line connecting the center point and the horizontal line.

Hereinafter, an apparatus and method for controlling a virtual camera according to an embodiment of the present invention will be described with reference to the accompanying drawings.

1 is a block diagram showing a control apparatus of a virtual camera according to an embodiment of the present invention. 1, a control apparatus 100 for a virtual camera according to an exemplary embodiment of the present invention includes a camera unit 110, an input unit 120, a storage unit 130, a video signal output unit 140, and a controller 150 ).

The camera unit 110 may include a first camera module 110-1 and a second camera module 110-2.

The first camera module 110-1 generates a first RGB video signal by photographing the same object as the second camera module 110-2 under the control of the controller 150, RGB video signal to the video signal processing unit 152 of the control unit 150 in real time.

The first camera module 110-1 has a virtual oblique line connecting the center point of the image acquisition sensor of the first camera module 110-1 and the center point of the image acquisition sensor of the second camera module 110-2 Lt; / RTI > An imaginary oblique line can be formed in the upper direction with respect to the horizontal line.

In addition, the first camera module 110-1 is located at a position in a range of 15 to 20 degrees formed by a straight line connecting the central point of the image acquisition sensor of the first camera module 110-1 and the central point of the subject, .

The second camera module 110-2 generates a second RGB video signal by capturing an object of the same object as the first camera module 110-1 under the control of the controller 150, RGB video signal to the video signal processing unit 152 of the control unit 150 in real time.

The second camera module 110-2 has a virtual oblique line connecting the center point of the image acquisition sensor of the second camera module 110-2 and the center point of the image acquisition sensor of the first camera module 110-1 Lt; / RTI > An imaginary oblique line can be formed in the upper direction with respect to the horizontal line.

In addition, the second camera module 110-2 has a range of -15 degrees to -20 degrees formed by a straight line connecting the central point of the image acquisition sensor of the second camera module 110-2 and the central point of the subject, Position.

The input unit 120 may receive a user selection signal indicating one composite image selected by the user among a plurality of composite video signals displayed through a display unit (not shown) under the control of the controller 150. [

The storage unit 130 may previously store the deviation fixing control value and the difference discrimination control table.

The deviation fixed control value may include a distance deviation value and a position deviation value which are parameter information for controlling the virtual camera.

The difference discrimination control table may include a distance table value and a position table value which are arbitrary parameter information for controlling the virtual camera.

The distance table value may include a plurality of distance deviation values. A plurality of distance deviation values may be calculated through a shrinkage distance deviation calculating equation based on a specific camera module located at a close distance from the subject among the first camera module and the second camera module. The plurality of distance deviation values calculated through the reduction distance deviation calculation equation may be stored in the storage unit 130 in advance.

In addition, a plurality of distance deviation values may be calculated through an enlarged distance deviation calculation equation based on a specific camera module located at a distance from the subject, among the first camera module and the second camera module. The plurality of distance deviation values calculated through the reduction distance deviation calculation equation may be stored in the storage unit 130 in advance.

The position table value may include a plurality of position deviation values. The plurality of positional deviation values are obtained by dividing an angle formed by a straight line and a horizontal line connecting the center point of the image acquisition sensor of the first camera module and the subject and a straight line connecting the center point of the image acquisition sensor of the second camera module and the center point of the subject and a horizontal line Can be calculated from the angle formed. The calculated plurality of positional deviation values may be stored in the storage unit 130 in advance.

The storage unit 130 stores the distance L1 between the subject and the first camera module, the distance L2 between the subject and the second camera module, the angle between the straight line connecting the first camera module and the subject and the horizontal line, The angle between the straight line connecting the second camera module and the subject and the horizontal line can be stored in advance. For example, the distance L1 between the subject and the first camera module, the distance L2 between the subject and the second camera module, the angle between the straight line connecting the first camera module and the subject and the horizontal line, The angle formed between the straight line and the horizontal line connecting the first camera module 110-1 and the second camera module 110-2 may be received through the input unit 120 and stored in advance in the storage unit 130, It can be updated to a new value at the time of the change of the position.

The distance value L1 between the subject and the first camera module and the distance L2 between the subject and the second camera module are set to the first camera module 110-1 and the second camera sensor module 110-2, The control unit 150 may measure the distance values through the provided distance sensors (not shown), and store the measured distance values in the storage unit 130.

The control unit 150 may include a video signal processing control unit 151, a video signal processing unit 152, a video signal synthesizing unit 153, and a virtual camera setting unit 154.

First, the video signal processing controller 151 of the controller 150 controls the first camera module 110-1 and the second camera module 110-2 provided in the camera unit 110 to output the first RGB video signal and 2 RGB video signals to be output to the video signal processing control unit 151. [

Thereafter, the video signal processing control unit 151 of the control unit 150 can determine whether the deviation fixing control value is stored in the storage unit 130 in advance.

As a result of the determination, if the deviation fixing control value is stored in advance, the video signal processing controller 151 of the controller 150 may extract the deviation fixing control value stored in advance from the storage unit 130. [

Thereafter, the video signal processing control unit 151 of the control unit 150 reflects the deviation fixed control values extracted for each of the first RGB video signal and the second RGB video signal output from the camera unit 110, 1 virtual camera RGB video signal and the second virtual camera RGB video signal, and output the generated first virtual camera RGB video signal and second virtual camera RGB video signal to the video signal processing unit 152 in real time. For example, the first virtual camera RGB video signal and the second virtual camera RGB video signal are transmitted to the first camera module 110-1 and the second camera module 110-2, The image signals used in the synthesis to generate the same image signal as the image signal photographed by the camera on the subject. The first virtual camera RGB video signal and the second virtual camera RGB video signal may each include information of a view angle of a virtual camera that photographs a subject and information of a video signal whose size of an image of a finally outputted subject is adjusted.

Then, the image processing signal unit 152 of the control unit 150 receives the first virtual camera luminance signal, the second virtual camera RGB image signal, and the second virtual camera RGB image signal from the first virtual camera RGB image signal and the second virtual camera RGB image signal received from the image signal processing control unit 151, The first virtual camera color difference signal, the second virtual camera luminance signal, and the second virtual camera color difference signal, respectively, in real time. for example, The video signal processing unit 152 of the control unit 150 can generate the first virtual camera luminance signal and the first virtual camera color difference signal in real time from the first virtual camera RGB video signal transmitted from the video signal processing control unit 151. [ The first virtual camera color difference signal may include a first virtual camera RY color difference signal, a first virtual camera GY color difference signal, and a first virtual camera BY color difference signal. The video signal processing unit 152 of the control unit 150 may generate the second virtual camera luminance signal and the second virtual camera color difference signal from the second virtual camera RGB video signal transmitted from the video signal processing control unit 151 in real time have. The second virtual camera color difference signal may include a second virtual camera RY color difference signal, a second virtual camera GY color difference signal, and a second virtual camera BY color difference signal.

Thereafter, the video signal processing unit 152 of the control unit 150 can generate the virtual camera luminance signal correction value and the virtual camera color difference signal correction value in real time. For example, the video signal processor 152 of the controller 150 calculates the difference between the first virtual camera luminance signal and the second virtual camera luminance signal, generates a virtual camera luminance signal difference value indicating the difference between the two signals in real time, The virtual camera luminance signal correction value can be generated in real time from the generated virtual camera luminance signal difference value. The virtual camera luminance signal correction value is a value for correcting to eliminate the difference between the two signals. The video signal processing unit 152 of the control unit 150 calculates the difference between the first virtual camera color difference signal and the second virtual camera color difference signal to generate a virtual camera color difference signal difference value representing the difference between the two signals in real time, The virtual camera color difference signal correction value can be generated in real time from the generated virtual camera color difference signal difference value. The virtual camera color difference signal correction value is a value for correcting the difference between the two signals.

The video signal processor 152 of the control unit 150 may store the virtual camera luminance signal correction value and the virtual camera color difference signal correction value generated in real time in the storage unit 130. [ The virtual camera luminance signal correction value and the virtual camera color difference signal correction value stored in the storage unit 130 are stored in the storage unit 130 so that the video signal processing unit 152 of the controller 150 generates a new virtual camera luminance signal correction value and a virtual camera color difference signal correction value generation time Can be used as a reference value for shortening the time.

Thereafter, the video signal processing unit 152 of the control unit 150 receives the first virtual camera luminance signal, the corrected second virtual camera luminance signal, the corrected first virtual camera luminance signal, and the corrected second virtual camera luminance signal, which are corrected from the generated virtual camera luminance signal correction value and the virtual camera color difference signal correction value, The first virtual camera color difference signal and the corrected second virtual camera color difference signal, respectively. For example, the video signal processing unit 152 of the control unit 150 receives the first virtual camera luminance signal, which is corrected by reflecting the virtual camera luminance signal correction value generated for the first virtual camera luminance signal and the second virtual camera luminance signal, And generate the corrected second virtual camera luminance signal, respectively. In addition, the video signal processor 152 of the controller 150 receives the first virtual camera color difference signal, which is corrected by reflecting the virtual camera color difference signal correction value generated for the first virtual camera color difference signal and the second virtual camera color difference signal, And generate the corrected second virtual camera color difference signal.

Thereafter, the video signal processing unit 152 of the control unit 150 outputs the corrected first virtual camera luminance signal, the corrected second virtual camera luminance signal, the corrected first virtual camera color difference signal, and the corrected second virtual camera luminance signal, And may transmit the color difference signal to the image signal synthesis unit 153.

Thereafter, the video signal synthesis unit 153 of the control unit 150 receives the first virtual camera luminance signal, the corrected second virtual camera luminance signal, the corrected first virtual camera color difference signal, and the corrected first virtual camera luminance signal from the video signal processing unit 152, The second virtual camera color difference signals are received and the virtual camera composite video signal, which is one video signal in which the received signals are synthesized, can be generated in real time.

In addition, the video signal synthesis unit 153 of the control unit 150 may further perform a layout correction processing operation in consideration of the layout of an image finally output from the virtual camera composite video signal, with respect to the generated virtual camera composite video signal have.

Thereafter, the video signal composition unit 153 of the control unit 150 can transmit the generated virtual camera composite video signal to the virtual camera video signal output unit 140-1 provided in the video signal output unit 140 in real time .

The video signal output unit 140 may include a virtual camera video signal output unit 140-1 and a composite video signal output unit 140-2.

The virtual camera video signal output unit 140-1 receives the virtual camera composite video signal in real time from the video signal synthesis unit 153 under the control of the control unit 150 and outputs the received virtual camera composite video signal to the CVBS Banking Sync, HDMI (High Definition Multimedia Interface), and VGA (Video Graphics Array), and outputs the video standard to a display unit (not shown).

On the other hand, when the deviation fixing control value is not stored in advance, the video signal processing control section 151 of the control section 150 obtains a position deviation value and an arbitrary distance deviation from the deviation difference control table stored in advance in the storage section 130 Values can be respectively extracted.

Any position deviation value can be extracted from the position table value included in the deviation discrimination control table. The image signal processing controller 151 of the controller 150 controls the angle formed between the straight line connecting the first camera module 110-1 stored in the storage unit 150 and the subject and the horizontal line, -2) and an angle formed by a straight line connecting the subject and the horizontal line, an arbitrary position deviation value can be extracted from the deviation discrimination control table.

Any distance deviation value can be extracted from the distance table value included in the deviation discrimination control table. The video signal processing control unit 151 of the control unit 150 controls the video signal processing controller 151 to reflect the distance L1 between the first camera module and the subject stored in advance in the storage unit 150 and the distance L2 between the second camera module and the subject, Can be extracted from the deviation discrimination control table.

Thereafter, the video signal processing control unit 151 of the control unit 150 may generate an arbitrary deviation control value including the extracted arbitrary position deviation value and an arbitrary distance deviation value.

Thereafter, the video signal processing control unit 151 of the control unit 150 reflects the extracted arbitrary deviation control values to the first RGB video signal and the second RGB video signal, respectively, 1 RGB video signal and a second RGB video signal in which an arbitrary deviation control value is reflected.

Then, the video signal processing controller 151 of the controller 150 outputs the first RGB video signal reflecting the generated deviation control value and the second RGB video signal reflecting the arbitrary deviation control value to the video signal processor 152, .

Thereafter, the video signal processing unit 152 of the control unit 150 receives the first RGB video signal from which the received arbitrary deviation control value is reflected, and the first luminance signal from the second RGB video signals in which the arbitrary deviation control value is reflected, The first chrominance signal, the second chrominance signal, and the second chrominance signal in real time.

Thereafter, the video signal processing unit 152 of the control unit 150 can generate the luminance signal correction value and the color difference signal correction value in real time.

Thereafter, the video signal processing unit 152 of the control unit 150 outputs the corrected first luminance signal, the corrected second luminance signal, the corrected first color difference signal, and the corrected first luminance signal, which have been corrected from the generated luminance signal correction value and the color difference signal correction value, The second color difference signal can be generated.

In addition, the image signal processor 152 of the control unit 150 may store the generated luminance correction value and color difference correction value in the storage unit 130 in real time.

Thereafter, the video signal processing unit 152 of the control unit 150 transmits the corrected first luminance signal, the corrected luminance signal, the corrected first color difference signal, and the corrected second color difference signals to the video signal synthesis unit 152 .

Thereafter, the image signal synthesis unit 152 of the control unit 150 generates an image signal S 1, S 2, S 1, S 2, S 3, S 4, S 5, S 6, Can be generated in real time.

In addition, the video signal synthesis unit 152 of the control unit 150 may further perform a layout correction processing operation in consideration of the layout of an image finally output from the composite video signal for the generated composite video signal.

Thereafter, the control unit 150 can transmit the generated composite video signal to the composite video signal output unit 140-2 of the video signal output unit 140 in real time.

Thereafter, the control unit 150 controls the composite video signal output unit 140-2 so that the composite video signal is transmitted through at least one of CVBS (Composite Video Banking Sync), HDMI (High Definition Multimedia Interface), and VGA It can be controlled so as to be changed to the video standard and output to the display unit (not shown).

Thereafter, the virtual camera setting unit 154 of the control unit 150 transmits, via the input unit 120, It can be determined whether a user selection signal has been received. The user selection signal may include information indicating one composite image selected by the user among a plurality of composite video signals output to the display unit (not shown).

If the user selection signal is received, the virtual camera setting unit 154 of the controller 150 stores the position deviation value and the distance deviation value corresponding to the selected composite video signal in the storage unit 130 according to the user selection signal, From the previously stored difference discrimination control table.

In addition, the virtual camera setting unit 154 of the control unit 150 may generate and store the deviation deviation control value including the extracted position deviation value and the distance deviation value in the storage unit 130 or update it.

On the other hand, when no user selection signal is received, the virtual camera setting unit 154 of the control unit 150 newly generates an arbitrary deviation control value different from the arbitrary deviation control value currently used, The processing before the execution can be re-executed. For example, if the distance deviation value included in any deviation control value currently used is 0 and the position deviation value is 0, the virtual camera setting unit 154 of the control unit 150 determines A new deviation control value can be generated by extracting a distance deviation value having a value of 1 and a position deviation value having a value of 1.

In the meantime, each component of the control device 100 of the virtual camera is separately shown in the drawing to show that it can be functionally and logically separated, and is physically separate component or implemented as a separate code It does not mean anything.

In this specification, each function means a functional and structural combination of hardware for carrying out the technical idea of the present invention and software for driving the hardware. For example, each functional unit may refer to a logical unit of a predetermined code and a hardware resource for executing the predetermined code, and may be a code physically connected to the functional unit, But can be easily deduced to the average expert in the field of the invention.

FIG. 2 is an exemplary view showing the arrangement of a virtual camera when first and second camera modules according to an embodiment of the present invention are located on an oblique line; FIG. 2, the first camera module 210-1 according to the embodiment of the present invention is installed on an imaginary horizontal line parallel to the horizontal line, and the first camera module 210-1 and the second camera module 210-1, Module 210-2 may be connected to each other in a virtual diagonal line. A plurality of virtual cameras 210-3 may be arranged to be spaced apart from each other on a virtual slant line connecting the first camera module 210-1 and the second camera module 210-2.

FIG. 3 is a diagram illustrating an example of an image generated through a virtual camera and an image output from the first and second camera modules, respectively, when the first and second camera modules according to an embodiment of the present invention are located on a diagonal line. . Referring to FIG. 3, the first camera module 210-1 and the second camera module 210-2 according to the embodiment of the present invention may be located on a virtual diagonal line. The hypothetical oblique line can be formed extending in the upward direction with respect to the horizontal line.

The center point of the image capturing sensor of the first camera module 210-1 may be located closer to the center point of the subject 230 than the center point of the image capturing sensor of the second camera module 210-2.

An angle formed by a straight line connecting the central point of the image acquisition sensor of the first camera module 210-1 and the central point of the subject and the horizontal line forms an angle of 15 to 20 degrees and the image of the second camera module 210-2 The angle formed by the straight line connecting the center point of the acquisition sensor and the center point of the subject and the horizontal line can be 15 degrees to 20 degrees.

A plurality of virtual cameras 210-3 may be disposed at equal intervals on a virtual slant line connecting the first camera module 210-1 and the second camera module 210-2.

At least one virtual camera disposed in the upper direction with respect to the virtual camera positioned at the center among the plurality of virtual cameras 210-3 may be disposed on the first camera module 210-1.

In addition, at least one virtual camera disposed in the lower direction with respect to the virtual camera positioned at the center among the plurality of virtual cameras 210-3 may be disposed on the side of the second camera module 210-2.

The first camera module 210-1 may output the output image 220-1 of the first camera module including the upper surface of the subject 230. [

The length of a straight line connecting the center point of the image capturing sensor of the first camera module 210-1 and the center point of the subject is shorter than the length of the straight line connecting the center point of the image capturing sensor of the second camera module 210-2 and the center point of the subject The width of the image of the subject 230 finally output by the output image 220-1 of the first camera module is finally output by the output image 220-2 of the second camera module And may have a value larger than the width of the image of the subject 230. [ Accordingly, the image of the subject 230 that is finally output by the output image 220-1 of the first camera module is compared with the image of the subject 230 that is finally output by the output image 220-2 of the second camera module It may have an enlarged image.

The second camera module 210-2 may output the output image 220-2 of the second camera module including the lower surface of the subject 230. [

The length of a straight line connecting the center point of the image capturing sensor of the second camera module 210-2 and the center point of the subject is shorter than the length of the straight line connecting the center point of the image capturing sensor of the first camera module 210-1 and the center point of the subject The width of the image of the subject 230 that is finally output by the output image 220-2 of the second camera module is shorter than the width of the subject 230 that is finally output by the output image 220-1 of the first camera module Quot;) < / RTI > The image of the subject 230 finally output by the output image 220-2 of the second camera module is compared with the image of the subject 230 which is finally output by the output image 220-1 of the first camera module You can have a reduced image.

One of the plurality of virtual camera composite images 220-3 output by the plurality of virtual cameras 210-3 may output an image including a front portion of the subject 230. [

The width of the image of the subject 230, which is finally output by the virtual camera located at the top of the plurality of virtual camera composite images 220-3 output from the plurality of virtual cameras 210-3, And may have a value larger than the width of the image of the subject 230 that is finally output. Therefore, the image of the subject 230, which is finally output by the virtual camera located at the uppermost position, can have an enlarged image as compared with the image of the subject 230 which is finally output by the virtual camera located at the lowermost position.

On the other hand, the image of the subject 230 that is finally output by the virtual camera located at the lowermost portion may have a reduced image compared to the image of the subject 230 that is finally output by the virtual camera located at the topmost position.

FIG. 4 is a diagram illustrating distance deviations occurring when first and second camera modules according to an embodiment of the present invention are located on a diagonal line; FIG. Referring to Figure 4, The distance L1 between the center point of the image capturing sensor of the first camera module 210-1 and the center point of the subject 230 according to the embodiment of the present invention is smaller than the distance L1 between the center point of the image capturing sensor of the first camera module 210-1 and the center point of the subject 230, Is shorter than the distance L2 between the center point of the subject 230 and the center point of the subject 230.

The distance L2 between the center point of the image capturing sensor of the second camera module 210-2 and the center point of the subject 230 is longer than the distance L2 between the center point of the image capturing sensor of the first camera module 210-1 and the center point of the subject 230. [ Is longer than the distance Ll between the center points of the center of gravity.

The angle formed by the straight line connecting the central point of the image acquisition sensor of the first camera module 210-1 and the central point of the subject and the horizontal line is 15 degrees to 20 degrees and the image acquisition sensor of the second camera module 210-2 The angle formed by the straight line connecting the center point of the subject and the center point of the subject and the horizontal line forms 15 to 20 degrees.

A plurality of virtual cameras 210-3 may be arranged on an imaginary slant line connecting the first camera module 210-1 and the second camera module 210-2 while maintaining equal intervals.

The first camera module 210-1 may output the output image 220-1 of the first camera module including the upper surface of the subject 230. [

The silver width D1 of the subject finally output by the output image 220-1 of the first camera module corresponds to the width D2 of the subject finally output by the output image 220-2 of the second camera module, It is much wider. This is because the distance L1 between the center point of the image capturing sensor of the first camera module 210-1 and the center point of the subject 230 is smaller than the distance L1 between the center point of the image capturing sensor of the second camera module 210-2 and the center point of the subject 230 Is shorter than the distance L2 between the center points.

The second camera module 210-2 may output the output image 220-2 of the second camera module including the lower surface of the subject 230. [

The silver width D2 of the subject finally output by the output image 220-2 of the second camera module is the width D1 of the subject finally output by the output image 220-1 of the first camera module, . This is because the distance L2 between the center point of the image capturing sensor of the second camera module 210-2 and the center point of the subject 230 is shorter than the distance L2 between the center point of the image capturing sensor of the first camera module 210-1 and the center point of the subject 230 And has a longer distance than the distance L1 between the center points.

From the width D2 of the subject finally output by the width D1 of the subject finally output by the output image 220-1 of the first camera module and the output image 220-2 of the second camera module, Value can be calculated.

The distance deviation value DOD according to the embodiment of the present invention is a value indicating the degree of distance of the virtual camera from the reference distance value 0.

Also, the distance deviation value DOD according to the embodiment of the present invention can be calculated through a Deviation Of Distance Reduction (DODR) calculation equation or a Deviation Of Distance Expansion (DODE) equation have.

As shown in FIG. 4, the reduction distance deviation (DODR) calculation equation is calculated based on the distance between the first camera module 210-1 and the second camera module 210-2, The deviation value can be calculated. For example, the calculation method of the reduction distance deviation (DODR) is a method of calculating the distance deviation value based on the distance between the first camera module 210-1 and the second camera module 210-2, Module 210-1 as a reference.

The reduction distance deviation calculation equation (DODR) according to the embodiment of the present invention can be expressed as follows.

DODR is the distance deviation value, D1 is the width of the image of the subject outputted by the RGB video signal outputted from the first camera module 210-1 which is a specific camera module located close to the subject, (M) is used as a value indicating the size of a subject, and the position of the subject is changed to a point at which a position deviation value corresponding to a deviation between the subject and the specific camera module and a distance between the subject and the remaining camera module becomes zero. H1 is the height of the image of the subject outputted by the RGB video signal outputted from the first camera module 210-1 and H2 is the height of the image of the second camera Means the height of the image of the subject output by the RGB video signal output from the module 210-2.

Further, at the time of calculating the distance deviation value by the reduction distance variation calculation equation (DODR), the distance deviation value of the second camera module 210-2 which is a camera module other than the specific camera module is calculated as D2 + (H1-H2-n) . D2 is the width of the image of the subject outputted by the RGB video signal outputted from the second camera module 210-2 which is not the specific camera module, and n is the value indicating the size of the subject of the virtual camera composite image Unit m is used and the same position as the position of the virtual camera at a point where a position deviation value according to a difference between the distance between the subject and the specific camera module and the distance between the subject and the remaining camera module becomes 0 H1 is the height of the image of the subject outputted by the RGB video signal outputted from the first camera module 210-1 which is a specific camera module, H2 is the height of the image of the subject outputted from the second camera module 210-2, And the height of the image of the subject output by the camera.

4, the enlargement distance deviation (DODE) calculation equation is calculated by dividing a specific camera module located at a distance from the subject, among the first camera module 210-1 and the second camera module 210-2, To calculate the distance deviation value. For example, when calculating the distance deviation value, the DODE calculation equation is used to calculate the distance deviation value based on a distance between the first camera module 210-1 and the second camera module 210-2, Module 210-2 as a reference.

The enlargement distance deviation calculation equation (DODE) according to the embodiment of the present invention can be expressed as follows.

DODE is the distance deviation value, D2 is the width of the image of the subject outputted by the RGB video signal outputted from the second camera module 210-2 which is a specific camera module located at a distance from the subject, (M) is used as a value indicating the size of a subject, and the position of the subject is changed to a point at which a position deviation value corresponding to a deviation between the subject and the specific camera module and a distance between the subject and the remaining camera module becomes zero. H1 is the height of the image of the subject outputted by the RGB video signal outputted from the first camera module 210-1 which is not the specific camera module and H2 is the height of the image of the specific camera module Means the height of the image of the subject output by the RGB video signal output from the second camera module 210-2.

In calculating the distance deviation value by the enlargement distance deviation calculation equation (DODE), the distance deviation value of the first camera module 210-1 which is a camera module other than the specific camera module is D1- (H1-H2-n) Can be calculated. D1 is the width of the image of the subject outputted from the RGB video signal outputted from the first camera module 210-1 which is the camera module other than the specific camera module and n is the value indicating the size of the subject of the virtual camera composite image Unit m is used and the same position as the position of the virtual camera at a point where a position deviation value according to a difference between the distance between the subject and the specific camera module and the distance between the subject and the remaining camera module becomes 0 H1 is the height of the image of the subject outputted by the RGB video signal outputted from the first camera module 210-1 which is the other camera module other than the specific camera module and H2 is the height of the second camera module 210 -2) of the subject image outputted by the RGB video signal.

Therefore, the apparatus and method for controlling a virtual camera according to an embodiment of the present invention may be configured such that a first camera module 210-1 and a second camera module 210-2 are connected to each other through a deviation control value stored in advance in a deviation control table The position of the virtual camera located on the diagonal line can be determined.

The apparatus and method for controlling a virtual camera according to an exemplary embodiment of the present invention may include a first camera module 210-1 and a second camera module 210-2, And the position of the virtual camera can be controlled by determining a deviation fixed control value according to the user input signal after temporarily determining an arbitrary deviation fixed control value.

The deviation discrimination control table may include a plurality of position deviation values and a plurality of distance deviation values generated in advance and generated. For example, the controller of a virtual camera according to an embodiment of the present invention may calculate the distance L1 between the center point of the image acquisition sensor of the first camera module and the center point of the object received through the input unit or stored in the storage unit among the plurality of distance deviation values, And an arbitrary distance deviation value corresponding to the distance L2 between the center point of the image acquisition sensor of the second camera module and the center point of the subject can be extracted.

In addition, the controller of the virtual camera according to the embodiment of the present invention controls the angles formed by the straight line and the horizontal line connecting the central point of the image acquisition sensor of the first camera module 210-1 stored in advance in the storage unit and the central point of the subject, It is possible to extract an arbitrary position deviation value corresponding to an angle formed by a straight line connecting the center point of the image acquisition sensor of the camera module 210-2 and the center point of the subject and the horizontal line.

5 is a flowchart showing a control method of a virtual camera when a deviation fixing control value is stored in advance in a storage unit according to an embodiment of the present invention. 5, the control unit 150 of the controller 100 of the virtual camera according to the embodiment of the present invention includes a first camera module (not shown) disposed at both ends of a virtual oblique line, The first RGB image signal and the second RGB image signal generated from the first camera module 201-1 and the second camera module 210-2, respectively.

Thereafter, the control unit 150 may determine whether the deviation fixing control value is stored in the storage unit 130 (502).

As a result of the determination, when the deviation fixed control value is stored in advance in the storage unit 130, the controller 150 reflects the deviation control value for the first RGB video signal and the second RGB video signal, The virtual camera RGB image signal, and the second virtual camera RGB image signal, respectively (503). For example, the control unit 150 may extract the deviation-fixed control value stored in advance from the storage unit 130. [

Thereafter, the controller 150 may generate the virtual camera luminance signal correction value and the virtual camera color difference signal correction value in real time (504). For example, a first virtual camera luminance signal, a first virtual camera color difference signal, a second virtual camera luminance signal, and a second virtual camera luminance signal are generated from the generated first virtual camera RGB video signal and second virtual camera RGB video signals of the controller 150, Camera color difference signals can be generated in real time. Thereafter, the controller 150 generates a virtual camera luminance signal difference value from the first virtual camera luminance signal and the second virtual camera luminance signal, and generates a virtual camera color difference signal from the first virtual camera color difference signal and the second virtual camera color difference signal, A difference value can be generated. Thereafter, the controller 150 generates a virtual camera luminance signal correction value from the virtual camera luminance signal difference value, and generates a virtual camera color difference signal correction value from the virtual camera color difference signal difference value.

In addition, the controller 150 may store the generated virtual camera luminance correction value and the generated virtual camera color difference correction value in the storage unit 130 in real time.

Thereafter, the controller 150 reflects the generated virtual camera luminance signal correction value and the virtual camera color difference signal correction value, and outputs the corrected first virtual camera luminance signal, the corrected second virtual camera luminance signal, A camera color difference signal, and a corrected second virtual camera color difference signal, respectively (505).

Thereafter, the control unit 150 receives the first virtual camera luminance signal, the corrected second virtual camera luminance signal, the corrected first virtual camera color difference signal, and the corrected second virtual camera color difference signals, The synthesized video signal of the virtual camera can be generated in real time (506). The control unit 150 can transmit the generated virtual camera composite video signal to the virtual camera video signal output unit 140-1 of the video signal output unit 140 in real time.

In addition, the controller 150 may further perform a layout correction processing operation in consideration of the layout of an image finally output from the virtual camera composite video signal with respect to the generated virtual camera composite video signal.

Thereafter, the control unit 150 outputs the virtual camera composite video signal through the virtual camera video signal output unit 140-1 to the video camera 100 through a composite video banking sync (CVBS), a high-definition multimedia interface (HDMI) It is possible to change the image standard to at least one image standard and output the image standard to a display unit (not shown) (507).

Meanwhile, the deviation fixing control value stored in advance in the storage unit 130 may include a distance deviation value and a position deviation value. The distance deviation value may be calculated and stored in advance through a reduction distance deviation calculation equation or an enlarged distance deviation calculation equation reflecting the distance (L1) between the first camera module and the subject and the distance (L2) between the second camera module and the subject .

In addition, the positional deviation value may be calculated and reflected by reflecting an angle formed by a straight line connecting the first camera module and the subject and a horizontal line, and an angle formed by a straight line and a horizontal line connecting the second camera module and the subject.

6 is a flowchart showing a control method of a virtual camera when the deviation fixing control value is not stored in advance in the storage unit according to an embodiment of the present invention. Referring to FIG. 6, when the deviation fixing control value is not stored in the storage unit in advance, the controller 150 of the control apparatus 100 of the virtual camera according to the embodiment of the present invention determines the arbitrary A deviation control value may be generated (601). For example, the control unit 150 may extract an arbitrary position deviation value and an arbitrary distance deviation value from the entry discrimination control table stored in the storage unit 130, respectively. Then, the control unit 150 may generate an arbitrary deviation control value including any extracted position deviation value and any distance deviation value.

Thereafter, the control unit 150 reflects the extracted arbitrary deviation control values to the first RGB video signal and the second RGB video signal, respectively, and outputs the first RGB video signal reflecting an arbitrary deviation control value, A second RGB video signal reflecting the control value can be generated (602).

Thereafter, the controller 150 can generate the luminance signal correction value and the color difference signal correction value in real time (603). For example, the control unit 150 generates a first luminance signal, a first color difference signal, a second luminance signal, and a second luminance signal from the first RGB image signal in which the generated deviation control value is reflected and the second RGB image signals in which a certain deviation control value is reflected, And the second color difference signal, respectively. Thereafter, the controller 150 may generate a luminance signal difference value from the first luminance signal and the second luminance signal, and may generate a color difference signal difference value from the first color difference signal and the second color difference signal. Thereafter, the control unit 150 generates a luminance signal correction value from the luminance signal difference value, and generates a color difference signal correction value from the color difference signal difference value.

Thereafter, the controller 150 outputs the corrected first luminance signal, the corrected second luminance signal, the corrected first color difference signal, and the corrected second color difference signal by reflecting the generated luminance signal correction value and the color difference signal correction value Respectively (604).

Thereafter, the control unit 150 generates a composite video signal, which is a video signal obtained by combining the corrected first luminance signal, the corrected second luminance signal, the corrected first color difference signal, and the corrected second color difference signals in real time (605).

In addition, the controller 150 may further perform a layout correction processing operation in consideration of the layout of an image finally output from the composite video signal for the generated composite video signal.

Thereafter, the control unit 150 controls the composite video signal output unit 140-2 so that the composite video signal is transmitted through at least one of CVBS (Composite Video Banking Sync), HDMI (High Definition Multimedia Interface), and VGA (606) so as to be output to the display unit (not shown).

Thereafter, the control unit 150 transmits, via the input unit 120, It can be determined whether a user selection signal has been received (607).

As a result of the determination, if the user selection signal is received, the controller 150 outputs a position deviation value and a distance deviation value corresponding to the selected composite video signal according to the user selection signal, (608).

Thereafter, the virtual camera setting unit 154 of the control unit 150 generates a deviation fixed control value including the extracted position deviation value and the distance deviation value, and stores the generated deviation fixed control value in the storage unit 130 (609).

If the user selection signal is not received, the controller 150 generates a new deviation control value different from the currently used deviation control value, and proceeds to step 602 to perform the corresponding process (step 610) .

Meanwhile, the difference discrimination control table stored in advance in the storage unit 130 may include a distance table value and a position table value. The distance table value includes a plurality of distance deviation values, and the plurality of distance difference values reflect the distance (L1) between the first camera module and the subject and the distance (L2) between the second camera module and the subject, Or may be calculated and stored in advance in the magnification-varying deviation calculation equation.

The position table value includes a plurality of positional deviation values. The plurality of positional deviation values include an angle formed by a straight line connecting the first camera module and the subject and a horizontal line, and a straight line connecting the second camera module and the subject, Can be calculated and reflected in advance.

The methods according to exemplary embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. Program instructions to be recorded on the medium may be those specially designed and constructed for the present invention or may be known and available to those of ordinary skill in the computer software arts.

Although the present invention has been described with reference to the accompanying drawings and the foregoing embodiments, the present invention is not limited thereto but is limited by the following claims. Accordingly, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope of the present invention as defined by the appended claims.

100: Control device of virtual camera
110:
110-1: First camera module
110-2: second camera module
120: Input unit
130:
140: Video signal output section
140-1: Virtual camera video signal output unit
140-2: Composite video signal output unit
150:
151: Video signal processing control unit
152: Video signal processor
153:
154: Virtual camera setting unit
210-1: First camera module
210-2: second camera module
210-3: Multiple virtual cameras
220-1: Output image of the first camera module
220-2: output image of the second camera module
220-3: Output image of plural virtual cameras

Claims (22)

A first camera module and a second camera module which are respectively disposed at both ends of a virtual slanting line and generate a first RGB video signal and a second RGB video signal respectively with respect to a subject, An angle formed by a straight line connecting the center point of the acquired sensor and the center point of the subject and a horizontal line forms an angle of 15 to 20 degrees and an angle formed by a straight line connecting the center point of the image acquisition sensor of the second camera module and the center of the subject, A camera unit having an angle of 15 to 20 degrees;
At least one of a deviation control value and a difference control table is stored in advance, wherein the deviation control value includes a distance deviation value and a position deviation value, which are parameter information for controlling the virtual camera;
A video signal output unit for outputting a virtual camera composite video signal to a display unit; And
The first RGB image signal and the second RGB image signal, determining whether the deviation fixing control value is stored in the storage unit in advance, and if there is the deviation fixing control value stored in advance, Signal and the second RGB video signal to generate the first virtual camera RGB video signal and the second virtual camera RGB video signal respectively by reflecting the deviation fixed control value to the virtual camera luminance signal correction value and the virtual camera color difference signal correction And generates a first virtual camera luminance signal corrected from the virtual camera luminance signal correction value, the virtual camera color difference signal correction value, the first virtual camera RGB video signal, and the second virtual camera RGB video signal, A second virtual camera luminance signal, a corrected first virtual camera color difference signal, and a corrected second virtual camera color difference signal, And a control unit for generating the virtual camera composite video signal and changing the video standard to at least one of CVBS, HDMI, and VGA through a virtual camera video signal output unit of the video signal output unit,
Wherein the video signal output unit further includes a composite video signal output unit,
And an input unit receiving a user input signal representing a selected composite video signal among a plurality of composite video signals outputted from the composite video signal output unit and displayed through the display unit,
Wherein the control unit generates an arbitrary deviation control value from the deviation discrimination control table when there is no previously stored deviation fixing control value and outputs the arbitrary deviation control value to the received first RGB video signal and the second RGB video signal Generating a first RGB image signal and a second RGB image signal by reflecting the control value, generating a luminance signal correction value and a color difference signal correction value, and outputting the luminance signal correction value, the color difference signal correction value, A first luminance signal, a corrected second luminance signal, a corrected first color difference signal, and a corrected second color difference signal from the video signal and the second RGB video signal to generate a composite video signal, Converting the video standard into at least one video standard among the CVBS, the HDMI, and the VGA through the composite video signal output unit, and outputting the video standard to the display unit, Wherein the controller determines whether an input signal is received and, when the user input signal is received, extracts a position deviation value and a distance deviation value corresponding to the selected composite video signal from the deviation difference control table to generate the deviation fixing control value The control unit of the virtual camera.
delete delete delete 2. The method according to claim 1,
Wherein the distance between the first camera module and the second camera module is defined as a distance from the reference distance value 0, and a distance between the first camera module and the second camera module, According to the following equation

(DODR is the distance deviation value,
D1 is the width of the image of the subject outputted by the RGB video signal output from the specific camera module,
H1 is the height of the image of the subject outputted by the RGB video signal outputted from the specific camera module,
H2 is the height of the image of the subject outputted by the RGB video signal outputted from the camera module other than the specific camera module,
n is a value representing the size of the subject of the virtual camera composite image, and unit m is used as a unit, and a position deviation value according to a deviation between the subject and the specific camera module and a distance between the subject and the remaining camera module is 0 " refers to the same point as the position of the virtual camera)
Of the virtual camera. 6. The method according to claim 5,
The following equation

(D2 is the width of the image of the subject outputted by the RGB video signal outputted from the camera module other than the specific camera module,
H1 is the height of the image of the subject outputted by the RGB video signal outputted from the specific camera module,
H2 is the height of the image of the subject outputted by the RGB video signal outputted from the camera module other than the specific camera module,
n is a value representing the size of the subject of the virtual camera composite image, and unit m is used as a unit, and a position deviation value according to a deviation between the subject and the specific camera module and a distance between the subject and the remaining camera module is 0 " refers to the same point as the position of the virtual camera)
Of the virtual camera. 2. The method according to claim 1,
Wherein the distance between the first camera module and the second camera module is a distance from the reference distance value 0, and the distance between the first camera module and the second camera module, , The following equation

(DODE is the distance deviation value,
D2 is the width of the image of the subject outputted by the RGB video signal output from the specific camera module,
H1 is the height of the image of the subject outputted by the RGB video signal outputted from the camera module other than the specific camera module
H2 is the height of the image of the subject output by the RGB video signal output from the specific camera module
n is a value representing the size of the subject of the virtual camera composite image, and unit m is used as a unit, and a position deviation value according to a deviation between the subject and the specific camera module and a distance between the subject and the remaining camera module is 0 " refers to the same point as the position of the virtual camera)
Of the virtual camera.
8. The method according to claim 7,
The following equation

(D1 is the width of the image of the subject outputted by the RGB video signal outputted from the remaining camera module,
H1 is the height of the image of the subject outputted by the RGB video signal outputted from the camera module other than the specific camera module,
H2 is the height of the image of the subject output by the RGB video signal output from the specific camera module
n is a value representing the size of the subject of the virtual camera composite image, and unit m is used as a unit, and a position deviation value according to a deviation between the subject and the specific camera module and a distance between the subject and the remaining camera module is 0 " refers to the same point as the position of the virtual camera)
And a distance deviation value of the remaining camera module, which is defined as < RTI ID = 0.0 > a < / RTI >
9. The method according to claim 6 or 8,
An angle formed by a straight line connecting the center point of the image capturing sensor of the first camera module and the center point of the subject and a horizontal line, and an angle of the image captured by the second camera module Is calculated from an angle formed by a straight line connecting the center point of the sensor and the center point of the subject and a horizontal line.
The apparatus of claim 1,
Generating a first virtual camera luminance signal from the first virtual camera RGB video signal, generating a second virtual camera luminance signal from the second virtual camera RGB video signal, Generates a virtual camera luminance signal difference value indicating a difference between camera luminance signals, and generates the virtual camera luminance signal correction value from the generated virtual camera luminance signal difference value.
11. The apparatus according to claim 10,
Generating a first virtual camera color difference signal from the first virtual camera RGB image signal, generating a second virtual camera color difference signal from the second virtual camera RGB image signal, Generates a virtual camera color difference signal difference indicating a difference between camera color difference signals, and generates the virtual camera color difference signal correction value from the generated virtual camera color difference signal difference value.
The apparatus of claim 1,
Generating a first luminance signal from the first RGB video signal, generating a second luminance signal from the second RGB video signal, and generating a luminance signal difference value indicating a difference between the first luminance signal and the second luminance signal And generates the luminance signal correction value from the generated luminance signal difference value.
13. The apparatus according to claim 12,
Generating a first color difference signal from the first RGB image signal, generating a second color difference signal from the second RGB image signal, and generating a color difference signal difference value indicating a difference between the first color difference signal and the second color difference signal And generates the color difference signal correction value from the generated color difference signal difference value.
delete Receiving a first RGB video signal and a second RGB video signal respectively generated from a first camera module and a second camera module, which are respectively disposed at both ends of a virtual oblique line and perform shooting with respect to a subject;
Determining whether a deviation fixed control value including a distance deviation value and a position deviation value, which is parameter information for controlling the virtual camera, is stored in advance in the storage unit;
Generating an arbitrary deviation control value when the deviation fixing control value is not previously stored in the storage section;
Reflecting the arbitrary deviation control value on the first RGB video signal and the second RGB video signal, respectively;
Generating a luminance signal correction value and a color difference signal correction value;
Generating a corrected first luminance signal, a corrected second luminance signal, a corrected first color difference signal, and a corrected second color difference signal by reflecting the luminance signal correction value and the color difference signal correction value;
Generating a synthesized image signal which is one image signal in which the corrected first luminance signal, the corrected second luminance signal, the corrected first color difference signal, and the corrected second color difference signals are synthesized;
Converting the synthesized video signal into at least one video standard of CVBS, HDMI, and VGA, and outputting the synthesized video signal to a display unit; And
Through the input And generates a new deviation control value different from the arbitrary deviation control value when the user selection signal is not received, Wherein the step of performing the step is performed by moving to a step of reflecting each signal to the target.
delete delete 16. The method of claim 15,
Wherein the distance between the first camera module and the second camera module is defined as a distance from the reference distance value 0, and a distance between the first camera module and the second camera module, Depending on the,

(DODR is the distance deviation value,
D1 is the width of the image of the subject outputted by the RGB video signal output from the specific camera module,
H1 is the height of the image of the subject outputted by the RGB video signal outputted from the specific camera module
H2 is the height of the image of the subject outputted by the RGB video signal outputted from the camera module other than the specific camera module
n is a value representing the size of the subject of the virtual camera composite image, and unit m is used as a unit, and a position deviation value according to a deviation between the subject and the specific camera module and a distance between the subject and the remaining camera module is 0 " refers to the same point as the position of the virtual camera)
Of the virtual camera. 19. The method of claim 18,
The following equation

(D2 is the width of the image of the subject outputted by the RGB video signal outputted from the remaining camera module,
H1 is the height of the image of the subject output by the RGB video signal output from the specific camera module,
H2 is the height of the image of the subject outputted by the RGB video signal outputted from the remaining camera module
n is a value representing the size of the subject of the virtual camera composite image, and unit m is used as a unit, and a position deviation value according to a deviation between the subject and the specific camera module and a distance between the subject and the remaining camera module is 0 " refers to the same point as the position of the virtual camera)
And a distance deviation value of the remaining camera module defined by the distance value of the camera module.
16. The method of claim 15,
Wherein the distance between the first camera module and the second camera module is a distance from the reference distance value 0, and the distance between the first camera module and the second camera module, Depending on the,

(DODE is the distance deviation value,
D2 is the width of the image of the subject outputted by the RGB video signal output from the specific camera module,
H1 is the height of the image of the subject outputted by the RGB video signal outputted from the camera module other than the specific camera module
H2 is the height of the image of the subject output by the RGB video signal output from the specific camera module
n is a value representing the size of the subject of the virtual camera composite image, and unit m is used as a unit, and a position deviation value according to a deviation between the subject and the specific camera module and a distance between the subject and the remaining camera module is 0 " refers to the same point as the position of the virtual camera)
Of the virtual camera.
21. The method of claim 20,
The following equation

(D1 is the width of the image of the subject outputted by the RGB video signal outputted from the remaining camera module
H1 is the height of the image of the subject outputted by the RGB video signal outputted from the camera module other than the specific camera module
H2 is the height of the image of the subject output by the RGB video signal output from the specific camera module
n is a value representing the size of the subject of the virtual camera composite image, and unit m is used as a unit, and a position deviation value according to a deviation between the subject and the specific camera module and a distance between the subject and the remaining camera module is 0 " refers to the same point as the position of the virtual camera)
And a distance deviation value of the remaining camera module defined by the distance value of the camera module.
22. The method according to claim 19 or claim 21,
An angle formed by a straight line connecting the center point of the image capturing sensor of the first camera module and the center point of the subject and a horizontal line, and an angle of the image captured by the second camera module Is calculated from an angle formed by a straight line connecting the center point of the sensor and the center point of the subject and a horizontal line.

Images