KR20170055455A - Camera system for compensating distortion of lens using super wide angle camera and Transport Video Interface Apparatus used in it - Google Patents

Abstract

The present invention relates to a lens distortion image correction camera system using an ultra wide angle camera and a transport video Interface (TVI) apparatus applied with the same. The lens distortion image correction camera system using an ultra wide angle camera according to an embodiment of the present invention includes an ultra wide angle camera module, a main control unit for controlling and operating an imaging operation of the ultra wide angle camera module and the entire signal processing operation of the corresponding camera system, and an image processing unit which independently performs ePTZ (panning, tilting, zooming). Accordingly, the present invention can provide a customized monitoring image for a plurality of user interest areas.

Description

[0001] The present invention relates to a camera system and a TVI apparatus using the same, and more particularly,

The contents disclosed in this specification are based on Smart NUX-based high resolution wide angle correction camera module developed during the development time: 2013-06-01 ~ 2015-05-31 (24 months) as KITCHEN & It is an invention related to the development project of video call platform technology (task number S2091405). Specifically, one embodiment relates to a camera system that provides a monitoring image.

Unless otherwise indicated herein, the contents set forth in this section are not prior art to the claims of this application and are not to be construed as prior art to be included in this section.

In a typical camera system, when one user designates one area when using a general camera, the camera photographs only the area, and the other user who desires to monitor the other area monitors the desired area I can not.

In addition, since the conventional PTZ camera acquires a desired image by driving the actuator, there is a problem in that it is impossible to take a picture in a direction other than the viewing direction of the PTZ camera, and a user or a storage device for checking the image of the camera also has a wide There is a blind spot.

In order to solve such a problem, a PTZ operation of a camera is performed using a mechanical PTZ (panning, tilting, zooming), and a camera image (Japanese Patent Application Laid-Open No. 10-2012-0012397, hereinafter referred to as " Prior Art ").

However, in the related art, a method of acquiring and observing an image independent of each user with respect to an image of an arbitrary limited point of view picked up in a direction viewed by a mechanical PTZ control, as if there is a PTZ effect, Since the images are acquired separately from each other, the total range of the extractable images is limited.

In the prior art, when video information is transmitted from a large number of users via a network, the control range required by the user is limited. That is, when different PTZ view images proceed to the opposite operation of the mechanical PTZ, there is a problem that the user can not operate the desired region.

In addition, in the related art, video information is stored only in the video region photographed by the mechanical PTZ, and there is a limitation in monitoring and changing the desired region from the information stored by the users.

In the disclosed embodiment, a circular omnidirectional image of an ultra-wide angle camera module is processed to independently perform ePTZ (Panning, Tilting, Zooming) for each image of a user's interest area to provide customized monitoring images for a plurality of user interest areas And a TVI (Transport Video Interface) apparatus to which the present invention is applied.

Another object of the present invention is to provide a lens distortion image correction camera system using an ultra-wide angle camera and a TVI (Transport Video Interface) device applied thereto in cooperation with a remote controller unit so as to enhance user convenience in performing ePTZ.

Particularly, the area to be monitored by the user is photographed in a circular omnidirectional image, and a virtual ePTZ is performed on the circular omnidirectional image. More specifically, the area to be monitored by the user is photographed as a circular omnidirectional image, The present invention provides a lens distortion image correction camera system using a super wide angle camera and a TVI (Transport Video Interface) device applied thereto by performing a virtual ePTZ on a circular omnidirectional image of a region of interest so that a user can monitor a wide area omnidirectionally .

According to an embodiment of the present invention, there is provided a camera system for correcting a lens distortion image using an ultra-

Performing independent processing-based image processing for each region of interest that performs ePTZ (Panning, Tilting, Zooming) independently for each of the images of the designated user's interest region based on the circular omnidirectional image, B) designating a set default interest area or user interest area, c) separating the circular omni-directional image corresponding to the ROI, d) selecting a circular omni-directional image of the separated ROI E) performing a virtual ePTZ on a circular omni-directional image of a point of interest-corrected point-of-interest at a viewing point of the ROI; f) performing a virtual ePTZ- The circular omni-directional image of the region of interest is subjected to wide angle correction to convert it into a panoramic plane image, (E) performing a virtual ePTZ for a circular omni-directional image of a point-of-interest corrected region of interest at a viewing point of the ROI, When a Panning command is input according to a user's key manipulation, the coordinates of the circular omni-directional image are centered on the circular omni-directional image of the separated ROI, (T: Tilting) command according to user key manipulation, each image coordinate of the circular omniazimensional image is transformed into a transparency y (i, j) based on the center position of the circular omniazimetic image of the separated region of interest Based on the transparency y axis component based on the alpha y value and mapping the transparency y (alpha y) information according to the tilt value (Alpha y) corresponding to the tilt value according to the user input tilt command according to the mapping information between the tilting value and the transparency y, and sets the mapping information between the tilting value and the transparency y When the Z-Zooming command is input in accordance with the user's key operation, the zoom-in command is input when the zoom command is a zoom-in command Transparency x (alpha x) Transparency x (alpha x) Performs operations related to zooming in accordance with the transparency of the x-axis component. Between the transparency x (alpha x) and the zooming ratio mapped transparency x (Alpha x) corresponding to a zoom-in ratio according to a user input zoom-in command according to the mapping information between the zoom-in ratio and the transparency x (alpha x) so as to set a plurality of different user input zoom Tilt > - > fan sequence in the case where the input command is a zoom-out command, and operates in accordance with a user-specified position as a zoom-out ratio And the virtual ePTZ is independently performed for each of the circular omnidirectional images of the user's area of interest.

In one embodiment, a region to be monitored by a user is photographed in a circular omni-directional image, and a virtual ePTZ is performed on the circular omni-directional image. Specifically, the region to be monitored by the user is photographed in a circular omni-directional image, The user performs a virtual ePTZ on the circular omnidirectional image of the user's interest area to monitor the wide area in all directions.

In addition, a large number of users with different interest regions monitor a wide area all around the ROI.

Then, the circular omni-directional image of the ultra-wide angle camera module is processed to perform ePTZ (Panning, Tilting, Zooming) independently for each image of the user's interest region to provide customized monitoring images for a plurality of user's interest areas.

In other words, when a general camera is used, if one user designates one area, the camera captures only that area, so that it is not possible for another user wishing to monitor another area to monitor the desired area , One embodiment monitors the area desired by the other user.

In addition, since the conventional PTZ camera acquires a desired image by driving the actuator, it is impossible to photograph the PTZ camera in the direction other than the viewing direction, and the user or the storage device for checking the image of the camera is also required to have a wide However, in one embodiment, ePTZ is performed on the basis of the viewing position of the user's interest area to monitor the wide area in all directions.

The DVR stores the video image using the HD-TVI (High Definition Transport Video Interface), performs full-HD (1280x720p, 1920x1080p) video recording, and performs virtual PTZ. Using a conventional analog cable, you can see clear images even at distances of over 300m (1000ft).

1 is a view showing a configuration of a system related to a TVI (Transport Video Interface) apparatus to which a lens distortion image correction camera system using an ultra-wide angle camera according to an embodiment is applied
2 is a view illustrating a configuration of a TVI apparatus to which a lens distortion image correction camera system using an ultra-wide angle camera according to an embodiment is applied
FIG. 3 is a flowchart illustrating an operation of a camera system for correcting a lens distortion image using an ultra-wide angle camera according to an exemplary embodiment of the present invention.
4 is a view showing an ePTZ view image according to an embodiment;
5 is a diagram illustrating an ePTZ performing operation according to an embodiment;
6 is a view illustrating an operation of converting into a panoramic plane image according to an embodiment

FIG. 1 is a diagram illustrating a configuration of a system related to a TVI (Transport Video Interface) apparatus to which a lens distortion image correcting camera system using an ultra-wide angle camera according to an embodiment is applied. 2 is a diagram illustrating a configuration of a TVI (Transport Video Interface) apparatus to which a lens distortion image correction camera system using an ultra-wide angle camera according to an embodiment is applied.

1 and 2, an image capturing unit 101 for capturing an ultra-wide-angle circular omnidirectional image according to an embodiment, a camera processor 102 for controlling an image capturing operation of the image capturing unit 101, An independent processing-based distortion correction unit 103 for performing an ePTZ (panning, tilting, zooming) independently on each of the images of the user interest area based on the circular omniazimensional image of the ultra-wide angle camera module, A video processing unit 104 for synthesizing an image corrected by the distortion correction unit 103 with an audio signal to generate screen reproduction information, and a display control unit 104 for providing the screen reproduction information to a display device Gt; 106 < / RTI >

The image capturing unit 101 includes an ultra-wide angle camera module, captures an omnidirectional image of a specific region, and inputs a circular 360-degree omnidirectional image of the region into the camera system. In one embodiment, a virtual ePTZ (Panning, Tilting, Zooming) is performed by specifying an image of a region desired by a plurality of users and correcting a viewpoint by using an ultra-wide angle camera without a separate device such as an actuator Can be performed.

The camera processor 102 performs various control operations (e.g., imaging start operation of an ultra-wide angle camera) related to the imaging operation of the ultra-wide angle camera, performs signal processing on the captured circular 360 degree omni-directional image, .

The distortion correcting unit 103 performs an independent process-based image process (hereinafter, referred to as an " image process ") for performing an ePTZ (panning, tilting, zooming) independently for each of the images of the user interest area, which is based on the circular omniazimuth image of the ultra- Unit. The image processing unit is configured to receive a circular omniazimuth image (360-degree image) of the ultra-wide angle camera module and designate a default ROI or a ROI that is set, separates circular omni-directional images corresponding to the ROI, (I.e., the viewing point of the super-wide angle camera module is the viewing point of the user's interest area, in this case, the viewing point of the user's interest area is, for example, And the virtual ePTZ is performed, and the circular omni-directional image of the virtual ePTZ processed user's area is subjected to wide-angle correction (step < RTI ID = 0.0 > And converts them into panoramic planar images to provide customized monitoring images for a number of user interest areas (see , When using a general camera, if one user designates one area, the camera captures only that area, so that it is not possible for other users wishing to monitor another area to monitor the desired area The conventional PTZ camera has a problem that the PTZ camera can not photograph in the direction other than the viewing direction of the PTZ camera as the desired image is acquired by driving the actuator. There is a wide blind spot outside. When the Panning command is input to the circular omni-directional image of the separated ROI, the image processing unit converts each of the image coordinates into an electronic virtual image based on a center position of the circular omni-directional image of the separated ROI Z-transforming the respective image coordinates based on the center position of the circular omni-directional image of the separated ROI when the tilting (T: Tilting) command is inputted, When the command is inputted, the virtual virtual digital image scaling conversion is performed corresponding to the designated zoom ratio on the basis of the user specified position, and the virtual ePTZ is independently performed for each circular omnidirectional image of the user's interest area. In addition, the image processing unit may be configured to store a circular omniazimuth image of a previously stored super wide angle camera module in a region of interest desired by the user (for example, a region of interest desired by a person monitoring a specific place or an area may be different, And a virtual ePTZ is independently performed on the changed image by point-in-time to the viewing point of the ROI. That is, the pre-stored circular omni-directional image is changed to an image of an arbitrary user's interest area, and the virtual ePTZ is independently performed on the changed image. On the other hand, an embodiment uses a remote controller unit (RCU) ('joystick' in the conventional camera system) specifically for ePTZ command input. For this purpose, a key corresponding to each ePTZ command and transmitting a pre-designated identification RCU (Remote Control Unit) code value of the ePTZ command (eg, "Up" movement key is tilt up, The image processing unit previously registers the identification RCU code value information for each ePTZ command linked with the remote controller unit so as to be interlocked with the remote controller unit having the pan key, EPTZ is performed based on the identification RCU code value for each ePTZ command received from the remote controller unit.

The remote controller unit (RCU) has a key corresponding to each ePTZ command and transmitting a predetermined remote control unit (RCU) code value of the corresponding ePTZ command. Then, an RCU-based code value that identifies the corresponding ePTZ command is transmitted to the camera system, that is, the identified RCU code value, when the user presses the user key.

The audio processing unit 105 processes the input audio signal into an audio signal corresponding to the designated protocol to the audio processing unit 105 of the TVI apparatus and transmits the audio signal to the video processing unit 104.

The video processing unit 104 is provided with a video processing unit 104 for synthesizing an image corrected by the distortion correction unit 103 with an audio signal to generate screen reproduction information and the screen reproduction information to a display device Technology, and a detailed description thereof will be omitted).

The interface 106 interfaces the screen reproduction information provided from the video processing section 104 with a display device (e.g., an HD monitor) and outputs the interface to the display device. For example, either a serial digital interface (SDI-TX) or a transport video interface (SDI-TX) is used.

Meanwhile, one embodiment can independently implement and operate a lens distortion image correction camera system using an ultra-wide angle camera. In this case, the camera system is configured as follows.

That is, the camera system according to one embodiment includes a main controller for controlling and operating an imaging operation of the super wide angle camera module, the super wide angle camera module, and the entire signal processing operation of the camera system, (Panning, Tilting, Zooming) for each of the images of the designated user's interest region based on the circular omnidirectional image of the ROI.

The ultra-wide angle camera module captures an omni-directional image of a specific area and inputs a circular 360-degree omni-directional image of the area into the camera system. In one embodiment, a virtual ePTZ (Panning, Tilting, Zooming) is performed by specifying an image of a region desired by a plurality of users and correcting a viewpoint by using an ultra-wide angle camera without a separate device such as an actuator Can be performed.

The main control unit is a main control unit of the camera system. That is, the main control unit of the camera system controls the imaging operation of the ultra-wide angle camera module and manages and manages the entire signal processing related to the camera system (it belongs to the prior art, and a detailed description thereof will be omitted).

The image processing unit (or engine) may be configured to perform an ePTZ (Panning, Tilting, Zooming) operation for each of the images of the user interest area designated based on the circular omniazimuth image of the ultra-wide angle camera module under the control of the main control unit It is the image process unit based on the area independent processing. The image processing unit is configured to receive a circular omniazimuth image (360 degree image) of the ultra-wide angle camera module and designate a default ROI or a ROI, separates circular omni-directional images corresponding to the ROI, (I.e., the viewing point of the super-wide angle camera module is the viewing point of the user's interest area, in this case, the viewing point of the user's interest area is, for example, And the virtual ePTZ is performed, and the circular omni-directional image of the virtual ePTZ processed user's area is subjected to wide-angle correction (step < RTI ID = 0.0 > And converts them into panoramic planar images to provide customized monitoring images for a number of user interest areas (see , When using a general camera, if one user designates one area, the camera captures only that area, so that it is not possible for other users wishing to monitor another area to monitor the desired area The conventional PTZ camera has a problem that the PTZ camera can not photograph in the direction other than the viewing direction of the PTZ camera as the desired image is acquired by driving the actuator. There is a wide blind spot outside. When the Panning command is input to the circular omni-directional image of the separated ROI, the image processing unit converts each of the image coordinates into an electronic virtual image based on a center position of the circular omni-directional image of the separated ROI Z-transforming the respective image coordinates based on the center position of the circular omni-directional image of the separated ROI when the tilting (T: Tilting) command is inputted, When the command is inputted, the virtual virtual digital image scaling conversion is performed corresponding to the designated zoom ratio on the basis of the user specified position, and the virtual ePTZ is independently performed for each circular omnidirectional image of the user's interest area. In addition, the image processing unit may be configured to store a circular omniazimuth image of a previously stored super wide angle camera module in a region of interest desired by the user (for example, a region of interest desired by a person monitoring a specific place or an area may be different, And a virtual ePTZ is independently performed on the changed image by point-in-time to the viewing point of the ROI. That is, the pre-stored circular omni-directional image is changed to an image of an arbitrary user's interest area, and the virtual ePTZ is independently performed on the changed image. On the other hand, an embodiment uses a remote controller unit (RCU) ('joystick' in the conventional camera system) specifically for ePTZ command input. For this purpose, a key corresponding to each ePTZ command and transmitting a pre-designated identification RCU (Remote Control Unit) code value of the ePTZ command (eg, "Up" movement key is tilt up, The image processing unit previously registers the identification RCU code value information for each ePTZ command linked with the remote controller unit so as to be interlocked with the remote controller unit having the pan key, EPTZ is performed based on the identification RCU code value for each ePTZ command received from the remote controller unit.

The remote controller unit (RCU) has a key corresponding to each ePTZ command and transmitting a predetermined remote control unit (RCU) code value of the corresponding ePTZ command. Then, an RCU-based code value that identifies the corresponding ePTZ command is transmitted to the camera system, that is, the identified RCU code value, when the user presses the user key.

FIG. 3 is a view illustrating an operation of a lens distortion image correction camera system using an ultra-wide angle camera according to an exemplary embodiment in order.

3, the camera system according to an exemplary embodiment receives a circular omniazimuth image of an ultra-wide angle camera module (S301) and designates a default interest area or a user interest area (S304) (In this case, if a default ROI is set, the circular omnidirectional image is divided and separated by the set number according to the preset default ROI information at steps S302 and S305).

Next, the circular omnidirectional image of the separated ROI is corrected to a principal point of view of the ROI, and a virtual ePTZ is performed (S303). The circular omnidirectional image of the virtual ePTZ processed ROI is subjected to wide angle correction Panoramic plane images, and provides customized monitoring images for a plurality of user interest areas.

That is, the viewing point of the ultra-wide angle camera module is set to a viewing point of the user's interest area (in this case, the viewing point of the user's interest area is, for example, center coordinates of the user's interest area), performs a virtual ePTZ, performs a wide-angle correction of the circular omnidirectional image of the virtual ePTZ-processed user's interest area to convert it into a panoramic plane image, Provides customized monitoring images.

For example, when a pan (P) command is input from the remote controller unit to the circular omni-directional image of the separated ROI, each of the image coordinates is converted to a center position of the circular omni-directional image of the separated ROI Electronic virtual rotation movement digital conversion. When receiving a T (Tilting) command from the remote controller unit, each image coordinate is subjected to an electronic virtual up-and-down digital conversion based on the center position of the circular omni-directional image of the separated ROI. In addition, when a Z (Z) command is inputted, virtual ePTZ is independently performed for each circular omni-directional image of the user's interest region by performing electronic virtual digital image scaling conversion in accordance with a zoom ratio specified based on a user- And converts the circular omni-directional image of the virtual ePTZ processed user's interest area into a panoramic plane image by performing wide angle correction to provide customized monitoring images for a plurality of user interest areas.

More specifically, the area to be monitored by the user is photographed in a circular omnidirectional image, and a virtual ePTZ is performed on the circular omnidirectional image. Specifically, the area to be monitored by the user is photographed in a circular omnidirectional image, The user performs a virtual ePTZ on the circular omni-directional image of the user's interest area in the image, and the user monitors the wide area in all directions. Specifically, when a pan (P) command is input in accordance with a user's key operation, the circular omni-directional image of the separated ROI is input to a circular omni-directional image based on a center position of the circular omni-directional image of the separated ROI (T: Tilting) command is inputted according to the user's key manipulation, the center coordinates of the circular omni-directional image of the separated region of interest is referred to as the image coordinate of the circular omni-directional image (Alpha y) corresponding to the stereoscopic circular image, in order to tilt the stereoscopic circular image in consideration of the feature of the circular image, that is, unlike a general plane image. Specifically, the transparency y (alpha y) Based on the transparency of the y-axis component and performs a tilting operation according to the transparency of the y-axis component and maps the transparency y (alpha y) (Alpha y) corresponding to the tilt value according to the user input tilt command according to the mapping information between the tilting value and the transparency y, When the Z-Zooming command is input according to the user's key operation, the tilting operation is performed for each of the input tilt values to perform an electronic virtual up-down movement digital conversion, that is, When the zoom command is a zoom-in command, transparency x (alpha x) is performed at a zoom ratio, and transparency is performed according to transparency of an x-axis component. (Alpha x) corresponding to the zoom-in ratio according to the user input zoom-in instruction according to the mapping information between the zoom-in ratio and the transparency x (alpha x) ) To And zooming in on the circular omnidirectional image, and when the input command is a zoom-out command, the zoom-out-tilt-> tilt- > Fan sequence to perform an electronic virtual digital image scaling conversion corresponding to a designated zoom-out ratio based on a user-specified position, thereby performing a virtual ePTZ independently for each circular omnidirectional image of the user's area of interest.

Thus, when using a general camera, if one user designates one area, the camera captures only that area, so that it is not possible for other users wishing to monitor another area to monitor the desired area , One embodiment monitors the area desired by the other user.

In addition, since the conventional PTZ camera acquires a desired image by driving the actuator, it is impossible to photograph the PTZ camera in the direction other than the viewing direction, and the user or the storage device for checking the image of the camera is also required to have a wide However, in one embodiment, ePTZ is performed on the basis of the viewing position of the user's interest area to monitor the wide area in all directions.

On the other hand, one embodiment changes the circular omniazimuth image of the pre-stored super wide angle camera module to a circular omniazimetic image of the user's desired area, corrects the changed image to the viewing point of the ROI, .

In this case, it is preferable that, in this case, the circular omnidirectional image of the pre-stored super wide-angle camera module is divided into a circular omni-directional region of interest And changes the point of view of the changed image to the viewing point of the ROI and performs the virtual ePTZ independently.

That is, the pre-stored circular omni-directional image is changed to an image of an arbitrary user's interest area, and the virtual ePTZ is independently performed on the changed image.

In addition, one embodiment uses a remote controller unit (RCU) (a 'joystick' in the existing camera system) specifically for inputting ePTZ commands. For this purpose, a key corresponding to each ePTZ command and transmitting a pre-designated identification RCU (Remote Control Unit) code value of the ePTZ command (eg, "Up" movement key is tilt up, The image processing unit previously registers the identification RCU code value information for each ePTZ command linked with the remote controller unit so as to be interlocked with the remote controller unit having the pan key, EPTZ is performed based on the identification RCU code value for each ePTZ command received from the remote controller unit.

4 is a diagram illustrating an ePTZ view image according to an embodiment.

4, an exemplary embodiment of the present invention receives a circular omniazimuth image of an ultra-wide angle camera module and specifies a predetermined default ROI or a user ROI, and separates a circular omni-directional image corresponding to the ROI, Fig. 4 is an example in which the default interest region (i.e., the region of interest to be monitored) is set to three. Thus, the circular omnidirectional image is divided and separated by the set number according to the predetermined default ROI information.

5 is a diagram illustrating an ePTZ performing operation according to an embodiment of the present invention.

5, when a pan (P) command is input from the remote controller unit to the circular omniazimensional image of the separated ROI, one center of the circular omni-directional image of the separated ROI ) Digital conversion of each image coordinate by electronic virtual rotation movement. When a T (Tilting) command is input from the remote controller unit, each image coordinate is digitally converted into an electronic virtual up-and-down motion (alpha y based) based on the center position of the circular omni-directional image of the separated ROI. In addition, when a Z (Z: Zooming) command is inputted, electronic digital image scaling is performed in accordance with a zoom ratio specified based on a user-specified position (for example, A virtual ePTZ is performed independently for each of the circular omnidirectional images of the user's area of interest, and the circular omnidirectional image of the user's ePTZ processed virtual image is subjected to wide angle correction To a panoramic plane image, and provides customized monitoring images for a plurality of user interest areas.

6 is a diagram illustrating an operation of converting a panoramic plane image according to an exemplary embodiment.

6, an original circular image of an ultra-wide angle camera module, that is, an original circular image obtained by photographing 360 degrees of a specific area, is subjected to wide angle correction to obtain a panoramic plane image (e.g., a 360- , 180 degree panoramic plane image) and provides it as a monitoring image.

The correction method of one embodiment can be exemplified by a rotation conversion method and a perspective correction method. The perspective correction method can give a PTZ tilting effect by performing perspective correction based on the Y axis of the complementary image as a part of the image that is reduced as the distance from one point or one position is increased by the perspective of perspective. Of the perspective correction methods, the vanishing point method is a method of assuming an infinite distance as objects are reduced as the perspective of the vanishing point image moves away.

Description of the Related Art [0002]
101: image capturing unit 102: camera processor
103: distortion correction unit 104: video processing unit
105: audio processor 106: interface

Claims (8)

Super wide angle camera module;
A main controller for controlling and operating the imaging operation of the super wide angle camera module and the entire signal processing operation of the camera system; And
Based on an independent process-based image process for performing an ePTZ (panning, tilting, zooming) independently for each image of a user's interest area designated based on a circular omniazimuth image of the ultra-wide angle camera module under the control of the main controller unit;
/ RTI >
The image processing unit
a) receiving a circular omni-directional image of the ultra-wide angle camera module
b) specify a default default interest area or user interest area,
c) separating the circular omnidirectional image corresponding to the region of interest,
d) correcting the circular omnidirectional image of the separated ROI to the viewing point of the ROI
e) performing a virtual ePTZ on a circular omni-directional image of a point of interest-corrected point of interest at a viewing point of the ROI,
f) transforming the circular omni-directional image of the virtual ePTZ processed user's interest area into a panoramic plane image by performing a wide angle correction to provide a plurality of customized monitoring images for each user's interest area,

(E) performing a virtual ePTZ on a circular omnidirectional image of a point of interest-corrected point of interest at a viewing point of the ROI,
Wherein the image processing unit comprises:
When a Panning command is input according to a user's key manipulation, the coordinates of the circular omni-directional image are centered on the circular omni-directional image of the separated ROI, (T: Tilting) command according to user key manipulation, each image coordinate of the circular omniazimensional image is transformed into a transparency y (i, j) based on the center position of the circular omniazimetic image of the separated region of interest Based on the transparency y-axis component based on the transparency y (alpha y), performs mapping tilting based on the transparency y (alpha y) information and registers mapping information between the transparency y (alpha y) (Alpha y) corresponding to a tilt value according to a user input tilt command according to the mapping information between the tilting value and the transparency y, a plurality of different user input tilts (Z: Zooming) command according to the user's key operation. When the input zoom command is a zoom-in command, the operation of the transparency x Alpha x) at a zoom ratio Performs operations related to zooming in accordance with the transparency of the x-axis component, and performs mapping-information mapping between transparency x (alpha x) and transparency x (alpha x) (Alpha x) corresponding to the zoom-in ratio according to the user input zoom-in command according to the mapping information between the zoom-in ratio and the transparency x (alpha x) And when the input command is a zoom-out command, it sequentially operates in a set zoom-out->tilter-> fan order to correspond to a zoom-out ratio specified based on a user-specified position W electronically by a virtual digital image scaling conversion to independently perform virtual ePTZ a circular omnidirectional image for each of the user of interest;
A camera system for compensating a lens distortion image using an ultra wide angle camera. The method according to claim 1,
A remote controller unit (RCU) corresponding to each ePTZ command and having a key for transmitting a pre-designated identification RCU (Remote Control Unit) code value of a corresponding ePTZ command;
/ RTI >

The image processing unit includes:
And an ePTZ is performed based on an identification RCU code value for each ePTZ command received from the remote controller unit, and the ePTZ is performed based on the identification RCU code value for each ePTZ command received from the remote controller unit. Lens Distortion Image Correction Camera System. 3. The method according to claim 1 or 2,
The image processing unit includes:
The method includes changing a circular omniazimuth image of a pre-stored super wide angle camera module to a circular omniazimetic image of a desired region of interest by the user, performing point-in-time correction of the changed image to a viewing point of the ROI, and performing virtual ePTZ independently Lens Distortion Image Correction Camera System Using Super Wide Angle Camera. 3. The method according to claim 1 or 2,
The image processing unit includes:
The method includes changing a circular omniazimuth image of a pre-stored super wide angle camera module to a circular omniazimetic image of a desired region of interest by the user, performing point-in-time correction of the changed image to a viewing point of the ROI, and performing virtual ePTZ independently Lens Distortion Image Correction Camera System Using Super Wide Angle Camera. An image capturing unit for capturing an ultra wide angle circular omnidirectional image;
A camera processor for controlling an image capturing operation of the image capturing unit;
An independent process-based distortion correction unit for independently performing ePTZ (Panning, Tilting, Zooming) on each of the images of the user's interest region designated based on the circular omniazimensional image of the image capturing unit;
An audio processing unit for receiving and processing an audio signal;
A video processing unit for synthesizing an image corrected by the distortion correction unit with an audio signal to generate screen reproduction information; And
An interface for providing the screen reproduction information to a display device;
Lt; / RTI >
The distortion correction unit receives a circular omniazimuth image of the image capturing unit and designates a default ROI or a ROI, separates circular omni-directional images corresponding to the ROI, and outputs the circular omni-directional image of the ROI And a virtual ePTZ is performed at a point of time of the interest region of the ROI, a circular omni-directional image of the user's ROI subjected to the virtual ePTZ process is subjected to wide angle correction to convert it into a panoramic plane image, A plurality of customized monitoring images for each user's interest area,

Wherein the distortion correcting unit comprises:
When a Panning command is input according to a user's key manipulation, the coordinates of the circular omni-directional image are centered on the circular omni-directional image of the separated ROI, (T: Tilting) command according to user key manipulation, each image coordinate of the circular omnidirectional image based on the center position of the circular omnidirectional image of the separated region of interest is converted into the transparency y Alpha) y based on the transparency y axis component and performs tilting according to the transparency y (alpha y) corresponding to the tilt value according to the user input tilt command. (Z: Zooming) command is input according to the user's key operation, When the previously input zoom command is a zoom-in command, the transparency x (alpha x) is operated at a zoom ratio and the zoom-in operation is performed according to transparency of the x-axis component. (X) (alpha x), and when the input command is a zoom-out command, the zoom-out operation is performed by operating a zoom-in operation for each of a number of different user input zoom- Sequentially performing an electronic virtual digital image scaling conversion corresponding to a designated zoom-out ratio based on a user-specified position to independently perform a virtual ePTZ for each circular omni-directional image of the user's interest area;
(TVI) apparatus using a lens distortion image correction camera system using an ultra-wide angle camera. 6. The method of claim 5,
A remote controller unit (RCU) corresponding to each ePTZ command and having a key for transmitting a pre-designated identification RCU (Remote Control Unit) code value of a corresponding ePTZ command;
/ RTI >

Wherein the distortion correcting unit comprises:
And an ePTZ is performed based on an identification RCU code value for each ePTZ command received from the remote controller unit, and the ePTZ is performed based on the identification RCU code value for each ePTZ command received from the remote controller unit. A TVI (Transport Video Interface) device using a lens distortion image correction camera system. 6. The method of claim 5,
A remote controller unit (RCU) corresponding to each ePTZ command and having a key for transmitting a pre-designated identification RCU (Remote Control Unit) code value of a corresponding ePTZ command;
/ RTI >

Wherein the distortion correcting unit comprises:
And an ePTZ is performed based on an identification RCU code value for each ePTZ command received from the remote controller unit, and the ePTZ is performed based on the identification RCU code value for each ePTZ command received from the remote controller unit. A TVI (Transport Video Interface) device using a lens distortion image correction camera system. 6. The method of claim 5,
Wherein the distortion correcting unit comprises:
And changing the circular omniazimensional image of the pre-stored image capturing unit to the circular omniazimetic image of the user's desired range, correcting the changed image to the viewing point of the ROI, and performing the virtual ePTZ independently. A TVI (Transport Video Interface) device with a lens distortion image correction camera system using a camera.

Images