KR101001425B1 - Apparatus and method controlling PTZPan-Tilt-Zoom camera using multi sensor - Google Patents

Abstract

The present invention relates to a multi-sensor based PTZ camera control device and method, and more particularly, to pan-tilt-zoom (PTZ: pan-tilt-zoom) based on the movement of a mobile terminal device having an acceleration sensor and a touch sensor. The present invention relates to a PTZ camera control apparatus and method for controlling a camera.

The multi-sensor based PTZ camera control apparatus and method according to the present invention solves the problem that a device such as a keyboard, a mouse and a joystick for controlling a conventional camera should be connected to a computer, thereby enabling a mobile terminal such as a mobile phone or personal digital assistants. Has the advantage of easy operation.

Multi sensor, pan-tilt-zoom (PTZ) camera

Description

Apparatus and method controlling PTZ (Pan-Tilt-Zoom) camera using multi sensor}

The present invention relates to a multi-sensor based PTZ (pijet) camera control device and method, and more particularly, a PTZ camera control device that can control a remote PTZ camera according to the movement of the device with the built-in acceleration sensor and touch sensor And to a method.

With the recent development of electronic and communication technology, the field for public safety and well-being life is emerging as the most interesting technology field using mobile devices such as mobile phones and personal digital assistants (PDAs).

For example, as the field of use of various sensors in addition to the phone function of a mobile phone is diversified, it is evolving into a human-centered digital convergence information device.

In addition, as society develops, the need for safety is increasing, and for the safety of public areas, CCTVs (closed-circuit television) are installed to prevent various crimes and safety accidents and to solve the incidents by playing recorded video.

Recently, more and more people want to see a child, an old mother, or a dog by installing surveillance cameras at homes, schools, children's playgrounds, and playrooms.

Closed-circuit television (CCTV) is used not only for video surveillance but also in various fields. To provide effective services in these fields, 360-degree rotation is required through the pan-tilt-zoom (PTZ) function. You need to look in different directions with one camera.

Conventional methods of controlling a pan-tilt-zoom (PTZ) camera include a keyboard, a mouse, a joystick, and the like.

However, the related art has a problem in that a device such as a keyboard, a mouse, and a joystick should be connected to a computer.

That is, there is a problem that can not be easily operated in a mobile terminal such as a mobile phone, PDA (personal digital assistants) to move and operate.

The technical problem to be achieved by the present invention is to solve the problem of the conventional method of controlling a pan-tilt-zoom (PTZ) camera, a mobile embedded with a multi-sensor, such as a touch image sensor and an acceleration sensor To provide a multi-sensor based PTZ camera control device and method that can control a pan-tilt-zoom (PTZ) camera according to the movement of the device.

One embodiment of a multi-sensor based PTZ camera control apparatus according to the present invention for solving the above technical problem, the sensing receiver for separating the touch sensor data and the three-axis acceleration sensor data of the received multi-sensor data; A cache configured to store the separated touch sensor data and 3-axis acceleration sensor data, respectively; A processor for mapping a pan-tilt-zoom (PTZ) camera control command based on the stored touch sensor data and 3-axis acceleration sensor data; A data generator configured to generate a data packet including the pan-tilt-zoom (PTZ) camera control command; And a transmitter for transmitting the data packet.

One embodiment of a multi-sensor based PTZ camera control method according to the present invention for solving the above technical problem, the sensing receiving step of separating the touch sensor data and the 3-axis acceleration sensor data of the received multi-sensor data; A data storing step of storing the separated touch sensor data and the 3-axis acceleration sensor data, respectively; A processing step of mapping a pan-tilt-zoom (PTZ) camera control command based on the stored touch sensor data and 3-axis acceleration sensor data; A data generation step of generating a data packet including the pan-tilt-zoom (PTZ) camera control command; And a transmitting step of transmitting the data packet.

According to the multi-sensor based PTZ camera control apparatus and method according to the present invention, a device such as a keyboard, a mouse and a joystick for controlling a conventional camera needs to be connected to a computer to solve a problem such as a mobile phone or a personal digital assistant (PDA). The terminal has an advantage that can be easily operated.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a view showing a conceptual diagram of a multi-sensor based PTZ camera control method according to the present invention.

The mobile device 110 in FIG. 1 may be a mobile phone, a PDA, a smart phone, or the like capable of wireless communication.

The mobile device 110 may include a touch sensor and a 3-axis acceleration sensor to detect the movement of the mobile device, analyze the movement of the mobile device to form a data packet, and transmit the data packet to a remote place through the wireless Internet 120. The pan-tilt-zoom (PTZ) camera 130 may be transmitted to the pan-tilt-zoom (PTZ) camera 130 to control the pan-tilt-zoom (PTZ) camera 130.

The mobile device includes a display unit to display an image captured by the pan-tilt-zoom (PTZ) camera 130 controlled by the data packet in real time.

The mobile device is capable of wireless connection such as Wi-Fi.

2 is a view showing a conceptual diagram of a multi-sensor based PTZ camera control apparatus according to the present invention.

The multi-sensor based PTZ camera control apparatus according to the present invention may be included in a hair work device having a touch sensor and a 3-axis acceleration sensor.

The multi-sensor based PTZ camera control apparatus according to the present invention includes a multi sensor unit 225, a sensing receiver 230, a cache 240, a processor 250, a data generator 260, and a transmitter 270.

The multi sensor unit 225 includes a touch sensor 210 and a three-axis angular velocity sensor 220.

The touch sensor 210 may sense a finger touch light such as a display unit of the mobile device.

Stretching two points of the display unit through the finger touch may be mapped to a magnification control command of an area that can be captured by a remote pan-tilt-zoom (PTZ) camera.

Collecting two points of the display unit may be mapped to a reduction control command of an area that can be captured by a remote pan-tilt-zoom (PTZ) camera.

The three-axis angular velocity sensor is a panning control command, tilting control command or zooming control of a pan-tilt-zoom (PTZ) camera based on an angular velocity magnitude value above a predetermined threshold. Can be mapped to a command.

FIG. 3 is a diagram illustrating an embodiment of mapping a pan-tilt-zoom (PTZ) camera control command based on a 3-axis acceleration magnitude value according to the present invention.

FIG. 3A is a diagram illustrating a result of measuring a value of a 3-axis acceleration magnitude for panning control of a pan-tilt-zoom (PTZ) camera.

The panning left control of the pan-tilt-zoom (PTZ) camera of FIG. 3A is mapped when turning from the current position of the mobile device on the -X axis to the -Z axis.

The panning right control of the pan-tilt-zoom (PTZ) camera of FIG. 3A is mapped when turning from the current position of the mobile device on the + X axis to the -Z axis.

FIG. 3B is a view showing a result of measuring a value of a 3-axis acceleration magnitude for tilting control of a pan-tilt-zoom (PTZ) camera.

The tilt-up control of the pan-tilt-zoom (PTZ) camera of FIG. 3B is mapped to the case of turning from the current position of the mobile device on the + Y axis to the -Z axis.

The tilt down control of the pan-tilt-zoom (PTZ) camera of FIG. 3B is mapped to the case of turning from the current position of the mobile device on the -Y axis to the -Z axis.

FIG. 3C is a diagram illustrating a result of measuring a value of a 3-axis acceleration magnitude for zooming control of a pan-tilt-zoom (PTZ) camera.

The zoomoing in control of the pan-tilt-zoom (PTZ) camera of FIG. 3C is mapped when the mobile device in the -Y axis moves horizontally from the current position to the -Z axis.

The zooming out control of the pan-tilt-zoom (PTZ) camera of FIG. 3C is mapped when the mobile device moves from the current position of the mobile device on the + Y axis to the -Z axis.

3D is a diagram illustrating a reference axis of a mobile device in the mapping embodiment of FIGS. 3A, 3B, and 3C.

 The pan-tilt-zoom (PTZ) camera control command is a variable that changes when the mobile device's position changes.

The sensing receiver 230 separates touch sensor data and three-axis acceleration sensor data among data received from the multi-sensor 225.

The cache 240 stores separated touch sensor data and three-axis acceleration sensor data, respectively.

The processor 250 maps a pan-tilt-zoom (PTZ) camera control command based on the stored touch sensor data and the 3-axis acceleration sensor data.

The processor 250 includes a noise remover 251, a divider 252, a fast Fourier transform 253, and a camera control command mapping unit 254.

The noise removing unit 251 removes noise of the touch sensor data and the 3-axis acceleration sensor data.

The dividing unit 252 divides the noise-removed touch sensor data into a two-dimensional grid structure.

The fast Fourier transform unit 253 performs fast Fourier transform on the noise-free 3-axis acceleration sensor data.

The camera control command mapping unit 254 may use the pan-tilt-zoom (PTZ) based on a touch sensor data position and direction change value in the divided grid structure and a predetermined direction acceleration magnitude value in the fast Fourier transformed 3-axis acceleration sensor data. : Map pan-tilt-zoom camera control command.

The camera control command mapping unit 254 includes a touch sensing mapping unit (not shown) and an acceleration sensing mapping unit (not shown).

The touch sensing mapping unit maps the area that the pan-tilt-zoom (PTZ) camera can monitor from the touch sensor data position and direction change in the divided grid structure to a zoom control command or a zoom control command. do.

The acceleration sensing mapping unit performs a panning control command, a tilting control command, or a tilting control command of the pan-tilt-zoom (PTZ) camera from an acceleration magnitude value equal to or greater than a predetermined threshold value in three-axis acceleration sensor data. Map to any of the zooming control commands.

An acceleration magnitude value in a predetermined direction of the acceleration sensing mapping unit represents a direction of changing from one axis among the X axis, the Y axis, or the Z axis to another axis as discussed above.

That is, the panning left control of the pan-tilt-zoom (PTZ) camera of FIG. 3A is mapped when the mobile device is rotated from the current position of the mobile device on the -X axis to the -Z axis.

The data generator 260 generates a data packet including a pan-tilt-zoom (PTZ) camera control command.

The transmitter 270 transmits a data packet including a pan-tilt-zoom (PTZ) camera control command to a pan-tilt-zoom (PTZ) camera through a wireless Internet. do.

4 is a flowchart illustrating a method for controlling a multi-sensor based PTZ camera according to the present invention.

The touch sensor data and the 3-axis acceleration sensor data are separated from the received multi-sensor data (S410).

The separated touch sensor data and the 3-axis acceleration sensor data are stored, respectively (S420).

A pan-tilt-zoom (PTZ) camera control command is mapped based on the stored touch sensor data and the 3-axis acceleration sensor data (S430).

A data packet including a pan-tilt-zoom (PTZ) camera control command is generated (S440).

The generated data packet is transmitted to a remote pan-tilt-zoom (PTZ) camera through wireless communication (S450).

Step 430 is specifically performed through the following process.

The noise of the touch sensor data and the three-axis acceleration sensor data are removed (S431).

The noise-removed touch sensor data is divided into a two-dimensional grid structure (S432).

Fast Fourier transform the noise-free 3-axis acceleration sensor data (S433).

The pan-tilt-zoom (PTZ) camera based on a touch sensor data position and direction change value in a divided grid structure and a predetermined direction acceleration magnitude value in the fast Fourier transformed 3-axis acceleration sensor data. Map the control command (S434).

In addition, the camera control command mapping step is performed through the touch sensing mapping step and the acceleration sensing mapping step.

The touch sensing mapping step includes an enlargement control command or a reduction control command for an area that the pan-tilt-zoom (PTZ) camera can monitor from the touch sensor data position and direction change in the divided grid structure. Map with.

The acceleration sensing mapping step includes a panning control command and a tilting control command of the pan-tilt-zoom (PTZ) camera from an acceleration magnitude value equal to or greater than a predetermined threshold in three-axis acceleration sensor data. Or a zooming control command.

Although the present invention has been described with reference to one embodiment shown in the accompanying drawings, it is merely an example, and those skilled in the art may realize various modifications and equivalent other embodiments therefrom. I can understand.

1 is a view showing a conceptual diagram of a multi-sensor based PTZ camera control method according to the present invention.

2 is a view showing a conceptual diagram of a multi-sensor based PTZ camera control apparatus according to the present invention.

FIG. 3 is a diagram illustrating an embodiment of mapping a pan-tilt-zoom (PTZ) camera control command based on a 3-axis acceleration magnitude value according to the present invention.

4 is a flowchart illustrating a method for controlling a multi-sensor based PTZ camera according to the present invention.

Claims (9)

A sensing receiver configured to separate touch sensor data and 3-axis acceleration sensor data among the received multi-sensor data; A cache configured to store the separated touch sensor data and 3-axis acceleration sensor data, respectively; A processor for mapping a pan-tilt-zoom (PTZ) camera control command based on the stored touch sensor data and 3-axis acceleration sensor data; A data generator configured to generate a data packet including the pan-tilt-zoom (PTZ) camera control command; And Includes; Transmitting unit for transmitting the data packet, The processor comprising: A noise removing unit for removing noise of the touch sensor data and the 3-axis acceleration sensor data; A divider dividing the noise removed touch sensor data into a two-dimensional grid structure; A fast Fourier transform unit for fast Fourier transforming the noise-free 3-axis acceleration sensor data; And Pan-tilt-zoom (PTZ) based on a touch sensor data position and direction change value in the divided grating structure and a predetermined direction acceleration magnitude value in the fast Fourier transformed 3-axis acceleration sensor data. And a camera control command mapping unit for mapping camera control commands. delete The method of claim 1, The camera control command mapping unit Touch to map an area that can be monitored by the pan-tilt-zoom (PTZ) camera to an enlargement control command or a reduction control command from the touch sensor data position and direction change values in the divided grid structure. Sensing mapping unit; And Panning control command, tilting control command or zooming of the pan-tilt-zoom (PTZ) camera from the acceleration magnitude value of a predetermined direction or more in the three-axis acceleration sensor data A multi-sensor based PTZ camera control apparatus comprising a; acceleration sensing mapping unit for mapping to any one of the control command. The method of claim 1, The multi-sensor is embedded in a mobile terminal including a display unit for displaying an image acquired by a pan-tilt-zoom (PTZ) camera controlled by the data packet. Sensor based PTZ camera control unit. The method of claim 3, wherein The predetermined direction is a multi-sensor based PTZ camera control device, characterized in that the direction to change from any one of the first axis of the X-axis, Y-axis or Z-axis to any other second axis. A sensing receiving step of separating touch sensor data and 3-axis acceleration sensor data among the received multi-sensor data; A data storing step of storing the separated touch sensor data and the 3-axis acceleration sensor data, respectively; A processing step of mapping a pan-tilt-zoom (PTZ) camera control command based on the stored touch sensor data and 3-axis acceleration sensor data; A data generation step of generating a data packet including the pan-tilt-zoom (PTZ) camera control command; And A transmitting step of transmitting the data packet; The processing step, A noise removing step of removing noise of the touch sensor data and the 3-axis acceleration sensor data; A division step of dividing the noise removed touch sensor data into a two-dimensional grid structure; A fast Fourier transform step of fast Fourier transforming the noise-free 3-axis acceleration sensor data; And Pan-tilt-zoom (PTZ) based on a touch sensor data position and direction change value in the divided grating structure and a predetermined direction acceleration magnitude value in the fast Fourier transformed 3-axis acceleration sensor data. A camera control command mapping step of mapping a camera control command, comprising: a multi-sensor based PTZ camera control method. delete The method of claim 6, The camera control command mapping step Touch to map an area that can be monitored by the pan-tilt-zoom (PTZ) camera to an enlargement control command or a reduction control command from the touch sensor data position and direction change values in the divided grid structure. Sensing mapping step; And Panning control command, tilting control command or zooming of the pan-tilt-zoom (PTZ) camera from the acceleration magnitude value of a predetermined direction or more in the three-axis acceleration sensor data The acceleration sensing mapping step of mapping to any one of the control command; Multi-sensor based PTZ camera control method comprising a. The method of claim 8, The predetermined direction is a direction of changing from one of the first axis, which is one of the X axis, Y axis or Z axis to the second axis of the other, the multi-sensor based PTZ camera control method.

Images