KR20130134391A - A remote control apparatus for ip camera using touch input of mobile terminal - Google Patents

Abstract

The present invention relates to a remote control apparatus for an IP camera using touch input of a mobile terminal comprising: a touch input unit for receiving touch input of a user in a touch screen displaying a photographed image of an IP camera; a data collection unit for collecting touch information detected in the touch input unit; a data analysis unit for consecutively analyzing the X-axis and Y-axis movement direction and movement speed of the touch input in case the touch input is a consecutive input signal based on the collected touch information; a data conversion unit for converting to speed information of an X-axis and Y-axis motor of the IP camera based on the analyzed data; and a data transmission unit for transmitting the movement speed information of an X-axis and Y-axis direction motor of the IP camera to the IP camera located in a remote place. According to the above present invention, a user interface, which is intuitively known and is conveniently used by a user, is provided, thereby contributing to vitalize the security solution industry using a mobile terminal and increasing the personal security equipment market. [Reference numerals] (4) Mobile terminal;(41) Touch input unit;(42) Data collection unit;(43) Data analysis unit;(44) Data conversion unit;(45) Data transmission unit

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an IP camera remote control apparatus using a touch input of a mobile terminal,

The present invention relates to a remote control apparatus for an IP camera using a touch input of a mobile terminal, and more particularly, to a remote control apparatus for a touch screen of a mobile terminal, To a technique for continuously operating a directional operation such as a pan and tilt of an IP camera.

Recently, with the rapid spread of touch-screen mobile terminals, the development of wireless communication networks and the expansion of the private security market, products combining wireless communication, mobile terminals and security solutions are emerging.

IP cameras have been installed in daycare centers, schools, and apartment complexes so that users can check the images of the sites where IP cameras are installed wherever the Internet is available. This IP camera has been used in various fields as well as video surveillance. In order to provide more effective service in the field of video surveillance, the IP camera can rotate 360 degrees through the pan / tilt / zoom (PTZ) It is necessary to provide a function to show the direction.

Conventionally, in the image checking system using a mobile terminal, when a direction of an IP camera is operated, a button on a specific area of the screen of the mobile terminal is clicked to manipulate the direction of the camera. This method can use only one button at a time, so that the camera can move in only one direction, and it is troublesome to operate several buttons several times in order to change the direction continuously.

In order to overcome this disadvantage, in Korean Patent No. 1001425, a remote pan-tilt-zoom (PTZ) camera can be controlled according to the movement of a mobile terminal equipped with an acceleration sensor and a touch sensor And a PTZ camera control device and method.

However, such a prior art patent requires a separate acceleration sensor, and the calculation process using the acceleration sensor is complicated. In addition, since the user has to move the mobile terminal vertically and horizontally for pan / tilt control of the camera, The camera image can not be accurately grasped due to the shaking of the camera.

Accordingly, there is an increasing demand for a device that can solve the problem of the IP camera remote control method using the conventional mobile terminal and can control the operation of the IP camera at a remote location with a simple operation.

SUMMARY OF THE INVENTION The present invention has been conceived to solve such a conventional problem, and it is an object of the present invention to provide a method and apparatus for continuously controlling a pan / tilt direction and a speed of an IP camera according to acceleration of a touch input of a user, So that it is possible to continuously change the direction of the camera and adjust the speed by only touch input of the camera.

Another object of the present invention is to maximize the user's convenience by performing all of the pan / tilt / zoom operation of the camera with only one finger touch operation.

It is another object of the present invention to provide an apparatus and a method for controlling an operation of a camera according to user's feelings by analyzing emotional state of a user who provides a touch input.

According to a preferred aspect of the present invention, there is provided a touch screen display device including a touch input unit for receiving a user touch input on a touch screen on which an image of an IP camera is displayed, A data analyzing unit for continuously analyzing the X-axis and Y-axis moving directions and the moving speed of the touch input when the touch input is a continuous input signal based on the collected touch information, And a data transmission unit for transmitting the movement speed information of the X-axis and Y-axis direction motors of the IP camera to the IP camera at a remote location, An IP camera remote control device using a touch input of a mobile terminal is provided.

Here, when the touch information is periodically collected at a preset threshold time interval in the data collecting unit and the current touch coordinates are (x _n , y _n ), the speeds of the X-axis and Y- .

X axis motor speed = (x _{n + 1} - x _n ) / acceleration constant

Y-axis motor speed = (y _{n + 1} - y _n ) / acceleration constant

The data conversion unit may output the same value as the speeds of the X axis and Y axis motors calculated immediately before the touch coordinate value does not change in consideration of the limitation of the screen size of the mobile terminal.

The data analyzing unit may track the position of the subject when a selection signal and a subject detection command for a specific subject in the photographed image of the IP camera are input from a user to a moving direction and a moving direction of the subject for each predetermined threshold time unit It is possible to calculate the speed and output the calculated moving direction and moving speed of the subject as the X-axis and Y-axis moving directions and the moving speed of the touch input.

If the touch input is a discontinuous input signal based on the touch information collected by the data collection unit, a zoom control UI is generated and controlled to be displayed on the touch screen, and based on the touch position input on the zoom control UI A zoom control unit for generating a zoom-in or zoom-out control signal having the touch position as a center position and transmitting the zoom-in or zoom-out control signal to the data transmission unit, and controlling the zoom control UI display to be removed when a touch input is made in an area other than the zoom control UI .

The user emotion analyzing unit analyzes the input tactile information including the area, the pressure, and the moving speed of the touch input based on the touch information collected by the data collecting unit, and analyzes the user's emotional state based on the analyzed information. And the data analyzing unit may transmit the speed information of the X-axis and Y-axis motors of the IP camera in consideration of the user's emotional state analyzed by the user's emotional analysis unit.

In addition, the data analyzing unit preferably changes at least one of brightness, saturation, and contrast of the captured image of the IP camera displayed on the screen in consideration of the user's emotional state analyzed by the user's emotional analysis unit.

According to the present invention, providing an intuitive and easy-to-use user interface for a user can contribute to activation of a security solution industry using a mobile terminal, and it is expected to expand the market for personal security equipment.

1 is a configuration diagram of an IP camera remote control system according to the present invention.
2 is a block diagram illustrating an internal configuration of a mobile terminal for IP camera remote control according to the first embodiment of the present invention.
3 is a flowchart illustrating an IP camera remote control operation performed in the mobile terminal according to the first embodiment of the present invention.
4 is a flowchart illustrating a process of performing a detection function according to a subject designation according to the present invention.
5 is a block diagram illustrating an internal configuration of a mobile terminal for IP camera remote control according to a second embodiment of the present invention.
6 is a flowchart illustrating a process of performing an IP camera remote control operation in a mobile terminal according to a second embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention.

In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification and claims, when a part includes a certain component, it means that it can further include other components, except to exclude other components unless specifically stated otherwise.

1 is a configuration diagram of an IP camera remote control system according to the present invention.

1, an IP camera remote control system according to the present invention includes an IP camera 1 installed in an area to be monitored and an IP camera 1 through a mobile communication network 3 including an Internet network 2 and a base station. And a mobile terminal 4 connected to the IP camera 1 for remotely controlling the directional operation of the IP camera 1.

The IP camera 1 is for capturing an image of an area to be monitored and transmitting the photographed image to a mobile terminal 4 of a manager located at a remote location via a communication device (not shown) such as a modem. The communication device is a wired / In addition, various wireless communication modules such as 3G, 4G, and WiBro can be used.

1, a general IP camera 1 includes an X-axis motor 11 and a Y-axis motor 12 for pan / tilt driving, and a zoom driving unit 13 for performing a zoom in / .

The mobile terminal 4 may be a smart phone, a tablet PC, or the like, which is a mobile communication terminal possessed by a manager having an authority to monitor a monitored area. The mobile terminal 4 analyzes the direction and speed of the touch input when a touch input on the touch screen is performed by the administrator, generates pan, tilt, and zoom control signals of the IP camera 1 according to the analyzed result, 1) so that the directional operation and the zoom control operation of the IP camera 1 can be performed continuously.

That is, when the IP camera 1 receives the pan, tilt, and zoom control signals from the mobile terminal 4 via the communication network, the IP camera 1 controls the X axis motor 11, the Y axis motor 12, and the zoom driver 13, So as to perform the direction operation and the zoom operation operation.

2 is a block diagram illustrating an internal configuration of a mobile terminal for IP camera remote control according to the first embodiment of the present invention.

2, the mobile terminal 4 for IP camera remote control according to the first embodiment of the present invention includes a touch input unit 41, a data collection unit 42, a data analysis unit 43, A conversion unit 44 and a data transmission unit 45.

The touch input unit 41 receives a user touch input on a touch screen on which a photographed image of the IP camera 1 is displayed. The touch input unit 41 includes a touch screen on which a photographed image is displayed and a touch input on the touch screen, And a touch sensor for detecting the touch.

The data collection unit 42 collects the touch information detected by the touch input unit 41. The touch information may be a position coordinate of the touch input. The position coordinates of the touch input are periodically collected in a predetermined threshold time unit The coordinate change value of the continuous touch input is collected. The touch information collected by the data collection unit 42 may further include information such as a touch pressure and a touch area in addition to the position coordinates. These information may be used as basic information for detecting the emotion state of the manager or the user who inputs the touch .

When the touch input is a continuous input signal based on the touch information collected by the data collecting unit 42, the data analyzing unit 43 continuously analyzes the X-axis and Y-axis moving directions and the moving speed of the touch input. If the current touch coordinate P _{n + 1} is (x _{n + 1} , y _{n + 1} ) and the touch coordinate P _n at the previous detection time point is (x _n , y _n ) The moving speeds of the input in the X and Y axis directions can be calculated in units of (x _{n + 1} - x _n ) / threshold time units, (y _{n + 1} - y _n ) / threshold time units, It can be confirmed by checking whether the speed calculation result is positive or negative.

The data converting unit 44 converts the X-axis and Y-axis moving directions and the moving speed values of the touch input into the speed information of the X-axis and Y-axis motors 11 and 12 of the IP camera 1 based on the analyzed data do.

The speeds of the X-axis and Y-axis motors 11 and 12 can be calculated by the following equation (1).

[Equation 1]

X axis motor speed = (x _{n + 1} - x _n ) / acceleration constant

Y-axis motor speed = (y _{n + 1} - y _n ) / acceleration constant

Here, the acceleration constant is a value unique to the motor as the rotation acceleration constant of the motor, and when the specifications of the X-axis and Y-axis motors 11 and 12 are the same, the acceleration constants of the respective motors are the same value.

The data transmitting unit 45 transmits the moving speed information of the X- and Y-axis direction motors 11 and 12 of the IP camera 1 to the IP camera 1 located at a remote place, and a wireless communication module can be used.

I

3 is a flowchart illustrating an IP camera remote control operation performed in the mobile terminal according to the first embodiment of the present invention.

Referring to FIG. 3, first, the user's touch input information is periodically (continuously) collected at predetermined threshold time intervals by the data collecting unit 42 (S10). As described above, the touch information may further include information such as a touch pressure, a touch area, etc. in addition to the position coordinates of the touch input.

When the touch input information of the user is collected by the data collecting unit 42, the data analyzing unit 43 calculates the movement of the touch input, that is, the X-axis and Y-axis moving directions and the moving speed continuously (S20).

When there is a coordinate change of the touch input during the set threshold time unit, the data conversion unit 44 converts the movement information (movement direction and speed information) of the touch input into motor speed information (S30) If not, the motor speed value of the previous section, that is, the previous threshold time unit section, is output to maintain the motor speed of the previous section as it is (S40). In step S40, considering that the continuous increase of coordinates is physically impossible in accordance with the limitation of the size of the touch screen of the mobile terminal 4, when the same coordinate value is continuously accumulated, the X-axis and Y-axis motors 11, 12).

Therefore, if the administrator releases his / her finger from the touch screen, the touch coordinate movement analyzing operation is stopped and the direction switching operation of the IP camera 1 is also stopped accordingly.

When the motor speed values of the X- and Y-axis motors 11 and 12 are calculated, the calculated information is transmitted to the IP camera 1 via the data transmitting unit 45, and the IP camera 1 And performs a pan / tilt operation of the camera.

FIG. 4 is a flowchart illustrating a process in which a detection function according to a subject designation is performed according to the present invention. When an administrator who is a user designates a specific subject on the screen and operates a subject detection function, the IP camera 1 So that the subject can be tracked while being rotated.

Referring to FIG. 4, a selection signal and a subject detection command for a specific subject in the photographed image of the IP camera 1 are input from the administrator (S110). The selection of the subject can be performed by various methods such as a method of drawing a touch trace along the outline of the subject, a method of touching the center portion of the subject for a long time, a method of touching a closed curve surrounding the subject, The data analyzing unit 43 recognizes the subject selection signal input as a detection command or recognizes the detection command when a specific key button is pressed.

When a subject detection command is inputted, the data analyzer 43 tracks the position of the subject and calculates the moving direction and the moving speed of the subject at every predetermined threshold time unit (S120). The calculated moving direction of the subject and the moving The speed is converted into the X-axis and Y-axis moving directions and the moving speed of the touch input (S130).

Then, the data converting unit 44 converts the value converted to the motion value of the touch input into motor speed information (S140), and the data transmitting unit 45 transmits the converted motor speed information to the IP camera 1 (S150).

As described above, the motion of the subject is converted into the motion value of the touch input and transmitted to the IP camera 1, which simplifies and simplifies the data processing on the side of the IP camera 1.

5 is a block diagram illustrating an internal configuration of a mobile terminal for IP camera remote control according to a second embodiment of the present invention.

The second embodiment is a characteristic part in which the configuration of the user emotion analyzing unit 46 and the zoom control unit 47 is added to the basic configuration of the first embodiment.

The user's emotion analyzing unit 46 analyzes the input tactile information including the area, the pressure, and the moving speed of the touch input based on the touch information collected by the data collecting unit 42, and based on the analyzed information, State. In order to analyze the emotional state, the characteristics of the touch operation according to the emotional state of the manager, that is, the characteristics of the input haptic information according to the emotional state, must be stored in the pattern form in advance. The touch operation characteristic pattern information according to the emotional state may be obtained by preliminarily setting the touch input characteristic for each emotional state of the manager and learning it or the touch input characteristic information for each general emotional state in advance and extracting the characteristic factors at the time of touch input, And a method of determining the emotion state of the user by comparing the feature factors with the set touch input characteristic information.

Here, the user's feelings can be classified into three levels of calmness, tension, and excitement as measures of mental comfort, and it is also possible to further subdivide them.

When the user's emotional state of the user is recognized in the user's emotional analysis unit 46, the data analysis unit 43 analyzes the X-axis and Y-axis motors 11 and 12 of the IP camera 1 ) Of the speed information of the vehicle. For example, when the user's emotional state is 'calm', the calculated motor speed information is used as it is. If the user's emotional state is 'tense', the weighted value is added to the calculated motor speed information, The motor speed value is calculated to be greater than the motor speed calculated according to the motor speed value, and when the user's emotional state is 'excited', the weight value can be made larger than that in the case of 'tension'. Thus, when the user's emotions are closer to the excited state and the user moves the touch position after touching the finger on the touch screen for pan / tilt control of the IP camera 1, The motor can be rotated faster than the calculated motor speed. Accordingly, the pan / tilt control speed of the motor can be changed by reflecting the emotional state of the user during the pan / tilt remote control operation, so that the camera rotation operation can be performed through the user interaction, There is an advantage that monitoring can be provided.

The user interaction through the user's emotional analysis can change the brightness, saturation, contrast, etc. of the camera photographed image displayed on the screen according to the user's emotional state in addition to the camera rotation operation. For example, when the user is in an excited state, it is possible to display an image with brighter and clearer color.

When the touch input is a discontinuous input signal based on the touch information collected by the data collection unit 42, the zoom control unit 47 generates and controls the zoom control UI to be displayed on the touch screen, A zoom-in or zoom-out control signal having a touch position as a center position on the basis of the input, and transmits the zoom-in or zoom-out control signal to the data transmitting unit 45. When a touch input is present in an area other than the zoom control UI, As shown in FIG.

The operation of the zoom control unit 47 will be described in detail with reference to FIG.

6 is a flowchart illustrating a process of performing an IP camera remote control operation in a mobile terminal according to a second embodiment of the present invention.

Referring to FIG. 6, when the touch input data input from the user is collected, whether the touch input signal is continuous or discontinuous is analyzed. When the touch input signal is continuous, steps S220 to S240 are performed. If it is discontinuous, steps S250 to S270 are performed.

Here, the data collecting unit 42 recognizes the touch input signal as a signal for pan / tilt control of the IP camera 1 when the touch input signal is continuous and transmits the collected touch input data to the data analyzing unit 43, The steps S220 to S240 are performed by the data analysis unit 43, which is the same as the first embodiment of FIG. 3, and thus description thereof is omitted.

When the touch input signal is discontinuous, that is, when only one touch input is detected, the data collecting unit 42 recognizes the touch input signal as a command signal for zoom control, To the zoom control unit 47.

Upon receiving the touch input occurrence notification information and touch position information from the data collection unit 42, the zoom control unit 47 generates and displays a zoom control UI at a specific position on the screen (S250). The zoom control UI may be a zoom control bar shape in which zoom level tabs are displayed step by step or a graphic UI in the form of two push buttons for zooming in and zooming out.

The zoom control unit 47 analyzes the touch input position of the user when the zoom control UI is displayed, and generates a zoom-in or zoom-out control signal according to the touch position when the touch position is within the zoom control UI (S260). The zoom in or zoom out control signal includes zoom center information and zoom level value information. The zoom center value information may be a touch position coordinate value received in step S250, and the zoom level value may be a zoom level value corresponding to a tap closest to the touch position, for example, when the zoom control UI is in the form of a zoom control bar.

The zoom control unit 47 analyzes the touch input position of the user in a state where the zoom control UI is displayed and determines that the touch position is an area other than the zoom control UI and removes the zoom control UI on the screen ).

In this case, there is an advantage that all the zoom in / zoom out control operations can be easily performed with only one finger. That is, conventionally, a separate key button or menu button operation for zoom control is required, or a zoom control operation is performed through the operation of two fingers being opened or wiped while two fingers are touched on the screen, There is a problem that the operation is troublesome. However, in this embodiment, the zoom operation can be performed with only one finger, and the zoom control operation through the zoom control UI is advantageous compared to the conventional zoom operation.

Although the embodiment of the present invention has been described above with reference to the drawings, the specific structure is not limited to the present embodiment, and even if design changes are made within the scope of the present invention, they are included in the present invention .

1: IP camera 2: Internet network
3: mobile communication network 4: mobile terminal
11: X-axis motor 12: Y-axis motor
13: zoom driving unit 41: touch input unit
42: Data collecting unit 43: Data analyzing unit
44: data conversion unit 45: data transmission unit
46: user emotion analysis unit 47: zoom control unit

Claims (7)

An apparatus for remote control of an IP camera using a touch input of a mobile terminal,
A touch input unit for receiving a user touch input on a touch screen on which the photographed image of the IP camera is displayed;
A data collecting unit collecting the touch information detected by the touch input unit;
A data analyzing unit for continuously analyzing the X-axis and Y-axis moving directions and the moving speed of the touch input when the touch input is a continuous input signal based on the collected touch information;
A data converter for converting speed information of the X-axis and Y-axis motors of the IP camera based on the analyzed data; And
Remote control device of the IP camera using the touch input of the mobile terminal, characterized in that it comprises a data transmission unit for transmitting the moving speed information of the X-axis and Y-axis motor of the IP camera to the IP camera located at a remote location.
The method of claim 1,
Wherein, when the touch information is periodically collected at a predetermined threshold time unit in the data collecting unit and the current touch coordinates are (x _n , y _n ), the speeds of the X-axis and Y-axis motors are expressed by the following equations Wherein the remote controller is a remote controller of the IP camera using the touch input of the mobile terminal.
X axis motor speed = (x _{n + 1} - x _n ) / acceleration constant
Y-axis motor speed = (y _{n + 1} - y _n ) / acceleration constant
3. The method of claim 2,
Wherein the data converting unit outputs the same value as the speed of the X axis and Y axis motor calculated immediately before when the touch coordinate value is not changed.
3. The method of claim 2,
Wherein the data analyzing unit tracks the position of the subject when a selection signal and a subject detection command for a specific subject in the photographed image of the IP camera are input from a user and stores the moving direction and the moving speed of the subject in a predetermined threshold time unit And outputs the calculated moving direction and the moving speed of the subject as the X-axis and Y-axis moving directions and the moving speed of the touch input, using the touch input.
The method of claim 1,
A zoom control UI is generated and controlled to be displayed on the touch screen when the touch input is a discontinuous input signal based on the touch information collected by the data collection unit, A zoom control unit for generating a zoom-in or zoom-out control signal having a touch position as a center position and transmitting the generated zoom-in or zoom-out control signal to the data transmission unit and controlling the zoom control UI display to be removed when there is a touch input in an area other than the zoom control UI A remote control device of an IP camera using touch input of a mobile terminal.
The method of claim 1,
A user emotion analyzing unit for analyzing the input tactile information including the area, the pressure, and the moving speed of the touch input based on the touch information collected by the data collecting unit, and analyzing the emotional state of the user based on the analyzed information And,
Wherein the data analyzer emits the speed information of the X-axis and Y-axis motors of the IP camera in consideration of the user emotion state analyzed by the user emotion analyzing unit. Control device.
The method according to claim 6,
Wherein the data analyzer changes at least one of brightness, saturation, and contrast of the photographed image displayed on the screen in consideration of the user emotion state analyzed by the user emotion analyzer, Remote control device of IP camera using input.

Images