KR101332421B1 - Method for controlling mobile terminal using image input device and the mobile terminal - Google Patents

Abstract

Disclosed are a method and apparatus for controlling a terminal operation using an image input device. The present invention includes converting a signal input from an image input device into digital data, calculating the amount of light for each target frame of the digital data to determine whether the amount of blocked light is included, and counting the number of frames determined as the amount of blocked light. Controlling the operation of the portable terminal according to the step and the number of counted frames. According to the present invention, in a portable terminal having an image input apparatus, a specific function performed when the image input apparatus is in operation can be controlled using the image input apparatus.

Camera, Video input device, Video input, Light quantity, Motion control, Portable terminal

Description

Method for controlling mobile terminal using image input device and its portable terminal

The present invention relates to operation control of a portable terminal, and more particularly, to a method of controlling a specific operation of a portable terminal using an image input apparatus in a portable terminal having an image input apparatus.

As multimedia functions are emphasized, the use of portable terminals having cameras, for example, mobile communication terminals, personal digital assistants (PDAs), and wireless Internet terminals, has become common.

The function of generating image or video data or displaying stored image or video data using a portable terminal having a camera is one of the most widely used technologies.

In addition, technologies for transmitting image or video data stored in a user's portable terminal to a counterpart room or making a video call with the other party in real time using a camera provided in the portable terminal are increasingly developed.

In addition, various additional functions such as generating an image or video data or outputting an avatar during a video call or converting an image transmitted during the video call to a substitute video are implemented.

 In the related art, in order to perform additional functions such as volume control, avatar output, and video switching while generating an image or video data or making a video call, it is inconvenient to input a multi-level function command to the portable terminal. have.

The present invention provides a method and apparatus for controlling a specific operation of a portable terminal using the image input apparatus in a portable terminal having an image input apparatus.

According to an aspect of the present invention, in the method for controlling the operation of a portable terminal using an image input device, converting a signal input from the image input device into digital data of a predetermined format, the unit of a frame of a predetermined size Calculating the amount of light for each target frame of the digital data separated by, and determining whether the amount of blocked light is a quantity of light, counting the number of frames determined as the amount of blocked light, and controlling the operation of the portable terminal according to the number of counted frames. Including the step of, wherein the blocking light amount is the amount of light when the image input device is blocked for the control of the portable terminal is provided.

Here, the step of calculating the amount of light for each target frame of the digital data divided into frame units having a predetermined size to determine whether the blocked light amount is the total amount of binary values corresponding to each pixel data included in the target frame or Calculating an average value and comparing the calculated total sum or average value with a predetermined threshold.

Here, when the total sum or average value calculated from the comparison result is equal to or less than the threshold value, it may be determined that the amount of light of the target frame is the amount of blocked light.

Here, the step of calculating the amount of light for each target frame of the digital data divided into frame units having a predetermined size to determine whether the amount of blocked light is a block value, the binary value corresponding to each pixel data included in the target frame has a predetermined threshold value. Counting the number of pixels that are less than or equal to and comparing the ratio of the counted number of pixels to the total number of pixels included in the target frame with a predetermined threshold ratio.

Here, when the ratio of the number of counted pixels to the total number of pixels included in the target frame is greater than or equal to the threshold ratio in the comparison result, it may be determined that the amount of light of the target frame is the blocking light amount.

Here, the digital data is data in RGB format, and the smaller the amount of light, the smaller the binary value corresponding to the pixel data.

Here, calculating the amount of light for each target frame of the digital data divided into frame units having a predetermined size and determining whether the amount of blocked light is a blocked light amount may include binary corresponding to data representing luminance among the pixel data included in the target frame. Calculating a total sum or average value of the values and comparing the calculated total sum or average value with a predetermined threshold.

Here, when the total sum or average value calculated from the comparison result is equal to or less than the threshold value, it may be determined that the amount of light of the target frame is the amount of blocked light.

Here, calculating the amount of light for each target frame of the digital data divided into frame units having a predetermined size and determining whether the amount of blocked light is a blocked light amount may include binary corresponding to data representing luminance among the pixel data included in the target frame. Counting the number of pixels whose value is less than or equal to a predetermined threshold and comparing the ratio of the counted pixel count to the total number of pixels included in the target frame with a predetermined threshold ratio.

Here, when the ratio of the number of counted pixels to the total number of pixels included in the target frame is greater than or equal to the threshold ratio as a result of the comparison, it may be determined that the amount of light of the target frame is the blocking light amount.

Here, the digital data is YUV format data, and the smaller the amount of light, the smaller the binary value corresponding to the data representing the brightness.

The controlling of the operation of the portable terminal according to the number of the counted frames includes determining whether a control signal for controlling the portable terminal is input according to the number of the counted frames and counting the number of control signals. It may include a step.

Here, in the controlling of the operation of the portable terminal according to the number of the counted frames, the operation of the portable terminal may be controlled by referring to a predetermined operation according to the counted control signal.

According to another aspect of the present invention, the image input device for converting the signal of the optical object into an electrical signal and outputs, the data input from the image input device is converted into digital data of a predetermined format, in a frame unit of a predetermined size The control unit controls the operation of the portable terminal according to the number of frames and an image signal processor for counting the number of frames determined as the blocking light amount by calculating the amount of light for each target frame of the divided digital data. It includes, but the amount of blocking light is provided a portable terminal, characterized in that the amount of light when the image input device is blocked for the control of the portable terminal.

Here, the image signal processor may calculate a total sum or average value of binary values corresponding to each pixel data included in each target frame, and compare the calculated total sum or average value with a predetermined threshold value.

Here, when the total sum or the average value calculated from the comparison result is equal to or less than the threshold value, the image signal processor may determine that the amount of light of the target frame is the amount of blocked light.

Here, the image signal processor may count the number of pixels whose binary value corresponding to each pixel data included in each target frame is less than or equal to a predetermined threshold, and calculate the ratio of the calculated number of pixels to the total number of pixels included in the target frame. It can be compared with a predetermined threshold ratio.

Here, when the ratio of the number of counted pixels to the total number of pixels included in the target frame is greater than or equal to the threshold ratio in the result of the comparison, the image signal processor may determine that the amount of light of the target frame is a blocked light amount.

Here, the image signal processor may calculate a total sum or average value of binary values corresponding to data representing luminance among the pixel data included in the target frame, and compare the calculated total sum or average value with a predetermined threshold value.

Here, when the total sum or the average value calculated from the comparison result is equal to or less than the threshold value, the image signal processor may determine that the amount of light of the target frame is the amount of blocked light.

Here, the image signal processor counts the number of pixels whose binary value corresponding to the luminance indicating data among the pixel data included in the target frame is equal to or less than a predetermined threshold, and counts the pixels for the total number of pixels included in the target frame. The ratio of numbers can be compared with a predetermined threshold ratio.

Here, when the ratio of the number of counted pixels to the total number of pixels included in the target frame is greater than or equal to the threshold ratio in the comparison result, the image signal processor may determine that the amount of light of the target frame is a blocked light amount.

Here, when the number of counted frames is greater than or equal to a predetermined number, the image signal processor may determine that a control signal for controlling the portable terminal is input and count the number of control signals.

Here, the controller may control the portable terminal with reference to a predetermined operation according to the number of counted control signals.

According to the present invention, in a portable terminal having an image input apparatus, a specific function performed when the image input apparatus is in operation can be controlled using the image input apparatus.

BRIEF DESCRIPTION OF THE DRAWINGS The present invention is capable of various modifications and various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the detailed description. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. In the following description of the present invention, when it is determined that the detailed description of the related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

In the present specification, a portable terminal according to an embodiment of the present invention includes a communication function, and it is assumed that an image input device provided in the portable terminal is a camera.

In addition, in the present specification, assuming that there is one camera, a description will be given of controlling the operation of the camera. However, the portable terminal according to the embodiment of the present invention may have two or more cameras. In addition, controlling the operation of two or more cameras simultaneously controls the operation of one camera, and it will be apparent to those skilled in the art in view of the technical idea of the present invention, and thus a separate description thereof will be omitted.

1 is a block diagram illustrating the internal functions of a portable terminal having a camera according to an embodiment of the present invention.

Prior to the detailed description of FIG. 1, it is intended to clarify that the divisions of the components in the present specification are merely divided by the main functions of each component. That is, two or more components to be described below may be integrated into one component, or one component may be divided into two or more components. Each of the components to be described below may additionally perform some or all of the functions of other components in addition to the main functions of the components, and some of the main functions of each component are different. It may also be performed by. Therefore, the presence or absence of each component described through this specification should be functionally interpreted, and for this reason, the configuration of the component according to the image input control apparatus of the present invention is limited to the extent that the object of the present invention can be achieved. It is clear that this can be different.

Referring to FIG. 1, the portable terminal 100 according to an embodiment of the present invention may include a camera 110, an image signal processor 120, an input unit 125, an audio input unit 130, and an audio output unit 135. , The transmitter / receiver 140, the display 145, the storage 150, and the controller 155 are configured.

The camera 110 is a functional component that converts an optical signal incident through the lens into an electrical signal and transmits the converted optical signal to the image signal processor 120.

Here, the camera 110 may be a charge-coupled device (CCD) sensor or a complementary metal-oxide semiconductor (CMOS) sensor.

The image signal processor 120 is a component that converts the electrical signal received from the camera 110 into digital data (eg, RGB format, YUV format, etc.) according to a predetermined format.

In this case, the converted digital data is divided into frame units having a predetermined size, and data for one frame is a set of data for each pixel in the frame.

When the converted digital data is in RGB format, each pixel is represented by data corresponding to red, green, and blue. In YUV format, each pixel is represented by Y (luminance, luminance) and U (chrominance and red component chrominance- red) and V (chrominance-blue).

The color space representation format that may be used in the process of the signal processor 120 converting an electrical signal into digital data may include various color space representation formats in addition to the RGB format or the YUV format. Detailed description of the color space representation format known at the time of filing the present invention will be omitted.

In addition, the image signal processor 120 may perform an enlargement, reduction, rotation, error correction, gamma correction, white correction, or the like with respect to an electrical signal input from the camera 110, and may be encoded in a predetermined format. The compressed video can be decoded.

The image input from the camera 110 may be converted into digital data by the image signal processor 120 and then displayed on the display unit 145 or may be transmitted to the counterpart terminal through a communication network via the transceiver 140. have.

In connection with the present invention, the image signal processing unit 120 measures the amount of light of the image input from the camera 110 to determine whether the lens of the camera 110 is blocked or how many times to control the operation of the portable terminal 100. The controller 155 transmits information on whether the information is blocked to the controller 155. Hereinafter, this will be described in detail.

According to the exemplary embodiment of the present invention, the image signal processor 120 determines whether the image input is blocked by the lens of the camera 110 by using the light amount of the input image.

Various methods may be used as a method of measuring the amount of light in the input image.

For example, suppose that the image signal processor 120 converts an input electrical signal into digital data in RGB format. At this time, it may be determined that the input of the image to the lens of the camera 110 is blocked as the converted digital data is closer to black (ie, a black and white screen). Accordingly, the image signal processor 120 may determine whether the image input is blocked by the lens of the camera 110 according to how close each black color is in the frame of the input image.

Here, if data close to black is represented as a small binary value in pixel data, the image signal processor 120 determines whether the total sum or average of binary values for each pixel data in one frame is less than or equal to a predetermined threshold. The amount of light corresponding to the blocking of the lens of the camera 110 may be determined.

Alternatively, the image signal processor 120 may first determine whether a binary value for each pixel data in one frame is less than or equal to a predetermined threshold, and again determine whether the number of pixels less than or equal to the threshold is greater than or equal to a predetermined threshold ratio. 110, it is possible to determine whether the amount of light corresponding to the blocking of the lens.

As another example, when the image signal processing unit 120 converts the input electrical signal into digital data in the YUV format, the amount of light of the input image may be determined as only the Y value of each pixel in one frame.

If the Y value is represented by a binary value when the brightness is low, the image signal processor 120 determines whether the total sum or average value of the Y values of each pixel data in one frame is less than or equal to a predetermined threshold value. It is possible to determine whether the amount of light corresponding to the blocking of.

Similarly, the image signal processor 120 first determines whether the Y value of each pixel data in one frame is less than or equal to a predetermined threshold, and again determines whether the number of pixels less than or equal to the threshold is greater than or equal to a predetermined threshold ratio. It is possible to determine whether the amount of light corresponding to blocking of the lens.

Here, the threshold or the threshold ratio is an experimentally derived value for the amount of light when the user intentionally cuts off the lens portion of the camera 110 by hand for the purpose of controlling the operation of the portable terminal 100.

Hereinafter, for convenience of understanding and explanation of the present invention, the amount of light when the lens of the camera 110 is blocked for operation control of the portable terminal 100 will be referred to as 'blocking light amount'.

On the other hand, when the user blocks the lens of the camera 110 to control the operation of the portable terminal 100, even if it is assumed to block for the shortest time, image data corresponding to a few frames of the image data input from the camera 110 is Indicates the amount of blocking light.

For example, when the user blocks the lens of the camera 110 to control the operation of the portable terminal 100, the input image data corresponding to at least 10 frames may represent the blocking light amount.

Here, as the same effect as measuring the amount of light of the image data corresponding to a certain number of frames or more, the image data input for a predetermined time may be the blocking light amount.

For example, when blocking the lens of the camera 110 to control the operation of the portable terminal 100, the image data input for at least 1 second may represent the blocking light amount.

Here, the predetermined number or the predetermined time may be experimentally derived from the operation of blocking the lens of the camera 110 by the user for the control of the portable terminal 100.

Hereinafter, for the convenience of understanding and explanation of the present invention, a certain number of experimentally derived and designated blocking light quantity is input as 'm', and a predetermined time for blocking light quantity is input as 't'. Where m and t are natural numbers.

As described above, when the image data corresponding to the m frame or the image data input for 't' among the image data input from the camera 110 to the image signal processor 120 indicates the blocking light amount, It can be seen that the blocking of the camera 110 has occurred for the operation control.

Hereinafter, for convenience of description, when the image data corresponding to the m frame or the image data input during t indicates the amount of blocking light, a 'control signal' for controlling the camera operation is described as being input.

As an exemplary embodiment of the present invention, the portable terminal 100 may be designated to perform a predetermined operation according to the number of times the control signal is input from the camera 110 to the image signal processing unit 120.

For example, when the control signal is input once, the volume is adjusted, and when the control signal is input twice consecutively, the avatar is output. When the control signal is input three times consecutively, a substitute image is input instead of the image input from the camera 110. You can specify the operation such as printing.

At this time, the image signal processor 120 monitors whether the next control signal is input within a predetermined time after the first control signal is input to determine the number of input control signals.

For example, if the secondary control signal is not input within 2 seconds after the primary control signal is input, the image signal processing unit 120 ends monitoring and determines that the control signal is input once. The controller 155 controls the camera operation according to one control signal input. That is, in the above-described example, the controller 155 may adjust the volume.

For example, if the secondary control signal is input within 2 seconds after the primary control signal is input, the image signal processor 120 continuously monitors whether the tertiary control signal is input. As described above, when the third control signal is not input within 2 seconds, the image signal processor 120 may determine that the control signal is input twice.

Hereinafter, for convenience of description, the predetermined time for the image signal processing unit 120 to continuously determine the control signal will be expressed as 'T'.

The input unit 125 is a means for receiving a control command for controlling the operation of the portable terminal 100, a control command for executing an application, and the like from the user. Here, the input unit 125 may be implemented as a plurality of key buttons (for example, a number key or a letter key, a symbol key such as * or #, a function key such as a menu, a call, a confirmation, a wireless Internet connection, or a direction moving key). It may be implemented in the form of a touch screen.

The sound input unit 130 starts operation under the control of the controller 155 and is a means for receiving an analog voice signal from a user. For example, the sound input unit 130 may be a microphone.

The sound output unit 135 performs a function of outputting sound stored in the storage unit 150 or received through a communication network under the control of the controller 155. Here, the sound output unit 135 may include a sound source chip, a speaker, and the like.

The transceiver 140 is connected to another device (for example, a counterpart terminal) via a communication system according to the form of the portable terminal 100, and transmits and receives data such as sound, images, and images through the communication network. It performs the function.

The display unit 145 may include data corresponding to a command input through the input unit 125 (for example, letters or numbers, a menu, an application execution screen, etc.), an image captured by the camera 110, and a storage unit 150. It displays the data stored in the) or the data received through the transceiver 140, and the like. For example, the display unit 145 may be a liquid crystal display (LCD).

The storage unit 150 stores an operation program of the portable terminal 100 and data (letters, numbers, images, videos, etc.) input through an external input device (for example, a 24-pin data input / output terminal). In addition, the storage 150 stores image data photographed through the camera 110, data received through the transceiver 140, and the like.

The controller 155 may include internal components of the portable terminal 100 (for example, the camera 110, the image signal processor 120, the input unit 125, the sound input unit 130, the sound output unit 135, The transceiver 140, the display 145, the storage 150, etc.).

In particular, the controller 155 receives information on how many times a control signal has been input for controlling the operation of the portable terminal 100 from the image signal processor 120 so that an operation corresponding to the number of control signals can be performed. do.

So far, the inside of the portable terminal according to the embodiment of the present invention has been described with reference to FIG. 1. Hereinafter, an example in which an external structure and a block light amount of a portable terminal according to an embodiment of the present invention are input will be described with reference to FIGS. 2 to 3.

2 is a diagram illustrating an external structure of a portable terminal having a camera according to an embodiment of the present invention, and FIG. 3 is a diagram illustrating an image input to a camera according to an embodiment of the present invention.

As shown in FIG. 2, the portable terminal 100 according to the embodiment of the present invention includes a camera 110 in the front.

For example, the camera 110 is located in front of the portable terminal 100 in order to easily assume that the user blocks the camera 110 lens with a finger for controlling the operation of the portable terminal 100. However, it is apparent in view of the technical spirit of the present invention that the camera 110 may be located anywhere outside the portable terminal 100 in order to facilitate the photographing of the subject and the operation of blocking the image input to the camera lens.

3 is a diagram illustrating that an image input from the camera 110 located in front of the portable terminal 100 is displayed.

4 is a diagram illustrating a screen displayed when the camera is blocked according to an embodiment of the present invention.

When the camera 110 of the portable terminal 100 is in operation, when the camera in operation is blocked with a finger or the like, an image input from the camera 110 is displayed as shown in FIG. 4. In this case, the image signal processor 120 may determine that the image input from the camera 110 represents the amount of blocking light. In addition, since the image signal processor 120 may determine the number of times of input of the control signal using a predetermined time or a predetermined number of times that the amount of blocking light is input, the description thereof will be omitted.

So far, the external structure and the blocking light amount of the portable terminal according to the embodiment of the present invention have been described with reference to FIGS. 2 to 3. Hereinafter, an operation control method of a portable terminal according to an embodiment of the present invention will be described with reference to FIGS. 5 and 6.

5 is a flowchart illustrating an operation control method of a portable terminal according to an embodiment of the present invention.

FIG. 5 illustrates that the image signal processing unit 120 of the portable terminal 100 converts an electrical signal input from the camera 110 into digital data in RGB format and closes to black data (ie, digital data corresponding to a blocked light amount). Assuming that is represented by a small value in binary method, it will be described an embodiment in which an image input from the camera 110 represents a blocked light amount as the total sum or average of binary values for each pixel data in one frame. Shall be.

In addition, in the following description, in order to pay attention to the overall flow in explaining the operation control method of the portable terminal according to the embodiment of the present invention, the portable terminal 100 is mainly used in each step rather than the component shown in FIG. The operation will be described.

In operation 510, an image is input from the camera 110, and in operation 520, the total sum or average of binary values for each pixel data in one frame of the digital data converted from the camera 110 is calculated.

The total sum or average value calculated in step 530 is then compared with a predetermined threshold. That is, it is determined whether the frame for which the total sum or average value of the binary values for each pixel data is a frame representing the amount of blocked light.

As a result of the comparison, if the calculated total sum or average value exceeds the predetermined threshold value (when not indicating the blocked light amount), steps 510 to 530 are repeated. That is, a process of continuously receiving an image from the camera 110, dividing the input image into frame units to measure the amount of light, and determining whether the measured frame is a frame indicating the amount of blocked light.

At this time, it is necessary to perform step 590 before repeating step 510 to step 530. This will be described below in step 560.

If the result of the comparison in step 530 is that the calculated total sum or average value is equal to or less than a predetermined threshold value (indicative of the amount of blocked light), the number of frames representing the amount of blocked light is counted in step 540.

Next, it is determined whether the number of frames counted in step 550 is m or more. Here, since it has been described above, whether or not the input image data during the t (that is, the experimentally derived and designated number, which is a predetermined time at which the blocking light amount is input) indicates the blocking light amount has been described above. Is omitted.

As a result of the determination in step 550, if the number of frames corresponding to the counted blocked light amount is less than m, steps 510 to 550 are repeated. That is, the process of determining whether the input image in the frame unit represents the blocked light amount is continued.

If the determination result is that the number of frames counted is m or more. It is determined that a control signal for controlling the portable terminal 100 is input from the camera 110.

That is, it is possible to determine whether one control signal has been input by repeating steps 510 to 550 until the number of counted frames becomes m or more.

If it is determined in step 530 that the total sum or average of binary values for each pixel data in the frame exceeds the threshold before determining that one control signal is input, the number of frames counted in step 540 is initialized as in step 590. I need a step. In this way, the number of consecutive frames indicative of the amount of blocked light can be counted to determine the input of the control signal.

In operation 570, it is determined whether the input of the control signal is terminated. As described above, if the next control signal is not input within T after the last control signal is counted, it may be determined that the input of the control signal is finished.

As a result of the determination, if the input of the control signal is not finished, steps 510 to 570 are repeated to count the next control signal.

As a result of the determination, when the input of the control signal is finished, an operation corresponding to the number of counted control signals is performed.

It is obvious after step 580 to initialize the number of frames and the number of control signals counted for input of the next control signal.

6 is a flowchart illustrating an operation control method of a portable terminal according to another embodiment of the present invention.

FIG. 6 illustrates that the image signal processing unit 120 of the portable terminal 100 converts an electrical signal input from the camera 110 into digital data in YUV format, and the Y value is represented by a binary value when the brightness is low. Assume, an embodiment in which the Y value and the threshold value of each pixel data in one frame are first compared, and then the number of pixels satisfying the condition is compared with the threshold ratio to generate a comparison result.

In operation 610, an image is input from the camera 110, and in operation 620, the number of pixels whose Y value is less than or equal to a predetermined threshold value of each pixel data in one frame of the digital data converted from the camera 110 is calculated.

In operation 630, the ratio of the calculated number of pixels to the total number of pixels included in one frame is compared with a predetermined threshold ratio.

Subsequently, it may be determined whether one frame of the image input through the steps 620 and 630 is a frame indicating a blocked light amount.

As a result of the comparison, if the ratio of the calculated number of pixels to the total number of pixels included in one frame is less than the predetermined threshold ratio (when not indicating the blocking light amount), steps 610 to 630 are repeated. That is, a process of continuously receiving an image from the camera 110, dividing the input image into frame units to measure the amount of light, and determining whether the measured frame is a frame indicating the amount of blocked light.

At this time, before performing steps 610 to 630, step 690 is required, which will be described below.

As a result of the comparison, when the ratio of the calculated number of pixels to the total number of pixels included in one frame is equal to or greater than a predetermined threshold ratio (indicative of the amount of blocked light), the number of frames representing the amount of blocked light is counted in step 640.

In step 650, it is determined whether the number of frames counted is m or more. Here, it may be determined whether the image data input during t indicates the amount of blocked light, and the description thereof will be omitted since it is technically similar to the counting of the number of frames.

As a result of determination, if the number of counted frames is less than m, steps 610 to 650 are repeated. That is, the process of determining whether the input image in the frame unit represents the blocked light amount is continued.

If the determination result is that the number of frames counted is m or more. It is determined that a control signal for controlling the portable terminal 100 is input from the camera 110.

That is, by repeating step 610 to step 650 until the number of counted frames is m or more, it may be determined whether one control signal has been input.

Here, if it is determined in step 630 that the ratio of the calculated number of pixels to the total number of pixels included in one frame is less than the predetermined threshold ratio before determining that one control signal has been input, counting in step 640 as in step 690. It is necessary to initialize the number of frames that have been used. In this way, the number of consecutive frames indicative of the amount of blocked light can be counted to determine the input of the control signal.

In operation 670, it is determined whether the input of the control signal is terminated. As described above, if the next control signal is not input within T after the last control signal is counted, it may be determined that the input of the control signal is finished.

As a result of the determination, if the input of the control signal is not finished, steps 610 to 670 are repeated to count the next input control signal.

As a result of the determination, when the input of the control signal is finished, an operation corresponding to the number of counted control signals is performed.

It is obvious after step 680 to initialize the number of frames and the number of control signals counted for input of the next control signal.

Up to now, the process in which the image signal processing unit 120 converts a signal input from the camera into digital data such as RGB format or YUV format, and calculates the amount of light of the input image using the converted data.

However, as another embodiment of the present invention, the image signal processor 120 may calculate the amount of light directly from the intensity of the electrical signal input from the camera. That is, before the image signal processing unit 120 converts the signal input from the camera to digital data, the image signal processor 120 may compare the intensity of the input signal with a predetermined threshold value and determine the amount of blocked light. As described above, it may be determined by the control signal that the blocking light amount lasts for a predetermined number of times or for a predetermined time, and accordingly, it is apparent to those skilled in the art in view of the technical idea of the present invention. .

In calculating the amount of light, before and after converting an electrical signal into digital data, there is essentially no difference, and since a method of performing a specific process using digital data is more commonly used, in the present specification, the intensity of the above-described electrical signal is increased. Detailed description on the calculation of the amount of light used will be omitted.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention as defined in the appended claims. It will be understood that the invention may be varied and varied without departing from the scope of the invention.

1 is a block diagram illustrating the internal functions of a portable terminal with a camera according to an embodiment of the present invention.

2 is a diagram illustrating an external structure of a portable terminal having a camera according to an embodiment of the present invention.

3 is a diagram illustrating that an image input to a camera according to an embodiment of the present invention is displayed.

4 is a diagram illustrating a screen displayed when the camera is blocked according to an embodiment of the present invention.

5 is a flowchart illustrating an operation control method of a portable terminal according to an embodiment of the present invention.

6 is a flowchart illustrating an operation control method of a portable terminal according to another embodiment of the present invention.

<Explanation of symbols for the main parts of the drawings>

100: Portable terminal

110: camera

120: image signal processing unit

Claims (24)

In the method for controlling the operation of the portable terminal using the image input device, Converting a signal input from the image input apparatus into digital data of a predetermined format; Calculating the amount of light for each target frame of the digital data divided into frame units having a predetermined size to determine whether the amount of blocked light is blocked; Counting the number of frames determined as the amount of blocking light; And Controlling the operation of the portable terminal according to the number of the counted frames; The blocking light amount is a light amount when the image input device is cut off for the control of the portable terminal. The method of claim 1, The step of determining whether the amount of light is blocked by calculating the amount of light for each target frame of the digital data divided into frame units of the predetermined size, Calculating a total sum or average value of binary values corresponding to each pixel data included in the target frame; And And comparing the calculated total sum or average value with a predetermined threshold value. 3. The method of claim 2, And if the calculated total sum or average value is less than or equal to the threshold, as a result of the comparison, determining that the amount of light of the target frame is the amount of cutoff light. The method of claim 1, The step of determining whether the amount of light is blocked by calculating the amount of light for each target frame of the digital data divided into frame units of the predetermined size, Counting the number of pixels whose binary value corresponding to each pixel data included in the target frame is equal to or less than a predetermined threshold; And And comparing the ratio of the counted number of pixels to the total number of pixels included in the target frame with a predetermined threshold ratio. 5. The method of claim 4, And if the ratio of the number of counted pixels to the total number of pixels included in the target frame is greater than or equal to the threshold ratio as a result of the comparison, determining that the amount of light of the target frame is a blocked light amount. Portable terminal operation control method using. The method according to any one of claims 2 to 4, The digital data is RGB format data, and the smaller the amount of light, the smaller the binary value corresponding to the pixel data. The method of claim 1, The step of determining whether the amount of light is blocked by calculating the amount of light for each target frame of the digital data divided into frame units of the predetermined size, Calculating a total sum or average value of binary values corresponding to data representing luminance among the pixel data included in the target frame; And And comparing the calculated total sum or average value with a predetermined threshold value. 8. The method of claim 7, And if the calculated total sum or average value is less than or equal to the threshold as a result of the comparison, determining that the amount of light of the target frame is the cutoff amount of light. The method of claim 1, The step of determining whether the amount of light is blocked by calculating the amount of light for each target frame of the digital data divided into frame units of the predetermined size, Counting the number of pixels whose binary value corresponding to data representing luminance among the pixel data included in the target frame is equal to or less than a predetermined threshold value; And And comparing the ratio of the counted number of pixels to the total number of pixels included in the target frame with a predetermined threshold ratio. 10. The method of claim 9, When the ratio of the counted pixel number to the total number of pixels included in the target frame is greater than or equal to the threshold ratio in the result of the comparison, it is determined that the light amount of the target frame is the blocking light amount. Portable terminal operation control method. The method according to any one of claims 7 to 9, The digital data is YUV-type data, and the smaller the amount of light, the smaller the binary value corresponding to the data representing the brightness. The method of claim 1, Controlling the operation of the portable terminal according to the number of the counted frames Determining whether a control signal for controlling the portable terminal is input according to the number of the counted frames; And And counting the number of the control signals. 13. The method of claim 12, Controlling the operation of the portable terminal according to the number of the counted frames And controlling the operation of the portable terminal with reference to a predetermined operation according to the counted control signal. An image input device configured to convert a signal of an optical object into an electrical signal and output the converted signal; Converts the data input from the image input apparatus into digital data of a predetermined format, calculates an amount of light for each target frame of the digital data divided into frame units of a predetermined size, and determines whether the amount of blocked light is An image signal processor counting the number of frames determined as blocked light amount; And A control unit for controlling the operation of the portable terminal according to the number of frames, The blocking light amount is a light amount when the image input device is blocked for controlling the portable terminal. 15. The method of claim 14, The image signal processor, Calculating a total sum or average value of binary values corresponding to each pixel data included in each target frame; And comparing the calculated total sum or average value with a predetermined threshold. 16. The method of claim 15, And if the calculated total sum or average value is less than or equal to the threshold as a result of the comparison, the image signal processor determines that the amount of light of the target frame is the amount of blocked light. 15. The method of claim 14, The image signal processor, Counting the number of pixels whose binary value corresponding to each pixel data included in each target frame is equal to or less than a predetermined threshold value, And comparing the ratio of the calculated number of pixels to the total number of pixels included in the target frame with a predetermined threshold ratio. 18. The method of claim 17, If the ratio of the counted number of pixels to the total number of pixels included in the target frame is greater than or equal to the threshold ratio as a result of the comparison, the image signal processor determines that the amount of light of the target frame is the blocking light amount. Portable terminal made with. 15. The method of claim 14, The image signal processor, Calculating a total sum or average of binary values corresponding to data representing luminance among the pixel data included in the target frame; And comparing the calculated total sum or average value with a predetermined threshold. The method of claim 19, And if the calculated total sum or average value is less than or equal to the threshold value, the image signal processor determines that the amount of light of the target frame is the amount of cutoff light. 15. The method of claim 14, The image signal processor, Counting the number of pixels whose binary value corresponding to data representing luminance among the pixel data included in the target frame is equal to or less than a predetermined threshold value, And a ratio of the counted number of pixels to the total number of pixels included in the target frame is compared with a predetermined threshold ratio. 22. The method of claim 21, If the ratio of the counted number of pixels to the total number of pixels included in the target frame is greater than or equal to the threshold ratio as a result of the comparison, the image signal processor determines that the amount of light of the target frame is the blocking light amount. Portable terminal made with. 15. The method of claim 14, And the image signal processor determines that a control signal for controlling the portable terminal is input when the number of the counted frames is greater than or equal to a predetermined number, and counts the number of the control signals. 24. The method of claim 23, And the controller controls the portable terminal with reference to a predetermined operation according to the counted control signal.

Images