KR20100078147A - Method and apparatus for saving image data in portable terminal - Google Patents

Abstract

PURPOSE: An image data storage unit of a portable terminal and a method thereof are provided to detect a face area from received image data and store the face area by image data, thereby easily registering an opponent's image in a phonebook. CONSTITUTION: An image storage and management unit(102) comprises a face detecting unit(120) and a similar photograph checking unit(130). The face detecting unit detects a user corresponding to a facial area of the user from received video data by control of a control unit(100) or a user corresponding to a preset setting range. The similar photograph checking unit determines a corresponding user by comparing a stored user range with a currently detected image.

Description

TECHNICAL AND APPARATUS FOR SAVING IMAGE DATA IN PORTABLE TERMINAL

The present invention relates to an image data storage device and method of a portable terminal, and more particularly, to an apparatus and method for storing a picture of a counterpart user without storing a picture by storing image data received using the portable terminal as image data. It is about.

Recently, with the rapid development of portable terminals, it is indispensable for modern people, regardless of age or gender, and is used as a medium for wireless voice calls and information exchange.

In the early stages of the spread of portable terminals, it was recognized that they could simply be carried and wirelessly made available. However, as the technology has developed, service providers and terminal manufacturers have competitively developed products (or services) to differentiate themselves from others. have.

For example, the portable terminal may include a phone book, a game, a short message, an e-mail, a morning call, an MP 3 layer, and a schedule management function. It has developed into a multimedia device capable of digital cameras and wireless Internet services to provide various services.

The digital camera function as described above provides an advantage of taking an image at any time without carrying a separate camera, so that users can easily take an image at any time and store it, and check the captured image at any time without restriction of time and place.

In addition, recently, it provides a function to link the picture taken using the camera of the portable terminal with other additional services.

For example, when a phone call is received from a corresponding user by storing a picture taken with the name of the other party to be stored in the phonebook in conjunction with a phonebook which is one of the additional services of the mobile terminal by taking a picture taken using the camera of the portable terminal. In addition, the user may output a picture corresponding to the user on the screen.

However, in order to use such a service, a user must directly photograph a camera mounted on a portable terminal, select and register a photo stored in the portable terminal, or transmit a photo from another portable device to the portable terminal for registration.

Accordingly, there may be a problem in that the user may take a predetermined procedure for connecting the portable device and the portable terminal, and the user may take a picture directly.

The present invention was derived to solve the above problems, and an object of the present invention is to provide an apparatus and method for storing image data received from a portable terminal as image data.

Another object of the present invention is to provide an apparatus and method for converting image data received from a portable terminal into image data and applying the same to a phone book.

Another object of the present invention is to provide an apparatus and method for detecting and storing a face of a counterpart during a video call in a portable terminal.

According to a first aspect of the present invention for achieving the above object, when the apparatus for storing image data in the portable terminal detects the face area of the user from the received image data, the device for pre-stored the detected face area When it is determined whether each face area is the same user's face compared to the face area, the image storage management unit may store the face area detected from the image data.

According to a second aspect of the present invention for achieving the above object, a method for storing image data in a portable terminal comprises the steps of detecting the face area of the user from the received image data, and pre-store the detected face area Determining whether each face area is a face of the same user compared to one face area, and storing the face area detected from the image data when the face area is determined to be a face area of the same user. It is characterized by.

As described above, the present invention is to store image data received by using a portable terminal as image data, and to process a face area from the received image data and store the image data as image data. The video can be registered in the phone book. In addition, the present invention detects and stores a face of a user when receiving image data, so that a picture of the counterpart user can be stored without taking a separate picture.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In describing the present invention, when it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

In the following description, an apparatus and method for storing image data received as a image data using a portable terminal according to an exemplary embodiment of the present invention will be described.

1 is a block diagram showing the configuration of a portable terminal according to an embodiment of the present invention.

1A is a block diagram illustrating a configuration of a portable terminal for storing received image data as image data according to an exemplary embodiment of the present invention.

Referring to FIG. 1A, the portable terminal includes a control unit 100, an image storage management unit 102, a memory unit 104, an input unit 106, a display unit 108, an image processing unit 110, and an audio processing unit. It can be configured to include the 112 and the communication unit 114.

The controller 100 controls the overall operation of the portable terminal. For example, when performing processing and control for voice call and data communication, and receiving image data from the portable terminal according to the present invention in addition to the usual functions, the image storage management unit 102 causes the image data to be stored in the image data. Process to detect and store the user's face.

Thereafter, the control unit 100 stores the area detected by the image storage management unit 102, that is, the face area of the user as an image of the user corresponding to the phone number of the phone book, or the user corresponding to the phone number of the recent call history. Process to register as an image.

The image storage manager 102 processes to detect and store the face region of the user from the image data received under the control of the controller 100. The image storage manager 102 detects the face of the user until the end of the video call. In this case, only the image of the same person can be detected and stored in comparison with the previously stored image.

In this case, the image storage manager 102 may process to detect and store only an image corresponding to a face angle, a pose, etc. corresponding to a user's selection of the portable terminal. A detailed description of the image storage manager will be described later with reference to FIG.

The memory unit 104 includes a read only memory (ROM), a random access memory (RAM), and a flash ROM. The ROM stores microcode and various reference data of a program for processing and controlling the controller 100.

The RAM is a working memory of the controller 100 and stores temporary data generated during execution of various programs. In addition, the flash ROM stores various updatable storage data such as a phone book, an outgoing message, and an incoming message.

In addition, the memory unit 104 stores the detected area as an image file when the user's area is detected in the image data according to the present invention.

The input unit 106 includes 0 to 9 numeric key buttons, a menu button (menu), a cancel button (clear), an OK button, a call button (TALK), an end button (END), an internet access button, a navigation key ( Or a plurality of function keys such as arrow keys) buttons and character input keys, and provides key input data corresponding to a key pressed by the user to the controller 100.

The display unit 108 displays status information generated during operation of the portable terminal, a limited number of characters, a large amount of moving images and still images, and the like. The display unit 108 may use a color liquid crystal display (LCD).

The image processor 110 performs a function of an image decoder and an image encoder, decodes the image data, outputs an image signal to the display unit 108, and provides audio data to the audio processor 112.

The voice processing unit 112 is connected to a speaker and a microphone, and converts the received audio data from the image processing unit 110 into an analog voice signal and outputs it to the speaker through a predetermined process.

The communication unit 114 performs a function of transmitting and receiving a radio signal of data input and output through an antenna (not shown). For example, in the case of transmission, after performing channel coding and spreading on the data to be transmitted, RF processing is performed to transmit the data. In the case of reception, the received RF signal is converted into a baseband signal. The baseband signal is de-spreaded and channel decoded to restore data.

1 (b) is a block diagram illustrating a configuration of an image storage management unit of a portable terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 1B, the image storage manager 102 may include a face detector 120 and a similar photo checker 130.

First, as described above, the image storage manager 102 detects and stores a face region of the user from the received image data, and the image storage manager 102 detects the face of the user until the end of the video call. In comparison with the stored image, only the image of the same person can be detected and stored.

The face detector 120 of the image storage unit 102 may receive a command from the controller 100 of the portable terminal to detect a user's face area or a user corresponding to a preset setting range from the received image data.

The face detector 120 includes an expression recognizer 122, a pose recognizer 124, and a face tracker 126, and the face tracker 126 is controlled by the face detector as described above. Is detected.

The facial expression recognizer 122 of the face detector 120 checks a user's facial expression corresponding to an image storage method in the image data, and accordingly, the facial detector 120 detects a user region (eg, a specific facial expression identified by the facial expression recognizer). ; The area of the laughing user).

The pose recognizer 124 of the face detector 120 checks a pose of a user corresponding to an image storage method in the image data, and accordingly, the face detector 120 determines a user region of a specific pose of the pose identified by the pose recognizer. Can be selected.

The image capturing unit 130 of the image storage manager 102 compares the user's area checked by the face detector 120 with the user's area previously stored under the control of the image storage manager 102. Determine whether the area is the same user.

That is, the similar picture checking unit 130 compares the pre-stored user's area with the image currently detected by the face detecting unit 120 to determine whether the user is the same user or not the same user.

Although it may be performed by the control unit 100 of the portable terminal of the image storage management unit 102, it is shown in a separate configuration in the present invention is an exemplary configuration for convenience of description to never limit the scope of the invention It will be appreciated by those skilled in the art that various modifications may be made within the scope of the invention. For example, the controller 100 may be configured to process all of them.

The foregoing has described an apparatus for storing image data received as a portable image data using a portable terminal according to an exemplary embodiment of the present invention. In the following description, image data received using the apparatus according to the present invention is described. A method for storing as image data will be described.

2 is a flowchart illustrating a process of storing image data received by a portable terminal as image data according to an exemplary embodiment of the present invention.

Referring to FIG. 2, the portable terminal first receives image data in step 201. That is, the portable terminal uses a service capable of receiving image data, such as a video communication service.

In step 203, the portable terminal checks the user's area, ie, the user's area, present in the received image data.

Herein, the portable terminal can check only an area corresponding to the entire face or body of the receiving user in the image data, and the portable terminal selects only the real user's area when checking the area of a person other than the actual counterpart user. You can check it.

In step 205, the portable terminal converts the user identified in step 203 to an image file, and then proceeds to step 207 to store the converted image file. In this case, the portable terminal may temporarily store the image or automatically store the image in a photo album so that the user can check the image at any time.

The portable terminal then terminates this algorithm.

3 is a flowchart illustrating a process of storing a specific image of a counterpart while using a video call service in a portable terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 3, the portable terminal proceeds to step 301 to check whether a user image storage event occurs. Here, the user image storage event refers to an event for storing a face image of a counterpart corresponding to a desired face pose, face angle, and facial expression among image data received by the portable terminal.

If it is determined in step 301 that the user image storage event does not occur, the portable terminal proceeds to step 315 to perform a corresponding function (eg, standby mode).

On the other hand, if it is determined in step 301 that the user image storage event occurs, the mobile terminal proceeds to step 303 to check the image storage method from the user of the portable terminal. Here, step 303 is a process of confirming the face shape of the counterpart user to be stored by the user of the portable terminal. can confirm.

In step 305, the portable terminal receives the image data with the counterpart user. In step 307, the portable terminal checks the user from the received image data. That is, step 307 refers to a process of tracking the face of the user among the image data received by the portable terminal.

In step 309, the portable terminal compares the checked user with the storage method checked in step 303. After that, the portable terminal proceeds to step 311. Make sure that it is the same as the storage method checked in step.

If it is determined in step 311 that the user is not identical to the checked storage method, the portable terminal proceeds to step 305 to perform the process of receiving the image data again.

On the other hand, if it is confirmed in step 311 that the same user as the confirmed storage method, the portable terminal proceeds to step 313 and stores the face of the confirmed user, that is, the counterpart user the same as the storage method.

The portable terminal then terminates this algorithm.

4 is a flowchart illustrating a process of storing a specific image of a counterpart as a phone book image while using a video call service in a portable terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 4, the portable terminal first performs a video call service capable of receiving video data in step 401, and then proceeds to step 403 to receive video data.

In step 405, the portable terminal identifies the user in the received image data. In step 407, the portable terminal processes the user region in the image data identified in step 405 to be converted into an image file.

In step 409, the portable terminal processes to store the converted image, and in step 411, the portable terminal determines whether to apply the converted image to the phone book. Here, the portable terminal may pop up a menu for selecting whether to apply the image to the phone book so that the user can select the menu.

If the converted image is not applied to the phone book in step 411, the portable terminal terminates the present algorithm.

If the converted image is applied to the phone book in step 411, the portable terminal proceeds to step 413 and determines whether the converted image is suitable as an image to be applied to the phone book. For example, when the mobile terminal is an image to be applied to a phone book and the converted image is an image identified in front and includes a face area of a predetermined size or more, the portable terminal may identify the image to be applied to the phone book.

Thereafter, the portable terminal processes the applied image to the phone book and ends the present algorithm.

Here, the portable terminal shows the stored image to the user and selects an image to be applied to the phonebook, or, if there is no photo stored in the phonebook, selects the most appropriate image among N images and automatically stores the image. In addition, the portable terminal may be configured to automatically update to a pre-stored image even if a pre-registered image exists in the phone book to maintain the latest image.

In FIG. 4, a method of converting a user area of image data into an image file and applying the same to a phone book according to an exemplary embodiment of the present invention has been described. However, the present invention may process to apply the image to a recent call history.

5 is a flowchart illustrating a process of detecting a user of the same person during a video call in a portable terminal according to an exemplary embodiment of the present invention.

First, the portable terminal first receives the image data in step 501, and proceeds to step 503 detects a user from the received image data. Here, the method of detecting a user in the image data is the same as described above.

In step 505, the portable terminal determines whether there is an image of a user previously stored. That is, step 505 is a process of checking whether there is an image of a user for detecting a user of the same person in the image data.

If it is determined in step 505 that there is no user image previously stored, the portable terminal proceeds to step 507 and stores the image of the user.

If there is an image of the user previously stored in step 505, the portable terminal proceeds to step 511 and compares the previously stored user image with the currently detected image to determine whether the user is the same user. This is to prevent the portable terminal from detecting an image of a nearby person and recognizing the same user when checking the face of the counterpart user.

If it is determined in step 511 that the pre-stored user's image and the currently detected image are determined to be the same user, the portable terminal performs the process of step 507.

On the other hand, if it is determined in step 511 that the user is not identical to each other by comparing the image of the pre-stored user and the currently detected image, the portable terminal performs the process of step 501.

When the user's image is stored in step 507, the portable terminal proceeds to step 509 to check whether the reception of the image data is terminated.

If the reception of the reception of the image data is not confirmed in step 509, the portable terminal repeats the above procedure until the reception of the image data is repeated by performing the process of step 501 again.

On the other hand, if it is determined in step 509 that the reception of the image data is received, the portable terminal ends the present algorithm.

6 is a flowchart illustrating a process of storing image data of a portable terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 6, when the portable terminal stores more than a predetermined number of image storage images, the portable terminal may store a specific image continuously checked by performing the following process.

First, in step 601, the portable terminal checks whether the user's face region exists in the user image, that is, the received image data.

If the user image is not checked in step 601, the portable terminal repeats the process of step 601.

On the other hand, when confirming the user image in step 601, the portable terminal proceeds to step 603 to confirm the number of images currently stored, and proceeds to step 605 to check whether the maximum image storage number is stored.

If the maximum number of images is stored in step 605, the mobile terminal proceeds to step 607 in which the portable terminal deletes the earliest stored image, that is, the first stored image among the currently stored images. Do it.

In step 609, the portable terminal processes to store the currently confirmed image.

If the maximum number of images is stored in step 605, the portable terminal performs the process of step 609.

The portable terminal then terminates this algorithm.

Meanwhile, in the detailed description of the present invention, specific embodiments have been described, but various modifications are possible without departing from the scope of the present invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the scope of the following claims, but also by the equivalents of the claims.

1 (a) is a block diagram showing the configuration of a portable terminal for storing received image data as image data according to an embodiment of the present invention;

Figure 1 (b) is a block diagram showing the configuration of the image storage management unit of the portable terminal according to an embodiment of the present invention,

2 is a flowchart illustrating a process of storing image data received by a portable terminal as image data according to an exemplary embodiment of the present invention;

3 is a flowchart illustrating a process of storing a specific image of a counterpart while using a video call service in a portable terminal according to an embodiment of the present invention;

4 is a flowchart illustrating a process of storing a specific image of a counterpart as a phone book image while using a video call service in a portable terminal according to an embodiment of the present invention;

5 is a flowchart illustrating a process of detecting a user of the same person during a video call in a portable terminal according to an embodiment of the present invention;

6 is a flowchart illustrating a process of storing image data of a portable terminal according to an exemplary embodiment of the present invention.

Claims (12)

An apparatus for storing image data in a portable terminal, When detecting a face region of the user from the received image data, comparing the detected face region with a previously stored face region and determining whether each face region is the same user's face, the face region detected by the image data Apparatus comprising an image storage management unit for storing the. The method of claim 1, The image storage management unit, And storing a face area detected from the image data until the reception of the image data ends. The method of claim 1, The image storage management unit, And after storing the detected face area, processing to register an image of the face area as a picture of a user corresponding to a phone book and a recent call history number. The method of claim 1, The image storage management unit, When detecting a face region of the image data, the apparatus compares whether the face region corresponds to a storage method, detects a face region corresponding to the storage method, and detects a face region of the user from the received image data. . The method of claim 4, wherein The storage method is And at least one of a facial expression, a pose, and a facial angle of a user present in the image data. The method of claim 1, The image storage management unit, When the face area is detected, when the maximum number of images is not stored, the image of the detected face area is stored. When the image is stored by the maximum number of images, the maximum image is deleted. And store an image of the detected face area. In the method for storing image data in a portable terminal, Detecting a face region of the user from the received image data; Comparing the detected face areas with previously stored face areas to determine whether each face area is a face of the same user; And when the face area is determined to be a face area of the same user, storing the face area detected from the image data. The method of claim 7, wherein Method for storing image data in the portable terminal, And performing the reception until the reception of the image data. The method of claim 7, wherein Method for storing image data in the portable terminal, And after storing the detected face area, registering an image of the face area as a picture of a user corresponding to a phone book and a recent call history number. The method of claim 7, wherein Detecting a face area of the user from the received image data, Checking the preset storage method, And detecting a face area corresponding to the storage method by comparing whether the face area of the image data is a face area corresponding to the storage method. The method of claim 10, The storage method is And at least one of a facial expression, a pose, and a facial angle of a user present in the image data. The method of claim 7, wherein The process of storing the face area detected from the image data may include: When detecting the face area, checking a current image storing number; Verifying that the maximum number of images has been saved, and Storing an image of the detected face region when the image is not stored as many as the maximum number of images; And storing the image of the detected face area after deleting the maximum image when the image is stored as many as the maximum number of images.

Images