KR101541815B1 - Method and apparatus for saving image data in portable terminal - Google Patents

Abstract

The present invention relates to an apparatus and method for storing image data received by using a portable terminal as image data and storing a photograph of a user of another user without taking another photograph, And an image storage management unit for storing the detected face region in the image data when the detected face region is compared with the previously stored face region to determine whether the respective face regions are the same user's face .

Image storage, image data, phonebook image, history

Description

TECHNICAL FIELD [0001] The present invention relates to an apparatus and method for storing image data of a portable terminal,

The present invention relates to an apparatus and method for storing image data of a portable terminal, and more particularly, to an apparatus and method for storing image data received by using a portable terminal as image data, .

Recently, according to the rapid development of portable terminals, it is used as a necessity indispensable to modern people regardless of whether they are male or female, and is used as a medium capable of wireless voice communication and information exchange.

However, as the technology is developed, the service provider and the terminal manufacturer competitively develop a product (or a service) in order to differentiate it from other companies, have.

For example, the portable terminal may include a phone book, a game, a short message, an e-mail, a morning call, an MP 3 (MPEG Layer 3) , Digital cameras, and multimedia devices capable of wireless Internet services.

The digital camera function as described above has an advantage that an image can be taken at any time without carrying a separate camera, so that the user can easily take an image at any time and store it, and can confirm the taken image at any time without restriction of time and place.

In addition, recently, a function of linking a picture taken by using the camera of the portable terminal with another supplementary service is provided.

For example, when a photograph is received from a corresponding user by allowing a photograph taken using the camera of the portable terminal to be stored together with the name of the other person to be stored in the phone book in cooperation with the phone book, which is one of the additional services of the portable terminal, , It is possible to output a photograph corresponding to the user to the screen.

However, in order to utilize the above-mentioned services, it is necessary to take a photograph directly with a camera mounted on the portable terminal, select a photograph stored in the portable terminal, or register the photograph in the portable terminal by transmitting the photograph to the portable terminal.

Accordingly, it is troublesome to perform a predetermined procedure for connecting the portable device and the portable terminal, and a situation that the user must directly take a picture may give a feeling of rejection to the other user.

It is an object of the present invention to provide an apparatus and method for storing image data received from a portable terminal as image data.

It is another object of the present invention to provide an apparatus and method for converting image data received by a portable terminal into image data and applying the image data to a phone book.

It is still another object of the present invention to provide an apparatus and method for detecting and storing a face of a counterpart in a video call in a portable terminal.

According to a first aspect of the present invention, there is provided an apparatus for storing image data in a portable terminal, the apparatus comprising: And an image storage management unit for storing the face region detected from the image data when it is determined that each face region is the face of the same user as compared with the face region.

According to a second aspect of the present invention, there is provided a method for storing image data in a portable terminal, the method comprising the steps of: detecting a face region of a user from received image data; Determining whether each face region is the same user's face by comparing the face region with a face region; and storing the detected face region in the image data when the face region is confirmed as the face region of the same user .

As described above, the present invention stores image data received by using a portable terminal as image data, and detects the face area from the received image data and stores the detected face data as image data. Thus, The image can be registered in the phone book. In addition, the present invention detects and stores a face of a user when receiving image data, so that a photograph of the other user can be stored without taking another photograph.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. In the following description, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

Hereinafter, an apparatus and method for storing image data received as image data using a portable terminal according to a preferred embodiment of the present invention will be described.

1 is a block diagram illustrating a configuration of a portable terminal according to a preferred embodiment of the present invention.

FIG. 1 (a) is a block diagram illustrating a configuration of a portable terminal for storing received image data as image data according to a preferred embodiment of the present invention.

1, the portable terminal includes a control unit 100, an image storage management unit 102, a memory unit 104, an input unit 106, a display unit 108, an image processing unit 110, (112) and a communication unit (114).

The controller 100 controls the overall operation of the portable terminal. For example, in the case of performing processing and control for voice communication and data communication and receiving image data from the portable terminal according to the present invention in addition to ordinary functions, The face of the user is detected and stored.

Then, the control unit 100 stores the area detected by the image storage management unit 102, that is, the face area of the user, as an image of the user corresponding to the phone number of the phone book, As shown in Fig.

According to the control of the controller 100, the image storage management unit 102 detects and stores the face region of the user in the received image data, and the image storage management unit 102 detects the face of the user It is possible to process only the image of the same person by comparing with the previously stored image.

At this time, the image storage management unit 102 may detect and store only images corresponding to the face angle, pose, and the like corresponding to the user's selection of the portable terminal. A detailed description of the image storage management unit will be described in detail with reference to FIG. 1 (b).

The memory unit 104 includes a ROM (Read Only Memory), a RAM (Random Access Memory), and a flash ROM. The ROM stores microcode of a program for processing and controlling the control unit 100 and various reference data.

The RAM is a working memory of the controller 100, and stores temporary data generated during execution of various programs. In addition, the flash ROM stores various updatable storage data such as a phone book, an origination message, and a received message.

In addition, the memory unit 104 stores the detected area as an image file when a user area is detected in the image data according to the present invention.

The input unit 106 includes numeric key buttons 0 to 9 and a menu key, a cancel button, an OK button, a talk button, an end button, an Internet access button, a navigation key Or direction key) buttons and a character input key, and provides key input data corresponding to a key pressed by the user to the control unit 100. [

The display unit 108 displays status information generated during operation of the portable terminal, a limited number of characters, a large amount of moving images, still images, and the like. The display unit 108 may be a color liquid crystal display (LCD).

The image processing unit 110 decodes the image data by performing a function of a video decoder and a video encoder, and outputs a video signal to the display unit 108, and provides the audio data to the audio processing unit 112.

The voice processor 112 is connected to a speaker and a microphone. The voice processor 112 converts the voice data supplied from the image processor 110 into an analog voice signal, and outputs the analog voice signal to a speaker through a predetermined process.

The communication unit 114 performs transmission / reception processing of wireless signals of data input / output through an antenna (not shown). For example, in the case of transmission, channel coding and spreading are performed on data to be transmitted, RF processing is performed for transmission, and in case of a receiver, the received RF signal is converted into a baseband signal And performs a function of de-spreading and channel decoding the baseband signal to recover data.

1 (b) is a block diagram showing the configuration of an image storage management unit of a portable terminal according to a preferred embodiment of the present invention.

Referring to FIG. 1B, the image storage management unit 102 may include a face detection unit 120 and a similar photo recognition unit 130.

As described above, the image storage management unit 102 detects and stores a face region of the user in the received image data. The image storage management unit 102 detects the face of the user until the end of the video call, It is possible to detect and store only the image of the same person as compared with the stored image.

The face detection unit 120 of the image storage unit 102 detects a user corresponding to a user's face area or a predetermined setting range from the received image data in response to an instruction from the controller 100 of the portable terminal.

The face detector 120 includes a face recognizer 122, a pose recognizer 124 and a face tracker 126. The face follower 126 controls the face detector 126 in accordance with the control of the face detector, .

The face recognizer 122 of the face detector 120 confirms the facial expression of the user corresponding to the image storing method from the image data and the face detecting unit 120 detects the facial expression of the user ; The area of the smiling user).

The pose recognizer 124 of the face detector 120 confirms the pose of the user corresponding to the image storing method in the image data and the face detector 120 detects the user's area of the specific pose of the pose confirmed by the pose recognizer, Can be selected.

The similarity checking unit 130 of the image storage management unit 102 compares the area of the user identified by the face detection unit 120 with the area of the user who is storing the image according to the control of the image storage management unit 102 It is determined whether the area is the same user.

That is, the similar photo confirmation unit 130 compares the area of the user stored previously with the image currently detected by the face detection unit 120, and determines whether the user is the same user or not.

The present invention can be performed by the control unit 100 of the portable terminal of the image storage management unit 102. However, it is to be understood that the present invention is not limited to the exemplary configuration for convenience of description, Those skilled in the art will appreciate that various modifications are possible within the scope of the invention. For example, the control unit 100 may be configured to process all of them.

As described above, an apparatus for storing image data received as image data using the portable terminal according to the preferred embodiment of the present invention has been described. In the following description, the image data received using the apparatus according to the present invention A method for storing image data will be described.

2 is a flowchart illustrating a process of storing image data received in a portable terminal according to an exemplary embodiment of the present invention as image data.

Referring to FIG. 2, the portable terminal receives image data in step 201. FIG. That is, the portable terminal uses a service capable of receiving image data such as a video communication service.

Then, the portable terminal proceeds to step 203 and checks the area of the user present in the received image data from the received image data.

Here, the portable terminal can only identify an area corresponding to the face or whole body of the receiving user in the image data. When the portable terminal confirms the area of a person other than the actual user of the other party, only the area of the actual user is selected Can be confirmed.

In step 205, the portable terminal converts the user identified in step 203 into an image file, and then proceeds to step 207 to store the converted image file. At this time, the portable terminal can temporarily store the image or automatically store the image in a photo album so that the user can check the image at any time.

Thereafter, the portable terminal terminates the present algorithm.

FIG. 3 is a flowchart illustrating a process of storing a specific image of the other party while using a video call service in a portable terminal according to a preferred embodiment of the present invention.

Referring to FIG. 3, the portable terminal proceeds to step 301 and determines whether a user image storage event occurs. Here, the user image storage event refers to an event for storing the facial image of the other party, which matches the face pose, face angle, and facial expression desired by the user among the image data received by the portable terminal.

If it is determined in step 301 that the user image storage event does not occur, the portable terminal proceeds to step 315 and performs a corresponding function (standby mode).

If it is determined in step 301 that a user image storage event has occurred, the portable terminal proceeds to step 303 and checks the image storage method from the user of the portable terminal. Herein, the step 303 is a step of confirming the face type of the counterpart user to be stored by the user of the portable terminal, and the portable terminal can display the counterpart face image storing method corresponding to the face pose, face angle, can confirm.

The portable terminal proceeds to step 305 and receives the image data with the other user. Then, the portable terminal proceeds to step 307 and confirms the user from the received image data. That is, the step 307 is a process of tracking a user's face among the image data received by the portable terminal.

The portable terminal then proceeds to step 309 and compares the checked user with the storage mode determined in step 303. In step 311, the user of the other user, Make sure that it is the same as the storage method checked in step.

If it is determined in step 311 that the user is not the same as the stored method, the portable terminal proceeds to step 305 and performs a process of receiving image data.

On the other hand, if it is determined in step 311 that the same user is identified as the storage method, the portable terminal proceeds to step 313 and stores the face of the other user, which is the same as the checked user.

Thereafter, the portable terminal terminates the present algorithm.

4 is a flowchart illustrating a process of storing a specific image of the other party as a phonebook image while using a video call service in a portable terminal according to a preferred embodiment of the present invention.

Referring to FIG. 4, the portable terminal performs a video call service capable of receiving image data in step 401, and then proceeds to step 403 to receive image data.

In step 405, the portable terminal confirms the user from the received image data. In step 407, the portable terminal processes the user area in the image data identified in step 405 into an image file.

Then, the portable terminal proceeds to step 409 to process the converted image, and then proceeds to step 411 to confirm whether the converted image is to be applied to the phone book. Here, the portable terminal may pop up a menu for selecting whether to apply the image to the phone book, and allow the user to select the menu.

If the converted image is not applied to the phone book in step 411, the mobile terminal ends the algorithm.

If the converted image is applied to the phone book in step 411, the portable terminal proceeds to step 413 and determines whether the converted image is suitable for the phone book. For example, if the converted image is an image to be applied to a phone book, and the face image includes a face area of a predetermined size or larger, the portable terminal can be identified as an image to be applied to the phone book.

After that, the portable terminal processes the confirmed image to apply to the phone book, and ends the algorithm.

Here, the portable terminal displays the stored image to the user, selects an image to be applied to the phone book, or automatically selects the most appropriate image among the N images when there is no image stored in the phone book. In addition, even if an image registered in the phone book exists, the portable terminal can automatically update the previously stored image to maintain the latest image.

4, a method of converting a user area of image data into an image file and applying the converted image file to a phone book has been described with reference to the preferred embodiment of the present invention. However, the present invention can also be applied to recent calls.

5 is a flowchart illustrating a process of detecting a user of the same person during a video call in a portable terminal according to an exemplary embodiment of the present invention.

First, the mobile terminal first receives image data in step 501, and then proceeds to step 503 to detect a user from the received image data. Here, the method of detecting a user in the image data is the same as that described above.

In step 505, the portable terminal determines whether there is an image of the user. That is, in step 505, it is checked whether there is an image of a user for detecting a user of the same person in the image data.

If it is determined in step 505 that there is no previously stored user image, the portable terminal proceeds to step 507 and stores the image of the user.

If there is an image of the user stored in step 505, the portable terminal proceeds to step 511 and compares the image of the user with the currently stored image to determine whether the user is the same user. This is to prevent an image of a neighboring person from being recognized as a same user when the face of the opposite user is checked in the portable terminal.

If it is determined in step 511 that the image of the user stored in step 511 and the currently detected image are identical to each other, the portable terminal performs the process of step 507.

If it is determined in step 511 that the user is not the same user, the portable terminal performs the process of step 501.

If the image of the user is stored in step 507, the portable terminal proceeds to step 509 and checks whether the image data is received.

If the end of the reception of the video data is not confirmed in step 509, the portable terminal repeats the above-described steps until the reception of the video data is completed by re-executing the procedure of step 501. [

On the other hand, if it is determined in step 509 that the end of the reception of the image data is confirmed, the portable terminal ends the algorithm.

6 is a flowchart illustrating a process of storing image data of a portable terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 6, when the portable terminal stores an image of a predetermined number of images or more, the portable terminal may store a specific image to be continuously checked by performing the following procedure.

In step 601, the portable terminal confirms whether the user's face region exists in the user image, that is, the received image data.

If the user does not confirm the user image in step 601, the portable terminal repeats the procedure of step 601. [

In step 601, the portable terminal proceeds to step 603 to check the number of currently stored images, and then proceeds to step 605 to check whether images are being stored for the maximum number of stored images.

If it is determined in step 605 that the image has been stored for the maximum number of images stored, the portable terminal proceeds to step 607 and determines whether the stored image is the fastest among the stored images, that is, .

Then, the portable terminal proceeds to step 609 and stores the currently determined image.

On the other hand, if it is determined in step 605 that images corresponding to the maximum number of images to be stored are not stored, the portable terminal performs the procedure of step 609. FIG.

Thereafter, the portable terminal terminates the present algorithm.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments, but is capable of various modifications within the scope of the invention. Therefore, the scope of the present invention should not be limited by the illustrated embodiments, but should be determined by the scope of the appended claims and equivalents thereof.

FIG. 1 (a) is a block diagram illustrating a configuration of a portable terminal for storing received image data as image data according to a preferred embodiment of the present invention. FIG.

1 (b) is a block diagram illustrating a configuration of an image storage management unit of a portable terminal according to an exemplary embodiment of the present invention.

2 is a flowchart illustrating a process of storing image data received in a portable terminal according to a preferred embodiment of the present invention as image data;

FIG. 3 is a flowchart illustrating a process of storing a specific image of the other party while using a video call service in a portable terminal according to a preferred embodiment of the present invention.

FIG. 4 is a flowchart illustrating a process of storing a specific image of the other party as a phonebook image while using a video call service in a portable terminal according to a preferred embodiment of the present invention;

5 is a flowchart illustrating a process of detecting a user of the same person during a video call in a portable terminal according to a preferred embodiment of the present invention,

6 is a flowchart illustrating a process of storing image data of a portable terminal according to an exemplary embodiment of the present invention.

Claims (12)

An apparatus for storing image data in a portable terminal, A communication unit for receiving image data; A memory unit for storing an image of a contact of a partner user and an image of a partner user performing a video call; And A face detecting unit for detecting at least one face from the received image data and identifying a face having similarity with an image of a previously stored counterpart user among the detected faces and comparing the image of the counterpart user stored in the memory with a face having the identified similarity And a control unit for updating the control information. The method according to claim 1, Wherein, And at least one face satisfying the condition is detected until the end of the video call. The method according to claim 1, The image of the counterpart user being updated with the face having the identified similarity, Phone book information, recent call history, and the like. delete 3. The method of claim 2, The above- A user's facial expression, a user's pose, and a user's angle. delete A method for storing image data in a portable terminal, Detecting at least one face from the received image data, An operation of confirming a face having similarity with an image of a previously stored relative user among the detected faces, and And updating the image of the pre-stored counterpart user with the face having the identified similarity. 8. The method of claim 7, Wherein the operation of detecting at least one face in the received image data comprises: And detecting at least one face satisfying the condition. 8. The method of claim 7, And updating the image of the previously stored counterpart user with the face having the confirmed similarity, Phone book information, recent call history, and the like. delete 9. The method of claim 8, In the storage method, A face angle, and a face angle of a user present in the image data. 9. The method of claim 8, The above- A face of the user, a pose of the user, and an angle of the user.

Images