KR20050079125A - Methods and a apparatus of setting normal display image and ringing signal for mobile phone - Google Patents

Abstract

The present invention is to automatically change the standby screen and the ringtone sound signal according to the facial expression determined by the portable terminal, the photographing unit for photographing the user's face and input as a face image signal; A controller configured to analyze facial expression characteristics of the image signal photographed by the photographing unit, search for similar facial expressions, and set an associated stored standby screen and a ringing bell signal; A database unit connected to the control unit and recording and storing association information between a plurality of facial expression features, a standby screen, and a ringing bell signal; A feature analyzer for analyzing and detecting features of facial expressions from the face image signal input by the control of the controller; A memory unit connected to the control unit to record and store standby screen information and ring tone signal information associated with facial expression features of the database unit; It is characterized by an input / output unit configured to output and display standby screen information applied from the control unit, and to output and receive incoming bell signal information, and to input a control command. Sample process of photographing the face of joy, sadness and expressionless face; An extraction process of analyzing and extracting a face region and a facial expression feature from a face image signal photographed in the above process and making a database; And a plurality of standby screens and ringing bells recorded on the portable terminal, and a linking process for storing the records by linking with each facial expression.

Description

Standby screen and bell signal setting device and method of mobile terminal {METHODS AND A APPARATUS OF SETTING NORMAL DISPLAY IMAGE AND RINGING SIGNAL FOR MOBILE PHONE}

The present invention is to determine the emotional state by recognizing their facial expressions with a portable terminal, in particular, the standby screen and ring signal setting of the mobile terminal to automatically change the standby screen and the ringing tone signal according to the determined facial expression An apparatus and method are provided.

The mobile communication system freely moves within a service area formed by a base station (BS) using a mobile terminal (MS: MOBILE STATION) registered with a mobile station (MSC: MOBILE SWITCHING CENTER). It is a high-tech wireless communication device that instantly connects and communicates with a desired party anytime and anywhere by switching and controlling, and uses various additional services provided by a server.

The mobile terminal which communicates while moving as described above should be able to conveniently communicate with the desired party at any time and anywhere by wireless connection, and when the other party is called, it transmits a dialing signal, and when the called party calls from the other party Generate a signal.

When the portable terminal MS generates the ringing tone signal by the called, the calling party number is displayed on the corresponding display unit, and the display unit displays the background screen or the standby screen by the user's preference in the standby state.

The user's favorite ring tone signal and the standby screen are changed by a change in emotion or mood and facial expression, and the mood and facial expression are brightly changed by a refreshing melody and standby screen selected by a preference.

In the mobile terminal as described above, a variety of additional services are provided to increase the utilization, photographing and recording an object using a built-in camera among the additional services, transmitting or outputting to a desired counterpart, etc. The function of is integrally provided.

Analyzing the facial expressions of a particular person photographed with the camera by various analysis methods may identify the corresponding emotion or mood.

Accordingly, there is a need to develop a technology of photographing a user's facial expression, analyzing current emotions using a corresponding analysis method, changing and setting a ringing bell signal suitable for the analyzed emotions, and simultaneously changing and setting a background image of a standby state.

Hereinafter, a ringing tone setting method and a standby screen setting method of a portable terminal according to the related art will be described with reference to the accompanying drawings.

1 is a functional configuration diagram of a general mobile communication system, and FIG. 2 is a flowchart of a method for setting a standby screen and a ringing bell signal of a mobile terminal according to the prior art.

Referring to FIG. 1, a general mobile communication system will be described. A mobile communication service area 30 in which a mobile station (MS) 10 is freely moved by a base station (BS) 20 and wirelessly communicates with a desired counterpart 30. ), And the mobile terminal 10 freely moves in the mobile communication service area 30 to communicate with the other party connected wirelessly through the base station 20.

Since the path of the portable terminal 10 communicating with the other party by wireless connection is set by the switching process of the mobile switching center (MSC) 30, the communication terminal transmits and receives the corresponding communication signal with the wirelessly connected party through the set communication path. Communication is in progress.

Each of the base stations 20 forms a unique service area 30, and since a plurality of base stations 20 are arranged at regular intervals, the whole base station 20 may be formed as a service area 30.

The mobile terminal 10 communicates with the counterpart mobile terminal 10 in various ways including voice level communication, performs message data communication using a text message, and displays image information photographed using an integrated camera. Record save, output and send to designated counterpart.

The portable terminal 10 displays a video screen designated by a user's preference in a standby state, outputs an incoming call signal designated by a user when called by a counterpart, and can be arbitrarily changed and set by the user.

Hereinafter, a method of setting a standby screen and a ringing bell signal of a portable terminal according to the related art will be described with reference to FIG. 2.

When the portable terminal 10 is not operated for communication and additional services, it is determined whether to set the standby screen state of the display unit displaying the standby state (S10), and when setting the idle screen in the determination (S10), Search for a plurality of standby screen data stored in the corresponding memory built in the portable terminal 10 (S20), and set to output the standby screen selected by the search (S20) to the display unit in the standby state of the portable terminal (S30). ).

As described above, if it is determined whether to set a ringing tone signal indicating an alarm that the called party is called from the other party in the mobile terminal 10 on which the standby screen is set (S40), and the ringing tone signal is set in the determination (S40). The mobile terminal 10 searches for a plurality of ringing tones signals recorded in the mobile terminal 10 (S50), and sets the ringing tones signal selected in the search (S50) to be output in a called state (S60).

According to the prior art of the configuration described above, the incoming call sound signal generated by the standby screen and the called screen displayed on the mobile terminal 10 does not reflect the user's emotion or mood change, and to change the set state once, The process is very complicated and cumbersome.

The present invention provides a device and method for setting a standby screen and a bell signal of a mobile terminal for capturing and analyzing a user's facial expression to distinguish joy, sadness and normal state and automatically changing the standby screen and a ringing bell signal suitable for each expression. The purpose is to provide.

The present invention devised to achieve the above object, the photographing unit for taking a face of the user of the mobile terminal and inputs it as a face image signal; A controller configured to analyze facial expression characteristics of the image signal photographed by the photographing unit, search for a similar facial expression, and set an associated stored standby screen and a ringing bell signal; A database unit connected to the control unit and storing and storing connection information of a plurality of facial expression features, a standby screen, and a ringing bell signal; A feature analyzer for analyzing and detecting features of facial expressions from a face image signal input by the control of the controller; A memory unit connected to the control unit to record and store standby screen information and ring tone signal information associated with a facial expression feature of the database; It is characterized in that it consists of an input and output unit for generating and displaying the incoming call signal information to be output and display the standby screen information applied from the control unit, and inputs a control command.

In addition, the present invention devised to achieve the above object, a sample process of photographing the joy and sorrow and expressionless face of a number of people sampled when creating the facial expression data to record and store in the mobile terminal; An extraction process of analyzing and extracting a face region and a facial expression feature from a face image signal photographed in the above process and making a database; A plurality of idle screens and ringing bells recorded on the mobile terminal are searched and selected, and the linking process is performed by storing the data in association with each facial expression.

In addition, the present invention devised to achieve the above object, the photographing process of inputting the image signal by taking a face when inputting the corresponding data for each user expression in the mobile terminal; A search process of extracting a feature of a face by analyzing a face image signal input in the above process and searching a database to identify similar features; If a similar to the facial feature extracted from the analysis is searched, there is a feature consisting of an output process for automatically setting the corresponding standby screen and the ringing bell respectively.

Hereinafter, an apparatus and a method for setting a standby screen and a bell signal of a mobile terminal according to the present invention will be described with reference to the accompanying drawings.

3 is a configuration diagram of a standby screen and a bell signal setting device of the mobile terminal according to the present invention, and FIG. 4 is a standby screen and a bell signal recording setting method of the mobile terminal according to the present invention. 5 is a flowchart illustrating a method for setting a standby screen and a bell signal output of the portable terminal according to the present invention.

Referring to FIG. 3, the standby screen and the bell signal setting device of the mobile terminal according to the present invention will be described. The photographing unit 140 photographs a user's face and inputs it as a face image signal.

Analyzing facial expression characteristics of the image signal captured by the photographing unit 140 and searching for a similar expression to set the associated stored standby screen and the ringing bell signal, and the face image information captured and input from the photographing unit 140. Is applied to the feature analyzer 130 to analyze the feature of the face, and when the facial feature information analyzed from the feature analyzer 130 is input, it is recorded and stored in the database unit 120 and whether there is the same or similar information. If the same similar information is found in the search, the controller 110 reads the associated information and reads the standby screen and the ringing bell signal information from the memory unit 150 and outputs it to the input / output unit 160;

It is connected to the control unit 110 and records and stores the connection information of the plurality of facial expression features and the standby screen and the ringing bell signal, the facial feature information by the joy, sadness, no expression of the plurality of faces sampled and input by the manufacturer of the mobile terminal A database unit 120 for recording and storing the information, and storing and outputting the information of the standby screen information and the ringing bell signal associated with each facial expression;

Analyzing and detecting features of facial expressions from the facial image signal input by the control of the controller 110, the face region is extracted from the input facial image information by color correction, principal component analysis, video, and neural network. A feature analysis unit 130 for extracting a feature of facial expression using geometric features and color information from the extracted face region;

A memory unit 150 connected to the control unit 110 to record and store standby screen information and ring tone signal information associated with facial expression features of the database unit 120;

An input / output unit 160 for outputting and displaying idle screen information applied from the controller 110 and outputting incoming ring signal information and inputting a control command;

Under the control of the control unit 110 is a configuration consisting of a wireless unit 100 for wirelessly transmitting and receiving a communication signal while moving and wirelessly connected to the base station (BS).

Hereinafter, the standby screen and the bell signal setting device of the mobile terminal according to the present invention will be described with reference to the accompanying drawings.

In the database unit 120 of the portable terminal, a facial feature of a plurality of representative, sampled, and sampled by a maker (MAKER) in advance is made into a database, and is searched and output by the controller 110.

For example, the sampled facial feature data extracts facial region signals by analyzing the face image signals of joy, sadness, and expressionlessness of 15 people using color information method, principal component analysis method, video method, and neural network method. The information of each face is extracted by using the information, and the data is recorded and stored in the database.

A basic algorithm for extracting a face region from the face image signal is, for example, a method of extracting eye, nose, and mouth regions using color information, and using principal component analysis, color information, and video in addition to the color information. , Neural network method and the like are the existing methods, and new methods may be newly proposed.

Based on the extracted eye, nose, and mouth areas of the analyzed facial region, geometrical characteristics based on various data values such as distance values between two tails according to each expression, distance values between mouth and nose ends, distance values between both ends of lips, etc. Extract.

The feature data of each facial expression of 15 people sampled and sampled as described above, which is joy, sadness, and expressionless expression, that is, 45 facial expression characteristic data are stored in a database (D / B) in the database 120. do.

As described above, the database unit 120 in which three types of facial expression features are recorded and stored by the manufacturer is recorded and stored in the memory unit 150. Searches for and saves the associated standby screen and ringing bell signal.

The face image signal of the user is photographed by using the photographing unit 140 of the portable terminal manufactured by the manufacturer as described above, and the photographed face image signal is controlled by the control unit 110 to the feature analyzer 130. Since it is applied, the manufacturer analyzes and extracts facial features through the same process as extracting facial regions from facial image signals and again extracting facial facial features.

The feature analyzing unit 130 analyzes and extracts a face region from the input face image signal, as previously described, including a newly presented method such as a color information method, a principal component analysis method, a video method, and a neural network method. The method extracts a feature of a facial expression by geometric feature extraction and color information from the extracted face region signal.

As described above, the feature information signal of the facial expression analyzed and extracted by the feature analyzer 130 is applied to the controller 110, and the controller 110 searches the database to determine whether there is the same or similar information signal. do.

When the control unit searches the database unit 120 and confirms the same similar facial expression features, the associated information is extracted, and the standby screen data and the ringing ring sound are received from the memory unit 150 using the extracted linked information. The signal data are respectively read and set to be output to the input / output unit.

In other words, by photographing and analyzing the face of the user of the mobile terminal through the photographing unit 140, the feature of the facial expression is extracted and the database is searched to determine whether it is a happy expression, a sad expression, or no expression. Reads from the memory unit 150 the standby screen and the ringing tone signal set appropriately for each corresponding facial expression and outputs the same from the input / output unit.

Therefore, the mobile terminal checks the change in the mood state of the user by photographing, outputs a standby screen suitable for the user's mood, and outputs a ringing tone signal signaled by the called party to the user's mood.

Hereinafter, a standby screen and a bell signal recording setting method of the portable terminal according to the present invention will be described with reference to FIG.

The process of judging whether to record and record data of the user's facial expression on the portable terminal by photographing the sampled facial expression data to be recorded and stored on the portable terminal. (S100); In the case of creating the user facial expression confirmation data in the process (S100), the sample process consisting of photographing and inputting the face images of the expressions of joy and sadness and no expression for each of the sampled plurality of faces (S110),

Analyzing the extracted facial region and facial expression features from the facial image signal photographed in the above process, and storing them as a database. Analyzing the input facial image signal results in color information, principal component analysis, video, neural network. Extracting an area and again analyzing and extracting features of facial expression using geometric feature extraction and color information (S120); An extraction process consisting of a process of storing the information extracted by analyzing the extracted information in the process (S120) into a database unit (S130),

Search and select multiple standby screens and ringing bells recorded in the mobile terminal, respectively, and record and store them in association with facial expressions, and select appropriate ones for each facial expression by searching multiple standby screens and ringing bell signals recorded in the mobile terminal. Process (S140); In the process (S140) it is composed of a linking process consisting of the step (S150) of recording and storing in association with each of the facial expressions and the ringing bell signal selected in the screen.

Hereinafter, the above-described configuration will be described in detail with reference to the accompanying drawings a method of setting a standby screen and a bell signal recording of a portable terminal according to the present invention.

It is determined whether to create a facial expression data to be input to the database by the mobile terminal (S100), and when the facial expression data is written in the judgment, photographed the joy and sadness and the expressionless facial expressions of the sampled majority (S110), the photographing Facial region is analyzed and extracted from each of the extracted facial image signals by using color information, principal component analysis, video, or neural network, and facial expression by geometric feature extraction and color information from the extracted facial region signals. Analyze and extract the features (S120) and record and store the data in the database unit 120, respectively, to form a database of happy face expressions, sad face expressions, and expressionless face expressions (S130).

As described above, the standby screen and the ringing bell suitable for the characteristic face expression recorded and stored in the database unit 120 are searched and selected from the memory unit 150 (S140), and the standby screen and the ringing bell signal suitable for each face expression are selected. To be linked.

Associated recording and storage of the standby screen and the ringing bell suitable for each facial expression feature of the database unit 120 may be initially recorded and stored by the manufacturer, and may be arbitrarily changed by the user. have.

Hereinafter, the standby screen and the bell signal output setting method of the portable terminal according to the present invention will be described with reference to FIG. 5.

In the case of inputting the corresponding data for each user's facial expression on the portable terminal, a face is photographed and input as image information. ; In the process (S200) in the case of setting each of the standby screen and the ringing bell signal according to the user's expression, the shooting process consisting of the process of photographing and inputting the user's face (S210),

Analyzing the facial image signal input in the photographing process to extract the features of the face and to search the database unit 120 to identify similar features. The input face image information is analyzed by color information method, principal component analysis method, and video method. Extracting a facial region by analyzing by neural network method and extracting a feature of facial expression using geometric feature extraction and color information from the extracted facial region (S220); A search process (S230) of checking whether there is a similar feature of the facial expression extracted in the process (S220) by searching the database unit 120;

If a similar to the face feature photographed in the search process is found, the corresponding standby screen and the ringing bell are automatically set, respectively, and a process of determining whether or not the search is performed by checking the database unit for the similarity to the face feature extracted in the search process ( S240); If it is determined in the step (S240) and the search is confirmed, it is composed of an output process consisting of the step (S250) of setting to output the corresponding standby screen and the incoming call ring stored in association.

Hereinafter, the configuration as described above, the standby screen and the bell signal output setting method of the mobile terminal (MS) according to the present invention will be described in detail with reference to the accompanying drawings.

It is determined whether to input the facial expression according to the current mood of the user in the mobile terminal (S200), and if the user's facial expression is to be input in the determination (S200), the user's face is photographed through the photographing unit 140 so that the face Since the image signal is input (S210) and the face image signal input as described above is applied to the feature analyzer 130 by the controller 110, color information method, principal component analysis method, video method, neural network method, etc. The facial region is analyzed and extracted using the extracted feature, and the feature of facial expression is analyzed and extracted by geometric feature extraction and color information (S220).

The facial expression feature of the user, which is analyzed and extracted as described above, is applied to the controller 110, and the controller 110 searches the database 120 to determine whether there is the same or similar (S230).

If the same or similar is found in the checking process (S230) (S240), the information associated with the facial expression feature signal retrieved from the database unit 120 is checked, and the memory unit is used by using the identified association information. The standby screen and the ringing bell sound signal are read from 150 and the corresponding setting is automatically performed through the input / output unit (S250).

The mobile terminal according to the present invention configured as described above checks a facial expression by photographing a user's face and analyzing features, and displays a standby screen suitable for the user's atmosphere based on the identified feature. A suitable ring tone signal is generated.

The present invention of the configuration described above has the industrial use effect to capture the facial expression of the user of the mobile terminal to grasp the atmosphere and to generate a suitable standby screen and ringing ring sound signal.

In addition, since the standby screen and the ringing bell signal of the display unit are automatically changed and set according to the facial expression of the user, there is a convenient effect of adjusting the atmosphere of the user.

1 is a functional configuration diagram of a general mobile communication system,

2 is a flowchart illustrating a method for setting a standby screen and a ringing bell signal of a conventional mobile terminal;

3 is a configuration diagram of a standby screen and a bell signal setting device of a mobile terminal of the present invention;

4 is a flowchart illustrating a method for setting a standby screen and a bell signal recording of a mobile terminal of the present invention;

5 is a flowchart illustrating a method for setting a standby screen and a bell signal output of a portable terminal of the present invention.

** Explanation of symbols on the main parts of the drawing **

100: wireless unit 110: control unit 120: database unit

130: feature analysis unit 140: recording unit 150: memory unit

160: input and output unit

Claims (16)

A photographing unit which photographs a user's face of a mobile terminal and inputs it as a face image signal; A controller configured to analyze facial expression characteristics of the image signal photographed by the photographing unit, search for a similar facial expression, and set an associated stored standby screen and a ringing bell signal; A database unit connected to the control unit for recording and storing connection information of a plurality of facial expression features, a standby screen, and a ringing bell signal; A feature analyzer for analyzing and detecting features of facial expressions from a face image signal input by the control of the controller; A memory unit connected to the control unit for recording and storing standby screen information and ring tone signal information associated with facial expression features of the database; Stand-by screen and bell signal setting device of the portable terminal, characterized in that consisting of the input and output unit for outputting and displaying the ringing signal information is applied to output and display the standby screen information from the control unit. According to claim 1, Standby screen and bell signal setting device of the portable terminal, characterized in that the configuration further comprises a wireless unit for wirelessly transmitting and receiving a communication signal while moving and wirelessly connected to the base station under the control of the controller. The method of claim 1, wherein the control unit, The facial image information photographed and input from the photographing unit is applied to the feature analyzer to analyze the feature of the face, and when the facial feature information analyzed from the feature analyzer is input, the same as that recorded and stored in the database unit or Searching for similar information, and if the same similar information is found in the search, reads the associated information, and reads the standby screen and the incoming bell signal information from the memory unit and outputs the output to the input / output unit. Screen and bell signal setting device. The method of claim 1, wherein the database unit, It records and records the facial feature information by joy, sadness, and expressionlessness of a plurality of faces sampled and inputted by the manufacturer of the portable terminal, and records and stores the standby screen information and the ringing bell signal information associated with each expression. Standby screen and bell signal setting device of a mobile terminal, characterized in that consisting of. The method of claim 1, wherein the feature analysis unit, Standby screen and bell signal setting device of the portable terminal, characterized in that for extracting the facial region from the face image information input by the control of the control unit and the feature of facial expression from the extracted face region. The method of claim 5, The face region extraction uses color information method, principal component analysis method, video method, and neural network method, and facial expression feature extraction is performed by using a geometric feature and color information. . A sample process of photographing the joys, sorrows, and expressionless faces of a large number of people sampled in the case of creating facial expression data recorded on a mobile terminal; An extraction process of analyzing and extracting a face region and a facial expression feature from a face image signal photographed in the above process and storing and making a database; Standby screen and ring signal recording setting method of the mobile terminal, characterized in that it comprises a linking process for searching and selecting each of the plurality of standby screen and the ringing bell recorded on the portable terminal, and records and stores in association with each facial expression. The method of claim 7, wherein the sample process, Determining whether or not to record and store data confirming a user's expression on the mobile terminal; When the user facial expression confirmation data is generated in the above process, the standby screen and the bell signal recording setting of the mobile terminal, characterized in that the photographing process of inputting the face images of each of the sampled joy expressions and sadness expressions and expressionless expressions. Way. The method of claim 7, wherein the extraction process, Extracting a face region by analyzing the input face image signal, and analyzing and extracting features of facial expressions; Standby screen and bell signal recording setting method of the portable terminal, characterized in that the database consisting of the information extracted in the process of the process of recording and storing. The method of claim 9, Extracting a face region from the input face image signal uses color information, principal component analysis, video, neural network, And extracting a facial expression signal from the face region signal using geometric feature extraction and color information. The method of claim 7, wherein the linkage process, Selecting a suitable one for each facial expression by searching a plurality of standby screens and a ringing bell signal recorded in the mobile terminal; Standby screen and ring signal recording method of the mobile terminal, characterized in that consisting of the process of recording and storing the ring signal and the ringing bell signal selected for each facial expression. In the case of inputting the corresponding data for each user's expression in the mobile terminal, the shooting process of taking a face and inputting it as an image signal; A search process of extracting a feature of a face by analyzing a face image signal input in the above process and searching a database to identify similar features; When the similar to the facial feature extracted from the analysis is found, the standby screen and the bell signal output setting method of the mobile terminal, characterized in that the output process for automatically setting the respective standby screen and the ringing bell. The method of claim 12, wherein the photographing process, Determining whether to set a corresponding standby screen and a ringing bell signal according to a user's expression input to the mobile terminal; Standby screen and ring signal output setting method of the mobile terminal, characterized in that the process of taking a picture of the user's face when setting the respective standby screen and the ringing bell signal according to the user's expression. The method of claim 12, wherein the searching process comprises: Extracting a facial region signal by analyzing a face image signal input in the photographing process and extracting a feature of facial expression from the extracted facial region signal; A method of setting a standby screen and a bell signal output of a portable terminal, characterized in that it comprises a process of checking a database unit whether there is a similar feature of the facial expression extracted in the process. The method of claim 14, To extract the face region signal by analyzing the input face image signal, color information method, principal component analysis method, video method, neural network method, The method of setting a standby screen and a bell signal output of the portable terminal, wherein the feature of facial expression is extracted from the extracted facial region signal using geometric feature extraction and color information. The method of claim 12, wherein the output process, Determining whether or not a search has been made by checking a database unit that is similar to a facial feature extracted in the search process; If it is determined in the process and confirmed by the search, the standby screen and the bell signal output setting method comprising the step of outputting the corresponding standby screen and the ringing bell recorded and stored.