WO2013189446A2

WO2013189446A2 - Method and apparatus for displaying terminal screen image based on individual biological features

Info

Publication number: WO2013189446A2
Application number: PCT/CN2013/082476
Authority: WO
Inventors: 刘建松
Original assignee: 中兴通讯股份有限公司
Priority date: 2013-03-15
Filing date: 2013-08-28
Publication date: 2013-12-27
Also published as: CN104049833A; WO2013189446A3

Abstract

Disclosed are a method and apparatus for displaying a terminal screen image based on individual biological features, which relate to multimedia communication technologies. The method comprises: when a user uses a terminal, obtaining feature data of the user by acquiring and analyzing biological data of the user; comparing the feature data with all prestored feature data; and if matching feature data is found, displaying a pre-customized terminal screen image corresponding to the feature data. The present invention acquires biological data of a user by means of an externally arranged video acquisition device and/or audio acquisition device, and automatically recognizes a current operation user using the biological data, thereby automatically presenting to a user personalized customized terminal screen image, which not only improves the safety but also facilitates the user's operation.

Description

Terminal screen image display method and device based on personal biometrics

The present invention relates to multimedia communication technologies, and more particularly to a method for automatically identifying a currently operating user based on personal biometrics and displaying a personalized customized terminal screen image and related devices. Background technique

At present, the presentation interface of the conference TV terminal product, that is, the graphical user interface is single, and no different interfaces are designed for different users, and the same set of graphical interface interfaces are used for display and interaction, including some personal information related to the user. For example, address books, call records, etc., all of the information that is closely related to the user is also uniformly presented and displayed. Then, if a conference TV terminal is used by more than one person at the same time, it will bring certain inconvenience and security risks to different users. Summary of the invention

An object of the embodiments of the present invention is to provide a terminal screen image display method and apparatus based on personal biometrics, so as to at least solve the problem of inconvenient operation and security risks of the terminal.

According to an aspect of the embodiments of the present invention, a method for displaying a terminal screen image based on a personal biometric is provided, including:

When the user uses the terminal, the user's characteristic data is obtained by collecting and analyzing the user's biological data;

Comparing the feature data with all feature data stored in advance;

If the matching feature data is found, a pre-customized terminal screen image corresponding to the feature data is displayed. Preferably, the biometric data comprises face data and/or sound data, and the face data and/or the sound data are acquired by using a video capture device and/or an audio capture device.

Preferably, the face data and/or sound data are analyzed by an image codec module and/or an audio codec module to extract feature data about faces and/or sounds.

Preferably, during the comparison of the feature data with all the feature data stored in advance, if the matching feature data is found, the user information corresponding to the feature data is extracted and loaded to display the terminal screen image customized by the user.

Preferably, if no matching feature data is found, the terminal prompts the user to prompt the user to customize his terminal screen image.

Preferably, the step of the user customizing his terminal screen image comprises:

Collecting biological data of the current end user;

Performing analysis on the biological data, extracting feature data used to characterize the user; and storing the extracted feature data.

Preferably, the step of the user customizing the image of the terminal screen thereof further includes:

Receiving and storing user-customized graphical interface customization information, and binding the graphical interface customization information to the user's feature data, so as to load corresponding graphic interface customization information through the feature data;

The user-customized other information of the user is received and stored, and the other information of the user is bound to the feature data of the user, so that other information of the user is displayed on the customized graphic interface of the user to form a terminal screen image.

Preferably, when the user does not customize the graphical interface customization information, the default graphical interface is displayed. According to another aspect of the embodiments of the present invention, a terminal screen image display apparatus based on a personal biometric is provided, including:

The biometric extraction module is configured to obtain feature data as user identity information by collecting and analyzing the user's biometric data when the user uses the terminal; a biometric comparison module configured to compare the feature data with all feature data stored in advance;

The screen image display module is configured to display a pre-customized terminal screen image corresponding to the feature data when the matching feature data is found.

Preferably, the method further comprises:

The user information storage module is configured to store the feature data of the user, and bind the feature data to the graphical interface customization information for displaying the screen image of the terminal, and other information of the user;

A graphical interface customization module configured to receive customized graphical user interface customization information.

Compared with the prior art, the beneficial effects of the embodiments of the present invention are:

The embodiment of the present invention utilizes personal biometric recognition technology including face recognition and/or voice recognition to store and control user information, and can automatically store and associate user information, which is convenient and easy to use, and has high security, especially in many cases. When users use the same terminal, it brings convenience and practicability, greatly enhances the experience of the terminal, and brings the possibility of personalizing the terminal. DRAWINGS

1 is a flowchart of a method for displaying a screen image of a terminal based on a personal biometric according to an embodiment of the present invention;

2 is a block diagram of a terminal screen image display device based on a personal biometric according to an embodiment of the present invention;

3 is a flowchart of a user setting personal information, customizing a screen image of a terminal, and storing the data provided by an embodiment of the present invention;

FIG. 4 is a flowchart of a user using a terminal according to an embodiment of the present invention. detailed description

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, The preferred embodiments illustrated are for illustrative purposes only and are not intended to limit the invention. 1 is a flowchart of a method for displaying a screen image of a terminal based on a personal biometric according to an embodiment of the present invention. As shown in FIG. 1, the method includes the following steps:

Step 101: The terminal runs for the first time, and displays a system administrator interface, prompting the user to enter feature data for characterizing the user, and the feature data may be feature data about the face or feature data about the voice. It may be other feature data capable of identifying the user's identity; Step 102. Collecting the user's face data through a video capture device such as a camera, and extracting the feature data of the user's vision, or collecting the sound data through an audio collection device such as a microphone, and performing feature extraction. Using the feature data to establish user information and store it in a user information database;

Step 103. The user customizes the image of the terminal screen, including customizing the image interface and setting other information of the user, that is, customizing the personal use interface and the information data, and the content of the customized use interface includes the theme of the graphic interface, such as color, picture, Information such as transparency, display position, etc. The content of the customized information data includes other information of the user, such as an address book or an address book. After the user finishes the customized editing, the system binds the information input by the user with the characteristic data of the user, and stores the information. In the database;

By repeating the above steps 102 and 103, data of a plurality of users can be established in the terminal; Step 104. The terminal enabled recognition system of the user data has been established for face image detection and recognition and/or collection and recognition of sound data, etc. When the terminal is used, the terminal automatically collects biological data input by an input device such as a camera or a microphone, performs feature analysis on the biological data, extracts feature data, and compares the feature data with all feature data stored in the database. If the current feature data is not found in the database, the user is prompted to store no personal information, and the user is reminded to perform personal information storage, and steps 102 and 103 are repeated;

Step 105. Retrieving the matched information in the terminal database, and displaying the terminal screen image of the current user customized information including the graphical interface and the current user's other information, the user other Information includes, but is not limited to, an address book or address book, call history information, terminal configuration information, and the like;

Step 106: The terminal records information set by the current user, including but not limited to information such as an address book or an address book, terminal configuration information, and a call record, and is automatically presented when the user next time uses.

Through the above steps, the terminal must be equipped with at least audio and video information collecting devices such as a camera and a microphone, and these peripherals can be used as personal biometrics collecting devices to automatically recognize the current operating user and automatically present the customized customized terminal screen image. Reduce user operations, very convenient and easy to use.

The above graphical interface is a graphical operation interface provided by the terminal, and receives a user's operation instruction through the remote controller and outputs a response human-computer interaction interface.

The above address book is an address book used in the terminal, and records information such as the address, name, and the like of the called terminal.

The above call record is the terminal information that the terminal has recorded, including the address, name, and the like.

The following uses the scenario of the conference television terminal as an example, and further describes the present invention with reference to FIG. 2 to FIG. 4.

2 is a block diagram of a terminal screen image display device based on a personal biometric according to an embodiment of the present invention. As shown in FIG. 2, the method includes:

The video capture device 10, which is a conference television image acquisition device, generally includes a camera, which is used for collecting facial data in the embodiment of the present invention.

The audio collection device 20, which is a conference television audio collection device, generally includes a microphone, which is used for collecting sound data in the embodiment of the present invention.

Display device 30, typically a television or personal computer display, is configured to output an image of a conference television terminal.

a conference television terminal 40, a conference television main device, which will have a real-time image of a certain conference point, The voice and related data information are collected, compressed, and multiplexed and sent to the transmission channel. At the same time, the received image, voice, and data information are decomposed and decoded, and restored to the image, voice, and data of the opposite site. In the embodiment of the present invention, it is responsible for performing analysis, feature extraction, storage, retrieval, and comparison of the user's personal biometrics. It includes:

The audio codec module 41 is configured to encode, decode, and extract feature data of the collected sound data;

The video codec module 42 is configured to encode, decode, and extract feature data of the collected face data;

The user information storage module 43 is configured to store the feature data of the user, and bind the feature data to the graphical interface customization information for displaying the screen image of the terminal, and other information of the user, that is, the user information storage The module 43 is a module for storing user information, and includes information such as customized graphical interface information, configuration information, an address book, a call record, and the like;

The graphical interface customization module 44 is configured to receive user-customized graphical interface customization information, that is, the graphical interface customization module 44 is a module that provides a personalized graphical interface customization function for the user, and allows the user to freely select a personal favorite display. the way;

The biometric comparison module 45 is configured to compare the feature data with all feature data stored in advance.

Preferably, the video capture device 10, the audio capture device 20, the audio codec module 41, and the video codec module 42 constitute a biometric feature module, which is used to collect and analyze the user's biological data when the user uses the terminal. Characteristic data of user identity information.

Preferably, the display device 30 constitutes a screen image display module, and is configured to display a pre-customized terminal screen image corresponding to the feature data when the matched feature data is found.

The embodiment of the invention provides a novel terminal screen image display mode for improving the user experience, which can improve the ease of use and satisfaction of the user using the terminal.

Application of personalized customization and display process in conference television terminal according to embodiments of the present invention It consists of two main processes: one is the process of establishing user data, including the collection, analysis and storage of feature data, the customization and storage of the graphical interface, and the automatic storage of other information such as configuration information, address book, call record, etc. One is the user use process, including the collection, analysis and comparison process of the feature data. The other information of the user includes the automatic display of the configuration information, the address book, the call record, and the like, and the storage process of the new information, which are respectively described below according to the illustration.

FIG. 3 is a flowchart of a user setting personal information, customizing a screen image of a terminal and storing the data provided by the embodiment of the present invention. As shown in FIG. 3, the steps include:

Step S301: Running a system management function of the conference television terminal, prompting to start to customize the function of the customized terminal;

Step S302: collecting user biometric data, such as face data and sound data, to be entered by using a peripheral device such as a camera or a microphone;

Step S303: The video processing module and the audio processing module of the conference television terminal collect and analyze the entered biometric data, and extract the feature data. If the analysis is successful, step S305 is performed; otherwise, step S304 is performed;

Step S304: prompting the user that the data collection fails, asking whether to perform data collection and analysis again, if yes, executing step S302, otherwise performing step S310;

Step S305: storing the feature data of the user in a user information database of the conference television terminal, for comparison and matching when the user uses;

Step S306: prompting the user whether to perform a personalized graphical interface customization operation. If the customization operation is performed, step S308 is performed, and the user can select how to display the graphical interface of the conference television terminal according to personal preference, otherwise step S307 is performed;

Step S307: If the user does not perform customization temporarily, the user is prompted to display in the default graphical interface, and the customization operation may be performed at any time, and the customization process is exited, and step S310 is performed. Step S308: If the user selects customization, the customization function of the terminal is presented. And interface, customized according to user choice; Step S309: associating the user's graphical interface customization information with the feature data used as the identity information, and automatically associating and storing other user information with the feature data, where the stored information includes but is not limited to terminal configuration information and address. Book, call record, etc.

Step S310: The user data collection is completed, and the customization process ends.

4 is a flowchart of a user using a terminal according to an embodiment of the present invention. As shown in FIG. 4, a typical process when a user uses a conference television terminal after enabling a personalized customized display function is as follows:

Step S401: Enable the personalized customized display function to start the user identification process;

Step S402: The terminal starts collecting biological data such as a face or a sound through a camera or a microphone;

Step S403: input the collected biological data to the conference television terminal;

Step S404: The video codec module or the audio codec module of the conference television terminal analyzes the collected biological data, and extracts the feature data. If the extraction is successful, step S6 is performed, otherwise step S405 is performed;

Step S405: prompting the user that the feature data collection fails, whether to continue the acquisition, if yes, proceed to step S402; otherwise, execute step S413;

Step S406: Compare the extracted feature data with all the feature data stored on the terminal to find whether there is a matching object. If there is no matching object, execute step S407. If there is a matching object, search for the current user's graphical interface. Customizing the information, if the graphical interface customization information of the user is stored, step S409 is performed, if the graphical interface customization information is not stored, step S411 is performed;

Step S407: If the matching feature data is not found, the current user is not stored in the conference television terminal, and the user information is required to be input and stored. If the user selects, the process proceeds to step S408; otherwise, step S413 is performed;

Step S408: Perform user information entry and storage according to the process described in FIG. 3;

Step S409: Acquire and load the graphic interface customization information stored by the current user, and display a Customized graphical interface;

Step S410: Obtain other information about the user related to the current user, including an address book, a call record, and the like, and display it on the graphical interface of the user;

Step S411: Display a system default graphical interface;

Step S412: Automatically record related operations performed by the current user, including configuration information, an address book, a call record, and the like, and automatically associate with the feature data of the current user;

Step S413: The typical process ends.

The embodiment of the invention proposes a new application scenario of the conference television terminal, in particular, the ease of use and security is improved when multiple users simultaneously use the same conference television terminal, if there is no method and system described above, The personal information related to the use of the conference television terminal, such as the address book, the call record, and the like, will be presented, and can be seen by all, which increases the amount of spam and has no security, and solves the two methods by the method proposed by the embodiment of the present invention. Aspects of the problem. That is, the embodiment of the present invention provides a graphical interface interface for automatically presenting different human-computer interactions for different users, and only displays information related to the currently recognized users, including call records, address books, etc., The information about the current user's irrelevant information is automatically blocked, reducing the amount of information that the user needs to pay attention to, improving the ease of operation, and improving the security of the terminal.

Although the invention has been described in detail above, the invention is not limited thereto, and various modifications may be made by those skilled in the art in accordance with the principles of the invention. Therefore, modifications made in accordance with the principles of the present invention should be construed as falling within the scope of the present invention.

Claims

claims

1. A terminal screen image display method based on personal biometric characteristics, including: when the user uses the terminal, the user's characteristic data is obtained by collecting and analyzing the user's biometric data;

Compare the characteristic data with all pre-stored characteristic data;

If matching feature data is found, the pre-customized terminal screen image corresponding to the feature data is displayed.

2. The method according to claim 1, wherein the biological data includes face data and/or voice data, and a video collection device and/or an audio collection device are used to collect the face data and/or voice data.

3. The method according to claim 2, wherein an image codec module and/or an audio codec module are used to analyze the face data and/or voice data, and extract feature data about the face and/or voice. .

4. The method according to claim 3, wherein during the comparison of the feature data with all pre-stored feature data, if matching feature data is found, user information corresponding to the feature data is extracted and loaded to Displays a user-predefined terminal screen image.

5. The method according to any one of claims 1 to 4, wherein if no matching feature data is found, the terminal prompts the user to customize his terminal screen image.

6. The method according to claim 5, wherein the step of the user customizing his terminal screen image includes:

Collect the current end user’s biometric data;

Analyze the biological data and extract characteristic data used to characterize the user's identity; store the extracted characteristic data.

7. The method according to claim 6, wherein the step of the user customizing his terminal screen image further includes: Receive and store the graphical interface customization information customized by the user, and bind the graphical interface customization information to the user's characteristic data, so that the corresponding graphical interface customization information can be loaded through the characteristic data;

Receive and store other user information customized by the user, and bind the other user information with the user's characteristic data, so that the other user information is displayed on the user customized graphical interface to form a terminal screen image.

8. The method according to claim 7, wherein when the user does not customize the graphical interface customization information, a default graphical interface is displayed.

9. A terminal screen image display device based on personal biometric features, including: a biometric feature extraction module configured to obtain feature data as user identity information by collecting and analyzing the user's biometric data when the user uses the terminal;

A biometric comparison module configured to compare the characteristic data with all pre-stored characteristic data;

The screen image display module is configured to display a pre-customized terminal screen image corresponding to the characteristic data when matching characteristic data is found.

10. The device according to claim 7, further comprising:

The user information storage module is configured to store the user's characteristic data, and bind and store the characteristic data with the graphical interface customization information used to display the terminal screen image and other user information;

The graphical interface customization module is configured to receive user-customized graphical interface customization information.