WO2013189317A1 - Procédé d'interaction multimédia basé sur des informations du visage humain, dispositif et terminal associés - Google Patents

Procédé d'interaction multimédia basé sur des informations du visage humain, dispositif et terminal associés Download PDF

Info

Publication number
WO2013189317A1
WO2013189317A1 PCT/CN2013/080766 CN2013080766W WO2013189317A1 WO 2013189317 A1 WO2013189317 A1 WO 2013189317A1 CN 2013080766 W CN2013080766 W CN 2013080766W WO 2013189317 A1 WO2013189317 A1 WO 2013189317A1
Authority
WO
WIPO (PCT)
Prior art keywords
biometric information
contact
information
terminal
matching
Prior art date
Application number
PCT/CN2013/080766
Other languages
English (en)
Chinese (zh)
Inventor
金骏
孙奥
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2013189317A1 publication Critical patent/WO2013189317A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to a multimedia interaction method and apparatus based on face information and a terminal. Background technique
  • Human-Computer Interaction Techniques are technologies that enable people to talk to computers in an efficient manner through computer input and output devices.
  • Human-computer interaction technology emerged with the advent of computers. From the initial manual operation stage to the human-computer interaction technology represented by virtual reality technology, human-computer interaction technology has experienced many stages. The history of human-computer interaction has shown that it is gradually moving from a computer-centric complex interaction to a simple, natural interaction with people. The current multimedia-based, multi-channel human-computer interaction technology has achieved a lot of research results, such as text recognition, gesture recognition, speech recognition, speech synthesis and many other research results and products.
  • the disadvantages of the above methods include: The interaction process is unfriendly, and the manual operation in the initial stage of human-computer interaction development is basically the same, and the efficiency is low. When the time is long, the information of the characters on the multimedia data cannot be recalled, and further interaction will be failure. Summary of the invention
  • the embodiments of the present invention are directed to a multimedia interaction method and device based on face information, and a terminal, which are used to solve the problem of unfriendly human interaction in the prior art and low efficiency in the interaction process.
  • the problem of interaction failure is a multimedia interaction method and device based on face information, and a terminal, which are used to solve the problem of unfriendly human interaction in the prior art and low efficiency in the interaction process. The problem of interaction failure.
  • a multimedia interaction method based on biometric information comprising:
  • the biometric information is extracted in the current multimedia material, and the extracted biometric information is matched with the previously stored biometric information. If the matching is determined to be successful, the contact information of the contact corresponding to the biometric information is called to interact.
  • the biometric information is further matched to the network social media related to the end user or the terminal is directly requested to perform storage processing.
  • the network social media related to the end user is accessed, and the extracted biometric information is further matched with the biometric information of the contact stored in the social media, and if it is determined that the further matching is successful, the call is made.
  • the contact information of the contact corresponding to the biometric information is exchanged; if the further matching fails, the terminal is requested to perform an edit storage process.
  • the step of the requesting terminal performing the edit storage process includes:
  • the contact information is modified as needed.
  • the current multimedia material is multimedia material existing in the terminal, or is a multimedia material captured by the terminal in real time.
  • the biometric information is face information.
  • a multimedia interaction device based on biometric information comprising:
  • the associated storage module is configured to associate and store the biometric information of the contact with the contact information of the contact in the terminal;
  • Matching the interaction module extracting the biometric information in the current multimedia material, and matching the extracted biometric information with the previously stored biometric information, and if it is determined that the matching is successful, calling the contact corresponding to the biometric information Contact information to interact.
  • the matching interaction module is further configured to: if the matching fails, further matching the biometric information to the network social media related to the end user or requesting the associated storage module to perform editing storage processing.
  • a terminal comprising at least the biometric information based multimedia interaction device of claim 8 or 9.
  • the embodiment of the invention further excavates the information in the image, and the method is simple, effective, friendly, and efficient compared with the previous interaction mode, thereby greatly improving the friendliness of the system.
  • FIG. 1 is a schematic flow chart of a first method embodiment of the present invention
  • FIG. 2 is a schematic flow chart of a second method embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of an apparatus according to an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of a terminal according to an embodiment of the present invention. detailed description
  • FIG. 1 is a schematic flowchart of a first method embodiment of the present invention, which may specifically include:
  • Step 101 Associate the biometric information of the contact with the contact information of the contact in the terminal, and store the data after the association, where the storage location may be the terminal local or the server;
  • Step 102 Extract biometric information in the current multimedia material, and match the extracted biometric information with the previously stored biometric information, and if it is determined that the matching is successful, call the contact information of the contact corresponding to the biometric information. Interact.
  • the first method embodiment of the present invention automatically detects the biometric information in the multimedia data, and extracts the identified biometric information to match the previously stored biometric information, thereby calling up the contact information of the corresponding contact. Automatically interact with multimedia materials.
  • FIG. 2 is a schematic flowchart of a second method embodiment of the present invention, which may specifically include the following steps:
  • Step 200 Collect biometric information of the contact; the collection manner may be multiple, for example, may be collected by the terminal in real time, or may be downloaded to the terminal through a computer or a network; Step 201: Associate the biometric information of the contact with the contact information of the contact in the terminal, and the storage location may be the terminal local or the server; specifically, the user collects through the collection device or the Internet or the computer.
  • the biometric information of the contact obtained by importing and the like is associated with the contact information of the contact, and the contact information may be edited and modified according to the actual situation, for example, adding new contact information or modifying the existing contact information, etc.
  • the contact information includes: one or more of the contact name, the title, the unit, the phone number, the email address, the QQ number, the Kaixin account, and the like; when the user associates, the terminal may be based on the terminal
  • the original contact information function software associates the biometric information of the contact with the corresponding phone number in the address book software; or establishes a total contact information database, and associates the biometric information of the contact with all or Part of the contact information Line association; wherein, the user can establish a contact information database by using various methods, including: (1) The user can establish a database according to the currently owned, already marked multimedia data set at a certain time; (2) adopting The method of function 1 incrementally establishes the database; (3) the user marks the personal information while browsing the data, and updates the marked data to the database in real time; if, if desired, with the person on the multimedia material The interaction triggers the terminal to extract the biometric information of the contact in the current multimedia material, and searches and matches the extracted biometric information with the previously
  • Step 203 determining whether the matching is successful, if yes, performing step 204; otherwise, performing the step
  • Step 204 Display the matching result, that is, the contact information of the contact, in an interactive manner on the user interface, for example, prompting the terminal user to send a message to the person, or sending an email to the person;
  • Step 205 Determine whether the terminal user needs to modify the contact information of the contact, if not modified, go to step 206, otherwise go to step 209;
  • Step 206 The user operates according to the prompt, and enters a corresponding software function module, such as a short message processing software module;
  • Step 207 when the biometric information of the contact is not matched to the contact information corresponding to the contact, the user may further search for the social media related to the end user after being authorized by the user. , further matching the biometric information in the social media according to the biometric information of the contact;
  • the terminal may be directly requested to perform storage, that is, step 209 is performed;
  • Step 208 Determine whether the further matching is successful, if yes, go to step 204; otherwise, go to step 209;
  • Step 209 The terminal is requested to perform storage; specifically, the user is asked whether to store the biometric information of the contact and associate with the corresponding contact information. If yes, the requesting terminal stores the biometric information and the currently known contact information. And associating the biometric information with the contact information; if the contact information corresponding to the biometric information is not currently known, the biometric information may be selected to be stored as a reserve for later editing and use;
  • Step 210 The user performs the multimedia material reading offline after completing the recording. If there is still the next biometric information to be matched, the process proceeds to step 200, and the above process is repeatedly performed.
  • the face information is taken as an example, and the use process includes but is not limited to these scenarios.
  • User A uses the terminal to browse the local picture.
  • the user may want to interact with the person in the photo.
  • the face detection algorithm is used to detect the face of the image, and then the detected face is identified and matched based on the detection.
  • the sample library user A for face recognition can be authorized and configured.
  • the user A authorization program can access the local contact database.
  • the program matches the avatar information in the local contact of the user according to the detected face information, and performs recognition of the character in the current image. If the recognition is successful, a prompt box will pop up on the current image browsing interface, giving the user A some options that can be operated, such as calling a person in the photo, or sending a message to the person in the short message.
  • search fails, there will be corresponding prompts on the interface, such as whether to complete the contact information, or further request the user's authorization to determine whether the search scope can be expanded.
  • prompts on the interface such as whether to complete the contact information, or further request the user's authorization to determine whether the search scope can be expanded.
  • user A can authorize the program to access the homepage of the website.
  • the character recognition is further performed in the picture of the user's buddy list and the avatar information. If the identification is successful, the interface may be prompted whether to further interact with the task, for example, displaying the status update of the task for a recent period of time.
  • the currently acquired images can be analyzed in real time. Similar to the previous usage scenario, the face is first detected and the detected face information is identified. If the identification fails, the user is prompted to manually mark the multimedia information material so as to conveniently interact with the multimedia material in the future.
  • the user information marked by the user is stored as a sample of the local person sample, which is also a library of image retrieval samples that are defaulted by the user when performing image interaction in the future.
  • FIG. 3 is a schematic structural diagram of an apparatus according to an embodiment of the present invention, which may include: an associated storage module and a matching interaction module, where
  • the associated storage module is mainly responsible for pre-associating and storing the biometric information of the contact with the contact information of the contact in the terminal, and the storage location may be the terminal local or the server;
  • the matching interaction module is mainly responsible for extracting the current multimedia data. Biometric information, and Matching the extracted biometric information with the previously stored biometric information, and if it is determined that the matching is successful, calling out the contact information of the contact corresponding to the biometric information to interact; if the matching fails, the biometric information is Further matching with the network social media related to the end user or requesting the associated storage module to perform editing storage processing.
  • FIG. 4 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
  • the terminal includes at least the foregoing apparatus according to the embodiment of the present invention, where the apparatus includes: an associated storage module and a matching interaction module, where
  • the associated storage module is mainly responsible for pre-associating and storing the biometric information of the contact with the contact information of the contact in the terminal, and the storage location may be the terminal local or the server;
  • the matching interaction module is mainly responsible for extracting the current multimedia data. Biometric information, and the extracted biometric information is matched with the previously stored biometric information. If it is determined that the matching is successful, the contact information of the contact corresponding to the biometric information is called to interact; if the matching fails, then The biometric information is further matched to the network social media related to the end user or the associated storage module is requested to perform an edit storage process.
  • the embodiment of the present invention provides a multimedia interaction method and device based on face information, and a terminal. Compared with the prior art, the embodiment of the present invention further mines information in an image, and some need manual intervention. The things are handled automatically, and the user only needs to make a selection based on the output information of the system. Compared with the previous interaction mode, this method is simple, effective, friendly, and efficient, which greatly enhances the friendliness of the system.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne un procédé d'interaction multimédia basé sur des informations relatives à une caractéristique biologique, ainsi qu'un dispositif et un terminal associé. Ce procédé consiste à : associer, au préalable, des informations sur une caractéristique biologique d'une personne de contact à des informations de contact sur la personne de contact dans un terminal et à les stocker en mémoire ; extraire les informations sur la caractéristique biologique à partir de données multimédia actuelles, et mettre en correspondance les informations sur la caractéristique biologique extraites et les informations sur la caractéristique biologique précédemment stockées en mémoire ; et s'il est déterminé que la mise en correspondance est réussie, récupérer les informations de contact sur la personne de contact correspondant aux informations sur la caractéristique biologique en vue d'une interaction. Par rapport au mode d'interaction connu, le mode d'interaction de la présente invention est simple et efficace, l'interface est conviviale, et l'efficacité est élevée, ce qui permet d'accroître considérablement la convivialité du système.
PCT/CN2013/080766 2012-12-28 2013-08-02 Procédé d'interaction multimédia basé sur des informations du visage humain, dispositif et terminal associés WO2013189317A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210583452.8 2012-12-28
CN2012105834528A CN103076879A (zh) 2012-12-28 2012-12-28 基于人脸信息的多媒体交互方法及装置及终端

Publications (1)

Publication Number Publication Date
WO2013189317A1 true WO2013189317A1 (fr) 2013-12-27

Family

ID=48153437

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/080766 WO2013189317A1 (fr) 2012-12-28 2013-08-02 Procédé d'interaction multimédia basé sur des informations du visage humain, dispositif et terminal associés

Country Status (2)

Country Link
CN (1) CN103076879A (fr)
WO (1) WO2013189317A1 (fr)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103076879A (zh) * 2012-12-28 2013-05-01 中兴通讯股份有限公司 基于人脸信息的多媒体交互方法及装置及终端
CN104185140A (zh) * 2013-05-23 2014-12-03 深圳中兴网信科技有限公司 一种视频智能楼宇服务器、终端、系统及访问方法
CN103414815B (zh) * 2013-07-15 2017-04-05 魅族科技（中国）有限公司 联系人信息的显示方法和终端
CN104346159A (zh) * 2013-08-09 2015-02-11 联想(北京)有限公司 信息处理的方法及电子设备
CN104901994B (zh) 2014-10-22 2018-05-25 腾讯科技（深圳）有限公司 网络系统中用户的属性数值转移方法、装置及系统
CN105320407A (zh) * 2015-11-12 2016-02-10 上海斐讯数据通信技术有限公司 一种获取照片人物社交动态的方法及装置
CN107194817B (zh) * 2017-03-29 2023-06-23 腾讯科技（深圳）有限公司 用户社交信息的展示方法、装置和计算机设备
CN109002447A (zh) * 2017-06-07 2018-12-14 中兴通讯股份有限公司 一种信息采集整理方法及装置
CN109427017A (zh) * 2017-08-24 2019-03-05 中兴通讯股份有限公司 一种提示方法及装置
CN110555171B (zh) * 2018-03-29 2024-04-30 腾讯科技（深圳）有限公司 一种信息处理方法、装置、存储介质及系统
CN110661898A (zh) * 2018-06-29 2020-01-07 阿里巴巴集团控股有限公司 一种实现应用程序处理的方法及装置
CN112235181A (zh) * 2020-08-29 2021-01-15 上海量明科技发展有限公司 弱社交方法、客户端及系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070140532A1 (en) * 2005-12-20 2007-06-21 Goffin Glen P Method and apparatus for providing user profiling based on facial recognition
CN101641948A (zh) * 2007-03-29 2010-02-03 索尼爱立信移动通讯有限公司 具有集成照片管理系统的移动设备
CN102667763A (zh) * 2009-08-07 2012-09-12 谷歌公司 带有社交网络辅助的面部识别
CN103076879A (zh) * 2012-12-28 2013-05-01 中兴通讯股份有限公司 基于人脸信息的多媒体交互方法及装置及终端

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100677421B1 (ko) * 2004-12-30 2007-02-02 엘지전자 주식회사 휴대단말기에서의 참조필드 이용방법
CN100580691C (zh) * 2007-03-16 2010-01-13 上海博康智能信息技术有限公司 综合利用人脸及人体辅助信息的交互式人脸识别系统及方法
CN101576810B (zh) * 2008-05-09 2011-01-12 杭州中正生物认证技术有限公司 利用生物识别技术实现文件安全打印的方法及系统
CN101741973A (zh) * 2009-12-07 2010-06-16 深圳华为通信技术有限公司 显示相关信息的方法及移动通信终端
US20110316666A1 (en) * 2010-06-25 2011-12-29 Kabushiki Kaisha Toshiba Information device, computer program product and method thereof
CN102521619A (zh) * 2011-11-22 2012-06-27 汉王科技股份有限公司 基于人脸识别的信息呈现方法及装置和人脸识别打印系统
CN102523213B (zh) * 2011-12-13 2014-09-17 华为终端有限公司 服务器、终端鉴权方法以及服务器、终端

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070140532A1 (en) * 2005-12-20 2007-06-21 Goffin Glen P Method and apparatus for providing user profiling based on facial recognition
CN101641948A (zh) * 2007-03-29 2010-02-03 索尼爱立信移动通讯有限公司 具有集成照片管理系统的移动设备
CN102667763A (zh) * 2009-08-07 2012-09-12 谷歌公司 带有社交网络辅助的面部识别
CN103076879A (zh) * 2012-12-28 2013-05-01 中兴通讯股份有限公司 基于人脸信息的多媒体交互方法及装置及终端

Also Published As

Publication number Publication date
CN103076879A (zh) 2013-05-01

Similar Documents

Publication Publication Date Title
WO2013189317A1 (fr) Procédé d'interaction multimédia basé sur des informations du visage humain, dispositif et terminal associés
US9058375B2 (en) Systems and methods for adding descriptive metadata to digital content
US9304657B2 (en) Audio tagging
US9521175B2 (en) Media tagging
US8649776B2 (en) Systems and methods to provide personal information assistance
CN106971009B (zh) 语音数据库生成方法及装置、存储介质、电子设备
US20090327272A1 (en) Method and System for Searching Multiple Data Types
TW201540115A (zh) 通訊事件歷史
EP2599016A1 (fr) Partage de supports automatique par le biais d'un clic d'obturateur
US20110148857A1 (en) Finding and sharing of digital images based on shared face models
JP2013524348A5 (fr)
CN110602516A (zh) 基于视频直播的信息交互方法、装置及电子设备
US20130332804A1 (en) Methods and devices for data entry
CN101297292A (zh) 用于向电子日记本加入内容或从中获取内容的方法和系统
JP2019053566A (ja) 表示制御装置、表示制御方法及びプログラム
KR102252964B1 (ko) 온라인 커뮤니케이션의 리뷰 시스템, 방법 및 컴퓨터 프로그램
TW201539210A (zh) 個人資訊管理服務系統
WO2014101416A1 (fr) Procédé et appareil d'affichage de fichier
CN105354284A (zh) 模板的处理方法及装置、短信识别方法及装置
TWI528186B (zh) 經由音訊發布訊息的系統及方法
WO2015101074A1 (fr) Procédé, système, équipement et dispositif d'identification d'image basée sur une image
CN106558311B (zh) 语音内容提示方法和装置
JP2017021672A (ja) 検索装置
JP2020009011A (ja) フォトブック作製システム及びサーバ装置
JP2015207258A (ja) 情報出力装置、情報出力方法及びプログラム、情報提供装置、情報提供方法及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13806924

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13806924

Country of ref document: EP

Kind code of ref document: A1