EP2033121A2 - Verfahren und elektronische vorrichtung zum ermöglichen von multimediensuche - Google Patents

Verfahren und elektronische vorrichtung zum ermöglichen von multimediensuche

Info

Publication number
EP2033121A2
EP2033121A2 EP06831655A EP06831655A EP2033121A2 EP 2033121 A2 EP2033121 A2 EP 2033121A2 EP 06831655 A EP06831655 A EP 06831655A EP 06831655 A EP06831655 A EP 06831655A EP 2033121 A2 EP2033121 A2 EP 2033121A2
Authority
EP
European Patent Office
Prior art keywords
search
input
electronic device
search parameter
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP06831655A
Other languages
English (en)
French (fr)
Other versions
EP2033121A4 (de
Inventor
Severi Uusitalo
Samuli Silanto
Antti Aaltonen
Zoran Radivojevic
Teemu Ahmaniemi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Oyj
Original Assignee
Nokia Oyj
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Oyj filed Critical Nokia Oyj
Publication of EP2033121A2 publication Critical patent/EP2033121A2/de
Publication of EP2033121A4 publication Critical patent/EP2033121A4/de
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44Browsing; Visualisation therefor

Definitions

  • Embodiments of the present invention relate to a method and electronic device for enabling searching.
  • they relate to a method and electronic device for enabling searching where a search parameter may be any one of a plurality of different types of media.
  • Search engines which enable a user of an electronic device to search through and retrieve data, are well known in the art.
  • the data searched by such search engines may be personal data stored in the electronic device, for example in a memory of the device, or may be personal data or third party data stored on a computer network such as an intranet or the internet.
  • the data stored may be of a number of different media types and the number of media types is proliferating. As the number of media types increases the process of searching through such data is becoming more important and more time consuming. Therefore it would be desirable to provide an improved multimedia searching mechanism. In particular it would be desirable to provide such a mechanism suitable for use in portable electronics applications.
  • a method of enabling a search using an electronic device comprising; detecting actuation of a user input dedicated to provide access to a graphical user interface; and presenting, in response to the actuation of the dedicated user input, the graphical user interface for enabling a user to input a search parameter where the search parameter may be any one of a plurality of different types of media.
  • the plurality of different types of media include at least two media types from the group of text, audio or pictorial inputs.
  • Embodiments of the invention provide the advantage that, as a user only needs to make a single actuation of the dedicated user input to access the graphical user interface, they enable quick and convenient access to a graphical user interface for multi-media searching.
  • embodiments of the invention also provide the advantage that they allow for a simplified method of enabling a search as a single graphical user interface can accept search parameters of a plurality of different media types.
  • an electronic device operable to enable a search using any one of a plurality of different types of search parameters
  • a display comprising; a display; user input means comprising a dedicated user input for providing access to a graphical user interface; and a processor operable to control the device, in response to the actuation of the dedicated user input to control the display to present the graphical user interface for enabling a user to input a search parameter where the search parameter may be any one of a plurality of different types of media.
  • a computer program comprising program instructions for controlling an electronic device, the electronic device having a display and a user input dedicated to provide access to a graphical user interface, which, when loaded into a processor, provides: means for detecting actuation of the dedicated user input; and means for presenting, Jn response to the actuation of the dedicated user input, a graphical user interface for enabling a user to input a search parameter where the search parameter may be any one of a plurality of different types of media.
  • a graphical user interface for enabling a user to input a search parameter into an electronic device where the search parameter may be any one of a plurality of different types of media.
  • Fig. 1 schematically illustrates an electronic device
  • Fig. 2. is a flow chart illustrating the method steps according to an embodiment of the present invention.
  • Fig. 3. illustrates a graphical user interface according to an embodiment of the present invention.
  • the Figures illustrate a method of enabling a search using an electronic device 1 , the method comprising; detecting 21 actuation of a user input 13 dedicated to provide access to a graphical user interface 41 and presenting 23, in response to the actuation 21 of the dedicated user input 13, the graphical user interface 41 for enabling a user to input a search parameter 43 where the search parameter 43 may be any one of a plurality of different types of media.
  • Fig. 1 schematically illustrates an electronic device 1. Only the features referred to in the following description are illustrated. It should, however, be understood that the device 1 may comprise additional features that are not illustrated.
  • the electronic device 1 may be, for example, a mobile cellular telephone, a personal digital assistant, a computer, a portable digital camera which may also be operable to send and receive SMS/MMS messages or any other electronic device operable to enable a search.
  • the device may be operable to enable a search by carrying out the search itself or by placing an external search request.
  • the illustrated electronic device 1 comprises: a processor 3, a memory 5, a user interface 9 and, in this example, an imaging device 15 and a communication device 17
  • the user interface 9 comprises a display 11 and user input means 12.
  • the user input means 12 may be any means which enable a user to input information into the device 1 including, for example, a keypad, a joystick, voice recognition means or a touch sensitive region of the display 11.
  • the user input means also comprises a dedicated user input 13.
  • the dedicated user input 13 is dedicated for providing access to a graphical user interface for enabling multi-media searching, irrespective of the mode of operation of the device 1.
  • the dedicated user input 13 may be, for example, a key which may be part of a keypad or may be situated separately from the other input means 12 of the device 1.
  • the processor 3 is connected to receive input commands from the user input means 12, including the dedicated user input 13, and to provide output commands to the display 11.
  • the processor 3 is also connected to write to and read from the memory 5.
  • the memory 5 stores computer program instructions 7, which when loaded into the processor 3, enable the processor 3 to control the operation of the device 1 as described below.
  • the computer program instructions 7 provide the logic and routines that enables the electronic device 1 to perform the method illustrated in Fig 2.
  • the computer program instructions 7 may arrive at the electronic device 1 via an electromagnetic carrier signal 8 or be copied from a physical entity 6 such as a computer program product, a memory device or a record medium such as a CD-ROM or DVD.
  • the imaging device 15 may be any device operable to capture images.
  • the imaging device 15 is controlled by the processor 3.
  • the images captured by the imaging device can be stored in the memory 5 and displayed on the display 13.
  • the communication device 17 may be a transceiver which enables the device 1 to communicate within a wireless communications network such as a cellular communications network or a wireless LAN.
  • the communications device 17 may comprise a physical connection, such as a cable, to an external network which enables the device 1 to communicate within the external network.
  • the communications device 17 is controlled by the processor 3.
  • the device 1 may enable a search by controlling the communications device 17 to send a request for a search to an external search engine.
  • the communications device 17 may also be operable to receive the results of the search from the external search engine.
  • Fig 2. schematically illustrates a method of enabling a search using the device 1 according to an embodiment of the invention.
  • the processor 3 detects actuation of the dedicated user input 13 and, in response, controls the device 1 to present 23 a graphical user interface (GUI) 41 for enabling multi-media searching on the display 11.
  • GUI graphical user interface
  • Fig. 3. illustrates an example of a GUI 41 according to an embodiment of the invention.
  • the GUI 41 enables a user to input a search parameter 43 so that a search can be carried out to locate data corresponding to the information content of the search parameter 43.
  • the input search parameter 43 in fig 3 is a text input, however the search parameter may be any one of a plurality of different types of media such as text, audio or pictorial inputs.
  • a user wishes to input a text search parameter they may be able to input the text using the input means 12.
  • the user may be able to input alpha-numeric characters using a keypad.
  • the user may also be able to input a text search parameter using audio input means, for example, the user may be able to speak into the audio input means so that the processor 3 can then recognize the input speech and convert it into a text string.
  • the GUI 41 may comprise a text entry field 45 in which the input text is presented to a user.
  • the user selects or highlights the text entry field 45 before they can input a text search parameter.
  • the text entry field may be automatically activated when the user begins inputting text.
  • the GUI 41 may also enable a user to input audio search parameters. For example, a user may be able to make a musical input by humming or singing a tune, or playing a piece of music into the audio input means. The piece of music may be music which is stored in the memory 5 of the device 1.
  • the audio input means may be activated automatically when the user accesses the GUI 41 or the GUI 41 may include a user selectable option 53 to activate the audio input means.
  • the GUI may also enable a user to input a pictorial search parameter. In one embodiment of the invention a user may input a pictorial search parameter by capturing an image using the imaging device 15 while the GUI 41 is presented.
  • the GUI 41 may include a user selectable option 55 to activate the imaging device 15 and capture an image.
  • the imaging device 15 may be operable to detect wavelengths of light outside the visible spectrum.
  • the processor 3 may be operable to detect searchable patterns from these wavelengths for use as the search parameter 43.
  • the GUI 41 may include an image entry field in which the images captured by the imaging device 15 are presented to a user.
  • the image entry field may also function as a viewfinder of the imaging device 15 to enable a user to view the images before they are captured.
  • the GUI 41 may also enable a user to select an image from images stored in the memory 5 of the device 1 for use as a search parameter 43.
  • the GUI 41 may include a user selectable option 47 to enter and select an image from a database of images.
  • the database of images may include images captured by the imaging device 15 or images which have been received in a message such as an email or MMS message or downloaded from a network such as the internet.
  • the search parameter 43 may be the whole or a part of the image.
  • the user may be able to select which part of the image they wish to use as the search parameter 43, for example they may wish to select a particular object in an image such as a person's face or a building, or a particular colour in the image.
  • the processor 3 detects that a search parameter 43 has been input.
  • the processor 3 may detect a signal from the user input means 12 indicating that a search parameter 43 has been input such as actuation of an enter key or selection of a user selectable option 51 such as 'OK' or 'enter' from the GUI.
  • the processor 3 may detect that no further input has been made within a predetermined time.
  • the processor 3 determines 27 the media type and the information content of the search parameter.
  • the media type of the search parameter 43 is the form of the information content of the search parameter 43, for example, text, audio or pictorial information, or a combination of these.
  • the processor 3 may be operable to automatically determine the media type of the search parameter 43.
  • the processor 3 may be operable to determine the media type of the search parameter 43 by determining which type of input means was used to input the search parameter 43, for example the processor 3 may detect that the imaging device 15 has been used and so determine that the search parameter 43 is a pictorial input.
  • the GUI 41 may comprise a user selectable option 49 to indicate the media type of the search parameter 43.
  • the media type of the search parameter 43 may determine the algorithms that are used to extract the information content from the search parameter and locate the corresponding information.
  • the media type of the search parameter 43 may also determine the databases that are searched.
  • the information content of the search parameter 43 is the data or the patterns in the data of the input search parameter 43.
  • the processor 3 also determines 27 the information content of the search parameter 43. For example, if the input is a text input it will determine the text string that has been input. If the search parameter 43 is a spoken audio input, the processor 3 will convert the spoken words into a text string and then enable the search to be carried out to locate information corresponding to the text string. If the input is an audio input, such as a musical input the processor 3 may extract information from the input, for example, by determining patterns within the tune.
  • the processor 3 may extract content information from the image, for example, by determining patterns within the image.
  • the processor 3 enables a search to be carried out to find information corresponding to the information content of the search parameter 43.
  • the search may be to locate information matching or similar to the information content of the search parameter 43. For example, if the information content is a text string the search may locate documents containing the same text string or a similar text string either in the document or within the title of the document. If the search parameter 43 is an image or a musical input the search may be to locate image or musical files having the same or similar patterns to the search parameter 43.
  • the search may be through information stored externally of the device 1 , for example, information stored in a network such as an intranet or the internet or through information stored internally of the device 1 , for example files and folders stored in the memory 5 of the device 1.
  • the device 1 may also be operable to enable a search for data having specific properties. For example a user may be able to search for documents that were last modified on a particular date by inputting a date as the search parameter 43. Once the search has been completed the processor 3 controls the display 11 to present the results to the user.
  • the results may be, for example, a list of websites or file names which contain information corresponding to the information content of the search parameter. In some embodiments the user may be able to access the websites or files directly from the results list.
EP06831655A 2006-06-23 2006-06-23 Verfahren und elektronische vorrichtung zum ermöglichen von multimediensuche Withdrawn EP2033121A4 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IB2006/003501 WO2008001158A2 (en) 2006-06-23 2006-06-23 A method and electronic device for enabling multimedia searching

Publications (2)

Publication Number Publication Date
EP2033121A2 true EP2033121A2 (de) 2009-03-11
EP2033121A4 EP2033121A4 (de) 2011-08-17

Family

ID=38846015

Family Applications (1)

Application Number Title Priority Date Filing Date
EP06831655A Withdrawn EP2033121A4 (de) 2006-06-23 2006-06-23 Verfahren und elektronische vorrichtung zum ermöglichen von multimediensuche

Country Status (3)

Country Link
EP (1) EP2033121A4 (de)
CN (1) CN101473319A (de)
WO (1) WO2008001158A2 (de)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102929552B (zh) * 2012-10-25 2015-07-08 东莞宇龙通信科技有限公司 终端和信息搜索方法
CN103106234A (zh) * 2012-11-07 2013-05-15 无锡成电科大科技发展有限公司 一种网页内容搜索方法和装置
CN104252508B (zh) * 2013-09-18 2016-06-01 腾讯科技(深圳)有限公司 多媒体文件搜索方法、装置和终端设备
CN103761026B (zh) * 2014-01-13 2017-06-27 联想(北京)有限公司 一种信息处理的方法及电子设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5873080A (en) * 1996-09-20 1999-02-16 International Business Machines Corporation Using multiple search engines to search multimedia data
US20030154483A1 (en) * 2002-01-22 2003-08-14 Benoit Mory Interface device intended to be used with a multi-media content restitution device to perform searches on a multi-media content being restored
US20040267774A1 (en) * 2003-06-30 2004-12-30 Ibm Corporation Multi-modal fusion in content-based retrieval

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003091727A (ja) * 2001-09-17 2003-03-28 Canon Inc 画像処理装置及びその方法、プログラム
US7921091B2 (en) * 2004-12-16 2011-04-05 At&T Intellectual Property Ii, L.P. System and method for providing a natural language interface to a database

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5873080A (en) * 1996-09-20 1999-02-16 International Business Machines Corporation Using multiple search engines to search multimedia data
US20030154483A1 (en) * 2002-01-22 2003-08-14 Benoit Mory Interface device intended to be used with a multi-media content restitution device to perform searches on a multi-media content being restored
US20040267774A1 (en) * 2003-06-30 2004-12-30 Ibm Corporation Multi-modal fusion in content-based retrieval

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2008001158A2 *

Also Published As

Publication number Publication date
WO2008001158A2 (en) 2008-01-03
WO2008001158B1 (en) 2008-12-11
EP2033121A4 (de) 2011-08-17
CN101473319A (zh) 2009-07-01
WO2008001158A3 (en) 2008-10-30

Similar Documents

Publication Publication Date Title
US9013600B2 (en) Filing digital images using voice input
US8375283B2 (en) System, device, method, and computer program product for annotating media files
EP2174482B1 (de) Anordnung, verfahren und computerprogramm zur verwendung von bildern in kontaktlisten in elektronischen geräten
US20090327272A1 (en) Method and System for Searching Multiple Data Types
US20120096354A1 (en) Mobile terminal and control method thereof
US8713079B2 (en) Method, apparatus and computer program product for providing metadata entry
US20110202864A1 (en) Apparatus and methods of receiving and acting on user-entered information
US20070245006A1 (en) Apparatus, method and computer program product to provide ad hoc message recipient lists
US20190172456A1 (en) Method for sharing photograph based on voice recognition, apparatus and system for the same
US9009191B2 (en) Systems and methods for presenting content relevant to text
KR20110000679A (ko) 정보 모델 기반 사용자 인터페이스를 제공하는 방법, 장치 및 컴퓨터 프로그램 제품
US20080075433A1 (en) Locating digital images in a portable electronic device
CN102929552A (zh) 终端和信息搜索方法
CN107463652A (zh) 外接存储设备的连接控制方法及装置
KR20080083290A (ko) 디지털 파일의 컬렉션에서 디지털 파일을 액세스하기 위한방법 및 장치
EP2033121A2 (de) Verfahren und elektronische vorrichtung zum ermöglichen von multimediensuche
KR101520896B1 (ko) 휴대용 단말기의 데이터 관리 장치 및 방법
CA2726391C (en) Filing digital images using voice input
KR101248165B1 (ko) 휴대전화 및 그 데이터 검색방법
CN112817511B (zh) 文本指纹的处理方法及装置、电子设备、存储介质
EP2851891A1 (de) Mobiles Benutzerendgerät und Steuerverfahren eines solchen Endgeräts
CN104660819B (zh) 移动设备以及访问移动设备中文件的方法
KR20140086853A (ko) 음성 데이터 분석을 통한 화자기반 콘텐츠 관리 장치 및 방법
KR20090025347A (ko) 멀티미디어 탐색을 가능하게 하는 방법 및 전자 기기
CN110502484A (zh) 在移动终端显示文件信息的方法、装置及介质

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20081204

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK RS

DAX Request for extension of the european patent (deleted)
RBV Designated contracting states (corrected)

Designated state(s): DE FI FR GB

A4 Supplementary search report drawn up and despatched

Effective date: 20110714

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 17/30 20060101AFI20110708BHEP

17Q First examination report despatched

Effective date: 20110722

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20111202