CN104881471A - Information processing method and terminal equipment - Google Patents

Information processing method and terminal equipment Download PDF

Info

Publication number
CN104881471A
CN104881471A CN201510283697.2A CN201510283697A CN104881471A CN 104881471 A CN104881471 A CN 104881471A CN 201510283697 A CN201510283697 A CN 201510283697A CN 104881471 A CN104881471 A CN 104881471A
Authority
CN
China
Prior art keywords
information
time management
audio
application
multimedia messages
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510283697.2A
Other languages
Chinese (zh)
Inventor
陈小翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Priority to CN201510283697.2A priority Critical patent/CN104881471A/en
Publication of CN104881471A publication Critical patent/CN104881471A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43Querying
    • G06F16/432Query formulation
    • G06F16/433Query formulation using audio data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43Querying
    • G06F16/432Query formulation
    • G06F16/434Query formulation using image data, e.g. images, photos, pictures taken by a user

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention discloses an information processing method and terminal equipment. The method comprises the following steps: acquiring multimedia information; performing feature extraction on the multimedia information to obtain at least one feature parameter corresponding to the multimedia information; determining target information based on the at least one feature parameter; determining and opening a corresponding application based on the target information.

Description

A kind of information processing method and terminal device
Technical field
The present invention relates to the terminal management technology in the communications field, particularly relate to a kind of information processing method and terminal device.
Background technology
At present, along with science and technology more and more progress, terminal device, especially intelligent terminal, can provide increasing application for user.But user being usually to need the administration interface first entering application carrying out choosing of each application, then from the administration interface of application, choosing required intended application, so, making the operation of user comparatively complicated, reduce the operating efficiency of user.
Summary of the invention
In view of this, fundamental purpose of the present invention is to propose a kind of information processing method and terminal device, at least can solve the above-mentioned problems in the prior art.
Embodiments provide a kind of information processing method, described method comprises:
Collect multimedia messages;
Feature extraction is carried out to described multimedia messages, obtains at least one characteristic parameter that described multimedia messages is corresponding;
Based at least one characteristic parameter described, determine target information;
Based on described target information, determine and open corresponding application.
Embodiments provide a kind of terminal device, comprising:
Collecting unit, for collecting multimedia messages;
Feature extraction unit, for carrying out feature extraction to described multimedia messages, obtains at least one characteristic parameter that described multimedia messages is corresponding;
Processing unit, for based at least one characteristic parameter described, determines target information; Based on described target information, determine and open corresponding application.
Adopt information processing method provided by the invention and terminal device, at least one characteristic parameter of the multimedia messages that can collect, determines target information, and then based target information is determined and opened relevant application.So, just can just determine by means of only gathering multimedia messages the related application that will open, decrease in prior art and need first to activate application management interface, then from application management interface, repeatedly page turning finds the complex operations of the application that will open, improve the operating efficiency of user, and improve the experience of user.
Accompanying drawing explanation
Fig. 1 is the hardware configuration schematic diagram of the terminal device realizing each embodiment of the present invention;
Fig. 2 is the wireless communication system schematic diagram of terminal device as shown in Figure 1;
Fig. 3 is embodiment of the present invention information processing method schematic flow sheet one;
Fig. 4 is embodiment of the present invention information processing method schematic flow sheet two;
Fig. 5 is embodiment of the present invention example one;
Fig. 6 is embodiment of the present invention example two;
Fig. 7 is embodiment of the present invention example three;
Fig. 8 is embodiment of the present invention example four;
Fig. 9 is embodiment of the present invention example five;
Figure 10 is the invention process information processing method schematic flow sheet two;
Figure 11 is embodiment of the present invention terminal device composition structural representation.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further with reference to accompanying drawing.
Embodiment
Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
Terminal device can be implemented in a variety of manners.Such as, the terminal described in the present invention can comprise the such as terminal device of mobile phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP (portable media player), guider etc. and the fixed terminal of such as digital TV, desk-top computer etc.Below, suppose that terminal is terminal device.But it will be appreciated by those skilled in the art that except the element except being used in particular for mobile object, structure according to the embodiment of the present invention also can be applied to the terminal of fixed type.Fig. 1 is the hardware configuration signal of the terminal device realizing each embodiment of the present invention.Terminal device 100 can comprise wireless communication unit 110, A/V (audio/video) input block 120, user input unit 130, sensing cell 140, output unit 150, storer 160, interface unit 170, controller 180 and power supply unit 190 etc.Fig. 1 shows the terminal device with various assembly, it should be understood that, does not require to implement all assemblies illustrated.Can alternatively implement more or less assembly.Various embodiment described herein can to use such as computer software, the computer-readable medium of hardware or its any combination implements.For hardware implementation, embodiment described herein can by using application-specific IC (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), processor, controller, microcontroller, microprocessor, being designed at least one performed in the electronic unit of function described herein and implementing, in some cases, such embodiment can be implemented in controller 180.For implement software, software code can be implemented by the software application (or program) write with any suitable programming language, and software code can be stored in storer 160 and to be performed by controller 180.
Describe wherein according to the communication system that terminal device of the present invention can operate with reference to figure 2.Such communication system can use different air interfaces and/or Physical layer.Such as, the air interface used by communication system comprises such as frequency division multiple access (FDMA), time division multiple access (TDMA) (TDMA), CDMA (CDMA) and universal mobile telecommunications system (UMTS) (especially, Long Term Evolution (LTE)), global system for mobile communications (GSM) etc.As non-limiting example, description below relates to cdma communication system, but such instruction is equally applicable to the system of other type.With reference to figure 2, cdma wireless communication system can comprise multiple terminal device 100, multiple base station (BS) 270, base station controller (BSC) 275 and mobile switching centre (MSC) 280.MSC280 is constructed to form interface with Public Switched Telephony Network (PSTN) 290.MSC280 is also constructed to form interface with the BSC275 that can be couple to base station 270 via back haul link.Back haul link can construct according to any one in some interfaces that oneself knows, described interface comprises such as E1/T1, ATM, IP, PPP, frame relay, HDSL, ADSL or xDSL.Will be appreciated that system as shown in Figure 2 can comprise multiple BSC2750.
Based on above-mentioned terminal device hardware structure and communication system, each embodiment of the inventive method is proposed.
Embodiment one,
Embodiments provide a kind of information processing method, as shown in Figure 3, described method comprises:
Step 301: collect multimedia messages;
Step 302: carry out feature extraction to described multimedia messages, obtains at least one characteristic parameter that described multimedia messages is corresponding;
Step 303: based at least one characteristic parameter described, determine target information;
Step 304: based on described target information, determines and opens corresponding application.
Here, the present embodiment can be applied to terminal device, such as, can be the equipment such as smart mobile phone, panel computer.
Described multimedia messages can be pictorial information or can be audio-frequency information.
Describedly feature extraction is carried out to multimedia messages can be: image characteristics extraction being carried out to pictorial information, such as can carry out feature extraction for using feature vector method;
Or, for carry out audio feature extraction to audio-frequency information, can be able to comprise: first multimedia messages and audio-frequency information are divided into multiple audio data frame; A stack features is calculated for each audio data frame; Then the feature calculated is assembled into proper vector; The proper vector obtained is carried out the calculating such as principal component analysis (PCA), the proper vector after obtaining analyzing; Quantification is carried out to the proper vector after analysis and obtains audio-frequency fingerprint information.Wherein, described calculating can calculate for utilizing the mode such as Fast Fourier Transform (FFT) coefficient, plum and the general coefficient of rate of pausing, spectrum flatness.
At least one characteristic parameter described in the present embodiment can be: at least one characteristic parameter in image information, or the audio fingerprint feature information that can be in audio-frequency information, at least one section audio information is corresponding.
Preferably, described target information can match with at least one characteristic information, and can include the relevant information of at least one application in described target information, such as, can include the identification information of application, the link information etc. of application; Described target information can for the information extracted from the information bank preset.
Described based target information is determined and is opened corresponding application: when the relevant information of the application that described target information comprises, determine to open this application; When including the relevant information of two and above application in described target information, then showing the relevant information of these two and above application, being selected according to the relevant information of display by user, open the application that user selects.
Can preset multiple relevant informations corresponding to a target information in information bank, target information can be an application, and relevant information can be the shopping address etc. of the product of the link of this application or the download address of application or application correspondence.Such as, the audio file collected is QQ letter sound, and so target information can be just QQ, and relevant information can be the download address of QQ, or can be the peripheral product etc. of QQ.
Preferably, the trigger condition of step 301 is performed in the present embodiment, Ke Yiwei: judge whether to detect the operation meeting first condition, wherein, described first condition can carry out rocking operation for terminal device by characterizing consumer, if so, then determines to start to perform step 301.Like this, just can enter the operation gathering multimedia messages fast, thus quickening is determined and is opened the operating speed of corresponding application.
Visible, by adopting such scheme, according at least one characteristic parameter of the multimedia messages collected, determine target information, then based target information is determined and is opened relevant application.So, just can just determine by means of only gathering multimedia messages the related application that will open, decrease in prior art and need first to activate application management interface, then from application management interface, repeatedly page turning finds the complex operations of the application that will open, improve the operating efficiency of user, and improve the experience of user.
Embodiment two,
Embodiments provide a kind of information processing method, as shown in Figure 4, described method comprises:
Step 401: collect multimedia messages; Described multimedia messages is pictorial information;
Step 402: carry out feature extraction to described multimedia messages, obtains at least one characteristic parameter that described multimedia messages is corresponding;
Step 403: based on extracting at least one characteristic parameter obtained in described pictorial information, chooses the image information or Word message of mating with at least one characteristic parameter described from the time management Image Database preset; Wherein, in described time management Image Database, include the related information of at least one time management application, and the image information corresponding with the related information that each described time management is applied or Word message;
Step 404: from described time management Image Database, determines that the very first time corresponding with described image information or Word message manages the related information applied; Based on the related information of described very first time management application, determine and open the management application of the described very first time.
Here, the present embodiment can be applied to terminal device, such as, can be the equipment such as smart mobile phone, panel computer.
Describedly feature extraction is carried out to multimedia messages can be: image characteristics extraction being carried out to pictorial information, such as can carry out feature extraction for using feature vector method.
Preferably, the trigger condition of step 401 is performed in the present embodiment, Ke Yiwei: judge whether to detect the operation meeting first condition, wherein, described first condition can carry out rocking operation for terminal device by characterizing consumer, if so, then determines to start to perform step 401.Like this, just can enter the operation gathering multimedia messages fast, thus quickening is determined and is opened the operating speed of corresponding application.
Preferably, the application of time management described in the present embodiment can comprise multiple, carries out example below illustrate for the present embodiment composition graphs 5:
The first step: equipment receives rocking action; Open camera function; And with equipment, surrounding environment is taken pictures; Equipment can judge whether photo array function is opened; If do not opened; Then rest on the page of taking pictures, if open, then can identify clapped content;
Second step: the content that content and the equipment of photo array are arranged is mated; Look at whether coincide;
If misfitted, then by entering high in the clouds, can be identified by the data in high in the clouds; Then can judge whether network, if there is no network, then can rest on the page of taking pictures, if there is network, can to take a picture and mate, if coupling, then can enter corresponding time management function; If do not mated, then remain on the page of taking pictures;
If coincide, then can enter the time management function that clapped content is corresponding; There is following several situation:
Situation one, alarm clock: a, take the landscape relevant to alarm clock or word; Then identify; B: then phase picture that opportunity identification is clapped whether with bed: double bed, single bed, lunch break bed, two-layer bed; The picture relevant Deng bed or word and alarm clock, clock, wrist-watch, wearable device; Clock icon is correlated with; Deng the picture relevant with alarm clock or word; C: identify the page arriving alarm clock successfully; If do not identify successfully; The request of identification then can be sent to high in the clouds; Identification range expands further;
Situation two, zebra time: a: take the landscape relevant to zebra time or word; Then identify; B: then phase picture that opportunity identification is clapped whether with country map, national flag, national emblem, country manager personage; Country manager flower, National Animal, national purpose-built; World clock clock and watch figure; Aircraft; The pictures relevant with zebra time such as earth figure or word; C: identify the page arriving zebra time successfully; If do not identify successfully; The request of identification then can be sent to high in the clouds; Identification range expands further;
Situation three, timer: a: take the landscape relevant to timer or word; Then identify; B: then phase picture that opportunity identification is clapped whether with gymnasium, runway, racing track, timer device; Table tennis, shuttlecock, gym suit, swimming, sporting equipment picture, sportsman's photo, the picture relevant with timer or the words such as timing rifle; C: identify the page arriving timer successfully; If do not identify successfully; The request of identification then can be sent to high in the clouds; Identification range expands further;
Situation four, countdown: a: take the landscape relevant to countdown or word; Then identify; B: then phase picture that opportunity identification is clapped whether with pot, bowl, electromagnetic oven, electric cooker, equipment of cooking, cooks equipment, soup clay pot; To heat up water equipment; To make coffee equipment; Or the picture that equipment of chemical industry etc. are relevant with countdown or word; C: identify the page arriving countdown successfully; If do not identify successfully; The request of identification then can be sent to high in the clouds; Identification range expands further;
3rd step: terminate
In addition, the mode about image information corresponding to alarm clock in rise time managing image information bank can as shown in Figure 6, comprise:
The first step: enter alarm clock application;
Second step: open the material database management identifying application;
3rd step: select uploading pictures or upload word;
1: uploading pictures: bed: double bed, single bed, lunch break bed, two-layer bed; In the picture that bed is relevant; User thinks that the picture that it doesn't matter is good; Clock: alarm clock, clock, wrist-watch, wearable device; Clock icon is correlated with; In the picture relevant with clock; Or user thinks that the picture that it doesn't matter is good; Need to compress to the picture uploaded; When ensureing picture quality, file is not more than 100K; But user can the relevant data limited of oneself setting
2: upload word: bed (double bed, single bed, lunch break bed, two-layer bed; Deng the word content that bed is relevant; Or user thinks that the word that it doesn't matter is good); Clock (alarm clock, clock, wrist-watch, wearable device; Clock icon is correlated with; Word Deng relevant with clock); Need to carry out number of words restriction to the word uploaded; Not unnecessary 40 bytes of word; But user can the relevant data limited of oneself setting
4th step: detect whether have afoul similar picture or word with other classifications; If had equally, then upload failure; If different, then can upload to local data, or upload to high in the clouds; If upload to high in the clouds, also need to detect whether have data network, if do not had, then upload unsuccessful, if had, then can upload
5th step: time management Image Database is uploaded successfully
6th step: terminate.
Can as shown in Figure 7, comprise about the mode of the picture of application zebra time correspondence in rise time managing image information bank:
The first step: enter application zebra time
Second step: open the material database management identifying application
3rd step: select uploading pictures or upload word
1: uploading pictures: such as, country map, national flag, national emblem, country manager personage; Country manager flower, National Animal, national purpose-built, World clock clock and watch figure, aircraft, the picture that earth figure etc. are relevant with World clock; Need to compress to the picture uploaded; When ensureing picture quality, file is not more than 100K; But user can the relevant data limited of oneself setting
2: upload word: country map, national flag, national emblem, country manager personage; Country manager flower, National Animal, national purpose-built; World clock; Aircraft; The word that earth figure etc. are relevant with World clock; Need to carry out number of words restriction to the word uploaded; Not unnecessary 40 bytes of word; But user can the relevant data limited of oneself setting.
4th step: detect whether have afoul similar picture or word with other classifications; If had equally, then upload failure; If different, then can upload to local data, or upload to high in the clouds; If upload to high in the clouds, also need to detect whether have data network, if do not had, then upload unsuccessful, if had, then can upload
5th step: time management Image Database is uploaded successfully
6th step: terminate
In addition, the mode about image information corresponding to rise time managing image information bank Timer can as shown in Figure 8, comprise:
The first step: enter timer application
Second step: open the material database management identifying application
3rd step: select uploading pictures or upload word
1: uploading pictures: gymnasium, runway, racing track, timer device; Table tennis, shuttlecock, gym suit, swimming, sporting equipment picture, sportsman's photo, timing rifle; In the picture relevant with timer;
Need to compress to the picture uploaded; When ensureing picture quality, file is not more than 100K; But user oneself can set the data of relevant restriction;
2: upload word: gymnasium, runway, racing track, timer device; Table tennis, shuttlecock, gym suit, swimming, sporting equipment picture, sportsman's photo, timing rifle; Deng the word content relevant with timer;
Need to carry out number of words restriction to the word uploaded; Not unnecessary 40 bytes of word; But user oneself can set the data of relevant restriction;
4th step: detect whether have afoul similar picture or word with other classifications; If had equally, then upload failure; If different, then can upload to local data, or upload to high in the clouds; If upload to high in the clouds, also need to detect whether have data network, if do not had, then upload unsuccessful, if had, then can upload;
5th step: the image information that time management Image Database Timer is corresponding is uploaded successfully
6th step: terminate
In addition, the mode about image information corresponding to countdown in rise time managing image information bank can as shown in Figure 9, comprise:
The first step: enter countdown application;
Second step: open the material database management identifying application;
3rd step: select uploading pictures or upload word;
1: uploading pictures: pot, bowl, electromagnetic oven, electric cooker, equipment of cooking, cooks equipment, soup clay pot; To heat up water equipment; To make coffee equipment; Or equipment of chemical industry, waits the picture relevant with countdown;
Need to compress to the picture uploaded; When ensureing picture quality, file is not more than 100K; But user oneself can set the data of relevant restriction;
2: upload word: pot, bowl, electromagnetic oven, electric cooker, equipment of cooking, cooks equipment, soup clay pot; To heat up water equipment; To make coffee equipment; Or equipment of chemical industry, waits the word relevant with countdown; Need to carry out number of words restriction to the word uploaded; Not unnecessary 40 bytes of word; But user oneself can set the data of relevant restriction;
4th step: detect whether have afoul similar picture or word with other classifications; If had equally, then upload failure; If different, then can upload to local data, or upload to high in the clouds; If upload to high in the clouds, also need to detect whether have data network, if do not had, then upload unsuccessful, if had, then can upload;
5th step: in time management Image Database, the pictorial information of countdown is uploaded successfully
6th step: terminate.
Visible, by adopting such scheme, according at least one characteristic parameter of the multimedia messages collected, determine target information, then based target information is determined and is opened relevant application.So, just can just determine by means of only gathering multimedia messages the related application that will open, decrease in prior art and need first to activate application management interface, then from application management interface, repeatedly page turning finds the complex operations of the application that will open, improve the operating efficiency of user, and improve the experience of user.
Embodiment three,
Embodiments provide a kind of information processing method, as shown in Figure 10, described method comprises:
Step 1001: collect multimedia messages; Described multimedia messages is audio-frequency information;
Step 1002: carry out feature extraction to described multimedia messages, obtains at least one audio frequency characteristics parameter that described multimedia messages is corresponding;
Step 1003: based on extracting at least one the audio frequency characteristics parameter obtained in described audio-frequency information, chooses the audio feature information with at least one audio frequency characteristics parameter matching described from the time management audio-frequency information storehouse of presetting; Wherein, in described time management audio-frequency information storehouse, include the related information of at least one time management application, and the audio feature information corresponding with the related information that each described time management is applied;
Step 1004: from described time management audio-frequency information storehouse, determine the related information that second time management corresponding with described audio-frequency information is applied; Based on the related information of described second time management application, determine and open described second time management application.
Here, the present embodiment can be applied to terminal device, such as, can be the equipment such as smart mobile phone, panel computer.
Described audio feature extraction is carried out to audio-frequency information, can comprise: first multimedia messages and audio-frequency information are divided into multiple audio data frame; A stack features is calculated for each audio data frame; Then the feature calculated is assembled into proper vector; The proper vector obtained is carried out the calculating such as principal component analysis (PCA), the proper vector after obtaining analyzing; Quantification is carried out to the proper vector after analysis and obtains audio-frequency fingerprint information.Wherein, described calculating can calculate for utilizing the mode such as Fast Fourier Transform (FFT) coefficient, plum and the general coefficient of rate of pausing, spectrum flatness.
At least one characteristic parameter described in the present embodiment can be: the audio fingerprint feature information that in audio-frequency information, at least one section audio is corresponding.
Preferably, described target information can match with at least one characteristic information, and can include the relevant information of at least one application in described target information, such as, can include the identification information of application, the link information etc. of application; Described target information can for the information extracted from the information bank preset.
Described based target information is determined and is opened corresponding application:
When the relevant information of the application that described target information comprises, determine to open this application;
When including the relevant information of two and above application in described target information, then showing the relevant information of these two and above application, being selected according to the relevant information of display by user, open the application that user selects.
The related information of the application of time management described in the present embodiment can include identification information or the link information etc. of at least one time management application.
Preferably, the trigger condition of step 1001 is performed in the present embodiment, Ke Yiwei: judge whether to detect the operation meeting first condition, wherein, described first condition can carry out rocking operation for terminal device by characterizing consumer, if so, then determines to start to perform step 1001.Like this, just can enter the operation gathering multimedia messages fast, thus quickening is determined and is opened the operating speed of corresponding application.
Such as, first ambient sound is gathered, then feature extraction is carried out to ambient sound, extract one section of description about universal geography of playing in TV, by the characteristic parameter extracted, mate with each audio-frequency information in time management audio-frequency information storehouse, find the audio-frequency information of coupling, then get the related information that this audio-frequency information is corresponding; Determine that the corresponding zebra time that is applied as is applied according to this related information, then open the application of zebra time for user and show.
Be understandable that, these are only an example, in practical operation, the collection of multiple ambient sound can be carried out, multiple audio-frequency information can be obtained, then compare with the multiple audio feature informations stored in information bank and determine corresponding audio feature information.
Preferably, audio-frequency information in the time management audio-frequency information storehouse of the present embodiment can be preset according to actual conditions, such as, first the audio frequency of some special words can be set user, and the identification information audio frequency of these vocabulary and corresponding time management applied is interrelated, and be kept in time management audio-frequency information storehouse, so, the mode of search can be increased, promote the experience of user further.
Visible, by adopting such scheme, according at least one characteristic parameter of the multimedia messages collected, determine target information, then based target information is determined and is opened relevant application.So, just can just determine by means of only gathering multimedia messages the related application that will open, decrease in prior art and need first to activate application management interface, then from application management interface, repeatedly page turning finds the complex operations of the application that will open, improve the operating efficiency of user, and improve the experience of user.
Embodiment four,
Embodiments provide a kind of terminal device, as shown in figure 11, comprising:
Collecting unit 1101, for collecting multimedia messages;
Feature extraction unit 1102, for carrying out feature extraction to described multimedia messages, obtains at least one characteristic parameter that described multimedia messages is corresponding;
Processing unit 1103, for based at least one characteristic parameter described, determines target information; Based on described target information, determine and open corresponding application.
Here, the present embodiment can be applied to terminal device, such as, can be the equipment such as smart mobile phone, panel computer.
Described multimedia messages can be pictorial information or can be audio-frequency information.
Described feature extraction unit 1102 pairs of pictorial informations carry out image characteristics extraction, such as can carry out feature extraction for using feature vector method; Or, for carry out audio feature extraction to audio-frequency information, can be able to comprise: first multimedia messages and audio-frequency information are divided into multiple audio data frame; A stack features is calculated for each audio data frame; Then the feature calculated is assembled into proper vector; The proper vector obtained is carried out the calculating such as principal component analysis (PCA), the proper vector after obtaining analyzing; Quantification is carried out to the proper vector after analysis and obtains audio-frequency fingerprint information.Wherein, described calculating can calculate for utilizing the mode such as Fast Fourier Transform (FFT) coefficient, plum and the general coefficient of rate of pausing, spectrum flatness.
At least one characteristic parameter described in the present embodiment can be: at least one characteristic parameter in image information, or the audio fingerprint feature information that can be in audio-frequency information, at least one section audio information is corresponding.
Preferably, described target information can match with at least one characteristic information, and can include the relevant information of at least one application in described target information, such as, can include the identification information of application, the link information etc. of application; Described target information can for the information extracted from the information bank preset.
Described based target information is determined and is opened corresponding application: when the relevant information of the application that described target information comprises, determine to open this application; When including the relevant information of two and above application in described target information, then showing the relevant information of these two and above application, being selected according to the relevant information of display by user, open the application that user selects.
Can preset multiple relevant informations corresponding to a target information in information bank, target information can be an application, and relevant information can be the shopping address etc. of the product of the link of this application or the download address of application or application correspondence.Such as, the audio file collected is QQ letter sound, and so target information can be just QQ, and relevant information can be the download address of QQ, or can be the peripheral product etc. of QQ.
Preferably, processing unit, for judging whether to detect the operation meeting first condition, wherein, described first condition can carry out rocking operation for terminal device by characterizing consumer, if so, then determines to start to collect multimedia messages.Like this, just can enter the operation gathering multimedia messages fast, thus quickening is determined and is opened the operating speed of corresponding application.
Visible, by adopting such scheme, according at least one characteristic parameter of the multimedia messages collected, determine target information, then based target information is determined and is opened relevant application.So, just can just determine by means of only gathering multimedia messages the related application that will open, decrease in prior art and need first to activate application management interface, then from application management interface, repeatedly page turning finds the complex operations of the application that will open, improve the operating efficiency of user, and improve the experience of user.
Embodiment five,
Embodiments provide a kind of terminal device, as shown in figure 11, comprising:
Collecting unit 1101, for collecting multimedia messages;
Feature extraction unit 1102, for carrying out feature extraction to described multimedia messages, obtains at least one characteristic parameter that described multimedia messages is corresponding;
Processing unit 1103, for based at least one characteristic parameter described, determines target information; Based on described target information, determine and open corresponding application.
Described multimedia messages is pictorial information; Described processing unit, for based on extracting at least one characteristic parameter obtained in described pictorial information, chooses the image information or Word message of mating with at least one characteristic parameter described from the time management Image Database preset; Wherein, in described time management Image Database, include the related information of at least one time management application, and the image information corresponding with the related information that each described time management is applied or Word message.
Described processing unit, for from described time management Image Database, determines that the very first time corresponding with described image information or Word message manages the related information applied; Based on the related information of described very first time management application, determine and open the management application of the described very first time.
Here, the present embodiment can be applied to terminal device, such as, can be the equipment such as smart mobile phone, panel computer.
Describedly feature extraction is carried out to multimedia messages can be: image characteristics extraction being carried out to pictorial information, such as can carry out feature extraction for using feature vector method.
Preferably, processing unit described in the present embodiment, for judging whether to detect the operation meeting first condition, wherein, described first condition can carry out rocking operation for terminal device by characterizing consumer, if so, then determines to start to collect multimedia messages.Like this, just can enter the operation gathering multimedia messages fast, thus quickening is determined and is opened the operating speed of corresponding application.
Preferably, the application of time management described in the present embodiment can comprise multiple, carries out example below illustrate for the present embodiment composition graphs 5:
The first step: equipment receives rocking action; Open camera function; And with equipment, surrounding environment is taken pictures; Equipment can judge whether photo array function is opened; If do not opened; Then rest on the page of taking pictures, if open, then can identify clapped content;
Second step: the content that content and the equipment of photo array are arranged is mated; Look at whether coincide;
If misfitted, then by entering high in the clouds, can be identified by the data in high in the clouds; Then can judge whether network, if there is no network, then can rest on the page of taking pictures, if there is network, can to take a picture and mate, if coupling, then can enter corresponding time management function; If do not mated, then remain on the page of taking pictures;
If coincide, then can enter the time management function that clapped content is corresponding; There is following several situation:
Situation one, alarm clock: a, take the landscape relevant to alarm clock or word; Then identify; B: then phase picture that opportunity identification is clapped whether with bed: double bed, single bed, lunch break bed, two-layer bed; The picture relevant Deng bed or word and alarm clock, clock, wrist-watch, wearable device; Clock icon is correlated with; Deng the picture relevant with alarm clock or word; C: identify the page arriving alarm clock successfully; If do not identify successfully; The request of identification then can be sent to high in the clouds; Identification range expands further;
Situation two, zebra time: a: take the landscape relevant to zebra time or word; Then identify; B: then phase picture that opportunity identification is clapped whether with country map, national flag, national emblem, country manager personage; Country manager flower, National Animal, national purpose-built; World clock clock and watch figure; Aircraft; The pictures relevant with zebra time such as earth figure or word; C: identify the page arriving zebra time successfully; If do not identify successfully; The request of identification then can be sent to high in the clouds; Identification range expands further;
Situation three, timer: a: take the landscape relevant to timer or word; Then identify; B: then phase picture that opportunity identification is clapped whether with gymnasium, runway, racing track, timer device; Table tennis, shuttlecock, gym suit, swimming, sporting equipment picture, sportsman's photo, the picture relevant with timer or the words such as timing rifle; C: identify the page arriving timer successfully; If do not identify successfully; The request of identification then can be sent to high in the clouds; Identification range expands further;
Situation four, countdown: a: take the landscape relevant to countdown or word; Then identify; B: then phase picture that opportunity identification is clapped whether with pot, bowl, electromagnetic oven, electric cooker, equipment of cooking, cooks equipment, soup clay pot; To heat up water equipment; To make coffee equipment; Or the picture that equipment of chemical industry etc. are relevant with countdown or word; C: identify the page arriving countdown successfully; If do not identify successfully; The request of identification then can be sent to high in the clouds; Identification range expands further;
3rd step: terminate
In addition, the mode about image information corresponding to alarm clock in rise time managing image information bank can as shown in Figure 6, comprise:
The first step: enter alarm clock application;
Second step: open the material database management identifying application;
3rd step: select uploading pictures or upload word;
1: uploading pictures:
Bed: double bed, single bed, lunch break bed, two-layer bed; In the picture that bed is relevant; User thinks that the picture that it doesn't matter is good; As long as user feels to conform to alarm clock concept
Clock: alarm clock, clock, wrist-watch, wearable device; Clock icon is correlated with; In the picture relevant with clock; Or user thinks that the picture that it doesn't matter is good; As long as user feels to conform to alarm clock concept;
Need to compress to the picture uploaded; When ensureing picture quality, file is not more than 100K; But user can the relevant data limited of oneself setting
2: upload word:
Bed: double bed, single bed, lunch break bed, two-layer bed; Deng the word content that bed is relevant; Or user thinks that the word that it doesn't matter is good; As long as user feels to conform to alarm clock concept;
Clock: alarm clock, clock, wrist-watch, wearable device; Clock icon is correlated with; Deng the word relevant with clock; Or user thinks that the word that it doesn't matter is good; As long as user feels to conform to alarm clock concept; Need to carry out number of words restriction to the word uploaded; Not unnecessary 40 bytes of word; But user can the relevant data limited of oneself setting
4th step: detect whether have afoul similar picture or word with other classifications; If had equally, then upload failure; If different, then can upload to local data, or upload to high in the clouds; If upload to high in the clouds, also need to detect whether have data network, if do not had, then upload unsuccessful, if had, then can upload
5th step: time management Image Database is uploaded successfully
6th step: terminate.
Can as shown in Figure 7, comprise about the mode of the picture of application zebra time correspondence in rise time managing image information bank:
The first step: enter application zebra time
Second step: open the material database management identifying application
3rd step: select uploading pictures or upload word
1: uploading pictures:
Country map, national flag, national emblem, country manager personage; Country manager flower, National Animal, national purpose-built; World clock clock and watch figure; Aircraft; The picture that earth figure etc. are relevant with World clock; Or user thinks that the picture that it doesn't matter is good; As long as user feels to conform to concept zebra time;
Need to compress to the picture uploaded; When ensureing picture quality, file is not more than 100K; But user can the relevant data limited of oneself setting
2: upload word:
Country map, national flag, national emblem, country manager personage; Country manager flower, National Animal, national purpose-built; World clock; Aircraft; The word that earth figure etc. are relevant with World clock; Or user thinks that the word that it doesn't matter is good; As long as user feels to conform to concept zebra time;
Need to carry out number of words restriction to the word uploaded; Not unnecessary 40 bytes of word; But user can the relevant data limited of oneself setting
4th step: detect whether have afoul similar picture or word with other classifications; If had equally, then upload failure; If different, then can upload to local data, or upload to high in the clouds; If upload to high in the clouds, also need to detect whether have data network, if do not had, then upload unsuccessful, if had, then can upload
5th step: time management Image Database is uploaded successfully
6th step: terminate
In addition, the mode about image information corresponding to rise time managing image information bank Timer can as shown in Figure 8, comprise:
The first step: enter timer application
Second step: open the material database management identifying application
3rd step: select uploading pictures or upload word
1: uploading pictures:
Gymnasium, runway, racing track, timer device; Table tennis, shuttlecock, gym suit, swimming, sporting equipment picture, sportsman's photo, timing rifle; In the picture relevant with timer; Or user thinks that the picture that it doesn't matter is good; As long as user feels to conform to timer concept;
Need to compress to the picture uploaded; When ensureing picture quality, file is not more than 100K; But user can the relevant data limited of oneself setting
2: upload word:
Gymnasium, runway, racing track, timer device; Table tennis, shuttlecock, gym suit, swimming, sporting equipment picture, sportsman's photo, timing rifle; Deng the word content relevant with timer; Or user thinks that the word that it doesn't matter is good; As long as user feels to conform to timer concept;
Need to carry out number of words restriction to the word uploaded; Not unnecessary 40 bytes of word; But user oneself can set the data of relevant restriction;
4th step: detect whether have afoul similar picture or word with other classifications; If had equally, then upload failure; If different, then can upload to local data, or upload to high in the clouds; If upload to high in the clouds, also need to detect whether have data network, if do not had, then upload unsuccessful, if had, then can upload;
5th step: the image information that time management Image Database Timer is corresponding is uploaded successfully
6th step: terminate
In addition, the mode about image information corresponding to countdown in rise time managing image information bank can as shown in Figure 9, comprise:
The first step: enter countdown application;
Second step: open the material database management identifying application;
3rd step: select uploading pictures or upload word;
1: uploading pictures:
Pot, bowl, electromagnetic oven, electric cooker, equipment of cooking, cooks equipment, soup clay pot; To heat up water equipment; To make coffee equipment; Or equipment of chemical industry, waits the picture relevant with countdown; ; Or user thinks that the picture that it doesn't matter is good; As long as user feels to conform to countdown concept;
Need to compress to the picture uploaded; When ensureing picture quality, file is not more than 100K; But user oneself can set the data of relevant restriction;
2: upload word:
Pot, bowl, electromagnetic oven, electric cooker, equipment of cooking, cooks equipment, soup clay pot; To heat up water equipment; To make coffee equipment; Or equipment of chemical industry, waits the word relevant with countdown; Or user thinks that the word that it doesn't matter is good; As long as user feels to conform to countdown concept;
Need to carry out number of words restriction to the word uploaded; Not unnecessary 40 bytes of word; But user oneself can set the data of relevant restriction;
4th step: detect whether have afoul similar picture or word with other classifications; If had equally, then upload failure; If different, then can upload to local data, or upload to high in the clouds; If upload to high in the clouds, also need to detect whether have data network, if do not had, then upload unsuccessful, if had, then can upload;
5th step: in time management Image Database, the pictorial information of countdown is uploaded successfully
6th step: terminate.
Visible, by adopting such scheme, according at least one characteristic parameter of the multimedia messages collected, determine target information, then based target information is determined and is opened relevant application.So, just can just determine by means of only gathering multimedia messages the related application that will open, decrease in prior art and need first to activate application management interface, then from application management interface, repeatedly page turning finds the complex operations of the application that will open, improve the operating efficiency of user, and improve the experience of user.
Embodiment six,
Embodiments provide a kind of terminal device, comprising:
Collecting unit, for collecting multimedia messages;
Feature extraction unit, for carrying out feature extraction to described multimedia messages, obtains at least one characteristic parameter that described multimedia messages is corresponding;
Processing unit, for based at least one characteristic parameter described, determines target information; Based on described target information, determine and open corresponding application.
Described multimedia messages is audio-frequency information; Described processing unit, for based on extracting at least one the audio frequency characteristics parameter obtained in described audio-frequency information, chooses the audio file with at least one audio frequency characteristics parameter matching described from the time management audio-frequency information storehouse of presetting; Wherein, in described time management audio-frequency information storehouse, include the related information of at least one time management application, and the audio file corresponding with the related information that each described time management is applied.
Described processing unit, for from described time management audio-frequency information storehouse, determines the related information that second time management corresponding with described audio file is applied; Based on the related information of described second time management application, determine and open described second time management application.
Here, the present embodiment can be applied to terminal device, such as, can be the equipment such as smart mobile phone, panel computer.
First described feature extraction unit, for being divided into multiple audio data frame by multimedia messages and audio-frequency information; A stack features is calculated for each audio data frame; Then the feature calculated is assembled into proper vector; The proper vector obtained is carried out the calculating such as principal component analysis (PCA), the proper vector after obtaining analyzing; Quantification is carried out to the proper vector after analysis and obtains audio-frequency fingerprint information.Wherein, described calculating can calculate for utilizing the mode such as Fast Fourier Transform (FFT) coefficient, plum and the general coefficient of rate of pausing, spectrum flatness.
At least one characteristic parameter described in the present embodiment can be: the audio fingerprint feature information that in audio-frequency information, at least one section audio is corresponding.
Preferably, described target information can match with at least one characteristic information, and can include the relevant information of at least one application in described target information, such as, can include the identification information of application, the link information etc. of application; Described target information can for the information extracted from the information bank preset.
Described processing unit, for the relevant information applied comprised when described target information, determines to open this application; When including the relevant information of two and above application in described target information, then showing the relevant information of these two and above application, being selected according to the relevant information of display by user, open the application that user selects.
The related information of the application of time management described in the present embodiment can include identification information or the link information etc. of at least one time management application.
Such as, first ambient sound is gathered, then feature extraction is carried out to ambient sound, extract one section of description about universal geography of playing in TV, by the characteristic parameter extracted, mate with each audio-frequency information in time management audio-frequency information storehouse, find the audio-frequency information of coupling, then get the related information that this audio-frequency information is corresponding; Determine that the corresponding zebra time that is applied as is applied according to this related information, then open the application of zebra time for user and show.
Be understandable that, these are only an example, in practical operation, the collection of multiple ambient sound can be carried out, multiple audio-frequency information can be obtained, then compare with multiple audio feature informations of information difficulties that one is reluctant to bring to the notice of others and determine corresponding audio feature information.
Preferably, audio-frequency information in the time management audio-frequency information storehouse of the present embodiment can be preset according to actual conditions, such as, first the audio frequency of some special words can be set user, and the identification information audio frequency of these vocabulary and corresponding time management applied is interrelated, and be kept in time management audio-frequency information storehouse, so, the mode of search can be increased, promote the experience of user further.
Visible, by adopting such scheme, according at least one characteristic parameter of the multimedia messages collected, determine target information, then based target information is determined and is opened relevant application.So, just can just determine by means of only gathering multimedia messages the related application that will open, decrease in prior art and need first to activate application management interface, then from application management interface, repeatedly page turning finds the complex operations of the application that will open, improve the operating efficiency of user, and improve the experience of user.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.These are only the preferred embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every utilize instructions of the present invention and accompanying drawing content to do equivalent structure or equivalent flow process conversion; or be directly or indirectly used in other relevant technical fields, be all in like manner included in scope of patent protection of the present invention.

Claims (10)

1. an information processing method, is characterized in that, described method comprises:
Collect multimedia messages;
Feature extraction is carried out to described multimedia messages, obtains at least one characteristic parameter that described multimedia messages is corresponding;
Based at least one characteristic parameter described, determine target information;
Based on described target information, determine and open corresponding application.
2. method according to claim 1, is characterized in that, described multimedia messages is pictorial information;
Described based at least one characteristic parameter described, determine target information, comprising:
Based on extracting at least one characteristic parameter obtained in described pictorial information, from the time management Image Database preset, choose the image information or Word message of mating with at least one characteristic parameter described; Wherein, in described time management Image Database, include the related information of at least one time management application, and the image information corresponding with the related information that each described time management is applied or Word message.
3. method according to claim 2, is characterized in that, described based on described target information, determines and opens corresponding application, comprising:
From described time management Image Database, determine that the very first time corresponding with described image information or Word message manages the related information applied; Based on the related information of described very first time management application, determine and open the management application of the described very first time.
4. method according to claim 1, is characterized in that, described multimedia messages is audio-frequency information;
Described based at least one characteristic parameter described, determine target information, comprising:
Based on extracting at least one the audio frequency characteristics parameter obtained in described audio-frequency information, from the time management audio-frequency information storehouse of presetting, choose the audio file with at least one audio frequency characteristics parameter matching described; Wherein, in described time management audio-frequency information storehouse, include the related information of at least one time management application, and the audio file corresponding with the related information that each described time management is applied.
5. method according to claim 4, is characterized in that, described based on described target information, determines and opens corresponding application, comprising:
From described time management audio-frequency information storehouse, determine the related information that second time management corresponding with described audio file is applied; Based on the related information of described second time management application, determine and open described second time management application.
6. a terminal device, is characterized in that, comprising:
Collecting unit, for collecting multimedia messages;
Feature extraction unit, for carrying out feature extraction to described multimedia messages, obtains at least one characteristic parameter that described multimedia messages is corresponding;
Processing unit, for based at least one characteristic parameter described, determines target information; Based on described target information, determine and open corresponding application.
7. terminal device according to claim 6, is characterized in that, described multimedia messages is pictorial information;
Described processing unit, for based on extracting at least one characteristic parameter obtained in described pictorial information, chooses the image information or Word message of mating with at least one characteristic parameter described from the time management Image Database preset; Wherein, in described time management Image Database, include the related information of at least one time management application, and the image information corresponding with the related information that each described time management is applied or Word message.
8. terminal device according to claim 7, is characterized in that, described processing unit, for from described time management Image Database, determines that the very first time corresponding with described image information or Word message manages the related information applied; Based on the related information of described very first time management application, determine and open the management application of the described very first time.
9. terminal device according to claim 6, is characterized in that, described multimedia messages is audio-frequency information;
Described processing unit, for based on extracting at least one the audio frequency characteristics parameter obtained in described audio-frequency information, chooses the audio file with at least one audio frequency characteristics parameter matching described from the time management audio-frequency information storehouse of presetting; Wherein, in described time management audio-frequency information storehouse, include the related information of at least one time management application, and the audio file corresponding with the related information that each described time management is applied.
10. terminal device according to claim 9, is characterized in that, described processing unit, for from described time management audio-frequency information storehouse, determines the related information that second time management corresponding with described audio file is applied; Based on the related information of described second time management application, determine and open described second time management application.
CN201510283697.2A 2015-05-28 2015-05-28 Information processing method and terminal equipment Pending CN104881471A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510283697.2A CN104881471A (en) 2015-05-28 2015-05-28 Information processing method and terminal equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510283697.2A CN104881471A (en) 2015-05-28 2015-05-28 Information processing method and terminal equipment

Publications (1)

Publication Number Publication Date
CN104881471A true CN104881471A (en) 2015-09-02

Family

ID=53948964

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510283697.2A Pending CN104881471A (en) 2015-05-28 2015-05-28 Information processing method and terminal equipment

Country Status (1)

Country Link
CN (1) CN104881471A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080086511A1 (en) * 2006-10-10 2008-04-10 Canon Kabushiki Kaisha Image display controlling apparatus, method of controlling image display, and storage medium
CN101742179A (en) * 2008-11-26 2010-06-16 晨星软件研发(深圳)有限公司 Multi-medium play method and multi-medium play device
CN103646655A (en) * 2013-12-30 2014-03-19 优视科技有限公司 Method and device for multimedia playing
CN104144250A (en) * 2013-05-09 2014-11-12 腾讯科技(深圳)有限公司 Method and device for prompting events on terminal
CN104268150A (en) * 2014-08-28 2015-01-07 小米科技有限责任公司 Method and device for playing music based on image content
CN104486331A (en) * 2014-12-11 2015-04-01 上海元趣信息技术有限公司 Multimedia file processing method, client terminals and interaction system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080086511A1 (en) * 2006-10-10 2008-04-10 Canon Kabushiki Kaisha Image display controlling apparatus, method of controlling image display, and storage medium
CN101742179A (en) * 2008-11-26 2010-06-16 晨星软件研发(深圳)有限公司 Multi-medium play method and multi-medium play device
CN104144250A (en) * 2013-05-09 2014-11-12 腾讯科技(深圳)有限公司 Method and device for prompting events on terminal
CN103646655A (en) * 2013-12-30 2014-03-19 优视科技有限公司 Method and device for multimedia playing
CN104268150A (en) * 2014-08-28 2015-01-07 小米科技有限责任公司 Method and device for playing music based on image content
CN104486331A (en) * 2014-12-11 2015-04-01 上海元趣信息技术有限公司 Multimedia file processing method, client terminals and interaction system

Similar Documents

Publication Publication Date Title
CN107800888B (en) Information display method and device
CN103365663B (en) It is used for developing terminal and the method for intention
CN107798653B (en) Image processing method and device
CN109344291A (en) A kind of video generation method and device
CN107609056B (en) Question and answer processing method and device based on picture recognition
CN112307240B (en) Page display method and device, storage medium and electronic equipment
CN113412608B (en) Content pushing method and device, server and storage medium
CN106131627A (en) A kind of method for processing video frequency, Apparatus and system
CN106910136A (en) It is method and device, the system of family's portrait
CN106021542A (en) Image display method and image server, terminal
CN112203115B (en) Video identification method and related device
CN112100221B (en) Information recommendation method and device, recommendation server and storage medium
CN111760294B (en) Method and device for controlling non-player game characters in game
CN105933529A (en) Shooting picture display method and device
EP3571849A1 (en) System and method for selecting scenes for browsing histories in augmented reality interfaces
CN105989107A (en) Application recommendation method and device
CN112381570A (en) Target user-oriented advertisement delivery method and device
CN107734579A (en) A kind of mobile platform energy consumption optimization method based on Markovian decision process
CN109194689A (en) Abnormal behaviour recognition methods, device, server and storage medium
CN109840444A (en) A kind of barcode scanning recognition methods, equipment and computer readable storage medium
CN104410563A (en) Information push method and wireless device
US20170163904A1 (en) Picture processing method and electronic device
KR101429612B1 (en) System and Method for Tag Map Service based Interest
CN104994082B (en) A kind of pictorial information processing method, server and system
CN109065065A (en) Call method, mobile terminal and computer readable storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20150902

RJ01 Rejection of invention patent application after publication