CN102110454B - A kind of system of selection of EQ pattern and device - Google Patents

A kind of system of selection of EQ pattern and device Download PDF

Info

Publication number
CN102110454B
CN102110454B CN201110023378.XA CN201110023378A CN102110454B CN 102110454 B CN102110454 B CN 102110454B CN 201110023378 A CN201110023378 A CN 201110023378A CN 102110454 B CN102110454 B CN 102110454B
Authority
CN
China
Prior art keywords
pattern
current frame
frame image
motion estimation
estimation module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201110023378.XA
Other languages
Chinese (zh)
Other versions
CN102110454A (en
Inventor
高飞
王萧程
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vimicro Corp
Original Assignee
Vimicro Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vimicro Corp filed Critical Vimicro Corp
Priority to CN201110023378.XA priority Critical patent/CN102110454B/en
Publication of CN102110454A publication Critical patent/CN102110454A/en
Application granted granted Critical
Publication of CN102110454B publication Critical patent/CN102110454B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Analysis (AREA)

Abstract

The invention discloses a kind of system of selection and device of EQ pattern, in order to realize the selection utilizing video image control EQ pattern.The system of selection of a kind of EQ pattern provided by the invention comprises: obtain the video image gathered; Motion analysis is carried out to described video image, determines the body dynamics information of described video image; According to the body dynamics information of described video image, determine the current EQ pattern needing to adopt.

Description

A kind of system of selection of EQ pattern and device
Technical field
The present invention relates to balanced device (EQ, Equalizer) technical field, particularly relate to a kind of system of selection and device of EQ pattern.
Background technology
EQ is a kind of electronic equipment that can regulate the amplification quantity of various frequency content electric signal respectively, by the adjustment of the various different frequencies to signal, compensates the defect of loudspeaker and sound field, compensates and modify various sound source and other special role.In general, the sound frequency that people can hear is that this audio frequency range can be divided into many frequency ranges by 20Hz-20KHz, EQ, then to extra amplification or the decay in addition of these frequency ranges, to obtain the sound effect more suited the requirements.
At present, most audio player both provides several fixing EQ pattern and selects for user, and more common EQ pattern comprises allusion (Classical), jazz (JAZZ), popular (POP), rock and roll (ROCK), voice (Vocal) etc.When usually listening the music of a type, adopt corresponding EQ pattern, sound that effect can be better, likely can run counter to desire with another kind.
Generally speaking, different EQ patterns can bring user and bring different sound results of broadcast, brings more music to enjoy to user.
But, the selection utilizing video image control EQ pattern can't be realized in prior art, if user will switch EQ pattern, manually can only switch, make troubles to user.
Summary of the invention
Embodiments provide a kind of system of selection and device of EQ pattern, in order to realize the selection utilizing video image control EQ pattern.
The system of selection of a kind of EQ pattern that the embodiment of the present invention provides comprises:
Obtain the video image gathered;
Motion analysis is carried out to described video image, determines the body dynamics information of described video image;
According to the body dynamics information of described video image, determine the current EQ pattern needing to adopt.
The selecting arrangement of a kind of EQ pattern that the embodiment of the present invention provides comprises:
Image acquisition unit, for obtaining the video image of collection;
Body dynamics information determining unit, for carrying out motion analysis to described video image, determines the body dynamics information of described video image;
EQ pattern determining unit, for the body dynamics information according to described video image, determines the current EQ pattern needing to adopt.
The embodiment of the present invention, by obtaining the video image gathered; Motion analysis is carried out to described video image, determines the body dynamics information of described video image; According to the body dynamics information of described video image, determine the current EQ pattern needing to adopt, thus achieve the selection utilizing video image control EQ pattern, user-friendly, improve the experience effect of user.
Accompanying drawing explanation
The overall procedure schematic diagram of the system of selection of a kind of EQ pattern that Fig. 1 provides for the embodiment of the present invention;
The idiographic flow schematic diagram of the system of selection of a kind of EQ pattern that Fig. 2 provides for the embodiment of the present invention;
The histogram schematic diagram of the associating vector that Fig. 3 provides for the embodiment of the present invention;
The structural representation of the selecting arrangement of a kind of EQ pattern that Fig. 4 provides for the embodiment of the present invention.
Embodiment
Embodiments provide a kind of system of selection and device of EQ pattern, in order to realize the selection utilizing video image control EQ pattern, user-friendly, improve the experience effect of user.
The technical scheme that the embodiment of the present invention provides, under the scene of CRUX (such as drive in field) can be applied in, the first-class image capture device of shooting is utilized to gather the video image of surrounding, and the movable information of the things shown in video image is extracted, according to the EQ of the movable information adjustment player of current things.
According to the current video content that image acquisition units collects, such as: the details of amount of exercise, image is how many, adjusts the EQ of current music, enable to present harmonious tone color according to current things.Such as, when people strenuous exercise, cheerful and light-hearted, finger-popping music can be equipped with simultaneously, and the EQ pattern such as popular (POP) that select such music to be applicable to or rock and roll (ROCK).
In a word, according to the change when foreground or displacement speed etc., the tone color of adjustment music player, can make user obtain good experience effect automatically.
Below in conjunction with accompanying drawing, the technical scheme that the embodiment of the present invention provides is described.
See Fig. 1, the system of selection of a kind of EQ pattern that the embodiment of the present invention provides totally comprises step:
The video image that S101, acquisition gather.
S102, motion analysis is carried out to video image, determine the body dynamics information of video image.
S103, body dynamics information according to video image, determine the current EQ pattern needing to adopt.
Preferably, step S102 comprises:
Variable-size-block estimation is carried out to video image, determines the quantity of the motion estimation module of each size of mating with current frame image.
Determine the motion vector of each motion estimation module of mating with current frame image, and according to the length of motion vector, determine the movement degree classification that each motion estimation module of current frame image is corresponding, and add up the quantity of the motion estimation module of current frame image corresponding to each movement degree classification.
Utilize the quantity of the motion estimation module of each size of mating with current frame image, and the quantity of the motion estimation module of current frame image corresponding to each movement degree classification, determine the body dynamics information of current frame image.
Preferably, utilize the quantity of the motion estimation module of each size of mating with current frame image, and the quantity of the motion estimation module of current frame image corresponding to each movement degree classification, determine that the step of the body dynamics information of current frame image comprises:
To the quantity of the motion estimation module of each size of mating with current frame image, and the quantity of the motion estimation module of current frame image corresponding to each movement degree classification, being normalized according to pixel, obtaining the associating vector of the body dynamics information for representing current frame image.
Preferably, step S103 comprises:
To the associating vector of the body dynamics information representing current frame image be used for, mate with the vector of combining pre-set.
EQ pattern corresponding to vector is successfully combined as alternative EQ pattern using with the Vectors matching of combining of current frame image.
Utilize alternative EQ pattern, determine the current EQ pattern needing to adopt.
Preferably, utilize alternative EQ pattern, determine that the current step of the EQ pattern adopted that needs comprises:
Judge whether the time of same alternative EQ mode duration exceedes default time threshold;
Is exceeded the EQ pattern of default time threshold the lasting time, be defined as the current EQ pattern needing to adopt.
The idiographic flow of the system of selection of a kind of EQ pattern that the embodiment of the present invention provides, as shown in Figure 2.
The video image that step S201, acquisition gather.
Be described as follows about step S202:
The video encoder of current advanced person can be adopted to realize this step.Particularly; the method for estimating becoming size can be adopted: according to the trifling degree of moving region; the motion estimation module of different size is utilized to mate; choose the dimension combination (comprising the motion estimation module of one or more sizes) of optimum matching; the result estimated as current kinetic exports; such as, smaller block usually can be used to estimate in the more trifling place of motion.
The motion estimation module of the different sizes described in the embodiment of the present invention, such as 16*16,8*8,8*4; 4*8; The block of 4*4 size.Usual maximum lump size is 16*16, and minimum block size is 4*4.The motion estimation module of different size characterizes the smoothness of image, the intensity of namely moving.
Then, carry out image smoothing data and extract (block of different size is normalized).
Motion estimation module in image is classified.
Skip represents from former frame and directly predicts do not have motion vector also not have motion residuals.
Direct indicates there is motion residuals without motion vector.
The quantity of the motion estimation module of each size of statistics current frame image.
Wherein, to the size of the image block obtained after image block (can be called piecemeal) in estimation, whether the motion illustrating object is to a certain extent level and smooth, and the motion piecemeal of rigidity object is larger, and the piecemeal of deformation part is then smaller.
Carry out the object that image smoothing data are extracted, be the smoothing parameter obtaining present image motion, this parameter can use the ratio of less piecemeal to represent, such as: the piecemeal of below 8*8 accounts for the ratio of moving region.
Be described as follows about step S203:
Step S203 is the extraction (to different motion degree vector classification and normalization) about image motion attribute information.
Determine the motion vector MV (x, y) of each motion estimation module, wherein, x, y represent the displacement of horizontal direction and vertical direction respectively.The size of motion vector represents the severe degree of motion.Motion vector is classified by length, such as, can be divided into four classes, represent with L1, L2, L3, L4 respectively.And set a length range, such as L1 (Th0, Th1) for each class, represent that the motion vector of length between Th0 to Th1 belongs to L1 class, the motion vector namely falling into the motion estimation module of this scope belongs to such.
This four class can represent different motion intense degree respectively, such as: the most violent, more acutely, generally, substantially motionless.Wherein, the motion estimation module for intra-frame encoding mode can be appointed to belong to the class of most motion intense.
Be described as follows about step S204:
Step S204 is for obtaining united information feature interpretation.
To the block of different size in variable-size-block motion estimation result and classification corresponding to motion vector, after pixel normalization, multi-C vector can be described as.Namely combine vector, such as, represent an associating vector by histogram as shown in Figure 3.
The embodiment of the present invention can in advance by different Histogram Mappings in different EQ patterns.Mapping method can by carrying out training to carry out to the MTV of different EQ pattern.Also manual mapping can be carried out to different video clipss.Afterwards, the histogram that variable-size-block estimation etc. sets up associating vector is carried out to this video clips, after the histogram normalization to accumulation, characterize the associating vector of a type games feature corresponding to an EQ pattern.
Be described as follows to step S208 about step S205:
To the associating vector that step S204 obtains, the associating vector corresponding with several typical EQ pattern prestored mates, and the EQ pattern selecting the associating vector correspondence of mating most is current alternative EQ pattern.
Then EQ judgement of stability is carried out.Time filtering is carried out to alternative EQ and removes fluctuation information, carry out continuity judgement afterwards.When alternative EQ pattern is different from the EQ pattern that current player sets, and when the duration exceedes certain hour threshold value, the EQ pattern sending instructions to player change broadcasting is current alternative EQ pattern.
See Fig. 4, the selecting arrangement of a kind of EQ pattern that the embodiment of the present invention provides comprises:
Image acquisition unit 101, for obtaining the video image of collection.
Body dynamics information determining unit 102, for carrying out motion analysis to video image, determines the body dynamics information of video image.
EQ pattern determining unit 103, for the body dynamics information according to video image, determines the current EQ pattern needing to adopt.
Preferably, described body dynamics information determining unit 102 comprises:
Motion estimation unit 201, for carrying out variable-size-block estimation to video image, determines the quantity of the motion estimation module of each size of mating with current frame image.
Movement properties determining unit 202, for determining the motion vector of each motion estimation module of mating with current frame image, and according to the length of motion vector, determine the movement degree classification that each motion estimation module of current frame image is corresponding, and add up the quantity of the motion estimation module of current frame image corresponding to each movement degree classification.
Characteristics determining unit 203, for utilizing the quantity of the motion estimation module of each size of mating with current frame image, and the quantity of the motion estimation module of current frame image corresponding to each movement degree classification, determine the body dynamics information of current frame image.
Preferably, described characteristics determining unit 203, to the quantity of the motion estimation module of each size of mating with current frame image, and the quantity of the motion estimation module of current frame image corresponding to each movement degree classification, being normalized according to pixel, obtaining the associating vector of the body dynamics information for representing current frame image.
Preferably, described EQ pattern determining unit 103 comprises:
Characteristic storing unit 301, for storing the corresponding relation of associating vector and the EQ pattern pre-set.
Characteristic matching unit 302, for being used for the associating vector of the body dynamics information representing current frame image, will mate with the vector of combining pre-set; Further, EQ pattern corresponding to vector is successfully combined as alternative EQ pattern using with the Vectors matching of combining of current frame image.
Judging processing unit 303, for utilizing alternative EQ pattern, determining the current EQ pattern needing to adopt.
Preferably, described judgement processing unit 303 comprises:
EQ judgement of stability unit 401, for judging whether the time of same alternative EQ mode duration exceedes default time threshold.
EQ adjustment unit 402, for being exceeded the EQ pattern of default time threshold the lasting time, is defined as the current EQ pattern needing to adopt.
Those skilled in the art should understand, embodiments of the invention can be provided as method, system or computer program.Therefore, the present invention can adopt the form of complete hardware embodiment, completely software implementation or the embodiment in conjunction with software and hardware aspect.And the present invention can adopt in one or more form wherein including the upper computer program implemented of computer-usable storage medium (including but not limited to magnetic disk memory and optical memory etc.) of computer usable program code.
The present invention describes with reference to according to the process flow diagram of the method for the embodiment of the present invention, equipment (system) and computer program and/or block scheme.Should understand can by the combination of the flow process in each flow process in computer program instructions realization flow figure and/or block scheme and/or square frame and process flow diagram and/or block scheme and/or square frame.These computer program instructions can being provided to the processor of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing device to produce a machine, making the instruction performed by the processor of computing machine or other programmable data processing device produce device for realizing the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
These computer program instructions also can be stored in can in the computer-readable memory that works in a specific way of vectoring computer or other programmable data processing device, the instruction making to be stored in this computer-readable memory produces the manufacture comprising command device, and this command device realizes the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
These computer program instructions also can be loaded in computing machine or other programmable data processing device, make on computing machine or other programmable devices, to perform sequence of operations step to produce computer implemented process, thus the instruction performed on computing machine or other programmable devices is provided for the step realizing the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
Obviously, those skilled in the art can carry out various change and modification to the present invention and not depart from the spirit and scope of the present invention.Like this, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies thereof, then the present invention is also intended to comprise these change and modification.

Claims (4)

1. a system of selection for balanced device EQ pattern, is characterized in that, the method comprises:
Obtain the video image gathered;
Motion analysis is carried out to described video image, determines the body dynamics information of described video image;
According to the body dynamics information of described video image, determine the current EQ pattern needing to adopt;
Described motion analysis is carried out to described video image, determines that the step of the body dynamics information of video image comprises:
Variable-size-block estimation is carried out to described video image, determines the quantity of the motion estimation module of each size of mating with current frame image;
Determine the motion vector of each motion estimation module of mating with current frame image, and according to the length of motion vector, determine the movement degree classification that each motion estimation module of current frame image is corresponding, and add up the quantity of the motion estimation module of current frame image corresponding to each movement degree classification;
Utilize the quantity of the motion estimation module of each size of mating with current frame image, and the quantity of the motion estimation module of current frame image corresponding to each movement degree classification, determine the body dynamics information of current frame image, concrete steps comprise:
To the quantity of the motion estimation module of each size of mating with current frame image, and the quantity of the motion estimation module of current frame image corresponding to each movement degree classification, being normalized according to pixel, obtaining the associating vector of the body dynamics information for representing current frame image;
The described body dynamics information according to described video image, determine that the current step of the EQ pattern adopted that needs comprises:
To the associating vector of the body dynamics information representing current frame image be used for, mate with the vector of combining pre-set;
EQ pattern corresponding to vector is successfully combined as alternative EQ pattern using with the Vectors matching of combining of current frame image;
Utilize alternative EQ pattern, determine the current EQ pattern needing to adopt.
2. method according to claim 1, is characterized in that, utilizes alternative EQ pattern, determines that the current step of the EQ pattern adopted that needs comprises:
Judge whether the time of same alternative EQ mode duration exceedes default time threshold;
Is exceeded the EQ pattern of default time threshold the lasting time, be defined as the current EQ pattern needing to adopt.
3. a selecting arrangement for balanced device EQ pattern, is characterized in that, this device comprises:
Image acquisition unit, for obtaining the video image of collection;
Body dynamics information determining unit, for carrying out motion analysis to described video image, determines the body dynamics information of described video image;
EQ pattern determining unit, for the body dynamics information according to described video image, determines the current EQ pattern needing to adopt;
Described body dynamics information determining unit comprises:
Motion estimation unit, for carrying out variable-size-block estimation to described video image, determines the quantity of the motion estimation module of each size of mating with current frame image;
Movement properties determining unit, for determining the motion vector of each motion estimation module of mating with current frame image, and according to the length of motion vector, determine the movement degree classification that each motion estimation module of current frame image is corresponding, and add up the quantity of the motion estimation module of current frame image corresponding to each movement degree classification;
Characteristics determining unit, for utilizing the quantity of the motion estimation module of each size of mating with current frame image, and the quantity of the motion estimation module of current frame image corresponding to each movement degree classification, determine the body dynamics information of current frame image;
Described characteristics determining unit, to the quantity of the motion estimation module of each size of mating with current frame image, and the quantity of the motion estimation module of current frame image corresponding to each movement degree classification, being normalized according to pixel, obtaining the associating vector of the body dynamics information for representing current frame image;
Described EQ pattern determining unit comprises:
Characteristic storing unit, for storing the corresponding relation of associating vector and the EQ pattern pre-set;
Characteristic matching unit, for being used for the associating vector of the body dynamics information representing current frame image, will mate with the vector of combining pre-set; Further, EQ pattern corresponding to vector is successfully combined as alternative EQ pattern using with the Vectors matching of combining of current frame image;
Judging processing unit, for utilizing alternative EQ pattern, determining the current EQ pattern needing to adopt.
4. device according to claim 3, is characterized in that, described judgement processing unit comprises:
EQ judgement of stability unit, for judging whether the time of same alternative EQ mode duration exceedes default time threshold;
EQ adjustment unit, for being exceeded the EQ pattern of default time threshold the lasting time, is defined as the current EQ pattern needing to adopt.
CN201110023378.XA 2011-01-20 2011-01-20 A kind of system of selection of EQ pattern and device Expired - Fee Related CN102110454B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110023378.XA CN102110454B (en) 2011-01-20 2011-01-20 A kind of system of selection of EQ pattern and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110023378.XA CN102110454B (en) 2011-01-20 2011-01-20 A kind of system of selection of EQ pattern and device

Publications (2)

Publication Number Publication Date
CN102110454A CN102110454A (en) 2011-06-29
CN102110454B true CN102110454B (en) 2015-11-25

Family

ID=44174585

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110023378.XA Expired - Fee Related CN102110454B (en) 2011-01-20 2011-01-20 A kind of system of selection of EQ pattern and device

Country Status (1)

Country Link
CN (1) CN102110454B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109640166A (en) * 2018-08-13 2019-04-16 张利军 Piece caudal flexure selection method based on dynamic degree

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1620120A (en) * 2003-11-20 2005-05-25 乐金电子(惠州)有限公司 Control device of audio frequency equalizer display
CN1726558A (en) * 2002-12-17 2006-01-25 汤姆森许可公司 Method for tagging and displaying songs in a digital audio player
CN1892895A (en) * 2005-06-29 2007-01-10 乐金电子(中国)研究开发中心有限公司 Mobile terminal with music replay ability and method for displaying equalizer thereof

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
MXPA04002234A (en) * 2001-09-11 2004-06-29 Thomson Licensing Sa Method and apparatus for automatic equalization mode activation.

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1726558A (en) * 2002-12-17 2006-01-25 汤姆森许可公司 Method for tagging and displaying songs in a digital audio player
CN1620120A (en) * 2003-11-20 2005-05-25 乐金电子(惠州)有限公司 Control device of audio frequency equalizer display
CN1892895A (en) * 2005-06-29 2007-01-10 乐金电子(中国)研究开发中心有限公司 Mobile terminal with music replay ability and method for displaying equalizer thereof

Also Published As

Publication number Publication date
CN102110454A (en) 2011-06-29

Similar Documents

Publication Publication Date Title
CN104967960B (en) Voice data processing method and system during voice data processing method, game are live
CN103207728B (en) The method of augmented reality is provided and the terminal of this method is supported
CN109685726A (en) Scene of game processing method, device, electronic equipment and storage medium
CN105228050B (en) The method of adjustment and device of earphone sound quality in terminal
CN104183227B (en) The display processing method and device of application program
CN106375789B (en) Medium living broadcast method and apparatus
CN110602550A (en) Video processing method, electronic equipment and storage medium
CN109361949A (en) Method for processing video frequency, device, electronic equipment and storage medium
CN109151573A (en) Video source modeling control method, device and electronic equipment
CN113556604B (en) Sound effect adjusting method, device, computer equipment and storage medium
CN106375590A (en) Volume adjusting method and device of intelligent terminal
CN109587558A (en) Method for processing video frequency, device, electronic equipment and storage medium
CN104320670A (en) Summary information extracting method and system for network video
US20140064517A1 (en) Multimedia processing system and audio signal processing method
CN112913330B (en) Method for selecting color extraction from video content to produce light effects
CN110580141A (en) Mobile terminal and sound effect control method
CN106412716A (en) Method and apparatus for adjusting multimedia playing effect, and electronic device
CN103297581B (en) A kind of mobile terminal and regulate the method for its equalizer
CN109271129A (en) Audio method of adjustment, device, electronic equipment and storage medium
CN110213486A (en) Image capturing method, terminal and computer readable storage medium
CN108765264A (en) Image U.S. face method, apparatus, equipment and storage medium
US11510300B2 (en) Determinning light effects based on video and audio information in dependence on video and audio weights
CN104113682B (en) A kind of image acquiring method and electronic equipment
CN103391466A (en) Set top box of television and video output method thereof
CN109640151A (en) Method for processing video frequency, device, electronic equipment and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20151125

Termination date: 20200120

CF01 Termination of patent right due to non-payment of annual fee