CN107566612A - Music preferences moade setting method, device and mobile device - Google Patents
Music preferences moade setting method, device and mobile device Download PDFInfo
- Publication number
- CN107566612A CN107566612A CN201710676892.0A CN201710676892A CN107566612A CN 107566612 A CN107566612 A CN 107566612A CN 201710676892 A CN201710676892 A CN 201710676892A CN 107566612 A CN107566612 A CN 107566612A
- Authority
- CN
- China
- Prior art keywords
- face
- models
- pattern
- music preferences
- depth information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present invention proposes a kind of music preferences moade setting method, device and mobile device, and the music preferences moade setting method includes, based on the structure light for being incident upon face, gathering speckle pattern corresponding to face；According to the depth information of speckle pattern, compared with the depth information of at least one face 3D models, obtain multiple comparison results；The music preferences pattern of mobile device is configured according to multiple comparison results.By the present invention, the depth information as corresponding to being then based on face is configured to music preferences pattern, realizes the automation that music preferences pattern is set, and so that set music preferences pattern meets the personalized emotional need of user.
Description
Technical field
The present invention relates to mobile device technology field, more particularly to a kind of music preferences moade setting method, device and shifting
Dynamic equipment.
Background technology
With the development of mobile device, user has the demand being configured to the music preferences pattern of mobile device.For example,
User can be configured, for example, setting in the setup module of the music class application program of mobile device to music preferences pattern
It is set to the music preferences pattern of happy class.
The content of the invention
It is contemplated that at least solves one of technical problem in correlation technique to a certain extent.
Therefore, the present invention proposes a kind of music preferences moade setting method, device and mobile device, by being then based on face
Corresponding depth information is configured to music preferences pattern, realizes the automation that music preferences pattern is set, and so that institute
The music preferences pattern of setting meets the personalized emotional need of user.
The music preferences moade setting method that first aspect present invention embodiment proposes, including：Based on being incident upon face
Structure light, gather speckle pattern corresponding to the face；According to the depth information of the speckle pattern, with least one face
The depth information of 3D models compares, and obtains multiple comparison results；Music according to the multiple comparison result to mobile device
Preference pattern is configured.
The music preferences moade setting method that first aspect present invention embodiment proposes, by based on the knot for being incident upon face
Structure light, speckle pattern corresponding to face is gathered, and according to the depth information of speckle pattern, with least one face 3D models
Depth information compares, and obtains multiple comparison results, and the music preferences pattern according to multiple comparison results to mobile device
It is configured, depth information is configured to music preferences pattern as corresponding to being then based on face, realizes music preferences pattern
The automation of setting, and so that set music preferences pattern meets the personalized emotional need of user.
The music preferences pattern that second aspect of the present invention embodiment proposes sets device, including：Acquisition module, for based on
The structure light of face is incident upon, gathers speckle pattern corresponding to the face；Comparing module, for according to the speckle pattern
Depth information, compared with the depth information of at least one face 3D models, obtain multiple comparison results；Setup module, use
In being configured according to the multiple comparison result to the music preferences pattern of mobile device.
The music preferences pattern that second aspect of the present invention embodiment proposes sets device, by based on the knot for being incident upon face
Structure light, speckle pattern corresponding to face is gathered, and according to the depth information of speckle pattern, with least one face 3D models
Depth information compares, and obtains multiple comparison results, and the music preferences pattern according to multiple comparison results to mobile device
It is configured, depth information is configured to music preferences pattern as corresponding to being then based on face, realizes music preferences pattern
The automation of setting, and so that set music preferences pattern meets the personalized emotional need of user.
The music preferences pattern that third aspect present invention embodiment proposes sets device, it is characterised in that including：Processing
Device；For storing the memory of processor-executable instruction；Wherein, the processor is configured as：Based on being incident upon face
Structure light, gather speckle pattern corresponding to the face；According to the depth information of the speckle pattern, with least one face
The depth information of 3D models compares, and obtains multiple comparison results；Music according to the multiple comparison result to mobile device
Preference pattern is configured.
The music preferences pattern that third aspect present invention embodiment proposes sets device, by based on the knot for being incident upon face
Structure light, speckle pattern corresponding to face is gathered, and according to the depth information of speckle pattern, with least one face 3D models
Depth information compares, and obtains multiple comparison results, and the music preferences pattern according to multiple comparison results to mobile device
It is configured, depth information is configured to music preferences pattern as corresponding to being then based on face, realizes music preferences pattern
The automation of setting, and so that set music preferences pattern meets the personalized emotional need of user.
Fourth aspect present invention embodiment proposes a kind of non-transitorycomputer readable storage medium, when the storage is situated between
Instruction in matter by terminal computing device when so that terminal is able to carry out a kind of music preferences moade setting method, described
Method includes：Based on the structure light for being incident upon face, speckle pattern corresponding to the face is gathered；According to the speckle pattern
Depth information, compared with the depth information of at least one face 3D models, obtain multiple comparison results；According to the multiple
Comparison result is configured to the music preferences pattern of mobile device.
The non-transitorycomputer readable storage medium that fourth aspect present invention embodiment proposes, by based on being incident upon people
The structure light of face, speckle pattern corresponding to face is gathered, and according to the depth information of speckle pattern, with least one face 3D
The depth information of model compares, and obtains multiple comparison results, and inclined to the music of mobile device according to multiple comparison results
Good model is configured, and depth information is configured to music preferences pattern as corresponding to being then based on face, realizes that music is inclined
The automation that good model is set, and so that set music preferences pattern meets the personalized emotional need of user.
Fifth aspect present invention also proposes a kind of mobile device, and the mobile device includes memory and processor, described to deposit
Computer-readable instruction is stored in reservoir, when the instruction is by the computing device so that the computing device is as originally
The music preferences moade setting method that invention first aspect embodiment proposes.
The mobile device that fifth aspect present invention embodiment proposes, by based on the structure light for being incident upon face, gathering people
Speckle pattern corresponding to face, and according to the depth information of speckle pattern, done with the depth information of at least one face 3D models
Compare, obtain multiple comparison results, and the music preferences pattern of mobile device is configured according to multiple comparison results, by
It is then based on depth information corresponding to face to be configured music preferences pattern, realizes that music preferences pattern is set automatic
Change, and so that set music preferences pattern meets the personalized emotional need of user.
The additional aspect of the present invention and advantage will be set forth in part in the description, and will partly become from the following description
Obtain substantially, or recognized by the practice of the present invention.
Brief description of the drawings
Of the invention above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments
Substantially and it is readily appreciated that, wherein：
Fig. 1 is the schematic flow sheet for the music preferences moade setting method that one embodiment of the invention proposes；
Fig. 2 is structure light schematic diagram in correlation technique；
Fig. 3 is the projection set schematic diagram of structure light in the embodiment of the present invention；
Fig. 4 is the schematic flow sheet for the music preferences moade setting method that another embodiment of the present invention proposes；
Fig. 5 is the schematic device of a projective structure light；
Fig. 6 is the schematic flow sheet for the music preferences moade setting method that another embodiment of the present invention proposes；
Fig. 7 is the schematic flow sheet for the music preferences moade setting method that another embodiment of the present invention proposes；
Fig. 8 is the structural representation that the music preferences pattern that one embodiment of the invention proposes sets device；
Fig. 9 is the structural representation that the music preferences pattern that another embodiment of the present invention proposes sets device；
Figure 10 is the schematic diagram of image processing circuit in one embodiment.
Embodiment
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end
Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached
The embodiment of figure description is exemplary, is only used for explaining the present invention, and is not considered as limiting the invention.On the contrary, this
All changes that the embodiment of invention includes falling into the range of the spirit and intension of attached claims, modification and equivalent
Thing.
Fig. 1 is the schematic flow sheet for the music preferences moade setting method that one embodiment of the invention proposes.
Embodiments of the invention can apply the music preferences pattern of the music class application program in user is to mobile device
During being configured, this is not restricted.
Wherein, application program can refer to run software program on an electronic device, and electronic equipment is, for example, personal electricity
Brain (Personal Computer, PC), cloud device or mobile device, mobile device such as smart mobile phone, or flat board electricity
Brain etc..Terminal can be the hardware that smart mobile phone, tablet personal computer, personal digital assistant, e-book etc. have various operating systems
Equipment, this is not restricted.
Can be, for example, the center of mobile device on hardware it should be noted that the executive agent of the embodiment of the present invention
Processor (Central Processing Unit, CPU), can be, for example, the music class application in mobile device on software
The related service of program, this is not restricted.
Referring to Fig. 1, this method includes：
Step 101：Based on the structure light for being incident upon face, speckle pattern corresponding to face is gathered.
It is known that the set of projections of direction in space light beam is collectively referred to as structure light, as shown in Fig. 2 Fig. 2 is to be tied in correlation technique
Structure light schematic diagram, the equipment of generating structure light can project to luminous point, line, grating, grid or speckle on testee
Certain projector equipment or instrument or the laser for generating laser beam.
Alternatively, referring to Fig. 3, Fig. 3 is the projection set schematic diagram of structure light in the embodiment of the present invention.With the throwing of structure light
The set that photograph album is combined into a little carries out example, and the set of the point can be referred to as speckle set.
Projection set is specially speckle set corresponding to structure light in the embodiment of the present invention, i.e. this is used for projective structure
The device of light is specifically to project luminous point on testee, by the way that luminous point is projected on testee so that generation is tested
Speckle set of the object under structure light, rather than line, grating, grid or speckle are projected on testee, due to speckle
Memory space needed for set is smaller, thus, it is possible to avoid influenceing the operational efficiency of mobile device, the storage for saving equipment is empty
Between.
In an embodiment of the present invention, can be by project structured light to face, collection is related based on structure light human face
Some view data.Due to the physical characteristic of structure light, the view data collected by structure light, people can be reflected
The depth information of face, the depth information can be, for example, the 3D information of face, by being then based on the depth information of face to movement
The music preferences pattern of equipment is configured, thus, the flexibility and automaticity that lifting music preferences pattern is set.
Alternatively, in some embodiments, referring to Fig. 4, before step 101, in addition to：
Step 100：In the music class application program during user starts mobile device, projective structure light.
In an embodiment of the present invention, the device for being capable of projective structure light can be configured in a mobile device in advance, and then,
In the music class application program during user starts mobile device, the device for being used for projective structure light is opened, with projective structure
Light, or, the device for being used for projective structure light can also be opened after user triggers and mobile device is unlocked, with
Projective structure light, this is not restricted.
Referring to Fig. 5, Fig. 5 is the schematic device of a projective structure light, is combined into line with the set of projections of structure light and is shown
Example, is combined into that the principle of the structure light of speckle is similar, and the device can include the projector and video camera for set of projections, wherein, throwing
The project structured light of certain pattern in testee surface, is formed modulated by testee surface configuration on the surface by emitter
Line 3-D view.The 3-D view is by the camera detection in another location, so as to obtain the two-dimentional fault image of line.
The relative position and testee surface profile that the distortion degree of line is depended between the projector and video camera, intuitively, along the line
The displacement (or skew) shown is proportional to testee apparent height, and the distortion of line illustrates the change of testee plane
Change, discontinuously show the physical clearance on testee surface, when the timing of relative position one between the projector and video camera, by
The two-dimentional fault image coordinate of line can reappear testee surface tri-dimensional profile.
By user start mobile device in music class application program when, ability projective structure light, movement can be saved
The energy consumption of equipment.
Step 102：According to the depth information of speckle pattern, ratio is done with the depth information of at least one face 3D models
It is right, obtain multiple comparison results.
Wherein, the quantity of face 3D models can be one or more.
, can be by the depth information of speckle pattern, with least one face 3D models, each in the embodiment of the present invention
The depth information of face 3D models compares, and obtains multiple comparison results, and each face 3D models have corresponding to one respectively
Comparison result.
Alternatively, comparison result is：The depth information of speckle pattern, it is similar between the depth information of face 3D models
Degree.
In an embodiment of the present invention, the characteristic value of the depth information of speckle pattern, and one people of extraction can be extracted
The characteristic value of the depth information of face 3D models, and the similarity algorithm in correlation technique calculates phase between the characteristic value of the two
Like degree, by that analogy, this computing is made to the depth information of each face 3D models, obtained corresponding with each face 3D models
Similarity, this is not restricted.
Wherein, the depth information can specifically for example, the distance of the profile of face and face, profile can be, for example,
Coordinate value of each point in rectangular coordinate system in space on face, distance can be, for example, each o'clock on face relative to one
The distance of individual reference position, the reference position can be some positions on mobile device, and this is not restricted.
Specifically, depth information can be obtained according to the distortion of speckle image.
According to the physical characteristic of structure light, if being incident upon on a three-dimensional testee, it projects set
Speckle distortion occurs in speckle image, i.e. the arrangement mode of certain some speckle is offset with other speckles.
Therefore, in an embodiment of the present invention, these offset informations can be based on, determine the Two-Dimensional Speckle image of distortion
Depth information corresponding to coordinate conduct, and the 3D information of face is directly restored according to the depth information.
In an embodiment of the present invention, the depth information of at least one face 3D models is predetermined, the people
Face 3D models are a benchmark face 3D model, and the corresponding depth information is that depth corresponding to benchmark face 3D models is believed
Breath, for example, the face 3D models of model, or the face 3D models of star, this is not restricted.
In an embodiment of the present invention, because the face 3D models that prestore are a benchmark face 3D model, this is corresponding
Depth information is depth information corresponding to benchmark face 3D models, therefore, according to the depth information of speckle pattern, with least one
In individual face 3D models, the depth information of each face 3D models compares, and obtains comparison result, can support and subsequently be based on
The comparison result is configured to the music preferences pattern of mobile device, is performed and is set with targetedly pattern, Lifting scheme
Efficiency and effect are set.
Step 103：The music preferences pattern of mobile device is configured according to multiple comparison results.
In embodiments of the invention, it can determine currently most to cater to the depth information of face from multiple comparison results
Corresponding music preferences pattern, to be set based on the music preferences pattern music preferences pattern current to mobile device
Put.
Specifically, face 3D models corresponding to comparison result can be obtained as mesh when comparison result is default result
Mark face 3D models；The music preferences pattern of mobile device is carried out according to music preferences pattern corresponding to target face 3D models
Set；Wherein, default result is：Similarity between the depth information of speckle pattern, and the depth information of face 3D models is small
In or equal to predetermined threshold value, i.e. filtered out from multiple comparison results as face 3D corresponding to the comparison result of default result
Model, entered based on the music preferences pattern current to mobile device of music preferences pattern corresponding to the corresponding face 3D models
Row is set.
For example, it may be determined that emotional information corresponding with target face 3D models, and determine sound corresponding with emotional information
Happy preference pattern is simultaneously used as target music preference pattern, is that target music is inclined directly by the music preferences pattern configurations of mobile device
Good model.
Further, alternatively, can be by each comparison result when the quantity of comparison result for being default result is multiple
Corresponding similarity carries out sequence from high to low, by the face belonging to comparison result corresponding to most forward similarity that sorts
3D models are not restricted as the target face 3D models to this.
In the present embodiment, by based on the structure light for being incident upon face, gathering speckle pattern corresponding to face, and according to dissipating
The depth information of spot pattern, compared with the depth information of at least one face 3D models, obtain multiple comparison results, and
The music preferences pattern of mobile device is configured according to multiple comparison results, the depth information as corresponding to being then based on face
Music preferences pattern is configured, realizes the automation that music preferences pattern is set, and so that set music preferences
Pattern meets the personalized emotional need of user.
Fig. 6 is the schematic flow sheet for the music preferences moade setting method that another embodiment of the present invention proposes.
Referring to Fig. 6, this method includes：
Step 601：Based on the structure light for being incident upon face, speckle pattern corresponding to face is gathered.
In an embodiment of the present invention, can be by project structured light to face, collection is related based on structure light human face
Some view data.Due to the physical characteristic of structure light, the view data collected by structure light, people can be reflected
The depth information of face, the depth information can be, for example, the 3D information of face, by being then based on the depth information of face to movement
The music preferences pattern of equipment is configured, thus, the flexibility and automaticity that lifting music preferences pattern is set.
Step 602：According to the depth information of speckle pattern, ratio is done with the depth information of at least one face 3D models
It is right, obtain multiple comparison results.
Wherein, the quantity of face 3D models can be one or more.
, can be by the depth information of speckle pattern, with least one face 3D models, each in the embodiment of the present invention
The depth information of face 3D models compares, and obtains multiple comparison results, and each face 3D models have corresponding to one respectively
Comparison result.
Alternatively, comparison result is：The depth information of speckle pattern, it is similar between the depth information of face 3D models
Degree.
In an embodiment of the present invention, the characteristic value of the depth information of speckle pattern, and one people of extraction can be extracted
The characteristic value of the depth information of face 3D models, and the similarity algorithm in correlation technique calculates phase between the characteristic value of the two
Like degree, by that analogy, this computing is made to the depth information of each face 3D models, obtained corresponding with each face 3D models
Similarity, this is not restricted.
Wherein, the depth information can specifically for example, the distance of the profile of face and face, profile can be, for example,
Coordinate value of each point in rectangular coordinate system in space on face, distance can be, for example, each o'clock on face relative to one
The distance of individual reference position, the reference position can be some positions on mobile device, and this is not restricted.
Specifically, depth information can be obtained according to the distortion of speckle image.
According to the physical characteristic of structure light, if being incident upon on a three-dimensional testee, it projects set
Speckle distortion occurs in speckle image, i.e. the arrangement mode of certain some speckle is offset with other speckles.
Therefore, in an embodiment of the present invention, these offset informations can be based on, determine the Two-Dimensional Speckle image of distortion
Depth information corresponding to coordinate conduct, and the 3D information of face is directly restored according to the depth information.
In an embodiment of the present invention, the depth information of at least one face 3D models is predetermined, the people
Face 3D models are a benchmark face 3D model, and the corresponding depth information is that depth corresponding to benchmark face 3D models is believed
Breath, for example, the face 3D models of model, or the face 3D models of star, this is not restricted.
In an embodiment of the present invention, because the face 3D models that prestore are a benchmark face 3D model, this is corresponding
Depth information is depth information corresponding to benchmark face 3D models, therefore, according to the depth information of speckle pattern, with least one
In individual face 3D models, the depth information of each face 3D models compares, and obtains comparison result, can support and subsequently be based on
The comparison result is configured to the music preferences pattern of mobile device, is performed and is set with targetedly pattern, lifts font
Efficiency and effect are set.
Step 603：Judge whether each comparison result in multiple comparison results is default result, if it is not, then performing step
Rapid 604, if so, then performing step 605.
Wherein, default result is：Similarity between the depth information of speckle pattern, and the depth information of face 3D models
Less than or equal to predetermined threshold value.
Predetermined threshold value therein is set in advance, can be preset by the program of dispatching from the factory of mobile device, or, also may be used
To be set by user according to self-demand, this is not restricted.
For example, each comparison result can be compared with default result respectively, it is every in multiple comparison results to judge
Whether individual comparison result is default result.
Step 604：Any processing is not made.
In an embodiment of the present invention, can if each comparison result in multiple comparison results is not default result
Not make any processing, i.e. the music preferences pattern of mobile device is not configured, mobile device now is the sound given tacit consent to
Happy preference pattern.
Step 605：Face 3D models corresponding to comparison result are obtained as target face 3D models.
And if some or multiple comparison results in multiple comparison results can trigger basis when being default result
Multiple comparison results are configured to the music preferences pattern of mobile device, if for example, there are one in multiple comparison results
Comparison result be default result, then using face 3D models corresponding to the comparison result of one as target face 3D models,
, can be by the phase corresponding to each comparison result for default result when quantity if the comparison result of default result is multiple
Carry out sequence from high to low like degree, using the face 3D models to sort belonging to comparison result corresponding to most forward similarity as
The target face 3D models, subsequently the music preferences pattern of mobile device is set based on the depth information of face with support
Put.
Step 606：According to the first relation table, it is determined that emotional information corresponding with target face 3D models.
Wherein, first relation table is pre-configured with, and specific configuration process is referring to following embodiments.
The mark of everyone face 3D models of the first relation list notation and the corresponding relation of emotional information, mood letter therein
Breath can be, for example, neutral, happy, sad, surprised, detest, indignation, fear, wherein it is possible to true by way of manually demarcating
Emotional information corresponding to fixed each face 3D models, is not restricted to this.
In an embodiment of the present invention, can be according to target face 3D models after target face 3D models are determined
Mark, corresponding with target face 3D models emotional information, lifting music preferences pattern are determined directly from the first relation table
Efficiency is set.
Step 607：According to the second relation table, it is determined that music preferences pattern corresponding with emotional information and conduct target music
Preference pattern.
Wherein, second relation table is pre-configured with, and specific configuration process is referring to following embodiments.
Corresponding relation between each emotional information of second relation list notation and music preferences pattern, mood letter therein
Breath can be, for example, neutral, happy, sad, surprised, detest, indignation, fear, wherein it is possible to true by way of manually demarcating
Music preferences pattern corresponding to fixed each emotional information, is not restricted to this.
In an embodiment of the present invention, after emotional information is determined, can directly be closed according to emotional information from second
It is that music preferences pattern corresponding with emotional information is determined in table, lifting music preferences pattern sets efficiency.
Step 608：It is target music preference pattern directly by the music preferences pattern configurations of mobile device.
For example, when emotional information is happy, the music preferences pattern for setting mobile device is happy class.
Further, user can set matching in setting according to the individual demand of oneself in the embodiment of the present invention
Music preferences pattern.For example, the music preferences pattern that the emotional information of happiness is matched can be arranged to happy class by user,
The music preferences pattern that the emotional information of happiness can be matched, is arranged to sentimental class, this is not restricted.
In the present embodiment, by based on the structure light for being incident upon face, gathering speckle pattern corresponding to face, and according to dissipating
The depth information of spot pattern, compared with the depth information of at least one face 3D models, obtain multiple comparison results, and
The music preferences pattern of mobile device is configured according to multiple comparison results, the depth information as corresponding to being then based on face
Music preferences pattern is configured, realizes the automation that music preferences pattern is set, and so that set music preferences
Pattern meets the personalized emotional need of user., can be according to target face 3D moulds after target face 3D models are determined
The mark of type, emotional information corresponding with target face 3D models is determined directly from the first relation table, lift music preferences mould
Formula sets efficiency., can be according to emotional information after emotional information is determined, determination and mood directly from the second relation table
Music preferences pattern corresponding to information, further lift music preferences pattern and efficiency is set.
Fig. 7 is the schematic flow sheet for the music preferences moade setting method that another embodiment of the present invention proposes.
Referring to Fig. 7, in the above-described embodiments before step 601, this method also includes：
Step 701：Multiple face 3D models are obtained, and it is every based on the structure light for being incident upon each face 3D models, collection
Speckle pattern corresponding to individual face 3D models.
Step 702：The depth information of speckle pattern is defined as to the depth information of face 3D models.
By regarding multiple face 3D models as benchmark face 3D models, subsequently directly according to mobile device user face
The depth information of speckle pattern, compared with the depth information of at least one benchmark face 3D models, can realize that music is inclined
The automation that good model is set.
Wherein it is possible to multiple face 3D models, Yi Jiji are obtained from webpage with webpage correlation technique such as crawler technology
In the structure light for being incident upon each face 3D models, speckle pattern corresponding to each face 3D models is gathered, and determine everyone
The depth information of speckle pattern corresponding to face 3D models, by determining multiple face 3D models, Ke Yiman in the embodiment of the present invention
The personalized emotional need of sufficient mobile device user, lifting user use stickiness.
Step 703：It is determined that emotional information corresponding to each face 3D models, and determine sound corresponding with every kind of emotional information
Happy preference pattern.
Wherein it is possible to the mode of user's demarcation determines emotional information corresponding to each face 3D models, and determine with it is every kind of
Music preferences pattern corresponding to emotional information, by determining that mood corresponding to each face 3D models is believed in the embodiment of the present invention
Breath, and music preferences pattern corresponding with every kind of emotional information is determined, the personalized mood need of mobile device user can be met
Ask, lifting user uses stickiness.
Step 704：First relation table is generated according to the mark of each face 3D models and corresponding emotional information.
Step 705：According to the corresponding relation table of music preferences schema creation second of every kind of emotional information.
Step 706：The first relation table and the second relation table are stored respectively.
By being pre-configured with the first relation table and the second relation table, and the first relation table and the second relation table are carried out respectively
Storage, such as be stored in being locally stored of mobile device, it can be easy to subsequently directly middle call every kind of mood from being locally stored
Information, and corresponding music preferences pattern, lift music preferences pattern configurations efficiency.
After target face 3D models are determined, it can directly be closed according to the mark of target face 3D models from first
It is that emotional information corresponding with target face 3D models is determined in table, lifting music preferences pattern sets efficiency.Determining feelings
After thread information, music preferences mould corresponding with emotional information can be determined directly from the second relation table according to emotional information
Formula, further lift music preferences pattern and efficiency is set.
In the present embodiment, by obtaining multiple face 3D models, and based on the structure light for being incident upon each face 3D models,
Speckle pattern corresponding to each face 3D models is gathered, the depth that the depth information of speckle pattern is defined as to face 3D models is believed
Breath, it is determined that emotional information corresponding to each face 3D models, and determine music preferences pattern corresponding with every kind of emotional information, root
The first relation table is generated according to the mark of each face 3D models and corresponding emotional information, according to every kind of emotional information and its
The corresponding relation table of music preferences schema creation second, is stored, Neng Gouman to the first relation table and the second relation table respectively
The personalized emotional need of sufficient mobile device user, lifting user use stickiness.By being pre-configured with the first relation table and second
Relation table, and being stored respectively to the first relation table and the second relation table, such as be stored in being locally stored of mobile device,
It can be easy to, subsequently directly from the middle every kind of emotional information of calling, and corresponding music preferences pattern is locally stored, be lifted
Music preferences pattern configurations efficiency.
Fig. 8 is the structural representation that the music preferences pattern that one embodiment of the invention proposes sets device.
Referring to Fig. 8, the device 800 includes：
Acquisition module 801, for based on the structure light for being incident upon face, gathering speckle pattern corresponding to face.
Comparing module 802, for the depth information according to speckle pattern, believe with the depth of at least one face 3D models
Breath compares, and obtains multiple comparison results.
Setup module 803, for being configured according to multiple comparison results to the music preferences pattern of mobile device.
Alternatively, in some embodiments, referring to Fig. 9, setup module 803, including：
Acquisition submodule 8031, for when comparison result is default result, obtaining face 3D moulds corresponding to comparison result
Type is as target face 3D models.
Submodule 8032 is set, it is inclined to the music of mobile device for the emotional information according to corresponding to target face 3D models
Good model is configured.
Wherein, default result is：Similarity between the depth information of speckle pattern, and the depth information of face 3D models
Less than or equal to predetermined threshold value.
Alternatively, in some embodiments, submodule 8032 is set, is specifically used for：
According to the first relation table, it is determined that emotional information corresponding with target face 3D models；
According to the second relation table, it is determined that music preferences pattern corresponding with emotional information and conduct target music preferences mould
Formula；
It is target music preference pattern directly by the music preferences pattern configurations of mobile device.
Alternatively, in some embodiments, referring to Fig. 9, the device 800 also includes：
Acquisition module 804, for obtaining multiple face 3D models, and based on the structure for being incident upon each face 3D models
Light, gather speckle pattern corresponding to each face 3D models.
First determining module 805, for the depth information of speckle pattern to be defined as to the depth information of face 3D models.
Second determining module 806, for determining emotional information corresponding to each face 3D models, and determine and every kind of mood
Music preferences pattern corresponding to information.
First generation module 807, generated for the mark according to each face 3D models and corresponding emotional information
First relation table.
Second generation module 808, for being closed according to the corresponding music preferences schema creation second of every kind of emotional information
It is table.
Memory module 809, for being stored respectively to the first relation table and the second relation table.
Projection module 810, for user start mobile device in music class application program when, projective structure light.
It should be noted that music preferences moade setting method embodiment is explained in earlier figures 1- Fig. 7 embodiments
The bright music preferences pattern for being also applied for the embodiment sets device 800, and its realization principle is similar, and here is omitted.
In the present embodiment, by based on the structure light for being incident upon face, gathering speckle pattern corresponding to face, and according to dissipating
The depth information of spot pattern, compared with the depth information of at least one face 3D models, obtain multiple comparison results, and
The music preferences pattern of mobile device is configured according to multiple comparison results, the depth information as corresponding to being then based on face
Music preferences pattern is configured, realizes the automation that music preferences pattern is set, and so that set music preferences
Pattern meets the personalized emotional need of user.
The embodiment of the present invention also provides a kind of mobile device.Above-mentioned mobile device includes image processing circuit, at image
Managing circuit can utilize hardware and/or component software to realize, it may include define ISP (Image SignalProcessing, image
Signal transacting) pipeline various processing units.Figure 10 is the schematic diagram of image processing circuit in one embodiment.Such as Figure 10 institutes
Show, for purposes of illustration only, only showing the various aspects of the image processing techniques related to the embodiment of the present invention.
As shown in Figure 10, image processing circuit includes imaging device 910, ISP processors 930 and control logic device 940.Into
As equipment 910 may include there is one or more lens 912, the camera of imaging sensor 914 and structured light projector 916.
Structured light projector 916 is by structured light projection to measured object.Wherein, the structured light patterns can be laser stripe, Gray code, sine
Striped or, speckle pattern of random alignment etc..Imaging sensor 914 catches the structure light image that projection is formed to measured object,
And send structure light image to ISP processors 930, acquisition measured object is demodulated to structure light image by ISP processors 930
Depth information.Meanwhile imaging sensor 914 can also catch the color information of measured object.It is of course also possible to by two images
Sensor 914 catches the structure light image and color information of measured object respectively.
Wherein, by taking pattern light as an example, ISP processors 930 are demodulated to structure light image, are specifically included, from this
The speckle image of measured object is gathered in structure light image, by the speckle image of measured object with reference speckle image according to pre-defined algorithm
View data calculating is carried out, each speckle point for obtaining speckle image on measured object dissipates relative to reference to the reference in speckle image
The displacement of spot.The depth value of each speckle point of speckle image is calculated using trigonometry conversion, and according to the depth
Angle value obtains the depth information of measured object.
It is, of course, also possible to obtain the depth image by the method for binocular vision or based on jet lag TOF method
Information etc., is not limited herein, as long as can obtain or belong to this by the method for the depth information that measured object is calculated
The scope that embodiment includes.
After the color information that ISP processors 930 receive the measured object that imaging sensor 914 captures, it can be tested
View data corresponding to the color information of thing is handled.ISP processors 930 are analyzed view data can be used for obtaining
It is determined that and/or imaging device 910 one or more control parameters image statistics.Imaging sensor 914 may include color
Color filter array (such as Bayer filters), imaging sensor 914 can obtain to be caught with each imaging pixel of imaging sensor 914
Luminous intensity and wavelength information, and provide one group of raw image data being handled by ISP processors 930.
ISP processors 930 handle raw image data pixel by pixel in various formats.For example, each image pixel can
Bit depth with 8,10,12 or 14 bits, ISP processors 930 can be carried out at one or more images to raw image data
Reason operation, image statistics of the collection on view data.Wherein, image processing operations can be by identical or different bit depth
Precision is carried out.
ISP processors 930 can also receive pixel data from video memory 920.Video memory 920 can be memory device
The independent private memory in a part, storage device or electronic equipment put, and may include DMA (Direct Memory
Access, direct direct memory access (DMA)) feature.
When receiving raw image data, ISP processors 930 can carry out one or more image processing operations.
After ISP processors 930 get color information and the depth information of measured object, it can be merged, obtained
3-D view.Wherein, can be extracted by least one of appearance profile extracting method or contour feature extracting method corresponding
The feature of measured object.Such as pass through active shape model method ASM, active appearance models method AAM, PCA PCA, discrete
The methods of cosine transform method DCT, the feature of measured object is extracted, is not limited herein.It will be extracted respectively from depth information again
The feature of measured object and feature progress registration and the Fusion Features processing that measured object is extracted from color information.Herein refer to
Fusion treatment can be the feature that will be extracted in depth information and color information directly combination or by different images
Middle identical feature combines after carrying out weight setting, it is possibility to have other amalgamation modes, finally according to the feature after fusion, generation
3-D view.
The view data of 3-D view can be transmitted to video memory 920, to carry out other place before shown
Reason.ISP processors 930 from the reception processing data of video memory 920, and to processing data carry out original domain in and RGB and
Image real time transfer in YCbCr color spaces.The view data of 3-D view may be output to display 960, so that user sees
See and/or further handled by graphics engine or GPU (GraphicsProcessing Unit, graphics processor).In addition, ISP
The output of processor 930 also can be transmitted to video memory 920, and display 960 can read picture number from video memory 920
According to.In one embodiment, video memory 920 can be configured as realizing one or more frame buffers.In addition, ISP processing
The output of device 930 can be transmitted to encoder/decoder 950, so as to encoding/decoding image data.The view data of coding can quilt
Preserve, and decompressed before being shown in the equipment of display 960.Encoder/decoder 950 can be handled by CPU or GPU or association
Device is realized.
The image statistics that ISP processors 930 determine, which can be transmitted, gives the unit of control logic device 940.Control logic device 940
It may include the processor and/or microcontroller for performing one or more routines (such as firmware), one or more routines can be according to connecing
The image statistics of receipts, determine the control parameter of imaging device 910.
In the embodiment of the present invention, the step of realizing music preferences moade setting method with image processing techniques in Figure 10, can
Referring to above-described embodiment, will not be repeated here.
In order to realize above-described embodiment, the present invention also proposes a kind of non-transitorycomputer readable storage medium, works as storage
Instruction in medium by terminal computing device when so that terminal is able to carry out a kind of music preferences moade setting method, side
Method includes：Based on the structure light for being incident upon face, speckle pattern corresponding to face is gathered；According to the depth information of speckle pattern,
Compared with the depth information of at least one face 3D models, obtain multiple comparison results；According to multiple comparison results to moving
The music preferences pattern of dynamic equipment is configured.
Non-transitorycomputer readable storage medium in the present embodiment, by based on the structure light for being incident upon face, adopting
Collect speckle pattern corresponding to face, and according to the depth information of speckle pattern, believe with the depth of at least one face 3D models
Breath compares, and obtains multiple comparison results, and the music preferences pattern of mobile device is set according to multiple comparison results
Put, depth information is configured to music preferences pattern as corresponding to being then based on face, realizes what music preferences pattern was set
Automation, and so that set music preferences pattern meets the personalized emotional need of user.
In order to realize above-described embodiment, the present invention also proposes a kind of computer program product, when in computer program product
Instruction when being executed by processor, perform a kind of music preferences moade setting method, method includes：Based on the knot for being incident upon face
Structure light, gather speckle pattern corresponding to face；According to the depth information of speckle pattern, the depth with least one face 3D models
Degree information compares, and obtains multiple comparison results；The music preferences pattern of mobile device is set according to multiple comparison results
Put.
Computer program product in the present embodiment, by based on the structure light for being incident upon face, gathering corresponding to face
Speckle pattern, and according to the depth information of speckle pattern, compare, obtain with the depth information of at least one face 3D models
Multiple comparison results, and the music preferences pattern of mobile device is configured according to multiple comparison results, by being then based on
Depth information corresponding to face is configured to music preferences pattern, realizes the automation that music preferences pattern is set, also, make
Obtain the personalized emotional need that set music preferences pattern meets user.
It should be noted that in the description of the invention, term " first ", " second " etc. are only used for describing purpose, without
It is understood that to indicate or implying relative importance.In addition, in the description of the invention, unless otherwise indicated, the implication of " multiple "
It is two or more.
Any process or method described otherwise above description in flow chart or herein is construed as, and represents to include
Module, fragment or the portion of the code of the executable instruction of one or more the step of being used to realize specific logical function or process
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discuss suitable
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In embodiment, software that multiple steps or method can be performed in memory and by suitable instruction execution system with storage
Or firmware is realized.If, and in another embodiment, can be with well known in the art for example, realized with hardware
Any one of row technology or their combination are realized：With the logic gates for realizing logic function to data-signal
Discrete logic, have suitable combinational logic gate circuit application specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method carries
Suddenly it is that by program the hardware of correlation can be instructed to complete, described program can be stored in a kind of computer-readable storage medium
In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, can also
That unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould
Block can both be realized in the form of hardware, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized in the form of software function module and as independent production marketing or in use, can also be stored in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or the spy for combining the embodiment or example description
Point is contained at least one embodiment or example of the present invention.In this manual, to the schematic representation of above-mentioned term not
Necessarily refer to identical embodiment or example.Moreover, specific features, structure, material or the feature of description can be any
One or more embodiments or example in combine in an appropriate manner.
Although embodiments of the invention have been shown and described above, it is to be understood that above-described embodiment is example
Property, it is impossible to limitation of the present invention is interpreted as, one of ordinary skill in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changed, replacing and modification.
Claims (12)
1. a kind of music preferences moade setting method, it is characterised in that comprise the following steps：
Based on the structure light for being incident upon face, speckle pattern corresponding to the face is gathered；
According to the depth information of the speckle pattern, compare, obtain more with the depth information of at least one face 3D models
Individual comparison result；
The music preferences pattern of mobile device is configured according to the multiple comparison result.
2. music preferences moade setting method as claimed in claim 1, it is characterised in that described to be tied according to the multiple compare
Fruit is configured to the music preferences pattern of mobile device, including：
When the comparison result is default result, face 3D models corresponding to the comparison result are obtained as target face 3D
Model；
The music preferences pattern of mobile device is configured according to emotional information corresponding to the target face 3D models；
Wherein, the default result is：Between the depth information of the speckle pattern, and the depth information of the face 3D models
Similarity be less than or equal to predetermined threshold value.
3. music preferences moade setting method as claimed in claim 2, it is characterised in that described according to the target face 3D
Emotional information corresponding to model is configured to the music preferences pattern of mobile device, including：
According to the first relation table, it is determined that emotional information corresponding with the target face 3D models；
According to the second relation table, it is determined that music preferences pattern corresponding with the emotional information and conduct target music preferences mould
Formula；
It is the target music preference pattern directly by the music preferences pattern configurations of the mobile device.
4. music preferences moade setting method as claimed in claim 3, it is characterised in that described based on being incident upon face
Structure light, before gathering speckle pattern corresponding to the face, in addition to：
Multiple face 3D models are obtained, and based on the structure light for being incident upon each face 3D models, gather each face 3D
Speckle pattern corresponding to model；
The depth information of the speckle pattern is defined as to the depth information of the face 3D models；
It is determined that emotional information corresponding to each face 3D models, and determine music preferences pattern corresponding with every kind of emotional information；
First relation table is generated according to the mark of each face 3D models and corresponding emotional information；
According to the second relation table described in the corresponding music preferences schema creation of every kind of emotional information；
First relation table and second relation table are stored respectively.
5. the music preferences moade setting method as described in claim any one of 1-4, it is characterised in that described based on projection
In the structure light of face, before gathering speckle pattern corresponding to the face, in addition to：
In the music class application program during user starts the mobile device, the structure light is projected.
6. a kind of music preferences pattern sets device, it is characterised in that including：
Acquisition module, for based on the structure light for being incident upon face, gathering speckle pattern corresponding to the face；
Comparing module, for the depth information according to the speckle pattern, the depth information with least one face 3D models
Compare, obtain multiple comparison results；
Setup module, for being configured according to the multiple comparison result to the music preferences pattern of mobile device.
7. music preferences pattern as claimed in claim 6 sets device, it is characterised in that the setup module, including：
Acquisition submodule, for when the comparison result is default result, obtaining face 3D moulds corresponding to the comparison result
Type is as target face 3D models；
Set submodule, for according to corresponding to the target face 3D models emotional information to the music preferences mould of mobile device
Formula is configured；
Wherein, the default result is：Between the depth information of the speckle pattern, and the depth information of the face 3D models
Similarity be less than or equal to predetermined threshold value.
8. music preferences pattern as claimed in claim 7 sets device, it is characterised in that the setting submodule, it is specific to use
In：
According to the first relation table, it is determined that emotional information corresponding with the target face 3D models；
According to the second relation table, it is determined that music preferences pattern corresponding with the emotional information and conduct target music preferences mould
Formula；
It is the target music preference pattern directly by the music preferences pattern configurations of the mobile device.
9. music preferences pattern as claimed in claim 8 sets device, it is characterised in that also includes：
Acquisition module, for obtaining multiple face 3D models, and based on the structure light for being incident upon each face 3D models, gather institute
State speckle pattern corresponding to each face 3D models；
First determining module, for the depth information of the speckle pattern to be defined as to the depth information of the face 3D models；
Second determining module, for determining emotional information corresponding to each face 3D models, and determine and every kind of emotional information pair
The music preferences pattern answered；
First generation module, for described in the mark according to each face 3D models and the generation of corresponding emotional information
First relation table；
Second generation module, for the second pass according to the corresponding music preferences schema creation of every kind of emotional information
It is table；
Memory module, for being stored respectively to first relation table and second relation table.
10. the music preferences pattern as described in claim any one of 6-9 sets device, it is characterised in that also includes：
Projection module, during for music class application program in starting the mobile device in user, project the structure light.
11. a kind of non-transitorycomputer readable storage medium, is stored thereon with computer program, it is characterised in that the program
The music preferences moade setting method as any one of claim 1-5 is realized when being executed by processor.
12. a kind of mobile device, including memory and processor, computer-readable instruction is stored in the memory, it is described
When instruction is by the computing device so that music preferences of the computing device as any one of claim 1 to 5
Moade setting method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710676892.0A CN107566612A (en) | 2017-08-09 | 2017-08-09 | Music preferences moade setting method, device and mobile device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710676892.0A CN107566612A (en) | 2017-08-09 | 2017-08-09 | Music preferences moade setting method, device and mobile device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107566612A true CN107566612A (en) | 2018-01-09 |
Family
ID=60975081
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710676892.0A Pending CN107566612A (en) | 2017-08-09 | 2017-08-09 | Music preferences moade setting method, device and mobile device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107566612A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102566740A (en) * | 2010-12-16 | 2012-07-11 | 富泰华工业（深圳）有限公司 | Electronic device with emotion recognition function, and output control method of such electronic device |
| CN104851437A (en) * | 2015-04-28 | 2015-08-19 | 广东欧珀移动通信有限公司 | Song playing method and terminal |
| CN105426404A (en) * | 2015-10-28 | 2016-03-23 | 广东欧珀移动通信有限公司 | Music information recommendation method and apparatus, and terminal |
| CN105956059A (en) * | 2016-04-27 | 2016-09-21 | 乐视控股（北京）有限公司 | Emotion recognition-based information recommendation method and apparatus |
| CN106504751A (en) * | 2016-08-01 | 2017-03-15 | 深圳奥比中光科技有限公司 | Self adaptation lip reading exchange method and interactive device |
-
2017
- 2017-08-09 CN CN201710676892.0A patent/CN107566612A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102566740A (en) * | 2010-12-16 | 2012-07-11 | 富泰华工业（深圳）有限公司 | Electronic device with emotion recognition function, and output control method of such electronic device |
| CN104851437A (en) * | 2015-04-28 | 2015-08-19 | 广东欧珀移动通信有限公司 | Song playing method and terminal |
| CN105426404A (en) * | 2015-10-28 | 2016-03-23 | 广东欧珀移动通信有限公司 | Music information recommendation method and apparatus, and terminal |
| CN105956059A (en) * | 2016-04-27 | 2016-09-21 | 乐视控股（北京）有限公司 | Emotion recognition-based information recommendation method and apparatus |
| CN106504751A (en) * | 2016-08-01 | 2017-03-15 | 深圳奥比中光科技有限公司 | Self adaptation lip reading exchange method and interactive device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11115633B2 (en) | Method and system for projector calibration | |
| CN109118569B (en) | Rendering method and device based on three-dimensional model | |
| CN107481304B (en) | Method and device for constructing virtual image in game scene | |
| EP2824923B1 (en) | Apparatus, system and method for projecting images onto predefined portions of objects | |
| CN101697233B (en) | Structured light-based three-dimensional object surface reconstruction method | |
| CN107209007A (en) | Method, circuit, equipment, accessory, system and the functionally associated computer-executable code of IMAQ are carried out with estimation of Depth | |
| US10223839B2 (en) | Virtual changes to a real object | |
| CN107517346A (en) | Photographic method, device and mobile device based on structure light | |
| CN107465906B (en) | Panorama shooting method, device and the terminal device of scene | |
| CN107480615A (en) | U.S. face processing method, device and mobile device | |
| CN107452034B (en) | Image processing method and device | |
| CN107483845B (en) | Photographic method and its device | |
| CN107610077A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| WO2019047985A1 (en) | Image processing method and device, electronic device, and computer-readable storage medium | |
| CN107392874A (en) | U.S. face processing method, device and mobile device | |
| CN107507269A (en) | Personalized three-dimensional model generating method, device and terminal device | |
| CN107610171B (en) | Image processing method and device | |
| CN107370950B (en) | Focusing process method, apparatus and mobile terminal | |
| US20150015732A1 (en) | Apparatus, system and method for projecting images onto predefined portions of objects | |
| CN107707831A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| US8633926B2 (en) | Mesoscopic geometry modulation | |
| CN107551549A (en) | Video game image method of adjustment and its device | |
| CN107820019A (en) | Blur image acquiring method, device and equipment | |
| CN107705278A (en) | The adding method and terminal device of dynamic effect | |
| CN107330974A (en) | merchandise display method, device and mobile device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180109 |
|
| RJ01 | Rejection of invention patent application after publication |