CN105389318B - A kind of information processing method and electronic equipment - Google Patents
A kind of information processing method and electronic equipment Download PDFInfo
- Publication number
- CN105389318B CN105389318B CN201410455557.4A CN201410455557A CN105389318B CN 105389318 B CN105389318 B CN 105389318B CN 201410455557 A CN201410455557 A CN 201410455557A CN 105389318 B CN105389318 B CN 105389318B
- Authority
- CN
- China
- Prior art keywords
- information
- location information
- video image
- image
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Telephone Function (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The invention discloses a kind of information processing methods, the poor technical problem of the prompt effect for solving electronic equipment.The described method includes: acquiring the image information in preset range by least one described image acquisition units, when detecting the presence of the first acoustic information by one of sound collection unit, determine that first acoustic information corresponds to the first location information in orientation；First acoustic information is marked according to the first location information, and determines that the corresponding user of the first location information is the first user；The first video image corresponding with the first location information is obtained, first video image includes the image of first user, and marks first video image according to the first location information；The first incidence relation is established for first acoustic information and first video image of the first location information is equally marked.The invention also discloses corresponding electronic equipments.
Description
Technical field
The present invention relates to field of computer technology, in particular to a kind of information processing method and electronic equipment.
Background technique
In daily work, some users need to participate in many videoconferences, when participating in videoconference, sometimes
Entire conference process is recorded, such as can generally use 360 ° of whole recording mode, the complete lower participation meeting of recording
All personnel, so that the case where meeting at that time can be watched at any time later.
When carrying out meeting, different users section may serve as speaker in different times, such as carry out meeting
When, there may be the speech of meeting presider, there is speech and speech of some employees of some leaders etc..And record now
Conference content, can only generally find out is that multiple people are participating in meeting, and someone can only hear the sound of speech therein when making a speech,
It may not be very good identification for being specifically who is making a speech.Especially distant view is recorded sometimes, and people seems and compares in video
It is small, it is at this moment, just more difficult to recognize spokesman, and electronic equipment can not also prompt user.
As it can be seen that the prompt effect of electronic equipment in the prior art is poor, user is if it is intended to know that specifically who is sending out
Speech, it may be necessary to be very familiar with the sound characteristic of each spokesman, or may need to watch video repeatedly can just find out, it is clear that
It brings inconvenience to users.
Summary of the invention
The embodiment of the present invention provides a kind of information processing method and electronic equipment, for solving the prompt effect of electronic equipment
Poor technical problem.
A kind of information processing method is applied to electronic equipment, and the electronic equipment includes at least one image acquisition units
With at least one sound collection unit；It the described method comprises the following steps:
By at least one described image acquisition units acquire preset range in image information, when pass through one of sound
When sound acquisition unit detects the presence of the first acoustic information, determine that first acoustic information corresponds to the first position letter in orientation
Breath；
First acoustic information is marked according to the first location information, and determines that the first location information is corresponding
User is the first user；
The first video image corresponding with the first location information is obtained, first video image includes described first
The image of user, and first video image is marked according to the first location information；
It is established for first acoustic information and first video image of the first location information is equally marked
First incidence relation.
Optionally, when detecting the presence of the first acoustic information by one of sound collection unit, described is determined
One acoustic information corresponds to the first location information in orientation, comprising: when detecting the presence of institute by one of sound collection unit
When stating the first acoustic information, the location information in orientation corresponding to the sound collection unit is determined, and determining position is believed
Breath is used as the first location information.
Optionally, the first video image corresponding with the first location information is obtained, comprising:
According to the position corresponding relationship between sound collection unit and image acquisition units, the determining and sound collection list
The corresponding image acquisition units of member；
In the image of described image acquisition unit acquisition, administrative division map corresponding with the first location information is chosen
Picture, and using the area image as first video image.
Optionally, in first acoustic information and first video for the first location information is equally marked
Image is established after the first incidence relation, further includes:
If detecting the presence of second sound information by one of sound collection unit, the second sound information is determined
The second location information in corresponding orientation；
If the second location information and the first location information are not same position information, according to the second
Second sound information described in information flag is set, and determines that the corresponding user of the second location information is second user；
The second video image corresponding with the second location information is obtained, second video image includes described second
The image of user, and second video image is marked according to second location information label；
It is established for the second sound information and second video image of the second location information is equally marked
Second incidence relation.
Optionally, if after the second location information and the first location information are not same position information, also
Include:
For there are first acoustic informations of first incidence relation and first video image to establish jointly
Label is stored, stores first acoustic information and first video image according to the storage label of foundation.
Optionally, after detecting the presence of the first acoustic information by one of sound collection unit, further includes: right
First acoustic information carries out noise reduction process.
Optionally, after obtaining the first video image corresponding with the first location information, further includes:
Control the area of first video image display area occupied on the display unit of the electronic equipment
Second area is changed by the first area, first area is less than the second area.
Optionally, after determining that the corresponding user of the first location information is the first user, further includes: pass through face
Identification technology determines the first user information corresponding to first user；
It is established for first acoustic information and first video image of the first location information is equally marked
First incidence relation, comprising: establish institute for first acoustic information, first video image and first user information
State the first incidence relation.
A kind of electronic equipment, the electronic equipment include at least one image acquisition units and at least one sound collection list
Member；The electronic equipment further include:
First determining module, for acquiring the image letter in preset range by least one described image acquisition units
Breath, when detecting the presence of the first acoustic information by one of sound collection unit, determines first acoustic information pair
Answer the first location information in orientation；
Second determining module, for marking first acoustic information according to the first location information, and described in determination
The corresponding user of first location information is the first user；
Module is obtained, for obtaining the first video image corresponding with the first location information, the first video figure
First video image is marked as the image comprising first user, and according to the first location information；
First establishes module, for for first acoustic information of the first location information and described is equally marked
First video image establishes the first incidence relation.
Optionally, first determining module is specifically used for: detecting the presence of when by one of sound collection unit
When first acoustic information, the location information in orientation corresponding to the sound collection unit is determined, and by determining position
Information is as the first location information.
Optionally, the acquisition module is for obtaining the first video image corresponding with the first location information, specifically
Are as follows:
According to the position corresponding relationship between sound collection unit and image acquisition units, the determining and sound collection list
The corresponding image acquisition units of member；
In the image of described image acquisition unit acquisition, administrative division map corresponding with the first location information is chosen
Picture, and using the area image as first video image.
Optionally, first determining module is also used to: establishing module described first is equally to be marked described first
First acoustic information and first video image of location information are established after first incidence relation, if passing through it
In a sound collection unit detect the presence of second sound information, determine that the second sound information corresponds to the second in orientation
Confidence breath；
Second determining module is also used to: if the second location information and the first location information are not same positions
Confidence breath then marks the second sound information according to the second location information, and determines that the second location information is corresponding
User be second user；
The acquisition module is also used to: acquisition the second video image corresponding with the second location information, and described second
Video image includes the image of the second user, and marks the second video figure according to second location information label
Picture；
Described first, which establishes module, is also used to: for the second sound information that the second location information is equally marked
And second video image establishes the second incidence relation.
Optionally, the electronic equipment further includes second establishing module, is used for: if the second location information with it is described
After first location information is not same position information, for there are first acoustic information of first incidence relation and institutes
It states the first video image and establishes common storage label, store first acoustic information and described according to the storage label of foundation
First video image.
Optionally, the electronic equipment further includes processing module, is used for: being detected by one of sound collection unit
To there are after first acoustic information, noise reduction process is carried out to first acoustic information.
Optionally, the electronic equipment further includes control module, for obtaining and described first in the acquisition module
After confidence ceases corresponding first video image, the first video image institute on the display unit of the electronic equipment is controlled
The area of the display area occupied changes into second area by the first area, and first area is less than the second area.
Optionally, the electronic equipment further includes identification module, is used for: determining described first in second determining module
After the corresponding user of location information is the first user, by facial recognition techniques, the is determined corresponding to first user
One user information；
Described first, which establishes module, is specifically used for: for first acoustic information, first video image and described
One user information establishes first incidence relation.
In the embodiment of the present invention, when detecting the presence of the first acoustic information, can determine whether in orientation with first sound
Corresponding first video image of information, and first acoustic information and first video are marked according to the same location information
Image, so as to establish first incidence relation for first acoustic information and first video image, in this way, working as
User is when checking, as long as finding first acoustic information, it will be able to be seen simultaneously according to first incidence relation described
First video image, as long as alternatively, finding first video image, it will be able to be listened to simultaneously according to first incidence relation
First acoustic information.For example, different users section may serve as speaker in different times when carrying out meeting,
If being user A in the first period speaker, when hearing the sound of user A, it will be able to be seen according to incidence relation is corresponding
To the video image of user A, in this way, can easily determine on earth is who is making a speech, the prompt effect of electronic equipment is enhanced
Fruit checks or tries to figure out repeatedly without user, saves the operating time, improves user experience.
Detailed description of the invention
Fig. 1 is the broad flow diagram of information processing method in the embodiment of the present invention；
Fig. 2 is the primary structure block diagram of electronic equipment in the embodiment of the present invention.
Specific embodiment
The embodiment of the present invention provides a kind of information processing method, is applied to electronic equipment, and the electronic equipment includes at least
One image acquisition units and at least one sound collection unit；The described method includes: passing through at least one described Image Acquisition
Unit acquires the image information in preset range, when detecting the presence of the first acoustic information by one of sound collection unit
When, determine that first acoustic information corresponds to the first location information in orientation；According to first location information label described the
One acoustic information, and determine that the corresponding user of the first location information is the first user；It obtains and the first location information
Corresponding first video image, first video image include the image of first user, and according to the first position
First video image described in information flag；For first acoustic information of the first location information and described is equally marked
First video image establishes the first incidence relation.
In the embodiment of the present invention, when detecting the presence of the first acoustic information, can determine whether in orientation with first sound
Corresponding first video image of information, and first acoustic information and first video are marked according to the same location information
Image, so as to establish first incidence relation for first acoustic information and first video image, in this way, working as
User is when checking, as long as finding first acoustic information, it will be able to be seen simultaneously according to first incidence relation described
First video image, as long as alternatively, finding first video image, it will be able to be listened to simultaneously according to first incidence relation
First acoustic information.For example, different users section may serve as speaker in different times when carrying out meeting,
If being user A in the first period speaker, when hearing the sound of user A, it will be able to be seen according to incidence relation is corresponding
To the video image of user A, in this way, can easily determine on earth is who is making a speech, the prompt effect of electronic equipment is enhanced
Fruit checks or tries to figure out repeatedly without user, saves the operating time, improves user experience.
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
In the embodiment of the present invention, the electronic equipment for example can be mobile phone, PAD (tablet computer), PC (individual calculus
Machine), notebook, video camera, smart television, such as can be dedicated recording arrangement, etc., the present invention is with no restrictions.
In addition, the terms "and/or", only a kind of incidence relation for describing affiliated partner, indicates may exist
Three kinds of relationships, for example, A and/or B, can indicate: individualism A exists simultaneously A and B, these three situations of individualism B.Separately
Outside, character "/" herein typicallys represent the relationship that forward-backward correlation object is a kind of "or" unless otherwise specified.
The preferred embodiment of the present invention is described in detail with reference to the accompanying drawing.
Referring to Figure 1, the embodiment of the present invention provides a kind of information processing method, and the method can be applied to electronics and set
Standby, the electronic equipment may include at least one image acquisition units and at least one sound collection unit.The method
Main flow is described as follows:
Step 101: the image information in preset range is acquired by least one described image acquisition units, when passing through it
In sound collection unit when detecting the presence of the first acoustic information, determine that first acoustic information corresponds to the first of orientation
Location information.
In the embodiment of the present invention, image acquisition units for example can be camera, and sound collection unit for example can be wheat
Gram.
In the embodiment of the present invention, the electronic equipment be can be in the recording for carrying out multimedia file, the multimedia text
It can be both including video or including audio in part.Such as a kind of scene is: holding group session, the electronic equipment is right
Meeting carries out whole recording.It is at least one described sound collection unit and at least one described image then when being recorded
Acquisition unit all works at the same time.
Why the electronic equipment may include at least one described image acquisition units and at least one described sound
Acquisition unit is to preferably record to multimedia file, and different image acquisition units can acquire different direction
Image, different sound collection units can also acquire the sound of different direction.It, then can be as far as possible e.g. in recorded meeting
Be ensured of in the recording for carrying out 360 ° omni-directional, everyone to attend a meeting is recorded in, avoid drain message.
The preset range can for example refer to spatial dimension corresponding to the video in the multimedia file of recording.Logical
When at least one image acquisition units described in crossing acquire the image information in the preset range, if passing through one of sound
Acquisition unit has collected acoustic information, which is known as first acoustic information, then can determine described first
The information is known as the first location information by the information in orientation corresponding to acoustic information, that is, the first location information is
Refer to the position where the sound source of first acoustic information.
Optionally, in the embodiment of the present invention, the corresponding first location information of first acoustic information is determined, it can be with
Using some general auditory localization algorithms in the prior art, because these algorithms all comparative maturities, just few superfluous herein
It states.
Optionally, in the embodiment of the present invention, the corresponding first location information of first acoustic information is determined, in addition to
Except general auditory localization algorithm, other methods can also be used.Specifically, when passing through one of sound collection list
When member detects the presence of the first acoustic information, determines that first acoustic information corresponds to the first location information in orientation, can wrap
It includes: when detecting the presence of first acoustic information by one of sound collection unit, determining the sound collection list
The location information in orientation corresponding to member, and using determining location information as the first location information.
That is, when collecting first acoustic information, can determine acquisition first sound in the embodiment of the present invention
Location information corresponding to the sound collection unit of information, can be by the location information directly as the first location information.
In the embodiment of the present invention, at least one described image acquisition units and at least one described sound collection list are being set
When first, such as the corresponding orientation of each image acquisition units can be enabled, and enable the corresponding side of each sound collection unit
Position.Preferably, the sound of each sound collection unit one user of corresponding acquisition can be enabled as far as possible, or multiple sound can be enabled
The sound of acquisition unit all one users of corresponding acquisition, can make positioning result more accurate in this way.Likewise, also as far as possible can be with
The image of each image acquisition units one user of corresponding acquisition is enabled, or all corresponding acquisition of multiple images acquisition unit can be enabled
The image of one user can make positioning result more accurate in this way.
Optionally, in the embodiment of the present invention, first sound is being detected the presence of by one of sound collection unit
It can also include: that noise reduction process is carried out to first acoustic information after message breath.
This noise reduction process can be throughout, that is, until first acoustic information acquisition finishes, before
Noise reduction process can be carried out to first acoustic information always.
For the specific processing mode of noise reduction, have in the prior art very much, such as Noise Elimination from Wavelet Transform etc., this hair
It is bright to this with no restriction.
Step 102: first acoustic information being marked according to the first location information, and determines the first position letter
Ceasing corresponding user is the first user.
After determining the first location information, it can be marked for first acoustic information, the mode of marking
Such as can be according to the first location information come marking, as described first acoustic information marks the upper first position
Information, the position where indicating the sound source of first acoustic information are first position corresponding to the first location information.
Also, after determining the first location information, the corresponding use of the first location information can be naturally also determined
Family, such as the user is known as first user.
It certainly, in this case, is the corresponding user of one sound collection unit of default or multiple sound collections
Unit corresponds to a user, and a sound collection unit is only corresponding with a user.
Step 103: obtaining the first video image corresponding with the first location information, first video image includes
The image of first user, and first video image is marked according to the first location information.
After determining the first location information, it can be obtained by least one described image acquisition units and described the
Corresponding first video image of one location information, because the corresponding user of the first location information is first use
Family, therefore, needed in first video image include first user image.
After obtaining first video image, first video image can be similarly and marked, marking
Mode continues to be according to the first location information come marking, the first position on as described first Video Image Marker
Information indicates that position corresponding to first video image is first position corresponding to the first location information.
In this way, the first position letter is just marked simultaneously for first acoustic information and first video image
Breath, this also indicates that the sound corresponding to the first position is first acoustic information, corresponding to the first position
Video is first video image.
Certainly, because of the limitation of hardware condition, in some electronic equipments, the quantity of possible image acquisition units does not have sound
The quantity of sound acquisition unit is more, in this case, it is also possible to which an image acquisition units need the corresponding multiple orientation of acquisition
Image, specifically a namely image acquisition units may need the corresponding image for acquiring multiple users.
Therefore, optionally, in the embodiment of the present invention, the first video image corresponding with the first location information is obtained,
It may include: the determining and sound collection according to the position corresponding relationship between sound collection unit and image acquisition units
The corresponding image acquisition units of unit；In the image of described image acquisition unit acquisition, choose and the first location information
Corresponding area image, and using the area image as first video image.
First video image is by an image acquisition units institute at least one described image acquisition units
Acquisition, therefore, if the quantity of image acquisition units is not less than 2, first video image is obtained, first will
This image acquisition units is determined from multiple images acquisition unit.
Such as the position being previously stored between sound collection unit and image acquisition units in the electronic equipment is corresponding
Relationship in the position in corresponding relationship, such as can be the corresponding image acquisition units of a sound collection unit, i.e. sound
Acquisition unit and image acquisition units correspond, this is a kind of more satisfactory corresponding relationship, alternatively, if Image Acquisition list
The quantity of member is less than the quantity of sound collection unit, then can be an image acquisition units in the position in corresponding relationship
Corresponding multiple sound collection units, for example, see table 1:
Table 1
From table 1 it follows that if the quantity of image acquisition units is less than the quantity of sound collection unit, some figures
As acquisition unit can correspond to multiple sound collection units, some image acquisition units can correspond to a sound collection unit,
A specific image acquisition units correspond to several sound collection units, the position phase with image acquisition units and sound collection unit
It closes, the present invention is with no restriction.
For example, being exemplified by Table 1.If it is determined that obtain first acoustic information is sound collection unit 4, then it can basis
Table 1 determines that image acquisition units corresponding with sound collection unit 4 are image acquisition units 2.Meanwhile it can also from table 1
It arrives, the corresponding sound collection unit of image acquisition units 2 has 3, that is to say, that image acquisition units 2 may acquire 3 simultaneously
The image of a user, this 3 users are respectively as follows: and the corresponding user 2 of sound collection unit 2, corresponding with sound collection unit 3
User 3 and user 4 corresponding with sound collection unit.And corresponding use is had confirmed according to first acoustic information
Family, user 4 as corresponding with sound collection unit 4, therefore, it is necessary to the figures of each user acquired from image acquisition units 2
The image of user 4 is intercepted out as in.Because the position corresponding with first acoustic information of position corresponding to user 4 is identical,
The as described first position, then the image of user 4 area image namely corresponding with the first location information, is intercepting out
After the area image, so that it may using the area image as first video image.
Certainly, after determining image acquisition units according to sound collection unit, if image acquisition units correspondence is adopted
Collect the image of multiple users, then, described image acquisition unit can also be enabled since determining described image acquisition unit
The image of single user is only acquired, which is first user, and by described image acquisition unit collected described the
The image of one user is as first video image.
Can be there are two types of mode that is, obtaining first video image, one is adopted from image acquisition units
The image of corresponding single user is intercepted out in the image of multiple users of collection, this mode can retain the image of multi-user, with
For other purposes.Another kind is the image for enabling image acquisition units only shoot corresponding single user, this mode use collected
Family image is relatively clear complete, watches convenient for user.
Optionally, in the embodiment of the present invention, first video image corresponding with the first location information is being obtained
It later, can also include: control first video image viewing area occupied on the display unit of the electronic equipment
The area in domain changes into second area by the first area, and first area is less than the second area.
That is, first video image can be amplified display after obtaining first video image, be convenient for
User's viewing.
Certainly, after obtaining first video image, the display position of first video image can also be adjusted,
That is, can also include: control described first after obtaining first video image corresponding with the first location information
The position of video image display area occupied on the display unit of the electronic equipment changes into the 4th by the third place
Position.Such as first video image is shown in the marginal position of the display unit originally, can be adjusted to described
The center of display unit is shown, is watched convenient for user.
Step 104: for first acoustic information and first video that the first location information is equally marked
Image establishes the first incidence relation.
The first location information is marked for first acoustic information and first video image, then can be
First acoustic information and first video image establish first incidence relation.In this way, when user is determining
According to the first incidence relation determination and first video image can be checked when stating the first acoustic information, likewise, working as
User can be determining according to first incidence relation when determining first video image and listens to first sound
Information.For example, if being the meeting that a user records in viewing, when speaker A speech, user can be according to speaker A's
Acoustic information determines the video image with the acoustic information there are incidence relation, the i.e. video image of speaker A, thus quickly
That just can know that speech is speaker A, no longer needs to be searched by repeating the modes such as viewing video, saves query time, mention
High operating efficiency, also improves user experience.
Further, in the embodiment of the present invention, in first sound for the first location information is equally marked
Information and first video image are established after first incidence relation, can also include:
If detecting the presence of second sound information by one of sound collection unit, the second sound information is determined
The second location information in corresponding orientation；
If the second location information and the first location information are not same position information, according to the second
Second sound information described in information flag is set, and determines that the corresponding user of the second location information is second user；
The second video image corresponding with the second location information is obtained, second video image includes described second
The image of user, and second video image is marked according to second location information label；
It is established for the second sound information and second video image of the second location information is equally marked
Second incidence relation.
That is, being established after first incidence relation for first acoustic information and first video image, record
Also continuing, if detecting the presence of the second sound information again by one of sound collection unit, can determine
The corresponding second location information of the second sound information.It determines the mode of the second location information and determines described the
The mode of one location information can be similar, seldom repeats.
After determining the second location information, it can be determined that the second location information and the first location information are
No is same position information, can if the second location information and the first location information are same position information
It is a part of first acoustic information with the determination second sound information, can continues to acquire.
It, can be according to institute if the second location information and the first location information are not same position information
It states second location information and marks the second sound information, and determine the corresponding user of the second location information, by the user
The referred to as described second user.Later, second video image is obtained, includes the second user in second video image
Image, and be similarly second location information described in second Video Image Marker, and, for second video image and institute
It states second sound information and establishes second incidence relation, so that user can determine described according to the second sound information
Two video images, or user is made to can determine the second sound information according to second video image.It thus can be right
That answers determines different speakers and corresponding video image, checks convenient for user.
That is, until when acoustic information corresponding location information difference, recorded in recording process before
Acoustic information is an entirety, and corresponding video image is also an entirety before, can uniformly establish an incidence relation.When
The step of when the corresponding location information difference of acoustic information, establishing incidence relation again, i.e., starting again before repetition.
Optionally, in the embodiment of the present invention, if with the first location information not being same in the second location information
It can also include: for there are first acoustic information of first incidence relation and first views after location information
Frequency image establishes common storage label, stores first acoustic information and first video according to the storage label of foundation
Image.
First acoustic information and first video image are stored according to common storage label, can be incited somebody to action in this way
First acoustic information and first video image storage can also be checked to together when checking together.
In the embodiment of the present invention, first acoustic information is being stored and when first video image, it can will be described
First acoustic information and first video image take out independent storage, as described first acoustic information and first view
Frequency image establishes the storage label, is stored according to the storage label.This storage mode is more clear, convenient
User searches at any time.
Alternatively, can not also individually be stored when storing first acoustic information and first video image, but
Still using first acoustic information and first video image as a part for the multimedia file recorded come integrally into
Row storage, but in the multimedia file of storage, there are described first for first acoustic information and first video image
Incidence relation, so user can determine first video image as long as it can determine first acoustic information, or
User can determine that first acoustic information as long as it can determine first video image.This storage mode is without independent
Multiple information are stored, more saving memory space, also makes memory space more orderly.
Optionally, in the embodiment of the present invention, after determining that the corresponding user of the first location information is the first user,
It can also include: to determine the first user information corresponding to first user by facial recognition techniques.So, this
In the case of, it is that first acoustic information that the first location information is equally marked and first video image establish the
One incidence relation may include: for the foundation of first acoustic information, first video image and first user information
First incidence relation.
That is, after determining first user, in order to preferably be convenient for identifying to first user, Ke Yitong
Facial recognition techniques are crossed to determine first user information corresponding to first user, first user information is for example
It may include one or more in the name of first user, age, department, position, telephone number, mailbox etc.
?.It so naturally, when establishing first incidence relation, that is, is first acoustic information, the first video figure
Picture and first user information establish first incidence relation.
For example, user has found first acoustic information, when playing first acoustic information, the electronics is set
It is standby to determine first video information automatically according to first incidence relation, and play out simultaneously, and playing institute
First user information will be shown when stating the first video information, on the display unit, so that user can be very convenient
Ground understands some information of speaker, may be more conducive to user and understand the content that speaker is said, and convenient for user with
Speaker's connection etc..
Fig. 2 is referred to, based on the same inventive concept, the embodiment of the present invention provides a kind of electronic equipment, the electronic equipment
It may include at least one image acquisition units and at least one sound collection unit, the electronic equipment can also include first
Determining module 201, the second determining module 202, acquisition module 203 and first establish module 204.
First determining module 201 is used to acquire the image letter in preset range by least one described image acquisition units
Breath, when detecting the presence of the first acoustic information by one of sound collection unit, determines first acoustic information pair
Answer the first location information in orientation；
Second determining module 202 is used to mark first acoustic information according to the first location information, and determines institute
Stating the corresponding user of first location information is the first user；
Module 203 is obtained for obtaining the first video image corresponding with the first location information, first video
Image includes the image of first user, and marks first video image according to the first location information；
First establishes module 204 for first acoustic information and the institute for the first location information is equally marked
It states the first video image and establishes the first incidence relation.
Optionally, in the embodiment of the present invention, the first determining module 201 is specifically used for: when pass through one of sound collection
When unit detects the presence of first acoustic information, the location information in orientation corresponding to the sound collection unit is determined,
And using determining location information as the first location information.
Optionally, in the embodiment of the present invention, it is corresponding with the first location information described for obtaining to obtain module 203
First video image, specifically:
According to the position corresponding relationship between sound collection unit and image acquisition units, the determining and sound collection list
The corresponding image acquisition units of member；
In the image of described image acquisition unit acquisition, administrative division map corresponding with the first location information is chosen
Picture, and using the area image as first video image.
Optionally, in the embodiment of the present invention, the first determining module 201 is also used to: establishing module 204 first is same mark
First acoustic information and first video image for having remembered the first location information establish first incidence relation
Later, if detecting the presence of second sound information by one of sound collection unit, the second sound information pair is determined
Answer the second location information in orientation；
Second determining module 202 is also used to: if the second location information and the first location information are not same positions
Confidence breath then marks the second sound information according to the second location information, and determines that the second location information is corresponding
User be second user；
It obtains module 203 to be also used to: obtaining the second video image corresponding with the second location information, second view
Frequency image includes the image of the second user, and marks second video image according to second location information label；
First, which establishes module 204, is also used to: for the second sound information that the second location information is equally marked
And second video image establishes the second incidence relation.
Optionally, in the embodiment of the present invention, the electronic equipment further includes second establishing module, and described second establishes module
Module 204 is established with the first determining module 201, the second determining module 202, acquisition module 203 and first to be connected.Described second
Module is established to be used for: if after the second location information and the first location information are not same position information, to deposit
Common storage label is established in first acoustic information of first incidence relation and first video image, according to
The storage label of foundation stores first acoustic information and first video image.
Optionally, in the embodiment of the present invention, the electronic equipment further includes processing module, and the processing module is true with first
Cover half block 201, the second determining module 202 obtain module 203, first establish module 204 and described second to establish module homogeneous
Even.The processing module is used for: after detecting the presence of first acoustic information by one of sound collection unit,
Noise reduction process is carried out to first acoustic information.
Optionally, in the embodiment of the present invention, the electronic equipment further includes control module, and the control module is true with first
Cover half block 201, the second determining module 202 obtain module 203, first establish module 204, described second establish module and described
Processing module is connected.The control module is used for: obtaining corresponding with the first location information first obtaining module 203
After video image, first video image display area occupied on the display unit of the electronic equipment is controlled
Area changes into second area by the first area, and first area is less than the second area.
Optionally, in the embodiment of the present invention, the electronic equipment further includes identification module, and the identification module and first is really
Cover half block 201, the second determining module 202 obtain module 203, first establish module 204, described second establish module, the place
Reason module is connected with the control module.The identification module is used for: determining the first position in the second determining module 202
After the corresponding user of information is the first user, by facial recognition techniques, determine corresponding to first user that first uses
Family information；First, which establishes module 204, is specifically used for: for first acoustic information, first video image and described first
User information establishes first incidence relation.
The embodiment of the present invention provides a kind of information processing method, is applied to electronic equipment, and the electronic equipment includes at least
One image acquisition units and at least one sound collection unit；The described method includes: passing through at least one described Image Acquisition
Unit acquires the image information in preset range, when detecting the presence of the first acoustic information by one of sound collection unit
When, determine that first acoustic information corresponds to the first location information in orientation；According to first location information label described the
One acoustic information, and determine that the corresponding user of the first location information is the first user；It obtains and the first location information
Corresponding first video image, first video image include the image of first user, and according to the first position
First video image described in information flag；For first acoustic information of the first location information and described is equally marked
First video image establishes the first incidence relation.
In the embodiment of the present invention, when detecting the presence of the first acoustic information, can determine whether in orientation with first sound
Corresponding first video image of information, and first acoustic information and first video are marked according to the same location information
Image, so as to establish first incidence relation for first acoustic information and first video image, in this way, working as
User is when checking, as long as finding first acoustic information, it will be able to be seen simultaneously according to first incidence relation described
First video image, as long as alternatively, finding first video image, it will be able to be listened to simultaneously according to first incidence relation
First acoustic information.For example, different users section may serve as speaker in different times when carrying out meeting,
If being user A in the first period speaker, when hearing the sound of user A, it will be able to be seen according to incidence relation is corresponding
To the video image of user A, in this way, can easily determine on earth is who is making a speech, the prompt effect of electronic equipment is enhanced
Fruit checks or tries to figure out repeatedly without user, saves the operating time, improves user experience.
It is apparent to those skilled in the art that for convenience and simplicity of description, only with above-mentioned each function
The division progress of module can according to need and for example, in practical application by above-mentioned function distribution by different function moulds
Block is completed, i.e., the internal structure of device is divided into different functional modules, to complete all or part of function described above
Energy.The specific work process of the system, apparatus, and unit of foregoing description, can be with reference to corresponding in preceding method embodiment
Journey, details are not described herein.
In several embodiments provided herein, it should be understood that disclosed system, device and method can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the module or
The division of unit, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units
Or component can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, institute
Display or the mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, device or unit
Indirect coupling or communication connection can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can store in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially
The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words
It embodies, which is stored in a storage medium, including some instructions are used so that a computer
It is each that equipment (can be personal computer, server or the network equipment etc.) or processor (processor) execute the application
The all or part of the steps of embodiment the method.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory
(Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic or disk
Etc. the various media that can store program code.
Specifically, the corresponding computer program instructions of one of the embodiment of the present application information processing method can be deposited
It stores up on CD, hard disk, the storage mediums such as USB flash disk, when the computer journey corresponding with a kind of information processing method in storage medium
Sequence instruction is read or is performed by an electronic equipment, includes the following steps:
By at least one described image acquisition units acquire preset range in image information, when pass through one of sound
When sound acquisition unit detects the presence of the first acoustic information, determine that first acoustic information corresponds to the first position letter in orientation
Breath；
First acoustic information is marked according to the first location information, and determines that the first location information is corresponding
User is the first user；
The first video image corresponding with the first location information is obtained, first video image includes described first
The image of user, and first video image is marked according to the first location information；
It is established for first acoustic information and first video image of the first location information is equally marked
First incidence relation.
Optionally, it stored in the storage medium and step: is deposited when being detected by one of sound collection unit
In the first acoustic information, determine that first acoustic information corresponds to the first location information in orientation, corresponding computer instruction
During being performed, specifically include:
When detecting the presence of first acoustic information by one of sound collection unit, determine that the sound is adopted
Collect the location information in orientation corresponding to unit, and using determining location information as the first location information.
Optionally, store in the storage medium and step: the first view corresponding with the first location information is obtained
Frequency image, corresponding computer instruction specifically include during being performed:
According to the position corresponding relationship between sound collection unit and image acquisition units, the determining and sound collection list
The corresponding image acquisition units of member；
In the image of described image acquisition unit acquisition, administrative division map corresponding with the first location information is chosen
Picture, and using the area image as first video image.
Optionally, stored in the storage medium and step: to be equally marked described in the first location information
First acoustic information and first video image establish the first incidence relation, and corresponding computer instruction is specifically being performed it
Afterwards, further includes:
If detecting the presence of second sound information by one of sound collection unit, the second sound information is determined
The second location information in corresponding orientation；
If the second location information and the first location information are not same position information, according to the second
Second sound information described in information flag is set, and determines that the corresponding user of the second location information is second user；
The second video image corresponding with the second location information is obtained, second video image includes described second
The image of user, and second video image is marked according to second location information label；
It is established for the second sound information and second video image of the second location information is equally marked
Second incidence relation.
Optionally, stored in the storage medium and step: if the second location information and the first position are believed
Breath is not same position information, corresponding computer instruction after being specifically performed in, further includes:
For there are first acoustic informations of first incidence relation and first video image to establish jointly
Label is stored, stores first acoustic information and first video image according to the storage label of foundation.
Optionally, it stored in the storage medium and step: is really detected and is deposited by one of sound collection unit
In the first acoustic information, corresponding computer instruction is after being specifically performed, further includes:
Noise reduction process is carried out to first acoustic information.
Optionally, store in the storage medium and step: the first view corresponding with the first location information is obtained
Frequency image, corresponding computer instruction is after being specifically performed, further includes:
Control the area of first video image display area occupied on the display unit of the electronic equipment
Second area is changed by the first area, first area is less than the second area.
Optionally, stored in the storage medium with step: determine that the corresponding user of the first location information is the
One user, corresponding computer instruction is after being specifically performed, further includes: by facial recognition techniques, determines described first
First user information corresponding to user；Optionally, stored in the storage medium and step: to be equally marked described
First acoustic information and first video image of one location information establish the first incidence relation, and corresponding computer refers to
It enables during being specifically performed, comprising: be first acoustic information, first video image and first user
Information establishes first incidence relation.
The above, above embodiments are only described in detail to the technical solution to the application, but the above implementation
The explanation of example is merely used to help understand method and its core concept of the invention, should not be construed as limiting the invention.This
In the technical scope disclosed by the present invention, any changes or substitutions that can be easily thought of by those skilled in the art, should all cover
Within protection scope of the present invention.
Claims (16)
1. a kind of information processing method, be applied to electronic equipment, the electronic equipment include at least one image acquisition units and
At least one sound collection unit；It the described method comprises the following steps:
During carrying out multimedia document recording, acquired in preset range by least one described image acquisition units
Image information, wherein the image of each image acquisition units one user of corresponding acquisition, and all described image acquisition units of institute
It works at the same time, all users is recorded in the multimedia file；It is detected when by one of sound collection unit
There are when the first acoustic information, determine that first acoustic information corresponds to the first location information in orientation；
First acoustic information is marked according to the first location information, and determines the corresponding user of the first location information
For the first user；
The first video image corresponding with the first location information is obtained, first video image includes first user
Image, and first video image is marked according to the first location information；
First is established for first acoustic information and first video image of the first location information is equally marked
Incidence relation；
During user watches the multimedia file recorded, when exporting first acoustic information, according to described
First incidence relation exports first video image；Alternatively, being closed when exporting first video image according to described first
Connection relationship exports first acoustic information.
2. the method as described in claim 1, which is characterized in that when detecting the presence of by one of sound collection unit
When one acoustic information, determine that first acoustic information corresponds to the first location information in orientation, comprising: when pass through one of sound
When sound acquisition unit detects the presence of first acoustic information, the position in orientation corresponding to the sound collection unit is determined
Information, and using determining location information as the first location information.
3. method according to claim 2, which is characterized in that obtain the first video figure corresponding with the first location information
Picture, comprising:
According to the position corresponding relationship between sound collection unit and image acquisition units, the determining and sound collection unit pair
The image acquisition units answered；
In the image of described image acquisition unit acquisition, area image corresponding with the first location information is chosen, and
Using the area image as first video image.
4. the method as described in claim 1, which is characterized in that for the first location information is equally marked described
One acoustic information and first video image are established after the first incidence relation, further includes:
If detecting the presence of second sound information by one of sound collection unit, determine that the second sound information is corresponding
The second location information in orientation；
If the second location information and the first location information are not same position information, according to the second confidence
Breath marks the second sound information, and determines that the corresponding user of the second location information is second user；
The second video image corresponding with the second location information is obtained, second video image includes the second user
Image, and second video image is marked according to second location information label；
Second is established for the second sound information and second video image of the second location information is equally marked
Incidence relation.
5. method as claimed in claim 4, which is characterized in that if in the second location information and the first location information
After not being same position information, further includes:
For there are first acoustic informations of first incidence relation and first video image to establish common storage
Label stores first acoustic information and first video image according to the storage label of foundation.
6. method as claimed in claim 5, which is characterized in that detecting the presence of by one of sound collection unit
After one acoustic information, further includes: carry out noise reduction process to first acoustic information.
7. the method as described in claim 1-6 is any, which is characterized in that obtaining corresponding with the first location information the
After one video image, further includes:
The area of first video image display area occupied on the display unit of the electronic equipment is controlled by the
One area changes into second area, and first area is less than the second area.
8. the method as described in claim 1-6 is any, which is characterized in that determining the corresponding user of the first location information
After the first user, further includes: by facial recognition techniques, determine the first user information corresponding to first user；
First is established for first acoustic information and first video image of the first location information is equally marked
Incidence relation, comprising: establish described for first acoustic information, first video image and first user information
One incidence relation.
9. a kind of electronic equipment, the electronic equipment includes at least one image acquisition units and at least one sound collection list
Member；The electronic equipment further include:
First determining module, for passing through at least one described Image Acquisition list during carrying out multimedia document recording
Image information in member acquisition preset range, wherein the image of each image acquisition units one user of corresponding acquisition, and it is all
Described image acquisition unit works at the same time, and all users are recorded in the multimedia file；When pass through one of sound
When sound acquisition unit detects the presence of the first acoustic information, determine that first acoustic information corresponds to the first position letter in orientation
Breath；
Second determining module for marking first acoustic information according to the first location information, and determines described first
The corresponding user of location information is the first user；
Module is obtained, for obtaining the first video image corresponding with the first location information, the first video image packet
Image containing first user, and first video image is marked according to the first location information；
First establishes module, for first acoustic information and described first for the first location information is equally marked
Video image establishes the first incidence relation；
The electronic equipment is also used to during user watches the multimedia file recorded, when output described first
When acoustic information, first video image is exported according to first incidence relation；Alternatively, when exporting the first video figure
When picture, first acoustic information is exported according to first incidence relation.
10. electronic equipment as claimed in claim 9, which is characterized in that first determining module is specifically used for: when passing through it
In sound collection unit when detecting the presence of first acoustic information, determine side corresponding to the sound collection unit
The location information of position, and using determining location information as the first location information.
11. electronic equipment as claimed in claim 10, which is characterized in that the acquisition module is for obtaining and described first
Confidence ceases corresponding first video image, specifically:
According to the position corresponding relationship between sound collection unit and image acquisition units, the determining and sound collection unit pair
The image acquisition units answered；
In the image of described image acquisition unit acquisition, area image corresponding with the first location information is chosen, and
Using the area image as first video image.
12. electronic equipment as claimed in claim 9, which is characterized in that first determining module is also used to: described first
Establishing module is that first acoustic information that the first location information is equally marked and first video image are established
After first incidence relation, if detecting the presence of second sound information by one of sound collection unit, institute is determined
State the second location information that second sound information corresponds to orientation；
Second determining module is also used to: if the second location information and the first location information are not same position letters
Breath then marks the second sound information according to the second location information, and determines the corresponding use of the second location information
Family is second user；
The acquisition module is also used to: obtaining the second video image corresponding with the second location information, second video
Image includes the image of the second user, and marks second video image according to second location information label；
Described first, which establishes module, is also used to: for the second sound information and the institute that the second location information is equally marked
It states the second video image and establishes the second incidence relation.
13. electronic equipment as claimed in claim 12, which is characterized in that the electronic equipment further includes second establishing module,
For: if after the second location information and the first location information are not same position information, for there are described the
First acoustic information and first video image of one incidence relation establish common storage label, according to depositing for foundation
It stores up label and stores first acoustic information and first video image.
14. electronic equipment as claimed in claim 13, which is characterized in that the electronic equipment further includes processing module, is used for:
After detecting the presence of first acoustic information by one of sound collection unit, to first acoustic information into
Row noise reduction process.
15. the electronic equipment as described in claim 9-14 is any, which is characterized in that the electronic equipment further includes control mould
Block, for after the acquisitions module obtains corresponding with the first location information the first video image, control described the
The area of one video image display area occupied on the display unit of the electronic equipment changes into the by the first area
Two areas, first area are less than the second area.
16. the electronic equipment as described in claim 9-14 is any, which is characterized in that the electronic equipment further includes identification mould
Block is used for: after second determining module determines the corresponding user of the first location information for the first user, passing through face
Portion's identification technology determines the first user information corresponding to first user；
Described first, which establishes module, is specifically used for: using for first acoustic information, first video image and described first
Family information establishes first incidence relation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410455557.4A CN105389318B (en) | 2014-09-09 | 2014-09-09 | A kind of information processing method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410455557.4A CN105389318B (en) | 2014-09-09 | 2014-09-09 | A kind of information processing method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105389318A CN105389318A (en) | 2016-03-09 |
| CN105389318B true CN105389318B (en) | 2019-09-24 |
Family
ID=55421615
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410455557.4A Active CN105389318B (en) | 2014-09-09 | 2014-09-09 | A kind of information processing method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105389318B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107995543B (en) * | 2017-12-27 | 2019-12-03 | 广东小天才科技有限公司 | A kind of method and microphone apparatus of the closing of control microphone apparatus |
| CN108376058A (en) * | 2018-02-09 | 2018-08-07 | 斑马网络技术有限公司 | Sound control method and device and electronic equipment and storage medium |
| CN112153461B (en) * | 2020-09-25 | 2022-11-18 | 北京百度网讯科技有限公司 | Method and device for positioning sound production object, electronic equipment and readable storage medium |
| CN115225884A (en) * | 2022-08-30 | 2022-10-21 | 四川中绳矩阵技术发展有限公司 | Interactive reproduction method, system, device and medium for image and sound |
| CN115134581A (en) * | 2022-08-30 | 2022-09-30 | 四川中绳矩阵技术发展有限公司 | Fusion reproduction method, system, equipment and storage medium of image and sound |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20090107712A (en) * | 2008-04-10 | 2009-10-14 | (주)엠앤소프트 | Korean data searching method and system using the double indexing |
| CN201426153Y (en) * | 2009-05-27 | 2010-03-17 | 中山佳时光电科技有限公司 | Intelligent camera control system for video conference |
| CN101771814A (en) * | 2009-12-29 | 2010-07-07 | 天津市亚安科技电子有限公司 | Pan and tilt camera with sound identification and positioning function |
| CN103986901A (en) * | 2013-02-08 | 2014-08-13 | 中兴通讯股份有限公司 | Method for obtaining needed video streams in video conference and corresponding devices |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002271741A (en) * | 2001-03-13 | 2002-09-20 | Matsushita Electric Ind Co Ltd | Video sound contents compiling apparatus and method for imparting index to video sound contents |
-
2014
- 2014-09-09 CN CN201410455557.4A patent/CN105389318B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20090107712A (en) * | 2008-04-10 | 2009-10-14 | (주)엠앤소프트 | Korean data searching method and system using the double indexing |
| CN201426153Y (en) * | 2009-05-27 | 2010-03-17 | 中山佳时光电科技有限公司 | Intelligent camera control system for video conference |
| CN101771814A (en) * | 2009-12-29 | 2010-07-07 | 天津市亚安科技电子有限公司 | Pan and tilt camera with sound identification and positioning function |
| CN103986901A (en) * | 2013-02-08 | 2014-08-13 | 中兴通讯股份有限公司 | Method for obtaining needed video streams in video conference and corresponding devices |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105389318A (en) | 2016-03-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9064160B2 (en) | Meeting room participant recogniser | |
| CN105389318B (en) | A kind of information processing method and electronic equipment | |
| US7920158B1 (en) | Individual participant identification in shared video resources | |
| US7433327B2 (en) | Method and system for coordinating communication devices to create an enhanced representation of an ongoing event | |
| US8560309B2 (en) | Remote conferencing center | |
| CN104767963B (en) | Participant's information demonstrating method in video conference and device | |
| CN103621131B (en) | The method and system being accurately positioned for carrying out space to equipment using audio-visual information | |
| EP2890088B1 (en) | Method for displaying schedule reminding information, terminal device and cloud server | |
| CN110232925A (en) | Generate the method, apparatus and conference terminal of minutes | |
| US9530067B2 (en) | Method and apparatus for storing and retrieving personal contact information | |
| CN104270806B (en) | Transmission power adjustment method and device | |
| US10468051B2 (en) | Meeting assistant | |
| WO2018049957A1 (en) | Audio signal, image processing method, device, and system | |
| GB2342802A (en) | Indexing conference content onto a timeline | |
| JP2011033993A (en) | Information presenting apparatus and method for presenting information | |
| CN107578777A (en) | Word-information display method, apparatus and system, audio recognition method and device | |
| CN109257498B (en) | Sound processing method and mobile terminal | |
| CN105610591B (en) | System and method for sharing information among multiple devices | |
| CN107785037A (en) | Use the method, system and medium of audio time code synchronized multimedia content | |
| CN108989736B (en) | Multimedia resource encryption method, device, system, storage medium and processor | |
| CN103984931B (en) | A kind of information processing method and the first electronic equipment | |
| CN109040245A (en) | The shared method and device of a kind of multiple videos, audio | |
| US10841368B2 (en) | Method for presenting schedule reminder information, terminal device, and cloud server | |
| CN114466283A (en) | Audio acquisition method and device, electronic equipment and peripheral component method | |
| JP2009239346A (en) | Photographing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |