Embodiment
For making the object of the invention, technical scheme and advantage clearer, will combine accompanying drawing that embodiment of the present invention is done to describe in detail further below.
Referring to Fig. 1, use camera for a kind of terminal equipment that the embodiment of the invention one provides, said camera comprises housing 1, camera lens 2, camera lens keeper 4, horizontal motor 5, microphone array 7 and audio frequency and video processing unit 8,
Said camera lens 2, camera lens keeper 4 and horizontal motor 5 are contained in the said housing 1, and said housing is a transparent region corresponding to the zone (zone shown in the mark A among the figure) of camera lens;
Said horizontal motor 5 is connected to movably camera lens keeper 4 through horizontal motor connecting portion 50;
Said camera lens 2 is connected to movably camera lens keeper 4 through camera lens connecting portion 20.
Said microphone array 7 is electrically connected with audio frequency and video processing unit 8, the target speech signal of gathering is sent to audio frequency and video processing unit 8, so that 8 pairs of targets of audio frequency and video processing unit are carried out orientation;
Said camera lens 2 is electrically connected with audio frequency and video processing unit 8, gathers the target image of oriented target and is sent to audio frequency and video processing unit 8, so that 8 pairs of targets of audio frequency and video processing unit position.
Be the exemplary position relation between each parts that shows among Fig. 1, for example, can adjust the installation site of audio frequency and video processing unit in housing 1 as required.
8 pairs of targets of above-mentioned audio frequency and video processing unit are carried out orientation, confirm the general location direction of target, and audio frequency and video processing unit 8 can adopt time delay to estimate mode, confirm the direction position of target according to the time-delay of each microphone of target speech signal arrival.
When target is accurately located (as confirming the position of people's face), the audio frequency and video processing unit can adopt motion target tracking algorithm and people's face detection algorithm to confirm the position of target head.
Above-mentioned transparent region A can be formed by the transparent material on the housing, perhaps, forms through the perforation on the housing.
After horizontal motor 5 started, horizontal motor connecting portion 50 drove camera lens keeper 4 and moves, and the mobile meeting of camera lens keeper 4 is moved camera lens connecting portion 20, and camera lens 2 is moved, thereby reaches the effect of adjustment camera angle.In the present embodiment horizontal driven by motor camera lens keeper in the horizontal direction (left and right directions) move, the camera angle of being adjusted is mainly horizontal camera angle.
The embodiment of the invention is connected to the camera lens keeper through movably camera lens keeper is set respectively with horizontal motor and camera lens, and after utilizing microphone array and audio frequency and video processing unit that target is carried out orientation; Utilize camera lens and audio frequency and video processing unit that target is carried out pinpoint technological means, can pass through camera lens keeper moving lens after making horizontal electric motor starting, change the camera angle of camera lens; And; Can realize the variation of auto-acquire position, realize the automatic adjustment of camera angle, thereby improved photographic effect; Convenient for users, strengthened user experience.
For the ease of the clear technical scheme of describing the embodiment of the invention; In inventive embodiment; Adopted printed words such as " first ", " second " that function is distinguished with essentially identical identical entry of effect or similar item, it will be appreciated by those skilled in the art that printed words such as " first ", " second " do not limit quantity and execution order.
A kind of terminal equipment that provides in the face of the embodiment of the invention two down describes with camera.Be television set with the terminal equipment in the present embodiment, camera is that the scene of used as television camera is that example describes.
Said camera comprises housing, camera lens, camera lens keeper and horizontal motor, and said camera lens, camera lens keeper and horizontal motor are contained in the said housing, and said housing is a transparent region corresponding to the zone of camera lens; Said horizontal motor is connected to movably camera lens keeper through horizontal motor connecting portion; Said camera lens is connected to movably camera lens keeper through the camera lens connecting portion.
Present embodiment is realized camera angle adjustment in the horizontal direction through above-mentioned horizontal motor.
Further, said camera lens keeper is a gear, be respectively arranged with on said camera lens connecting portion and the horizontal motor connecting portion with as the corresponding tooth of the gear of camera lens keeper.
Tooth on the camera lens connecting portion is meshed with gear as the camera lens keeper; Thereby camera lens and camera lens keeper are linked together; Tooth on the horizontal motor connecting portion is meshed with the gear as the camera lens keeper, thereby horizontal motor and camera lens keeper are linked together.
Further, housing described in the present embodiment comprises first housing section and second housing section, be connected through shaft between said first housing section and second housing section,
Said camera lens, camera lens keeper and horizontal motor are contained in said first housing section;
The outer setting of said second housing section has the housing connecting portion, and said housing connecting portion is connected with guide rail on being arranged on terminal equipment, and said housing connecting portion is connected with the motor vertical connecting portion of set motor vertical.
Referring to Fig. 2; Show the structural representation of camera under the rise state; First housing section 11 is positioned at the top at terminal equipment (television set) display screen top, and second housing section 12 is fitted in the display screen back, and the junction between first housing section 11 and second housing section 12 is a shaft 13.
Referring to Fig. 3, show the structural representation of camera under the landing state, first housing section 11 and second housing section 12 all are fitted in the display screen back.
The motor vertical of present embodiment setting can make housing integral body move in vertical direction along guide rail, thereby realizes the rising and the decline of camera.This processing mode; When not using camera; Camera can be retracted to the back of television set, has guaranteed integrally-built compactedness of television set and aesthetic property on the one hand, on the other hand; Avoid camera owing to giving prominence to the problem that is easy to damage at the television set top, improved the fail safe of camera equipment.
Further; Present embodiment can make camera after rising and conforming to the television set over top through the adjustment of guide rail and the concrete size of housing, continues to move to the top; Thereby realize in vertical direction adjustment, for the user provides better shooting experience and imaging effect to camera angle.
The present embodiment housing is set to the two-part structure of first housing section and second housing section, and shaft has tension force, and after this tension force rose the housing of camera, first housing section can lean forward automatically and conform to the display screen top.This processing mode has increased the flexibility of camera structure, and camera and terminal equipment are fitted more, and overall structure is compact more, and profile is more attractive in appearance, and helps to improve imaging effect.
In a kind of example, in the shaft 13 torsion spring is set, when the tension force through torsion spring rose camera, first housing section leaned forward automatically and conforms to the display screen top, and during the camera landing, first housing section is fitted in the back of display screen with second housing section.
In the scene shown in Figure 3; Guide rail 7, motor vertical 6 are arranged on a side of housing; Housing connecting portion 14 is connected with guide rail 7 on being arranged on terminal equipment (like the display screen of terminal equipment), and the motor vertical connecting portion of said housing connecting portion 14 and set motor vertical 6 60 connects mutually.Further; In the present embodiment in order to guarantee that camera can steadily go up and down; Be provided with two (or many) guide rails, and two housing connecting portions are set on housing accordingly, for example; The position (like the medianly zygomorphic position of second housing section) of symmetry is provided with two housing connecting portions 14 in the horizontal direction in the outside of second housing section 12, said two housing connecting portions respectively be arranged on terminal equipment on two guide rails be connected.At this moment, can utilize a motor vertical to move along corresponding guide rail respectively, perhaps, also can a motor vertical be set for each housing connecting portion through driving a plurality of housing connecting portions.The position of motor vertical can be arranged on a side of housing, also can be arranged on the position at the middle part of corresponding housing, and in Fig. 3, the position between P1 and the P2 is so that the up-down of camera is more steady.
In the present embodiment; Guide rail can be arranged on the left and right sides of housing; Or be arranged on the position at the middle part of corresponding housing, the position shown in P1 and P2 in the corresponding diagram 3 is provided with a guide rail respectively on television set, with further in lifting process, guarantee camera steadily.At this moment, the position of set housing connecting portion should be corresponding to the position of guide rail, so that guarantee successfully being connected of housing connecting portion and guide rail.
Exemplary, above-mentioned housing connecting portion is a gear, be respectively arranged with on said guide rail and the said motor vertical connecting portion with as the corresponding tooth of the gear of housing connecting portion.Tooth on the guide rail is meshed with gear as the housing connecting portion, thereby guide rail and housing connecting portion are linked together, and the tooth on the motor vertical connecting portion is meshed with gear as the housing connecting portion, thereby motor vertical and housing connecting portion are linked together.
Camera is connected with guide rail through the housing connecting portion on the housing; And be connected with motor vertical; Thereby make camera with a kind of integral body movably mode be connected on the terminal equipment of main body, realize the purpose of adjustment camera angle, and can prevent accidental damage camera.
Be appreciated that; Above-mentioned camera lens keeper and housing connecting portion also can be realized by other devices outside the gear, for example, and rotating shaft etc.; Accordingly, the camera lens keeper also can change because concrete realization parts are different with the connected mode of miscellaneous part with the housing connecting portion.
From the above mentioned, horizontal motor, gear (camera lens keeper) and camera lens constitute an organic whole in the present embodiment.When horizontal electric motor starting, driven gear rotates, thereby drives the camera move left and right, realizes the purpose of the horizontal camera angle of adjustment; Motor vertical, gear (housing connecting portion) and guide rail constitute an organic whole, and when motor vertical started, driven gear went up and down along guide rail, realize the integrally-built up-down of camera.
Present embodiment can also be provided with a substrate with the zone that television set (like the display screen of television set) contacts at the housing of camera, is convenient to the installation and the slip of camera, makes camera fit in television set more.
Three pairs of terminal equipments of the embodiment of the invention describe with the concrete working method of camera, and present embodiment uses the scene of camera to describe as example with TV a kind of translator, that can adjust camera angle.
TV among the present invention is used camera, has two motors, a horizontal motor and a motor vertical, and it can the demand according to the user adjust camera angle under the control of audio frequency and video processing unit.
Further; Said camera comprises communication interface and audio frequency and video processing unit; One end of said communication interface is connected to terminal equipment; The other end of said communication interface is connected to the audio frequency and video processing unit, and said audio frequency and video processing unit is connected with the motor drive ic of horizontal motor and the motor drive ic of motor vertical respectively.Said camera also comprises audio collection device (like microphone), and said audio collection device is connected to said audio frequency and video processing unit.
Motor vertical can make camera at the withdrawal of time spent not television set back, keeps the globality and the aesthetic property of television set; Rise in use, supply user's use of making a video recording, when needed, motor vertical can be increased to the over top of television set and the position that the top has certain intervals with camera, to adjust the angle of vertical shooting.The horizontal camera angle that horizontal motor is mainly used in the adjustment camera obtains better imaging effect.
Referring to Fig. 4, show the internal structure sketch map of camera.Be provided with in the camera that camera lens is used to gather video image information, MIC (microphone) array is used for audio frequency acquiring information, audio frequency and video processing unit, motor and corresponding electrode chip for driving, communication interface (television interface).
Horizontal motor that adopts in the present embodiment and motor vertical all are a kind of stepping motor, and stepping motor belongs to a kind of induction machine, are its power supply through motor drive ic, make the motor operate as normal.
The user can drive the motor on the camera through the button on remote controller or the TV, regulates the horizontal and vertical position of camera, and concrete steps are following:
1: television set receives the user through the direction button of remote controller or the signal instruction of the transmission of the button on the television set.
2: television set sends signal instruction to the audio frequency and video processing unit of camera through television interface.
The television interface of television set is sent to the communication interface (television interface) of camera with signal instruction, and the communication interface of camera is sent to the audio frequency and video processing unit with signal instruction.
3: the audio frequency and video processing unit of camera produces order accordingly according to this signal instruction, sends to corresponding motor drive ic.
4: motor drive ic drives corresponding motor, makes camera vertical moving or horizontal adjustment.
Motor drive ic A drives horizontal motor A, after horizontal motor A starts, drives the camera lens move left and right; Motor drive ic B drives motor vertical B, after motor vertical B starts, drives the camera lens vertical moving.
The terminal equipment that above-mentioned steps 1 to 4 provides a kind of external command according to the user to adjust camera angle is used camera; Yet; Present embodiment also provides a kind of variation that can auto-acquire (like the user) position; Initiatively adjust the terminal equipment of camera camera angle and use camera, the concrete processing as follows:
The dynamic tracing function is set in the audio frequency and video processing unit; When needs are adjusted angle lens automatically, launch the dynamic tracing function of audio frequency and video processing unit, moving of user caught in beginning automatically; According to user's current location, initiatively adjust the imaging visual angle of camera.
Main application scenarios of the present invention is that domestic TV connection network carries out video calling or video-game; The occasion of perhaps handling official business is carried out video conference etc.Exemplary; The mode that present embodiment adopts auditory localization to combine people's face location to combine; Confirm user's current location; At first confirm the approximate location direction (orientation) at user place, confirm user's accurate position at the Sounnd source direction of monitoring out then according to user's sound, and the imaging visual angle of adjustment camera.
(1) auditory localization technology
The voice communication environment that is widely used in having noisy background based on the auditory localization technology of microphone array is like meeting-place, multi-media classroom etc., to improve speech quality.Microphone array is listed on the basis of time domain and frequency domain has increased a spatial domain, and the voice signal from the space different directions that receives is handled, and can realize speaker's real-time tracking.In the present embodiment, as shown in Figure 3, classify example as with 4 microphone array that microphone was constituted that are arranged side by side respectively in twos and describe.
Adopt in the present embodiment based on the time delay estimation approach, use microphone array that sound source is positioned.Based on the time delay estimation approach; Because arriving each microphone life period, the signal (target speech signal) that sound source is sent postpones; Dependency relation according between each MIC channel signal estimates time delay, thereby sound source position is estimated, confirms the direction position of target.This method is calculated very fast, can reach real-time requirement.The microphone array that present embodiment adopts 4 MIC to constitute can cover 150 ° camera angle.
Optional, the mode that also can utilize microphone array to adopt directional beam to form positions sound source.Directional beam forms a kind of form that is based on peak power output steerable beam method; The voice signal that this method receives microphone array carries out the wave beam of filter delay and weighted sum formation particular orientation; Calculate the beam energy that each points to then; Wherein, prominent direction is exactly approximate to a maximum of sound source position in the search volume, with the direction of this direction as determined target.
(2) people's face location technology
The recognition of face of broad sense comprises a series of correlation techniques that make up face identification system, searches like man face image acquiring, people's face location, recognition of face preliminary treatment, identity validation and identity etc.Application scenarios of the present invention need not carry out final identity validation, and the position that only need track people's face gets final product, so present embodiment adopts man face image acquiring, people's face location technology.
The related algorithm of people's face location mainly contains two types: the algorithm that based target is followed the tracks of, the method that people's face detects and target tracking algorism combines.The motion target tracking algorithm that the algorithm that based target is followed the tracks of places one's entire reliance upon is found out people's face from moving target, do not make full use of the characteristic of people's face, therefore in face tracking, uses seldom separately.The method that people's face detection and tracking algorithm combines is on the based target track algorithm, utilizes the relevant information (the for example colour of skin, organ distribution etc.) of people's face to reach the purpose of quick tracking.
Automatically under the mode at the imaging visual angle of adjustment camera, main performing step is following:
A) camera rises to the television set top, and camera is started working.
B) the MIC array begins to catch sound, and camera lens begins to catch image.
Camera gets access to audio, video data through microphone array and camera lens, to guarantee successfully to realize video calling.
C) the audio frequency and video processing unit is judged the general location of sound source through the auditory localization technology.
When starting the dynamic tracing function, target (user) moves when causing sound source position to change, and camera calculates the time delay that sound source (target speech signal) arrives each microphone, judges the general location of sound source, thereby confirms the direction position of target.
D) the audio frequency and video processing unit drives horizontal motor (and/or motor vertical), makes cam lens towards Sounnd source direction.
E) the audio frequency and video processing unit is confirmed the position of people's face according to people's face location technology.
The image of target on the camera collection Sounnd source direction adopts motion target tracking algorithm and people's face detection algorithm to confirm the position of target head (mainly being people face), so that target is accurately located.
F) the audio frequency and video processing unit drives horizontal motor, and the camera direction is finely tuned, and makes the center of people's face at image pickup scope.
By above-mentioned steps A) to F) realized the camera angle of automatic adjustment camera.
The embodiment of the invention four also provides the implementation method of a kind of terminal equipment with camera, and referring to Fig. 5, said method comprises:
51: the camera lens of camera is arranged in the housing, and wherein, said housing is a transparent region corresponding to the zone of camera lens;
52:, and said camera lens connecting portion is connected to said camera lens keeper for said camera lens is provided with camera lens connecting portion and camera lens keeper movably;
53: horizontal motor is set in housing, and the connecting portion of horizontal motor is connected to said camera lens keeper,, camera lens is moved through the moving lens keeper with behind horizontal electric motor starting.
54: when target moves; Gather the target speech signal of target through set microphone array; And utilize the audio frequency and video processing unit target to be carried out orientation according to said target speech signal; For example, utilize the audio frequency and video processing unit to adopt time delay to estimate mode, confirm the direction position of target according to the time-delay of each microphone of target speech signal arrival.
55: gather the target image of directional aim through said camera lens; And utilize the audio frequency and video processing unit that said target is positioned according to said target image; For example; Utilize the audio frequency and video processing unit to adopt motion target tracking algorithm and people's face detection algorithm to confirm the position of target head, so that target is positioned.
56: utilize the horizontal motor of audio frequency and video processing unit startup, camera lens is moved to and the corresponding position of target of being located by horizontal motor.
Present embodiment does not carry out the strictness qualification to the execution order of above-mentioned each step, for example, can in housing, be provided with after the camera lens keeper yet, and camera lens and horizontal motor are set again.
Further, said housing comprises first housing section and second housing section, is connected through shaft between said first housing section and second housing section, is provided with torsion spring in the said shaft, and said method also comprises:
Said camera lens, camera lens keeper and horizontal motor are contained in said first housing section;
Outer setting housing connecting portion in said second housing section; And said housing connecting portion is connected with guide rail on being arranged on terminal equipment; And; Said housing connecting portion is connected with the motor vertical connecting portion of set motor vertical, after starting, camera lens is moved through mobile shell when said motor vertical.
Further, said camera lens keeper is a gear, on said camera lens connecting portion and horizontal motor connecting portion, be provided with respectively with as the corresponding tooth of the gear of camera lens keeper.
Further, the position of symmetry is provided with two housing connecting portions in the horizontal direction in the outside of said second housing section, said two housing connecting portions respectively be arranged on terminal equipment on two guide rails be connected.
Said housing connecting portion is a gear, be respectively arranged with on said guide rail and the said motor vertical connecting portion with as the corresponding tooth of the gear of housing connecting portion.
Further, for said camera is provided with communication interface and audio frequency and video processing unit, an end of said communication interface is connected to terminal equipment, and the other end of said communication interface is connected to the audio frequency and video processing unit; Said audio frequency and video processing unit is connected with the motor drive ic of horizontal motor and the motor drive ic of motor vertical respectively.
The concrete executive mode of each step can be referring to the embodiment of equipment of the present invention among the inventive method embodiment.
From the above mentioned, the embodiment of the invention is connected to the camera lens keeper through movably camera lens keeper is set respectively with horizontal motor and camera lens; And after utilizing microphone array and audio frequency and video processing unit that target is carried out orientation, utilize camera lens and audio frequency and video processing unit that target is carried out pinpoint technological means, can pass through camera lens keeper moving lens after making horizontal electric motor starting; Change the camera angle of camera lens, and, can realize the variation of auto-acquire position; Realize the automatic adjustment of camera angle; Thereby improved photographic effect, convenient for users, strengthened user experience.
Camera can vertical lift in the embodiment of the invention; Can be user-friendly to; The globality and the aesthetic property that when not using camera, can keep terminal equipment (like television set) outward appearance also can prevent the accidental damage to camera simultaneously, and the horizontal adjustment of camera; Then can adjust the camera angle of camera, provide the user better to make a video recording and experience and imaging effect.
The above is merely preferred embodiment of the present invention, is not to be used to limit protection scope of the present invention.All any modifications of within spirit of the present invention and principle, being done, be equal to replacement, improvement etc., all be included in protection scope of the present invention.