CN103713732A - Personal portable device - Google Patents
Personal portable device Download PDFInfo
- Publication number
- CN103713732A CN103713732A CN201210376073.1A CN201210376073A CN103713732A CN 103713732 A CN103713732 A CN 103713732A CN 201210376073 A CN201210376073 A CN 201210376073A CN 103713732 A CN103713732 A CN 103713732A
- Authority
- CN
- China
- Prior art keywords
- gesture
- camera
- personal portable
- intelligent personal
- portable device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a personal portable device which comprises a carrier, a processor, a camera, two passive infrared sensors, a storage device and a power module. The passive infrared sensors are respectively arranged on two sides of the carrier. The camera adopts a gesture control mode and is opened up through time difference of double-handed action sensed by the passive infrared sensors, and relevant operation of picture taking or camera shooting can be controlled to complete through gesture recognition. The personal portable device is simple and convenient to operate, and the gesture control mode is humanized.
Description
Technical field
The present invention relates to electronic device field, particularly relate to and a kind ofly make to use gesture and voice-operated portable intelligent individual portable device.
Background technology
Nowadays various electronic products emerge in an endless stream, however the input of traditional button, and nowadays dark ace-high touch-screen input mode cannot meet people completely to facilitating the higher demand of prompt operation.
For example, when people want to take pictures or photograph, need to from bag, draw out camera or with mobile phone, the panel computer of camera function, then open camera lens, switch mode, focus and flashlamp, just can take.And when everything is ready, may miss those written in water beautiful moments.People always need resonablely along spending some times on earphone cord before listening to the music for another example, or have to open eyes the song that screens switch wants when having a rest closing the eyes for rest.
Gesture and language are expression waies the most frequently used in mankind's activity, and the most hint expression of people all depends on gesture and language.And that gesture is compared language is more original, more general, also mean operation more easily.If can use gesture, realize taking pictures, make a video recording, search the control of these common functions of song fast with language, that will save a large amount of operation burdens.
Nowadays more existing companies make contributions in the man-machine interaction mode of gesture identification.For example MS is for the kinect in XBOX, X360 platform user, and the Intelligent gesture RTV remote television of Korea S Samsung.It is pointed out that at present the developing direction in this field is still not clear, application product is very few especially, concentrates on to take game control and the minority home security field that TV is visualisation platforms.
Except the input mode of more optimizing, people are also pursuing more humane electronic product outward appearance and the form of expression thereof.Mobile phone, panel computer, notebook computer are all hand-held visual device, they are carried to the use burden that can increase the weight of user simultaneously, and the form of expression are overlapping.
Therefore, for more and more faster people of rhythm of life instantly, need a kind of with better functionly, carry electronic equipment more easily, and this equipment should operate more aspect, only need speak and wave just can easily realize the feature operation that people want to it.As the carry-on equipment of individual, need to a kind ofly compare the outward appearance that the hand-held outward appearance of visual and user's viscosity are higher, as wear-type simultaneously.
Summary of the invention
In order to address the above problem, fundamental purpose of the present invention has been to provide and has a kind ofly made to use gesture and voice-operated wear-type individual portable device, and by several functions, the outward appearance with wear-type object presents for it, and more humane mode of operation is provided.
To achieve these goals, intelligent personal portable device provided by the present invention, comprises carrier,
Being used for the processor of control system is arranged on described carrier,
Being used for the camera of receiving optical signal is arranged on described carrier,
At least one passive infrared inductor is arranged on described carrier,
The memory device that is used for storing data is arranged on described carrier, and
Provide the power module of power supply to be arranged on described carrier,
Wherein, described camera adopts gesture control mode: described camera is opened by passive infrared inductor induction hand, and utilizes gesture identification to control it to complete the associative operation of taking pictures or making a video recording.
Further, described intelligent personal portable device also comprises that at least one is used for the microphone that the receiver of output audio and is used for receiving user speech instruction and is arranged on carrier.
Further, the quantity of described passive infrared inductor is two, and these two passive infrared inductors are separately positioned on the both sides of described carrier.
Further, the method for the manual camera in described intelligent personal portable device, comprises with step:
(1) a default time threshold values;
(2) by two passive infrared inductors, respond to respectively the action of both hands;
(3) calculate the mistiming that both hands start action the mistiming that two hands of comparison lift and the size of Preset Time threshold values;
(4) if the mistiming is less than default time threshold values, open camera; If the mistiming is greater than default time threshold values, do not open camera;
(5), after camera is opened, by gesture identification, control the associative operation that camera is taken pictures or made a video recording.
Further, the method for described manual camera also comprises: when opening camera, open microphone, by phonetic entry, select to enter exposal model or video recording pattern.
Further, described step (5) specifically comprises the following steps:
(51) image of camera collection is carried out to the region that Face Detection is determined hand;
(52) hand in image-region is carried out to gesture identification, determine gesture motion;
(53) carry out the default corresponding operating of gesture motion.
Further, described step (5) also comprises, according to fixed gesture motion, next gesture motion is given a forecast.
Further, described in described intelligent personal portable device, carrier is wear-type object.
Further, described in described intelligent personal portable device, carrier is bi-telephone, and wherein, the receiver of bi-telephone is the receiver of intelligent personal portable device, the microphone of bi-telephone is the microphone of intelligent personal portable device, and two passive infrared inductors lay respectively on two receivers.
Alternatively, described in described intelligent personal portable device, carrier is glasses, wherein, described camera is arranged on eyeglasses frame turning, described receiver is arranged on leg of spectacles end, and described microphone is arranged on leg of spectacles bottom near one end of eyeglass, and described touch pad is arranged on the both sides of leg of spectacles.
Alternatively, carrier described in described intelligent personal portable device is cap, the helmet or one-sided earphone.
Further, described intelligent personal portable device also comprises that at least one touch pad is arranged on carrier, by up and down or the touch pad that horizontally slips realize the difference that audio frequency is play and control.
Further, described intelligent personal portable device also comprises that a bluetooth module is arranged on carrier.
Further, described intelligent personal portable device also comprises that a GPS module is arranged on carrier.
Further, the gesture motion in the method for described manual camera, comprises
Gesture a: both hands finger palm is at same plane, stretch out respectively thumb and forefinger, make thumb and forefinger at tiger's jaw place, be 60-110 ° of angle, draw its excess-three in and refer to, the tiger's jaw of both hands is places horn shape, represents a pair of diagonal angle of photo frame, than the gesture that marks a rectangle edge frame of photo frame, determine coverage, wherein, under exposal model, gesture a is expressed as and determines camera lens viewfinder range; Under video recording pattern, gesture a represents to start or finish video recording;
Gesture b: both hands keep the shape as described in gesture a, draw in as focusing on, otherwise for defocusing, described gesture b represents the camera lens under exposal model to carry out convergent-divergent to center;
Gesture c: the singlehanded action of the five fingers, the expression unlatching Night of stretching out by clenching fist in a Preset Time section; Otherwise gesture c': one hand is stretched out the action of clenching fist by the five fingers in a Preset Time section, represents to close Night;
Gesture d: one hand is fired the action of finger, represents to open or close flashlamp;
Gesture e: one hand stretches out thumb and forefinger, draws its excess-three in and refers to, separately thumb and forefinger finger represent to focus on, and draw close thumb and forefinger and represent to defocus.
Further, the method for described manual camera, under exposal model, recording user both hands tiger's jaw position A (x
a, y
a), B (x
b, y
b) position in image coordinate, when preserving image, with this position, image is carried out to surface trimming.
Further, under exposal model, keep static after adopting gesture b to adjust the camera lens of camera, keep after gesture a a period of time, described processor is controlled camera and is automatically started shutter and take pictures.
Beneficial effect of the present invention is: intelligent personal portable device of the present invention is light wearable, tightr with user's combination, and form of expression hommization, mode of operation image, convenient, user only need make very natural, intelligible gesture and can control this device, realizes the light man-machine interaction mode that similar person to person exchanges.The present invention can present with the form of bi-telephone, also can present with the form of other wear-type objects such as glasses, cap, the helmet, one-sided earphone.
Accompanying drawing explanation
Fig. 1 is each components and parts work schematic diagram of intelligent personal portable device;
Fig. 2 is that carrier is the front elevation of the carrier intelligent personal portable device of bi-telephone;
Fig. 3 is that carrier is the stereographic map of the intelligent personal portable device of bi-telephone;
Fig. 4 is that carrier is the stereographic map of the intelligent personal portable device of glasses;
Fig. 5 is the process flow diagram of camera work;
Fig. 6 is the present invention gesture a used;
Fig. 7 is the present invention gesture b used;
Fig. 8 is the present invention gesture c used;
Fig. 9 is the present invention gesture d used;
Figure 10 is the present invention gesture e used.
Embodiment
Below in conjunction with accompanying drawing, the present invention is described in further detail.
As shown in Figure 1, a kind of intelligent personal portable device, comprise a kind of wear-type carrier, being used for the processor 12 of control system is arranged on described carrier, being used for the camera 2 of receiving optical signal is arranged on described carrier, at least one passive infrared inductor 8 is arranged on described carrier, and the memory device 14 that is used for storing data is arranged on described carrier, and provides the power module 20 of power supply to be arranged on described carrier.Wherein said camera 2 adopts gesture control modes, and described camera 2 is opened by passive infrared inductor 8 induction hands, and utilizes gesture identification to control it to complete the associative operation of taking pictures or making a video recording.
Further, the quantity of described passive infrared inductor 8 is two, and these two passive infrared inductors 8 are separately positioned on the both sides of described carrier.
Further, described intelligent personal portable device also comprises that at least one is used for the microphone 6 that the receiver 4 of output audio and is used for receiving user speech instruction and is arranged on carrier.
Further, described intelligent personal portable device also comprises that at least one touch pad 10 is arranged on carrier.
Further, described intelligent personal portable device also comprises that a bluetooth module 16 is arranged on carrier, is used for carrying out Wireless Data Transmission with other mobile terminals.
Further, described intelligent personal portable device also comprises that a GPS module 18 is arranged on carrier, is used for recording geographical position.
Described carrier can be the wear-type objects such as bi-telephone, glasses, cap, the helmet, one-sided earphone.
Intelligent personal portable device provided by the present invention, gesture is controlled the method for camera 2, specifically comprises the following steps:
(1) a default time threshold values;
(2) by two passive infrared inductors 8, respond to respectively the action of both hands;
(3) calculate the mistiming that both hands start action the mistiming that two hands of comparison lift and the size of Preset Time threshold values;
(4) if the mistiming is less than default time threshold values, open camera 2; If the mistiming is greater than default time threshold values, do not open camera 2;
(5) after camera 2 is opened, by gesture identification, control the associative operation that camera 2 is taken pictures or made a video recording.
When opening camera 2, open microphone 6, the voice signal of inputting by judgement, selection enters exposal model or video recording pattern, if microphone 6 does not receive voice signal in Preset Time, is defaulted as exposal model;
Step (5) specifically comprises:
(51) image of camera 2 inputs is carried out to the region that Face Detection is determined hand;
(52) hand in image-region is carried out to gesture identification, determine gesture motion;
(53) carry out the default corresponding operating of gesture motion.
Step (51) comprising: the image gathering is mated with default skin tone value, maximum connected region delimited as the possible region of hand.
Step (52) comprising: default graphic feature storehouse, the figure in opponent region mates with default graphic feature storehouse, determines gesture.
Described step (5) also comprises, according to fixed gesture motion, the position to next gesture motion in image gives a forecast, thereby saves system resource.
In conjunction with the process flow diagram shown in Fig. 5, describe the method for work of camera 2 in detail.Passive infrared inductor 8 is held open state, prepares to catch at any time user's input gesture.In order to save the energy, in the situation that there is no signal input, camera 2 and microphone 6 are in closed condition.When user lifts both hands and prepares to take pictures, the both hands that now lift enter the induction range of passive infrared inductor 8, and two passive infrared inductors 8 receive infrared input signal.In order to reduce False Rate, a default time threshold Δ t, if the mistiming that two passive infrared inductors 8 sense signal at this moment between in threshold value Δ t, think that user put hands up to do gesture and take simultaneously, otherwise think the non-user of this signal input signal for shooting.There are a lot of situations can cause erroneous judgement, the walking about of pedestrian in face of user for example, the setting of this threshold value can be reduced in walking about to taking the probability of the erroneous judgement of action of people in infra-red range.If be judged as user, do shooting action, open camera 2, open the microphone 6 of being controlled by a timing circuit, at Preset Time section t simultaneously
mode-selectin, allow user select screening-mode by voice mode, at t
mode-selectin time, microphone 6 is responsible for receiving user speech input signal.If at t
mode-selectin time, do not receive voice signal, be defaulted as exposal model, if receive " shooting ", the voice of " video recording " etc., select video recording pattern.After selecting wherein a kind of pattern, confirm screening-mode, close passive infrared inductor 8, until take, finish, then open passive infrared inductor 8, wait for and receive instruction next time.
Described camera 2 take pictures and recording function is controlled by simple gesture, conventional gesture motion and corresponding function thereof are as follows:
Gesture a: both hands finger palm is at same plane, stretch out respectively thumb and forefinger, make thumb and forefinger at tiger's jaw place, be 60-110 ° of angle, drawing its excess-three in refers to, the tiger's jaw of both hands is places horn shape, represent a pair of diagonal angle of photo frame, than the gesture that marks a rectangle edge frame of photo frame, determine coverage, as shown in Figure 6.
Under exposal model, gesture a is expressed as and determines camera lens viewfinder range; Under video recording pattern, gesture a represents to start or finish video recording.
Gesture b: both hands keep the shape as described in gesture a, draws in to center as focusing on, otherwise for defocusing.This gesture b represents the camera lens under exposal model to carry out convergent-divergent, as shown in Figure 7.
Under exposal model, adopt gesture b to adjust after the camera lens of camera, both hands keep static a period of time, keep gesture a over time, and processor 12 starts a delay circuit and controls camera automatic shutter that starts in a Preset Time.Because user's hand can not keep static completely, a therefore default vectorial mould threshold value, if the unique point moving range of continuous a few two field picture users' hand is in this threshold value, regards as static; Otherwise think that hand is still moving, and finds a view and is not over yet.
Gesture c: one hand is stretched out the action of the five fingers by clenching fist in a Preset Time section, as shown in Figure 8.This gesture c represents to open Night, otherwise, gesture c': singlehanded by stretching out the five fingers to the action of clenching fist in a Preset Time section, represent to close Night.
Gesture d: one hand is fired the action of finger, as shown in Figure 9.Default mode is automatic flash light.User can open or close flashlamp by gesture d, and under flashlamp closed condition, the action of making gesture d represents to open flashlamp; Under flashlamp open mode, the action of making gesture d represents to close flashlamp.
Gesture e: one hand stretches out thumb and forefinger, draws its excess-three in and refers to, the action of these two fingers is separated and drawn close to shape, as pinched an object with thumb and forefinger,, as shown in figure 10.This gesture e, under video recording pattern, carries out convergent-divergent to ongoing shooting, and separately thumb and forefinger finger represent to focus on, and draw close thumb and forefinger and represent to defocus.
The gesture identification of camera 2 is divided into two large steps: the first step is skin color model, marks off all colour of skin objects from picture; Second step is gesture identification, and the object extracting from first step is carried out to pattern match.The colour of skin is biological and physically distribute and have consistance, get rid of brightness and environment on the impact of the colour of skin after, the tone of skin is basically identical.
First, each two field picture collecting is adopted to medium filtering filtering noise, then by processing image later, carry out Face Detection.Adopt HSV color space as the color space of Face Detection, HSV color space is less on the impact of colourity and illumination, can in the situation that disturbed by different light, most accurately identify the colour of skin, improves recognition accuracy.In H direction setting colour of skin threshold value, set the threshold value of S and V direction simultaneously, be tentatively partitioned into the area of skin color such as hand and arm in image.The object of this step is to mark off arm, hand, face and all colour of skin objects, for next step identification staff dwindles determination range.Detected image is converted to bianry image.Image is done to external polygon and process, extraneous polygon unique point and people's face of hand differ widely, and determine the position of hand by this global characteristics.
Utilization image is cut apart, and obtains hand-type profile, and getting its borderline high curvature point is unique point, compares the similar hand-type of unique point in preset feature database, then is mapped to concrete gesture.Due at embedded platform, it is lower slightly that the computing power of processor is compared computing machine, is to guarantee real-time and user experience quality, and the present invention is that processor alleviates computation burden at three aspects:.First, gesture a of the present invention is for starting or finish to take gesture, and gesture b, c, d, e are for controlling gesture, and in shooting process, it occurs successively regular: when camera lens is determined viewfinder range after opening, only need identify coupling to gesture a.Camera lens is opened rear gesture b, c, d, e are the control to camera, and these four kinds of gestures are the highest from the probability of the screen lower right corner and lower left corner appearance.Because the stage different only need be identified several gestures wherein, and can anticipation its there is scope, dwindled gesture matching range, reduced calculated amount.Second, due to the present invention's self structure as previously described, all gestures all complete in visual range in face of user, and gesture scope of activities is little, continuity is strong, velocity variations is little, low to the tracer request of camera 2, compares to take TV and as display platform, with waving of arm, make the kinect control, and take the intelligent domestic system that whole room is tracking target, the present invention is without the tracking of long displacement in gesture identification process, and gesture changes continuously, and shared system resource is few.The 3rd, the gesture feature that the present invention uses is obvious, and details is few, and between 5 kinds of gestures, significantly, less demanding to unique point, has reduced again calculated amount to a certain extent in difference.Therefore, the calculated amount requirement based on less in gesture identification process of the present invention, the present invention selects pattern-recognition and the gesture based on algorithm to follow the tracks of as recognition methods.Its feature is to identify that details is more, the unconspicuous object of feature, but less demanding to the computing of processor.Further, after identifying user's gesture, intelligent personal portable device provided by the present invention can carry out prediction roughly to the position of next frame according to the gesture of former frame position in the drawings, to save system resource, it is followed the tracks of.
Under exposal model, described camera 2 finding a view in process after camera lens is opened, the user a that makes to use gesture confirms viewfinder range.When described camera 2 identifies the both hands that user shows gesture 1, if now user's both hands are with the mode of motion motion of gesture b, show that user determines viewfinder range yet, camera 2 is followed the tracks of user's both hands positions, until it stops, till becoming gesture a.Two diagonal angles that the tiger's jaw of now determining user's both hands is viewfinder range, and send confirmation sound by receiver 4, notify user's action of taking pictures to identify, and are about at t
shot-comfirmrear automatic camera.Start a delay circuit simultaneously and control camera at t
shot-comfirmafter time, automatically snap.Because user makes with the hands to confirm the action of viewfinder range, be continuous, speed, the limited motion of amplitude, under existing object recognition technique, object tracking technology, use previously described gesture identification method can realize well above-mentioned functions, and do not occupy too many system resource.Hear and confirm that after sound, user can remove both hands, intelligent personal portable device will automatically complete and take pictures.User also can make gesture c, gesture c' and gesture d as required, opens respectively or close Night, and opens or close flashlamp.
At t
shot-comfirmin time, recording user both hands tiger's jaw position A (x
a, y
a), B (x
b, y
b) position in image coordinate, deposit in buffer memory, in order to it is carried out to surface trimming when preserving image.Benefit to the surface trimming of image is, user can not be subject to the restriction of camera lens length breadth ratio, freely controls the size of photo; After shooting completes, just automatically complete the cutting of image simultaneously, be different from prior art, after taking pictures, manually cut away unwanted part.Technology of automatically image being cut of the present invention has alleviated user's operation burden.
Under video recording pattern, identical with under exposal model, the tiger's jaw of gesture a both hands is still as two diagonal angles of finding a view, and the camera lens when starting to take is carried out initial convergent-divergent.Video recording pattern is different from exposal model, after recognizing gesture a, starts shooting, carries out initial convergent-divergent, and now receiver 4 of the present invention sends prompt tone and notifies user, represents to start shooting.After video recording starts, user can remove both hands within the scope of camera lens, and camera 2 can be carried out the shooting of the first vision, convergent-divergent degree when convergent-divergent degree keeps starting to make a video recording.The same with the control under exposal model, user can make to use gesture c, gesture c' and gesture d controls respectively Night and flashlamp.Different, in video recording carries out, gesture a goes out to represent carry out to finish shooting, and the e that makes to use gesture of the convergent-divergent while therefore making a video recording carries out.As mentioned above, user, if end is made a video recording, only need to be presented on gesture a within the scope of camera again.When recognize gesture a in video recording carries out, the control circuit of intelligent personal portable device finishes video recording, and recorded content is saved in memory device 14.
Shown in Fig. 2 and Fig. 3 is that carrier is the intelligent personal portable device of bi-telephone, and the intelligent personal portable device that the carrier of take is below bi-telephone describes in detail to the present invention as example.
As shown in Figures 2 and 3, the receiver of bi-telephone is the receiver 4 of intelligent personal portable device, 6, two passive infrared inductors 8 of microphone that the microphone of bi-telephone is intelligent personal portable device lay respectively on two receivers 4, and two touch pads 10 lay respectively at the outside of two receivers 4.
Described processor 12, memory device 14, bluetooth module 16, power module 20 etc. can be gone up in place according to the difformity setting of bi-telephone.
The present invention be by Module-embeddings such as shooting, voice control, GPS location, touches to the carriers such as bi-telephone, the processor 12 that is used for controlling this embedded system adopts current usage degree ARM chip the highest, that platform is the most perfect to control, along with continually developing of product function, the renewal of chip is inevitable, and the present invention is not limited to some or a certain certain chip.
The present invention is used for storing the memory device 14 of data, adopts the flash storer that is applicable to portable electric appts.
The present invention there are certain requirements for described passive infrared inductor 8.The common passive infrared inductor on market of comparing, the sensitivity of the passive infrared inductor 8 in the present invention on induction range, minimum induction and different directions has specific requirement:
First, induction range should be in the raise one's hand region of most actions process of user, through the experiment to the user of different height, arm exhibition, this region be user dead ahead perpendicular to ground and perpendicular to the plane of user perspective, its vertical area is that the following 30 ° of left and right of user's shoulder horizontal level are to more than shoulder horizontal level 20 ° of left and right; Its horizontal zone is that two left and right are separated by about 22cm, width is 10cm left and right, length is the region of 18cm left and right.
Secondly, minimum induction is adjusted to the optimum distance in induction user's hands movement region.Although user's build and use habit are different, according to statistics, show that the position of user's hand and the distance of inductor are in 85cm.Reduce minimum induction, make it best identified scope and guarantee be slightly larger than in 85cm.
Finally, although user's high height and long arm is different, the action of raising one's hand has consistance: the motion amplitude in the vertical direction of action of raising one's hand is much larger than motion amplitude in the horizontal direction, and This move also has very large difference with the crowd who walks about in user the place ahead.To receiving the filter disc of infrared light, make corresponding change, to movement in vertical direction, sensitivity requires height, to horizontal motion, sensitivity requires low particular requirement to make the refraction of light meet the present invention.
The particular requirement of the sensitivity on induction range, minimum induction and different directions is intended to meet the raise one's hand ergonomics of action of user, and in face of reducing, people's inductor causing of walking about opens by mistake the probability opening simultaneously.Guarantee the lower rate of opening that opens by mistake, can effectively reduce electrical source consumption.
In order to coordinate the consideration of intelligent personal portable device economize on electricity, when user makes gesture, camera 2 keeps closed conditions, only has and makes gesture as user, just open camera 2 to its identification.Passive infrared inductor 8 coordinates camera 2 to complete gesture identification, can replace camera 2 to be held open state, thereby greatly reduce electrical source consumption, and open in time camera 2 when user makes gesture.
Described touch pad 10, by up and down or the touch pad that horizontally slips, realizes the difference of the audio frequency of playing by receiver 4 is controlled.Described bi-telephone comprises that is controlled a beginning/pause button that starts and suspend, and beginning/pause button is used for playing/suspending music.In order to save power supply, touch pad 10 can automatically enter holding state after no signal input reaches a period of time, if touch pad 10 need to be waken up from holding state, need to click beginning/pause button and activate touch pad 10.The signal of touch pad 10 inputs is used for controlling rising and the reduction of volume, and selection upper one or next song.For touch pad 10 is set up XoY plane coordinate system in its plane, the motion of X-axis positive dirction, for selecting next song, is upper one first song in the other direction; The motion of Y-axis positive dirction is that volume raises, in the other direction for volume reduces.If touch pad receives user and is greater than Y-axis in the displacement of X-direction, be judged as the motion in X-direction, carry out a upper head/next first-selected song; Otherwise think the motion of Y direction, carry out volume adjusting.
Described intelligent personal portable device also comprises a phonetic search system, and user can search and play corresponding song by saying the title of the song of music.Phonetic search system is the voice from microphone 6 inputs by identification, search for this title of the song in song storehouse.This has simplified the process of search, has also saved user and from hundreds of songs, has searched the trouble of music.User's voice signal is carried out to noise reduction process, extract phonetic feature, and use the pattern-recognition of HMM Hidden Markov.
Compare other wireless transport modules, bluetooth has the feature of low-power consumption.Meanwhile, the radiation of bluetooth is lower, is generally 1/2000 to 1/80 of mobile phone.Bluetooth module 16 of the present invention can with mate after other there is the mobile device of bluetooth module, as mobile phone, carry out data transmission.After bluetooth module 16 mates with mobile phone, described bi-telephone can be realized and answering/refuses phone, the transmission of the data wireless based on bluetooth and by bluetooth, play the functions such as mobile phone local music.
Particularly, music under broadcast state, when having phone incoming call, is not play phone incoming call prompt tone; Under music state, when having phone incoming call, telephone signal takies former music channel automatically, suspends music, plays phone incoming call prompt tone.Clicking beginning/pause button is used for suspending music and receives calls; Length is used for refusing to receive calls by beginning/pause button.
By data wireless, transmit photo or the video that user just can also have been taken and present by mobile phone, mobile phone reads the local data in intelligent personal portable device memory device 14 by bluetooth module 16.Equally, by bluetooth module 16 users, can select to play the music in mobile phone.In unlimited data transmission, described bi-telephone can be regarded common bluetooth earphone as.
Except the form with bi-telephone presents, the carrier of this intelligent personal portable device can be also cap, the helmet, glasses, one-sided earphone etc.Shown in Fig. 4 is that carrier is the embodiment of glasses.It is the most harsh that carrier is that the outward appearance of glasses arranges the requirement of hardware of the present invention, herein the feature of brief description glasses form.The method that of the present invention and user realizes information interchange is that human-machine interactive information is inputted to user's ears by receiver 4, obtains user's gesture and the voice signal that obtains user by microphone 6 by camera 2 simultaneously.Therefore, glasses are also ideal carriers of the present invention.As shown in Figure 4, camera 2 is arranged on eyeglasses frame turning, and the space that herein can provide is larger, is the ideal position that camera 2 is set; Receiver 4 is arranged on leg of spectacles end, for In-Ear; Microphone 6 is arranged on leg of spectacles bottom near one end of eyeglass, with nearest with face; Touch pad 10 is arranged on the both sides of leg of spectacles.The intelligent personal portable device that the carrier of take is glasses, the intelligent personal portable device that is bi-telephone with above-mentioned carrier has identical function, and required hardware module is also unchanged.
The intelligent personal assistants presenting with glasses form is compared bi-telephone form, has following features:
Glasses be the present invention of appearance form to the having relatively high expectations of circuit design, above-mentioned hardware module need to be placed in limited space.Nowadays the development of electronic product hardware is rapid, makes the lightweight equipment of small size become possibility, and the iPod nano of Apple is exactly the model in this.The hardware of the carrier of glasses form concentrates on spectacle frame: leg of spectacles and mirror holder flat position are used for putting hard circuit board; Flexible PCB is responsible for rising connection function on turning.
Due to the volume of glasses, to compare bi-telephone smaller, so note also the use of battery.User of the present invention operates few, without frequent signal input; Without automatically closing camera lens, touch pad under input condition, and GPS, bluetooth module just open when needed; And the present invention selects the hardware product of low-power consumption.If suitably reduce the resolution of camera lens, can be applicable to this carrier of glasses.
Glasses are the intelligent personal portable device of carrier, and its eyeglass can be set to dismountable, due to the demand of myope, can provide as required the selection that is applicable to user in actual production process, equally also can provide the eyeglasses such as sunglasses.
As mentioned above, the form of expression of the present invention is not limited to bi-telephone and glasses, and cap and the helmet, one-sided earphone are also extendible presentation modes.The present invention presents with the form of cap, and the space that can bring into play is larger, and it is easier in structure, to realize.Winter is cold, and institute's thing of wearing the clothes is more, and user does not mind increases a very small and exquisite electronic product again, has on the contrary and separates the cold sense of security.Under cold climate, user uses legacy equipment shooting meeting that both hands are exposed to a period of time in air, and gesture photographic method of the present invention only needs the time in several seconds by contrast; Shooting only need reach out one's hands especially when starting and finish, and shooting is carried out in process, and user even can carry both hands in pocket and warm oneself.User also can take calmly interesting scene and beautiful landscape in the winter time.
This product of helmet form can omit gesture identification function, as cyclist or people's first person shooting by motorcycle, records the stroke of oneself, leaves sweet memories, also can make the drive recorder of motorcycle or bicycle simultaneously.
Should be appreciated that, in the situation that not departing from its spirit and central feature, the present invention can other form realize.Therefore embodiment and concrete embodiment is here schematically, be not restricted, and the present invention is not limited in detailed description given here.
Claims (16)
1. an intelligent personal portable device, comprises carrier,
Being used for the processor of control system is arranged on described carrier,
Being used for the camera of receiving optical signal is arranged on described carrier,
At least one passive infrared inductor is arranged on described carrier,
The memory device that is used for storing data is arranged on described carrier, and
Provide the power module of power supply to be arranged on described carrier,
Wherein, described camera adopts gesture control mode, and described camera is opened by the movement of passive infrared inductor induction hand, and utilizes gesture identification to control it to complete the associative operation of taking pictures or making a video recording.
2. intelligent personal portable device as claimed in claim 1, is characterized in that: also comprise that at least one is used for the microphone that the receiver of output audio and is used for receiving user speech instruction and is arranged on carrier.
3. intelligent personal portable device as claimed in claim 2, is characterized in that: the quantity of described passive infrared inductor is two, and these two passive infrared inductors are separately positioned on the both sides of described carrier.
4. intelligent personal portable device as claimed in claim 3, is characterized in that: gesture is controlled the method for camera, comprises the following steps:
(1) a default time threshold values;
(2) by two passive infrared inductors, respond to respectively the action of both hands;
(3) calculate the mistiming that both hands start action the mistiming that two hands of comparison lift and the size of Preset Time threshold values;
(4) if the mistiming is less than default time threshold values, open camera; If the mistiming is greater than default time threshold values, do not open camera;
(5), after camera is opened, by gesture identification, control the associative operation that camera is taken pictures or made a video recording.
5. intelligent personal portable device as claimed in claim 4, is characterized in that: when opening camera, open microphone, by phonetic entry, select to enter exposal model or video recording pattern.
6. intelligent personal portable device as claimed in claim 5, is characterized in that: described step (5) specifically comprises the following steps:
(51) image of camera collection is carried out to the region that Face Detection is determined hand;
(52) hand in image-region is carried out to gesture identification, determine gesture motion;
(53) carry out the default corresponding operating of gesture motion.
7. intelligent personal portable device as claimed in claim 6, is characterized in that: described carrier is wear-type object.
8. intelligent personal portable device as claimed in claim 7, it is characterized in that: described carrier is bi-telephone, wherein, the receiver of bi-telephone is the receiver of intelligent personal portable device, the microphone of bi-telephone is the microphone of intelligent personal portable device, and two passive infrared inductors lay respectively on two receivers.
9. intelligent personal portable device as claimed in claim 7, it is characterized in that: described carrier is glasses, wherein, described camera is arranged on eyeglasses frame corner, described receiver is arranged on leg of spectacles end, described microphone is arranged on leg of spectacles bottom near one end of eyeglass, and described touch pad is arranged on the both sides of leg of spectacles.
10. intelligent personal portable device as claimed in claim 7, is characterized in that: described carrier is cap, the helmet or one-sided earphone.
11. intelligent personal portable devices as described in as arbitrary in claim 2-10, is characterized in that: also comprise that at least one touch pad is arranged on carrier, by up and down or the touch pad that horizontally slips realize the difference that audio frequency is play and control.
12. intelligent personal portable devices as described in as arbitrary in claim 1-10, is characterized in that: also comprise that a bluetooth module is arranged on carrier.
13. intelligent personal portable devices as described in as arbitrary in claim 1-10, is characterized in that: also comprise that a GPS module is arranged on carrier.
14. intelligent personal portable devices as described in as arbitrary in claim 6-10, is characterized in that: described gesture motion, comprises
Gesture a: both hands finger palm is at same plane, stretch out respectively thumb and forefinger, make thumb and forefinger at tiger's jaw place, be 60-110 ° of angle, draw its excess-three in and refer to, the tiger's jaw of both hands is places horn shape, represents a pair of diagonal angle of photo frame, than the gesture that marks a rectangle edge frame of photo frame, determine coverage, wherein, under exposal model, gesture a is expressed as and determines camera lens viewfinder range; Under video recording pattern, gesture a represents to start or finish video recording,
Gesture b: both hands keep the shape as described in gesture a, draw in as focusing on, otherwise for defocusing, described gesture b represents the camera lens under exposal model to carry out convergent-divergent to center,
Gesture c: one hand is stretched out the action of the five fingers by clenching fist in a Preset Time section, represents to open or close Night; Otherwise, gesture c': singlehanded by stretching out the five fingers to the action of clenching fist in a Preset Time section, represent to close Night,
Gesture d: one hand is fired the action of finger, represents to open or close flashlamp, and
Gesture e: one hand stretches out thumb and forefinger, draws its excess-three in and refers to, separately thumb and forefinger finger represent to focus on, and draw close thumb and forefinger and represent to defocus.
15. intelligent personal portable devices as claimed in claim 14, is characterized in that: under exposal model, and recording user both hands tiger's jaw position A (x
a, y
a), B (x
b, y
b) position in camera coordinate system, when preserving image, with this position, image is carried out to surface trimming.
16. intelligent personal portable devices as claimed in claim 14, it is characterized in that: under exposal model, after adopting gesture b to adjust the camera lens of camera, keep static, keep after gesture a a period of time, described processor is controlled camera and is automatically started shutter and take pictures.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210376073.1A CN103713732A (en) | 2012-09-28 | 2012-09-28 | Personal portable device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210376073.1A CN103713732A (en) | 2012-09-28 | 2012-09-28 | Personal portable device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103713732A true CN103713732A (en) | 2014-04-09 |
Family
ID=50406772
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210376073.1A Pending CN103713732A (en) | 2012-09-28 | 2012-09-28 | Personal portable device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103713732A (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104461324A (en) * | 2013-09-16 | 2015-03-25 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN104519385A (en) * | 2014-12-10 | 2015-04-15 | 深圳市国华识别科技开发有限公司 | System and method for intelligently leaving messages by aid of television sets |
| CN104536561A (en) * | 2014-12-10 | 2015-04-22 | 金硕澳门离岸商业服务有限公司 | Wearable device and method for controlling terminal device in operation by wearable device |
| CN105573522A (en) * | 2015-12-22 | 2016-05-11 | 广东欧珀移动通信有限公司 | Operation method of mobile terminal and mobile terminal |
| CN105792005A (en) * | 2014-12-22 | 2016-07-20 | 深圳Tcl数字技术有限公司 | Recording control method and device |
| CN105867601A (en) * | 2015-12-07 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Control method and apparatus of wearable device, and terminal |
| CN105929957A (en) * | 2016-04-26 | 2016-09-07 | 深圳市奋达科技股份有限公司 | Control method, apparatus and device for intelligent glasses |
| CN106131728A (en) * | 2016-08-03 | 2016-11-16 | 广东金润和科技股份有限公司 | Intelligent integrated form Bluetooth earphone device |
| CN107065225A (en) * | 2017-06-12 | 2017-08-18 | 广东邑安实业有限公司 | Intelligence law enforcement glasses |
| TWI612910B (en) * | 2017-04-27 | 2018-02-01 | H P B Optoelectronic Co Ltd | Cap structure with gesture recognition function |
| WO2018023423A1 (en) * | 2016-08-02 | 2018-02-08 | 张阳 | Method for displaying ownership of music switching technology and eyeglasses |
| CN109409233A (en) * | 2018-09-27 | 2019-03-01 | 普宙飞行器科技（深圳）有限公司 | Action recognition device, action identification method and unmanned plane |
| CN109862274A (en) * | 2019-03-18 | 2019-06-07 | 北京字节跳动网络技术有限公司 | Earphone with camera function, the method and apparatus for exporting control signal |
| CN110049228A (en) * | 2018-01-17 | 2019-07-23 | 北京林业大学 | A kind of new method and system taken pictures based on gesture control |
| CN113138669A (en) * | 2021-04-27 | 2021-07-20 | Oppo广东移动通信有限公司 | Image acquisition method, device and system of electronic equipment and electronic equipment |
| CN113709410A (en) * | 2020-05-21 | 2021-11-26 | 幻蝎科技(武汉)有限公司 | Method, system and equipment for enhancing human eye visual ability based on MR glasses |
| CN114007015A (en) * | 2021-10-29 | 2022-02-01 | 广东乐心医疗电子股份有限公司 | Control method and device of mobile terminal and electronic equipment |
-
2012
- 2012-09-28 CN CN201210376073.1A patent/CN103713732A/en active Pending
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104461324A (en) * | 2013-09-16 | 2015-03-25 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN104461324B (en) * | 2013-09-16 | 2017-12-29 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN104519385B (en) * | 2014-12-10 | 2017-03-22 | 深圳市国华识别科技开发有限公司 | System and method for intelligently leaving messages by aid of television sets |
| CN104519385A (en) * | 2014-12-10 | 2015-04-15 | 深圳市国华识别科技开发有限公司 | System and method for intelligently leaving messages by aid of television sets |
| CN104536561A (en) * | 2014-12-10 | 2015-04-22 | 金硕澳门离岸商业服务有限公司 | Wearable device and method for controlling terminal device in operation by wearable device |
| CN104536561B (en) * | 2014-12-10 | 2018-02-23 | 金硕澳门离岸商业服务有限公司 | Using the method and wearable device of wearable device control terminal device operation |
| CN105792005B (en) * | 2014-12-22 | 2019-05-14 | 深圳Tcl数字技术有限公司 | The method and device of video recording control |
| CN105792005A (en) * | 2014-12-22 | 2016-07-20 | 深圳Tcl数字技术有限公司 | Recording control method and device |
| CN105867601A (en) * | 2015-12-07 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Control method and apparatus of wearable device, and terminal |
| CN105573522B (en) * | 2015-12-22 | 2019-10-01 | 广东欧珀移动通信有限公司 | A kind of operating method and mobile terminal of mobile terminal |
| CN105573522A (en) * | 2015-12-22 | 2016-05-11 | 广东欧珀移动通信有限公司 | Operation method of mobile terminal and mobile terminal |
| CN105929957A (en) * | 2016-04-26 | 2016-09-07 | 深圳市奋达科技股份有限公司 | Control method, apparatus and device for intelligent glasses |
| WO2018023423A1 (en) * | 2016-08-02 | 2018-02-08 | 张阳 | Method for displaying ownership of music switching technology and eyeglasses |
| CN106131728A (en) * | 2016-08-03 | 2016-11-16 | 广东金润和科技股份有限公司 | Intelligent integrated form Bluetooth earphone device |
| TWI612910B (en) * | 2017-04-27 | 2018-02-01 | H P B Optoelectronic Co Ltd | Cap structure with gesture recognition function |
| CN107065225A (en) * | 2017-06-12 | 2017-08-18 | 广东邑安实业有限公司 | Intelligence law enforcement glasses |
| CN110049228A (en) * | 2018-01-17 | 2019-07-23 | 北京林业大学 | A kind of new method and system taken pictures based on gesture control |
| CN109409233A (en) * | 2018-09-27 | 2019-03-01 | 普宙飞行器科技（深圳）有限公司 | Action recognition device, action identification method and unmanned plane |
| CN109862274A (en) * | 2019-03-18 | 2019-06-07 | 北京字节跳动网络技术有限公司 | Earphone with camera function, the method and apparatus for exporting control signal |
| CN113709410A (en) * | 2020-05-21 | 2021-11-26 | 幻蝎科技(武汉)有限公司 | Method, system and equipment for enhancing human eye visual ability based on MR glasses |
| CN113138669A (en) * | 2021-04-27 | 2021-07-20 | Oppo广东移动通信有限公司 | Image acquisition method, device and system of electronic equipment and electronic equipment |
| CN114007015A (en) * | 2021-10-29 | 2022-02-01 | 广东乐心医疗电子股份有限公司 | Control method and device of mobile terminal and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103713732A (en) | Personal portable device | |
| CN202815718U (en) | Individual carried-with device | |
| CN111726536B (en) | Video generation method, device, storage medium and computer equipment | |
| CN105278745B (en) | Mobile terminal and its control method | |
| US11146771B2 (en) | Display control device, display control method, and program | |
| US11383166B2 (en) | Interaction method of application scene, mobile terminal, and storage medium | |
| WO2021023059A1 (en) | Photographing method and mobile terminal | |
| CN103593051B (en) | Head-mounted type display equipment | |
| US8860805B2 (en) | Electronic device and method of controlling the same | |
| CN109194879A (en) | Photographic method, device, storage medium and mobile terminal | |
| CN112532865B (en) | Slow-motion video shooting method and electronic equipment | |
| CN102932212A (en) | Intelligent household control system based on multichannel interaction manner | |
| CN110073316A (en) | Interaction virtual objects in mixed reality environment | |
| CN106341522A (en) | Mobile Terminal And Method For Controlling The Same | |
| US20200258314A1 (en) | Information processing device, information processing method, and recording medium | |
| CN110134316A (en) | Model training method, Emotion identification method and relevant apparatus and equipment | |
| CN205490994U (en) | Multi -functional intelligent sound box | |
| WO2022227393A1 (en) | Image photographing method and apparatus, electronic device, and computer readable storage medium | |
| WO2021147434A1 (en) | Artificial intelligence-based face recognition method and apparatus, device, and medium | |
| CN109284081A (en) | A kind of output method of audio, device and audio frequency apparatus | |
| WO2021244411A1 (en) | Movement self-adaptive synchronization method and electronic device | |
| CN109819167A (en) | A kind of image processing method, device and mobile terminal | |
| CN109725727A (en) | There are the gestural control method and device of screen equipment | |
| TWI656359B (en) | Device for mixed reality | |
| CN108881544A (en) | A kind of method taken pictures and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20140409 |