CN105912118A - Method and device for surround sound-image control based on natural user interface - Google Patents

Method and device for surround sound-image control based on natural user interface Download PDF

Info

Publication number
CN105912118A
CN105912118A CN201610224583.5A CN201610224583A CN105912118A CN 105912118 A CN105912118 A CN 105912118A CN 201610224583 A CN201610224583 A CN 201610224583A CN 105912118 A CN105912118 A CN 105912118A
Authority
CN
China
Prior art keywords
gesture
acoustic image
sound
user
midpoint
Prior art date
Application number
CN201610224583.5A
Other languages
Chinese (zh)
Inventor
童雷
张轶
Original Assignee
童雷
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 童雷 filed Critical 童雷
Priority to CN201610224583.5A priority Critical patent/CN105912118A/en
Publication of CN105912118A publication Critical patent/CN105912118A/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00Stereophonic arrangements
    • H04R5/04Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments

Abstract

The invention relates to a method and device for surround sound-image control based on a natural user interface. The method comprises the steps that a user's initial gesture of stretching a single hand into a detection area is collected by an optical sensor; coordinates of a current spatial position of the initial gesture located in the detection area are acquired, and the position is taken as the center point of sound-image space; a gesture action conducted by the hand which carries out the initial gesture with the center point of the sound-image space as the center within a sound-image control scope to control the sound-image position is detected; and a corresponding sound-image control instruction is output according to one-to-one correspondence relations between the preset direction and angle of the gesture action and the sound-image control instruction. The method and the device provided by the invention has the advantage that three-dimensional sound images are controlled by the natural user interface, so that workloads of film and television sound later-processing workers in three-dimensional sound-image control can be reduced greatly.

Description

A kind of surround sound acoustic image control method based on natural user interface and device

Technical field

The invention belongs to acoustic image and control technical field, be specifically related to a kind of surround sound acoustic image control based on natural user interface Method and device processed.

Background technology

After stereophonic recording technology occurs, just there is the concept of acoustic image.Stereosonic acoustic image controls mainly to use rotation Button controls, and the acoustic image of surround sound controls mainly to use rocking bar to control the mode with X-Y scheme interface, and at immersion sound After (panorama sound) occurs, the concept of acoustic image expands to three-dimensional, but current solution is also only limitted to use three dimensions to reflect Being incident upon X-Y scheme interface to be controlled acoustic image with rocking bar, the several picture of panorama such as Dolby Labs's exploitation controls plug-in unit, uses Family is experienced unsatisfactory.

Existing hardware controller typically uses the mode reducing dimension, uses two acoustic image controllers to complete three-dimensional sound image Location.Major defect is: a) dual controller needs user to make with the hands to be controlled simultaneously, it is impossible to complete other works the most simultaneously Make, as operation tape drive controller is reset and records acoustic image;B) threedimensional model is the most directly perceived;C) user's notice can be by complicated acoustic image Map operation disturbs.

Summary of the invention

It is an object of the invention to provide a kind of simple to operate, that learning curve is mild, user's control and Sound image localization The acoustic image control method of required channel height coincidence and device, solve, with this, the barrier that user is run in control three-dimensional sound image Hinder.

For achieving the above object, the present invention adopts the following technical scheme that

A kind of surround sound acoustic image control method based on natural user interface, comprises the following steps:

Gather user's one hand by optical pickocff and stretch into the initial sign in detection region;

Obtain the current spatial location coordinate of this initial sign being in detection region and as the midpoint of sound image space;

Detection sends the control sound that the one hand of gesture is sent in acoustic image control range centered by the midpoint of this sound image space The gesture motion of image position;

Export corresponding acoustic image according to default gesture motion direction, angle with the one-to-one relationship of acoustic image control instruction to control Instruction.

The present invention also aims to provide a kind of surround sound acoustic image based on natural user interface to control device, including:

Optical pickocff, for gather user's one hand stretch into detection region in initial sign and detection send initial sign The gesture motion of the singlehanded control acoustic image positions sent in acoustic image control range;

Sound image space midpoint acquiring unit, for obtaining the current spatial location coordinate of this initial sign being in detection region And as the midpoint of sound image space;

Acoustic image control instruction output unit, for according to the gesture motion direction preset, angle with acoustic image control instruction one by one Corresponding relation exports corresponding acoustic image control instruction.

The present invention, by using gesture, controls three-dimensional sound image by natural user interface, controls three dimensional sound with both hands simultaneously The control of picture is compared, it is possible to alleviate video display sound later stage personnel workload in three-dimensional sound image control, and control largely System is convenient, solves and uses dual controller to need user to make with the hands to be controlled at present simultaneously, it is impossible to completes other the most simultaneously Work, as operation tape drive controller is reset and records acoustic image, threedimensional model is the most directly perceived;And user's notice can be by complicated sound Technical problem as map operation interference.

Accompanying drawing explanation

The flow chart of the surround sound acoustic image control method based on natural user interface that Fig. 1 provides for the embodiment of the present invention;

The control schematic diagram of the surround sound acoustic image control method based on natural user interface that Fig. 2 provides for the embodiment of the present invention;

Fig. 3 controls the theory structure signal of device for a kind of based on natural user interface the surround sound acoustic image that the present invention provides Figure.

Detailed description of the invention

Below, in conjunction with example, substantive distinguishing features and the advantage of the present invention are further described, but the present invention not office It is limited to listed embodiment.

First optical pickocff is placed in the lower section of user's normal sitting posture work posture palm present position by the application, first Use optical pickocff to gather gesture, then by software, gesture is identified and according to gesture control acoustic image.

Shown in Figure 1, a kind of surround sound acoustic image control method based on natural user interface, comprise the following steps:

Gather user's one hand by optical pickocff and stretch into the initial sign in detection region;

Obtain the current spatial location coordinate of this initial sign being in detection region and as the midpoint of sound image space;

Detection sends the one hand of this initial sign control sound in acoustic image control range, centered by the midpoint of this sound image space The gesture motion of image position;

Export corresponding acoustic image according to default gesture motion direction, angle with the one-to-one relationship of acoustic image control instruction to control Instruction.

It should be noted that in the present invention, in default detection region, the initial sign of user just can detect Arrive, and after the initial sign of user being detected, acoustic image controls to start, and is otherwise failure to actuate, then by the space of this initial sign Coordinate position is as the midpoint of sound image space, and sends the one hand of initial sign in detection zone with this by detection units test The gesture motion of the control acoustic image positions centered by the midpoint of sound image space, detects that the corresponding gesture controlling acoustic image positions is moved After work, corresponding acoustic image control can be exported according to default gesture motion direction and angle and the corresponding relation of acoustic image control instruction Instruction processed sends audio workstation to, thus realizes being controlled acoustic image.

Wherein, implement, described detection region can be the user interface of acoustic image controller or acoustic image potentiometer extremely A predetermined space in one segment distance of user, such as 30cm, in the predetermined space in this 30cm, initial sign can be captured inspection Measure, outside then cannot catch and detect, the most just cannot be carried out acoustic image gesture control operation.When the gesture of user is in this space In the range of time, by the gesture motion gesture of controls acoustic image positions of detection hand, the control of the most exportable corresponding acoustic image positions refers to Order is to DAB workbench, it is achieved the scope control to the acoustic image positions of sound to be processed.

Concrete, the present invention with Digital Audio Workstation linkage in terms of, can be with one group by acoustic image control signal The form of midi signal is packaged transmitting to Digital Audio Workstation, and maximum ensures between different digital audio workstation Compatible.

The present invention controls acoustic image by the initial sign of detection user, convenient for users to use, and user can be singlehanded Carry out operating the control realizing acoustic image, and another hand can carry out other operation, such as operation tape drive controller, reset and record Acoustic image processed.

User is after acoustic image positions first describes for convenience, then carries out operation and the amendment of acoustic image positions, further, and this Invent further comprising the steps of:

Obtain user's locus coordinate to the subsequent gesture that acoustic image positions is revised;

Calculate the locus coordinate relative displacement relative to the midpoint of sound image space of this subsequent gesture;

Detection user is singlehanded in the working range of subsequent gesture, sent centered by the locus coordinate of this subsequent gesture The gesture motion of amendment acoustic image positions, according to the space bit of direction, angle and this subsequent gesture of this subsequent gesture action Put the relative displacement of coordinate and the midpoint of sound image space, calculate subsequent gesture action centered by the midpoint of sound image space Direction, angle;

The one_to_one corresponding of direction, angle and acoustic image control instruction according to the gesture motion centered by the midpoint of sound image space closes System exports corresponding acoustic image control instruction.

The present invention is by calculating the relative displacement of this subsequent gesture locus coordinate and the midpoint of sound image space so that User is when being unsatisfied with acoustic image positions and modifying operation, it is not necessary to specifically look for the midpoint of primary sound image space again, as long as In detection region, controlling the gesture motion of acoustic image positions in the working range of subsequent gesture accordingly, it is right to realize The amendment of primary sound image position, greatly facilitates the operation that acoustic image positions is revised by user, greatly improves the experience of user.

Implement, in the present invention, sat by the locus of subsequent gesture in the working range of described subsequent gesture Mark determines with the relative displacement of corresponding anchor axle, and described anchor axle is the axis of user, the locus coordinate of this subsequent gesture Determine that method is as follows with the relative displacement of corresponding anchor axle:

Gathered the image of user by optical pickocff, determine axis 10 and the shoulder breadth of user 100, according to the axis of user with Shoulder breadth calculates the axis of user and to the singlehanded corresponding shoulder of output initial sign and saves some vertical ranges d on 30, by this away from The locus coordinate of subsequent gesture and the relative displacement (shown in Figure 2) of corresponding anchor axle can be calculated from d.

Distance d according to this acquisition, it is thus achieved that the locus coordinate of subsequent gesture skew relative with corresponding anchor axle After amount, i.e. can determine that the working range of subsequent gesture, then calculate this point centered by the locus coordinate of subsequent gesture The direction of the gesture motion centered by the midpoint by sound image space corresponding to the rotation direction of subsequent gesture, angle, angle, so After can export corresponding acoustic image according to the direction of former gesture motion, angle and the one-to-one relationship of acoustic image control instruction and control Instruction, it is achieved to acoustic image positions control, describe and process.

In the present invention, the axis of the human body that the axis of described user refers to, the i.e. axis of the human body of a normal standard Line, described shoulder joint can be the most some the rotary middle points of shoulder joint, or are in arm 40 and elbow joint in shoulder joint A bit on 20 axis.

It should be noted that in the present invention, the optical pickocff gathering initial sign and user images can be one, with Shi Zhihang gesture-capture and picture catching;Can also two, gather the initial sign of user and the image of user respectively, respectively Realize catching and the calculating of above-mentioned relative displacement of gesture.I.e. when using dual sensor identification user's gesture, a biography Sensor charge capture gesture, another sensor, by judging user's body axis and shoulder breadth, calculates the acoustic image work that acoustic image controls Making scope, when determining axis and the shoulder breadth of user, distance d is subsequent gesture position coordinates center relative to sound image space Relative displacement, the control range that acoustic image controls can be 120 degree of circular cones centered by arm natural manner.

During it should be noted that implement, by increasing optical pickocff quantity, or optical sensing can be improved Device precision improves acoustic image control efficiency.Control it can in addition contain realize more complicated acoustic image by the combination of many gestures.

Further, in order to prevent user's one hand from stretching into misoperation in detection zone, after user's one hand is in detection zone After time delay a period of time, then perform to detect this gesture locus coordinate in detection zone and or gesture motion.

Implementing, in the present invention, described a period of time can set as required, as can be 3 seconds, and 4 seconds Clocks etc., do not limit, can sets itself as required.

Further, user uses for convenience, and in the present invention, described initial sign can capture gesture by an one hand, The natural relaxation hand-type i.e. launched bends to gesture, clenching fist performs the similar gesture capturing thing, and this gesture is setting acoustic image The gesture at the midpoint of the sound image space of position, naturally it is also possible to one other facilitate the gesture of elements of a fix central point, the most not Limit.

Specifically when operation, the arm sending gesture of user to naturally droop, and i.e. in nature, is then stretched into by hand Corresponding gesture motion is carried out in the space in detection region, time user's preparation starts to control acoustic image, now acoustic image positions Point is the midpoint that now user sends the hand place three dimensions internal coordinate of gesture, directly carries out the operation of relative position and repaiies Change;When determining that user is to set after acoustic image first, according to capturing gesture and obtain the center point coordinate of gesture, this captures the seat of gesture Mark is the midpoint of sound image space, and the initial position of all acoustic images is all this point, all puts with this and is configured and sets.

When the non-acoustic image of setting first, the current location residing for user's hand is the position of current sound acoustic image, and user is given Acoustic image change be skew based on this position, the midpoint of the sound image space of its sound be amendment before sound sound image space in Point adds acoustic image varying offset, and even first up till now sound has had acoustic image positions information, is reset to acoustic image according to relative displacement empty Between intermediate point.Owing to, in actual production, being not required to there is too abundant change in vertical dimensions, therefore using non-linear Mapping relations.

The embodiment of the present invention also provides for a kind of surround sound acoustic image based on natural user interface and controls device, sees Fig. 3 institute Show, comprising:

Optical pickocff, for gather user's one hand stretch into detection region in initial sign and detection send initial sign The gesture motion of the singlehanded control acoustic image positions sent in acoustic image control range;

Sound image space midpoint acquiring unit, for obtaining the current spatial location coordinate of this initial sign being in detection region And as the midpoint of sound image space;

Acoustic image control instruction output unit, for according to the gesture motion direction preset, angle with acoustic image control instruction one by one Corresponding relation exports corresponding acoustic image control instruction.

In the present invention, in default detection region, the initial sign of user just can detect and obtain, and use detected After the initial sign at family, acoustic image controls to start, and is otherwise failure to actuate, then using the spatial coordinate location of this initial sign as acoustic image The midpoint in space, and send the one hand of the initial sign midpoint with this sound image space in detection zone by detection units test be The gesture motion at center, after corresponding gesture motion being detected, can be according to default one hand gesture in acoustic image control range Direction of action and angle and the corresponding relation of acoustic image control instruction, export corresponding acoustic image control instruction and send audio work to Stand, thus realize acoustic image is controlled.

Wherein, implement, described detection region can be the user interface of acoustic image controller or acoustic image potentiometer extremely A predetermined space in one segment distance of user, such as 30cm, in the predetermined space in this 30cm, initial sign can be captured inspection Measure, outside then cannot catch and detect, the most just cannot be carried out acoustic image gesture control operation.When the gesture of user is in this space In the range of time, by detection control acoustic image positions gesture motion, the most exportable corresponding acoustic image positions control instruction to numeral Audio work platform, it is achieved the scope control to the acoustic image positions of sound to be processed.

Concrete, the present invention with Digital Audio Workstation linkage in terms of, can be with one group by acoustic image control signal The form of midi signal is packaged transmitting to Digital Audio Workstation, and maximum ensures between different digital audio workstation Compatible.

The present invention controls acoustic image by the initial sign of detection user, convenient for users to use, and user can be singlehanded Carry out operating the control realizing acoustic image, and another hand can carry out other operation, such as operation tape drive controller, reset and record Acoustic image processed.

In the present invention, user is after acoustic image positions first describes for convenience, then carries out operation and the amendment of acoustic image positions, Described surround sound acoustic image based on natural user interface controls device, also includes:

Subsequent gesture locus acquiring unit, sits the locus of the subsequent gesture that acoustic image positions is revised for obtaining user Mark;

Calculations of offset unit relatively, for calculating the locus coordinate phase relative to the midpoint of sound image space of this subsequent gesture To side-play amount;

Sound image space midpoint reset cell, is used for the one hand according to user in the working range of subsequent gesture, with subsequent gesture Locus coordinate centered by the direction of gesture motion, angle and this subsequent gesture of amendment acoustic image positions that are sent Locus coordinate, relative to the relative displacement at the midpoint of sound image space, calculates subsequent gesture action with in sound image space Direction centered by Dian, angle are also sent to acoustic image control instruction output unit.

It should be noted that in the present invention, described subsequent gesture locus acquiring unit and described sound image space midpoint Acquiring unit can be a unit, it is also possible to be that two different unit realize.

The present invention calculates, by relative calculations of offset unit, the follow-up sky that this subsequent gesture locus acquiring unit obtains Between the relative displacement at midpoint of position coordinates and sound image space, carried out in sound image space by sound image space midpoint reset cell The replacement of point so that user to acoustic image positions dissatisfied and modify operation time, it is not necessary to specifically look for primary sound image space again Midpoint, as long as detection region in, in the working range of subsequent gesture, control accordingly acoustic image positions gesture move Make, the amendment to primary sound image position can be realized, greatly facilitate the operation that acoustic image positions is revised by user, greatly improve The experience of user.

Implement, in the present invention, sat by the locus of subsequent gesture in the working range of described subsequent gesture Mark determines with the relative displacement of corresponding anchor axle, and described anchor axle is the axis of user, the locus coordinate of this subsequent gesture Determine that method is as follows with the relative displacement of corresponding anchor axle:

Gathered the image of user by optical pickocff, determine axis 10 and the shoulder breadth of user 100, according to the axis of user with Shoulder breadth calculates the axis of user to some vertical ranges d in the singlehanded corresponding shoulder joint 30 of output initial sign, by this away from The locus coordinate of subsequent gesture and the relative displacement (shown in Figure 2) of corresponding anchor axle can be calculated from d.

Distance d according to this acquisition, it is thus achieved that the locus coordinate of subsequent gesture skew relative with corresponding anchor axle After amount, this spatial operation range with subsequent gesture can be calculated.Again by calculating the locus seat with subsequent gesture It is designated as gesture motion centered by the midpoint by sound image space corresponding to the rotation direction of the subsequent gesture of central point, angle Direction, angle, then can export phase according to the direction of former gesture motion, angle with the one-to-one relationship of acoustic image control instruction The acoustic image control instruction answered, it is achieved to acoustic image positions control, describe and process.

In the present invention, the axis of the human body that the axis of described user refers to, the i.e. axis of the human body of a normal standard Line, described shoulder joint can be the most some the rotary middle points of shoulder joint, or are in arm 40 and elbow joint in shoulder joint A bit on 20 axis.

It should be noted that in the present invention, the optical pickocff gathering initial sign and user images can be one, with Shi Zhihang gesture-capture and picture catching;Can also two, gather the initial sign of user and the image of user respectively, respectively Realize catching and the calculating of above-mentioned relative displacement of gesture.I.e. when using dual sensor identification user's gesture, a biography Sensor charge capture gesture, another sensor, by judging user's body axis and shoulder breadth, calculates the acoustic image work that acoustic image controls Make scope, when determining axis and the shoulder breadth of user, i.e. can be calculated the side-play amount at acoustic image coordinate center, sound by distance d Control range as controlling can be 120 degree of circular cones centered by arm natural manner.

During it should be noted that implement, by increasing optical pickocff quantity, or optical sensing can be improved Device precision improves acoustic image control efficiency.Control furthermore it is also possible to realize more complicated acoustic image by the combination of many gestures.

Further, in order to prevent user's one hand from stretching into misoperation in detection zone, in the present invention, described based on natural user The surround sound acoustic image at interface controls device, including delays time to control unit, and also time delay in being in detection region at user's one hand After a period of time, trigger sound image space midpoint acquiring unit and perform detection this initial sign locus coordinate in detection zone With or trigger optical pickocff collection send the gesture motion that the one hand of gesture is sent in acoustic image control range.

Implementing, in the present invention, described a period of time can set as required, as can be 3 seconds, and 4 seconds Clocks etc., do not limit, can sets itself as required.

Further, user uses for convenience, and in the present invention, described initial sign can capture gesture by an one hand, The natural relaxation hand-type i.e. launched bends to gesture, clenching fist performs the similar gesture capturing thing, and this gesture is setting acoustic image The gesture at the midpoint of the sound image space of position, naturally it is also possible to one other facilitate the gesture of elements of a fix central point, the most not Limit.

Specifically when operation, the arm sending gesture of user to naturally droop, and i.e. in nature, is then stretched into by hand The gesture motion of acoustic image positions is controlled accordingly in the space in detection region, when user prepares to start to control acoustic image, Now the point of acoustic image positions is the midpoint that now user sends the hand place three dimensions internal coordinate of gesture, directly carries out relatively The operation of position and amendment;When determining that user is to set after acoustic image first, according to capturing gesture and obtain the center point coordinate of gesture, This captures the midpoint that coordinate is sound image space of gesture, and the initial position of all acoustic images is all this point, all puts with this and is configured With setting.

When the non-acoustic image of setting first, the current location residing for user's hand is the position of current sound acoustic image, and user is given Acoustic image change be skew based on this position, the midpoint of the sound image space of its sound be amendment before sound sound image space in Point adds acoustic image varying offset, if the most up till now sound has had acoustic image positions information, is reset to sound image space according to relative displacement Intermediate point.

Compared with prior art, the present invention, by using natural user interface to control three-dimensional sound image, controls with both hands simultaneously The control of three-dimensional sound image is compared, it is possible to alleviate video display sound later stage personnel work in three-dimensional sound image control largely Amount.

The above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For Yuan, under the premise without departing from the principles of the invention, it is also possible to make some improvements and modifications, these improvements and modifications also should It is considered as protection scope of the present invention.

Claims (10)

1. a surround sound acoustic image control method based on natural user interface, it is characterised in that comprise the following steps:
Gather user's one hand by optical pickocff and stretch into the initial sign in detection region;
Obtain the current spatial location coordinate of this initial sign being in detection region and as the midpoint of sound image space;
Detection sends the control sound that the one hand of gesture is sent in acoustic image control range centered by the midpoint of this sound image space The gesture motion of image position;
Export corresponding acoustic image according to default gesture motion direction, angle with the one-to-one relationship of acoustic image control instruction to control Instruction.
Surround sound acoustic image control method based on natural user interface the most according to claim 1, it is characterised in that user When acoustic image positions is revised, further comprising the steps of:
Obtain user's locus coordinate to the subsequent gesture that acoustic image positions is revised;
Calculate the locus coordinate relative displacement relative to the midpoint of sound image space of this subsequent gesture;
Detection user is singlehanded in the working range of subsequent gesture, sent centered by the locus coordinate of this subsequent gesture The gesture motion of amendment acoustic image positions, according to the space bit of direction, angle and this subsequent gesture of this subsequent gesture action Put the relative displacement of coordinate and the midpoint of sound image space, calculate subsequent gesture action centered by the midpoint of sound image space Direction, angle;
The one_to_one corresponding of direction, angle and acoustic image control instruction according to the gesture motion centered by the midpoint of sound image space closes System exports corresponding acoustic image control instruction.
Surround sound acoustic image control method based on natural user interface the most according to claim 2, it is characterised in that after described Determined by the relative displacement of the locus coordinate of subsequent gesture with corresponding anchor axle in the working range of continuous gesture, described Anchor axle is the axis of user, with the relative displacement of corresponding anchor axle, the locus coordinate of this subsequent gesture determines that method is such as Under:
Gathered the image of user by optical pickocff, determine axis and the shoulder breadth of user, according to axis and the shoulder breadth of user Calculate the axis of user to exporting the singlehanded corresponding shoulder of initial sign and saving the upper some vertical ranges D sky as subsequent gesture Between the relative displacement of position coordinates and corresponding anchor axle.
4., according to surround sound acoustic image control method based on natural user interface described in any one of claim 1-3, its feature exists In, after user's one hand is in detection region after time delay a period of time, then perform detection gesture space bit in detection zone Put coordinate and or gesture motion.
Surround sound acoustic image control method based on natural user interface the most according to claim 1, it is characterised in that at the beginning of described Beginning gesture is a singlehanded crawl gesture, and the natural relaxation hand-type i.e. launched to gesture bends the action gesture clenched fist.
6. a surround sound acoustic image based on natural user interface controls device, it is characterised in that including:
Optical pickocff, for gather user's one hand stretch into detection region in initial sign and detection send initial sign The gesture motion of the singlehanded control acoustic image positions sent in acoustic image control range;
Sound image space midpoint acquiring unit, for obtaining the current spatial location coordinate of this initial sign being in detection region And as the midpoint of sound image space;
Acoustic image control instruction output unit, for according to the gesture motion direction preset, angle with acoustic image control instruction one by one Corresponding relation exports corresponding acoustic image control instruction.
The most according to claim 6, surround sound acoustic image based on natural user interface controls device, it is characterised in that also wrap Include:
Subsequent gesture locus acquiring unit, sits the locus of the subsequent gesture that acoustic image positions is revised for obtaining user Mark;
Calculations of offset unit relatively, for calculating the locus coordinate phase relative to the midpoint of sound image space of this subsequent gesture To side-play amount;
Sound image space midpoint reset cell, is used for the one hand according to user in the working range of subsequent gesture, with subsequent gesture Locus coordinate centered by the direction of gesture motion, angle and this subsequent gesture of amendment acoustic image positions that are sent Locus coordinate, relative to the relative displacement at the midpoint of sound image space, calculates subsequent gesture action with in sound image space Direction centered by Dian, angle are also sent to acoustic image control instruction output unit.
The most according to claim 7, surround sound acoustic image based on natural user interface controls device, it is characterised in that after described Determined by the relative displacement of the locus coordinate of subsequent gesture with corresponding anchor axle in the working range of continuous gesture, described Anchor axle is the axis of user, with the relative displacement of corresponding anchor axle, the locus coordinate of this subsequent gesture determines that method is such as Under:
Gathered the image of user by optical pickocff, determine axis and the shoulder breadth of user, according to axis and the shoulder breadth of user Calculate the axis of user to exporting the singlehanded corresponding shoulder of gesture and saving the upper some vertical ranges D space bit as subsequent gesture Put the relative displacement of coordinate and corresponding anchor axle.
9. controlling device according to surround sound acoustic image based on natural user interface described in any one of claim 6-8, its feature exists In, including delays time to control unit, in being in detection region at user's one hand and after time delay a period of time, trigger sound image space Midpoint acquiring unit perform to detect this initial sign locus coordinate in detection zone and or trigger optical pickocff collection Send the gesture motion that the one hand of gesture is sent in acoustic image control range.
The most according to claim 6, surround sound acoustic image based on natural user interface controls device, it is characterised in that described Initial sign is a singlehanded crawl gesture, and the natural relaxation hand-type i.e. launched to gesture bends the action gesture clenched fist.
CN201610224583.5A 2016-04-12 2016-04-12 Method and device for surround sound-image control based on natural user interface CN105912118A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610224583.5A CN105912118A (en) 2016-04-12 2016-04-12 Method and device for surround sound-image control based on natural user interface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610224583.5A CN105912118A (en) 2016-04-12 2016-04-12 Method and device for surround sound-image control based on natural user interface

Publications (1)

Publication Number Publication Date
CN105912118A true CN105912118A (en) 2016-08-31

Family

ID=56745909

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610224583.5A CN105912118A (en) 2016-04-12 2016-04-12 Method and device for surround sound-image control based on natural user interface

Country Status (1)

Country Link
CN (1) CN105912118A (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6788809B1 (en) * 2000-06-30 2004-09-07 Intel Corporation System and method for gesture recognition in three dimensions using stereo imaging and color vision
CN104834377A (en) * 2015-05-05 2015-08-12 成都上生活网络科技有限公司 Audio control method based on 3D (3-Dimensional) gesture recognition

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6788809B1 (en) * 2000-06-30 2004-09-07 Intel Corporation System and method for gesture recognition in three dimensions using stereo imaging and color vision
CN104834377A (en) * 2015-05-05 2015-08-12 成都上生活网络科技有限公司 Audio control method based on 3D (3-Dimensional) gesture recognition

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
童雷等: "基于自然用户界面的环绕声声像控制器设计", 《北京电影学院学报》 *

Similar Documents

Publication Publication Date Title
US10248218B2 (en) Systems and methods of direct pointing detection for interaction with a digital device
JP6304241B2 (en) Display control apparatus, display control method, and program
US20170144311A1 (en) Auto-cleaning system, cleaning robot and method of controlling the cleaning robot
CN102830797B (en) A kind of man-machine interaction method based on sight line judgement and system
JP6199507B2 (en) Cleaning method, apparatus, program, and recording medium
US9430698B2 (en) Information input apparatus, information input method, and computer program
JP4850984B2 (en) Action space presentation device, action space presentation method, and program
EP2919093A1 (en) Method, system, and computer for identifying object in augmented reality
CN105393281B (en) Gesture decision maker and method, gesture operation device
Argyros et al. Vision-based interpretation of hand gestures for remote control of a computer mouse
US9962839B2 (en) Robot apparatus, method for controlling the same, and computer program
DE102014101735A1 (en) Method and device for controlling an robot device from surgery on the body
EP1974325B1 (en) Three-dimensional scan recovery
KR101227610B1 (en) Image recognizing apparatus, operation judging method, and computer-readable recording medium for recording program therefor
TW452723B (en) Method and apparatus for three-dimensional input entry
CN103279186B (en) Merge the multiple goal motion capture system of optical alignment and inertia sensing
JP6057396B2 (en) 3D user interface device and 3D operation processing method
EP2677398A2 (en) Virtual touch device without pointer on display surface
CN105659295B (en) For indicating the method for point of interest in the view of true environment on the mobile apparatus and for the mobile device of the method
EP2615523A1 (en) Image recognition apparatus, operation evaluation method, and program
US7377650B2 (en) Projection of synthetic information
CN102419632B (en) Adjusted sight line tracking man-machine interaction device
CN102915111A (en) Wrist gesture control system and method
EP2040156A2 (en) Image processing
US20110267265A1 (en) Spatial-input-based cursor projection systems and methods

Legal Events

Date Code Title Description
PB01 Publication
C06 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20160831

WD01 Invention patent application deemed withdrawn after publication