WO2016192440A1

WO2016192440A1 - Motion sensing control parameter adjustment method, motion sensing interaction system and electronic device

Info

Publication number: WO2016192440A1
Application number: PCT/CN2016/076777
Authority: WO
Inventors: 黄源浩; 肖振中; 钟亮洪; 许宏淮; 林靖雄
Original assignee: 深圳奥比中光科技有限公司
Priority date: 2015-06-05
Filing date: 2016-03-18
Publication date: 2016-12-08

Abstract

Disclosed are a motion sensing screen scrolling control method, a motion sensing interaction system and an electronic device. The motion sensing screen scrolling control method comprises: collecting a three-dimensional stereo image of a human body part in a motion sensing interaction system activation state; extracting a feature of the three-dimensional stereo image of the human body part to acquire a feature parameter, wherein the feature parameter comprises a three-dimensional coordinate of the human body part and a motion trajectory of the human body part; judging whether the human body part enters a predetermined sensing region according to the three-dimensional coordinate of the human body part; and when the human body part enters the predetermined sensing region, controlling the scrolling of a screen on the basis of the motion trajectory of the human body part and according to a predetermined rule. By means of the above-mentioned method, the present invention can control screen scrolling by sensing a spatial action of a human body part without the need for relying on an external input device, providing a user with a better use experience.

Description

Method for adjusting body shape control parameter, somatosensory interaction system and electronic device

【技术领域】[Technical Field]

The invention relates to the field of human-computer interaction, and particularly relates to a method for sensing a screen scrolling, a somatosensory interaction system and an electronic device.

【背景技术】【Background technique】

Human-computer interaction technology refers to the technology of realizing human-machine dialogue in an efficient manner through input and output devices. The existing interaction mode of human-computer interaction usually interacts with the machine system through external devices such as a mouse, a keyboard, a touch screen or a handle, and the machine system responds accordingly. For example, when it is necessary to control the volume adjustment, the volume adjustment is implemented by a mouse drag, or the volume adjustment is performed by sliding a human body part such as a finger on the touch screen.

The existing control parameter adjustment methods must be in direct contact with input devices such as a mouse and a touch screen to complete the parameter adjustment operation, so that the user control parameter adjustment operation must rely on the external device to restrain the user's behavior, and the specific implementation does not appear. Natural, not true.

【发明内容】 [Summary of the Invention]

The technical problem to be solved by the present invention is to provide a method for adjusting body shape control parameters, a somatosensory interaction system and an electronic device, which can control parameter adjustment by sensing the action of a human body part without relying on an external input device.

In order to solve the above technical problem, a technical solution adopted by the present invention is to provide a method for adjusting a body feeling control parameter, the method comprising: collecting a three-dimensional stereoscopic image of a human body part in an activated state of the somatosensory interaction system; Feature extraction of the three-dimensional image of the part to obtain feature parameters, the feature parameter includes three-dimensional coordinates of the human body part and a spatial motion track of the human body part; and determining whether the human body part enters according to the three-dimensional coordinates of the human body part The sensing area is predetermined; when the body part enters the predetermined sensing area, the parameter adjustment is performed according to the spatial motion trajectory of the body part.

The parameter includes at least one of volume, brightness, and screen scrolling speed.

Wherein, the method further comprises: when the human body part enters the predetermined sensing area, displaying an icon moving synchronously with the human body part on the screen.

Wherein, the method further comprises: when the human body part enters the predetermined sensing area, the screen displays a corresponding prompt.

Wherein, the human body part is a human hand.

In order to solve the above technical problem, another technical solution adopted by the present invention is to provide a somatosensory interaction system, the system includes an acquisition module, a feature extraction module, a judgment module, and a control module, wherein: the acquisition module is used for the sense of body Acquiring a three-dimensional image of a human body part in an active state; the feature extraction module is configured to perform feature extraction on the three-dimensional image of the human body part to obtain a feature parameter, where the feature parameter includes a three-dimensional coordinate of the human body part and a spatial motion trajectory of the human body part; the determining module is configured to determine whether the human body part enters a predetermined sensing area according to the three-dimensional coordinates of the human body part; and the control module is configured to: when the human body part enters a predetermined sensing In the region, the control performs parameter adjustment according to the spatial motion trajectory of the human body part.

The system further includes a display module, and the display module is configured to display an icon moving synchronously with the human body part on the screen when the human body part enters the predetermined sensing area.

The display module is further configured to display a corresponding prompt on the screen when the human body part enters the predetermined sensing area.

In order to solve the above technical problem, the present invention provides a technical solution for providing an electronic device, the electronic device somatosensory interaction system, the somatosensory interaction system includes an acquisition module, a feature extraction module, a judgment module, and a control module. The acquiring module is configured to collect a three-dimensional stereoscopic image of a human body part in an activated state of the somatosensory interaction system; the feature extraction module is configured to perform feature extraction on the three-dimensional stereoscopic image of the human body part to obtain a feature parameter, where the feature The parameter includes a three-dimensional coordinate of the human body part and a spatial motion trajectory of the human body part; the determining module is configured to determine whether the human body part enters a predetermined sensing area according to the three-dimensional coordinates of the human body part; When the body part enters the predetermined sensing area, the parameter adjustment is performed according to the spatial motion trajectory of the body part.

The invention has the beneficial effects that the three-dimensional stereoscopic image of the human body part is collected in the state of activating the somatosensory interaction system, and the feature extraction is performed according to the three-dimensional stereoscopic image of the human body part to obtain the characteristic parameter, wherein the feature is different from the prior art. The parameters include the three-dimensional coordinates of the human body part and the spatial motion trajectory of the human body part. According to the three-dimensional coordinates of the human body part, it is determined whether the human body part enters the predetermined sensing area, and when the human body part enters the predetermined sensing area, the parameter is controlled according to the spatial motion trajectory of the human body part. Adjustment. In this way, it is not necessary to rely on the external input device, and the parameter adjustment can be controlled by sensing the spatial action of the human body part, thereby giving the user a better use experience.

【附图说明】 [Description of the Drawings]

1 is a flow chart of a method for adjusting a somatosensory control parameter provided by an implementation of the present invention;

2 is a flowchart of an activated somatosensory interaction system according to an embodiment of the present invention;

3 is a schematic structural diagram of a somatosensory interaction system according to an embodiment of the present invention;

4 is a schematic structural diagram of another somatosensory interaction system according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of an activation module in a somatosensory interaction system according to an embodiment of the present invention; FIG.

6 is a schematic diagram of an operation of adjusting a screen scroll speed by a somatosensory control according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of operation of controlling brightness of a screen by a somatosensory control according to an embodiment of the present invention; FIG.

FIG. 8 is a schematic diagram of an operation of controlling volume adjustment by a sense of body according to an embodiment of the present invention.

【具体实施方式】【detailed description】

Referring to FIG. 1 , FIG. 1 is a method for adjusting a somatosensory control parameter according to an embodiment of the present invention. As shown in the figure, a method for adjusting a somatosensory control parameter of the embodiment includes:

S101: collecting a three-dimensional stereoscopic image of a human body part in an activated state of the somatosensory interaction system;

In the embodiment of the present invention, the somatosensory interaction system needs to be activated before the somatosensory interaction needs to be performed.

For further reference to FIG. 2, FIG. 2 is a flowchart of an activated somatosensory interaction system according to an embodiment of the present invention. As shown in the figure, the activation of the somatosensory interaction system includes the following steps:

S201: collecting a three-dimensional stereoscopic image;

A three-dimensional stereoscopic image within a predetermined spatial range is acquired by a 3D sensor. The acquired three-dimensional stereoscopic image includes all objects of the 3D sensor lens monitoring range. For example, the 3D sensor lens includes a table, a chair, and a person, and the acquired three-dimensional image includes all of these objects.

S202: processing the three-dimensional stereoscopic image, determining whether the three-dimensional stereoscopic image includes a three-dimensional stereoscopic image for activating a human body part of the somatosensory interaction system;

The three-dimensional stereoscopic image acquired by the 3D sensor is processed to determine whether the three-dimensional stereoscopic image includes a three-dimensional stereoscopic image for activating a human body part of the somatosensory interaction system. For example, if the preset human body part for activating the somatosensory interaction system is a human hand, it is recognized whether the human hand is included from the acquired three-dimensional stereoscopic image. If a three-dimensional stereoscopic image for activating a human body part of the somatosensory interaction system is included in the three-dimensional stereoscopic image, step S203 is performed.

S203: processing a three-dimensional stereoscopic image of a human body part, and converting into an activation instruction;

The processing of the three-dimensional image of the human body part into the activation instruction specifically includes: extracting the feature parameters of the three-dimensional image of the human body part, and the characteristic parameters include the three-dimensional coordinates of the human body part and the spatial motion track of the human body part, The feature parameter is matched with the feature parameter of the pre-stored activated somatosensory interaction system. When the matching degree reaches a predetermined threshold, an instruction corresponding to the pre-stored feature parameter is acquired as an activation command.

The three-dimensional images of the collected human body parts are extracted, and the feature parameters are obtained, and the feature parameters include position parameters and motion track parameters. The positional parameter, that is, the spatial position of the human body part, is represented by three-dimensional coordinates, that is, the motion trajectory of the human body part in space. For example, a palm gripping action, the parameter extraction includes the actual three-dimensional coordinates X, Y, Z of the palm of the hand to determine the specific positional relationship between the palm and the 3D sensor. It also includes the spatial motion trajectory of the palm, that is, the motion trajectory of the grip.

After the feature parameters are extracted, the extracted feature parameters are matched with the pre-stored feature parameters for activating the somatosensory interaction system.

For example, through a palm motion, the somatosensory interaction system is activated. The characteristic parameters of the pre-stored palm motion include A, B, and C. Currently, a three-dimensional image of a palm is collected, and the extracted feature parameters include A', B', and C. ', A', B', C' are matched with A, B, C, and it is judged whether the matching degree reaches a predetermined threshold.

When the extracted feature parameter matches the pre-stored feature parameter for activating the somatosensory interaction system to reach a predetermined threshold, an instruction corresponding to the pre-stored feature parameter is acquired as an activation command. The predetermined threshold is a value of a preset matching degree. For example, the predetermined threshold may be set to 80%. When the matching degree reaches 80% or more, an instruction corresponding to the pre-stored characteristic parameter is acquired as an activation instruction.

As a preferred implementation, when the matching degree of the extracted feature parameter and the pre-stored feature parameter for activating the somatosensory interaction system reaches a predetermined threshold, the system may further determine that the three-dimensional stereoscopic image includes a system for activating the somatosensory interaction system. Whether the three-dimensional image of the human body part lasts for a predetermined time. When the predetermined time reaches the predetermined time, the instruction corresponding to the pre-stored feature parameter is acquired as the activation command. In this way, it is possible to effectively prevent the false trigger from activating the somatosensory interaction system.

For example, the preset body part for activating the somatosensory intersection system is the palm of the hand. When the user in front of the 3D sensor is currently chatting with another person, a palm motion may be inadvertently made. After the system collects and recognizes the palm motion, it further determines whether the palm image contains the palm or not. Time, if it does not continue to reach the scheduled time, it can be judged that this is only a misoperation, then the somatosensory interaction system will not be activated. Wherein, the predetermined time here can be preset according to needs, for example, set to 10 seconds, 30 seconds, and the like.

As a still further preferred solution, a progress bar may be displayed on the screen to prompt the somatosensory interaction system activation state when the system collects and recognizes the human body part and does not reach the predetermined time. The progress bar can display the speed of the system activation, the degree of completion, the amount of remaining unfinished tasks, and the processing time that may be required in real time. As a possible implementation, the progress bar can be displayed in a rectangular strip. When the progress bar is full, it means that the somatosensory interaction system condition is activated and the somatosensory interaction system is activated. In this way, the user can have an intuitive understanding of the activation state of the somatosensory interaction system, and can also cause the user who misunderstands to stop the gesture action in time to avoid false triggering of the activation of the somatosensory interaction system.

S204: Activate the somatosensory interaction system according to the activation instruction.

According to the acquired activation instruction, the somatosensory interaction system is activated to enter the somatosensory interaction state.

After the activation of the somatosensory interaction system, the user may be prompted to activate the corresponding somatosensory interaction system. Among them, it can be prompted by displaying the predetermined area of the screen in a highlighted state. The predetermined area here may be a preset body sensing area corresponding to a plane area on the screen, such as an area of a certain area on the left side of the screen, or an area of a certain area on the right side of the screen. Of course, it can also be the entire screen.

Of course, the user may also be prompted by other means, such as by popping up a prompt that the somatosensory interaction system has been activated, or by a voice prompt, etc., which is not limited by the present invention.

In addition, after the somatosensory interaction system is activated, an icon that moves in synchronization with the human body part is displayed on the screen. The icon that moves synchronously with the human body part may be an icon similar to the human body part, for example, the human body part is a human hand, and the icon may be a hand shape icon. Of course, it can be other forms of icons, such as triangle icons, dot icons, and so on. The icon on the screen follows the movement of the body part and moves correspondingly on the screen. For example, the human hand moves to the right in space, and the icon also moves to the right along the screen.

In the activated state of the somatosensory interaction system, a three-dimensional stereoscopic image of the human body part within a predetermined spatial range is acquired by the 3D infrared sensor. The 3D infrared sensor can collect a three-dimensional image of the object in the spatial position, and the acquired three-dimensional image includes the spatial position coordinates of the object and the spatial motion track.

The spatial motion trajectory described in the embodiments of the present invention includes the posture of the human body component and the specific action of the human body component. For example, if the user makes a fist gesture in front of the 3D body sensor and slides in the space range, the 3D body sensor collects the three-dimensional image of the user's hand, and extracts the feature of the three-dimensional image of the hand, that is, the hand is obtained. The distance from the 3D sensor to the 3D coordinates of the 3D sensor, as well as the gripping and sliding movements of the hand. The processing of other three-dimensional stereoscopic images is similar to this, and the present embodiment will not be described by way of example.

The human body part mentioned in the embodiment of the present invention may be a human hand. Of course, it can also be other human body parts for operation such as a human face, a human foot, and the like.

S102: Perform feature extraction on a three-dimensional image of a human body part to obtain a feature parameter, where the feature parameter includes a three-dimensional coordinate of the human body part and a spatial motion track of the human body part;

The three-dimensional image of the collected human body part is subjected to feature extraction to obtain the feature parameters of the acquired three-dimensional space, wherein the feature parameters include the spatial three-dimensional coordinates of the human body part and the spatial motion track of the human body part. By feature extraction, it is possible to recognize the specific spatial position of the body part from the 3D sensor and the action of the body part. For example, a gripping action by a human hand, by collecting the stereoscopic image of the grip, and by feature extraction, can determine the specific spatial position of the human hand according to the parameters extracted by the feature and recognize that the motion is a gripping action. .

As a possible implementation, prior to identifying the action, the present invention includes a process of learning training to establish a training database. For example, in order to recognize the movement of a human hand, the system collects three-dimensional images of various gripping actions, and learns these different gripping actions to obtain specific feature parameters for identifying this specific action. For each different action, the system will do such a learning training process, and the specific characteristic parameters corresponding to various specific actions constitute a training database. When the system acquires a three-dimensional stereo image, the stereo image is extracted from the feature, and a specific action matching the same is found in the training database as a recognition result.

S103: determining, according to the three-dimensional coordinates of the human body part, whether the human body part enters the predetermined sensing area;

From the three-dimensional coordinates of the human body part in the extracted feature parameters, it is determined whether the human body part enters the predetermined sensing area. Wherein, the predetermined sensing area here may be a predetermined spatial range. For example, the spatial area corresponding to the predetermined area on the left side of the screen is set as the predetermined sensing area, and the action of the spatial range outside the predetermined sensing area does not respond. Or when different parameter adjustments need to be performed through different somatosensory actions, different predetermined sensing regions may be respectively set to correspond to different parameter adjustments, such as setting a predetermined spatial range on the upper side of the screen corresponding to the sensing and responding to the brightness adjustment, and the predetermined space on the lower side of the screen. The range corresponds to the sense and responds to volume adjustments and more. Of course, the setting may not be made. In this case, the spatial range in which the stereoscopic image can be acquired by the 3D sensor is a predetermined sensing area, and different operations are performed only according to different motion responses.

Wherein, when the human body part enters the predetermined sensing area, a corresponding prompt is displayed on the screen. Wherein, as a possible prompting manner, the predetermined sensing area may be displayed in a highlighted state to prompt the user to perform a control action within the predetermined sensing area. Of course, the predetermined sensing area can also prompt the user in other ways. Such as highlighting, flashing display or display stripes and so on.

When the three-dimensional coordinates of the human body part in the feature parameter fall within the predetermined sensing area range, step S104 is performed. Otherwise, no response is made.

S104: Control parameter adjustment according to a spatial motion trajectory of the human body part;

When the human body part enters the predetermined sensing area, the parameter adjustment is performed according to the spatial motion trajectory of the human body part in the feature extraction parameter. The parameter adjustment herein may be, but is not limited to, at least one of volume adjustment, screen brightness adjustment, and screen scroll speed adjustment.

The parameter adjustment according to the spatial motion trajectory of the human body part specifically includes: matching the spatial motion trajectory of the human body part with the pre-stored spatial motion trajectory, and when the matching reaches the predetermined matching threshold value, controlling the parameter corresponding to the pre-stored spatial motion trajectory is controlled. Adjustment.

For example, the action of pushing the palm up is correspondingly to increase the volume, and the action of pushing the palm downward corresponds to the volume of the low volume. When the action of pushing the palm upward is controlled, the volume is turned up, and the action of pulling the palm downward is controlled. Turn the volume down.

When the body part leaves the predetermined sensing area, the somatosensory interaction system enters the locked state, and the interaction of the somatosensory control parameter adjustment can only be entered after the somatosensory interaction system is activated again.

In the embodiment of the present invention, different parameters of different sensing regions may be preset, and different actions of different sensing regions may be adjusted corresponding to different parameters. For example, setting the area on the left side of the screen to the sensing area, the palm up motion control volume is adjusted, the palm down motion control volume is small, the screen on the right side of the screen, the sensing area, the fist movement, the upward movement, the screen brightness is increased, and the fist movement is moved downward to control the screen brightness adjustment. small. When the palm is detected in the predetermined sensing area on the left side of the screen and the palm moves upward, the volume is turned up, and the palm down motion control volume is turned down. When the gripping action is detected in the predetermined sensing area on the right side of the screen, the upward movement control screen is brightened, and when the gripping action is detected, the downward movement control screen is darkened. Of course, under such setting conditions, if the action of clenching is detected in a predetermined area on the left side of the screen, or when the palm is detected in a predetermined area on the right side of the screen, no response is made.

When different operations are not set in the predetermined area, only different actions may be set to correspond to different operations, and the range of the 3D body sensor capable of acquiring the stereoscopic image is the sensing area, as long as the human body part enters the sensing area and senses the action, And matching with the preset action reaches a predetermined threshold, that is, performing an operation corresponding to the action.

Please refer to FIG. 6. FIG. 6 is a schematic diagram of the operation of controlling the scrolling speed of the screen by the sense of body according to the embodiment of the present invention. As shown in the figure, when the human hand slides to the left, the control screen scrolls faster, and when the human hand slides to the right, the screen scrolling speed is controlled. slow. Of course, this is just an example. You can also set the control screen to scroll faster when the person slides to the right, and the control screen scrolls slowly when the person slides to the left.

Please refer to FIG. 7. FIG. 7 is a schematic diagram of the operation of adjusting the brightness of the screen through the somatosensory control according to the embodiment of the present invention. As shown in the figure, the first schematic diagram illustrates the motion control screen brightness reduction by moving the fist with the right hand. The schematic diagram shows that the action control screen moved to the middle by the right hand fist is displayed in normal brightness, and the third schematic diagram shows that the brightness of the screen is controlled by a certain action by the right hand fist.

Please refer to FIG. 8. FIG. 8 is a schematic diagram of the operation of controlling the volume adjustment by the somatosensory according to the embodiment of the present invention. As shown in the figure, the first schematic diagram illustrates the downward control of the volume by the left hand to control the volume reduction. The action of moving to the middle by the left hand fist is controlled to the normal volume, and the third schematic diagram shows that the volume of the upward movement by the left hand is controlled to increase the volume.

Of course, the above schematic diagram is only schematic, and what action corresponds to what kind of operation is performed by the control may be set as needed.

The invention collects a three-dimensional stereoscopic image of a human body part in a state of activating a somatosensory interaction system, and extracts feature parameters according to a three-dimensional stereoscopic image of the human body part, wherein the characteristic parameters include a three-dimensional coordinate of the human body part and a spatial motion track of the human body part, According to the three-dimensional coordinates of the human body part, it is determined whether the human body part enters the predetermined sensing area, and when the human body part enters the predetermined sensing area, the parameter adjustment is performed according to the spatial motion trajectory control of the human body part. In this way, it is not necessary to rely on the external input device, and the parameter adjustment can be controlled by sensing the spatial action of the human body part, thereby giving the user a better use experience.

Referring to FIG. 3, FIG. 3 is a schematic structural diagram of a somatosensory interaction system according to an embodiment of the present invention. The somatosensory interaction system of the embodiment is used to perform the method for adjusting the somatosensory control parameters of the embodiment shown in FIG. As shown, the somatosensory interaction system 100 of the present embodiment includes an acquisition module 11, a feature extraction module 12, a determination module 13, and a control module 14, wherein:

The collecting module 11 is configured to collect a three-dimensional stereoscopic image of a human body part in an activated state of the somatosensory interaction system;

In the embodiment of the present invention, when the somatosensory control parameter adjustment is required, the somatosensory interaction system needs to be activated first.

Referring to FIG. 4, FIG. 4 is a schematic structural diagram of another somatosensory interaction system according to an embodiment of the present invention. The somatosensory interaction system provided in this embodiment includes the same function as the somatosensory interaction system provided in the embodiment shown in FIG. In addition to the module, an activation module 15 is further included for controlling the activation of the somatosensory interaction system. The same function modules as those shown in Figure 3 have the same specific function implementation. For details, please refer to the related description below.

For example, please refer to FIG. 5. FIG. 5 is a schematic structural diagram of an activation module according to an embodiment of the present invention. As shown, the activation module 15 includes an acquisition unit 151, a determination unit 152, a conversion unit 153, and an activation unit 154, where:

The collecting unit 151 is configured to collect a three-dimensional stereoscopic image;

The acquisition unit 151 collects a three-dimensional stereoscopic image within a predetermined spatial range through a 3D sensor. The acquired three-dimensional stereoscopic image includes all objects of the 3D sensor lens monitoring range. For example, the 3D sensor lens includes a table, a chair, and a person, and the acquired three-dimensional image includes all of these objects.

The determining unit 152 is configured to process the three-dimensional stereoscopic image, determine whether the three-dimensional stereoscopic image includes a three-dimensional stereoscopic image for activating a human body part of the somatosensory interactive system, and output the determination result to the conversion unit 153.

The determining unit 152 processes the three-dimensional stereoscopic image acquired by the 3D sensor, and determines whether the three-dimensional stereoscopic image includes a three-dimensional stereoscopic image for activating a human body part of the somatosensory interactive system. For example, if the preset human body part for activating the somatosensory interaction system is a human hand, it is recognized whether the human hand is included from the acquired three-dimensional stereoscopic image.

The conversion unit 153 is configured to process the three-dimensional stereoscopic image of the human body part and convert it into an activation command.

The activation unit 154 is configured to activate the somatosensory interaction system in accordance with the activation instruction.

According to the acquired activation instruction, the somatosensory interaction system is activated to enter the somatosensory interaction state. The acquisition module 11 collects a three-dimensional stereoscopic image of a human body part entering the sensing area under the activation state of the somatosensory interaction system.

The feature extraction module 12 is configured to perform feature extraction on the three-dimensional image of the human body part to acquire feature parameters, where the feature parameters include three-dimensional coordinates of the human body part and spatial motion trajectories of the human body part;

The feature extraction module 12 performs feature extraction on the collected three-dimensional image of the human body part to obtain the feature parameters of the acquired three-dimensional space, wherein the feature parameters include the spatial three-dimensional coordinates of the human body part and the space of the human body part. Movement track. By feature extraction, it is possible to recognize the specific spatial position of the body part from the 3D sensor and the action of the body part. For example, a gripping action by a human hand, by collecting the stereoscopic image of the grip, and by feature extraction, can determine the specific spatial position of the human hand according to the parameters extracted by the feature and recognize that the motion is a gripping action. .

The determining module 13 is configured to determine whether the human body part enters the predetermined sensing area according to the three-dimensional coordinates of the human body part;

The judging module 13 judges whether the human body part enters the predetermined sensing area from the three-dimensional coordinates of the human body part among the extracted feature parameters. Wherein, the predetermined sensing area here may be a predetermined spatial range. For example, the spatial area corresponding to the predetermined area on the left side of the screen is set as the predetermined sensing area, and the action of the spatial range outside the predetermined sensing area does not respond. Or when different parameter adjustments need to be performed through different somatosensory actions, different predetermined sensing regions may be respectively set to correspond to different parameter adjustments, such as setting a predetermined spatial range on the upper side of the screen corresponding to the sensing and responding to the brightness adjustment, and the predetermined space on the lower side of the screen. The range corresponds to the sense and responds to volume adjustments and more. Of course, the setting may not be made. In this case, the spatial range in which the stereoscopic image can be acquired by the 3D sensor is a predetermined sensing area, and different operations are performed only according to different motion responses.

The control module 14 is configured to control parameter adjustment according to a spatial motion trajectory of the human body part when the human body part enters the predetermined sensing area.

When the human body part enters the predetermined sensing area, the control module 14 performs parameter adjustment according to the spatial motion trajectory of the human body part in the feature extraction parameter. The parameter adjustment herein may be, but is not limited to, at least one of volume adjustment, screen brightness adjustment, and screen scroll speed adjustment.

4, the somatosensory interaction system of the present embodiment may further include a display module 16 for displaying an icon moving synchronously with the human body part on the screen when the human body part enters the predetermined sensing area.

The icon that moves synchronously with the human body part may be an icon similar to the human body part, for example, the human body part is a human hand, and the icon may be a hand shape icon. Of course, it can be other forms of icons, such as triangle icons, dot icons, and so on. The icon on the screen follows the movement of the body part and moves correspondingly on the screen. For example, the human hand moves to the right in space, and the icon also moves to the right along the screen.

The display module 16 is further configured to display a corresponding prompt on the screen when the body part enters the predetermined sensing area.

Wherein, when the human body part enters the predetermined sensing area, the user may be prompted accordingly. As a possible implementation manner, the display module 16 may display the predetermined sensing area in a highlighted state to prompt the user to perform a control action within the predetermined sensing area. Of course, the predetermined sensing area can also prompt the user in other ways. Such as highlighting, flashing display or display stripes and so on.

Based on the somatosensory interaction system provided by the embodiment of the present invention, the embodiment of the present invention further provides an electronic device, where the electronic device includes the somatosensory interaction system described in the foregoing embodiment. The electronic device can be, but is not limited to, a smart TV, a smart phone, a tablet computer, a notebook computer, and the like.

The somatosensory interaction system provided by the embodiment of the present invention collects a three-dimensional stereoscopic image of a human body part in a state of activating a somatosensory interaction system, and extracts characteristic parameters according to a three-dimensional stereoscopic image of the human body part, wherein the characteristic parameters include a human body part. The three-dimensional coordinates and the spatial motion trajectory of the human body part determine whether the human body part enters the predetermined sensing area according to the three-dimensional coordinates of the human body part. When the human body part enters the predetermined sensing area, the parameter adjustment is performed according to the spatial motion trajectory control of the human body part. In this way, it is not necessary to rely on the external input device, and the parameter adjustment can be controlled by sensing the spatial action of the human body part, thereby giving the user a better use experience.

In the several embodiments provided by the present invention, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read only memory (ROM, Read-Only) Memory, random access memory (RAM), disk or optical disk, and other media that can store program code.

The above is only the embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformation of the present invention and the contents of the drawings may be directly or indirectly applied to other related technologies. The fields are all included in the scope of patent protection of the present invention.

Claims

A method for adjusting a somatosensory control parameter, characterized in that the method comprises:

Collecting a three-dimensional image of a human body part in an activated state of the somatosensory interaction system;

Performing feature extraction on the three-dimensional image of the human body part to obtain a feature parameter, where the feature parameter includes a three-dimensional coordinate of the human body part and a spatial motion track of the human body part;

Determining, according to the three-dimensional coordinates of the human body part, whether the human body part enters a predetermined sensing area;

When the human body part enters the predetermined sensing area, the parameter adjustment is performed according to the spatial motion trajectory of the human body part.
The method of claim 1 wherein said parameters comprise at least one of volume, brightness, and screen scroll speed.
The method of claim 1 further comprising:

When the body part enters the predetermined sensing area, an icon that moves in synchronization with the body part is displayed on the screen.
The method of claim 1 further comprising:

When the body part enters the predetermined sensing area, the screen displays a corresponding prompt.
The method of claim 1 wherein said body part is a human hand.
A somatosensory interaction system, characterized in that the system comprises an acquisition module, a feature extraction module, a judgment module and a control module, wherein:

The collecting module is configured to collect a three-dimensional stereoscopic image of a human body part in an activated state of the somatosensory interaction system;

The feature extraction module is configured to perform feature extraction on the three-dimensional image of the human body part to obtain a feature parameter, where the feature parameter includes a three-dimensional coordinate of the human body part and a spatial motion track of the human body part;

The determining module is configured to determine, according to the three-dimensional coordinates of the human body part, whether the human body part enters a predetermined sensing area;

The control module is configured to perform parameter adjustment according to a spatial motion trajectory of the human body part when the human body part enters a predetermined sensing area.
The system of claim 6 wherein said parameters comprise at least one of volume, brightness, and screen scroll speed.
The system according to claim 6, wherein the system further comprises a display module, wherein the display module is configured to display a synchronous movement with the human body part on the screen when the human body part enters the predetermined sensing area Icon.
The system according to claim 6, wherein the display module is further configured to display a corresponding prompt on the screen when the human body part enters the predetermined sensing area.
An electronic device, comprising: a somatosensory interaction system, the somatosensory interaction system comprising an acquisition module, a feature extraction module, a determination module, and a control module, wherein:

The collecting module is configured to collect a three-dimensional stereoscopic image of a human body part in an activated state of the somatosensory interaction system;

The feature extraction module is configured to perform feature extraction on the three-dimensional image of the human body part to obtain a feature parameter, where the feature parameter includes a three-dimensional coordinate of the human body part and a spatial motion track of the human body part;

The determining module is configured to determine, according to the three-dimensional coordinates of the human body part, whether the human body part enters a predetermined sensing area;

The control module is configured to perform parameter adjustment according to a spatial motion trajectory of the human body part when the human body part enters a predetermined sensing area.
The electronic device of claim 10, wherein the parameter comprises at least one of volume, brightness, and screen scroll speed.
The electronic device according to claim 10, wherein the system further comprises a display module, wherein the display module is configured to synchronize with the human body part on the screen when the human body part enters the predetermined sensing area Mobile icon.
The electronic device according to claim 10, wherein the display module is further configured to display a corresponding prompt on the screen when the human body part enters the predetermined sensing area.