TW201411412A - Contactless control system and method - Google Patents

Abstract

A contactless control system includes a camera, a display unit and a processing unit. The processing unit drives the display unit to display a present selection indicator, at least a first direction path and several second direction paths. One end of each second direction path is connected to the first direction path, and the other end of each second direction path represents a preset option. The processing unit receives several images captured by the camera for detecting at least one present position of a specified part of a user. The processing unit moves the displayed position of the present selection indicator on the first direction path and the second direction paths corresponding to the detected present position, or selects one of the preset options corresponding to the position of the present selection indicator.

Description

Non-contact control system and method

The present invention relates to a non-contact control system and method.

With the development of digital technology, many different digital applications have been developed, and many knowledge has been provided in digital form. More and more people use a variety of electronic devices as an aid in life.

At present, general electronic devices provide a variety of operating interfaces, such as a keyboard, a mouse, a touch screen, a remote control, and the like. When using such an operation interface, the user needs to specifically touch and hold the hardware components of such an operation interface, and such operations usually require additional learning of the operation mode, and the user who has not contacted can not easily get started.

Therefore, how to provide an operation method that is simple to use and does not need to specifically allow a user to hold or touch a specific hardware component is one of the current important research and development topics, and has become an urgent need for improvement in related fields.

Accordingly, one aspect of the present invention is to provide a non-contact control system for correspondingly moving a current option indication or selecting a corresponding option based on the location of a particular body part of the detected user. The contactless control system includes a camera, a display component, and a processing component. The processing element is coupled to the camera and the display element. The processing component includes a path display module and an indication processing module. Path display module driving display element A current option indication, at least one first axial path, and a plurality of second axial paths are displayed. The second axial path includes a first end and a second end, the first end of each of the second axial paths is coupled to the at least one first axial path, and the second end of each of the second axial paths Represents a preset option. The second axial paths are parallel to each other, and one of the second axial paths is perpendicular to the first axial direction of one of the at least one first axial paths. The instruction processing module receives the plurality of images captured by the camera, and the image detects at least one current location of a specific body part of the user. Instructing the processing module to select a position of the current option indication according to the current position of the specific body part, corresponding to the first axial path and the second axial path, or selecting one of the second ends according to the position indicated by the current option Represents the default options.

Another aspect of the present invention is to provide a non-contact control method for correspondingly moving a current option indication or selecting a corresponding option based on the location of a particular body part of the detected user. The contactless control method consists of the following steps:

(a) displaying a current option indication, at least one first axial path, and a plurality of second axial paths by a display element. The second axial path includes a first end and a second end. A first end of each of the second axial paths is coupled to the first axial path, and a second end of each of the second axial paths represents a predetermined option. The second axial paths are parallel to each other. One of the second axial paths is perpendicular to a first axial direction of one of the first axial paths.

(b) Receive a number of images taken by a camera.

(c) detecting at least one current location of a particular body part of a user from the image.

(d) corresponding to the first axial direction according to the current position of the specific body part On the path and the second axial path, move the position indicated by the current option, or select the preset option represented by one of the second ends according to the position indicated by the current option.

The application of the present invention has the following advantages. The user can intuitively move his or her specific body part and move the current option indication to select each option. In other words, the application of the present invention for option selection does not require a complicated learning process, and the difficulty of use is low, and there is no need to hold or touch additional hardware components. In addition, since the first axial path selected between the options is perpendicular to the second axial path representing each option, the probability of movement or selection of the error due to inaccurate movement of the user's body can be greatly reduced.

The spirit and scope of the present invention will be described in the following detailed description of the preferred embodiments of the present invention, which can be modified and modified by the teachings of the present invention. The spirit and scope of the present invention.

Please refer to FIG. 1 , which is a functional block diagram of a non-contact control system according to an embodiment of the invention. The contactless control system correspondingly moves the current option indication or selects the corresponding option according to the location of the detected specific body part of the user.

The contactless control system 100 includes a camera 110, a display component 120, and a processing component 130. The processing component 130 is coupled to the camera 110 and the display component 120 via a wired or wireless connection.

The processing component 130 includes a path display module 131 and an indication processing module 132. Figure 2 is a representation of the display of component 120. Example. Refer to both Figure 1 and Figure 2. The path display module 131 drives the display element 120 to display a current option indication 201, at least one first axial path 211, and a plurality of second axial paths 221, 222. Each of the second axial paths 221 and 222 includes a first end 221a, 222a and a second end 221b, 222b. The first ends 221a, 222a of the second axial paths 221, 222 are connected to the at least one first axial path 211, and the second ends 221b, 222b of the second axial paths 221, 222 respectively represent a preset option. Option221, Option222. The second axial paths 221, 222 are parallel to each other, and one of the second axial paths 221, 222 is perpendicular to the first axial direction 231 of the at least one first axial path 211.

The indication processing module 132 receives the plurality of images captured by the camera 110 and detects at least one current location of a particular body part of the user from the image. For example, the indication processing module 132 can identify a specific body part (such as a hand, a foot, a face or other human body features) of the user from the received image by using an image recognition algorithm, and further detect the image. Current position.

Next, the indication processing module 132 moves the position of the current option indication 201 corresponding to the current position of the specific body part corresponding to the first axial path 211 and the second axial path 221, 222, or according to the current option indication. The preset option represented by one of the second ends of the second axial path 221, 222 is selected. In this way, the user can intuitively move his specific body part and correspondingly move the current option indicator 201 to select each option. In addition, since the first axial path 211 selected between the options is perpendicular to the second axial paths 221, 222 representing the respective options, the movement of the user's body movement is inaccurate and the wrong movement is performed. Or choose the chance.

Processing component 130 can then execute the selected preset option. Furthermore, one of the second ends 221b, 222b of the second axial path 221, 222 represents an execution option. Thus, one of the processing elements 130 execution module 137 can execute the selected preset option when the selected preset option is an execution option. In this way, a plurality of options to be executed may be selected before the second end of the second axial path corresponding to the execution option is selected. To facilitate the user to identify the selected option, one of the processing component 130 selection indicator modules 135 can indicate the second end of the second axial path representing the selected preset option. The selection indicator module 135 can mark the second end of the second axial path representing the selected preset option by a text effect, a specific icon or other type of indication.

In one embodiment of the invention, the current option indication 201 or selection option can be moved by detecting the rate of movement. Therefore, the processing component 130 can further include a rate determining module 133. When a plurality of different current positions of the specific body part are detected in the plurality of images, the rate determining module 133 determines that the current position of the one of the movement axes formed by the current position is one of the first movement rates of the first axis 231 and One of the second axes 232 has a second rate of movement. Then, the indication processing module 132 can move the displayed current option indication 201 in a direction parallel to the first axis 231 or the second axis 232 according to the first movement rate and the second movement rate. For example, when a plurality of current positions of a specific body part are detected in a plurality of images to form a movement trajectory 241, the rate determining module 133 can determine a first movement rate of the movement trajectory 241 in the first axial direction 231. . In some embodiments of the invention, the indication processing is performed when the first movement rate is greater than a first rate threshold The module 132 moves the displayed current option indication 201 in a direction parallel to the first axis 231 and onto the first axial path 211, the first end 221a of the next second axial path 221. In still other embodiments of the present invention, the processing component 130 may calculate an acceleration parallel to the first axis 231 based on a plurality of first movement rates that are successively calculated. Therefore, when the acceleration parallel to the first axial direction 231 is greater than a first acceleration threshold, the indication processing module 132 moves the displayed current option indication 201 in a direction parallel to the first axis 231, and moves to the first The first end 221a of the next second axial path 221 is on an axial path 211.

Figure 3 is another embodiment of the screen displayed by display element 120. Refer to both Figure 1 and Figure 3. For example, when a plurality of current positions of a specific body part are detected in a plurality of images to form a movement trajectory 242, the rate determination module 133 determines a second movement rate of the movement trajectory 242 in the second axial direction. Thus, in some embodiments of the present invention, when the second movement rate is greater than a second rate threshold, the indication processing module 132 determines that one of the parallel second axes 232 is sensed to move, and the current option indication The 201 moves in a direction parallel to the direction of movement of the second axis 232 to select a preset option Option 221 represented by the second axial path 221 in the direction of movement of the movement track 242 from the position of the current option indication 201. Moreover, when the second movement rate is not greater than the second rate threshold, the indication processing module 132 determines that the movement direction of the movement trajectory 242 is not sensed without making a selection. In still other embodiments of the present invention, the processing component 130 may calculate an acceleration parallel to the second axis 232 based on a plurality of second movement rates that are successively calculated. Thus, when the acceleration parallel to the second axis 232 is greater than a second acceleration threshold, the indication processing module 132 will display The current option indication 201 is moved in a direction parallel to the second axis 232 to select a preset option Option 221 represented by the second axial path 221 in the direction of movement of the movement track 242 from the position of the current option indication 201. However, in other embodiments of the present invention, the rate determining module 133 can simultaneously determine the rate component of the detected moving trajectory in the first axis 231 and the second axis 232 for corresponding processing.

In another embodiment of the present invention, the indication processing module 132 includes an instruction selector 132a for selecting a preset option represented by a second axial path corresponding to a current position of the preset body part. For example, when the current position of the preset body part of the user has a movement of the parallel second axis item 232 in the lower half of the captured image, the command selector 132a can select the preset corresponding to the lower half accordingly. Option Option222.

Figure 4 is another embodiment of the screen displayed by display element 120. The first axial path 211 shown may include an initial position 251. The initial position corresponds to a specific position of each image. Referring to Fig. 5, it is an embodiment of an image taken by the camera 110. For example, the specific position 261 of the image captured by the camera 110 may be preset to correspond to the initial position 251 of the first axial path 211. Thus, the relative position display module 134 of the processing element 130 can drive the display element 120 to display the current position of the particular body part, corresponding to a position corresponding to one of the specific positions 261. For example, when the relative position of the current position 262 of the specific body part (such as the hand) of the user and the specific position 261 on the image is as shown in FIG. 5, the relative position display module 134 can drive the display element according to the relative position. The 120 display shows the corresponding location 252. Processing component 130 may pause the indication before detecting that the user has moved the current position of his particular body position to a particular location 261 The operation of the module 132. After detecting that the user has moved the current position of the particular body position to the particular position 261, the processing component 130 can prompt the user to initialize and begin the activation of the indication processing module 132. In this way, the user can understand how to relatively move his body and select each preset option. In addition, the image captured by the camera 110 can also be displayed on the display element at a position corresponding to the first axial path 211 and the second axial path 221, 222, which is more convenient for the user to operate.

Referring to Figures 6A and 6B, an embodiment of the form-changing function is provided by the present invention. When there are a plurality of first axial paths 211, 212, the second ends 223b, 224b of the second axial paths 223, 224 represent page change options. Furthermore, the first ends 221a, 222a, 223a, 224a, 225a of the second axial paths 221, 222, 223, 224, 225 are respectively connected to one of the first axial paths 211, 212. Thus, the path display module 131 can display one of the first axial paths 211, 212 as the main page to provide preset options represented by different second axial paths 221, 222, 223, 224, 225. In addition, when the selected preset option is a page change option (such as a preset option represented by the second axial path 223 or 224), the page change module 136 of the processing component 130 can move the current option indication to the next An axial path is displayed. In this way, more options can be provided by multiple pages.

Referring to Figure 7, another embodiment of the screen displayed by component 120 is shown. When there are a plurality of first axial paths 211, 212, the path display module 131 can further drive the display element 120 to display at least one third path 271 for connecting the first axial paths 211, 212. In this way, you can also increase the number of options available.

Please refer to FIG. 8 , which is a flowchart of a non-contact control method according to an embodiment of the present invention. In the non-contact control method, according to the position of the specific body part of the detected user, the current option is moved or the corresponding option is selected. The contactless control method can be implemented by a computer program. The computer program can be stored in a computer readable recording medium, and the computer can perform the contactless control method after reading the recording medium. Computer-readable recording media can be read-only memory, flash memory, floppy disk, hard disk, optical disk, flash drive, tape, network accessible database or familiar with the art can easily think of the same The function of the computer can read the recording medium.

The contactless control method 300 includes the step of displaying, in a step 310, a current option indication, at least one first axial path, and a plurality of second axial paths by a display element. The second axial path includes a first end and a second end. A first end of each of the second axial paths is coupled to the first axial path, and a second end of each of the second axial paths represents a predetermined option. The second axial paths are parallel to each other. One of the second axial paths is perpendicular to a first axial direction of one of the first axial paths.

In step 320, a plurality of images captured by a camera are received.

In step 330, at least one current location of a particular body part of a user is detected from the image. For example, an image recognition algorithm can be used to identify a particular body part of a user (such as a hand, foot, face, or other human body feature) from the received image and further detect its current position.

In step 340, according to the current position of the specific body part, corresponding to the first axial path and the second axial path, the current option indication is moved. The location, or the location indicated by one of the second ends, is selected according to the location indicated by the current option. In this way, the user can intuitively move his specific body part and correspondingly move the current option indication to select each option. In addition, since the first axial path selected between the options is perpendicular to the second axial path representing each option, the probability of movement or selection of the error due to inaccurate movement of the user's body can be greatly reduced.

In one embodiment of the contactless control method 300, after the step of selecting the preset option is performed in step 340, the selected preset option can be directly executed. In addition, the second end of one of the second axial paths can also be assigned to represent an execution option. Thus, the selected preset option can be executed when the selected preset option is an execution option. In this way, you can select multiple options to be executed before selecting the execution option to provide multiple selection. In addition, in the non-contact control method 300, the second end of the second axial path representing the selected preset option may be further marked to facilitate the user to identify the selected option.

In an embodiment of step 340, when a plurality of current positions of the specific body part are detected successively, determining a current movement position of one of the movement directions formed by the current position in the first axial direction and the second axis To one of the second movement rates. Next, the displayed current option indication is moved in a direction parallel to the first axis or the second axis based on the first movement rate and the second movement rate.

In some embodiments of the present invention, when the first movement rate is greater than a first rate threshold, the current option indication displayed on the display element is moved parallel to the first axis and moved to the first axis. On the path, the first end of the second axial path of the next connection. In still other embodiments of the present invention, the flatness may be calculated based on a plurality of first movement rates calculated in succession. The acceleration in the first axial direction. Then, when the acceleration parallel to the first axial direction is greater than a first acceleration threshold, the displayed current option indication is moved parallel to the first axial direction and moved to the first axial path, the next The first end of the second axial path.

In addition, when the second moving rate is greater than a second rate threshold, it is determined that one of the parallel second axial directions of movement is sensed, and the current option indication is moved to a direction parallel to the second axis. Select the preset option represented by the second axial path in the direction of movement from the position indicated by the current option. When the second moving rate is not greater than the second rate threshold, it is determined that the moving direction is not sensed without making a selection. In still other embodiments of the present invention, the acceleration parallel to the second axis may be calculated based on a plurality of second movement rates that are successively calculated. Then, when the acceleration parallel to the second axis is greater than a second acceleration threshold, the displayed current option indication is moved in a direction parallel to the second axis to select a position from the current option indication, to move the trajectory A preset option represented by the second axial path in the direction of movement. However, in other embodiments of the present invention, the rate components of the detected moving trajectories in the first axial direction and the second axial direction may be simultaneously determined for corresponding processing.

In another embodiment of step 340, a preset option represented by a second axial path corresponding to a current position of one of the preset body parts may be selected. In addition, the image captured by the camera can also be displayed on the display element at a position corresponding to the first axial path and the second axial path, which is more convenient for the user to operate.

Additionally, the first axial path displayed by the display element can include an initial position. This initial position corresponds to one of the images captured by the camera. Position. Therefore, in the non-contact control method, a corresponding position can be displayed on the display element, which is a relative positional relationship between the current position of the user-specific body part and the specific position. Therefore, step 340 can be suspended until the current position of the specific body part of the user is detected to be moved to the specific position. After detecting that the current position of the specific body part of the user has moved to a specific position, step 340 is started. In this way, the user can understand how to relatively move his body and select each preset option.

When a plurality of first axial paths are available, the second ends of the plurality of second axial paths may be assigned to represent page break options. A first end of each of the second axial paths is coupled to one of the first axial paths. Thus, in step 310, a page in which one of the first axial paths is dominant may be displayed to provide a preset option represented by a different second axial path. In addition, when the selected preset option is a form feed option, the current option indication can be moved to the next first axial path and displayed. In this way, more options can be provided by multiple pages.

Moreover, in an embodiment of step 310, the display element is further operative to display at least one third path for connecting the first axial paths. In this way, you can also increase the number of options available.

The application of the present invention has the following advantages. The user can intuitively move his or her specific body part and move the current option indication to select each option. In other words, the application of the present invention for option selection does not require a complicated learning process, and the difficulty of use is low, and there is no need to hold or touch additional hardware components. In addition, since the first axial path selected between the options is perpendicular to the second axial path representing each option, the probability of movement or selection of the error due to inaccurate movement of the user's body can be greatly reduced.

While the invention has been described above in terms of its embodiments, it is not intended to limit the invention, and various modifications and changes can be made without departing from the spirit and scope of the invention. For example, the parallel or vertical described above may tolerate a certain range of errors and is not limited to the disclosure. Therefore, the scope of the invention is defined by the scope of the appended claims.

100‧‧‧ Non-contact control system

110‧‧‧ camera

120‧‧‧Display components

130‧‧‧Processing components

131‧‧‧Path display module

132‧‧‧Indicating processing module

132a‧‧‧Command selector

133‧‧‧ Rate Judgment Module

134‧‧‧relative position display module

135‧‧‧Selection Marking Module

136‧‧‧page change module

137‧‧‧Execution module

201‧‧‧ current option indication

211~213‧‧‧First axial path

221~226‧‧‧second axial path

End points 221a~226a, 221b~226b‧‧‧

Option221~Option226‧‧‧Default options

231, 232‧‧‧ axial

241, 242‧‧‧ moving track

251‧‧‧ initial position

261‧‧‧Specific location

271‧‧‧ third path

300‧‧‧ Non-contact control method

310~340‧‧‧Steps

The above and other objects, features, advantages and embodiments of the present invention will become more apparent and understood.

FIG. 1 is a functional block diagram of a contactless control system according to an embodiment of the invention.

Figure 2 is an embodiment of a screen displayed by display element 120.

Figure 3 is another embodiment of the screen displayed by display element 120.

Figure 4 is another embodiment of the screen displayed by display element 120.

Figure 5 is an embodiment of an image taken by camera 110.

6A and 6B are diagrams showing an embodiment of a form feed function by the present invention.

Figure 7 is another embodiment of the screen displayed by display component 120.

Figure 8 is a flow chart of a non-contact control method in accordance with an embodiment of the present invention.

100‧‧‧ Non-contact control system

110‧‧‧ camera

120‧‧‧Display components

130‧‧‧Processing components

131‧‧‧Path display module

132‧‧‧Indicating processing module

132a‧‧‧Command selector

133‧‧‧ Rate Judgment Module

134‧‧‧relative position display module

135‧‧‧Selection Marking Module

136‧‧‧page change module

137‧‧‧Execution module

Claims (16)

A non-contact control system comprising: a camera; a display component; and a processing component, coupled to the camera and the display component, wherein the processing component comprises: a path display module, driving the display component to display a current An option indication, at least one first axial path, and a plurality of second axial paths, wherein each of the second axial paths includes a first end and a second end, each of the second axial paths The first end is connected to the at least one first axial path, and the second end of each of the second axial paths represents a preset option, and the second axial paths are parallel to each other, each of the One of the second axial paths is perpendicular to one of the first axial directions of the at least one first axial path; and an indication processing module receives a plurality of images captured by the camera from the images Detecting at least one current location of a particular body part of a user, and corresponding to the at least one first axial path and the second axial paths according to the at least one current position of the particular body part Moving the indication of the current location option, or based on the indicated current location option of selecting one of the plurality of second end wherein represents the default option. The non-contact control system of claim 1, wherein the processing component comprises: a rate determining module, wherein the specific body part is detected to When the number of the current positions is plural, determining a first movement rate of one of the movement positions formed by the current positions in the first axial direction and a second movement rate in the second axial direction, wherein the The indication processing module moves the displayed current option indication to a direction parallel to the first axis or the second axis according to the first movement rate and the second movement rate. The non-contact control system of claim 1, wherein the indication processing module comprises: an instruction selector for selecting the second axial path corresponding to the at least one current position of the preset body part This preset option. The non-contact control system of claim 1, wherein the at least one first axial path displayed includes an initial position corresponding to a specific position of each of the images, the processing element further The method includes: a relative position display module, driving the display component to display the at least one current position of the specific body part, corresponding to a position corresponding to the specific position, wherein detecting the at least one current position to move to the specific position The processing component suspends operation of the indication processing module, wherein the processing component starts to activate the indication processing module after detecting that the at least one current location moves to the specific location. The contactless control system of claim 1, wherein the processing component further comprises: A selection indicator module is provided to indicate the second end of the second axial path representing the selected preset option. The non-contact control system of claim 1, wherein when the number of the at least one first axial path is plural, a plurality of the second ends of the second axial paths represent a form feed Optionally, the first ends of the second axial paths are connected to one of the first axial paths, and the processing component further comprises: a page changing module, wherein the preset option is selected When the page change option is made, the current option indication is moved to the next first axial path. The non-contact control system of claim 1, wherein when the number of the at least one first axial path is plural, the path display module further drives the display element to display at least one third path for connecting The first axial paths. The non-contact control system of claim 1, wherein one of the second ends of the second axial paths represents an execution option, the processing component further comprising: an execution module, selected The preset option is the execution of the selected preset option when the option is executed. A contactless control method comprising: (a) displaying a current option indication, at least one first axial path, and a plurality of second axial paths by a display element, wherein each of the The second axial path includes a first end and a second end, the first end of each of the second axial paths is coupled to the at least one first axial path, and each of the second axial paths The second end represents a predetermined option, and the second axial paths are parallel to each other, and one of the second axial paths is perpendicular to a direction of the at least one first axial path. An axial direction; (b) receiving a plurality of images captured by a camera; (c) detecting at least one current location of a particular body part of the user from the images; and (d) determining the particular body part Selecting at least one current position corresponding to the at least one first axial path and the second axial paths, moving the position indicated by the current option, or selecting the second end according to the position indicated by the current option One of the preset options represented by one. The contactless control method of claim 9, wherein the step (d) comprises: determining the current position when the number of the at least one current position of the specific body part detected is plural a first movement rate of a movement trajectory in the first axial direction and a second movement rate in the second axial direction; and the current option to be displayed according to the first movement rate and the second movement rate The indication is moved in a direction parallel to the first axial direction or the second axial direction. The non-contact control method of claim 9, wherein the step (d) further comprises: Selecting the preset option represented by the second axial path corresponding to the at least one current position of the preset body part. The non-contact control method of claim 9, wherein the at least one first axial path displayed includes an initial position corresponding to a specific position of each of the images, the contactless control The method further includes: displaying, by the display component, the at least one current position of the specific body part, corresponding to a position of the specific position; and suspending performing the step before detecting that the at least one current position is moved to the specific position ( d); and after detecting that the at least one current location moves to the specific location, starting step (d). The non-contact control method of claim 9, further comprising: indicating the second end of the second axial path representing the selected preset option. The non-contact control method of claim 9, wherein when the number of the at least one first axial path is plural, a plurality of the second ends of the second axial paths represent a form feed Optionally, the first ends of the second axial paths are connected to one of the first axial paths, and the non-contact control method further comprises: when the selected preset option is a page change option , move the current option indication to the next first axial path. The non-contact control method of claim 9, wherein when the number of the at least one first axial path is plural, the display element further displays at least one third path for connecting the first axes To the path. The non-contact control method of claim 9, wherein one of the second ends of the second axial paths represents an execution option, and the non-contact control method further comprises: selecting the pre-selected When the option is set to execute, the selected preset option is executed.