TWI421728B - Document camera and associated method of object sensing control - Google Patents

Description

Object camera and related method for object sensing control

The present invention relates to a physical camera and related method for object sensing control, and more particularly to a physical camera and related method for realizing object sensing control according to a screen difference when capturing a picture.

The physical camera captures images of various objects and instantly outputs the images for playback/projection. Physical cameras have been widely used in teaching, presentation, and presentations.

In prior art physical cameras, the user has to control the various functions of the physical camera via physical function buttons provided on the physical camera. However, this kind of control technology is indirect and cannot provide a friendly and intuitive human-machine interface for physical cameras.

In order to reduce the gap between the user and the physical camera, the present invention provides a friendly object sensing control mechanism for the physical camera, allowing the user to intuitively, naturally, and efficiently control the physical camera with the motion of the object.

The human interface technology for recognizing/tracking gestures/actions includes techniques based on glove-based technology and vision based. In the glove-based technology, the user needs to use the glove with the sensor to control the machine, but the cost is high, the user's activity is limited, and the long-term wearing of the glove will also cause the user's burden, practicality and convenience. Limited. The technology of visual basis can be divided into two, one is contour-based and the other is model based. In the contour-based technique, since the gesture motion and the visual background interfere with each other, it is necessary to solve the problem that the edge is taken out and the fingers are shielded from each other. In the model-based technology, special model algorithms are designed, and the execution of the algorithms is quite complicated and time-consuming, and it is difficult to achieve immediate control.

One of the objects of the present invention is to provide a physical camera for object sensing control, comprising a photographing device, an output device and a processor. The photographing device sequentially captures the plurality of screens; the output device sequentially outputs the screens, and displays a preset number of function windows on each screen, and each function window corresponds to a function of the physical camera. A processor can determine whether to activate the function corresponding to each function window according to the difference between the screens.

In one embodiment, the processor provides/implements a filter module, a detection module, and a determination module. The filtering module divides a preset number of detection windows on each screen, and captures a corresponding picture feature in each detection window. Each detection window corresponds to a function window. The detection module sequentially compares the corresponding picture features of the two detection windows on the two different pictures to generate a comparison result, and detects whether the detection window changes according to the stack of the plurality of comparison results. When the number of detection windows in which the picture changes occur corresponds to a preset value, the determination module activates the corresponding function for the detection window with the picture change. Furthermore, the judging module can also record one or more window combinations, each window combination corresponding to a function of the physical camera; when the detection window of the screen change conforms to one of the window combinations, the judging module can start the matching window. Combine the functions corresponding to it. The filter module can be a Sobel filter module.

In one embodiment, the physical camera can be configured with a physical inductive start button, control whether the output device displays the function window, and control whether the filter module, the detection module, and the judging module operate.

It is still another object of the present invention to provide a method of applying the above-described physical camera for object sensing control.

In order to better understand the above and other aspects of the present invention, the preferred embodiments are described below, and in conjunction with the drawings, the detailed description is as follows:

Referring to Figure 1, there is shown a physical camera 10 in accordance with an embodiment of the present invention. The physical camera 10 is provided with a photographing device 12, a processor 14 and an output device 16. The photographing device 12 may include a photodetector matrix and an associated optical module to sequentially capture a plurality of pictures, such as a picture Fi(t), according to a certain timing (frequency). The processor 14 controls the operation of the physical camera 10, and the output device 16 outputs the screen Fi(t) captured by the photographing device 12 to the screen Fo(t) in accordance with the timing to form an instant motion image.

To implement the object inductive control of the present invention, the processor 14 can provide/implement a filter module 18, a comparison module 20 and a determination module 22, and can display the image Fo(t) output by the output device 16 K function windows f(1), f(2), ..., f(k) to f(K), each function window f(k) corresponds to a function of the physical camera 10. The processor 14 can determine whether to execute the function corresponding to each function window according to the difference between the different screens (such as between the front and rear adjacent screens Fi(t-1) and Fi(t)) to realize the object. Inductively controlled human interface. The user can directly manipulate the object 26 (such as a finger, a pen, a pointing device, etc.) in the corresponding position of each function window within the shooting range of the photographing device 12; when the processor 14 is captured by the photographing device 12, It is detected that a control action has occurred in a function window f(k), and the function corresponding to the function window f(k) can be executed.

When the object sensing control is performed, the filtering module 18 can segment the N detecting windows d(1), d(2), ..., d(n) to d(N) on each screen Fi(t). ), and capture a corresponding picture feature in each detection window d(n). Each detection window d(n) corresponds to a certain function window f(k). The detecting module 20 compares the corresponding picture features of the detection windows d(n) on two different pictures (such as between the front and rear adjacent pictures Fi(t-1) and Fi(t)) to generate a comparison result, and according to the continuous A stack of multiple comparison results is used to detect whether a picture change has occurred in each detection window d(n). When the user controls in the corresponding position of a function window f(k), a screen change occurs in the detection window d(n) corresponding to the function window f(k), and the determination module 22 can be based on Whether or not a screen change occurs in each detection window d(n) determines whether the user wants to execute the function corresponding to the function window f(k).

In an embodiment, the filter module 18 can be a Sobel filter module, and the Sobel filtering operation is performed in each detection window d(n) of the screen Fi(t) to capture the edge of the image. The detection module 20 can compare the image edge differences between the adjacent frames Fi(t-1) and Fi(t) in each detection window d(n). In one embodiment, the detection module 20 can continuously compare a series of adjacent pictures for each detection window d(n), such as pictures Fi(t-5) and Fi(t-4), Fi(t-4). And Fi(t-3), Fi(t-3) and Fi(t-2), Fi(t-2) and Fi(t-1), Fi(t-1) and Fi(t), and The comparison results of the adjacent pictures are stacked, and it is comprehensively judged whether or not a picture change occurs in each detection window d(n).

For example, if an object enters a detection window d(n) at time (t-4), the detection window d(n) will be between the screens Fi(t-5) and Fi(t-4). The difference in picture characteristics occurs; if the pictures Fi(t-4) and Fi(t-3), Fi(t-3) and Fi(t-2), Fi(t-2) and Fi(t-1), The comparison result of Fi(t-1) and Fi(t) reflects that the image of the object continues to appear in the detection window d(n), and it can be determined that the window d(n) has undergone a screen change. In contrast, if the comparison result of the screen Fi(t-4) and Fi(t-3) reflects that the image of the object does not continue, it can be determined that the window d(n) has not changed; the screen Fi(t-5) and The difference in picture characteristics of Fi(t-4) is a false positive caused by high frequency noise and/or fast background changes. That is to say, using the stack of comparison results to determine whether there is a picture change in each detection window, it can effectively prevent high frequency noise and rapid background change from affecting object sensing control.

In order to further avoid the influence of large-scale background light and shadow changes and noise on the object sensing control, when the number of detection windows of the simultaneous screen change meets a preset value, the determining module 22 will detect the change of the screen. The window performs its corresponding function. For example, the preset value may be 1; that is, if two or more detection windows are simultaneously changed in a certain time, the determination module 22 does not perform any function. If only one detection window changes the screen during a certain time, the judgment module 22 performs the function corresponding to the detection window/function window. The background light and shadow change will cause multiple screens to change at the same time, so the judgment module 22 will not respond to avoid such a situation from erroneously triggering various functions. In addition, when the user replaces the file before the photographing device 12 or adjusts the focal length thereof, the screens of the plurality of detection windows are also changed; and the judging module 22 also excludes the situation.

Moreover, the determination module 22 can also record one or more sets of window combinations, each of which corresponds to a function of the physical camera 10. When the detection window of the screen change conforms to one of the window combinations, the determination module 22 performs the function corresponding to the matching window combination. For example, a certain window combination is to associate two detection windows d(n1) and d(n2) with a certain function (where n1 and n2 are two fixed values); when detecting windows d(n1) and d(() N2) When the screen change occurs at the same time and no change occurs in the remaining detection windows, the judgment module 22 performs the function.

In one embodiment, the physical camera 10 can be provided with a physical induction start button 24 to control the initiation and end of the object sensing control. For example, when the physical camera 10 does not start the object sensing control mechanism, the user can press the sensing start button 24 to start the object sensing control; the physical camera 10 displays the function windows f on the output screen Fo(t). (k), and the filter module 18, the detection module 20 and the determination module 22 of the processor 14 also start to operate. When the user presses the induction start button 24 again, the physical camera 10 can stop the object sensing control: the physical camera 10 no longer displays the function windows on the screen Fo(t), and the filtering module 18 and the detecting module 20 The judgment module 22 also stops operating. The filter module 18, the detection module 20 and the determination module 22 can be implemented by hardware, firmware and/or software.

Please refer to FIG. 2, which is a flow 100 according to an embodiment of the present invention; the mechanism for implementing object sensing control by the physical camera 10 can be illustrated by the process 100. The main steps of the process 100 can be described as follows: Step 102: Start object sensing control. For example, the user can press the induction start button 24 to begin the process 100.

Step 104: The physical camera 10 superimposes the function window on the screen captured by the photographing device 12, and outputs the synthesized screen to the user.

Step 106: The filtering module 18, the detecting module 20 and the determining module 22 operate, and determine whether each function window is triggered according to whether a screen change occurs in each detecting window. If yes, proceed to step 108; otherwise, return to step 104 to continue the screen comparison and object detection.

Step 108: When a function window has been touched, the function corresponding to the function window can be executed.

Please refer to Figures 3 to 6, which illustrate the operation of the object sensing control in accordance with an embodiment of the present invention. In FIG. 3, the user first presses the induction start button 24 to activate the object sensing control mechanism of the physical camera 10. The physical camera 10 displays the two function windows f(a1) and f(a2) on the output screen 28a. For example, the function window f(a1) corresponds to the menu function. If the user wants to touch the function of the function window f (a1), the user can superimpose the object 26 (such as a finger, a pen, a pointing device, etc.) on the detection window d (a1) corresponding to the function window f (a1). At this time, the user will see that the function window f(a1) overlaps the manipulation object 26 on the output screen 28a, and of course, the display object 26 is superimposed on the function window f(a1). .

In FIG. 4, the user continuously superimposes the control object 26 on the detection window d (a1), and the comparison result of the detection module 20 stack reflects that the detection window d (a1) has undergone a screen change, the physical camera 10 displays "OK" on the output screen 28b, indicating that the function window f(a1) has been touched, and starts to execute the function corresponding to the function window f(a1), for example, to start the screen display (OSD, On-Screen Display). system.

In Fig. 5, the physical camera 10 activates the pre-screen display system, and displays the function windows f(b1) to f(b10) of the pre-screen display system on the output screen 28c, respectively corresponding to various functions of the physical camera 10, for example, Source switching, freeze screen, playback, auto focus, resolution adjustment, brightness adjustment, contrast adjustment, and more. Each of the function windows f(b1) to f(b10) may be arranged in an L shape (or, for example, a U shape) on the bottom side and the right side and/or the left side of the output screen. When the user wants to touch one of the functions, it is only necessary to superimpose the manipulation object 26 on the detection window corresponding to each function window before the photographing device 12.

The function window f (b10) in Fig. 5 can correspond to the function of "turn off the front display system". When the user wants to end the front-end display system of FIG. 5, the control object 26 can be superimposed on the output screen 28d to the detection window d corresponding to the function window f (b10) as shown in FIG. 6 (b10). The physical camera 10 can sense the change of the screen of the detection window d (b10), and execute the corresponding function of the function window f (b10) to exit the front display system.

In summary, compared with the physical button control interface of the conventional physical camera, the present invention can realize the friendly and intuitive object sensing control interface by using the existing structure of the physical camera, so that the user can directly and conveniently manipulate the physical object by directly controlling the object. The various functions of the camera.

In conclusion, the present invention has been disclosed in the above preferred embodiments, and is not intended to limit the present invention. A person skilled in the art can make various changes and modifications without departing from the spirit and scope of the invention. Therefore, the scope of the invention is defined by the scope of the appended claims.

10. . . Physical camera

12. . . Photography device

14. . . processor

16. . . Output device

18. . . Filter module

20. . . Comparison module

twenty two. . . Judging module

twenty four. . . Induction start button

26. . . Manipulating objects

28a-28d. . . Picture

100. . . Process

102-108. . . step

Fi(t), Fo(t). . . Picture

d(.). . . Detection window

f(.). . . Function window

Figure 1 is a physical camera in accordance with an embodiment of the present invention.

Figure 2 is a flowchart showing the operation of an embodiment of the present invention.

Figures 3 through 6 illustrate the operation of an embodiment in accordance with the present invention.

100. . . Process

102-108. . . step

Claims (10)

An object camera for controlling object control includes: a photographing device for sequentially capturing a plurality of screens; an output device sequentially outputting the screens, and displaying a preset number of function windows on the screens; wherein each of the screens The function window corresponds to a function of the physical camera; and a processor determines whether to execute the function corresponding to each function window according to the difference of the screens. The physical camera of claim 1, wherein the processor provides: a filter module, wherein a predetermined number of detection windows are segmented on each of the screens, and a corresponding one is captured in each detection window. a picture feature; wherein each of the detection windows corresponds to one of a preset number of function windows; and a detection module sequentially compares corresponding picture features of the detection windows on the two different pictures to generate a comparison result And detecting, according to the stack of the plurality of comparison results, whether the detection window has a picture change. The physical camera of claim 2, wherein the processor further provides: a judging module; when the number of detection windows in which the screen change occurs corresponds to a preset value, the judging module is directed to a screen change The detection window performs its corresponding function. The physical camera of claim 2, wherein the processor further comprises: a judging module, recording at least one window combination, each window combination corresponding to a function of the physical camera; when the screen change occurs The window conforms to one of the window combinations, and the determining module performs the function corresponding to the matching window combination. The physical camera of claim 2, further comprising an inductive start button, controlling whether the output device displays the preset number of function windows, and controlling whether the filter module and the detecting module operate. A method for applying a physical camera to perform object sensing control, the physical camera includes a photographing device and an output device, and the method includes: sequentially capturing a plurality of images by the photographing device; and sequentially outputting the image by the output device And displaying a preset number of function windows on the screens; causing each of the function windows to correspond to a function of the physical camera; and determining whether to perform the function corresponding to each of the function windows according to the difference of the screens. The method of claim 6, further comprising: dividing a predetermined number of detection windows on each of the screens, so that each of the detection windows corresponds to one of a preset number of function windows, and And capturing a corresponding picture feature in each detection window; and performing a filtering operation to sequentially compare the corresponding picture features of the detection windows on the two different pictures to generate a comparison result, and according to the stacking detection of the plurality of comparison results Measure whether the detection window has a picture change. The method of claim 7, further comprising: when the number of detection windows in which the picture changes occur corresponds to a preset value, performing a corresponding function for the detection window having the picture change. The method of claim 7, further comprising: recording at least one window combination, each window combination corresponding to a function of the physical camera; and when the detection window in which the picture change occurs conforms to one of the window combinations, executing the Match the function corresponding to the window combination. The method of claim 7, wherein the physical camera further comprises an inductive start button, and the method further comprises: controlling whether the output device displays the preset according to a situation in which the initiating start button is pressed A number of function windows and controlling whether the filter module and the detection module operate.