TWI494772B - System and method for operating a powerpoint file - Google Patents

Description

Briefing operating system and method

The present invention relates to a document operating system and method, and more particularly to a briefing operating system and method.

The newsletter has been used more and more in reports or speeches. Often, the presenter needs to stand in front of the projection screen to listen to the audience and make presentations based on the projected presentation. However, this location is not convenient for the reporter to operate the presentation itself, for example, turning pages.

In view of the above, it is desirable to provide a presentation operating system and method that can identify operations performed by a user on a projected briefing and synchronously control presentations in the electronic device.

A briefing operating system installed in an electronic device, the electronic device being connected to the camera device and the projector, the system comprising: a definition module, configured to acquire a plurality of images of a predetermined target captured by the camera device, and process the predetermined An image of the target to obtain a histogram of the predetermined target, and define a briefing operation function corresponding to each predetermined target or each predetermined target and a corresponding moving direction; a processing module for acquiring an image from the camera and imaging the image Processing to identify an object in the image, and using a log polar coordinate histogram to obtain a histogram of the identified object; a computing module for determining whether the histogram of the identified object matches the histogram of the predetermined target, if matched When the predetermined target has a corresponding moving direction, the camera device is compared according to the analysis. And setting a frame of the continuous image to obtain a moving direction of the recognized object; and executing a module for invoking a corresponding briefing operation function according to the predetermined target and the corresponding moving direction that match the identified object.

A method for operating a briefing is applied to an electronic device, the electronic device being connected to the camera device and the projector, the method comprising the steps of: acquiring a plurality of images of a predetermined target captured by the camera device; and processing the image of the predetermined target Obtaining a histogram of the predetermined target; defining a briefing operation function corresponding to each predetermined target or each predetermined target and a corresponding moving direction; acquiring an image from the imaging device and processing the image to identify an object in the image, and utilizing A logarithmic histogram histogram acquires a histogram of the identified object; determines whether the histogram of the identified object matches the histogram of the predetermined target; if the histogram of the identified object matches the histogram of the predetermined target and the predetermined target has a corresponding In the moving direction, the screen frame of the continuous image captured by the camera device is compared according to the analysis to obtain the moving direction of the recognized object; and the corresponding briefing operation function is called according to the predetermined target and the corresponding moving direction that match the identified object. .

Compared with the prior art, the briefing operating system and method can recognize the operation performed by the user on the projected briefing, and synchronously control the briefing in the electronic device, so that the user can give a speech to the audience in front of the projection screen. You can do things related to your newsletter without having to collaborate with others.

1‧‧‧Electronic device

10‧‧‧ processor

12‧‧‧Storage device

120‧‧‧Database

2‧‧‧ Briefing Operating System

20‧‧‧Definition module

22‧‧‧Processing module

24‧‧‧Computation Module

26‧‧‧Execution module

28‧‧‧Synchronization module

3‧‧‧Projector

4‧‧‧Projection screen

5‧‧‧ camera

1 is a diagram of an operational environment of a preferred embodiment of the present invention operating system.

2 is a block diagram of a briefing operation function module of a preferred embodiment of the present invention operating system.

FIG. 3 is a schematic diagram showing the setting of the briefing operation function of the preferred embodiment of the present invention.

4 is a flow chart showing the setting of the briefing operation function of the preferred embodiment of the present invention.

Figure 5 is a flow chart of a preferred embodiment of the present invention operating method.

As shown in FIG. 1, it is an operational environment diagram of a preferred embodiment of the present invention operating system. The briefing operating system 2 is installed and runs in the electronic device 1. The electronic device 1 can be a computer, a notebook computer, a mobile phone or an electronic device such as a personal digital assistant (PDA).

The electronic device 1 can be connected to the projector 3 to project a briefing opened in the electronic device 1 to the projection screen 4 for viewing by the projector 3.

The electronic device 1 can also be connected to the imaging device 5. In the preferred embodiment, the shooting angle of the imaging device 5 can be preset or fixed to capture an image of a designated area. As shown in FIG. 1, the photographing angle of the image pickup apparatus 5 is fixed to the area where the projection screen 4 is photographed. In addition, the time interval at which the imaging device 5 captures an image may be set in advance to acquire a plurality of consecutive images.

The briefing operating system 2 is configured to pre-define a plurality of images of predetermined targets captured by the camera device 5, and define a briefing operation function corresponding to each predetermined target or each predetermined target and a corresponding moving direction, and identify When the predetermined image is included in the image acquired from the image pickup device 5 and the moving direction of the predetermined target is confirmed to correspond to the above setting, the corresponding briefing operation function is called. With the briefing operating system 2, it is possible to perform a portable operation on the presentation before the projection screen 4 (for example, on The page is turned down, part of the content is deleted, and the like, and the briefing operation is synchronized to the briefing opened in the electronic device 1.

As shown in FIG. 2, it is a schematic diagram of a briefing operation function module of a preferred embodiment of the present invention operating system. The electronic device 1 further includes a processor 10 and a storage device 12. The processor 10 is configured to execute the presentation operating system 2 and other applications in the electronic device 1, such as an operating system or the like. The storage device 12 can be built in the electronic device 1 and can be externally connected to the electronic device 1, such as a SIM card (Smart Card), an SD card (Secure Digital Card), and the like. The storage device 12 includes a database 120 for storing images including predetermined objects captured by the camera device 5 and data set and acquired by the presentation operating system 2.

The briefing operating system 2 mainly includes a definition module 20, a processing module 22, a computing module 24, and an execution module 26.

Before identifying the user's briefing operation, it is necessary to set a plurality of predetermined targets to acquire related materials of a plurality of predetermined targets, for example, an image of a predetermined target, a moving direction of the predetermined target, and the like, and then defined according to the predetermined target or the predetermined target and the moving direction. The corresponding briefing operation function is used for subsequent recognition and presentation of the operation function of the briefing.

The definition module 20 is configured to set a plurality of predetermined targets or a plurality of predetermined targets and corresponding moving directions. As shown in FIG. 3, the predetermined target may be a different gesture including up, down, left, and right. 3 is merely illustrative. In other embodiments, the predetermined target may be any object or device, such as a teaching stick, a laser projection pen, or the like.

The processing module 22 is configured to acquire, from the camera device 5, a predetermined target image. As shown in FIG. 1, the camera device 5 is fixed to capture an area of the projection screen 4. When the user stands in front of or beside the projection screen 4, the user can reach out to make a related gesture, and the camera device 5 captures the image. The processing module 22 performs related processing.

The processing module 22 is further configured to process the image including the predetermined target, including: removing a background image of the image of the predetermined target to obtain a foreground image, extracting an edge of a predetermined target in the foreground image, and using a logarithmic coordinate The histogram calculates a histogram of each edge point to obtain a histogram of the predetermined target.

The removal of the background of the image can be performed by using a Gaussian mix model to separate the foreground image from the background image. In addition, the processing module 22 may further perform binarization processing and/or median filtering smoothing processing on the image to implement noise removal, thereby separating the foreground image including the predetermined target from the background image.

The extraction of the edges of the predetermined target can be performed using various edge finding algorithms. After extracting the edges of the predetermined target, logarithmic coordinate transformation can be performed on each edge point to obtain a logarithmic coordinate histogram of each edge point of the predetermined target.

The definition module 20 is further configured to store a histogram of the predetermined target to the database 120, and define a briefing operation function corresponding to each predetermined target or predetermined target and a corresponding moving direction. Referring to FIG. 3, different gestures (ie, predetermined targets) may correspond to different briefing operation functions, or different gestures and moving directions correspond to different briefing operation functions, when the briefing operating system 2 recognizes the gesture or the gesture. And the corresponding movement direction, the corresponding briefing operation function can be called to perform the related briefing operation. The briefing operation function may include turning pages up and down, deleting and/or recalling brushes, and the like.

After the definition of the predetermined target, the moving direction, and the briefing operation function is completed, the image of the projection screen 4 can be captured by the camera 5 according to a preset time interval after the presentation of the presentation operating system 2 is performed. Identify whether the user is doing a briefing.

The processing module 22 is further configured to acquire the captured image from the imaging device 5 and process the image to obtain a histogram of the identified object. The processing for acquiring an image includes: removing a background image of the image to identify an object in the foreground image, extracting an edge of the object in the foreground image, and calculating a histogram of each edge point by using a logarithmic histogram, thereby obtaining A histogram of the object. The algorithm applied in the processing may refer to the above algorithm for processing the image of the predetermined target.

The calculation module 24 is configured to determine whether the histogram of the identified object matches the histogram of the predetermined target. In the matching process, the shape context algorithm may be used to shape match the two, and other matching methods may be used to determine whether the histogram of the identified object matches the histogram of the predetermined target.

If the histogram of the identified object matches the histogram of the predetermined target and the predetermined target has a corresponding moving direction, the calculation module 24 further compares the frame of the continuous image captured by the imaging device 5 according to the analysis. Obtain the moving direction of the recognized object. The calculation of the moving direction of the object can be based on the target tracking algorithm using Mean-shift or the particle filter program to track the moving object, and the moving direction can be calculated by calculating the position of the object identified in each image. .

The execution module 26 is configured to invoke a corresponding briefing operation function according to a predetermined target and a corresponding moving direction that match the identified object. For example, for the currently playing The newsletter performs operations such as turning pages.

The execution module 26 is further configured to directly invoke the briefing operation function corresponding to the predetermined target when the histogram of the identified object matches the histogram of the predetermined target and the predetermined target has no corresponding moving direction.

In addition, the briefing operating system 2 further includes a synchronization module 28. The synchronization module 28 is configured to identify the user on the projection screen 4 by using a coordinate matrix transformation when the execution module 26 invokes the briefing operation function to edit the briefing content (for example, deleting, drawing a line, etc.) The start position and the end position of the operation in the displayed briefing, and map the start position and the end position of the operation to the corresponding positions of the briefings opened in the electronic device 1, and perform the briefing operation function. For example, when the user invokes the delete briefing operation function by a predetermined gesture, when the gesture moves to the left to delete part of the content, the synchronization module 28 recognizes the start position and the end position of the gesture movement, and correspondingly in the briefing The content between the start position and the end position is deleted at the position.

It is assumed that the Pro matrix is a coordinate position matrix of the briefings opened in the electronic device 1, H is a conversion matrix, and the P matrix is a matrix of image coordinate positions acquired by the imaging device 5, and the formula “Pro=H*P” and the following method can be used. Perform a transformation of the coordinate matrix:

The point coordinates (x, y) in the Pro matrix and the P matrix need to take corresponding four or more non-collinear points to find the transformation matrix H.

With the briefing operating system 2, the user can implement the synchronization operation of the briefing in the electronic device 1 according to a predefined operation in front of the projection screen 4 by means of gestures or other tools.

As shown in FIG. 4, it is a flow chart of the briefing operation function setting of the preferred embodiment of the present invention. First, in step S2, the definition module 20 sets a plurality of predetermined targets or a plurality of predetermined targets and a corresponding moving direction of each predetermined target, and the processing module 22 acquires a plurality of using the camera device 5 The captured image includes the intended target.

In step S4, the processing module 22 removes the background image of the image of the predetermined target to obtain a foreground image.

In step S6, the processing module 22 extracts an edge of a predetermined target in the foreground image.

In step S8, the processing module 22 calculates a histogram of each edge point by using a logarithmic coordinate histogram, and acquires a histogram of the predetermined target.

In step S10, the definition module 20 stores a histogram of the predetermined target to the database 120.

In step S12, the definition module 20 defines a briefing operation function corresponding to each predetermined target or predetermined target and a corresponding moving direction, and then ends the process.

As shown in FIG. 5, it is a flow chart of a preferred embodiment of the present invention operating method. In step S20, the processing module 22 acquires the captured image from the imaging device 5.

Step S22, the processing module 22 processes the image to obtain the identified object. Histogram. The processing for acquiring an image includes: removing a background image of the image to identify an object in the foreground image, extracting an edge of the object in the foreground image, and calculating a histogram of each edge point by using a logarithmic histogram, thereby obtaining A histogram of the object. The algorithm applied in the processing may refer to the above algorithm for processing the image of the predetermined target.

In step S24, the calculation module 24 determines whether the histogram of the identified object matches the histogram of the predetermined target.

If the histogram of the identified object matches the histogram of the predetermined target, in step S26, the calculation module 24 determines whether the predetermined target has a corresponding moving direction. If the histogram of the identified object does not match the histogram of the predetermined target, the flow returns to step S20.

If the predetermined target has a corresponding moving direction, the calculating module 24 obtains the moving direction of the recognized object according to the analysis and comparison of the frame frames of the continuous images captured by the imaging device 5 in step S28. If the predetermined target has no corresponding moving direction, step S30 is directly executed.

In step S30, the execution module 26 invokes a corresponding briefing operation function according to a predetermined target or a predetermined target and a corresponding moving direction that match the identified object, for example, performing a page turning operation on the currently played briefing, and then ending. This process.

In summary, the present invention complies with the requirements of the invention patent and submits a patent application according to law. However, the above description is only the preferred embodiment of the present invention, and the scope of the present invention is not limited to the above-described embodiments, and equivalent modifications or variations made by those skilled in the art in light of the spirit of the present invention are It should be covered by the following patent application.

1‧‧‧Electronic device

10‧‧‧ processor

12‧‧‧Storage device

120‧‧‧Database

2‧‧‧ Briefing Operating System

20‧‧‧Definition module

22‧‧‧Processing module

24‧‧‧Computation Module

26‧‧‧Execution module

28‧‧‧Synchronization module

Claims (8)

A briefing operating system installed in an electronic device, the electronic device being connected to the camera device and the projector, the system comprising: a definition module, configured to acquire a plurality of images of a predetermined target captured by the camera device, and process the predetermined An image of the target to obtain a histogram of the predetermined target, and define a briefing operation function corresponding to each predetermined target or each predetermined target and a corresponding moving direction; a processing module for acquiring an image from the camera and imaging the image Processing to identify an object in the image, and using a log polar coordinate histogram to obtain a histogram of the identified object; a computing module for determining whether the histogram of the identified object matches the histogram of the predetermined target, if matched When the predetermined target has a corresponding moving direction, the moving frame direction of the continuous image captured by the imaging device is compared according to the analysis to obtain a moving direction of the recognized object; and the executing module is configured to use the predetermined target matched with the identified object and The corresponding movement direction invokes the corresponding briefing operation function; and the synchronization module is used to call When the report operation function edits the content of the briefing, the coordinate matrix transformation is used to identify the start position and the end position of the user in the projected briefing, and the start position and the end position of the operation are mapped into the electronic device. The corresponding location of the opened newsletter and the function of the briefing operation. In the briefing operating system of claim 1, the processing module processing the image of the predetermined target includes: removing the background image in the predetermined target image to obtain the foreground image, and extracting the predetermined target in the foreground image. The edge, and a histogram of each edge point is calculated using a logarithmic histogram to obtain a histogram of the predetermined target. The processing system for acquiring an image includes: removing a background image in the image to obtain a foreground image, and extracting a foreground image, as in the briefing operating system described in claim 1 The edge of the object and the histogram of each edge point are calculated using a logarithmic histogram to obtain a histogram of the identified object. The execution module of claim 1, wherein the execution module is further configured to: when the histogram of the identified object matches the histogram of the predetermined target and the predetermined target has no corresponding moving direction, The briefing operation function corresponding to the predetermined target is called. A method for operating a briefing is applied to an electronic device, the electronic device being connected to the camera device and the projector, the method comprising the steps of: acquiring a plurality of images of a predetermined target captured by the camera device; and processing the image of the predetermined target Obtaining a histogram of the predetermined target; defining a briefing operation function corresponding to each predetermined target or each predetermined target and a corresponding moving direction; acquiring an image from the imaging device and processing the image to identify an object in the image, and utilizing A logarithmic histogram histogram acquires a histogram of the identified object; determines whether the histogram of the identified object matches the histogram of the predetermined target; if the histogram of the identified object matches the histogram of the predetermined target and the predetermined target has a corresponding And moving the direction of the image frame of the continuous image captured by the camera device according to the analysis to obtain the moving direction of the recognized object; and calling the corresponding briefing operation function according to the predetermined target and the corresponding moving direction that match the identified object; And when the briefing operation function is called, the content of the newsletter is compiled. And identifying, by coordinate matrix transformation, a start position and an end position of the user in the projected briefing, and mapping the start position and the end position of the operation to corresponding positions of the briefing opened in the electronic device, And perform the briefing operation function. The method of processing the image of the predetermined target to obtain a histogram of the predetermined target, as described in claim 5, wherein: And removing a background image in the predetermined target image to obtain a foreground image; extracting an edge of the predetermined target in the foreground image; and calculating a histogram of each edge point by using a log-polar coordinate histogram to obtain a histogram of the predetermined target. The method for reporting a briefing according to claim 5, wherein the image is acquired from the camera device and the image is processed to identify an object in the image, and a histogram of the identified object is obtained by using a logarithmic histogram. The steps include: removing a background image in the image to obtain a foreground image; extracting an edge of the object in the foreground image; and calculating a histogram of each edge point by using a logarithmic histogram to obtain a histogram of the identified object. The method for reporting a briefing according to claim 5, further comprising: directly calling the predetermined target when the histogram of the identified object matches the histogram of the predetermined target and the predetermined target has no corresponding moving direction Corresponding briefing operation function.