JP5115499B2 - Presentation device - Google Patents

Description

  The present invention relates to a presentation device.

  As a technique for recognizing a gesture, for example, there are a technique disclosed in Patent Documents 1 and 2 and a technique disclosed in Non-Patent Documents 1 and 2.

JP 2005-78291 A JP 2007-20756 A

http://bptv.nikkeibp.co.jp/article/081002/081002155.html http://www.itmedia.co.jp/bizid/articles/0612/08/news120.html

  It is conceivable that the presentation progresses by transitioning the output object with an operation according to the gesture (for example, performing an operation with the gesture to transition the display of the page from the projector to the display of the next page) Can be considered).

  However, it is sometimes difficult to make a presentation proceed appropriately with gestures. For example, a gesture made by a presenter and a presentation effect (for example, animation) brought about by the gesture may not match, which may make the audience feel uncomfortable. Further, for example, there are cases where the presenter concentrates on the presentation and performs an inappropriate operation (for example, an operation that erroneously switches the displayed page).

  Therefore, an object of the present invention is to support a presenter who makes a presentation progress with a gesture.

  Provided is a presentation device including data analysis means, operation information acquisition means, and presentation control means.

  The data analysis means identifies what is a recommended and / or deprecated operation by analyzing the presentation data in which the flow of object output is defined (eg, recommended / not recommended for each object output). The recommended operation is identified, and analysis result information including information indicating the recommended / unrecommended operation for each object output is generated). The object is, for example, a page, an image, a character, a sound, or the like.

  The operation information acquisition means acquires operation information including information representing a presenter desired operation, which is an operation meant by a presenter's gesture.

  The presentation control means controls the transition of the object output based on the specified recommended / unrecommended operation, the presenter desired operation represented by the operation information, and the presentation data. For example, when the specified presenter desired operation is a non-recommended operation corresponding to the next object output, the presenter desired operation is invalidated.

  Each unit described above may be realized by a hardware circuit, or may be realized by a processor executing a computer program.

FIG. 1 shows an overview of a presentation apparatus according to an embodiment of the present invention. FIG. 2 shows an example of the display flow defined in the presentation file. FIG. 3 shows various analysis tables. FIG. 4A shows a gesture scale specifying table. FIG. 4B shows an analysis result table. FIG. 4C shows the flow of display control. FIG. 5A shows the flow of transition of the sub display. FIG. 5B shows a gesture scale definition table. FIG. 5C is an explanatory diagram of correction of the gesture scale definition table.

  FIG. 1 shows a configuration of a presentation apparatus according to an embodiment of the present invention.

  The presentation device 101 is connected to the photographing device 103 and the display device 105.

  The imaging device 103 is composed of, for example, one or a plurality of cameras. The photographing device 103 photographs a presenter who is making a gesture. The photographing device 103 inputs the photographed image to the presentation device 101.

  The display device 105 is a projector, for example. The display device 105 displays an object represented by information from the presentation device 101.

  The presentation device 101 is a computer such as a personal computer, for example. The presentation apparatus 101 includes a storage unit 111, an operation information acquisition unit 113, a data analysis unit 115, and a presentation control unit 117. The storage unit 111 is realized by, for example, a main storage device and / or an auxiliary storage device. The operation information acquisition unit 113, the analysis unit 115, and the presentation control unit 117 are realized by, for example, a computer program being executed by a microprocessor (at least a part may be realized by a hardware circuit).

  The storage unit 111 stores an analysis table group 121, a gesture scale specifying table 125, and a gesture scale definition table 127. The storage unit 111 also stores the analysis result table 123 generated by the data analysis unit 115. Various tables will be described later.

  The operation information acquisition unit 113 acquires operation information based on the captured image from the imaging device 103. Specifically, for example, the operation information acquisition unit 113 detects the motion of the gesture target by analyzing the captured image, and identifies the presenter desired operation from the motion. The operation information acquisition unit 113 acquires operation information including information indicating the specified presenter desired operation and motion information indicating the motion of the gesture target. From this operation information, the presenter desired operation and the gesture scale of the operation can be specified. The gesture scale can be specified from motion information representing the motion of the gesture target. This information is, for example, the coordinates of the start point and end point of the moved gesture object.

  Here, the “gesture target” is a target that is moved by a gesture, and is, for example, a human body part (for example, a hand) or an instrument such as a pointing stick.

  Examples of the “movement of the gesture target” include an operation of pointing a point and an operation of sliding the gesture target to the right, left, down or up.

  “Presenter desired operation” includes, for example, pointing operation, right slide operation (switching the page by sliding the page from left to right), left slide operation (page by sliding the page from right to left) For example).

  Note that, instead of the operation information acquisition unit 113, the imaging device 103 may acquire operation information based on the captured image. In this case, the operation information acquisition unit 113 receives operation information from the imaging device 103.

  Based on the presentation data 301 and the analysis table group 121, the data analysis unit 115 identifies what is a recommended and / or non-recommended operation for each object display. The data analysis unit 115 creates an analysis result table 123 including information indicating the specified recommended / unrecommended operation, and stores the table 123 in the storage unit 111 and / or the presentation data 301. The presentation data 301 is data including objects such as pages, images, and characters. Note that “object display” refers to display of one or more objects, and transitions according to an operation meant by a gesture. For example, “When a page is displayed and an image is added to the page by animation”, “When another page is displayed instead of a certain page”, or “A certain page "When the display magnification of" is changed "means that a transition from one object display to another object display has been made.

  The presentation control unit 117 controls transition of object display from the display device 105 based on the recommended / unrecommended operation specified from the analysis result table 123, the presenter desired operation represented by the operation information, and the presentation data 301. .

  Hereinafter, the present embodiment will be described more specifically. In the following description, “animation” may be abbreviated as “animation”.

The presentation data 301 includes a presentation data main body and attribute information including information other than the presentation data main body. Assume that the presentation data 301 defines a flow of object display as shown in FIG. That is, the following flows (1) to (4):
(1) The first page is displayed as a slide-in from the left;
(2) The second page is displayed as a slide-in from the left;
(3) The third page is displayed as a slide-in from the left;
(4) On the third page, the image is displayed as a slide-in from the bottom with animation;
Is defined. The attribute information in the presentation data 301 includes the following information for each page:
(Page 1) Background theme attribute “Event”;
(2nd page) Background theme attribute “Event”, Memo “Explain the date properly”;
(3rd page) Background theme attribute "Event", Memo "Don't forget to advertise XX";
(Memo is information set by the file creator). In addition, it is assumed that the background of each page included in the presentation data 301 and the image displayed by animation are all warm colors.

  The data analysis unit 115 analyzes the presentation data 301 using various analysis tables included in the analysis table group 121.

  FIG. 3 shows various analysis tables.

The analysis table is a table created based on the viewpoint from which the presentation data 301 is analyzed. FIG. 3 shows the following seven tables as specific examples of the analysis table:
1211: A table in which the relationship between the background color attribute (for example, whether the background is warm or cold) and the operation value is defined;
1212: a table in which the relationship between the character string attribute and the action value is defined;
1213: a table in which the relationship between character attributes (for example, the typeface and size of characters) and action values is defined;
1214: a table in which the relationship between the animation color attribute (for example, whether the object displayed in animation is warm or cold) and the operation value is defined;
1215: a table in which a relationship between an animation size attribute (for example, the size of an image displayed in animation) and an operation value is defined;
1216: a table in which a relationship between animation-related attributes (relationship between the direction of animation and the direction of movement of the gesture target) and whether or not the movement of the gesture target is suitable;
1217: a table in which the relationship between the animation direction attribute and the appropriate direction of movement of the gesture target is defined;
There is. The “motion value” is one of evaluation values, and is a value related to the magnitude of movement of the gesture target.

  Tables 1211 and 1214 indicate that a large gesture is preferable in the warm color system and a small gesture is preferable in the cold color system. The table 1212 indicates that a large gesture is preferable when the displayed character string is “event”, and a small gesture is preferable when “research” is performed. Tables 1213 and 1215 indicate that a large gesture is preferable when the displayed object is large, and a small gesture is preferable when the displayed object is small. Further, the table 1216 indicates that the motion of the gesture target is suitable if the direction of the animation matches the direction of the motion of the gesture target, and that the motion of the gesture target is inappropriate if the direction does not match. . The table 1217 shows that it is appropriate that the gesture target moves in the same direction as the slide-in direction.

  The data analysis unit 115 acquires from the analysis table group 121 motion values, motion suitability, and motion direction corresponding to the attributes of various objects included in the presentation data 301. According to the above example, the data analysis unit 115 obtains an operation value corresponding to the background color attribute “warm color”, the character string attribute “event”, the animation image “warm color”, and the like specified from the presentation data 301 for each object display. Obtained from the tables 1211 to 1215 (according to FIG. 2, the presentation data 301 has a plurality of character string attributes such as “presentation A” and “XX Corporation” in addition to “event”. The only string attribute described in is "Event"). Then, the data analysis unit 115 calculates a value (for example, the sum, the logarithm, or the average) based on the plurality of acquired motion values for each object display. Based on the value calculated for each object display, the gesture scale is specified for each object display.

  FIG. 4A shows the gesture scale specifying table 125.

  The gesture scale specifying table 125 represents a plurality of gesture operation conditions respectively corresponding to a plurality of levels of gesture scales. The gesture motion condition is a condition regarding a value based on a plurality of motion values.

  According to the example shown in FIG. 4A, if the value based on a plurality of motion values is 20 or more, it is preferable to perform transition to the object display corresponding to the value with a large gesture, based on the plurality of motion values. If the value is greater than 0 and less than 20, it is preferable that the transition to the object display corresponding to the value is performed with a medium-sized gesture, and if the value based on a plurality of motion values is 0 or less It can be seen that the transition to the object display corresponding to the value is preferably performed with a small gesture.

  The data analysis unit 115 specifies a gesture scale corresponding to a gesture action condition that a value based on a plurality of action values satisfies for each object output from the gesture scale specifying table 125. Then, the data analysis unit 115 creates an analysis result table 123 representing a non-recommended operation and a gesture scale for each object output as shown in FIG. 4B. The non-recommended operation is, for example, an operation of sliding in from a direction opposite to the direction corresponding to the animation direction attribute (see the table 1217).

  As shown in FIG. 4C, when the operation information is input from the operation information acquisition unit 113 (S501), the presentation control unit 115 displays the desired presenter operation represented by the operation information, and the gesture scale specified from the operation information. However, it is determined whether or not the non-recommended operation and the gesture scale corresponding to the next object display are the same (S502).

  If the result of the determination in S502 is affirmative (S502: YES), the presentation control means 115 invalidates the presenter desired operation (S503). That is, the presentation control means 115 does not execute the process according to the presenter desired operation. Thereby, it is possible to prevent the presentation from proceeding inappropriately.

  When the result of the determination in S502 is negative (S502: NO), the presentation control means 115 changes the main display according to the presenter's desired operation, and the sub display also changes accordingly.

  Here, the “main display” is the above-described object display (for example, the screen in each frame shown in FIG. 2) based on the presentation data body. The main display is displayed in a first display area (for example, a screen projected from the display device 105 that is a projector) that is visible to the audience.

  On the other hand, the “sub-display” is a display of all or part of the attribute information. The secondary display is displayed in a second display area (for example, a display screen included in the presentation device 101) that is not visible to the audience but visible to the operator.

  FIG. 5A shows a sub-display transition flow corresponding to the object display transition flow shown in FIG. According to FIG. 5A, the deprecated operation included in the attribute information appears in the sub display. Thereby, the presenter can know what kind of gesture is not preferable for the next object display. Although FIG. 5A shows a non-recommended operation, a gesture scale may be displayed in addition to that. That way, you can know what gestures you don't want on any scale.

  The gesture scale is defined in the gesture scale definition table 127. That is, according to FIG. 5B, the gesture scale definition table 127 represents a plurality of target movement distances respectively corresponding to a plurality of levels of gesture scales. The “target moving distance” represents a distance (for example, a distance between two points along a straight line or a movement trajectory) that the gesture target has moved. This distance can be specified by using motion information representing the motion of the gesture target included in the operation information. Therefore, the presentation control unit 117 can grasp the scale of the gesture performed on the presenter by using the target moving distance specified from the operation information. The presentation control unit 117 controls the transition of the object display based on the grasped gesture and the gesture scale defined in the analysis result table 123.

  By the way, even if the target movement distance is the same, the gesture scale felt by the person who sees it is different. That is, one person may feel that it is a big gesture, but another person may not feel that way.

  Therefore, the presentation apparatus 101 may include a definition correction unit 511 as illustrated in FIG. 5C. The definition correction unit 511 is realized by, for example, a microprocessor executing a computer program. The definition correcting unit 511 updates the target movement distance recorded in the gesture scale definition table 127.

  Specifically, for example, the definition correcting unit 511 has the presenter perform a gesture on a certain scale (for example, a large scale and a small scale) before the presentation is started. The definition correction means 511 is based on the target moving distance specified from the gesture (for example, based on the default target moving distance in the gesture scale definition table 127), and the scale (and / or) another scale. The target movement distance recorded in the gesture scale definition table 127 is updated.

  The definition correcting unit 511 may update the operation values in the various analysis tables instead of or in addition to the target movement distance in the gesture scale definition table 127.

  As mentioned above, although embodiment and the modification of this invention were demonstrated, these are the illustrations for description of this invention, Comprising: It is not the meaning which limits the scope of the present invention only to these embodiment and modification. The present invention can be implemented in various other forms.

  For example, the analysis method is not limited to the above method, and other methods may be employed. For example, the number of analysis tables may be larger or smaller than the number of tables shown in FIG. Further, instead of or in addition to the non-recommended operation, the recommended operation may be specified and information indicating the recommended operation may be included in the analysis result table 123. Further, the recommended operation may be displayed as a sub display.

  In addition, for example, the presentation control unit 117 calculates a difference between a gesture operation (for example, target movement distance) represented by the acquired operation information and a gesture operation (for example, target movement distance) for a recommended operation corresponding to the next object output. You may specify. Then, the presentation control unit 117 transitions the object display according to the recommended operation corresponding to the next object output if the specified difference is equal to or less than the predetermined threshold, and if the specified difference is larger than the predetermined threshold, the presenter Processing according to a desired operation may be performed. The threshold value may be a fixed value or may be changeable by a presenter.

101 ... presentation device 103 ... photographing device 105 ... display device

Claims (8)

A data analysis means for identifying what is a recommended and / or deprecated operation by analyzing presentation data in which the output flow of the object is defined;
Operation information acquisition means for acquiring operation information including information indicating a presenter desired operation, which is an operation that is meant by a presenter's gesture;
A presentation apparatus comprising: a specified recommended / non-recommended operation, a presenter desired operation represented by the operation information, and a presentation control unit that controls transition of an object output based on the presentation data. Information (A) to (C) below:
(A) Information prepared for each object type, including information representing evaluation values corresponding to a plurality of types of object attributes;
(B) Gesture scale specifying information including information representing a plurality of gesture operation conditions respectively corresponding to a plurality of levels of gesture scales;
(C) Gesture scale definition information including information representing a plurality of target movement distances respectively corresponding to a plurality of levels of gesture scales;
Storage means for storing
The data analysis means executes the following (a) to (c):
(A) For various objects defined in the presentation data, an evaluation value corresponding to an object attribute is specified from the analysis information;
(B) identifying a recommended / unrecommended operation and a gesture scale for each object output based on a plurality of evaluation values specified for a plurality of types of objects and the gesture scale specifying information;
(C) generating analysis result information including information indicating a recommended / unrecommended operation and a gesture scale for each object output;
As an evaluation value, there is an action value related to the magnitude of the gesture action that is the movement of the gesture target,
In (c), the data analysis unit determines which of the plurality of gesture action conditions represented by the gesture scale specifying information matches a value based on a plurality of action values for each object output. Identify the gesture scale corresponding to the determined condition,
The analysis result information includes information representing the specified gesture scale,
The operation information includes information representing a gesture action,
The presentation data is composed of a presentation data body and attribute information including information other than the presentation data body,
The presentation control means performs the following processes (X) and (Y):
(X) Control object output based on the following information (x1) to (x4);
(X1) a gesture scale corresponding to the next object output identified from the analysis result information;
(X2) a gesture scale that is specified from the gesture scale definition information and that corresponds to the gesture action represented by the operation information;
(X3) Recommended / deprecated operation corresponding to the next object output;
(X4) Presenter desired operation represented by the operation information,
(Y) The object output according to the presentation data body is performed on the first output area, and the recommended / unrecommended operation corresponding to the next object output in the analysis result information is output to the second output area;
The presentation device according to claim 1. The presentation control means invalidates the presenter desired operation when the specified presenter desired operation is a non-recommended operation corresponding to the next object output.
The presentation device according to claim 1. The operation information includes information representing a gesture motion that is a motion of a gesture target,
The presentation control means identifies a difference between a gesture motion represented by the acquired operation information and a gesture motion for a recommended operation corresponding to the next object output, and if the identified difference is equal to or less than a predetermined threshold value The object output is transitioned according to a recommended operation corresponding to the next object output, and if the specified difference is larger than a predetermined threshold, processing according to the presenter desired operation represented by the operation information is performed.
The presentation apparatus according to claim 1 or 3. The presentation data is composed of a presentation data body and attribute information including information other than the presentation data body,
The data analysis unit generates analysis result information including information indicating recommended / unrecommended operations for each object output by analyzing the presentation data, and the analysis result information is generated in the presentation data. Include in attribute information,
The presentation device according to claim 1, 3 or 4. The data analysis means specifies a gesture scale in addition to recommended / unrecommended operations,
The operation information includes information representing a gesture motion that is a motion of a gesture target,
The presentation control means includes the following gesture scales (A) and (B):
(A) a gesture scale corresponding to the next object output specified by the data analysis means;
(B) a gesture scale corresponding to the gesture motion represented by the operation information;
Control object output based on
Definition correction means for causing a presenter to perform a gesture at a gesture scale of at least one level and correcting the definition of at least the gesture scale of the level based on a distance moved by the gesture object by the gesture;
The presentation device according to claim 1, further comprising: The presentation control means notifies the presenter of a recommended / unrecommended operation corresponding to the next object output.
The presentation device according to claim 1. Identifying what is a recommended and / or deprecated operation by analyzing presentation data in which the output flow of the object is defined;
Obtaining operation information including information representing a presenter desired operation, which is an operation meant by a presenter's gesture;
A computer program for causing a computer to execute a specified recommended / unrecommended operation, a presenter desired operation represented by the operation information, and a step of controlling transition of object output based on the presentation data.

Images