JP2020149529A - Moving image reproduction device - Google Patents

Abstract

To provide a moving image reproduction device capable of reproducing display content that was used for explanation by a user simply and by suppressing data capacity.SOLUTION: A moving image reproduction device (user terminal 10) stores the history of display content that was used for explanation by a user and reproduces it like a moving image after explanation. The moving image reproduction device includes: display means for displaying the display content; clocking means; storage means for storing page information on each page associated with an elapsed time from start of explanation or display start of the display content and evaluation associated with the elapsed time performed by the user; and content reproduction means for reproducing the page information and evaluation stored in the storage means integrally with the display content.SELECTED DRAWING: Figure 2

Description

The present invention relates to a moving image reproducing device capable of reproducing the display content used for explanation by the user in a useful manner.

At present, it is common for presenters to give explanations while displaying PowerPoint (registered trademark) slides and PDF files on a display at meetings, presentations, and sales activities. In the case of a presentation, a voice recorder or a video camera may be used to record the situation, but in addition to this, a method of linking explanatory materials with audio or video and storing them in chronological order is also known. ..

For example, the presentation data creation system of Patent Document 1 described below is composed of a first PC connected to a projector, a second PC connected to a video camera, and a memory unit. When the memory unit is attached to the first PC, the first PC can handle the storage area of the memory unit in the same manner as the storage area in its own device, and can read and record data. Can be done.

As a result, the presentation data creation system records event data (start, end, change instruction, etc. of slide image) read from the memory unit, document information such as extracted title data and page number data, slide image file, and recording unit. From the created video file, it is possible to create presentation data for synchronously displaying a video based on the video data, a slide image based on the slide image display data, and text information such as the title of these slide images ( Paragraphs 0049, 0079, FIG. 8).

Japanese Unexamined Patent Publication No. 2004-227514

However, since the system of Patent Document 1 requires a projector, a video camera, and the like in addition to the two PCs, there is a problem that the cost for data creation and the labor for preparation are large. In addition, since the focus of this presentation data is to faithfully reproduce the actual presentation, various data are added to the original data, and the data size becomes very large.

The present invention has been made in view of such circumstances, and an object of the present invention is to provide a moving image reproducing device that can easily reproduce the display content used for explanation by the user while suppressing the data capacity.

The present invention is a moving image playback device that stores a history of display content used for explanation by a user and can be played back like a moving image after the explanation, and describes a display means for displaying the display content, a timing means, and an explanation. A storage means for storing the page information of each page associated with the start or the elapsed time from the display start of the display content, and the evaluation performed by the user associated with the elapsed time, and the storage means. It is characterized by comprising a content reproduction means for integrally reproducing the page information and the evaluation stored in the display content with the display content.

In the moving image playback device of the present invention, when the user gives an explanation using the display content, the storage means is the page information (display of each page) associated with the start of the explanation or the elapsed time from the start of the display of the display content. (Start time, etc.) is stored as a history. In addition, the storage means stores the evaluation performed by the user (the explanation on this page shows that the listener's reaction was good, etc.) in a form including the information on the elapsed time.

After that, the content reproduction means reproduces the display content in which the page information and the evaluation of each page are integrated based on the display content explained by the user without generating new content data. As a result, the display content used for the explanation by the user can be easily reproduced with the data capacity suppressed.

In the moving image reproducing device of the present invention, it is preferable that the display means can display a total screen that totals the number of evaluations or points for each page.

According to this configuration, the user can list the number of evaluations and points for each page by displaying the aggregation screen on the display means. This allows the user to review the previous description and help improve it.

Further, in the moving image playback device of the present invention, when a user changes a part of the displayed content, the determination means is provided for determining whether or not the pages match or do not match before and after the change, and the determination means determines the match. If so, it is preferable that the evaluations are aggregated for the same page.

The user may modify or change each page of the displayed content after the explanation. At this time, the determination means determines whether or not each page of the displayed content matches or does not match before and after the change. When it is determined that the match is made by the determination means, such as when the change width is small, the evaluation is treated as for the same page and aggregated, so that the evaluation information for each page can be accumulated.

Further, the moving image playback device of the present invention includes a recording means for recording the sound associated with the elapsed time for which the user has explained the display content, and the content playback means is the display content after the explanation. At the time of reproduction, it is preferable to reproduce the sound recorded by the recording means together.

According to this configuration, the recording means records the voice explained by the user, and the content playing means also plays back the recorded voice when playing back the displayed content after the explanation. As a result, the explanation given by the user can be reproduced in a form close to the actual one.

Further, in the moving image reproducing device of the present invention, the display means is a touch panel type display, and it is preferable that the evaluation is performed based on a predetermined operation performed by the user on the display.

According to this configuration, since the display means is a touch panel type, operations such as tapping of the display means performed by the user in the description are stored in the storage means as an evaluation. As a result, the evaluation of each page can be easily left.

Further, the moving image reproducing device of the present invention includes a voice analysis means for recognizing the voice of the user and analyzing at least the content of the voice, and the voice analysis means performs the evaluation based on the content of the voice. Is preferable.

According to this configuration, the voice recognition means recognizes the user's voice and analyzes and evaluates the content (for example, whether the voice is positive content or negative content). As a result, the evaluation of each page can be automatically left without any particular operation by the user.

The figure explaining the scene of implementation of the moving image reproduction apparatus (user terminal) of this invention. The block diagram which shows the internal structure of the user terminal of FIG. (A) Explanation time chart. (B) The figure explaining the page information (aggregation screen) of each page of explanatory material. (A) Explanatory materials and examples of evaluation (page 3). (B) Explanatory materials and examples of evaluation (page 4). (A) Example of reproduction display (page 3). (B) Example of reproduction display (page 4). Example of changing the reproduction display (3rd page). An example of reproduction display of the corrected explanatory material (page 3).

Hereinafter, embodiments of the moving image reproducing device of the present invention will be described with reference to the drawings.

First, a scene of implementation of the moving image reproducing device of the present invention will be described with reference to FIG. FIG. 1 shows a scene in which employee P explains his company's products or services to client C as a sales activity. Here, the employee P will explain using the user terminal 10 (“moving image reproducing device” of the present invention) having a touch panel type display.

A dedicated application for storing the playback history of the explanatory material (“display content” of the present invention) is installed in the user terminal 10. This dedicated application has a player function of reproducing explanatory materials (mainly PDF files) on the display unit 10a (“display means” of the present invention) of the user terminal 10. The explanatory material may be a PowerPoint (registered trademark) file of Microsoft Corporation.

At this time, the explanation of the employee P, the remarks of the client C, the question, and the like are recorded by the voice recorder of the user terminal 10. Further, the recorded data is stored in the user terminal 10 together with page information such as how many minutes the explanation was given at the time from the start of the explanation (the start of displaying the explanatory material).

When employee P plays the same explanatory material on the user terminal 10 at a later date, what kind of explanation was given at that time by linking with the recorded data and page information previously stored, or what kind of explanation was given with client C. It is possible to reproduce what was exchanged.

Further, although the details will be described later, the employee P can self-evaluate whether or not the explanation was successful while displaying the slide of the explanatory material at the time of the explanation. For example, the display unit 10a can be evaluated by operating a tap or the like, inputting with a stylus, or operating a button of a small terminal wirelessly connected to the user terminal 10.

As a result, when employee P replays the explanatory material, he / she looks back on the previous explanation, and for the part that was given a low evaluation, correct the explanatory material, add a slide to the explanatory material, and explain how to do it. You can change itself.

Here, the scene of the sales activity by the employee P is illustrated, but the same applies when the presenter gathers a large number of people to give a presentation. Specifically, when the presenter gives an explanation while turning over the slides of the presentation material on the user terminal 10 (notebook type PC), the voice (recorded data) and page information at that time are stored. In addition, the presenter can perform a self-evaluation during the presentation by operating a predetermined key on the notebook PC.

Next, FIG. 2 is a block diagram showing an internal configuration of the user terminal 10. The user terminal 10 has a recording unit 12, a storage unit 13, a timing unit 14, a control unit 15, an input unit 16, an output unit 17, a data communication unit 18, a voice analysis unit 19, and a match determination unit 20 via the system bus 11. Are connected and these are devices that work together.

Examples of the user terminal 10 include smartphones, notebook PCs, tablet PCs, and the like. In presentations given to a large number of people, a notebook PC is usually used, but the presenter does not necessarily have to use a touch panel type display because he / she can perform self-evaluation by operating a predetermined key as described above. ..

Further, the user terminal 10 is provided with a recording unit 12 (“recording means” of the present invention) capable of recording voices such as explanations and questions. Specifically, the user terminal 10 needs to have a voice recorder function.

The storage unit 13 (“storage means” of the present invention) is composed of, for example, a hard disk device, an SSD, a flash memory, or the like, and in addition to the above-mentioned page information and evaluation, software for an operating system or a user terminal 10 or the like. I also remember various programs.

The timekeeping unit (“timekeeping means” of the present invention) is a clock included in the user terminal 10, and preferably has a timer function in addition to measuring real time. For example, the page feed timing in the explanation measured by the timekeeping unit 14 is incorporated into the above-mentioned page information.

The control unit 15 is composed of a CPU 15a, a ROM 15b, a RAM 15c, and the like, and functions as a computer. The CPU 15a realizes various functions by reading and executing various programs stored in the ROM 15b and the storage unit 13. Further, since the control unit 15 enables control to reproduce the explanatory material by integrating page information, evaluation, and the like, it corresponds to the "content reproduction means" of the present invention.

The input unit 16 is, for example, an input device such as a keyboard, a mouse, a touch pad, a touch panel, a touch pen (styrus pen), and a voice input device (microphone). Further, the output unit 17 is, for example, an output device such as a display (display unit 10a) for displaying an image or a speaker for emitting sound.

The data communication unit 18 is connected to the network NW described above, and transmits and receives various data to and from other devices such as a server. The details of the voice analysis unit 19 and the match determination unit 20 will be described later.

Next, FIG. 3 shows an example of the explanation given by the employee P to the client C. Specifically, as shown in FIG. 1, the employee P explained the company's service (new rate plan for electricity bill) while showing the slide of the explanatory material to the client C.

First, FIG. 3A shows a time chart of explanation by employee P. The explanatory material consists of a total of eight pages, and employee P turns the pages in order from the first page ([P1] in the figure) to explain. The horizontal axis is hours (minutes).

The explanation starts at 15:00 pm, and the timer starts at the same time as the display of the explanatory material starts (or the explanation starts). When switching pages, the elapsed time from the start of display is recorded. For example, the switching timing from the first page to the second page ([P2] in the figure) is one minute after the start of the timer ((1) in the figure), and the second to third pages (in the figure). The switching timing to [P3]) is 5 minutes after the start of the timer ((5) in the figure).

The explanation of employee P, the remarks of client C, the voice of questions (recorded data), and the page switching information (page information) are recorded by the user terminal 10 as data associated with the elapsed time from the start of display. It is stored in the unit 12 and the storage unit 13.

In addition, employee P may suspend (close) the display of explanatory materials and give explanations only in words or while showing other materials (magazines, pamphlets, etc.) to client C. Even in such a case, the voice and conversation are recorded by the recording unit 12 and stored as recorded data.

Here, the timing of the evaluation performed by employee P during the explanation is indicated by a star in the figure. The evaluation is also stored in the storage unit 13 of the user terminal 10 as data associated with the elapsed time from the start of display. The above-mentioned voice, page information, and evaluation are associated with time (real time) in addition to elapsed time.

In FIG. 3A, the explanation of the last page 8 (“P8” in the figure) ends 24 minutes after the start. After that, pages 3 and 7 (“P7” in the figure) are displayed, but it is a scene where employee P re-explains the difficult points pointed out by client C and answers questions. .. After that, the explanation ends at 15:30 pm and the timer is reset.

FIG. 3B shows a page information screen (“aggregation screen” of the present invention) constituting the explanatory material. This page information screen can also be viewed on the display unit 10a of the user terminal 10 as a function of the dedicated application.

Since the first page is displayed only once, the display time "15: 00-15: 01" is recorded in the "time 1" column. In addition, the third page is displayed twice (see FIG. 3A), and the "time 1" column is the first display time "15: 05-15: 10" and "time 2" columns. The second display time of "15: 24-15: 28" is recorded in.

Furthermore, if there is a page displayed three times, the display time is recorded in the "time 3" column, and if there is a page displayed n times (n: natural number), the "time n" column (not shown). The display time is recorded in.

On pages 2 to 8, employee P evaluates (primary evaluation) (see FIG. 3A). There are four grades from good evaluation to "++", "+", "-", and "---". For example, on the third page, “−−” and “+” are evaluated in the “evaluation” column, and the respective evaluation times are recorded.

In addition, the numerical values in the "point" column are numerical values of the above evaluations, and here, "++" is 3 points, "+" is 1 point, "-" is -1 point, and "---". Is calculated as -3 points. For example, the second page is given a score of 1 because the evaluation is "+", and the third page is given a score of -2 because the rating is "-" and "+".

With such a list, along with the page information, for example, the explanation on the third page was not smooth and took a long time (evaluation "---"), and the sixth page was convinced by the client C (evaluation "++"). ) And other information remains as a record, so employee P can use it to improve the explanation.

Next, with reference to FIG. 4, an explanatory material and an example of the evaluation performed by the employee P during the explanation will be described.

First, FIG. 4A shows a slide on page 3 of the explanatory material. Employee P explains "3. Features of the new rate plan" which is the content of the third page using the touch pen T or instructing with a finger.

Further, as shown in the figure, an evaluation button B is arranged at the upper right of the display unit 10a. Employee P explains "3. Features of the new rate plan", and when he feels that the response of client C is bad, he clicks the "-" side of the evaluation button B with the touch pen T at that point. By this operation, the evaluation associated with the elapsed time from the start of display is stored for the third page.

Employee P can also evaluate one slide multiple times. For example, regarding "(1) First month cash back" in the contents of the third page, if the client C's understanding is insufficient or the explanation is not smooth, "---" is evaluated. In addition, if the client C understands "(2) free maintenance" and "(3) points are accumulated", it can be evaluated as "+".

When evaluating "-", the employee P may double-click the "-" side of the evaluation button B with the touch pen T. Since the display unit 10a is a touch panel type, the employee P may click with his / her own finger. Further, the evaluation button B may not be provided, and the evaluation may be performed by a finger gesture (tap, flick, swipe, etc.).

Next, FIG. 4B shows a slide on page 4 of the explanatory material. Here, the employee P explains "4. First month cash back" which is the content of the fourth page using the touch pen T or while instructing with a finger.

Employee P explained "4. First month cash back", and when he felt that Client C was responsive and understood, at that point, he clicked the "+" side of the evaluation button B with the touch pen T. To do. By this operation, the evaluation associated with the elapsed time from the start of display is stored.

There are various other evaluation methods. The user terminal 10 includes a voice analysis unit 19 that recognizes the voice of employee P and analyzes the content of the voice (see FIG. 2). The voice analysis unit 19 can perform evaluation based on the content of the voice. For example, an NG word list is prepared in the storage unit 13 in advance, and when the words uttered by the employee P match the NG words, "-" is evaluated. As a result, the evaluation is automatically performed even if the employee P does not perform an operation such as tapping during the presentation.

Examples of NG words include "Yes ... (silence).", "That's right ... (silence).", "I can't answer right away ..." and so on. If the voice analysis unit 19 has the ability to judge the context, more accurate evaluation can be performed.

The voice analysis unit 19 may perform the evaluation based on the tone of the voice, the utterance interval, and the like. For example, when the tone of the explanation of employee P is low, he speaks fast, or he speaks unilaterally, the evaluation is "-". In addition, when the tone of employee P is large and clear, and the conversation with client C is bidirectional, the evaluation is "+".

Next, reproduction (reproduction) of the explanatory material will be described with reference to FIGS. 5 and 6.

On the user terminal 10, the explanatory material can be reproduced in conjunction with the history (voice, page information, evaluation) when the employee P previously explained (reproduction mode). First, FIG. 5A shows a reproduction display of the third page displayed on the display unit 10a of the user terminal 10.

In the reproduction display, a slide display unit 40 is arranged above the slide display unit 40, and an evaluation display unit 50 is arranged below the slide display unit 40. The slide display unit 40 is a display area in which slides of explanatory materials are reproduced. Employee P can play the explanatory material in the reproduction mode to check which slide of the explanatory material and at what timing the evaluation (primary evaluation) such as "+" or "-" was made. it can. In addition to playing back the explanatory material, the slide display unit 40 can fast-forward, rewind, adjust the volume, and the like.

The evaluation display unit 50 includes an overall evaluation column 55 and an individual evaluation column 56. For example, the employee P can input the overall evaluation (overall comment) for this explanatory material by tapping the overall evaluation column 55 of the evaluation display unit 50.

The individual evaluation column 56 is generated corresponding to the above-mentioned primary evaluation. On the third page, since the evaluation was performed twice, two evaluation columns 56a and 56b are generated. Employee P can input a more detailed secondary evaluation for the primary evaluation of the selected evaluation column by tapping the area of the individual evaluation column 56.

For example, as shown in the evaluation column 56a, the employee P leaves a secondary evaluation of "The explanation of the first month cashback is not transmitted" at the time when the evaluation of "---" is performed. As a result, the reason for evaluating "---" is also memorized, which can be useful for improving the explanation.

Next, FIG. 5B shows a reproduction display of the fourth page displayed on the display unit 10a of the user terminal 10. The screen configuration of the reproduction display is the same, but the evaluation column 56b is blank on the fourth page because the evaluation is performed only once.

The fourth page (reproduction display) is displayed next to the third page (reproduction display) when the explanatory material is reproduced in the reproduction mode. That is, in the reproduction mode, the explanatory material is paged according to the time chart shown in FIG. 3A. Since the second page is displayed in the latter half of the third page, FIG. 5A is redisplayed. The evaluation column 56a, which is the corresponding evaluation, may be highlighted at the first display, and the evaluation column 56b, which is the corresponding evaluation, may be highlighted at the second display.

Further, as shown in FIG. 6, the sound may be integrally reproduced including the sound. Here, the reproduction display on page 3 is shown, but in line with the display on page 3, employee P explained at the time of the explanation, "This is a new rate plan, but there are three major features ..." Audio is played.

By using this function, the explanation given by Employee P before can be reproduced in a form close to the actual one. Then, the employee P can recognize what kind of explanation was given at the time of the evaluation (“−−”) and can look back on the explanation more deeply.

A black screen is displayed for the period during which the employee P temporarily suspends the display of the explanatory material, and the conversation of the period is reproduced by voice. Therefore, it is possible to know the fact that the display is temporarily suspended. When the user terminal 10 is used in landscape orientation, the individual evaluation column 56 shown in FIG. 5A cannot be displayed at once, so that the individual evaluation column 56'is displayed under the slide.

In this way, in the reproduction mode, the display is performed as if it were reproduced content using explanatory materials, but the evaluation and audio are output integrally based on the elapsed time from the start of the explanation. It is not stored as video data. In particular, when trying to create reproduction content including audio, the amount of data becomes enormous.

Finally, with reference to FIG. 7, a match determination when the explanatory material is modified or changed will be described.

In the user terminal 10, the explainer can perform a self-evaluation on each page of the explanatory material, and the explanation can be reviewed by the above-mentioned reproduction mode. As a result, corrections and changes may occur, such as replacing low-rated pages (slides) or adding new pages.

FIG. 7 shows the third page with explanatory text added to make it a little easier to understand. Specifically, the explanation of "(30% of the billed amount in the first month)" is added to "(1) Cashback in the first month". "(2) Free maintenance" and "(3) Accumulate points" have also been changed with simple explanations.

In this example, since the content of the third page and the position in the whole are not changed, the same individual evaluation column 56'as before the change (see FIG. 6) is displayed. That is, the match determination unit 20 (“determination means” of the present invention) of the user terminal 10 determines the match / mismatch of each page before and after the change (see FIG. 2). Then, even when a predetermined page is modified or changed, if it is determined to be the same, the previous evaluation can be left.

For example, if the page titles (3. Features of the new rate plan) are the same, the match determination unit 20 determines that the pages (slides) match before and after the change. Also, if a new slide (for example, 4. Subscriber transition) is inserted between the 3rd and 4th pages, the previous 4th page will be moved down to the 5th page and the title will be "5". It will be changed to "First month cash back". In this case, if the title "First month cashback" excluding numbers is the same, it is determined that the pages match before and after the change.

For the pages that match before and after the change, various information on the page information screen (see FIG. 3B) is not changed either. For example, even when the third page is changed from the initial state (see FIG. 4A) and changed to the display shown in FIG. 7, time information (time 1, time 2), evaluation information, and points Is maintained. That is, even if the explanatory material is partially changed, if the change width is small, it is treated as the same slide and the evaluations are aggregated, so that the evaluation information for each page can be accumulated.

The screen display and evaluation input modes in the above-described embodiment are merely examples and can be changed as appropriate. The time information of the page information, evaluation, etc. is the elapsed time from the start of display of the explanatory material, but the timer may be started from the start of display to record the time when the page is turned, or the page may be turned. A method of recording the time (real time) may be used.

Further, the time possessed by the page information, the evaluation, etc. may be the elapsed time from the start of the explanation. For example, the explainer (presenter) may determine the start timing by operating a predetermined key of the notebook PC.

10 User terminal 10a Display unit 11 System bus 12 Recording unit 13 Storage unit 14 Timekeeping unit 15 Control unit 16 Input unit 17 Output unit 18 Data communication unit 19 Voice analysis unit 20 Match judgment unit 40 Slide display unit 50 Evaluation display unit 55 Overall evaluation Columns 56, 56'Individual evaluation columns 56a, 56b Evaluation columns

Claims (6)

A video playback device that stores the history of display content used by the user for explanation and can be played back like a video after the explanation.
Display means for displaying the display content and
Timekeeping means and
A storage means for storing the page information of each page associated with the elapsed time from the start of the explanation or the display start of the displayed content, and the evaluation performed by the user associated with the elapsed time.
A content reproduction means for integrally reproducing the page information and the evaluation stored in the storage means with the display content, and
A video playback device characterized by being equipped with. In the moving image playback device according to claim 1,
A moving image playback device, characterized in that a total screen that totals the number or points of the evaluations for each page can be displayed on the display means. In the moving image playback device according to claim 2,
When the user changes a part of the display content, it is provided with a determination means for determining whether or not the pages match or do not match before and after the change.
A moving image playback device, characterized in that, when a match is determined by the determination means, the evaluations are totaled for the same page. In the moving image playback device according to any one of claims 1 to 3,
A recording means for recording a voice associated with the elapsed time, wherein the user has described the display content, is provided.
The content reproducing means is a moving image reproducing device, characterized in that, when reproducing the displayed content after the explanation, the audio recorded by the recording means is also reproduced. In the moving image playback device according to any one of claims 1 to 4,
The display means is a touch panel type display.
A moving image reproducing device, characterized in that the evaluation is performed based on a predetermined operation performed by the user on the display. In the moving image playback device according to any one of claims 1 to 5,
A voice analysis means for recognizing the voice of the user and analyzing at least the content of the voice is provided.
The voice analysis means is a moving image reproducing device characterized in that the evaluation is performed based on the content of the voice.

Images