JP7114908B2 - Information processing system, information processing device, information processing method, and information processing program - Google Patents

Description

The present invention relates to an information processing system, an information processing device, an information processing method, and an information processing program.

A system is known that records recorded data such as blackboard writing data, voice data of uttered voice, and displayed display screen recorded during a predetermined period, and reproduces it later.

For example, Patent Literature 1 discloses a method of reproducing recorded blackboard writing on a whiteboard in synchronization with video of a meeting or class. Specifically, in Patent Document 1, when a drawing operation does not end within a certain period of time after starting to record a certain drawing operation, the recorded content is changed to the operation end state after a predetermined period of time. A method for efficiently reviewing is disclosed.

Conventionally, however, it has been difficult to perform efficient reproduction when data to be reproduced includes audio or video. That is, if the conventional method of adjusting the reproduction of other recorded data in accordance with the board-written data is used, there are cases where the audio and video are cut off at the stage where the meaning is lost and the reproduction is omitted, which is an efficient method. Couldn't play. That is, conventionally, it has been difficult to efficiently reproduce recorded data.

SUMMARY OF THE INVENTION It is an object of the present invention to efficiently reproduce recorded data.

In order to solve the above-described problem, an information processing system includes: an acquisition unit that acquires first recorded data in which an element section including a preset element to be recognized changes in chronological order; a specifying unit that specifies an active section to be reproduced in the element section of the first recorded data based on a threshold value of the amount of activity of the element according to the type of the first recorded data; a reproduction control unit that controls reproduction of the first record data according to the active section data of the active section of the record data. The acquiring unit acquires a plurality of first recorded data recorded in periods at least partially overlapping, and the identifying unit obtains the activity amount corresponding to each type of the plurality of first recorded data. The active section in the element section of each of the plurality of first recording data is specified based on the threshold value of . The reproduction control unit controls reproduction of the active section data of the active section included in the first record data at a reproduction speed higher than a recording speed, and controls the reproduction of the active section data of each of the plurality of first record data. reproduction control of a plurality of the first recording data according to the section data, and if the active sections of the plurality of the first recording data include overlapping sections having overlapping recording timings, the recording timings overlap; The reproduction speed is adjusted for each recording timing according to the number of active sections to be recorded.

According to the present invention, recorded data can be efficiently reproduced.

FIG. 1 is a schematic diagram showing an example of the configuration of an information processing system according to this embodiment. FIG. 2 is a schematic diagram showing an example of the hardware configuration of the information processing apparatus. FIG. 3 is a block diagram illustrating a functional configuration example of an information processing apparatus; FIG. 4 is a schematic diagram showing an example of the data structure of a recording data management DB. FIG. 5 is a schematic diagram showing an example of the data configuration of print data. FIG. 6 is a schematic diagram showing an example of the data structure of the first recording data and the second recording data. FIG. 7 is an explanatory diagram of an example of identifying an active section in the first recording data. FIG. 8 is an explanatory diagram of an example of active intervals and inactive intervals in recorded data. FIG. 9 is an explanatory diagram showing an example of reproduction control by the reproduction control unit. FIG. 10 is a schematic diagram showing an example of a display image displayed on the playback unit. FIG. 11 is a flow chart showing an example of an information processing procedure executed by the control unit of the present embodiment.

Hereinafter, embodiments of an information processing system, an information processing apparatus, an information processing method, and an information processing program according to the present embodiment will be described in detail with reference to the accompanying drawings. In this specification, parts having the same configuration and function are denoted by the same reference numerals, and detailed description thereof may be omitted.

The application target of the information processing system, the information processing apparatus, the information processing method, and the information processing program of the present embodiment is not limited. For example, the information processing system and information processing program of this embodiment are applied to an educational system, a conference system, and the like.

FIG. 1 is a schematic diagram showing an example of the configuration of an information processing system 1000 according to this embodiment.

An information processing system 1000 according to the present embodiment includes an information processing device 10 and a recording device 18 .

The information processing device 10 and the recording device 18 are communicably connected via a network 20 . In this embodiment, the information processing system 1000 will be described as including a plurality of recording devices 18 . The information processing device 10 and at least one of the plurality of recording devices 18 are connected wirelessly or by wire. When connecting wirelessly, for example, 3G (3rd Generation), 4G (4th Generation), LTE (Long Term Evolution), wireless LAN (Local Area Network), Bluetooth (registered trademark), etc. may be used.

The recording device 18 records recording data. Recorded data is data recorded by the recording device 18 . Recording refers to sound recording, video recording, storage, and the like. Recorded data includes, for example, blackboard data, moving image data, still image data, and audio data. The board-written data is data that defines the drawing contents of the board-written area on the electronic blackboard for each recording timing.

The recording device 18 may be any device that records recording data. In this embodiment, as an example, a case where the recording device 18 is each of the projection device 12, the electronic blackboard 14, and the microphone 16 will be described.

The projection device 12 is a device that projects an image. The projection device 12 is, for example, a projector. In the present embodiment, the projection device 12 sequentially records projection images projected continuously for a certain period of time in chronological order, and records moving image data of the projection images. In other words, the projection device 12 obtains moving image data defining projected images at each recording timing. Then, the projection device 12 transmits the moving image data to the information processing device 10 as recording data.

The electronic blackboard 14 sequentially records, in chronological order, the trajectory written in a predetermined board-written area, and records the board-written data of the board-written image. The board-written image is an image showing the content written on the board-written area. In other words, the electronic blackboard 14 obtains board-written data in which the content to be written is defined for each recording timing. Then, the electronic blackboard 14 transmits the board-written data to the information processing apparatus 10 as recording data.

The microphone 16 sequentially records sounds within a collectible range in chronological order to record audio data. That is, the microphone 16 obtains audio data defining sounds for each recording timing. Then, the microphone 16 transmits the audio data to the information processing device 10 as recording data.

Note that FIG. 1 shows one each of the projection device 12, the electronic blackboard 14, and the microphone 16. As shown in FIG. However, the information processing system 1000 may be configured to include two or more of at least one of the projection device 12 , the electronic blackboard 14 , and the microphone 16 . Also, one recording device 18 may have at least two of the projection function of the projection device 12 , the function of the electronic blackboard 14 , and the recording function of the microphone 16 .

A terminal device having at least one function of the projection device 12 , the electronic whiteboard 14 , and the microphone 16 may be used as the recording device 18 .

The information processing apparatus 10 performs reproduction control of a plurality of recorded data (details will be described later). The information processing apparatus 10 is implemented by, for example, a personal computer. Playback refers to at least one of display of images and the like, and output of sound.

Next, an example of the hardware configuration of the information processing device 10 will be described. FIG. 2 is a schematic diagram showing an example of the hardware configuration of the information processing device 10. As shown in FIG.

Each of the information processing device 10 and the recording device 18 includes a CPU (Central Processing Unit) 25, a ROM (Read Only Memory) 26, a RAM (Random Access Memory) 27, a HDD (Hard Disk Drive) 28, and a communication interface. /F (interface) 24 , an external I/F 23 and an operation panel 29 , which are interconnected via a bus 21 .

The CPU 25 comprehensively controls the operations of the information processing device 10 and the recording device 18 . The CPU 25 uses the RAM 27 as a work area and executes programs stored in the ROM 26, the HDD 28, or the like, thereby controlling the overall operation of the information processing apparatus 10 and realizing various functional units to be described later.

The HDD 28 stores programs, data, and the like. The operation panel 29 receives various operation inputs according to user's operations, and displays various information and various images.

In this embodiment, the operation panel 29 integrally includes both an operation reception unit 29A that realizes a reception function for receiving various operation instructions and a display unit 29B that realizes a display function for displaying various information. A case where the touch panel is a touch panel will be described. However, the configuration of the operation panel 29 is not limited to such a configuration. For example, the operation panel 29 may be configured with the operation reception section 29A and the display section 29B as separate bodies.

A communication I/F 24 is an interface for communicating with other devices and devices via the network 20 . The external I/F 23 is an interface for communicating with the speaker 23A, an external memory such as a recording medium, and the like. The speaker 23A realizes an output function of outputting sound.

Next, functions of the information processing apparatus 10 according to this embodiment will be described in detail.

FIG. 3 is a block diagram showing a functional configuration example of the information processing apparatus 10. As shown in FIG.

The information processing device 10 includes a control section 30 , a communication section 32 , a storage section 34 , a reproduction section 36 and an operation section 38 . The communication unit 32, the storage unit 34, the reproduction unit 36, the operation unit 38, and the control unit 30 are connected so as to be able to exchange data and signals.

The communication unit 32 communicates with the recording device 18 .

The communication unit 32 of the information processing device 10 has a receiving function and a transmitting function. A reception function of the communication unit 32 is a function of receiving various data and signals from the recording device 18 . A transmission function of the communication unit 32 is a function of transmitting various data and signals to the recording device 18 .

The storage unit 34 stores various data. The storage unit 34 is implemented by, for example, the HDD 28 (see FIG. 2). In this embodiment, the storage unit 34 stores a recording data management DB 34A.

The recorded data management DB 34A is a database for managing the recorded data 40. FIG. Note that the data format of the recording data management DB 34A is not limited to a database. The data format of the recording data management DB 34A may be, for example, a table.

FIG. 4 is a schematic diagram showing an example of the data structure of the recording data management DB 34A. The recording data management DB 34A associates device IDs, recording data 40, recording start timings, and recording periods.

The device ID is identification information for identifying each recording device 18 . Note that the recording data management DB 34A may have a configuration that does not include the device ID.

Recorded data 40 is recorded data recorded by each of the recording devices 18 . The recording data 40 includes, as described above, written-on-board data, moving image data, still image data, voice data, and the like.

FIG. 4 shows audio data A, audio data B, blackboard data A, and still image data B as an example of the recording data 40 . However, the recorded data 40 registered in the recorded data management DB 34A is not limited to these.

Also, the data format of the recording data 40 is not limited. For example, the recording data 40 may be in any data format such as JPG, JPEG, GIF, PNG, BMP, PDF, MP3, WAV.

The recording start timing in the recording data management DB 34A indicates the timing at which recording of the corresponding recording data 40 is started.

In this embodiment, the timing at which the recording data 40 is recorded will be referred to as recording timing. That is, the recording start timing indicates the recording timing at which recording is started among the recording timings of the recording data 40 . Further, in the present embodiment, the timing at which the recording of the recording data 40 is completed will be referred to as the recording end timing.

The recording timing is represented by year, month, day, hour, minute, second (yyyymmdd/hhmmss), for example. Note that the recording timing may indicate the timing at which each piece of recording data 40 is recorded, and may be represented by an elapsed time from a certain reference time.

The recording period in the recording data management DB 34A represents the data length of the corresponding recording data 40 in terms of time.

The recording data management DB 34A is updated by the control unit 30 each time the recording data 40 is received from the recording device 18. FIG. That is, when the control unit 30 of the information processing device 10 receives new recording data 40 from the recording device 18, it sequentially registers them in the recording data management DB 34A.

Returning to FIG. 3, the description continues. A reproducing unit 36 reproduces the recorded data 40 . Playback by the playback section 36 is controlled by the control section 30 . Playback control will be described later.

The playback unit 36 includes a display unit 36A and an audio output unit 36B. The display unit 36A displays various images. The display unit 36A is, for example, a display. The display unit 36A is implemented by, for example, the display unit 29B (see FIG. 2). The audio output unit 36B outputs sound. The audio output unit 36B is, for example, a speaker. The audio output unit 36B is implemented by, for example, the speaker 23A (see FIG. 2).

The operation unit 38 accepts operation instructions from the user. The operation unit 38 is, for example, a keyboard, a mouse, and the like. The operation unit 38 is implemented by the operation reception unit 29A (see FIG. 2).

Next, the control unit 30 of the information processing device 10 will be described. The control unit 30 controls the information processing device 10 . The control unit 30 is implemented by the CPU 25, the ROM 26, the RAM 27 (see FIG. 2), and the like. Note that the control unit 30 may be realized by a circuit or the like.

The control unit 30 has a communication control unit 30A, a storage control unit 30B, an acquisition unit 30C, an identification unit 30D, a reproduction control unit 30E, and a reception unit 30F. Some or all of the communication control unit 30A, the storage control unit 30B, the acquisition unit 30C, the identification unit 30D, the reproduction control unit 30E, and the reception unit 30F cause a processor circuit such as the CPU 25 to execute a program, that is, It may be realized by software, may be realized by hardware using a dedicated processing circuit such as an IC (Integrated Circuit), or may be realized by using software and hardware together. The number of processing circuits may be physically one or plural.

The communication control section 30A controls communication with the recording device 18 by the communication section 32 . In this embodiment, the communication control section 30A receives the recording data 40 from the recording device 18 via the communication section 32 .

The storage control unit 30B controls storage in the storage unit 34. FIG. In the present embodiment, each time the communication control unit 30A receives the recording data 40 from the recording device 18 via the communication unit 32, the storage control unit 30B stores the received recording data 40 as the device ID, recording start timing, and registered in the recording data management DB 34A in association with the recording period.

The device ID, the recording start timing of the recording data 40, and the recording period may be received together with the recording data 40 from the recording device 18 that transmitted the recording data 40. FIG.

Acquisition unit 30C acquires recording data 40 . In the present embodiment, a plurality of recorded data 40 recorded in periods at least partially overlapping are acquired. The recording data 40 is classified into first recording data 42 and second recording data 44 (details will be described later).

In the present embodiment, the acquisition unit 30C acquires at least one or more first recording data 42 . Note that the acquisition unit 30C may acquire one or more first recorded data 42 and one or more second recorded data 44 .

In the present embodiment, a case where the acquiring unit 30C acquires one or a plurality of first recording data 42 and one or a plurality of second recording data 44 as a plurality of recording data 40 will be described as an example. do. Note that when the first recording data 42 and the second recording data 44 are collectively described, they are simply referred to as the recording data 40 .

In the present embodiment, the acquisition unit 30C uses the reproduction target period to be reproduced as the overlapping period. Then, the acquisition unit 30C acquires the plurality of recorded data 40 by reading the plurality of recorded data 40 recorded in the reproduction target period to be reproduced from the recorded data management DB 34A.

The reproduction target period may be set in advance. Further, the acquisition unit 30C may acquire a reproduction target period from the operation unit 38 and read from the storage unit 34 a plurality of recorded data 40 recorded during a period including the reproduction target period.

In this case, for example, the user operates the operation unit 38 to input a reproduction target period to be reproduced. The reception unit 30F receives an operation instruction signal from the operation unit 38. FIG. Upon receiving the reproduction target period from the operation unit 38, the receiving unit 30F outputs it to the obtaining unit 30C. The acquisition unit 30C acquires from the storage unit 34 a plurality of recorded data 40 recorded during a period including the reproduction target period received from the operation unit 38 via the reception unit 30F.

Note that the acquisition unit 30C may acquire the recording data 40 directly from the recording device 18 via the communication control unit 30A and the communication unit 32. FIG. In this case, the acquiring section 30C may transmit an acquisition request signal for the record data 40 recorded during the period including the reproduction target period to the recording device 18 via the communication control section 30A and the communication section 32 . If the recording device 18 holds recorded data 40 recorded during a period including the reproduction target period included in the acquisition request signal, the recording device 18 may transmit the recorded data 40 to the information processing device 10 . Thereby, the acquisition unit 30C may directly acquire from the recording device 18 the plurality of recorded data 40 recorded during the period including the reproduction target period.

The identifying unit 30D identifies element sections E for each of the plurality of pieces of recorded data 40 obtained by the obtaining unit 30C, and identifies at least a portion of the element sections E as active sections.

Description will be made with reference to FIG. FIG. 5 is a schematic diagram showing an example of the data configuration of the recording data 40. As shown in FIG.

The element section E is a section including meaningful elements 72 in the recording data 40 . In other words, the element section E is a period including the element 72 in the entire recording period of the recording data 40 .

Element 72 is meaningful in conveying information. Elements 72 are, in particular, sounds, letters, symbols, images, etc. that indicate language that can be recognized as meaningful. Images that can be recognized as meaningful information include, for example, graphs, tables, images of objects, and the like. An image of an object is, for example, an image showing a person, a car, a document, and the like.

First, the identifying unit 30D analyzes each of the plurality of recorded data 40 acquired by the acquiring unit 30C, and analyzes the element section E including the element 72 for each of the plurality of recorded data 40. FIG. The identifying unit 30D identifies the element section E by this.

For example, assume that an interval in recorded data 40 contained the sound of meaningful words formed by combinations of words. In this case, the specifying unit 30D specifies, as the element section E, the section containing the voice.

Also, for example, assume that a section in the recorded data 40 includes an element 72 that indicates a meaningful character. In this case, the identifying unit 30D identifies, as the element section E, the section containing the character. Also, for example, if the recorded data 40 is board-written data, it is assumed that the recorded data 40 was the recorded data 40 indicating that characters were sequentially drawn on a whiteboard on which no characters were drawn. . In this case, the specifying unit 30D specifies, as an element section E, a section including characters to be drawn in the recording data 40. FIG.

Note that the identification unit 30D may set the target to be recognized as the element 72 in advance. For example, the identification unit 30D may preset characters and languages as objects to be recognized as the elements 72 . The object to be recognized as the element 72 may be appropriately changed by the user's operation instruction through the operation unit 38 or the like.

Also, as a method for identifying the element 72 by analyzing the recorded data 40, a known image processing method or sound data analysis method may be used.

In this manner, the identification unit 30D identifies the element section E in the recording data 40. FIG. The specifying unit 30D can distinguish, for example, a section during explanation by voice and a section during silence.

Here, the element section E in the recording data 40 is a section including the element 72 as described above. This element 72 may change along the time series in the element section E or may be fixed without change. That is, in the element section E, when the element 72 shows changes such as increase, decrease, positional change, shape change, etc. along the time series, and during the element section E, the element 72 has the same form (shape, position, etc.) continue to exist in the same form).

In the present embodiment, a section in the element section E in which the element 72 continuously changes along the time series will be referred to as a change section. In other words, the change section is a section, such as audio or video, that cannot be understood as information unless it is played back in chronological order at the time of recording.

Further, in the present embodiment, a section in the element section E in which the element 72 is stationary will be referred to as a stationary section. A still section is, in other words, a section whose information can be understood even when only one recording timing is reproduced, such as a still image or writing on a blackboard.

Here, as described above, the recording data 40 is classified into first recording data 42 and second recording data 44 .

The first recorded data 42 is the recorded data 40 in which the element 72 changes along the time series in the element section E including the meaningful element 72 . Specifically, the first recorded data 42 is the recorded data 40 in which the element section E is composed only of change sections and the element section E does not include a still section.

The second recorded data 44 is the recorded data 40 including the still section within the element section E. FIG.

FIG. 6 is a schematic diagram showing an example of the data structure of the first recording data 42 and the second recording data 44. As shown in FIG.

FIG. 6A is a schematic diagram showing an example of the data configuration of the first recording data 42. As shown in FIG. An element section E included in the first recording data 42 is a change section EA. The first recorded data 42 is, for example, audio data and moving image data.

6B and 6C are schematic diagrams showing an example of the data configuration of the second recording data 44. FIG. Element sections E included in the second recording data 44 include still sections EB. In this embodiment, the second recording data 44 will be classified into second recording data 44A and second recording data 44B.

As shown in FIG. 6B, the element section E of the second recording data 44A is composed of a change section EA and a still section EB. It should be noted that the element section E of the second recording data 44A only needs to be composed of the change section EA and the still section EB, and the number of the change section EA and the still section EB included in one element section E, and The positional relationship between the change section EA and the static section EB in one element section E is not limited.

For example, the element section E of the second recording data 44A may have a configuration in which the still section EB is arranged at the recording timing after the change section EA. Further, for example, the element section E of the second recording data 44A may have a configuration in which a change section EA, a still section EB, and a change section EA are arranged in this order in time series. Further, the element section E of the second recorded data 44A may have a configuration in which the still section EB and the change section EA are arranged in this order in time series. The second recording data 44A is, for example, blackboard data and moving image data.

As shown in FIG. 6C, the element section E of the second recording data 44B is the still section EB. Also, the second recording data 44B is, for example, still image data.

The specifying unit 30</b>D specifies an active section in the element section E of the recording data 40 .

An active section indicates a section to be reproduced in the recorded data 40 . In other words, the active section indicates the section to be reproduced in the element section E including the meaningful element 72 in the recorded data 40 .

That is, the specifying unit 30D specifies at least a part of the element section E in the record data 40 as an active section to be reproduced.

In the present embodiment, the specifying unit 30D uses different methods to specify the active section for the first recorded data 42 and the second recorded data 44. FIG.

First, a method for identifying active intervals in the first recording data 42 will be described.

The specifying unit 30</b>D specifies the active section P in the element section E of the first recorded data 42 based on the threshold value of the activity amount of the element 72 according to the type of the first recorded data 42 .

The types of the first recording data 42 are, for example, audio data and moving image data. Note that the first recording data 42 may be the recording data 40 in which the element section E is the change section EA, as described above, and the type of the first recording data 42 is not limited to these. In this embodiment, as an example, a case where the types of the first recording data 42 are audio data and moving image data will be described.

The amount of activity indicates the duration of the element 72 being continuously included and the amount of change in the element 72 . The duration indicates the time during which the element 72 is continuously included.

The amount of change indicates the amount by which element 72 changes. Specifically, when the type of the first recording data 42 is audio data, the amount of change is the volume indicating the element 72 . In this case, the amount of change is represented by the following formula (1), for example.

Amount of change=Volume at time t−0 Expression (1)

It should be noted that the sound volume may be represented by a physical quantity indicating the loudness of the sound, and the units of the sound volume are Pa (sound pressure), dB (sound intensity level), phon (sound loudness level), sone ( volume of sound).

Further, when the type of the first recording data 42 is moving image data, the amount of change is the amount of screen change between frames. For example, the amount of screen change is determined by using, as a reference frame, a frame captured at the time when at least a part of the included element 72 starts to change (referred to as the change start time), and the reference frame and the image after the change start time. shows the difference between the frame captured at the recording timing of . When the type of the first recording data 42 is moving image data, the amount of change is expressed by the following formula (2).

Amount of change=number of pixels indicating difference between frame at start of change and frame at time t/number of pixels in one frame Equation (2)

The specifying unit 30</b>D predetermines thresholds for the duration and the amount of change for each type of the first recording data 42 .

For example, when the type of the first recorded data 42 is audio data, the duration threshold is, for example, 500 ms. 500 ms is an example of a longer duration than interjections such as "a" and "e".

Moreover, when the type of the first recording data 42 is audio data, the threshold value of the amount of change is, for example, 60 db. 60db is an example of the loudness of a normal conversation.

Further, for example, when the type of the first recording data 42 is moving image data, the duration threshold is, for example, 66 ms. 60 ms indicates the duration when the element 72 included in the number of 2 frames or more changes at a general moving image frame rate of 30 fps. If the element 72 included in two or more frames continuously changes, the change of the element 72 becomes recognizable by the user.

Further, when the type of the second recording data 44 is moving image data, the threshold for the amount of change is, for example, 0.03. 0.03 is an example of a screen change threshold that excludes changes in mouse pointer and the like.

The threshold value for each type of the first recording data 42 may be determined in advance, but may be changed as appropriate by a user's operation instruction of the operation unit 38 or the like.

The specifying unit 30D specifies, as an active interval, an interval in which at least one of the duration and the amount of change is equal to or greater than the corresponding threshold in the element interval E included in the first recorded data 42 .

In the present embodiment, the specifying unit 30D selects, in the element section E included in the first recording data 42, a section in which both the duration and the amount of change are equal to or greater than the corresponding thresholds, as the active section to be reproduced. A case to specify is explained. Note that the specifying unit 30D may specify, as an active section, a section in the element section E included in the first recording data 42 in which the duration or amount of change is equal to or greater than the corresponding threshold value.

FIG. 7 is an explanatory diagram of an example of specifying the active section P in the first recording data 42. As shown in FIG.

For example, assume that the type of the first recording data 42 is moving image data, the duration threshold is S1, and the variation threshold is S2. It is also assumed that the first recorded data 42 includes _three element intervals E, element intervals E ₁ to E 3 .

In the example shown in FIG. 7, among the element intervals E (element intervals E ₁ to E ₃ ) included in the first recording data 42, the change amount of the element interval E ₁ is equal to or greater than the threshold value S2, but the duration is is less than the threshold S1. When the _first recorded data 42 is voice data, the element section E1 is a section including elements 72 such as the sound of an object falling, the sound of a pen being knocked, or short utterances such as "ah" and "eh". is. Further, when the _first recorded data 42 is moving image data, the element section E1 is, for example, a section in which the frame becomes completely black for an instant.

_The element section E2 has a change amount equal to or greater than the threshold value S2 and a duration equal to or greater than the threshold value S1. _The element section E2 is, for example, a section that requires efficient review of the recorded contents.

The element section _E3 has a change amount less than the threshold value S2 and a duration time greater than or equal to the threshold value S1. When the first recorded data 42 is audio data _, the element section E3 is a section including elements 72 such as the user's soliloquy and the sound of hitting an object. Further, when the first recorded data 42 is moving image data _, the element section E3 is a section including an element 72 such as a pointer that moves on the screen, for example.

In the case of the first recorded data 42 shown in FIG. 7, the specifying unit 30D selects the element section E ₃ among the element sections E (element section E ₁ to element section E ₃ ) included in the first recorded data 42 as Identify it as an active interval P.

Then, the specifying unit 30D specifies a section in which at least one of the duration and the amount of change is less than the corresponding threshold value S (S1, S2) in the element section E as an inactive section Q not to be reproduced. In the example shown in FIG. 7, the identification unit 30D identifies element intervals E ₁ and E ₃ among element intervals E (element intervals E ₁ to E ₃ ) as inactive intervals Q. In the example shown in FIG.

On the other hand, for the second recorded data 44, the identifying unit 30D identifies the element section E in the second recorded data 44 as the active section P. FIG.

FIG. 8 is an explanatory diagram of an example of the active section P and the non-active section Q in the recording data 40. As shown in FIG.

FIG. 8A is an explanatory diagram of an example of the active section P and the non-active section Q in the first recording data 42. FIG. Through the above process, the specifying unit 30D specifies, as an active section P, a section in which the amount of activity of the element 72 is equal to or greater than the threshold value, among the element sections E, which are the change sections EA, in the first recorded data 42 . The specifying unit 30D also specifies sections Q1 other than the element section E and sections Q2 of the element section E other than the active section P in the first recording data 42 as non-active sections Q. FIG.

FIG. 8B is an explanatory diagram of an example of the active section P and the non-active section Q in the second recording data 44A. Through the above process, the specifying unit 30D specifies, as active sections P, all sections of the element sections E including the change section EA and the still section EB in the second recorded data 44A. Then, the specifying unit 30D specifies the section Q other than the element section E in the second recording data 44A as the non-active section Q. As shown in FIG.

FIG. 8C is an explanatory diagram of an example of the active section P and the non-active section Q in the second recording data 44B. Through the above process, the identification unit 30D identifies all sections of element sections E, which are composed of still sections EB, in the second recorded data 44B as active sections P. FIG. Then, the specifying unit 30D specifies the section Q other than the element section E as the non-active section Q in the second recording data 44B.

In the following description, the data of the active interval P in the recording data 40 will be referred to as active interval data 80. FIG. That is, the active section data 80 is data of a portion of the section in the recorded data 40 specified by the specifying unit 30D.

Returning to FIG. 3, the description is continued. Next, the reproduction control section 30E will be described.

The reproduction control unit 30E controls reproduction of the plurality of recorded data 40 according to the active interval data 80 of each active interval P of the plurality of recorded data 40 acquired by the acquisition unit 30C.

When the acquiring unit 30C acquires a plurality of first recorded data 42 as the recorded data 40, the reproduction control unit 30E reproduces the active interval data 80 of each active interval P of the plurality of first recorded data 42. , to control reproduction of a plurality of first recorded data 42 . Further, when the acquiring unit 30C acquires both the first recorded data 42 and the second recorded data 44 as the recorded data 40, the reproduction control unit 30E determines the activity of each of the plurality of first recorded data 42. According to the section data 80 and the active section data 80 of the active section P of the second recorded data 44, reproduction control is performed on the plurality of first recorded data 42 and the second recorded data 44. FIG.

In the present embodiment, the reproduction control unit 30E reproduces the active section data 80 specified by the specifying unit 30D for each piece of recorded data 40, and excludes the non-active section Q from being reproduced.

For this reason, the plurality of recorded data 40 acquired by the acquisition unit 30C may be a plurality of types of recorded data 40, such as blackboard data, moving image data obtained by photographing discussion audio and displayed materials, and audio data. Even so, it is possible to suppress the abbreviated reproduction at the point where the meaning is unclear, and efficiently reproduce the meaningful section.

Further, in the present embodiment, the identifying unit 30D determines the first recorded data 42 based on the threshold value of the activity amount of the element 72 corresponding to the type of the first recorded data 42. specifies an active section P to be reproduced in the element section E included in .

Therefore, in the information processing apparatus 10 of the present embodiment, for the first recorded data 42 whose included element section E is the change section EA in which the element 72 continuously changes along the time series, the element section E Sections that hinder efficient playback, included in , are excluded from playback.

When the first recorded data 42 is voice data, the sections that hinder efficient reproduction include short utterances that have little meaning, such as "a" and "e", user's soliloquy, and objects. such as a tapping sound. Further, when the first recorded data 42 is moving image data, the section that hinders efficient reproduction includes, for example, a section in which the frame is black for a moment, a section including a pointer that moves on the screen, and the like. , are sections showing screen changes that are difficult to visually confirm.

Therefore, in the information processing apparatus 10 of the present embodiment, a section suitable for efficient reproduction can be set as the active section P to be reproduced.

Next, reproduction control of the recorded data 40 by the reproduction control section 30E will be described in detail. In the present embodiment, the reproduction control section 30E controls the reproduction device so as to reproduce the recorded data 40. FIG. Specifically, the reproduction control unit 30E controls the reproduction device so as to reproduce the active section data 80 included in the recording data 40 (details will be described later).

As a reproducing device for reproducing the recorded data 40, the reproducing unit 36 mounted on the information processing device 10 or the reproducing device 22 installed outside the information processing device 10 may be used.

The playback device 22 is a device that plays back sounds and images. The playback device 22 includes a display section 22A, an audio output section 22B, and a communication section 22C. The display unit 22A displays various images. The display unit 22A is, for example, a display. The audio output unit 22B outputs sound. The audio output unit 22B is, for example, a speaker. The communication unit 22C communicates with the information processing device 10 .

The information processing device 10 and the playback device 22 are directly connected via a cable so as to be able to exchange data and signals. Note that the information processing device 10 and the playback device 22 may be communicably connected via the network 20 . Then, the communication unit 32 may be configured to communicate with the recording device 18 and the reproducing device 22 .

Note that, in the present embodiment, a mode in which the reproduction control unit 30E controls the reproduction of the reproduction unit 36 will be described as an example.

Further, in the present embodiment, a case where the reproduction control unit 30E controls the reproduction unit 36 so as to perform streaming reproduction will be described as an example.

That is, in the present embodiment, the reproduction control unit 30E sequentially reads the active interval data 80 of the active interval P from the plurality of recorded data 40 acquired by the acquiring unit 30C according to the recording timing. A case in which the reproduction unit 36 is controlled to reproduce data 80 will be described as an example.

The reproduction control unit 30E performs reproduction control so that the active section data 80 of each of the plurality of recording data 40 acquired by the acquisition unit 30C is reproduced at a reproduction timing corresponding to the recording timing. That is, the reproduction control unit 30E analyzes a plurality of recorded data 40 in accordance with the recording timing, sets each recording timing at which the active section P of any one of the recorded data 40 appears as a reproduction target, and performs reproduction control. conduct.

Specifically, the reproduction control unit 30E reproduces the active section data 80 of each of the plurality of recording data 40 acquired by the acquisition unit 30C at the same recording timing and at the same reproduction timing corresponding to the recording timing. to control playback.

That is, for a section (non-overlapping section) in which only the active section P of the single recorded data 40 appears in the reproduction target period acquired by the acquisition unit 30C, only the active section data 80 of the active section P of the recorded data 40 is , and is reproduced at reproduction timing corresponding to the recording timing.

On the other hand, in the reproduction target period acquired by the acquisition unit 30C, for a section (overlapping section) in which the active sections P of the plurality of recorded data 40 overlap, the active section data 80 of the plurality of overlapping active sections P are obtained at each recording timing. playback is controlled at the same playback timing.

Returning to FIG. 3, the description continues. The reproduction control unit 30E controls the reproduction of the active section data 80 of the active section P included in the first recording data 42 so as to reproduce the active section P at a higher reproduction speed than the recording speed of the active section P.

Therefore, for example, when the active interval data 80 of the active interval P included in the first recording data 42 is audio data indicating some kind of sound, the reproduction control unit 30E reproduces the audio data of the active interval P as , playback is controlled at a playback speed faster than the recording speed. Further, when the active interval data 80 of the active interval P included in the first recording data 42 is moving image data, the reproduction control unit 30E reproduces the moving image data of the active interval P at a speed faster than the recording speed. Playback is controlled by playback speed.

As described above, in the active section P in the first recorded data 42, the element 72 continuously changes along the time series. Also, the change section EA is a section that cannot be understood as information unless it is reproduced in order along the time series at the time of recording. For this reason, if the change section EA is reproduced in chronological order of the recording timing, it is possible that the change section EA will be reproduced in a meaningful state even if it is reproduced at a reproduction speed higher than the reproduction speed at the time of recording. is high.

Therefore, the reproduction control unit 30E reproduces the active section data 80 of the active section P (change section EA) included in the first recording data 42 at a reproduction speed higher than the recording speed of the active section P. so that you can control the playback. Thereby, the reproduction control section 30E can efficiently reproduce the plurality of recorded data 40. FIG. Also, the reproduction time can be shortened.

The reproduction control unit 30E may reproduce the active section data 80 of the active section P included in the first recording data 42 at a reproduction speed higher than the recording speed, and the reproduction speed is not limited. For example, the reproduction control unit 30E may perform reproduction control at a reproduction speed higher than the recording speed and at a reproduction speed at which the element 72 included in the active section P can be recognized by humans. The playback speed may be set in advance, or may be changed by a user's operation instruction on the operation unit 38 .

In addition, when the active sections P of the plurality of first recording data 42 include overlapping sections with overlapping recording timings, the reproduction control unit 30E controls recording according to the number of active sections P with overlapping recording timings. The playback speed may be adjusted for each timing. For example, the reproduction control unit 30E controls reproduction of a plurality of overlapping active interval data 80 at a faster reproduction speed as the number of overlapping active intervals P is smaller.

On the other hand, for the active section P included in the second recording data 44, the reproduction control unit 30E reproduces the element 72 recorded at the specific recording timing of the included static section EB during the reproduction period corresponding to the static section EB. , to control playback.

The specific recording timing indicates, for example, the first recording timing in the still section EB. Note that the specific recording timing may be one recording timing in the still section EB, and is not limited to the first recording timing. However, from the viewpoint of ease of reproduction control, it is preferable to use the first recording timing in the still section EB as the specific recording timing.

Therefore, when the second recorded data 44 is still image data, the element 72 included in the frame corresponding to the first recording timing in the active section P (static section EB) is the reproduction period corresponding to the active section P. , is displayed continuously. For this reason, reproduction control is performed using only the element 72 included in one of the frames corresponding to each of the plurality of recording timings that constitute the active interval P in the second recording data 44. .

As described above, the stationary section EB is a section in which the element 72 is stopped for a predetermined period of time or longer. Therefore, by reproducing the element 72 recorded at one recording timing in the section, it is highly likely that the meaning of all the contents recorded in the still section EB can be comprehended. Therefore, for the active section P (still section EB) included in the second recording data 44, the reproduction control unit 30E reproduces the element 72 recorded at the specific recording timing of the included still section EB as the still section A plurality of recorded data 40 can be reproduced more efficiently according to the type of the active section P by performing reproduction control during the reproduction period according to the EB.

Note that when the active section P included in the second recorded data 44 includes both the still section EB and the change section EA (see the second recorded data 44B in FIG. 8C), the reproduction control unit 30E Only the still section EB may be reproduced in the same manner as described above, and the changing section EA may be excluded from the reproduction control.

As a result, the reproduction control unit 30E can, for example, exclude the midway change section EA in which the blackboard writing is written alone, and set the still section EB indicating the blackboard writing in the finished state as the reproduction target. can. In addition, this makes it possible to shorten the reproduction time.

Further, when the active section P included in the second recorded data 44 includes both the still section EB and the change section EA (see the second recorded data 44A in FIG. 8B), the reproduction control unit 30E The change section EA may be reproduced at a reproduction speed higher than the recording speed. Then, for the static section EB in the active section P, the reproduction control unit 30E may control the reproduction of the element 72 recorded at the specific recording timing for a reproduction period corresponding to the static section EB, in the same manner as described above. .

Also, there may be an overlapping section in which the recording timing overlaps between the active section P of the first recording data 42 and the active section P of the second recording data 44 . In this case, the reproduction control section 30E preferably performs the following reproduction control.

Specifically, the reproduction control unit 30E controls the first overlapping section between the active section P of the first recorded data 42 and the change section EA in the active section P of the second recorded data 44 in the overlapping section. , the active interval data 80 of the first recorded data 42 and the changing interval data of the changing interval EA of the second recorded data 44 are reproduced at the same recording timing and at the same reproduction timing at a reproduction speed higher than the recording speed. Playback control to play.

Then, the reproduction control unit 30E controls the second overlapping section between the active section P of the first recorded data 42 and the still section EB in the active section P of the second recorded data 44 in the overlapping section to perform the first The active interval data 80 of the active interval P in the recorded data 42 of the second recording data 42 is reproduced at a playback speed higher than the recording speed of the active interval data 80, and the static interval EB of the second recorded data 44 is recorded at a specific timing. to control the reproduction of the element 72 recorded in .

Playback control by the playback control unit 30E will be specifically described with reference to explanatory diagrams.

FIG. 9 is an explanatory diagram showing an example of reproduction control by the reproduction control section 30E.

For example, in a meeting, a plurality of audio data (first recorded data 42A, first recorded data 42B), blackboard data (second recorded data 44A), and still image data (second recorded data 44B) and are recorded. Then, a case of performing reproduction control on these recorded data 40 will be described. In FIG. 9, an arrow T indicates the time flow of recording timing.

The first recording data 42A includes an active section P from recording timings t1 to t3 and an active section P from recording timings t15 to t16. In the active section P from the recording timings t1 to t3, as the element 72, the element 72a1 voice "It's a problem" and the element 72a2 voice "Start" are recorded at different recording timings in chronological order. ing. In the active section P from recording timing t15 to t16, as the element 72, the voice "End", which is the element 72a3, is recorded.

The first recording data 42B includes active sections P of recording timings t2 to t4, t6 to t7, t9 to t10, and t12 to t13. In the plurality of active intervals P of the first recorded data 42B, the voice "please take notes" as the element 72b1, the voice "beginning" as the element 72b2, and the voice "be careful here" as the element 72b3 are respectively included. , element 72b4 of the speech "Good" and element 72b5 of the speech "Do you understand" were recorded.

The second recording data 44A includes an active section P from recording timings t6 to t11. The active section P of the second recording data 44A is composed of a change section EA from recording timings t6 to t8 and a still section EB from recording timings t8 to t11.

In the second recording data 44A, the change interval EA between recording timings t6 to t8 is composed of change interval data 81. FIG. The change section data 81 shows a state in which the elements 72 as characters (the character "D_" as the element 72c1, the character "1" as the element 72c2, and the character "CCA" as the element 72c3) are sequentially added. It consists of a plurality of frames 81C1-81Cn. A still section EB between recording timings t8 to t11 in the second recording data 44A is composed of active section data 80 consisting of a plurality of frames 81D. Each of these multiple frames 81D is the same frame containing the same elements 72 (element 72c1, character "D_", element 72c2, character "1", element 72c3, character "CCA").

The second recording data 44B includes an active section P from recording timings t5 to t14. The active section P of the second recorded data 44B is the static section EB. A still section EB from recording timings t5 to t14 in the second recording data 44B is composed of a plurality of identical frames including the same element 72 (characters "A+B" as the element 72d1).

The reproduction control unit 30E performs the following reproduction control on the plurality of recorded data 40 (first recorded data 42A, first recorded data 42B, second recorded data 44A, second recorded data 44B). .

Note that the column of reproduced content 90 in FIG. 9 shows the reproduced content reproduced according to the corresponding recording timing. In FIG. 9, an arrow S indicates the time flow of reproduction timing.

Note that the scale and timing of the recording timing and the scale and timing of the reproduction timing do not have to match completely. That is, the reproduction timing desired to correspond to the recording timing is not limited to the same time as long as it corresponds to the timing. Also, the temporal length of the section indicated by the plurality of recording timings and the temporal length of the section indicated by the corresponding plurality of reproduction timings may be the same or different.

The reproduction control of the reproduction control section 30E will be specifically described.

The reproduction control unit 30E identifies unreproduced active sections P in order from the upstream side to the downstream side of the recording timing time flow (see the direction of the arrow T) for the plurality of recorded data 40 . At this time, the reproduction control unit 30E sequentially identifies active sections P that have not been reproduced and that have the earliest recording timing.

In the case shown in FIG. 9, the reproduction control unit 30E first identifies the active section P of the recording timings t1 to t3 in the first recording data 42A, which has the earliest recording timing among the active sections P that have not been reproduced. Then, the reproduction control unit 30E reproduces the element 72a1 of the voice "problem" and the element 72a2 of the voice "begin" included in the active section P according to the recording timing of each of these elements 72. At each of the reproduction timings S1 to S2 and the reproduction timings S2 to S3, the reproduction unit 36 is controlled so as to reproduce at a reproduction speed higher than the recording speed.

In the active interval P between the recording timings t1 and t3, the interval Ta between the recording timings t1 and t2 is a non-overlapping interval that does not overlap with the active interval P in the other recording data 40. FIG.

Therefore, at the reproduction timing corresponding to this interval Ta (the interval between reproduction timings S1 and S2), the reproduction control unit 30E controls the voice "problem ” at corresponding reproduction timings S1 to S2 at a reproduction speed higher than the recording speed.

A section Tb between recording timings t2 and t3 is an overlapping section in which the active section P in the first recorded data 42A and the active section P in the first recorded data 42B overlap.

Therefore, at the reproduction timing corresponding to this section Tb (the section of reproduction timings S2 to S3), the reproduction control unit 30E controls the voice "begin" which is the element 72a2 included in the section Tb in the first recording data 42A. , and the voice "Please take notes", which is the element 72b1 included in the section Tb in the first recording data 42B, are both played back at a playback speed higher than the speed at which they were recorded. do.

On the other hand, the section Tc from the recording timings t3 to t4 in the first recorded data 42B is a non-overlapping section that does not overlap with the active section P in the other recorded data 40. FIG.

Therefore, at the reproduction timing corresponding to this section Tc (the section of reproduction timings S2 to S4), the reproduction control unit 30E reproduces the voice "beginning", which is the element 72b2 included in the section Tc in the first recording data 42B. , independently controls the reproducing section 36 so as to reproduce at corresponding reproduction timings S2 to S4 at a reproduction speed higher than the recording speed.

It should be noted that since the active section P is not included in the second recorded data 44 in the section Ta, section Tb, and section Tc, the reproduction section 36 The display image 70A displayed on the display section 36A does not include any of the elements 72 of the second recorded data 44 .

Next, a section Td from recording timings t4 to t5 will be described. Since the active section P is not included in any of the recorded data 40 in this section Td, the reproduction control section 30E does not perform reproduction control.

Next, the reproduction control unit 30E specifies an active section P whose recording start timing is the recording timing t5 of the second recording data 44B as the active section P which has not been reproduced and has the earliest recording timing. In the example shown in FIG. 9, the active section P in the second recording data 44B is the section from recording timings t5 to t14.

Here, the active section P of the second recording data 44B is the static section EB. That is, the active section P of the second recording data 44B is a section continuously including the same element 72 (characters "A+B" as the element 72d1).

Therefore, the reproduction control unit 30E records at the specific recording timing of the still section EB in the second recording data 44B at the reproduction timing (section of the reproduction timing S5 to S14) corresponding to the recording timing t5 to t14. The reproducing unit 36 is controlled so as to continue reproducing the element 72 (here, the character "A+B" which is the element 72d1).

That is, the reproduction unit 36 does not use all of the plurality of frames in the second recording data 44B at the reproduction timings corresponding to the recording timings t5 to t14 (the section of the reproduction timings S5 to S14), but rather Only one corresponding frame is played continuously. Specifically, the character “A+B”, which is the element 72d1 included in one frame in the second recorded data 44B, is displayed as the display image 70 on the reproduction unit 36 .

Here, the active section P of the recording timings t5 to t14 of the second recording data 44B includes an overlapping section that overlaps with the active section P of the other recording data 40. FIG. In other words, each active section P of the plurality of recorded data 40 may include an overlap period that overlaps with at least one active section P of other recorded data 40 . Therefore, the reproduction control unit 30E performs the following control. Here, reproduction control for each section (section Te to section To) separated by each of the recording start timing and the recording end timing of the active section P in each of the plurality of recording data 40 will be described in order.

First, the interval Te between recording timings t5 and t6 will be described. In the interval Te in the second recorded data 44B, the static interval EB in the second recorded data 44B is non-overlapping with the active interval P in the other recorded data 40 . Therefore, the reproduction control unit 30E controls the reproduction unit 36 so as to reproduce only the characters "A+B", which are the elements 72d1 of the second recording data 44B, for this section Te. Therefore, at the playback timing corresponding to this section Te, the playback unit 36 displays the characters "A+B", which are the elements 72d1 included in one frame in the second recorded data 44B, as the display image 70B. be done.

Next, a section Tf from recording timings t6 to t7 will be described. This section Tf is an overlapping section in which the still section EB of the second recorded data 44B, the active section P of the first recorded data 42B, and the change section EA of the second recorded data 44A overlap.

For this reason, the reproduction control unit 30E reproduces the voice "Be careful here", which is the element 72b3 included in the section Tf in the first recording data 42B, at a reproduction speed higher than the speed at the time of recording in the section Tf. Playback control to play with Further, the reproduction control unit 30E displays a display image 70C including both the elements 72 included in the section Tf of the second recorded data 44A and the elements 72 included in the section Tf of the second recorded data 44B. The playback unit 36 is controlled as follows.

Therefore, at the reproduction timing corresponding to the section Tf (the section of the reproduction timings S6 to S7), the reproduction unit 36 outputs the audio element 72b3 included in the section Tf in the first recording data 42B, "Please be careful here. is played back at a playback speed faster than the speed at which it was recorded. Further, at the reproduction timings (reproduction timings S6 to S7) corresponding to the section Tf, the display section 36A of the reproduction section 36 displays the data recorded at the first recording timing t5 in the still section EB in the second recording data 44B. The characters “A+B”, which is the element 72d1, are continuously displayed, and the elements 72 (elements 72c1 to 72c3) included in the change section EA in the second recording data 44 change the speed at the time of recording according to the recording timing. It is displayed while changing at a faster playback speed.

For this reason, for example, characters that are formed while being written on the board are reproduced by the reproduction unit 36 at a reproduction speed faster than the recording speed, and characters included in the still image are reproduced by the reproduction unit 36 without change. is played. Audio and moving images recorded at the same time are played back at a playback speed faster than the speed at which they were recorded.

Next, the interval Tg from recording timings t7 to t8 will be described. In the section Tg, the still section EB of the second recorded data 44B and the change section EA of the second recorded data 44A overlap, and the active section P of the first recorded data 42 is a non-overlapping section. .

Therefore, the reproduction control unit 30E continues the same reproduction control as in the section Tf except that the element 72 in the first recording data 42 is not reproduced in the section Tg.

Next, section Th from recording timing t8 to t9 will be described. In the section Th, the still section EB of the second recording data 44B and the still section EB of the second recording data 44A overlap.

Therefore, in this case, the reproduction control unit 30E controls the second recording data 44A and the second recording data 44B at the reproduction timing corresponding to the section Th from the recording timing t8 to t9 (the section from the reproduction timing S8 to S9). , to reproduce the element 72 recorded at the first recording timing of the still section EB.

Therefore, the reproduction unit 36 sets the reproduction timing (reproduction timings S8 to S9) corresponding to the section Th to the character "A+B" as the element 72d1, the character "D_" as the element 72c1, and the character " 1” and the characters “CCA”, which is the element 72c3, continue to be displayed. For example, an image showing the board writing in a state where additional writing has been completed is displayed on the display section 36A of the reproducing section 36 .

Next, an interval Ti from recording timings t9 to t10 will be described. In the section Ti, the still section EB of the second recorded data 44B, the still section EB of the second recorded data 44A, and the active section P of the first recorded data 42B overlap.

In this case, the reproduction control unit 30E performs reproduction control similar to that for the section Th for the second recorded data 44A and the second recorded data 44B. Then, for the change section EA of the section Ti in the first recording data 42B, the reproduction control unit 30E converts the voice "Good" which is the element 72b4 which is the element 72 included in the change section EA. At the reproduction timing corresponding to the recording timing t9, reproduction is controlled at a reproduction speed higher than the recording speed.

For this reason, the reproduction unit 36 sets the reproduction timing (reproduction timings S9 to S10) corresponding to the section Ti to the character "A+B" which is the element 72d1, the character "D_" which is the element 72c1, and the character " 1”, and the element 72c3 of the characters “CCA” are continuously displayed, and the element 72b4 of the voice “It’s good” is played back at a faster playback speed than at the time of recording.

Next, a section Tj from recording timings t10 to t11 will be described. In the section Tj, the still section EB of the second recording data 44A and the still section EB of the second recording data 44B overlap. For this reason, the reproduction control unit 30E controls each static section EB in each of the second recorded data 44A and the second recorded data 44B at the reproduction timing corresponding to the section Tj (the section between the reproduction timings S10 and S11). The reproducing unit 36 is controlled so as to reproduce the element 72 recorded at the first recording timing.

Therefore, the reproduction unit 36 sets the reproduction timings (reproduction timings S10 to S11) corresponding to the section Tj to the character "A+B" which is the element 72d1, the character "D_" which is the element 72c1, and the character " 1” and the characters “CCA”, which is the element 72c3, continue to be displayed. For this reason, in this section Tj, for example, an image showing the board writing in a state where additional writing to the board writing has been completed is displayed on the display section 36A of the reproducing section 36, as in the section Th.

Next, the section Tk from recording timing t11 to t12 will be explained. For the interval Tk, the static interval EB of the second recorded data 44B is non-overlapping with the active interval P of the other recorded data 40. As shown in FIG. Therefore, only the characters “A+B”, which is the element 72d1, are reproduced by the reproduction unit 36 during the reproduction timings S11 to S12 corresponding to this section Tk. That is, the display image 70E including only the characters “A+B” is displayed on the playback unit 36 .

That is, at the reproduction timing corresponding to the section Tk, the characters "D_", the character "1", and the character "CCA", which are the elements 72 of the second recording data 44A displayed in the previous section Tj, are displayed. Only the characters “A+B”, which are deleted and recorded in the section Te, are displayed on the display section 36A of the reproduction section 36 .

Next, the section Tk from recording timing t11 to t12 will be described. This section Tk does not include the active section P of any recording data 40 . Therefore, the reproduction control unit 30E excludes this section Tk from being reproduced.

Next, a section Tl from recording timings t12 to t13 will be described. In the section Tl, the active section P of the first recorded data 42B and the static section EB of the second recorded data 44B overlap.

Therefore, at the reproduction timing corresponding to the section Tl (the section of the reproduction timing S12 to S13), the reproduction control unit 30E outputs the voice "Do you understand?" , Play back at a faster playback speed than when recording. Further, the reproduction control unit 30E controls the element recorded at the first recording timing of the still section EB in the second recording data 44B at the reproduction timing corresponding to the section Tl (the section of the reproduction timing S12 to S13). It controls the reproducing unit 36 to reproduce the characters "A+B" which is 72d1.

Therefore, at the reproduction timing corresponding to the section Tl, the display image 70E including the characters "A+B", which are the characters recorded in the section Tl, is displayed on the display section 36A of the reproduction section 36, and the voice "I understand" is displayed. "Did you get it?" is played back at a faster speed than when it was recorded.

Next, a section Tm from recording timings t13 to t14 will be described. In the interval Tm, the static interval EB of the second recorded data 44B is non-overlapping with the active interval P in the other recorded data 40. FIG. Therefore, only the characters “A+B”, which is the element 72d1, are reproduced by the reproduction unit 36 during the reproduction timings S13 to S14 corresponding to this section Tm. That is, the display image 70E including only the characters “A+B” is displayed on the playback unit 36 .

Next, a section Tn from recording timings t14 to t15 will be described. Regarding the section Tn, it is not the active section P for any recording data 40 . Therefore, no element 72 is reproduced at the reproduction timings S14 to S15 corresponding to the interval Tn.

Next, a section To from recording timings t15 to t16 will be described. In the section To, only the active section P of the first recording data 42A is the active section P. Therefore, at the reproduction timing corresponding to this interval To (the interval of reproduction timings S15 and S16), the reproduction control unit 30E controls the voice “End”, which is the element 72a3 included in this interval To in the first recording data 42A. ” is independently reproduced at the corresponding reproduction timings S15 to S16 at a reproduction speed higher than the recording speed.

As described above, in the present embodiment, the reproduction control unit 30E performs reproduction control so that the active interval data 80 of each active interval P of the plurality of recorded data 40 is reproduced at the reproduction timing corresponding to the recording timing. . Therefore, in the overlapping section where the active sections P of the plurality of recorded data 40 overlap, the plurality of elements 72 included in the active section P of each of the plurality of recorded data 40 are simultaneously reproduced according to the recording timing. The Rukoto.

In addition, the reproduction speed and the contents of reproduction are adjusted according to the type of the active section P (whether it is a change section EA or a still section EB).

In FIG. 9, the reproduction control unit 30E sequentially reproduces the active interval data 80 of the active interval P along the recording timing time flow (arrow T) for the plurality of recorded data 40 acquired by the acquiring unit 30C. While reading, the reproduction unit 36 was controlled to reproduce the active interval data 80 of each recorded data 40 .

However, each time the reproduction control unit 30E receives a reproduction instruction signal from the reception unit 30F, the reproduction control unit 30E sequentially identifies an unreproduced active section P along the time series, and performs a plurality of recordings for each recording timing of the identified active section P. Reproduction control may be performed so that the active interval data 80 of each active interval P of the data 40 is reproduced.

In this case, the user inputs a reproduction instruction by operating the operation unit 38 . Then, the reception unit 30F receives a reproduction instruction signal indicating a reproduction instruction from the operation unit 38. FIG. The reproduction control section 30E may perform the above-described reproduction control each time it receives a reproduction instruction signal from the reception section 30F.

Specifically, the reproduction control unit 30E sequentially identifies the recording timing of the beginning of the active section P included in each of the plurality of recording data 40 shown in FIG. 9, and performs the same reproduction control as described above. That is, in this case, each time the reproduction control unit 30E receives the reproduction instruction signal, the reproduction control unit 30E shifts from the recording timing of the beginning of the active interval P included in each of the plurality of recording data 40 to the recording timing of the beginning of the next other active interval P. Playback control is performed sequentially with timing up to one control unit.

Note that FIG. 9 shows a form in which the elements 72 included in each active section P of the plurality of second recorded data 44 are combined with the same display image 70 and displayed. However, the reproduction control unit 30E may perform reproduction control so that the elements 72 are displayed in different display areas for each record data 40. FIG.

FIG. 10 is a schematic diagram showing an example of a display image 76 displayed on the playback unit 36. As shown in FIG. For example, display image 76 includes display area 76A, display area 76B, and display area 76C. The display area 76A, the display area 76B, and the display area 76C are display areas for displaying the elements 72 of the recording data 40 different from each other.

For example, when three recorded data 40 are acquired as the recorded data 40 to be reproduced, the moving image of the active section P included in one recorded data 40 is displayed in the display area 76A. In addition, the characters "A+B" are displayed in the display area 76B as the element 72d1 of the active section P included in another piece of recorded data 40. FIG. Also, the characters "D_", "1", and "CCA" as the elements 72c1 to 72c3 of the active interval P included in another piece of recorded data 40 are displayed in the display area 76C.

In this manner, the reproduction control unit 30E may control the reproduction of the reproduction unit 36 so that the elements 72 are displayed in different display areas for each record data 40. FIG.

Next, an example of an information processing procedure executed by the control unit 30 will be described.

FIG. 11 is a flowchart showing an example of an information processing procedure executed by the control unit 30 of this embodiment.

First, the acquisition unit 30C acquires a plurality of recorded data 40 recorded during a period including the reproduction target period (step S100). Next, the identification unit 30D identifies element sections E included in each of the plurality of recording data 40 acquired in step S100 (step S102).

Next, the identifying unit 30D classifies the recorded data 40 acquired in step S100 into first recorded data 42 and second recorded data 44 (step S104).

Next, the identification unit 30D identifies the active section P in the element section E for each of the first recorded data 42 and the second recorded data 44 classified in step S104 (step S106).

Next, the reception unit 30F repeats the negative determination until it receives the reproduction instruction signal (step S108: No). When the reception unit 30F determines that the reproduction instruction signal has been received (step S108: Yes), the process proceeds to step S110. In step S110, one unreproduced active section P is specified along the time series of the recording timing (step S110). Then, the reproduction control unit 30E controls reproduction of the active interval data 80 of the active interval P in the recording data 40 specified in step S110 (step S112). At this time, as described above, there may be an active section P of another recorded data 40 that overlaps the active section P of the recorded data 40 . In this case, as described above, the reproduction control unit 30E performs reproduction control so that the active interval data 80 of the active interval P of each of the plurality of recorded data 40 is reproduced at each recording timing of the specified active interval P. do.

Next, the reproduction control unit 30E determines whether or not to end the process (step S114). For example, the reproduction control unit 30E makes the determination in step S114 by determining whether or not an end signal indicating the end of processing has been received from the operation unit 38 via the reception unit 30F.

If a negative determination is made in step S114 (step S114: No), the process returns to step S108. On the other hand, if an affirmative determination is made in step S114 (step S114: Yes), this routine ends.

As described above, information processing system 1000 and information processing apparatus 10 according to the present embodiment include acquisition unit 30C, identification unit 30D, and reproduction control unit 30E. The acquiring unit 30C acquires the first recorded data 42 in which the element 72 changes in chronological order in the element section E including the meaningful element 72 . The specifying unit 30</b>D specifies the active section P to be reproduced in the element section E of the first recorded data 42 based on the threshold value of the activity amount of the element 72 according to the type of the first recorded data 42 . The reproduction control unit 30</b>E controls reproduction of the first record data 42 according to the active section data 80 of the active section P of the first record data 42 .

As described above, in the present embodiment, the information processing system 1000 and the information processing apparatus 10 select the element corresponding to the type of the first recording data 42 in the element section E including the element 72 in the first recording data 42 . Based on the threshold value of the amount of activity of 72, the active section P to be reproduced is specified in the element section E of the first recorded data 42 .

For this reason, the information processing apparatus 10 according to the present embodiment does not cover the entire section of the element section E including the element 72 in the first recorded data 42, but the section included in the element section E other than the section that hinders efficient reproduction. A segment can be identified as an active segment P to be played.

Therefore, the information processing apparatus 10 of the present embodiment can efficiently reproduce the recorded data 40 (first recorded data 42).

In particular, the information processing apparatus 10 of the present embodiment is effective in reviewing active learning. In detail, when looking back on a class (active learning) in which the learner actively engages in learning, in order for the learner to look back so that he or she follows the class experience, it is necessary to follow the class timeline. It's good to look back on the record of the class along. However, it takes a long time to play back all the recordings of the lesson. On the other hand, in active learning, since learners themselves actively engage in learning by giving presentations and raising issues, class programs (speakers, presentation content, etc.) are not uniform and should be omitted in advance. is difficult to identify. Therefore, by efficiently reproducing recorded data using the information processing apparatus 10 of the present embodiment, it becomes easy to review the lessons.

Also, the activity amount indicates the duration of the element 72 being continuously included and the amount of change in the element 72 . The identifying unit 30D identifies, as an active interval P, an interval in the element interval E in which at least one of the duration and the amount of change is equal to or greater than the corresponding threshold value.

The specifying unit 30D specifies a section in the element section E in which at least one of the duration and the amount of change is less than the corresponding threshold value, as an inactive section Q not to be reproduced.

In addition, the acquisition unit 30C acquires a plurality of first recorded data 42 recorded during periods at least partially overlapping. The specifying unit 30</b>D specifies the active section P in the element section E of each of the plurality of first recorded data 42 based on the threshold value of the amount of activity corresponding to the type of each of the plurality of first recorded data 42 . The reproduction control unit 30E controls reproduction of the plurality of first recorded data 42 according to the active section data 80 of each of the plurality of first recorded data 42 .

The active section P in the first recorded data 42 is at least a partial section of the element section E including the meaningful element 72 . Therefore, even if the plurality of first recorded data 42 acquired by the acquisition unit 30C is a plurality of types of recorded data 40 such as moving image data and audio data obtained by photographing the discussion sound and displayed materials, It is possible to suppress the abbreviated reproduction at the point where the meaning is unclear.

The obtaining unit 30C obtains one or a plurality of pieces of second recorded data 44 including a static section EB in which the element 72 is stationary within the element section E. FIG. The specifying unit 30D specifies the element section E in the second recording data 44 as the active section P. FIG. According to the active interval data 80 of the active interval P of each of the one or more first recorded data 42 and the active interval data 80 of the active interval P of the one or more second recorded data 44 , one or more first recorded data 42 and one or more second recorded data 44 are reproduced.

Also, when the type of the first recording data 42 is audio data, the amount of change is the volume indicating the element 72 . When the type of the first recording data 42 is moving image data, the amount of change is the amount of screen change between frames.

Elements 72 are at least one of sounds, letters, symbols, and images that indicate language.

The information processing method of the present embodiment includes the steps of acquiring first recorded data 42 in which the element 72 changes along the time series in an element section E including the meaningful element 72; a step of identifying an active section P to be reproduced in the element section E of the first recorded data 42 based on the threshold value of the amount of activity of the element 72 according to the type; and controlling reproduction of the first recorded data 42 according to the active section data 80 .

Further, the information processing program of the present embodiment includes a step of acquiring first recorded data 42 in which the element 72 changes along the time series in an element section E including the meaningful element 72; a step of identifying an active section P to be reproduced in the element section E of the first recorded data 42 based on the threshold value of the amount of activity of the element 72 corresponding to the type of the data 42; and controlling the reproduction of the first recorded data 42 in accordance with the active section data 80 of P.

Further, the reproduction control unit 30E performs reproduction control so that the active interval data 80 of each of the plurality of recorded data 40 is reproduced at a reproduction timing corresponding to the recording timing.

Further, the reproduction control unit 30E performs reproduction control so that the active interval data 80 of each of the plurality of recorded data 40 is reproduced at the same reproduction timing for each recording timing.

Further, the reproduction control unit 30E reproduces the active interval data 80 of the active interval P included in the first recorded data 42 with respect to the first recorded data 42 of the plurality of recorded data 40, Playback is controlled at a playback speed faster than the normal speed.

In the active section P in the first recorded data 42, the element 72 continuously changes along the time series. likely to be The information processing apparatus 10 of the present embodiment can reproduce the plurality of recorded data 40 more efficiently by performing the above processing according to the type of the active section P (change section EA, static section EB). can. Also, the reproduction time can be shortened.

Further, the reproduction control unit 30E controls the specific recording timing of the still section EB included in each of the active sections P included in the second recording data 44 of the plurality of recording data 40 for the second recording data 44. , is reproduced during a reproduction period corresponding to the still section EB.

The static section EB included in the active section P in the second recording data 44 is a section in which the element 72 is static. There is a high possibility that the meaning of all the contents recorded by EB can be grasped. Therefore, the information processing apparatus 10 of the present embodiment can more efficiently reproduce the plurality of recorded data 40 according to the type of the active section P by performing the above process.

Also, for example, the second recording data 44 is composed of one or a plurality of still images that are continuous in time series.

If there is an overlapping section in which the recording timing overlaps between the active section P of the first recording data 42 and the active section P of the second recording data 44, the reproduction control unit 30E , the active interval P of the first recorded data 42 and the change interval EA other than the still interval EB in the active interval P of the second recorded data 44, the active interval data of the first recorded data 42 80 and the change section data of the change section EA of the second recording data 44 are reproduced at the same recording timing and the same reproduction timing at a reproduction speed higher than the recording speed.

Then, the reproduction control unit 30E controls the second overlapping section between the active section P of the first recorded data 42 and the still section EB in the active section P of the second recorded data 44 in the overlapping section to perform the first The active section data 80 of the active section P in the recording data 42 is reproduced at a reproduction speed higher than the recording speed, and the element 72 recorded at the specific recording timing of the still section EB in the second recording data 44 is reproduced. Playback control.

Also, the reception unit 30F receives a reproduction instruction signal. Each time the reproduction control unit 30E receives a reproduction instruction signal, the reproduction control unit 30E sequentially identifies an unreproduced active section P included in the plurality of recorded data 40, and for each recording timing of the identified active section P, each of the plurality of recorded data reproduction control is performed so that the active section data 80 of the active section of .

Therefore, the information processing apparatus 10 of the present embodiment can perform efficient reproduction control in consideration of the characteristics of the recorded data 40 and the combination of overlapping sections.

Note that, in the present embodiment, the case where the reproduction control unit 30E controls the reproduction unit 36 so as to perform streaming reproduction has been described as an example.

However, the reproduction unit 36 may download the reproduction data from the control unit 30 and reproduce it. In this case, the reproduction control unit 30E creates reproduction data for reproducing the active interval data 80 of each of the plurality of recording data 40 by the same method as described above, and transmits the reproduction data to the reproduction unit 36. . Then, the reproduction unit 36 may reproduce the reproduction data downloaded from the control unit 30 .

In the above-described embodiment, the program for executing the above-described processing executed by the information processing apparatus 10 is a file in an installable format or an executable format, and can be downloaded from a CD-ROM, a flexible disk (FD), or a CD-ROM. R, DVD (Digital Versatile Disk), USB (Universal Serial Bus) memory or other computer-readable recording medium may be recorded and provided, or may be provided or distributed via a network such as the Internet. It may be configured as Also, various programs may be configured to be pre-installed in a ROM or the like and provided.

Further, the program executed by each of the information processing apparatuses 10 in the above-described embodiment has a module configuration including each of the above functional units. By reading the program from the ROM 26 or HDD 28 and executing it, each functional unit described above is loaded onto the RAM 27 (main memory), and each functional unit described above is generated on the RAM 27 (main memory). . Note that the information processing apparatus 10 can also implement some or all of the functional units described above using dedicated hardware such as ASIC (Application Specific Integrated Circuit) and FPGA (Field-Programmable Gate Array). is.

Although the embodiment has been described above, the embodiment is presented as an example and is not intended to limit the scope of the invention. The novel embodiments described above can be implemented in various other forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. The above-described embodiments and modifications are included in the scope and gist of the invention, and are included in the scope of the invention described in the claims and equivalents thereof.

10 Information processing device 30C Acquisition unit 30D Identification unit 30E Reproduction control unit 30F Acceptance unit 36 Reproduction unit 1000 Information processing system

JP 2007-066315 A

Claims (14)

an acquisition unit that acquires first recorded data in which the element changes along a time series in an element section containing a preset element to be recognized;
a specifying unit that specifies an active section to be reproduced in the element section of the first recorded data based on a threshold value of the amount of activity of the element according to the type of the first recorded data;
a reproduction control unit that controls reproduction of the first recorded data in accordance with active section data of the active section of the first recorded data;
with
The acquisition unit
Obtaining a plurality of first recorded data recorded during at least partially overlapping periods,
The identification unit
identifying the active section in the element section of each of the plurality of first recorded data based on the threshold value of the amount of activity corresponding to the type of each of the plurality of first recorded data;
The playback control unit
controlling reproduction of the active section data of the active section included in the first recording data at a reproduction speed higher than a recording speed;
controlling reproduction of the plurality of first recorded data according to the active interval data of each of the plurality of first recorded data;
If the active sections of the plurality of first recording data include overlapping sections with overlapping recording timings, the reproducing speed is adjusted for each recording timing according to the number of the active sections with overlapping recording timings. ,
Information processing system. The amount of activity indicates the duration that the element is continuously included and the amount of change in the element,
The identification unit
identifying, as the active interval, an interval in the element interval in which at least one of the duration and the amount of change corresponds to the threshold value or more;
The information processing system according to claim 1. The identification unit
identifying, in the element section, a section in which at least one of the duration and the amount of change is less than the corresponding threshold as an inactive section not to be reproduced;
The information processing system according to claim 2. when the type of the first recorded data is audio data, the amount of change is a volume indicating the element;
when the type of the first recording data is moving image data, the amount of change is an amount of screen change between frames;
The information processing system according to claim 2 or 3. The playback control unit
controlling the reproduction of the plurality of overlapping active section data at a faster reproduction speed as the number of the active sections whose recording timings overlap each other is smaller;
The information processing system according to claim 1 . The acquisition unit
Acquiring one or more pieces of second recorded data including a stationary section in which the element is stationary within the element section;
The identification unit
identifying the element section in the second recording data as the active section;
The playback control unit
one or more of the first recording data according to the active interval data of each of the one or more first recording data and the active interval data of the active interval of one or more of the second recording data; controlling reproduction of data and one or more of said second recorded data;
The information processing system according to any one of claims 1 to 5 . The playback control unit
For the active section included in the second recording data, the element recorded at a specific recording timing of the included static section is reproduced during a reproduction period corresponding to the static section.
The information processing system according to claim 6 . The playback control unit
The active section included in the second recorded data includes both the static section and a change section that is a section that cannot be understood as information unless it is reproduced in order along the time series at the time of recording. in this case, the still section is controlled for reproduction, and the change section is excluded from the reproduction control;
The information processing system according to claim 7 . The playback control unit
The active section included in the second recorded data includes both the static section and a change section that is a section that cannot be understood as information unless it is reproduced in order along the time series at the time of recording. in this case, controlling the reproduction of the change section at a reproduction speed higher than the speed at the time of recording;
The information processing system according to claim 7 . The playback control unit
When there is an overlapping section in which the recording timing overlaps between the active section of the first recording data and the active section of the second recording data,
For a first overlapping section between the active section of the first recording data and the change section in the active section of the second recording data in the overlapping section, the active section of the first recording data performing reproduction control so that the section data and the change section data of the change section of the second recording data are reproduced at the same reproduction timing at the same recording timing and at a reproduction speed higher than the recording speed;
For a second overlapping section between the active section of the first recording data and the static section of the active section of the second recording data in the overlapping section, the active section of the first recording data the active section data of the second recording data at a reproduction speed higher than the recording speed of the active section data, and reproducing the element recorded at a specific recording timing of the still section in the second recording data. do,
The information processing system according to claim 9 . The information processing system according to any one of claims 1 to 10, wherein said element is at least one of sounds, characters, symbols, and images indicating language. an acquisition unit that acquires first recorded data in which the element changes along a time series in an element section containing a preset element to be recognized;
a specifying unit that specifies an active section to be reproduced in the element section of the first recorded data based on a threshold value of the amount of activity of the element according to the type of the first recorded data;
a reproduction control unit that controls reproduction of the first recorded data in accordance with active section data of the active section of the first recorded data;
with
The acquisition unit
Obtaining a plurality of first recorded data recorded during at least partially overlapping periods,
The identification unit
identifying the active section in the element section of each of the plurality of first recorded data based on the threshold value of the amount of activity corresponding to the type of each of the plurality of first recorded data;
The playback control unit
controlling reproduction of the active section data of the active section included in the first recording data at a reproduction speed higher than a recording speed;
controlling reproduction of the plurality of first recorded data according to the active interval data of each of the plurality of first recorded data;
If the active sections of the plurality of first recording data include overlapping sections with overlapping recording timings, the reproducing speed is adjusted for each recording timing according to the number of the active sections with overlapping recording timings. ,
Information processing equipment. an acquisition step of acquiring first recorded data in which the element changes along a time series in an element section including a preset element to be recognized;
a specifying step of specifying an active section to be reproduced in the element section of the first recorded data based on a threshold value of the amount of activity of the element according to the type of the first recorded data;
a reproduction control step of controlling reproduction of the first recorded data according to active section data of the active section of the first recorded data;
including
The obtaining step includes:
Obtaining a plurality of first recorded data recorded during at least partially overlapping periods,
The identifying step includes:
identifying the active section in the element section of each of the plurality of first recorded data based on the threshold value of the amount of activity corresponding to the type of each of the plurality of first recorded data;
The playback control step includes:
controlling reproduction of the active section data of the active section included in the first recording data at a reproduction speed higher than a recording speed;
controlling reproduction of the plurality of first recorded data according to the active interval data of each of the plurality of first recorded data;
If the active sections of the plurality of first recording data include overlapping sections with overlapping recording timings, the reproducing speed is adjusted for each recording timing according to the number of the active sections with overlapping recording timings. ,
Information processing methods. an acquisition step of acquiring first recorded data in which the element changes along a time series in an element section including a preset element to be recognized;
a specifying step of specifying an active section to be reproduced in the element section of the first recorded data based on a threshold value of the amount of activity of the element according to the type of the first recorded data;
a reproduction control step of controlling reproduction of the first recorded data according to active section data of the active section of the first recorded data;
An information processing program for causing a computer to execute
The obtaining step includes:
Obtaining a plurality of first recorded data recorded during at least partially overlapping periods,
The identifying step includes:
identifying the active section in the element section of each of the plurality of first recorded data based on the threshold value of the amount of activity corresponding to the type of each of the plurality of first recorded data;
The playback control step includes:
controlling reproduction of the active section data of the active section included in the first recording data at a reproduction speed higher than a recording speed;
controlling reproduction of the plurality of first recorded data according to the active interval data of each of the plurality of first recorded data;
If the active sections of the plurality of first recording data include overlapping sections with overlapping recording timings, the reproducing speed is adjusted for each recording timing according to the number of the active sections with overlapping recording timings. ,
Information processing program.

Images