WO2017154845A1 - Reproducing device - Google Patents

Abstract

Provided is a reproducing device which assists in the detection by a user of useful information from time series data such as moving image data. A reproducing device 1 reproduces time-stamped moving image data 200, and is provided with: a reproduction frame determining unit 143 which acquires event information 300 including time of occurrence information; and a display unit 12 which jumps to and reproduces a time span, from among the moving image data 200, including a time point indicated by a time-stamp that is the same as or closest to the time of occurrence information of the event information 300 acquired by the reproduction frame determining unit 143.

Description

Playback device

The present invention relates to a playback device that plays back time-series data such as moving image data.

In factories and offices, various facilities are operating, and a data generator that monitors these facilities outputs field data indicating observation results for the facilities such as observation values, error information, and status information. The data generation device is a facility sensor, a programmable logic controller that controls factory automation (FA), a computer that counts products, a mobile terminal that allows a user to input information, and the like.

The on-site data is encoded or output as numerical values that are observation results, and is monitored by the fixed asset manager as event information with the occurrence location and date / time information added. The fixed asset manager is, for example, a facility maintenance manager in a factory and a facility manager such as a server in an office.

This event information is valuable information that contributes to operations such as factory and office operation management, product quality management, and business management. However, the event information output directly from the facility does not have secondary or tertiary meanings other than the direct meanings such as codes or simple observation numerical values, occurrence location and occurrence date and time. Conventionally, the information obtained at the site level is sequentially re-interpreted at each layer until it reaches the management and management level, and event information is changed into information with secondary and tertiary meanings. The event information was used at each level. Therefore, a time lag tends to occur in the way of information transmission between the site level and the management or management level, and the site level and the business management level tend to be liberated.

Therefore, an information collection system that can share event information in real time at each level has been proposed (see, for example, Patent Document 1). This information collection system stores a dictionary in which models that define the types of supplementary information added to field data are accommodated. In addition, a database storing supplementary information of various contents is prepared. Then, according to the dictionary, each supplementary information is searched from the database, and each searched supplementary information is added to the field data to generate event information.

As a result, the event information is not only simple background information for the field data but also explanatory information such as interpretation and evaluation of the contents of the field data, so that the information transmission has immediacy. In other words, from the user side, it seems that the event information describing the required contents directly and in an easy-to-understand manner has occurred, and when the event information arrives without requiring any interpretation work, Can understand secondary and tertiary meanings of information. Therefore, from the on-site level to the business management level, not only the arrival time lag of event information but also the understanding time lag of event information can be eliminated.

However, especially in the initial stage of starting up the information collection system, it is not easy to define the types of supplementary information to be added to the field data in the model without any deficiencies. Therefore, in many cases, observation of moving image data output from the surveillance camera is used together. This is because useful information not yet contained in the event information may exist in the moving image data.

The user displays both event information and moving image data on the viewing terminal, pays attention to the event information, pays attention to the moving image data, goes back and forth between both data, and changes the event information of interest. By changing the moving image data to be noticed, he was trying to obtain useful information.

JP 2012-23496 A

Video data is bulky data that not only records useful information that reinforces the content of event information, but also records a large amount of unnecessary information. Moreover, the existence of useful information is only possible, it is unknown where it exists in the field of view, it is unknown where it exists in the time series, and there is no clear distinction from other unnecessary information They are scattered all together.

Therefore, the observer had no choice but to observe each time of the video indicated by the moving image data. Even if useful information can be detected by observation, in order to confirm the useful information, the user must manually return the video to the desired position repeatedly until a cue point can be provided at the desired position. However, this troublesome work is also one of the causes for reducing the opportunity for the user to notice useful information.

An object of the present invention is to provide a playback device that supports detection of useful information from time-series data such as moving image data by a user in order to solve the above-described problems of the prior art.

In order to achieve the above object, a playback device according to the present invention plays back time-series data having a time stamp, and includes a first acquisition unit that acquires event information having occurrence time information, A display unit that reproduces a predetermined time range including a time indicated by a time stamp that is the same as or closest to the occurrence time information of the event information acquired by the first acquisition unit among the time-series data, Features.

The apparatus further comprises a second acquisition unit that acquires one or more other event information related to the event information acquired by the first acquisition unit, and the display unit includes the second of the time-series data. The acquisition unit may sequentially jump to a predetermined time range including each time indicated by the time stamp that is the same as or closest to the occurrence time information of the event information acquired by the acquisition unit and reproduce the event information.

The display unit may perform jump playback to a predetermined time range including the time when the event information is generated during playback of the time series data, and return to playback of the latest time when the jump playback ends.

During the reproduction of the time series data, the display unit performs a jump reproduction to a predetermined time range including a time when the event information is generated, and when the jump reproduction is completed, the display unit reproduces the time of reproduction immediately before the jump reproduction or the time You may make it return to reproduction | regeneration before and after.

The display unit may combine and display the acquired event information on the time-series data image.

The event information includes supplementary information of various contents, and the second acquisition unit is the same as the one or more supplementary information included in the event information acquired by the first acquisition unit. The event information having the following may be acquired.

The supplementary information may include event type information indicating the type of event.

The database may further include a database associating a plurality of the event information, and the second acquisition unit may acquire the event information associated with the event information acquired by the first acquisition unit in the database. Good.

The time series data may be moving image data, flow line trajectory data, or audio data.

The predetermined time range may start from a time indicated by a time stamp that is the same as or closest to the occurrence time information of the event information.

The predetermined time range starts at a past time than the time indicated by the same or closest time stamp as the occurrence time information of the event information, and the time indicated by the same or closest time stamp as the occurrence time information of the event information Alternatively, the future time may be terminated.

The predetermined time range may include only a time indicated by a time stamp that is the same as or closest to the occurrence time information of the event information, and the display unit may statically display the time-series data.

Among the time-series data, a generation unit that extracts time-series data in a predetermined time range including a time indicated by a time stamp that is the same as or closest to the occurrence time information of the event information acquired by the first acquisition unit, A storage unit that stores time-series data extracted by the data generation unit, and the display unit may display the time-series data stored in the storage unit.

The first acquisition unit acquires a plurality of the event information, and the generation unit is the same as the occurrence time information of the event information acquired by the first acquisition unit among the time-series data, or most You may make it extract the time series data of the continuous predetermined time range including all the time which a near time stamp shows.

The generation unit includes all times indicated by a time stamp that is the same as or closest to the occurrence time information of the event information acquired by the first acquisition unit and the second acquisition unit in the time-series data. Alternatively, time-series data in a continuous predetermined time range may be extracted.

The data processing unit further includes an operation unit that receives a user operation, and the data generation unit further generates association data that associates the extracted time-series data with the event information acquired by the first acquisition unit, and the storage unit The association data may be further stored, and the display unit may display time series data associated with the event information selected by the user using the operation unit and the association data.

According to the present invention, since the time range including the time when the event information occurs can be easily reproduced, the time range in which the time series data should be observed can be narrowed down, and the time series can be displayed to the user without requiring a complicated operation. Useful information can be noticed from data.

It is a schematic diagram which shows the installation environment of a reproducing | regenerating apparatus. It is a block diagram which shows the structure of the reproducing | regenerating apparatus concerning 1st Embodiment. It is the first half of the flowchart which shows the operation | movement of jump reproduction | regeneration by the reproducing | regenerating apparatus concerning 1st Embodiment. It is the latter half of the flowchart which shows the operation | movement of jump reproduction | regeneration by the reproducing | regenerating apparatus concerning 1st Embodiment. It is a schematic diagram which shows the display screen of a reproducing | regenerating apparatus, and shows the jump reproduction | regeneration event in real time reproduction | regeneration. It is a transition diagram which shows reproduction | regeneration of the moving image data which concerns on 1st Embodiment. It is a transition diagram showing reproduction of video data concerning a modification of a 1st embodiment. It is a transition diagram showing reproduction of video data concerning a modification of a 1st embodiment. It is a schematic diagram which shows the data structure of event information. It is a block diagram which shows the structure of the reproducing | regenerating apparatus concerning 2nd Embodiment. It is a flowchart which shows the operation example of the jump reproduction | regeneration by the reproducing | regenerating apparatus concerning 2nd Embodiment. It is a flowchart which shows the other operation example of the jump reproduction | regeneration by the reproducing | regenerating apparatus concerning 2nd Embodiment. It is a transition diagram which shows reproduction | regeneration of the moving image data which concerns on 2nd Embodiment. FIG. 10 is a block diagram illustrating a configuration of a playback device according to Modification Example 4. It is a schematic diagram which shows the database which concerns on the modification 4. It is a schematic diagram which shows the display screen of the reproducing | regenerating apparatus 1 which concerns on the modification 5, and shows the jump reproduction | regeneration event in real time reproduction | regeneration. It is a block diagram which shows the structure of the reproducing | regenerating apparatus concerning 3rd Embodiment. 10 is a flowchart illustrating a composite display operation by the playback apparatus according to the third embodiment. It is a schematic diagram which shows the display screen of the synthesis table by the reproducing | regenerating apparatus which concerns on 3rd Embodiment, and shows during real-time reproduction | regeneration. It is a block diagram which shows the structure of the reproducing | regenerating apparatus concerning 4th Embodiment. 14 is a flowchart illustrating a moving image data creation operation of the playback apparatus according to the fourth embodiment. It is a flowchart which shows the reproduction | regeneration operation | movement of the moving image data of the reproducing | regenerating apparatus which concerns on 4th Embodiment. FIG. 10 is a schematic diagram of moving image data generated by a playback device according to Modification 6. 16 is a flowchart showing a moving image data generation operation of a playback apparatus according to Modification 6.

(First embodiment)
(Constitution)
Hereinafter, a first embodiment of a playback apparatus according to the present invention will be described in detail with reference to the drawings. FIG. 1 is a schematic diagram showing an installation environment of the playback apparatus 1. A playback apparatus 1 shown in FIG. 1 is connected to a network 100 in which moving image data 200 and event information 300 are generated. The playback apparatus 1 determines the playback start frame of the moving image data 200 using the occurrence date and time of the event information 300, and plays back the moving image data 200 on the network 100.

The moving image data 200 is distributed in real time starting from the surveillance camera being photographed. The moving image data 200 is passed through an encoder in the network 100, and each frame data is given a time stamp. The time stamp directly or indirectly indicates the occurrence date and time of each frame data. The event information 300 is error information, status information, or the like, and is a measurement or observation result output from the measurement or observation equipment. In addition to the measurement or observation result, at least occurrence time information is added to the event information 300.

FIG. 2 is a block diagram showing the configuration of the playback device 1. The playback device 1 is a so-called computer having a communication interface with the network 100 and a man-machine input / output interface, and is, for example, a desktop computer, a laptop computer, a smartphone, or a tablet terminal. The playback apparatus 1 includes a playback processing unit 11, a display unit 12, an operation unit 13, and a playback control unit 14.

The reproduction processing unit 11 is a so-called graphic engine, and includes an arithmetic control device such as a CPU and a GPU and a frame memory. The reproduction processing unit 11 decodes the moving image data 200, generates frame data in chronological order, and sequentially updates the frame memory read by the display unit 12, such as VRAM or RAMDAC, with newly generated frame data. The reproduction processing unit 11 displays moving image data in an overlay display in a reproduction area defined on the display screen.

The display unit 12 is a screen that visualizes the frame data in the frame memory, and is a liquid crystal display, an organic EL display, or the like. The display unit 12 reads frame data from the frame memory at a predetermined fresh rate and sequentially visualizes the frame data. The operation unit 13 is an input interface that receives a user operation, and is a keyboard, a mouse, a touch panel, a microphone, or a camera. The operation unit 13 is used for selecting event information 300 by the user during reproduction of the moving image data 200.

The reproduction control unit 14 mainly includes a CPU, and instructs the reproduction processing unit 11 to change the reproduction position within the time range in which the moving image data 200 is captured. The playback control unit 14 temporarily inserts jump playback during real-time playback of the moving image data 200 in response to a user operation. In addition, playback or cue playback may be controlled from an arbitrary selection point by the user.

In real-time playback, the playback control unit 14 plays back the latest frame data of the moving image data 200 generated by the surveillance camera. In jump reproduction, the reproduction control unit 14 temporarily reproduces a predetermined time range including the generation time of the event information 300 selected by the user using the operation unit 13 during reproduction of the moving image data 200. When the reproduction within the predetermined time range is completed, the reproduction control unit 14 returns to the reproduction of the latest frame data in the moving image data 200. If it is real-time reproduction, the reproduction control unit 14 returns to real-time reproduction of the latest frame data.

The predetermined time range is, for example, 3 seconds, but can be changed by the user using the operation unit 13. What is necessary is just to change the value of the parameter which shows a predetermined time range. Further, the predetermined time range may be a range starting from the occurrence time of the event information 300 or a range including around the occurrence time of the event information 300. The position of the predetermined time range starting from the occurrence time of the event information 300 can be changed by the user using the operation unit 13. For example, the parameter value is added to or subtracted from the occurrence time of the event information 300 to determine the start of a predetermined time range, the parameter value may be changed, and if the parameter value is set to zero, the event information 300 The occurrence time is the start time.

The reproduction control unit 14 includes a data collection unit 141, a screen generation unit 142, and a reproduction frame determination unit 143. The data collection unit 141 includes an input / output interface with the network 100. The data collection unit 141 receives distribution of the moving image data 200 from the network 100. Further, the data collection unit 141 collects event information 300 in the network 100.

The screen generation unit 142 includes a CPU and lays out a display screen. The display screen has a playback area for moving image data 200 and a list display area for event information 300. The screen generation unit 142 expands the contents of the event information 300 and arranges them in the list display area. When the content of the event information 300 is large, an event detail area may be provided on the display screen, and the content of the event information 300 selected by the user may be displayed in the event detail area.

The playback frame determination unit 143 includes a CPU and a man-machine input interface. The playback frame determination unit 143 determines the timing for jumping the playback position, and determines from the moving image data 200 the frame data serving as the start point of the playback position of the jump destination.

The first timing of jump playback is the occurrence of a jump occurrence event. For example, in the case of a mouse operation, the jump occurrence event is a drag and drop of the event information 300 from the list display area or the event detail area to the reproduction area. The playback frame determination unit 143 monitors the user's operation using the operation unit 13 and determines the occurrence of a jump playback event.

The second timing of jump playback is the end of jump playback. Specifically, the second timing is the end of reproduction within a predetermined time range after jump reproduction. The playback frame determination unit 143 monitors the time stamp of the frame data to be written to the frame memory after starting the jump playback, and determines whether the time stamp corresponds to the end of the predetermined time range.

The first jump destination frame data is frame data corresponding to the start of a predetermined time range for jump reproduction. The frame data corresponding to the start end is frame data to which a time stamp indicating the start end of the predetermined time range is added. When determining that the user operation is a jump playback event, the playback frame determination unit 143 extracts occurrence time information from the event information 300 selected by the user operation. The starting end of the predetermined time range is calculated from this occurrence time information.

When jump playback is performed from the occurrence time of the event information 300, the start of the predetermined time range is the time itself indicated by the occurrence time information. When jump playback is performed by going back a specific time from the occurrence time of the event information 300, the playback frame determination unit 143 subtracts the specific time stored in advance from the time indicated by the occurrence time information, so that a predetermined time range is obtained. Get the beginning.

When the start frame of the predetermined time range is acquired, the playback frame determination unit 143 searches for frame data having a time stamp at the same time as the start end of the predetermined time range. When there is no time stamp at the same time, the playback frame determination unit 143 searches for frame data having a time stamp indicating the time closest to the same time. The search result is taken over by the playback processing unit 11, and the playback processing unit 11 draws the frame data indicated by the search result in the frame memory in chronological order.

The second jump destination frame data is the latest frame data in the moving image data 200. When the playback frame determination unit 143 determines the end of jump playback, the playback frame determination unit 143 instructs the playback processing unit 11 to play back the most recently delivered frame data. The reproduction processing unit 11 draws in the frame memory in chronological order from the most recently delivered frame data.

Typically, when a jump playback event occurs, the playback device 1 shifts the processing from a routine for playing back the moving image data 200 being distributed in real time to a routine for jump playback, and determines the end of jump playback. What is necessary is just to return to the routine process of reproducing in real time.

(Operation)
An example of the operation of the reproducing apparatus 1 is shown in FIGS. 3 and 4 are flowcharts showing the jump playback operation by the playback apparatus 1. First, the data collection unit 141 receives the moving image data 200 from the network 100 (step S01), and the reproduction processing unit 11 sequentially updates the frame memory with the latest frame data of the moving image data 200 (step S02). The display unit 12 displays the latest frame in the frame memory (step S03).

When there are a plurality of types of moving image data 200 due to the presence of a plurality of surveillance cameras, the playback control unit 14 displays the camera icon or thumbnail on the display screen so that the moving image data 200 is selected. It may be.

The data collection unit 141 collects the event information 300 from the network 100 in parallel with the reproduction processing of the moving image data 200 (step S04), and the screen generation unit 142 lists the event information 300 in the list display area of the display screen. And the contents are displayed (step S05).

When the user selects the event information 300 using the operation unit 13 and performs an operation that becomes a jump playback event (step S06), the playback frame determination unit 143 extracts the occurrence time information included in the selected event information 300. (Step S07). Then, the playback frame determination unit 143 refers to the generation time information and the time stamp of the moving image data 200 to search for frame data captured at the same time or the closest time to the generation time information (step S08).

Typically, the time stamp indicates the occurrence date and time of the frame data to which it belongs. Alternatively, representative occurrence date and time information such as the top frame data is attached to the metadata of the moving image data 200, and each time stamp indicates, for example, the order in which each frame data is reproduced with reference to the representative. By adding the time indicated by the time stamp to the occurrence date / time information, it becomes the occurrence date / time information of the frame data to which the time stamp belongs.

The reproduction processing unit 11 updates the frame memory in chronological order from the corresponding frame data by the search (step S09). Therefore, the display unit 12 reproduces and displays the moving image data 200 from the time when the selected event information 300 occurs (step S10). If the frame data exists on the network 100, it is distributed through the data collection unit 141.

The playback frame determination unit 143 acquires the end time of jump playback by adding a predetermined time range to the time indicated by the occurrence time information (step S11). When jump reproduction starts, the time stamp of the frame data to be displayed next is compared with the end time of jump reproduction (step S12). When the playback frame determination unit 143 determines that the time stamp has reached the end time of jump playback (step S13), the data collection unit 141 receives the latest frame data from the moving image data 200 (step S13). S14).

The playback processing unit 11 updates the frame memory in chronological order from the latest frame data next to the frame data to which the time stamp that has reached the end time of jump playback is added (step S15). Therefore, when the jump reproduction ends (step S16), the display unit 12 returns to the real-time reproduction of the moving image data 200 (step S17).

(Function)
FIG. 5 is a schematic diagram showing a display screen according to the first application example of the playback apparatus 1, and shows a jump playback event during real-time playback. FIG. 6 is a schematic diagram showing reproduction of the moving image data 200 according to the first application example.

In this application example, a surveillance camera is installed on the production assembly line. In this production assembly line, a product is tightened by a worker with a designated tool, and a dimension measuring device determines whether the product is good or bad downstream of the tightening operation. The surveillance camera is installed with the photographing optical axis facing the tightening work place.

When the dimensions of the product are within the allowable range, the dimension measuring device generates event information 300 indicating a non-defective product and sends it to the network 100. On the other hand, if the dimension of the product is out of the allowable range, the dimension measuring instrument generates event information 300 indicating a product defect and sends it to the network 100.

As shown in FIG. 5, a list of event information 300 generated one after another from the dimension measuring instrument is displayed on the display screen. On the display screen, the moving image data 200 of the production assembly line captured by the monitoring camera is also reproduced in real time. In the moving image data 200, the worker who is performing the tightening work at the tightening work place is shown to the hand.

When the dimension measuring instrument sends out product defect event information 300 in which the code “NG” is written to the network 100, the product defect event information 300 is collected by the data collection unit 141 and displayed on the display screen. . A monitor who monitors the site using the playback device 1 monitors the moving image data 200 in real time, and if the product failure event information 300 is listed, the product failure with a code “NG” is recorded. The event information 300 is dragged and dropped onto the playback area of the moving image data 200.

As shown in FIGS. 5 and 6, the event information 300 operated by the jump playback event has occurrence time information indicating, for example, time Tn-a-4. The playback device 1 is set with parameters such that the predetermined time range is 3 seconds and jump playback is performed from the occurrence of the event information 300. Therefore, the playback apparatus 1 starts from the state where the frame data at the latest time Tn is being played back, and the frame to which the time stamp at time Tn-a-4 is added in the moving image data 200 for monitoring the tightening work place. Move to jump playback from data.

Then, the real-time playback is resumed from the frame data of the latest time Tn + 5. In the video for 3 seconds during the jump playback, a scene in which the worker holds another tool different from the designated tool is shown immediately before the event information 300 of product failure occurs. For this reason, the observer who observed the jump-played 3 second video, coupled with the recognition that the product failure event information 300 occurred, tightened the product with another tool different from the designated tool. If an abnormality occurred, the cause of the product failure was estimated.

As described above, the moving image data 200 is not only information that reinforces the contents of the event information 300 that the worker is using another tool, but also bulk data that includes a large amount of unnecessary information. . In addition, the specific information is scattered both spatially and temporally in the photographing field of view, and is unifying from other unnecessary information with no clear distinction.

However, this playback device 1 is a time when there is a high possibility that another tool is used in the playback range of the moving image data 200 based on the occurrence time information included in the event information 300 of the product defect occurrence. The user is supported to narrow the range, and the user can obtain useful information that is not included in the event information 300 without leaving the selection of the event information 300.

In addition, since the time range in which there is a high possibility that the situation in which another tool is used is reproduced in accordance with the selection of the event information 300 of product failure, the user can see the contents of the event information 300 and the other tool. The video in the time range where there is a high possibility that the situation where the user is using is projected jumps together, and the content of the event information 300 seems to contain the video.

Therefore, the information value of the event information 300 is improved for the user. Furthermore, since the user is aware of the information to be included in the event information 300, the information value of the event information 300 is also greatly improved. For example, a sensor that detects removal of a tool may be installed in the tool storage area, and the type information of the removed tool detected by the sensor may be included in the event information 300 of the dimension measuring instrument.

(effect)
As described above, the playback device 1 is a playback device that plays back the moving image data 200 having the time stamp, and includes the first acquisition unit that acquires the event information 300 having the occurrence time information, and the moving image data 200. The display unit 12 that jumps and reproduces the time zone including the time indicated by the time stamp that is the same as or closest to the occurrence time information of the event information 300 acquired by the first acquisition unit is provided.

The first acquisition unit is the playback frame determination unit 143 in the present embodiment. The playback frame determination unit 143 acquires the event information 300 selected by the jump playback event when the jump playback event occurs. In addition, when event information 300 occurs in the network 100, the event information 300 may be acquired and jump-played. That is, the data collection unit 141 that captures the event information 300 into the playback device 1 is also an example of the first acquisition unit.

Thus, the playback apparatus 1 can assist the user so that useful information can be easily extracted from the moving image data 200, and is excellent in user friendliness for a person who monitors the moving image data 200.

In addition, to the user, the contents of the event information 300 and the video in the time range where there is a high possibility that the useful information is shown jump into the event information 300, and the contents of the event information 300 appear to contain the video. Therefore, the information value of the event information 300 is improved. Furthermore, since the user is aware of the information to be included in the event information 300, the information value of the event information 300 is also greatly improved.

(Modification 1)
The moving image data 200 is an example of time-series data having a time stamp, which is a result of measurement or observation in the order of time with respect to a phenomenon that varies with time. Examples of the time series data include moving image data 200, flow line image data, electrocardiogram data, voice data, voice recorder data, and the like. The playback apparatus 1 can perform jump playback according to the selection of the event information 300 as long as the data is arranged in time series order and a time stamp is added to each data, and can be applied to time series data. is there.

The flow line trajectory image data is data plotted so as to update the presence positions of objects and people in time series within a certain range of space. The flow line trajectory image data includes map image data and a plurality of pieces of presence position information. A time stamp is added to each location information. The reproduction processing unit 11 generates frame data in which the existing position indicated by the existing position information is plotted on the map image data, and updates the frame memory.

A second application example of the playback device 1 will be described. In this application example, the nurse carries a device for notifying the location of the RFID tag or the like, and a reader for reading the nurse's identification information from the RFID tag is installed in each place in the hospital. A server that collects output from each reader generates flow line trajectory image data by adding each location information of each reader that has read identification information to map image data in a hospital that is stored in advance. .

In addition, various medical devices are installed in the hospital, and the various medical devices generate event information 300 and output it to the network 100. The event information 300 transmitted to the network 100 includes patient abnormality event information 300 indicating a patient abnormality detected by the medical device.

First of all, at the morning consultation, it was reported that the nurse did not come within the regular time even though the medical device warned the patient abnormality last night. Therefore, the monitor of the playback apparatus 1 selects the event information 300 of the patient abnormality that occurred last night from the list display area on the display screen, and executes the jump playback event operation.

The data collection unit 141 acquires the flow line locus image data from the network 100 if the flow line locus image data is not reproduced. The playback frame determination unit 143 extracts the occurrence time information from the selected patient abnormality event information 300, refers to the time stamp included in the flow line trajectory image data, and obtains the location information of the same time as the occurrence time information. Explore.

The reproduction processing unit 11 generates frame data in which the existing position indicated by the searched existing position information is plotted on the in-hospital map indicated by the hospital map image data, and stores the frame data in the frame memory. The reproduction processing unit 11 generates frame data in a predetermined time range in chronological order by re-plotting the existing position information to which the time stamp that falls within the predetermined time range exceeding the rushing rule time is added in chronological order, Update the frame memory.

Thereby, in the reproduction area, the flow line trajectory of each nurse in a predetermined time range from the time when the patient abnormality event information 300 occurs is displayed in an overlay manner. When the flow line trajectory image data is already being reproduced, jump reproduction is performed. When the flow line trajectory image data is not reproduced, the reproduction starts from the time when the event information 300 indicating that the patient is abnormal.

The monitor who observed this regeneration had a nurse in charge in a separate ward away from the medical device that warned of the patient's abnormality, and the nurse in charge immediately started rushing from the ward. I found out that it was over time. In addition, it was found that there was a shortage of nurses in the hospital when the patient abnormality event information 300 occurred. In other words, it was found that due to the shortage of nurses, the nurses in charge were required to carry out work other than those in charge, which led to delays in rushing.

As described above, the playback device 1 can assist the user so that useful information can be easily extracted from the time series data even if it is time series data other than the moving image data 200, and is user friendly to those who analyze the time series data. Excellent. In addition, since the contents of the event information 300 and the time range in which the useful information is likely to appear are jumped together, the information value of the event information 300 is improved. Furthermore, since the user is aware of the information to be included in the event information 300, the information value of the event information 300 is also greatly improved.

(Modification 2)
The time-series data such as the moving image data 200 may be generated in real time and distributed over the network, or may be stored in the network 100 after generation of shooting or the like is completed. Time series data generated in real time and distributed over the network is often used for monitoring in real time, and it is desirable to reproduce the latest frame data of the time series data after jump reproduction.

On the other hand, as to the time series data that has already been generated, as shown in FIG. 7, after the jump reproduction ends, the frame data at the time following the predetermined time range after the jump reproduction may be reproduced in time series. When playback is performed in chronological order following the predetermined time range, the playback frame determination unit 143 does not need to determine the end of the predetermined time range.

Further, as shown in FIG. 8, the time-series data that has already been generated may be played back by returning to the frame data that was played back immediately before the jump playback or just before and after the jump playback, as shown in FIG.

That is, when the jump playback is completed, the playback frame determination unit 143 returns the playback of the time series data to the time when playback was performed immediately before the jump playback. The playback frame determination unit 143 stores a time stamp of frame data played immediately before jump playback or a time stamp having a time before and after the time, and after completion of jump playback, from the frame data to which the stored time stamp is added. Let it play.

(Modification 3)
The predetermined time range can be set to, for example, zero seconds. In other words, only the time indicated by the time stamp that is the same as or closest to the occurrence time information of the event information 300 may be jump-reproduced. In this case, a still image is displayed.

When the playback frame determination unit 143 designates the jump playback destination frame data, the playback frame determination unit 143 starts measuring a predetermined time. During the time counting, the next frame data is instructed, and when the predetermined time elapses, the next frame data is instructed. As a result, after the still image is displayed for a predetermined time, the playback of the portion that was played back immediately before the real-time playback or jump playback is resumed.

(Second Embodiment)
(Constitution)
Next, the reproducing apparatus 1 according to the second embodiment will be described in detail with reference to the drawings. The same functions and configurations as those of the first embodiment and the first to third modifications are denoted by the same reference numerals, and detailed description thereof is omitted.

First, the event information 300 will be described in detail. The measurement or observation device that generates the event information 300 is, for example, a temperature sensor, a dimension measurement device, a medical device, or the like. The measurement or observation equipment monitors the operating status of various facilities and patients operating in factories, offices, etc., and outputs event information 300 when events occur in various facilities and patients. The event is a periodic status report, a predetermined condition of an internal / external situation to be monitored being fulfilled, or a predetermined condition of an internal / external situation to be monitored being fulfilled.

FIG. 9 is a schematic diagram showing the data structure of the event information 300. As shown in FIG. 9, in the event information 300, in addition to measurement or observation results and occurrence time information, event type information indicating the type of event, explanation information explaining the measurement or observation results, purpose of monitoring, equipment, and patient It is possible to add information according to the situation and property of the other supplementary information.

Specifically, in the product assembly work site, the identification information of the worker who assembled the product may be added as supplementary information to the event information indicating the quality of the product. Such supplemental information is typically added as a result of the information collection system in the network 100 reconstructing the event information 300.

The information collection system has a model after reconstruction for each event information 300 output by the measurement or observation equipment. The model lists types of supplementary information to be added to the event information 300. The information collection system refers to the model and determines the type of supplemental information.

The information collection system narrows down the group of supplementary information of the determined type from the data of various contents existing in the network 100, and uses the contents of the event information 300 as a search key to search the event information 300 Search supplementary information according to the contents of. Then, the information collection system reconstructs the event information 300 by adding the corresponding supplementary information to the event information 300 output from the measurement or observation equipment.

FIG. 10 is a block diagram showing the configuration of the playback apparatus 1. As shown in FIG. 10, the playback control unit 14 of the playback device 1 further includes a search unit 144. The search unit 144 includes a CPU, and searches for event information 300 belonging to the same category within a certain range as the event information 300 selected by the jump playback event.

When some or all of the measurement or observation results and supplementary information included in the event information 300 are the same, the event information 300 belongs to the same category within a certain range. The search unit 144 searches the event information 300 belonging to the same category within a predetermined range specified in advance or a predetermined range specified by an operation using the user operation unit 13.

For example, the event information 300 belonging to the same category within a predetermined range specified in advance is the event information 300 having the same event type information indicating the type of event added as supplementary information. The search unit 144 searches the event information 300 to which the same event type information is added using the event type information of the event information 300 selected in the jump playback event as a search key. The search destination is in the playback device 1 when the data collection unit 141 has collected the event information 300, and the network 100 when the data collection unit 141 has not collected the event information 300.

Also, the search unit 144 monitors the contents of the jump playback event. Then, using the operation unit 13 in the list display area and the event detail area, single or plural supplementary information is selected from the single event information 300, and an event playback event occurs while the selection is valid. Then, the search unit 144 searches the event information 300 to which the same supplement information is added using the selected supplement information as a search key.

In other words, if a single or a plurality of supplementary information is not selected from a single event information 300, the search unit 144 searches the event information 300 to which the same supplement information is added using the event type information as a search key. To do.

The playback frame determination unit 143 handles the event information 300 selected by the jump playback event and the event information 300 searched by the search unit 144 in the same row. That is, each time when the corresponding event information 300 is generated by selection and search is sequentially jump-reproduced. The timing of each jump playback is the end of a predetermined time range during jump playback. When the previous jump playback ends, the next jump playback is performed.

The jump playback order may be the order of occurrence of the selected event information 300 in the order corresponding to the search or the ascending or descending order of the searched event information 300.

(Operation)
An example of the operation of such a playback apparatus 1 is shown in FIG. FIG. 11 is a flowchart showing the jump playback operation by the playback apparatus 1. When the moving image data 200 is being reproduced (step S21), when the user selects the event information 300 using the operation unit 13 and performs an operation that becomes a jump reproduction event (step S22), the search unit 144 selects the selected event. Event type information included in the information 300 is extracted (step S23).

The search unit 144 searches the other event information 300 using the extracted event type information as a search key (step S24). When other event information 300 has been collected, the search destination is within the playback device 1, and when other event information 300 has not been collected or is being collected, the search destination is the network 100.

The playback frame determination unit 143 extracts each occurrence time information included in the corresponding event information 300 by selection and search (step S25). Then, the playback frame determination unit 143 refers to the occurrence time information and the time stamp of the moving image data 200, and searches each frame data captured at the same time or the closest time to each occurrence time information (step S26).

Then, the playback processing unit 11 starts jump playback from the Nth jump playback order of the frame data corresponding to the search (step S27). Initially, N is initialized and N = 1. The playback frame determination unit 143 acquires the end time of the current jump playback (step S28). The jump reproduction order may be ascending order or descending order based on the occurrence time of the corresponding frame data by the search. Initially, the frame data at the same time as the event information 300 selected by the user is desirable.

When jump playback starts, the playback frame determination unit 143 compares the time stamp of the next frame data to be displayed with the end time of jump playback (step S29). When the playback frame determining unit 143 determines that the time stamp has reached the end time of jump playback (step S30, Yes), the playback frame determining unit 143 increments the jump playback order N by 1 (step S31). Then, it is determined whether or not the jump reproduction order N exceeds the added value of the number of selections and the number of hits (step S32).

If the jump reproduction number N does not exceed the comparison value (step S32, No), the reproduction processing unit 11 proceeds to jump reproduction of the Nth frame data in the next jump reproduction order (step S27). If the jump reproduction number N exceeds the added value of the selection number and the number of hits (step S32, Yes), the jump reproduction is terminated (step S33).

FIG. 12 shows another example of the operation of such a playback apparatus 1. FIG. 12 is a flowchart showing the jump playback operation by the playback apparatus 1. During reproduction of the moving image data 200 (step S41), the user selects the event information 300 using the operation unit 13 (step S42), and further selects one or more supplemental information from the selected event information 300 (step S43). ) When an operation that becomes a jump reproduction event is performed (step S44), the search unit 144 extracts supplementary information selected by the user from the selected event information 300 (step S45). The search unit 144 searches the other event information 300 using the extracted supplementary information as a search key (step S46). When there are a plurality of supplementary information, the search method is an AND search.

The playback frame determination unit 143 extracts each occurrence time information included in the corresponding event information 300 by selection and search (step S47). Then, the playback frame determination unit 143 refers to the occurrence time information and the time stamp of the moving image data 200 to search for each frame data captured at the same time or the closest time to each occurrence time information (step S48).

Then, the playback processing unit 11 starts jump playback from the Nth jump playback order of the frame data corresponding to the search (step S49). Initially, N is initialized and N = 1. The playback frame determination unit 143 acquires the current jump playback end time (step S50). The jump reproduction order may be ascending order or descending order based on the occurrence time of the corresponding frame data by the search. Initially, the frame data at the same time as the event information 300 selected by the user is desirable.

When jump playback starts, the playback frame determination unit 143 compares the time stamp of the next frame data to be displayed with the end time of jump playback (step S51). If the playback frame determination unit 143 determines that the time stamp has reached the end time of jump playback (step S52, Yes), the playback frame determination unit 143 increments the jump playback order N by 1 (step S53). Then, it is determined whether or not the jump reproduction order N exceeds the added value of the selected number and the number of hits (step S54).

If the jump playback number N is less than or equal to the added value of the selected number and the number of hits (step S54, No), the playback processing unit 11 proceeds to jump playback of the Nth frame data in the next jump playback order (step S49). ). If the jump reproduction number N exceeds the addition value of the selection number and the number of hits (step S54, Yes), the jump reproduction is terminated (step S55).

(Function)
A third application example of the playback apparatus 1 will be described. In this application example, a monitoring camera is installed on the production assembly line. In this production assembly line, a product is tightened by a worker with a designated tool, and a dimension measuring device determines whether the product is good or bad downstream of the tightening operation. The surveillance camera is installed with the photographing optical axis facing the tightening work place.

When the dimensions of the product are within the allowable range, the dimension measuring device generates event information 300 indicating a non-defective product and sends it to the network 100. On the other hand, if the dimension of the product is out of the allowable range, the dimension measuring instrument generates event information 300 indicating a product defect and sends it to the network 100.

On the display screen, a list of event information 300 generated one after another from the dimension measuring instrument is displayed. On the display screen, the moving image data 200 of the production assembly line captured by the monitoring camera is also reproduced in real time. In the moving image data 200, the worker who is performing the tightening work at the tightening work place is shown to the hand.

When the dimension measuring instrument sends the product defect event information 300 to the network 100, the product defect event information 300 is collected by the data collection unit 141 and displayed on the display screen. The monitoring person who monitors the site using the playback apparatus 1 monitors the moving image data 200 in real time, and when the product defect event information 300 is listed, the product defect event information 300 is reproduced from the moving image data 200. Drag and drop into the area.

The playback device 1 searches the event information 300 having event type information indicating product defects as well as the dragged and dropped event information 300. Then, as shown in FIG. 13, the generation time Tn-a-4 of the selected event information 300 and the generation times Tn-b-4 and Tn-c-3 of all the event information 300 corresponding to the search are included. Each predetermined time range is jump-played in order. In all jump-played images, a specific worker is holding another tool different from the designated tool. For this reason, the monitoring person estimated that a dimensional abnormality occurred due to the lack of skill of the specific worker and / or the use of another tool.

Therefore, the monitor includes supplementary information for identifying the specific worker who has caused the product failure by the assembly worker of the product, and supplementary information for identifying the worker from the event information 300 indicating that the product is a non-defective product. While selecting, the event information 300 was dragged and dropped to the reproduction area.

Then, in all the jump-played images, this specific worker was common in that he used the specified tool. For this reason, the supervisor was convinced that the dimensional abnormality was caused by the use of another tool, not the lack of skills of the specific worker, and thorough use of the dedicated tool.

(effect)
As described above, the playback device 1 further includes a second acquisition unit that acquires one or a plurality of other event information related to the event information 300 acquired by the first acquisition unit. The time information including the time indicated by the time stamp that is the same as or closest to the occurrence time information of the other event information 300 acquired by the second acquisition unit is sequentially jumped and reproduced. In the present embodiment, the search unit 144 corresponds to a second acquisition unit.

As a result, the playback apparatus 1 also searches the event information 300 belonging to the same category within a certain range as the selected event information 300, and sequentially jumps and reproduces a predetermined time range including the same time as the event information 300 belonging to the same category. To do. Therefore, information that is difficult to narrow down by the selected event information 300 is clearly revealed, and the chances of the user's awareness are dramatically increased.

(Modification 4)
FIG. 14 is a block diagram showing the configuration of the playback apparatus 1 according to this modification. As shown in FIG. 14, the playback device 1 includes a database 16. The database 16 may be included in a computer including the display unit 12 or may be included in a computer different from the computer including the display unit 12. Another computer is a component of the information collection system, for example, and may be installed in the network 100.

The database 16 is mainly configured to include an external storage device such as an HDD, and stores association of event information 300 in the network 100 as shown in FIG. The association links, for example, each event information 300 generated in each manufacturing process of the same product. Further, the association is associated with each event information 300 generated in a predetermined range such as in the same facility or the same factory.

The search unit 144 refers to the database 16 and searches the event information 300 associated with the event information 300 selected in the jump playback event. The playback frame determination unit 143 treats the event information 300 selected by the jump playback event and the event information 300 acquired by the search unit 144 referring to the database 16 in the same row, and sequentially jumps each time when the event information 300 occurs. Reproduce.

(Modification 5)
FIG. 16 is a schematic diagram showing a display screen of the playback apparatus 1 according to the modified example 5, and shows a jump playback event during real-time playback. The event information 300 selected by the user at the time of the jump playback event is not limited to one, and the user can select a plurality of pieces of event information.

The playback frame determination unit 143 extracts occurrence time information from all selected event information 300. Then, the reproduction processing unit 11 sequentially performs jump reproduction within a predetermined time range from the frame data to which the same or closest time stamp as each occurrence time information is added. In this modified example, since the playback frame determination unit 143 as the first acquisition unit acquires a plurality of event information 300 and the display unit 12 sequentially performs jump playback, the search unit 144 is not essential.

(Third embodiment)
(Constitution)
Next, the reproducing apparatus 1 according to the third embodiment will be described in detail with reference to the drawings. The same functions and configurations as those of the first and second embodiments and modifications 1 to 5 are denoted by the same reference numerals, and detailed description thereof is omitted.

FIG. 17 is a block diagram showing the configuration of the playback device 1. The playback device 1 further includes a synthesis unit 15. The combining unit 15 includes a CPU. The synthesizer 15 superimposes and displays the event information 300 on the video of the moving image data 200 during jump playback.

That is, the synthesizing unit 15 writes the content of the event information 300 selected by the jump playback event in the frame memory. The timing of writing is during reproduction within a predetermined time range including the same or the closest time as the event information 300. Further, the synthesis unit 15 writes the content of the event information 300 belonging to the same category within a certain range as the event information 300 selected in the jump playback event in the frame. This writing timing is during reproduction within a predetermined time range including the same or closest time as the event information 300 belonging to the same category within a certain range.

(Operation)
An example of the operation of the playback apparatus 1 is shown in FIG. FIG. 18 is a flowchart showing the composite display operation by the playback apparatus 1. When the moving image data 200 is being played back (step S71), when the user selects the event information 300 using the operation unit 13 and performs an operation that becomes a jump playback event (step S72), the search unit 144 selects the selected event. The event information 300 related to the information 300 is searched (step S73).

The reproduction processing unit 11 performs jump reproduction of the video in the same time zone as the corresponding event information 300 by the selection and search (step S74). The synthesizing unit 15 synthesizes and displays the event information 300 that occurs in the same time zone as the video on the video being jump-reproduced and is selected and searched (step S75).

(Function and effect)
FIG. 19 is a schematic diagram showing a display screen of the playback apparatus 1 and shows during jump playback. As shown in FIG. 19, in the video that is being jump-played, the occurrence time information included in the time range to be jump-played at the right end is displayed, and the contents of the corresponding event information 300 are displayed in an overlay by selection and search. The

In particular, when a plurality of jump reproductions are performed in order, if there is a composite display of the event information 300, it becomes easy for the monitor to recognize which event information 300 is generated at the timing. Note that the synthesis unit 15 may display the event information 300 not in the playback area of the moving image data 200 but in another area, for example, a detailed display area.

(Fourth embodiment)
(Constitution)
Next, a reproducing apparatus 1 according to the fourth embodiment will be described in detail with reference to the drawings. The same functions and configurations as those of the first to third embodiments and modifications 1 to 5 are denoted by the same reference numerals, and detailed description thereof is omitted.

The jump playback event has a property as a trigger for providing a moving image in a predetermined time range requested by the user at a timing requested by the user. On the other hand, even if there is no request from the user, a moving image in a predetermined time range including the time when the event information 300 is generated may be prepared in advance. FIG. 20 is a block diagram showing the configuration of the playback apparatus 1. The playback device 1 further includes a playback candidate generation unit 17 and a moving image storage unit 18. The reproduction candidate generation unit 17 mainly includes a CPU. The moving image storage unit 18 includes an external storage device such as an HDD.

The reproduction candidate generation unit 17 trims the moving image data 201 in a predetermined time range including the occurrence time of the event information 300 from the moving image data 200 and stores the trimmed moving image data 201 in the moving image storage unit 18. On the other hand, the reproduction candidate generation unit 17 trims the moving image data 201 and then deletes the original moving image data 200 from the storage area of the reproducing apparatus 1 or the network 100.

When the event information 300 is generated regardless of the selection by the user, the reproduction candidate generation unit 17 trims the moving image data 201 for all the event information 300 that has occurred. Note that the moving image data 201 may be trimmed using only the event information 300 having specific event type information. For example, if the time range for jump reproduction is 3 seconds as in the first embodiment, the predetermined time range to be trimmed by the reproduction candidate generation unit 17 is desirably set to be long, such as about 5 minutes. This is because the original moving image data 200 is deleted, so that the range that the user wants to browse is given a margin.

Further, the reproduction candidate generation unit 17 generates association data 400 between the event information 300 used for generating the moving image data 201 and the moving image data 201 generated using the event information 300. The association data 400 is data in which the identification information of each of the moving image data 201 and the event information 300 is paired, or directory data indicating a folder in which both the moving image data 201 and the event information 300 are stored.

The screen generation unit 142 refers to the association data 400 and displays the event information 300 specified by the association data 400 in the list display area. When the event information 300 is selected from the list display area, the playback frame determination unit 143 refers to the association data 400 and identifies the moving image data 201 associated with the selected event information 300. The reproduction processing unit 11 takes over from the reproduction frame determination unit 143 and updates the frame memory in order from the first frame data of the moving image data 201 so that the specified moving image data 201 is reproduced.

FIG. 21 is a flowchart showing the generation operation of the moving image data 201 in the reproducing apparatus 1. The data collection unit 141 monitors the network 100, and when event information 300 is generated (step S81), generation of the moving image data 201 is started. In addition, the moving image data 201 may be generated periodically, or a generation button for the moving image data 201 is prepared on the display screen, and the generation of the moving image data 201 is performed by pressing this generation button. Generation may begin.

When generation of the moving image data 201 is started due to the generation of the event information 300 or the like, the reproduction candidate generation unit 17 calculates the start of the moving image data 201 corresponding to the event information 300 (step S82). The reproduction candidate generation unit 17 stores in advance time parameters from the time of the event information 300 to the beginning of the moving image data 201. The reproduction candidate generation unit 17 subtracts the time parameter until the start time from the occurrence time information of the event information 300 to derive the time when the moving image data 201 becomes the start time.

Further, the reproduction candidate generation unit 17 calculates the end of the moving image data 201 (step S83). The reproduction candidate generation unit 17 stores in advance time parameters from the time of the event information 300 to the end of the moving image data 201. The reproduction candidate generation unit 17 adds the time parameter until the end to the generation time information of the event information 300, and derives the time at which the moving image data 201 ends.

When the start and end of the moving image data 201 are calculated, the reproduction candidate generating unit 17 duplicates all the frame data from the starting frame data to the ending frame data of the moving image data 201 from the moving image data 200 (step S84), it is stored in the moving image storage unit 18 (step S85).

In addition, the reproduction candidate generation unit 17 generates association data 400 by associating the identification information of the event information 300 used for the start and end calculations of the moving image data 201 and the identification information of the moving image data 201 ( In step S86, the moving image storage unit 18 stores the information (step S87). When the generation of the moving image data 201 and the association data 400 is completed (step S88), the reproduction candidate generation unit 17 deletes the moving image data 200 from the reproduction apparatus 1 or the network 100 (step S89).

FIG. 22 is a flowchart showing the reproduction operation of the moving image data 201 in the reproduction apparatus 1. The screen generation unit 142 refers to the association data 400 in the moving image storage unit 18 (step S91), and displays the event information 300 specified by the association data 400 in the list display area (step S92).

When the user selects the event information 300 using the operation unit 13 (step S93), the playback frame determination unit 143 refers to the association data 400 of the moving image storage unit 18 (step S94) and associates with the selected event information 300. The obtained moving image data 201 is specified (step S95).

The reproduction processing unit 11 reads out the moving image data 201 specified by the reproduction frame determination unit 143 from the moving image storage unit 18 (step S96), and the display unit 12 is associated with the selected event information 300 and selected event The moving image data 201 including the information generation time is displayed (step S97).

As described above, in the playback device 1, when the first acquisition unit taking the playback candidate generation unit 17 as an example acquires the event information 300, the playback candidate generation unit 17 acquires the event information acquired from the moving image data 200. The moving image data 201 in a predetermined time range including the time indicated by the time stamp that is the same as or closest to the occurrence time information of 300 is extracted, and the extracted moving image data 201 is stored in the moving image storage unit 18. Then, the display unit 12 displays the moving image data 201 stored in the moving image storage unit 18 in accordance with a user operation.

As a result, in the moving image data 200, only valuable information that contributes to operations such as operation management, product quality management, and business management can be stored as the moving image data 201, thereby reducing the amount of data. Contribute.

In addition, the reproduction candidate generation unit 17 further generates association data 400 that associates the extracted moving image data 201 with the acquired event information 300, and the moving image storage unit 18 further stores the association data 400. . The display unit 12 displays the moving image data 400 associated with the event information 300 selected by the user using the operation unit 13 and the association data 400.

Thereby, the event information 300 and the moving image data 201 are integrated through the association data 400, and the event information 300 and the moving image data 201 are organically connected to synergistically improve the value of the information.

(Modification 6)
FIG. 23 is a schematic diagram of moving image data 201 generated by the playback device 1 of Modification 6 according to the fourth embodiment. In the playback apparatus 1, one piece of moving image data 201 may be created for each piece of event information 300, or one piece of event information 300 may be used for one piece of event information 300 as in the playback apparatus 1 according to the modified example 6. The moving image data 201 may be generated.

That is, as shown in FIG. 23, the reproduction candidate generating unit 17 trims one moving image data 201 in a time range including all occurrence times of the plurality of event information 300. In the association data 400, all the identification information of the event information 300 and the identification information of one moving image data 201 are associated with each other.

The plurality of event information 300 may be a group selected by the user, a group generated before the generation timing of the moving image data 201, or the event information 300 belonging to the same category as the event information 300 selected by the user within a certain range. Any of the group which combined.

The reproduction candidate generation unit 17 stores in advance time parameters from the most recent occurrence time to the start of the moving image data 201 among these event information 300. The reproduction candidate generation unit 17 subtracts the time parameter until the start time from the occurrence time information of the event information 300 to derive the time when the moving image data 201 becomes the start time.

Also, the reproduction candidate generation unit 17 stores in advance time parameters from the latest occurrence time of these event information 300 to the end of the moving image data 201. The reproduction candidate generation unit 17 adds the time parameter until the end to the latest occurrence time information, and derives the time at which the moving image data 201 ends.

FIG. 24 is a flowchart showing an example of the generation operation of the moving image data 201 of the playback apparatus 1. When the periodic generation timing of the moving image data 201 arrives (step S101), the data acquisition unit 141 collects the moving image data 200 and event information 300 existing in the network 100 (step S102).

As a method other than acquiring a plurality of event information 300 that existed at the regular generation timing of the moving image data 201, for example, the plurality of event information 300 is selected from a list display area. Also, for example, other event information 300 having supplementary information selected by the user is acquired. Further, for example, by referring to the database 16, the event information 300 selected by the user and a plurality of event information 300 related on the database 16 are acquired.

When a plurality of event information 300 are collected, the playback frame determination unit 143 acquires the event information 300 (step S103), and extracts each occurrence time information included in the event information 300 (step S104). At this time, the reproduction candidate generation unit 17 searches for the latest occurrence time information from each occurrence time information (step S105), and searches for the latest occurrence time information from each occurrence time information (step S106).

Then, the reproduction candidate generation unit 17 calculates the start time of the moving image data 201 from the most recent occurrence time information (step S107). Further, the reproduction candidate generation unit 17 calculates the end of the moving image data 201 from the latest occurrence time information (step S108).

When the start and end of the moving image data 201 are calculated, the reproduction candidate generating unit 17 duplicates all the frame data from the starting frame data to the ending frame data of the moving image data 201 (step S109), and the moving image storage unit 18 (step S110).

Further, the reproduction candidate generation unit 17 associates all the identification information of the plurality of event information 300 with the identification information of the moving image data 201 to generate association data 400 (step S111) and stores it in the moving image storage unit 18. (Step S112). When the generation of the moving image data 201 and the association data 400 is completed (step S113), the reproduction candidate generation unit 17 deletes the moving image data 200 from the reproduction apparatus 1 or the network 100 (step S114).

As described above, in the playback apparatus 1, the first acquisition unit taking the playback frame determination unit 143 as an example acquires a plurality of event information 300, and the playback candidate generation unit 17 includes these events in the moving image data 200. The moving image data 201 including all occurrence times of the information 300 is extracted, and the extracted moving image data 201 is stored in the moving image storage unit 18.

Alternatively, when the first acquisition unit taking the reproduction frame determination unit 143 as an example and the second acquisition unit taking the search unit 144 as an example acquire the event information 300, the reproduction candidate generation unit 17 causes the moving image data 200 to be stored. Among them, the moving image data 201 including all occurrence times of the event information 300 is extracted, and the extracted moving image data 201 is stored in the moving image storage unit 18.

This contributes to a reduction in the amount of data, and each event information 300 and one moving image data 201 are organically connected to synergistically improve the value of the information.

1 playback device 11 playback processing unit 12 display unit 13 operation unit 14 playback control unit 141 data collection unit 142 screen generation unit 143 playback frame determination unit 144 search unit 15 combination unit 16 database 17 playback candidate generation unit 18 video storage unit 100 network 200 Moving image data 201 moving image data 300 event information 400 association data

Claims (16)

1. A playback device for playing back time-series data having a time stamp,
   A first acquisition unit for acquiring event information having occurrence time information;
   A display unit that reproduces a predetermined time range including a time indicated by a time stamp that is the same as or closest to the occurrence time information of the event information acquired by the first acquisition unit among the time-series data;
   Providing
   A reproducing apparatus characterized by the above.
2. A second acquisition unit that acquires one or more other event information related to the event information acquired by the first acquisition unit;
   The display unit
   Among the time-series data, sequentially jumping to a predetermined time range including each time indicated by the time stamp that is the same as or closest to the occurrence time information of the event information acquired by the second acquisition unit, and playing it back,
   The reproducing apparatus according to claim 1.
3. The display unit
   During playback of the time series data, jump playback to a predetermined time range including the time when the event information occurred,
   When the jump playback ends, return to the playback at the latest time,
   The reproducing apparatus according to claim 1 or 2, characterized by the above-mentioned.
4. The display unit
   During playback of the time series data, jump playback to a predetermined time range including the time when the event information occurred,
   When the jump playback ends, return to the playback time before or after the jump playback, or the playback before and after the time.
   The reproducing apparatus according to claim 1 or 2, characterized by the above-mentioned.
5. The display unit
   Combining and displaying the acquired event information on the image of the time-series data;
   The playback apparatus according to claim 1, wherein:
6. The event information includes supplementary information of various contents,
   The second acquisition unit acquires the event information having the same supplement information as one or more supplemental information included in the event information acquired by the first acquisition unit;
   The reproducing apparatus according to claim 2.
7. The supplementary information includes event type information indicating an event type,
   The playback apparatus according to claim 6.
8. A database for associating a plurality of the event information;
   The second acquisition unit acquires the event information associated with the event information acquired by the first acquisition unit in the database;
   The reproducing apparatus according to claim 2.
9. The time-series data is moving image data, flow line trajectory data or audio data;
   The playback apparatus according to claim 1, wherein:
10. The predetermined time range starts from a time indicated by the same or closest time stamp as the occurrence time information of the event information,
    The playback apparatus according to claim 1, wherein
11. The predetermined time range starts at a past time than the time indicated by the same or closest time stamp as the occurrence time information of the event information, and the time indicated by the same or closest time stamp as the occurrence time information of the event information Rather than ending with a future time,
    The playback apparatus according to claim 1, wherein
12. The predetermined time range includes only the time indicated by the same or closest time stamp as the occurrence time information of the event information,
    The display unit statically displays the time-series data;
    The playback apparatus according to claim 1, wherein
13. Among the time series data, a generation unit that extracts time series data in a predetermined time range including a time indicated by the same or closest time stamp as the occurrence time information of the event information acquired by the first acquisition unit;
    A storage unit for storing time-series data extracted by the data generation unit;
    Further comprising
    The display unit displays time-series data stored in the storage unit;
    The reproducing apparatus according to claim 1.
14. The first acquisition unit acquires a plurality of the event information,
    The generation unit includes, in the time series data, a continuous predetermined time range including all the times indicated by the same or closest time stamp as the occurrence time information of the event information acquired by the first acquisition unit. Extracting time series data,
    The playback apparatus according to claim 13.
15. The generation unit includes all times indicated by a time stamp that is the same as or closest to the occurrence time information of the event information acquired by the first acquisition unit and the second acquisition unit in the time-series data. Extracting time-series data for a continuous time range,
    The reproducing apparatus according to claim 2.
16. It further includes an operation unit that receives a user operation,
    The data generation unit further generates association data associating the extracted time series data with the event information acquired by the first acquisition unit,
    The storage unit further stores the association data,
    The display unit displays time-series data associated with the event information and the association data selected by the user using the operation unit;
    The playback apparatus according to claim 13, wherein

Images