JP5451017B2 - Moving picture recording / reproducing apparatus and moving picture management apparatus - Google Patents

Description

The present invention relates to a technique suitably applied to a moving image recording / playback apparatus and a moving image management apparatus.
More specifically, the present invention relates to a technique for managing a moving image that records the progress of training taken in a clinical training facility.

  It is well known that medical technology has been remarkably advanced and its technical content has become sophisticated. However, unfortunately, medical accidents tend to increase.

  Human resources engaged in the medical industry, especially in the medical field, have been in a chronic shortage of human resources over the past few years, and securing and educating human resources have become extremely important issues.

  The applicant has established a clinical training facility and promoted its use for medical professionals with the aim of getting those involved in the medical field to get used to the field as soon as possible and reducing medical accidents. Yes.

  Clinical training facilities have installed facilities that imitate hospitals in open spaces. A human body model for simulation training lies on the bed, and training such as heart massage, infusion administration, and oxygen inhalation is possible.

  A CCD camera for taking a moving image is provided on the ceiling of the bed. After completing a series of training, the video is played back in the conference room as a reflection meeting, and the trainees think about what points should be taken care of in the actual site.

JP 2008-148071 A

  As the number of trainees increases, the time that can be played back is limited. It is necessary to be able to cue in an instant so that it can be played back as efficiently as possible and focused on points to be careful.

  In addition, if a moving image that captures the state of training is accumulated, it is possible to grasp the tendency of the possibility of an accident that occurs in training with the same content. There are cases where an accident actually occurs or a medical worker notices just before reaching an accident even if the accident does not occur. In the medical industry etc., such cases are called “near-miss” because of the words “when near-miss” or “when you notice”, and this applicant will “not eliminate near-miss” to medical professionals. We are promoting enlightenment activities.

  In other words, when moving images obtained by taking a picture of the state of training are accumulated, it is possible to accumulate the moment of this “near-miss”. However, for that purpose, conventionally, a laborious work of editing a moving image has been required.

  The present invention has been made in view of the above points, and is a moving image recording / reproducing apparatus that realizes efficient cueing of captured moving images, and moving image management that realizes efficient cueing and management of moving images. An object is to provide an apparatus.

In order to solve the above problems, a moving image recording / reproducing apparatus of the present invention includes a camera that generates moving image data, a barcode reader that acquires a trainee ID for identifying each trainee who is shooting with the camera, A moving image file is generated by encoding moving image data, and a tag file including information in which time information corresponding to each frame of the moving image file is associated with a trainee ID is generated, and the moving image file and the tag file are nonvolatile. A recording processing unit for recording on the sex recording medium, a display unit for displaying the trainee ID included in the tag file, and an operation unit for outputting operation information. Then, when an arbitrary trainee ID is selected from the operator ID displayed on the display unit based on operation information output by the operation unit, the reproduction processing unit tags time information corresponding to the selected trainer ID. The moving image file is read out from the file, the moving image file is cued and decoded based on the read time information, and the moving image is displayed on the display unit. At the same time, when a comment is input from the operation unit during playback of the moving image, the playback processing unit adds the comment and the playback time of the moving image when the comment is input from the operation unit to the tag file as time information. The tag file is updated, and a screen in which a list in which a moving image and a plurality of comments are listed in the order of the number of duplicates based on the updated tag file is combined is displayed on the display unit.

  According to the above configuration, the moving image can be reproduced from the beginning of the time in which the trainee corresponding to the selected trainee ID is shown only by selecting the trainee ID displayed on the display unit using the operation unit. .

Furthermore, in order to solve the above problem, the moving image management apparatus of the present invention includes an encoded moving image file, time information corresponding to each frame of the moving image file, and identification information indicating a scene corresponding to the time information. A non-volatile recording medium in which a tag file is recorded, a display unit that displays a moving image related to the moving image file, and an operation unit that inputs a comment during reproduction of the moving image displayed on the display unit. Then, the playback processing unit updates the tag file by adding the comment and the playback time of the moving image when the comment is input from the operation unit as time information to the tag file, and based on the updated tag file, A screen is displayed on the display unit, which is a composite of a list of the comments listed in order of the number of duplicates .

  According to the above configuration, the comment can be displayed on the display unit when the next comment is input, when the next rotation image is reproduced, by simply inputting the comment in real time during the reproduction of the moving image. .

  According to the present invention, it is possible to provide a moving image recording / reproducing device that realizes efficient cueing of a captured moving image and a moving image management device that realizes efficient cueing and management of a moving image.

  Hereinafter, embodiments of the present invention will be described with reference to FIGS.

[1. Configuration of moving image recording / playback apparatus]
FIG. 1 is a functional block diagram of a moving image recording / playback apparatus 101 as an example of an embodiment of the present invention.
The moving image recording / playback apparatus 101 has an interface such as a USB (Universal Serial Bus), a CCD (Charge Coupled Devices) camera, and a barcode reader 103 on a personal computer on which a moving picture recording program, a moving picture playback program, and a web browser are installed. It is connected with.

  The CCD camera 102 and the barcode reader 103 are electrically connected to the recording processing unit 104 of the personal computer, and the moving image data acquired from the CCD camera 102 and the information acquired from the barcode reader 103 are sent to the recording processing unit 104. Supplied. Information acquired from the barcode reader 103 (hereinafter referred to as “trainee ID”) is information for identifying the trainee who is photographed by the CCD camera 102.

  The recording processing unit 104 generates a moving image file 110 by encoding moving image data obtained by the CCD camera 102 including time information. At the same time, the recording processing unit 104 creates a tag file 111 including tag data that is text data in which the time information included in the moving image file 110 and the trainee ID acquired from the barcode reader 103 are associated with each other. The detailed configuration of the recording processing unit 104 will be described later with reference to FIG. A specific example of text data described in the tag file 111 will be described later with reference to FIGS.

  The file system, which is a function provided by the OS, records moving image data generated from the recording processing unit 104 as a moving image file 110 in the nonvolatile storage 105. Also, tag data generated from the recording processing unit 104 is recorded as a tag file 111 in the nonvolatile storage 105.

  The reproduction processing unit 106 reads the moving image file 110 and the tag file 111 from the file system and displays them on the display unit 107. At that time, a part of the tag file 111 is displayed on the display unit 107, and the moving image file 110 is cued by selecting and inputting from the input unit.

  In addition, the reproduction processing unit 106 temporarily stores predetermined data generated by the control unit 108 based on the user's operation on the operation unit 109, and a tag stored in the nonvolatile storage 105 based on the data. The file 111 is updated. A detailed configuration of the reproduction processing unit 106 will be described later with reference to FIG.

  The control unit 108 controls the operation of each functional block constituting the personal computer. In this example, functional blocks to be controlled by the control unit 108 are a recording processing unit 104, a nonvolatile storage 105, and a reproduction processing unit 106. The control unit 108 is electrically connected to the operation unit 109, and operates the recording processing unit 104, the nonvolatile storage 105, and the reproduction processing unit 106 based on various operations on the operation unit 109 by the user.

  The operation unit 109 is composed of a keyboard, a pointing device, and the like disposed on the personal computer, and an operation signal corresponding to the operation is input from the operation unit 109 to the control unit 108 via an interface (not shown).

[2. Configuration of recording processing unit]
FIG. 2 is a functional block diagram centering on the recording processing unit 104.
The moving image data obtained from the CCD camera 102 is temporarily stored in the frame memory 202 and then sent to the encoder 203 mainly for compression, and then converted into the moving image file 110. The moving image file is stored in the nonvolatile storage 105.

  On the other hand, a phototransistor (not shown) outputs a barcode as a light intensity signal and sends it to the barcode reader 103. The barcode reader 103 decodes the barcode and reads the content. The read barcode information is sent to the ID recording unit 204.

  The ID recording unit 204 obtains time (hereinafter referred to as “elapsed time”) corresponding to the number of frames from the start of moving image recording from a clock 206 receiving a clock supplied to the frame memory 202. The ID recording unit 204 generates a tag file 111 including information (part of the tag data described above) that associates the barcode information sent from the barcode reader 103 and the elapsed time obtained from the clock 206, and this tag file 111 Is recorded in the non-volatile storage 105.

[3. Configuration of playback processing unit and control unit]
FIG. 3 is a functional block diagram centering on the reproduction processing unit 106 and the control unit 108.
After the moving image file 110 is decoded by the decoder 302 and converted into moving image data, the moving image data is temporarily stored in the frame memory 303 and then input to the image composition unit 304.

  On the other hand, the tag data of the tag file 111 is analyzed by the tag list creation unit 305. In the tag list creation unit 305, a list of tags is formed based on the analysis result, and information related to the list of tags is input to the image composition unit 304.

  The moving image data and the tag data input to the image combining unit 304 are combined and input to the display unit 107. Then, a screen on which a list of tags represented by moving images and tag data (hereinafter referred to as “initial composite screen”) is displayed on the display unit.

  An operation unit 109 including a keyboard and a pointing device such as a mouse selects a list of tags displayed on the display unit 107. Then, the information is sent to the cue control unit 306 and instructs the decoder 302 to cue based on the designated tag.

  In addition, the operation unit 109 inputs a comment at a predetermined position on the initial composite screen displayed on the display unit 107. Then, information indicating the comment and a position where the comment is input is sent to the comment control unit 307.

  The comment control unit 307 performs control related to the update of the tag file 111 to the tag list creation unit 305. Specifically, the comment control unit 307 temporarily stores, as a temporary file 308, a comment input from the operation unit 109 and information indicating a position where the comment is input in the tag list creation unit. The comment control unit 307 adds information such as a comment to the temporary file 308 each time information such as a comment is input by the operation unit 109. When the update of the temporary file 308 by the comment control unit 307 is completed, the tag list creation unit 305 updates the tag file 111 based on the temporary file 308. Details of updating the tag file 111 will be described later with reference to FIGS.

[4. Moving image cue]
FIG. 4 is a diagram illustrating the above-described initial synthesis screen, which is a display state of the moving image displayed on the display unit 107 and the tag information of the tag file 111. However, it is assumed that the tag file 111 has not been updated by the tag list creation unit 305.

A moving image display area 403 is provided on the left side of the display area of the web browser 402.
An ID list display area 404 is provided on the right side in the display area of the web browser 402.

  The content displayed in the ID list display area 404 is the contents of the tag file 111 itself. That is, the trainee ID read by the barcode reader 103 and the elapsed time from the start of moving image recording when the barcode is read are displayed. The contents of the tag file 111 will be described later with reference to FIG.

  When an arbitrary trainee ID in the ID list display area 404 is double-clicked, the moving image is cued at the elapsed time associated with the trainee ID. For example, it is assumed that the user double-clicks the trainee ID “000123” in the area 405 included in the ID list display area 404. Then, the decoder is controlled by the cue control unit so that the moving image from the elapsed time “00:12:34” associated with the trainee ID “000123” is reproduced in the moving image display area 403. .

[5. Tag file before update]
Next, the contents of the tag file for generating the display state shown in FIG. 4 will be described with reference to FIG.
FIG. 5 is a diagram illustrating an example of a tag file before update.
This tag file 502 is the tag file 502 before update generated by the ID recording unit 204.

  The tag file 502 is composed of text data and is divided into two fields by a field separator 503. In FIG. 5, “comma” is used for the field separator 503.

  The first field from the left is a “time information” field. In this “time information” field, the elapsed time of the moving image is written.

  The second field from the left is a “trainee ID” field. In this “trainee ID” field, an identification number for identifying the trainee obtained from the barcode reader 103 is written.

[6. Generate and update temporary files]
Next, generation and update of the temporary file 308 will be described.
FIG. 6 is an enlarged view of the vicinity of the moving image display area 403 of the web browser 402 shown in FIG.
Immediately above the moving image display area 403, a comment display area 605 for inputting a comment on the moving image currently displayed on the display unit 107 is provided. The comment display area 605 is preferably provided so as not to overlap the moving image display area 403 so as not to hinder the display of the moving image.

  The user operates a mouse and a keyboard which are an example of the operation unit 109 to generate a balloon in the comment display area 605 and inputs a comment in the balloon. At this time, the user can operate the mouse or the like to attach a pointer 602 that connects the balloon and a predetermined position of the moving image. Thereby, it is possible to accurately indicate to which position in the moving image the comment input in the balloon is.

  Hereinafter, a balloon with a pointer 602 is referred to as a balloon 603 with a pointer, and a balloon without a pointer 602 is referred to as a balloon 604 without a pointer.

  Information regarding the comment, the position of the balloon, and the position of the pointer 602 is stored in the tag list creation unit 305 as a temporary file 308 that is updated for each frame of the moving image, that is, for each elapsed time. Such update of the temporary file 308 is performed by the tag list creation unit 305 based on the control of the comment control unit 307.

[7. Temporary file after update completion]
FIG. 7 is a diagram illustrating an example of a temporary file that has been updated.
The updated temporary file 702 is composed of text data, and is divided into 3 or 4 fields by a field separator 703. Information for generating a balloon 604 without a pointer is stored in a line with three fields, and information for generating a balloon 603 with a pointer is stored in a line with four fields.

  The first field from the left is a “time information” field. In this “time information” field, the elapsed time of the moving image is written.

  The second field from the left is a “comment” field. In the “comment” field, the character strings input to the balloon 603 with a pointer and the balloon 604 without a pointer are written.

  The third field from the left is a “balloon position coordinate” field. In this “balloon position coordinate” field, information regarding the positions of the balloon 603 with a pointer and the balloon 604 without a pointer is written.

  The fourth field from the left is a “pointer position coordinate” field. In this “pointer position coordinate” field, information regarding the end point of the pointer 602 extending from the balloon 603 with a pointer is written.

[8. Update tag file]
Next, tag file update performed by the tag list creation unit 305 will be described.
FIG. 8 is a diagram illustrating an example of a tag file updated by the tag list creation unit 305.

  The tag file 802 is created by adding the temporary file 702 to the pre-update tag file 502 generated by the ID recording processing unit 104 and sorting the rows in ascending order of “time information”. That is, the tag file 802 is divided into 2, 3 or 4 fields by the field separator 803.

  Each row with two fields corresponds to the tag file 502 before update. The first field from the left of each line is a “time information” field. The second field from the left is a “trainee ID” field.

  Each line having three or four fields corresponds to the temporary file 702. The first field from the left of each line is a “time information” field. The second field from the left is a “comment” field. The third field from the left is a “balloon position coordinate” field. The fourth field from the left is a “pointer position coordinate” field.

[9. Speech balloon and video composition]
Next, playback of a synthesized video using the tag file 802 and playback of a video with a comment will be described with reference to FIG.
FIG. 9 is a flowchart showing the flow of combining speech balloons and moving images.

  A moving image is reproduced, that is, the moving image file 110 is input to the display unit 107 through the decoder 302, the frame memory 303, and the image composition unit 304 (step S901). Then, the tag list creation unit 305 initializes a variable m constituting the counter to 1 (step S902).

  The tag list creation unit 305 acquires the playback time of the moving image currently displayed on the display unit 107 from the moving image file 110 via the decoder 302 and the frame memory 303 (step S903). Then, the tag list creation unit 305 reads the tag file 802 stored in the nonvolatile storage 105, and acquires time information described in the m-th line of the tag file 802 (step S904).

  After the above processing is completed, the tag list creation unit 305 confirms whether or not the current reproduction time acquired in the processing of step S903 matches the time information described in the m-th line of the tag file 802 ( Step S905). If the current playback time does not coincide with the time information described in the m-th line of the tag file 802 (NO in step S905), the process proceeds to the process in step S913 described later, returns to the process in step S903, and again returns to the current Get playback time. That is, it waits until the current playback time matches the time information described in the m-th line of the tag file 802.

  If the current playback time matches the time information described in the m-th line of the tag file 802 (YES in step S905), the tag list creation unit 305 has two or more fields in the m-th line of the tag file 802. It is confirmed whether or not there is (step S906). If the number of fields in the m-th line of the tag file 802 is less than 2, the process proceeds to step S910 described later, m is incremented, and the process waits until the number of fields in the m-th line becomes 2 or more.

  If the number of fields in the mth line of the tag file 802 is 2 or more (YES in step S906), the tag list creation unit 305 further determines whether the number of fields in the mth line of the tag file 802 is four. Confirmation is made (step S907).

  If the number of fields in the m-th line of the tag file 802 is 4 (YES in step S907), a balloon 603 with a pointer is generated based on the information written in the four fields in the m-th line of the tag file 802. (Step S908), the generated balloon with a pointer is output to the image composition unit 304. The four fields here are a “time information” field, a “comment” field, a “balloon position coordinate” field, and a “pointer position coordinate” field.

  Then, the image composition unit 304 combines the moving image data input from the frame memory 303 and the balloon with pointer 603, and the moving image represented by the moving image data and the balloon with pointer 603 are combined at a predetermined position. A screen is displayed on the display unit 107 (step S909). The moving image data here is obtained by decoding the moving image file 110 through the decoder 302 and the frame memory 303.

  After the above processing is completed, the tag list creation unit 305 increments the variable m constituting the counter (step S910).

  On the other hand, if the number of fields in the m-th line of the tag file 802 is not four (NO in step S907), a balloon is generated based on the information written in the three fields in the m-th line of the tag file 802 (step S907). In step S911, the generated balloon is output to the image composition unit 304. The three fields here are a “time information” field, a “comment” field, and a “balloon position coordinate” field.

  Then, the image synthesis unit 304 synthesizes the above-described moving image data and the balloon with pointer 603 input from the frame memory 303, and a screen in which the moving image represented by the moving image data and the balloon are synthesized at a predetermined position. Is displayed on the display unit 107 (step S912). Then, the process proceeds to step S910, and the tag list creation unit 305 increments the variable m constituting the counter.

  After the above processing is completed, the tag list creation unit 305 confirms whether or not the m-th line of the tag file 802 exists (step S913). If the m-th line of the tag file 802 exists (NO in step S913), the process returns to step S903 to repeat each process. If the m-th line of the tag file 802 does not exist (YES in step S913), the process ends (step S914).

[10. List of comments in chronological order]
As described above, in the above-described embodiment of the present invention, the time-series order comment list 1002 shown in FIG. You may make it display on a part. This chronological order comment list is the tag file 802 itself. That is, the time-series order comment list can be created from the tag file 802 by the tag list creation unit. Furthermore, the moving image may be cued by double-clicking an arbitrary trainee ID in the time-series comment list.

[11. List of comments in descending order]
Further, in the embodiment of the present invention described above, a large order comment list 1102 shown in FIG. 11 in which comments input in the speech balloon are arranged in descending order simultaneously with the reproduction of the moving image with the speech balloon is displayed on the display unit. You may make it display. This large order comment list counts duplicate lines in the “comment” field of the tag file 802, deletes duplicate lines, and sorts the lines by count. By providing the tag list creation unit with a function for performing such sort processing, the tag list creation unit can create a large order comment list based on the tag file 802.

[12. effect]
As described above, according to the present invention, the trainee ID read by the barcode reader 103 during photographing of the trainee by the CCD camera is recorded in association with the time elapsed from the start of moving image recording. Accordingly, there is an effect that the moving image can be easily cued with the trainee ID.

  In addition, by storing the character string and the moving image reproduction time in association with each other, an arbitrary character string input during the reproduction of the moving image is recorded. Therefore, when the moving image is reproduced again after the input of the character string is completed, the character string corresponding to the reproduction time can be displayed in the comment display area. This has the effect of efficiently realizing the collection of so-called “near-miss” materials.

  In addition, it is now possible to generate a chronological order comment list and a large order comment list that sort and display the assigned comments. As a result, the number of types of keywords to be given is reduced as much as possible, and it is possible to recognize at a glance that different words have been given despite having the same meaning.

  In addition, the present invention is not limited to the above-described embodiments, and various modifications and changes can be made without departing from the scope of the present invention.

It is a block diagram which shows the moving image recording device which concerns on one Embodiment of this invention. It is a block diagram centering on a recording processing part. It is a block diagram centering on a reproduction | regeneration processing part and a control part. It is a figure which shows the display state of the tag information of a moving image and a tag file. It is a figure which shows an example of the tag file before an update. It is an enlarged view near the moving image display area of a web browser. It is a figure which shows an example of the temporary file which update was completed. It is a figure which shows an example of the updated tag file. It is a flowchart which shows the flow of a synthetic | combination of a balloon and a moving image. It is a figure which shows a time series order comment list. It is a figure which shows many order comment lists.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 101 ... Moving image recording / reproducing apparatus, 102 ... CCD camera, 103 ... Bar code reader, 104 ... Recording processing part, 105 ... Nonvolatile storage, 106 ... Reproduction processing part, 107 ... Display part, 108 ... Control part, 109 ... Operation 110: moving image file, 111: tag file, 202 ... frame memory, 203 ... encoder, 204 ... ID recording unit, 205 ... clock generator, 206 ... clock, 302 ... decoder, 303 ... frame memory, 304 ... image Composition unit, 305 ... Tag list creation unit, 306 ... Cue control unit, 307 ... Comment control unit, 308 ... Temporary file, 402 ... Web browser, 403 ... Moving image display area, 404 ... ID list display area, 405 ... Area , 502 ... Tag file, 503 ... Separator, 602 ... Pointer, 603 ... Blow with pointer However, 604 ... balloon without a pointer, 702 ... temporary files, 703 ... separator, 802 ... tag file, 803 ... separator, 1002 ... chronological order comment list, 1102 ... descending order comment list

Claims (2)

A camera that generates moving image data;
A barcode reader for acquiring a trainee ID for identifying each trainee who is photographing with the camera;
The moving image data is encoded to generate a moving image file, and a tag file including information associating time information corresponding to each frame of the moving image file and the trainee ID is generated, and the moving image file and A recording processing unit for recording the tag file in a nonvolatile recording medium;
A display unit for displaying the trainee ID included in the tag file;
An operation unit for outputting operation information;
When an arbitrary trainee ID is selected based on the operation information output by the operation unit from the operator ID displayed on the display unit, the time information corresponding to the selected trainer ID is displayed. Read from the tag file, cue and decode the moving image file based on the read time information, display the moving image on the display unit, and from the operation unit during playback of the moving image When a comment is input, the comment file and the playback time of the moving image when the comment is input from the operation unit are added to the tag file as the time information to update the tag file, and the updated based on the tag file to display a screen obtained by combining an enumeration said moving image and a plurality of the comments in the order of the overlapping number on the display unit reproduction process Moving picture reproducing apparatus equipped with and. A non-volatile recording medium on which a tag file including an encoded moving image file and time information corresponding to each frame of the moving image file and identification information indicating a scene corresponding to the time information is recorded;
A display unit for displaying a moving image according to the moving image file;
An operation unit for inputting a comment during reproduction of the moving image displayed on the display unit;
The tag file is updated by adding the comment and the playback time of the moving image when the comment is input from the operation unit to the tag file as the time information, and the moving image based on the updated tag file And a reproduction processing unit that causes the display unit to display a screen in which an image and a list in which a plurality of comments are listed in order of the number of duplicates are combined.

Images