JP5521398B2 - In-vehicle video data processing apparatus, data processing system, and program - Google Patents

Description

  The present invention relates to an in-vehicle moving image data processing device, a data processing system, and a program.

  In recent years, image data has been recorded for crime prevention in various places such as taxis, convenience stores, supermarkets, and buildings. For example, Patent Document 1 discloses an in-vehicle security device that takes a photograph of a passenger's face using a mobile phone with a digital camera for crime prevention. Such image data is used for grasping the contents of an incident or identifying a criminal when an incident occurs. The recorded criminal image may be used for subsequent investigations.

  Here, Patent Document 2 discloses an apparatus that extracts a representative scene from moving image data and generates a thumbnail image of the extracted scene. This apparatus is configured to identify a representative scene of moving image data based on a change in volume level of sound recorded together with the moving image and generate a thumbnail image of the scene.

JP 2002-342860 A JP 2004-159265 A

  However, immediately after the incident occurs, for example, immediately after a police officer or guard who rushed to the incident site after hearing the incident occurrence, the recorded video data is effectively used for subsequent investigation. There was no means to use.

  Immediately after the incident occurs, the criminal may still be near the scene of the incident, and finding the image that recorded the state of the incident, that is, the image that recorded the criminal as soon as possible in 1 second, would increase the clearance rate of the criminal. Is important to raise.

  For example, a vehicle (e.g., a police vehicle) is equipped with a device that reads removable media data recorded with moving image data and displays it on a display, and reproduces and displays a moving image using the device immediately after arrival at the incident site. It is possible. However, in general, when moving image data is recorded for crime prevention purposes, recording is continued for 24 hours. In such a case, the amount of recorded moving image data is enormous, and it is troublesome and time-consuming to find an image in which the state of the incident is recorded.

  In addition, when using the device described in Patent Document 2, it is necessary to bring back the moving image data to a place where the device described in Patent Document 2 is arranged, for example, in a police station, and the time loss is large. Although means for transmitting moving image data via the Internet is conceivable, if the amount of moving image data is enormous, data transmission in a short time may not be expected.

  According to the present invention, a moving image data acquisition unit that acquires moving image data associated with audio data via time information together with the audio data, and a portion of the audio data where the audio level is greater than a reference value. An extraction unit that extracts one or more locations, an extraction location information acquisition unit that acquires extracted location information indicating the extracted location, and generates a thumbnail image of a still image frame specified by the extracted location information among the moving image data An in-vehicle moving image data processing device is provided that includes a thumbnail image generation unit that performs a display and a display unit that displays the thumbnail image.

  According to the present invention, a moving image data acquisition step of acquiring moving image data associated with audio data via time information together with the audio data, and a portion of the audio data where the audio level is greater than a reference value. An extraction step for extracting one or more locations, an extraction location information acquisition step for acquiring extracted location information indicating the extracted location, and generating a thumbnail image of a still image frame specified by the extracted location information in the moving image data There is provided a program for causing a computer to execute a thumbnail image generating step and a display step of displaying the thumbnail image.

  Since the moving image data processing apparatus of the present invention is for in-vehicle use, it is possible to quickly confirm thumbnail images at locations where the audio level in moving image data recorded at various locations is greater than a reference value. Become. In addition, if the on-vehicle video data processing device of the present invention is used for police investigation, it is considered that the sound level is higher than the normal time at the time of the incident, so from among the video data recorded a huge amount of data It is possible to quickly extract a still image frame that is likely to be a record of the incident and confirm it by a thumbnail image. As a result, it is thought to promote early resolution of incidents.

  It is possible to quickly find and use important parts in the moving image data recorded at various places, for example, parts where the state of the incident is recorded.

It is an example of the functional block diagram of the vehicle-mounted moving image data processing apparatus of Embodiment 1. 4 is an example of a display mode of thumbnail images of the in-vehicle moving image data processing device according to the first embodiment. It is a flowchart figure which shows the flow of a process of the vehicle-mounted moving image data processing apparatus of Embodiment 1. It is an example of the functional block diagram of the vehicle-mounted moving image data processing device of Embodiment 2. It is an example of a functional block diagram of a data processing system of Embodiment 2. It is an example of the display mode of the thumbnail image of the vehicle-mounted moving image data processing device of Embodiment 2. It is an example of the functional block diagram of the vehicle-mounted moving image data processing device of Embodiment 3. It is a flowchart figure which shows the flow of a process of the vehicle-mounted moving image data processing apparatus of Embodiment 3. It is an example of the functional block diagram of the vehicle-mounted moving image data processing apparatus of Embodiment 5. It is an example of the functional block diagram of the vehicle-mounted moving image data processing device of Embodiment 6. It is an example of the display aspect of the thumbnail image of the vehicle-mounted moving image data processing device of Embodiment 6.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same components are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  Each unit constituting the in-vehicle moving image data processing device of each embodiment includes a CPU, a memory, and a program loaded in the memory (in addition to a program stored in the memory from the stage of shipping the device in advance). , Removable media such as CDs, and programs downloaded from servers on the Internet), storage units such as hard disks for storing the programs, network connection interfaces, displays, etc. Realized by combination. It will be understood by those skilled in the art that there are various modifications to the implementation method and apparatus.

In addition, the functional block diagrams of FIGS. 1, 4, 5, 7, 9, and 10 used in the description of each embodiment show functional unit blocks, not hardware unit configurations. In these drawings, it is described that the in-vehicle moving image data processing device of each embodiment is realized by one physically separated device, but the realization means is not limited to this. That is, two or more physically separated devices may be connected by wire or wirelessly, and the in-vehicle moving image data processing device of each embodiment may be realized by the plurality of devices.
<< Embodiment 1 >>

  In FIG. 1, an example of the functional block diagram of the moving image data processing apparatus 1 for vehicle-mounted of this embodiment is shown. The in-vehicle moving image data processing device 1 includes a moving image data acquisition unit 10, an extraction unit 20, an extraction location information acquisition unit 30, a thumbnail image generation unit 40, and a display unit 50. In addition, you may have a moving image data storage memory.

  The in-vehicle moving image data processing device 1 according to the present embodiment is mounted on, for example, a police vehicle such as a police car or a vehicle used by a security company for business. This is the same in all the following embodiments.

  The moving image data acquisition unit 10 is configured to acquire moving image data associated with audio data via time information (hereinafter, simply referred to as “moving image data”) together with the audio data. The time information here may be, for example, data indicating elapsed time from the start of recording of moving image data and audio data as 0 (zero). Alternatively, time data indicating the date and time when the moving image data and audio data are recorded may be used.

  The moving image data acquisition unit 10 is not particularly limited as a means for acquiring moving image data. For example, the moving image data acquisition unit 10 can communicate with a recording device that stores the moving image data in an internal memory such as an HDD wirelessly or by wire. You may implement | achieve by acquiring moving image data directly. Or you may implement | achieve by reading moving image data from removable media, such as SD card, CD, DVD, BD, and USB memory connected to the vehicle-mounted moving image data processing apparatus 1. The moving image data acquired by the moving image data acquisition unit 10 corresponds to moving image data recorded for crime prevention in various places such as a taxi, a convenience store, a supermarket, and a building.

  Note that the moving image data acquired by the moving image data acquisition unit 10 may be stored in a moving image data storage memory that is a non-volatile memory provided in the in-vehicle moving image data processing device 1. And when the vehicle-mounted moving image data processing apparatus 1 executes various processes using moving image data, the moving image data acquisition unit 10 may be configured to extract moving image data to be processed from the moving image data storage memory.

  The extraction unit 20 is configured to extract one or more locations where the audio level is greater than the reference value in the audio data associated with the video data acquired by the video data acquisition unit 10. Here, the “location” corresponds to data at a certain point in audio data in which a plurality of data is recorded in time series. That is, the extraction unit 20 acquires the audio data from the video data acquisition unit 10 when the video data acquisition unit 10 acquires the audio data and the video data associated with the audio data. Then, by comparing the reference value with the sound level of the sound data recorded with a plurality of data in time series, one or more places where the sound level is greater than the reference value are extracted. The reference value is an arbitrary design item, but needs to be set to a value that can extract an important part in the moving image data, for example, a part in which the state of the incident is recorded. In other words, the in-vehicle moving image data processing device 1 according to the present embodiment extracts a portion that has a high possibility of recording the state of the incident in the sound data by extracting a portion whose sound level is higher than the reference value. To do.

  The extraction unit 20 may hold a reference value arbitrarily determined in advance and use the reference value for comparison with the audio level of the audio data, or the moving image data acquisition unit 10 may store the moving image. Each time data is acquired, an input of a reference value may be received from the user, and a comparison with the sound level of the sound data may be performed using the reference value that has been received. Alternatively, a plurality of different reference values such as taxi reference values, convenience store reference values, supermarket reference values, etc. may be held depending on the location where the moving image data is recorded. In this case, every time the moving image data acquisition unit 10 acquires moving image data, a selection input as to which reference value is used is received from the user, and the sound level of the sound data is determined using the selected reference value. You may compare with. Furthermore, a predetermined number of samples may be randomly extracted from audio data recorded with a plurality of data in time series, and an average value calculated using the extracted samples may be used as a reference value. This sample may be extracted at random from audio data within a predetermined range determined by the user. In addition, you may comprise so that these reference values can be changed according to user operation.

  Here, the extraction processing by the extraction unit 20 may be triggered by the fact that the moving image data acquisition unit 10 has acquired moving image data, or an extraction processing start instruction input from the user (eg, thumbnail image display instruction input) It may be triggered by the acceptance of. For example, when extraction processing is performed using a reference value stored in advance by the fact that the moving image data acquisition unit 10 has acquired moving image data and an extraction result that satisfies the user cannot be obtained, for example, the extraction location is When there are too many (eg, when there are too many thumbnail images displayed), the reference value is changed according to the input from the user, and the extraction process start instruction input (eg: thumbnail image display instruction input) from the user is changed. The extraction process may be performed again on the same audio data with the acceptance as a trigger.

  Note that the extraction process here needs to be performed quickly, but if there are too many extraction locations, there is a risk that inconveniences such as a reduction in processing speed may occur. In addition, as described below, the in-vehicle moving image data processing device 1 of the present embodiment is configured to generate thumbnail images corresponding to the extracted locations and display them as a list. If there is too much, naturally, the amount of thumbnail images that the user has to check increases, and there is a possibility that inconveniences such as taking too much time for the image checking work may occur. Therefore, it is desirable that the thumbnail images to be displayed have an appropriate quantity that is not too large. In other words, it is desirable that the number of portions extracted by the extraction unit 20 is an appropriate quantity that is not too large.

  Therefore, the extraction unit 20 may be configured to extract a portion where the sound level is greater than the reference value and has a maximum value in the sound data. In such extraction, in addition to the above-described comparison between the reference value and the sound level of the sound data, the sound of the sound data that is temporally related in the sound data in which a plurality of data is recorded in time series is recorded. It may be realized by comparing the levels of levels. That is, sound data whose sound level is equal to or higher than the sound level of the sound data before and after the time may be determined as the maximum value data.

  Alternatively, when the number of locations extracted by the extraction unit 20 is larger than the reference quantity stored in advance, the extraction unit 20 selects the reference quantity from the extracted locations in descending order of the sound level. You may comprise so that the location may be extracted.

  The extraction location information acquisition unit 30 is configured to acquire extraction location information indicating the location extracted by the extraction unit 20. As the extraction location information, for example, the time when recording of audio data is started is set to 0 (zero), and the elapsed time from there can be considered.

  The thumbnail image generation unit 40 is configured to generate a thumbnail image of a still image frame specified by extraction location information from the moving image data extracted from the removable media or the moving image data storage memory by the moving image data acquisition unit 10. Specifically, when the thumbnail image generation unit 40 acquires the extracted location information (eg, the elapsed time from the start of recording of the audio data), the still image frame of the moving image data corresponding to the location specified by the extracted location information Is identified. For example, when the extracted location information is the elapsed time T from the start of recording of the audio data, the still image frame at the time T has elapsed from the start of recording in the moving image data is specified. Thereafter, when the specified still image frame is acquired, a thumbnail image is generated by reducing the resolution or the like. When there are a plurality of locations specified by the extracted location information, the thumbnail image generation unit 40 may generate thumbnail images corresponding to all locations.

  The display unit 50 is configured to display the thumbnail image generated by the thumbnail image generation unit 40. As a display mode, for example, a means for displaying a list of a plurality of thumbnail images or displaying them in a slide manner is conceivable.

  Here, FIG. 2 shows an example in which the display unit 50 displays thumbnail images. In the display screen of FIG. 2, a list of five thumbnail images is displayed. The “case number” in the upper left of the screen is an identification number assigned to each case. The time information below the thumbnail image is the time when each image was recorded. Note that this time information can be an elapsed time from the start of recording of each moving image data. The size described in the same box indicates the data amount of the thumbnail image. When receiving a selection input of “image enlargement” provided below each thumbnail image, the display unit 50 enlarges and displays the image displayed as the thumbnail image. The enlarged display uses a still image frame extracted from the moving image data and displays it at a higher resolution than the thumbnail image.

  Next, an example of the processing flow of the in-vehicle moving image data processing device 1 according to the present embodiment will be described with reference to the flowchart of FIG.

  First, moving image data associated with audio data via time information is acquired together with the audio data (moving image data acquisition step S10). For example, moving image data in which an incident site such as a taxi car or a convenience store store is recorded together with audio data is acquired from a removable medium or a recording device.

  Next, one or more locations where the audio level is higher than the reference value are extracted from the audio data associated with the video data acquired in the video data acquisition step S10 (extraction step S20). For example, the audio data associated with the acquired moving image data is extracted, the reference value held in advance is compared with the audio level of the audio data, and the audio level in the audio data is set to the reference value. Extract one or more larger locations.

  Moreover, the extraction location information which shows the location extracted by extraction step S20 is acquired (extraction location information acquisition step S30). For example, in the extraction step S20, each time a portion where the sound level in the sound data is larger than the reference value is extracted, information indicating the elapsed time from the start of recording the sound data in the extracted portion is acquired as the extracted portion information.

  Next, using the moving image data acquired in the moving image data acquisition step S10, a thumbnail image of the still image frame specified by the extracted location information is generated (thumbnail image generation step S40). For example, when the extracted location information is the elapsed time T from the start of audio data recording, the still image frame at the time T elapsed from the start of moving image data recording in the moving image data is specified. Then, when the specified still image frame is extracted, a predetermined process such as reducing the resolution is performed to generate a thumbnail image. In this step, one or more thumbnail images are generated using all the extracted location information acquired in the extracted location information acquisition step S30. In addition, this step may be performed in parallel with extraction step S20 and extraction location information acquisition step S30. In other words, a thumbnail image may be generated every time the extraction location information is acquired in the extraction location information acquisition step S30.

  Next, one or more thumbnail images generated in the thumbnail image generation step S40 are displayed (display step S50). For example, a list of thumbnail images or a slide display is displayed on the display. This step may be performed in parallel with the extraction step S20, the extraction location information acquisition step S30, and the thumbnail image generation step S40. That is, each time a thumbnail image is generated in the thumbnail image generation step S40, the thumbnail image may be displayed and the display content may be updated.

  Such processing includes, for example, a moving image data acquisition step of acquiring moving image data associated with audio data via time information together with the audio data, and the audio level in the audio data is greater than a reference value. An extraction step for extracting one or more locations, an extraction location information acquisition step for acquiring extracted location information indicating the extracted locations, and a thumbnail image of a still image frame specified by the extracted location information in the moving image data Can be realized by a program for causing a computer to execute a thumbnail image generation step for generating the thumbnail image and a display step for displaying the thumbnail image.

According to the in-vehicle moving image data processing device 1 and the computer program of this embodiment, it is possible to quickly find and display important portions in moving image data recorded for various purposes such as crime prevention. According to such a device, a police officer who gets on the police vehicle immediately after the incident occurs and visits the incident site can quickly check the recorded location of the incident in the video data on the spot. Is possible. As a result, tracking of the criminal can be started quickly, and early criminal arrest can be realized.
<< Embodiment 2 >>

  FIG. 4 shows an example of a functional block diagram of the in-vehicle moving image data processing device 1 of the present embodiment. FIG. 5 is a functional block diagram of a data processing system including one or more in-vehicle data processing devices 1 according to the present embodiment, one or more communication centers 2, and one or more terminal devices such as terminal terminals 3. An example is shown.

  As illustrated in FIG. 4, the in-vehicle moving image data processing device 1 according to the present embodiment includes a moving image data acquisition unit 10, an extraction unit 20, an extraction location information acquisition unit 30, a thumbnail image generation unit 40, and a display unit 50. A second selection receiving unit 110, a still image frame acquisition unit 120, and a transmission / reception unit 130. In addition, you may have a moving image data storage memory.

  The configurations of the moving image data acquisition unit 10, the extraction unit 20, the extraction location information acquisition unit 30, the thumbnail image generation unit 40, and the display unit 50 are the same as those in the first embodiment, and thus detailed description thereof is omitted here. To do. Hereinafter, the configuration of the second selection reception unit 110, the still image frame acquisition unit 120, and the transmission / reception unit 130 will be described.

  First, FIG. 6 shows an example in which the display unit 50 of the present embodiment displays thumbnail images. In the display screen of FIG. 6, a list of five thumbnail images is displayed. Note that the display screen of FIG. 6 is an interface for transmitting still image frames extracted from the moving image data acquired by the moving image data acquisition unit 10. Hereinafter, the interface of FIG. 6 will be described.

  The “case number” in the upper left of the screen is an identification number assigned to each case. The “acceptance date and time” next to the case number is the date and time when the notification of the occurrence of the incident, for example, the 110th notification was received. For example, when a user who is on a vehicle equipped with the in-vehicle moving image data processing device 1 inputs the case number to which the command is received and engaged by means of wireless or the like to the in-vehicle moving image data processing device 1, The in-vehicle moving image data processing device 1 accesses the server of the communication center 2 (see FIG. 5) that stores the date and time when the notification of the occurrence of the incident and the content of the notification are associated with the case number, and sets the date and time of reception. You may acquire and display as shown in the figure. In addition, when the in-vehicle moving image data processing device 1 according to the present embodiment receives a selection input of “case information detail display” next to the reception date and time, the details associated with each case number acquired from the server of the communication center 2 Such information, for example, the criminal's gender, physique, hairstyle, clothes, nationality, and case details may be displayed.

  The time information below each thumbnail image is the time when each image was recorded. Note that this time information can be an elapsed time from the start of recording of each moving image data. The size described in the same box indicates the data amount of the thumbnail image. In addition, when the selection input of “image enlargement” provided below each thumbnail image is received, the display unit 50 enlarges and displays the image displayed as the thumbnail image. The enlarged display uses a still image frame extracted from the moving image data and displays it at a higher resolution than the thumbnail image.

  In addition, when the in-vehicle moving image data processing device 1 of the present embodiment receives a selection input of “transmission selection” provided below each thumbnail image, the selected image is transmitted to the communication center 2 (for example, the police headquarters). (See FIG. 5). After that, when a selection input of “Send to headquarters” at the lower left of the screen is accepted, the selected image is transmitted to the headquarters. The image to be transmitted may be a thumbnail image or a still image frame extracted from moving image data. The communication center 2 (see FIG. 5) that has received the still image frame and / or the thumbnail image sends the received still image frame and / or thumbnail image to one or more portable terminals 3 (see FIG. 5), Alternatively, the thumbnail image may be transmitted to another in-vehicle data processing device 1 that is different from the in-vehicle data processing device 1 that has transmitted the thumbnail image. Hereinafter, a configuration for realizing such processing will be described.

  The second selection receiving unit 110 is configured to receive selection of one or more thumbnail images from among the thumbnail images displayed by the display unit 50. For example, a selection input of one or more thumbnail images from a plurality of thumbnail images displayed as shown in FIG. 6 is accepted. The means for receiving the selection input is not particularly limited, and may be received by touch panel input, for example. Alternatively, a pointer such as a cursor may be displayed on the screen displaying the thumbnail image, and a selection input of one thumbnail image may be received using the pointer. In the case of FIG. 6, for example, when a touch panel input is performed on the “transmission selection” button displayed below each thumbnail image, the second selection receiving unit 110 receives the selection of one thumbnail image. Then, for example, when a touch panel input is performed on the same “transmission selection” button, the second selection receiving unit 110 cancels the selection of the thumbnail image. As shown in the figure, a “Send selection” button below the selected thumbnail image and a “Send” button below the unselected thumbnail image so that the user can identify which thumbnail image is selected. The display mode of the “select” button may be different.

  The still image frame acquisition unit 120 is configured to acquire a still image frame in the moving image data corresponding to the thumbnail image received by the second selection reception unit 110. The “still image frame corresponding to the thumbnail image” corresponds to a still image frame that records the same image as the selected thumbnail image among a plurality of still image frames recorded as moving image data.

  For example, the following processing may be used as a means for the still image frame acquisition unit 120 to acquire the still image frame corresponding to the selected thumbnail image. When the thumbnail image is generated, the thumbnail image generation unit 40 associates the still image frame extracted from the moving image data to generate the thumbnail image with the generated thumbnail image in the internal memory in the in-vehicle moving image data processing device 1. save. Then, when the still image frame acquisition unit 120 identifies the thumbnail image received by the second selection reception unit 110, the still image frame acquisition unit 120 associates the identified thumbnail image among the still image frames stored by the thumbnail image generation unit 40. Identify and extract the still image frame.

  Alternatively, the following processing may be performed. When the thumbnail image generation unit 40 generates a thumbnail image, information indicating a location in the moving image data of the still image frame extracted from the moving image data to generate the thumbnail image (eg, from the start of recording of the moving image data). Elapsed time) is stored in the internal memory in the in-vehicle moving image data processing device 1 in association with the generated thumbnail image. Then, when the still image frame acquisition unit 120 identifies the thumbnail image received by the second selection reception unit 110, the still image frame acquisition unit 120 identifies the thumbnail image from the information indicating the location in the moving image data stored by the thumbnail image generation unit 40. Get information associated with thumbnail images. Then, using the acquired information, the location where the still image frame corresponding to the thumbnail image accepted in the moving image data is recorded is specified, and the specified still image frame is acquired.

  The transmission / reception unit 130 is configured to transmit the still image frame acquired by the still image frame acquisition unit 120 to an external device. The transmission / reception unit 130 transmits a still image frame to, for example, a device provided in the communication center 2, a mobile terminal 3 such as a mobile phone, another in-vehicle data processing device 1, a PC, or the like via the Internet. In addition, you may transmit to the portable terminals 3, such as a mobile telephone, by infrared communication. The transmission / reception unit 130 is configured to receive data transmitted from another in-vehicle data processing device 1, the communication center 2, or the mobile terminal 3.

  The in-vehicle moving image data processing device 1 according to the present embodiment can transmit a still image of a location extracted as an important location to another external device. According to such a device, a police officer who boarded a police vehicle at the time of the incident and visited the scene of the incident quickly confirmed the recorded location of the incident in the video data on the spot with a thumbnail image. In addition, you can send your favorite images to the police headquarters and other police officers' mobile terminals. As a result, it is possible to realize an early resolution of the case.

Moreover, according to the data processing system of this embodiment, the still image of the location extracted as an important location can be quickly transmitted to many other external devices via the communication center 2. According to such a system, a still image, which becomes an important document in an investigation selected by a police officer who has been put on the scene immediately after the incident occurs, can be obtained from a mobile terminal or an in-vehicle data processing device of the police officer engaged in the incident. Can be sent all at once, and early resolution of the incident is realized.
<< Embodiment 3 >>

  FIG. 7 shows an example of a functional block diagram of the in-vehicle moving image data processing device 1 of the present embodiment. The in-vehicle moving image data processing device 1 includes a moving image data acquisition unit 10, an extraction unit 20, an extraction location information acquisition unit 30, a thumbnail image generation unit 40, a display unit 50, and a location designation reception unit 60. Have. In addition, you may have the transmission / reception part 130 and a moving image data storage memory.

  Note that the configurations of the moving image data acquisition unit 10, the extracted location information acquisition unit 30, the thumbnail image generation unit 40, the display unit 50, and the transmission / reception unit 130 are the same as those in the first and second embodiments. Is omitted. Hereinafter, configurations of the location designation receiving unit 60 and the extracting unit 20 will be described.

  The location designation receiving unit 60 is configured to accept designation input of a predetermined location in the time information. As described in the first embodiment, the time information here is, for example, data indicating the elapsed time from the start of recording of moving image data and audio data as 0 (zero), moving image data and audio data This corresponds to time data indicating the date and time of recording.

  As a means for accepting a specified input at a predetermined location in the time information, for example, a means for accepting an input of an elapsed time from the start of recording of moving image data and audio data as 0 (zero) can be considered. Alternatively, when time data indicating the date and time when the moving image data is recorded is recorded in association with the moving image data, a means for receiving a specified input at a predetermined location by receiving the input of the date and time can be considered. As the date and time in such a case, for example, the date and time at the time of the occurrence of an event, the date and time of notification of the occurrence of an event, for example, the date and time when the 110th notification was received, etc. can be considered.

  In addition, the following means may be used as means for accepting the input of the date and time when the location designation receiving unit 60 has received the 110th report. For example, in the case where the in-vehicle moving image data processing device 1 is configured to be able to acquire the date / time information when the 110th report is received from the server of the communication center 2 or the like as described in the second embodiment, it is acquired from the communication center 2. The date / time information that received the 110th notification may be automatically acquired as a designated input of a predetermined location. Or you may implement | achieve by receiving the input of the date information which received the 110th report as a predetermined location from a user.

  The extraction unit 20 of the present embodiment is based on the configuration of the first and second embodiments, and is further configured to perform extraction while going back in time from the location received by the location designation receiving unit 60. Specifically, the extraction unit 20 is configured to perform the following processing. First, information indicating a location received by the location designation receiving unit 60 is acquired. If the acquired information is, for example, time data indicating the date and time when moving image data is recorded, the location of the audio data recorded at the date and time specified by the time data is specified. In addition, when the acquired information is, for example, the elapsed time T from the start of recording of moving image data and audio data, the location of the time T elapsed from the beginning of the audio data is specified. Thereafter, the reference value is compared in magnitude with the audio level of the audio data while going back in time from the specified location in the audio data.

  In the case of the present embodiment, the thumbnail image generation unit 40 generates a thumbnail image each time the extraction unit 20 performs an extraction process and the extraction part information acquisition unit 30 acquires the extraction part information, and the display unit 50 displays the thumbnail image. It is desirable to display and update thumbnail images each time is generated.

  With this configuration, it is possible to display thumbnail images of important locations extracted while going back in time from the designated location as needed. According to such a configuration, for example, by specifying and inputting the date and time when the 110th report was received as a predetermined location, it becomes possible to more quickly confirm the image at the time of the case extracted while going back from that time point. Early resolution of the case is realized.

  Note that the extraction unit 20 may be configured to extract the audio data that is temporally after the location received by the location designation reception unit 60 in time series. Such a configuration is useful when the party concerned stores the date and time when the incident occurred and generates a thumbnail image using moving image data after the time when the incident occurred.

  Next, an example of the processing flow of the in-vehicle moving image data processing device 1 according to the present embodiment will be described with reference to the flowchart of FIG.

  First, moving image data associated with audio data via time information is acquired together with the audio data (moving image data acquisition step S10). For example, moving image data in which an incident site such as a taxi car or a convenience store store is recorded together with audio data is acquired from a removable medium or a recording device.

  Next, designation input of a predetermined location in time information for associating moving image data and audio data is accepted (location designation acceptance step S11). For example, when time data indicating the date and time when recording the moving image data is recorded in association with the moving image data, the date and time when the incident occurred, the date and time when the notification of the occurrence of the incident (example: 110th notification) was received, etc. Accept date / time information input.

  Next, a part of the audio data associated with the moving image data acquired in the moving image data acquisition step S10 is temporally traced back from the position received in the location designation receiving step S11, and the portion where the audio level is higher than the reference value is selected. More than one part is extracted (extraction step S20). For example, when the date and time information is received in the location designation receiving step S11, the location recorded at the date and time specified by the date and time information in the audio data is specified, and the time is traced back from the specified location. Then, the reference value held in advance is compared with the sound level of the sound data, and one or more locations where the sound level in the sound data is greater than the reference value are extracted.

  Moreover, the extraction location information which shows the location extracted by extraction step S20 is acquired (extraction location information acquisition step S30). For example, in the extraction step S20, each time a portion where the sound level in the sound data is larger than the reference value is extracted, information indicating the elapsed time from the start of recording the sound data in the extracted portion is acquired as the extracted portion information.

  Next, using the moving image data acquired in the moving image data acquisition step S10, a thumbnail image of the still image frame specified by the extracted location information is generated (thumbnail image generation step S40). For example, when the extracted location information is the elapsed time T from the start of audio data recording, the still image frame at the time T elapsed from the start of moving image data recording in the moving image data is specified. Then, when the specified still image frame is extracted, a predetermined process such as reducing the resolution is performed to generate a thumbnail image. In this step, one or more thumbnail images are generated using all the extracted location information acquired in the extracted location information acquisition step S30. Note that this step is preferably performed in parallel with the extraction step S20 and the extraction location information acquisition step S30. In other words, it is desirable to generate a thumbnail image each time the extraction location information is acquired in the extraction location information acquisition step S30.

  Next, one or more thumbnail images generated in the thumbnail image generation step S40 are displayed (display step S50). For example, thumbnail images are displayed as a list on a display, displayed as a slide, or displayed on an interface for using (reproducing, enlarging, transmitting, etc.) moving image data and still image data. This step is preferably performed in parallel with the extraction step S20, the extraction location information acquisition step S30, and the thumbnail image generation step S40. That is, it is desirable to display the thumbnail image and update the display contents every time the thumbnail image is generated in the thumbnail image generation step S40.

  Such processing includes, for example, a moving image data acquisition step of acquiring moving image data associated with audio data via time information together with the audio data, and a location that receives a specified input of a predetermined location in the moving image data. Obtaining extraction location information indicating the extracted location, a designation receiving step, an extraction step of extracting one or more locations where the audio level is higher than a reference value while going back in time from the predetermined location in the audio data An extraction location information acquisition step, a thumbnail image generation step for generating a thumbnail image of a still image frame specified by the extraction location information using the moving image data, and a display step for displaying the thumbnail image. It is realizable with the program for making it run.

According to the in-vehicle moving image data processing device 1 and the computer program of the present embodiment, it is possible to more quickly find and display important portions in moving image data recorded for various purposes such as crime prevention.
<< Embodiment 4 >>

  The in-vehicle moving image data processing apparatus 1 according to the present embodiment is based on the in-vehicle moving image data processing apparatus 1 according to the third embodiment, and the configuration of the extraction unit 20 is partially different. Hereinafter, the configuration of the extraction unit 20 of the present embodiment will be described. Since other configurations are the same as those described in the first, second, and third embodiments, a detailed description thereof is omitted here.

  The extraction unit 20 according to the present embodiment is configured to perform extraction on audio data within a predetermined time from a location received by the location designation receiving unit 60. Note that the extraction unit 20 of the present embodiment can also be configured to perform extraction while going back in time from the location received by the location designation receiving unit 60. In the case of the extraction unit 20 of the present embodiment, This configuration is not essential.

  Here, “within a predetermined time from the location received by the location designation receiving unit 60” means any predetermined time before and after the time of the location received by the location designation receiving unit 60 (hereinafter referred to as “specified time”). For example, it may be 30 minutes before and after the designated time point, 45 minutes before the designated time point, or 45 minutes after the designated time point. The rule for determining the predetermined time is determined in advance, and the extraction unit 20 may determine the predetermined time according to a rule that is held in advance (eg, 30 minutes before and after the specified time). Or, the location designation receiving unit 60 receives the designation input of the predetermined location from the user, and inputs information for determining the predetermined time (for example, how many minutes before and after the designated time point) ) May be received and the predetermined time may be determined according to the user input.

  According to the in-vehicle moving image data processing apparatus 1 of the present embodiment, it becomes possible to narrow down the data to be processed such as the generation of thumbnail images, so that the time required for data processing of the in-vehicle moving image data processing apparatus 1 is reduced. It becomes possible to check the image of the incident situation more quickly.

Note that the processing flow of the in-vehicle moving image data processing device 1 according to the present embodiment can be realized according to the third embodiment, and thus detailed description thereof is omitted here.
<< Embodiment 5 >>

  FIG. 9 shows an example of a functional block diagram of the in-vehicle moving image data processing device 1 of the present embodiment. The in-vehicle moving image data processing device 1 includes a moving image data acquisition unit 10, an extraction unit 20, an extraction location information acquisition unit 30, a thumbnail image generation unit 40, a display unit 50, and a removable media detection unit 70. Have. In addition, you may have a moving image data storage memory.

  The configurations of the extraction unit 20, the extracted location information acquisition unit 30, the thumbnail image generation unit 40, and the display unit 50 are the same as those in the first, second, third, and fourth embodiments, and thus detailed description thereof is omitted here. To do. Hereinafter, configurations of the removable media detection unit 70 and the moving image data acquisition unit 10 will be described.

  The removable media detection unit 70 is configured to detect that a removable medium in which moving image data is recorded is disposed at a predetermined position (hereinafter simply referred to as “predetermined position”) where the moving image data acquisition unit 10 can acquire moving image data. Has been. The predetermined position is a position at which data can be exchanged between the in-vehicle moving image data processing apparatus 1 and the removable medium. That is, the removable media detection unit 70 is arranged at a predetermined position where removable media such as CD and DVD are placed on a predetermined tray, and data can be exchanged with the in-vehicle moving image data processing apparatus 1 as the tray is stored. When it is detected, it is detected. The removable media detection unit 70 detects when a removable medium such as an SD card, USB memory, CD, or DVD is inserted into a predetermined position where data can be exchanged with the in-vehicle moving image data processing apparatus 1. The in-vehicle moving image data processing device 1 may be provided with a plurality of predetermined positions for storing the removable media according to the type of the removable media.

  The means for detecting that the removable medium on which the moving image data is recorded is arranged at a predetermined position is not particularly limited, and may be detected using, for example, an infrared sensor or for storing the removable medium. A button configured to be physically pressed due to the storage of the removable medium is provided at a predetermined position provided in the storage medium, and the removable medium is electrically detected by pressing the button. May be detected at a predetermined position.

  The moving image data acquisition unit 10 of the present embodiment is configured to start acquiring moving image data from a removable medium triggered by the removable medium detection unit 70 detecting the placement of the removable medium at a predetermined position.

The in-vehicle moving image data processing apparatus 1 according to this embodiment is a user-friendly apparatus that realizes a reduction in the amount of user operations. According to the in-vehicle moving image data processing device 1 of the present embodiment, for example, when a police officer who arrives at the incident site receives a removable medium in which moving image data is recorded for crime prevention from the incident party, the received removable medium is used for in-vehicle use. By simply setting the moving image data processing device 1 at a predetermined position, it is possible to quickly confirm the thumbnail image in which the state of the incident is recorded.
<< Embodiment 6 >>

  FIG. 10 shows an example of a functional block diagram of the in-vehicle moving image data processing apparatus 1 of the present embodiment. This in-vehicle moving image data processing device 1 includes a moving image data acquisition unit 10, an extraction unit 20, an extraction location information acquisition unit 30, a thumbnail image generation unit 40, a display unit 50, a first selection receiving unit 80, The identification unit 90 and the reproduction unit 100 are included. In addition, you may have a moving image data storage memory.

  The configuration of the moving image data acquisition unit 10, the extraction unit 20, the extraction location information acquisition unit 30, the thumbnail image generation unit 40, and the display unit 50 is the same as that of the first, second, third, fourth, and fifth embodiments. Detailed description here is omitted. Hereinafter, the configuration of the first selection receiving unit 80, the specifying unit 90, and the playback unit 100 will be described.

  First, FIG. 11 shows an example of a mode in which the display unit 50 of the present embodiment displays thumbnail images. In the display screen of FIG. 11, a list of five thumbnail images is displayed. Note that the display screen of FIG. 11 is an interface for reproducing and displaying the moving image data acquired by the moving image data acquisition unit 10 from a predetermined position. That is, when a selection input of “play” provided below each thumbnail image is received, the moving image data acquired by the moving image data acquisition unit 10 is used to start playback at the location where each thumbnail image is recorded. To start. Hereinafter, a configuration for realizing such processing will be described. Other display contents in FIG. 11 are the same as those described in the second embodiment (FIG. 6), and thus detailed description thereof is omitted here.

  The first selection receiving unit 80 is configured to receive the selection of one thumbnail image from among the thumbnail images displayed by the display unit 50. For example, a selection input of one thumbnail image from a plurality of thumbnail images displayed as shown in FIG. 11 is accepted. The means for receiving the selection input is not particularly limited, and may be received by touch panel input, for example. Alternatively, a pointer such as a cursor may be displayed on the screen displaying the thumbnail image, and a selection input of one thumbnail image may be received using the pointer. In the case of FIG. 11, for example, when a touch panel input is performed on the “play” button displayed below each thumbnail image, the first selection receiving unit 80 receives the selection of one thumbnail image.

  The specifying unit 90 is configured to specify a portion of the moving image data acquired by the moving image data acquiring unit 10 where the thumbnail image that has been selected by the first selection receiving unit 80 is displayed. Here, the “location” corresponds to still image frame data for one frame at a certain point in the moving image data in which a plurality of data is recorded in time series.

  The means for realizing the specification in the specification unit 90 may be, for example, the following processing. When the thumbnail image generation unit 40 generates a thumbnail image, the thumbnail image generation unit 40 associates information indicating a location in the moving image data of the image (eg, elapsed time from the start of recording of the moving image data) with the generated thumbnail image. The data is stored in an internal memory in the moving image data processing apparatus 1. When the first selection receiving unit 80 identifies the thumbnail image that has been selected, the specifying unit 90 selects the identified thumbnail image from the information indicating the location in the moving image data stored by the thumbnail image generating unit 40. Get the associated information. This process is merely an example, and the specifying unit 90 may be specified by other means.

  The reproducing unit 100 is configured to reproduce and display a moving image after the part specified by the specifying unit 90. That is, the playback unit 100 acquires the moving image data that the moving image data acquisition unit 10 has taken out from the moving image data storage memory or the removable medium. In addition, information indicating the specified location in the moving image data (eg, elapsed time from the beginning) is acquired from the specifying unit 90. Then, the data of the frames after the location specified by the information is sequentially developed on the VRAM and displayed on the display, and the sound is output through the speaker.

The in-vehicle moving image data processing device 1 according to the present embodiment can reproduce and display moving images after a location extracted as an important location. According to such a device, a police officer who boarded a police vehicle immediately after the occurrence of the incident and visited the scene of the incident quickly used the thumbnail image to record the location of the incident in the video data. In addition to being able to check, it is possible to check the video after the thumbnail image that interests you. In this way, it is possible to utilize moving image data more efficiently than ever before.
Hereinafter, examples of the reference form will be added.
1. A video data acquisition unit that acquires video data associated with audio data via time information together with the audio data;
An extraction unit that extracts one or more locations in the audio data where the audio level is greater than a reference value;
An extracted location information acquisition unit for acquiring extracted location information indicating the extracted location;
Among the moving image data, a thumbnail image generation unit that generates a thumbnail image of a still image frame specified by the extraction location information;
A display unit for displaying the thumbnail image;
A vehicle-mounted moving image data processing apparatus.
2. A location designation receiving unit that accepts designation input of a predetermined location in the time information;
The extraction unit includes:
The in-vehicle moving image data processing device according to 1, wherein the extraction is performed while going back in time from a location received by the location designation receiving unit.
3. The moving image data is recorded in association with time data indicating the date and time when the moving image data was recorded,
The location designation receiving unit is
3. The in-vehicle moving image data processing device according to 2, wherein the input of date information is accepted to accept designation of a predetermined location in the time information.
4). A removable media detection unit for detecting that the removable media on which the video data is recorded is disposed at a predetermined position where the video data acquisition unit can acquire the video data;
The moving image data acquisition unit
The in-vehicle moving image data according to any one of 1 to 3, wherein acquisition of moving image data from the removable medium is started when the removable medium detection unit detects the placement of the removable medium at the predetermined position as a trigger. Processing equipment.
5). A first selection receiving unit that receives selection of one thumbnail image from among the thumbnail images displayed by the display unit;
In the moving image data, a specifying unit for specifying a location where the thumbnail image received by the first selection receiving unit is displayed;
A playback unit that plays back and displays the video after the location specified by the specifying unit;
The in-vehicle moving image data processing device according to any one of 1 to 4, further comprising:
6). A second selection receiving unit that receives selection of one or more thumbnail images from among the thumbnail images displayed by the display unit;
A still image frame acquisition unit that acquires a still image frame in the moving image data corresponding to the thumbnail image received by the second selection reception unit;
A transmission / reception unit for transmitting the still image frame to an external device;
The in-vehicle moving image data processing device according to any one of 1 to 5, further comprising:
7). The in-vehicle moving image data processing device according to claim 6;
A data processing system comprising: a communication center that receives the still image frame transmitted by the transmission / reception unit of the in-vehicle moving image data processing device and transmits the received still image frame to one or more terminal devices.
8). The in-vehicle moving image data processing device according to any one of claims 1 to 6, which is mounted on a police vehicle.
9. A video data acquisition step of acquiring video data associated with audio data through time information together with the audio data;
An extraction step of extracting one or more locations in the audio data where the audio level is greater than a reference value;
An extraction location information acquisition step for acquiring extraction location information indicating the extracted location;
A thumbnail image generation step of generating a thumbnail image of a still image frame specified by the extraction location information among the moving image data;
A display step for displaying the thumbnail image;
A program that causes a computer to execute.
10. A video data acquisition step of acquiring video data associated with audio data through time information together with the audio data;
A location designation accepting step for accepting designation input of a predetermined location in the time information;
An extraction step of extracting one or more locations where the audio level is greater than a reference value while going back in time from the predetermined location in the audio data;
An extraction location information acquisition step for acquiring extraction location information indicating the extracted location;
A thumbnail image generation step of generating a thumbnail image of a still image frame specified by the extraction location information using the moving image data;
A display step for displaying the thumbnail image;
A program that causes a computer to execute.

DESCRIPTION OF SYMBOLS 1 Vehicle-mounted video data processing apparatus 2 Communication center 3 Mobile terminal 10 Video data acquisition part 20 Extraction part 30 Extraction location information acquisition part 40 Thumbnail image generation part 50 Display part 60 Location designation | designated reception part 70 Removable media detection part 80 1st selection reception Unit 90 specifying unit 100 reproducing unit 110 second selection receiving unit 120 still image frame acquiring unit 130 transmitting / receiving unit

Claims (9)

A video data acquisition unit that acquires video data associated with audio data via time information together with the audio data;
An extraction unit that extracts one or more locations in the audio data where the audio level is greater than a reference value;
An extracted location information acquisition unit for acquiring extracted location information indicating the extracted location;
Among the moving image data, a thumbnail image generation unit that generates a thumbnail image of a still image frame specified by the extraction location information;
A display unit for displaying the thumbnail image;
Have
The in-vehicle moving image data processing apparatus, wherein the extraction unit holds a reference value for each place and performs the extraction process using the reference value corresponding to the place where the audio data to be processed is recorded. A location designation receiving unit that accepts designation input of a predetermined location in the time information;
The extraction unit includes:
The in-vehicle moving image data processing device according to claim 1 , wherein the extraction is performed while going back in time from a location received by the location designation receiving unit. The moving image data is recorded in association with time data indicating the date and time when the moving image data was recorded,
The location designation receiving unit is
The in-vehicle moving image data processing device according to claim 2 , wherein by receiving input of date and time information, designation of a predetermined location in the time information is received. A removable media detection unit for detecting that the removable media on which the video data is recorded is disposed at a predetermined position where the video data acquisition unit can acquire the video data;
The moving image data acquisition unit
The in-vehicle use according to any one of claims 1 to 3 , wherein acquisition of moving image data from the removable medium is started when the removable medium detection unit detects the placement of the removable medium at the predetermined position as a trigger. Movie data processing device. A first selection receiving unit that receives selection of one thumbnail image from among the thumbnail images displayed by the display unit;
In the moving image data, a specifying unit for specifying a location where the thumbnail image received by the first selection receiving unit is displayed;
A playback unit that plays back and displays the video after the location specified by the specifying unit;
The in-vehicle moving image data processing device according to claim 1 , further comprising: A second selection receiving unit that receives selection of one or more thumbnail images from among the thumbnail images displayed by the display unit;
A still image frame acquisition unit that acquires a still image frame in the moving image data corresponding to the thumbnail image received by the second selection reception unit;
A transmission / reception unit for transmitting the still image frame to an external device;
The in-vehicle moving image data processing apparatus according to any one of claims 1 to 5 , further comprising: The in-vehicle moving image data processing device according to claim 6 ,
A communication center that receives the still image frame transmitted by the transmission / reception unit of the in-vehicle moving image data processing device and transmits the received still image frame to one or more terminal devices;
A data processing system consisting of The in-vehicle moving image data processing device according to any one of claims 1 to 6 , which is mounted on a police vehicle. A video data acquisition step of acquiring video data associated with audio data through time information together with the audio data;
An extraction step of extracting one or more locations in the audio data where the audio level is greater than a reference value;
An extraction location information acquisition step for acquiring extraction location information indicating the extracted location;
A thumbnail image generation step of generating a thumbnail image of a still image frame specified by the extraction location information among the moving image data;
A display step for displaying the thumbnail image;
To the computer,
In the extraction step, a program for performing the extraction process using the reference value corresponding to the place where the audio data to be processed is recorded among the reference values for each predetermined place. .

Images