JP6853909B1 - Image processing equipment, image processing methods and programs - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing device, an image processing method and a program capable of allowing a user to view a plurality of moving images in a display mode suitable for the contents of the moving image. SOLUTION: A server 1 has a plurality of captured image data generated by a plurality of cameras photographing a predetermined area, and a plurality of captured image data acquired at a plurality of positions where a plurality of cameras are photographing a predetermined area. It is a specific captured image data among the plurality of captured image data based on the data acquisition unit 131 that acquires the sound data in association with each other and the state of the sound indicated by at least a part of the sound data among the plurality of sound data. A display mode determining unit 132 that determines the display mode of the specific captured image data, and a plurality of captured image data are displayed on the display of the user terminal so that the specific captured image data is displayed in the display mode determined by the display mode determining unit 132. It has a display control unit 133. [Selection diagram] Fig. 4

Description

The present invention relates to an image processing apparatus, an image processing method and a program.

Conventionally, there is known a technique of delivering a plurality of moving images captured by a plurality of cameras to a terminal capable of displaying an image and displaying the plurality of moving images on the terminal (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 11-289531

The conventional terminal displays a plurality of moving images in a predetermined arrangement or an arrangement arbitrarily set by the user. However, even if a attention scene that attracts the attention of many users is delivered in any of a plurality of videos, there is a possibility that the scene will be missed if the user is viewing another video. there were.

Therefore, the present invention has been made in view of these points, and an object of the present invention is to enable a user to view a plurality of moving images in a display mode suitable for the contents of the moving images.

In the image processing device of the first aspect of the present invention, a plurality of captured image data generated by a plurality of imaging devices capturing a predetermined area and the plurality of imaging devices capturing the predetermined area. The plurality of captured images are based on a data acquisition unit that acquires a plurality of sound data acquired at a plurality of positions in association with each other and a sound state indicated by at least a part of the sound data among the plurality of sound data. A display mode determining unit that determines a display mode of the specific captured image data that is the specific captured image data among the data, and a plurality of the specific captured image data so as to display the specific captured image data in the display mode determined by the display mode determining unit. It has a display control unit for displaying captured image data on the display unit.

The display mode determining unit may determine the display mode based on the loudness of the sound corresponding to at least a part of the sound data.

Among the plurality of sound data, the display mode determining unit corresponds to a second sound having a size larger than the display size of the first captured image data corresponding to the first sound data in the display unit and larger than the first sound data. The display mode may be determined so that the display size of the second captured image data corresponding to the sound data becomes large.

The display mode determining unit may determine the display mode based on the content of the sound corresponding to at least a part of the sound data.

The captured image data includes image pickup device identification information for identifying the image pickup device from which the captured image data was acquired, and the sound data is for identifying the device from which the sound data was acquired. The voice device identification information of the above is included, and the display mode determining unit refers to the related information in which the sound identification information and the image pickup device identification information for identifying each of the plurality of image pickup devices are associated with each other. Thereby, the display mode may be determined.

The captured image data includes first position information indicating the position where the captured image data is acquired, and the sound data includes second position information indicating the position where the sound data is acquired. Even if the display mode determining unit determines the display mode based on the state of the sound data corresponding to the second position information corresponding to the position closest to the position indicated by the first position information. Good.

The display mode determining unit may determine the display mode based on the state of sounds other than the predetermined sounds among the sounds included in the sound data.

The data acquisition unit may acquire the plurality of sound data acquired by the directional microphones provided in each of the plurality of imaging devices.

In the image processing method of the second aspect of the present invention, a computer captures a plurality of captured image data generated by a plurality of imaging devices capturing a predetermined area, and the plurality of imaging devices capture the predetermined area. The plurality of imagings are performed based on the step of associating and acquiring the plurality of sound data acquired at the plurality of positions, and the state of the sound indicated by at least a part of the sound data among the plurality of sound data. A step of determining a display mode of the specific captured image data which is the specific captured image data among the image data, and displaying the plurality of captured image data on the display unit so as to display the specific captured image data in the determined display mode. To perform the steps and.

In the program of the third aspect of the present invention, the computer captures a plurality of captured image data generated by a plurality of imaging devices capturing a predetermined area, and the plurality of imaging devices capture the predetermined area. The plurality of imaging images are based on a data acquisition unit that acquires a plurality of sound data acquired at a plurality of positions in association with each other and a sound state indicated by at least a part of the sound data among the plurality of sound data. A display mode determining unit that determines a display mode of the specific captured image data, which is the specific captured image data among the image data, and a plurality of the display mode determining units so as to display the specific captured image data in the display mode determined by the display mode determining unit. It functions as a display control unit that displays the captured image data of the above on the display unit.

According to the present invention, there is an effect that a user can view a plurality of moving images in a display mode suitable for the contents of the moving image.

It is a schematic diagram which shows the state which a plurality of cameras are installed in a stadium. It is a figure which shows the state which the image based on the plurality of captured image data created by a plurality of cameras is displayed on the display. It is a system block diagram of an image processing system. It is a figure which shows the configuration of a server. It is a figure which shows the operation sequence of a plurality of cameras, a server and a user terminal. It is a figure which shows the structure of a user terminal. It is a figure which shows the operation sequence of a plurality of cameras, a server and a user terminal in 2nd Embodiment.

[Overview of image processing system S]
1 and 2 are diagrams for explaining the outline of the image processing system S. The image processing system S is a person who views an image based on a plurality of captured image data output by cameras C (C1 to C5 in FIG. 1), which are a plurality of imaging devices that capture a predetermined area from different angles. It is a system that simultaneously displays on the display used by (hereinafter referred to as "user"). The camera C is installed in, for example, a stadium where a competition is held or an event venue where an event is held, and a predetermined area is an area where each camera C can take a picture. In the present specification, when it is not necessary to distinguish each of the plurality of cameras C1 to C5, it may be referred to as camera C.

FIG. 1 is a schematic view showing a state in which a plurality of cameras C1 to C5 are installed in a stadium. FIG. 2 is a diagram showing a state in which an image based on a plurality of captured image data created by a plurality of cameras C1 to C5 is displayed on a display. The captured image data is, for example, a moving image, but may be a still image.

The image processing system S has a feature that the mode of the image displayed on the display can be changed based on the state of the sound acquired at each position of the plurality of cameras C1 to C5. The sound state is represented by information related to the state of the area captured by the camera C, such as loudness, sound content, or sound frequency. In the image processing system S, for example, an image taken by the camera C at a position where a loud sound is acquired is displayed on the display so as to be more conspicuous than other images. For example, an image taken by the camera C at a position where a loud sound is acquired may be displayed larger than other images or may be displayed in a state surrounded by a special frame.

FIG. 2A shows a state in which images taken by the cameras C1 to C5 are displayed in each of the plurality of areas R1 to R5 on the display. In FIG. 2A, the image taken by the camera C1 is displayed in the largest area R1, and the other images are displayed in the areas R2 to R5 smaller than the area R1.

FIG. 2B is an example of an image displayed on the display when the sound acquired by the camera C5 is louder than the sound acquired by the other cameras C1 to C4 after the state of FIG. 2A. Is shown. In FIG. 2B, the image taken by the camera C5 is displayed in the area R1 instead of the image taken by the camera C1 displayed in the area R1 in FIG. 2A. In the image processing system S, the image displayed in a large size changes depending on the state of the sound acquired at the position where the image was taken. Therefore, for example, the image taken at a position close to the position where a loud cheer occurs is displayed. It is displayed large. As a result, it becomes difficult for the user to overlook the attention scene that attracts the attention of many users.

FIG. 3 is a system configuration diagram of the image processing system S. The image processing system S has a plurality of cameras C (C1 to C5), a server 1, and a user terminal 2. The plurality of cameras C, the server 1, and the user terminal 2 transmit and receive various data via the network N. The network N includes the Internet, a mobile phone network, and the like.

The server 1 acquires captured image data and sound data from each of the plurality of cameras C via the network N. The server 1 determines the captured image data to be displayed on the user terminal 2 in a display mode different from that of other images, based on the sound state indicated by the acquired sound data. The server 1 is an example of an image processing device that controls the user terminal 2 so that the user terminal 2 displays an image based on a plurality of captured image data in the determined display mode.

The user terminal 2 is a terminal having a display for displaying a plurality of images based on a plurality of captured image data distributed from the server 1, and is, for example, a smartphone, a tablet, or a personal computer. The number of user terminals 2 is arbitrary. In the image processing system S, for example, the user terminal 2 receives distribution of a plurality of captured image data and at least one sound data from the server 1 and simultaneously displays the distributed plurality of captured image data. Acquires a plurality of captured image data and at least one sound data from a plurality of cameras C without going through the server 1, and is based on the plurality of captured image data in a display mode based on the sound state indicated by at least one sound data. The image may be displayed on the display.

<First Embodiment>
First, an embodiment in which the server 1 determines the display mode will be described. In this case, the user terminal 2 displays a plurality of images based on the plurality of captured image data on the display based on the display mode instructed by the server 1.

[Configuration of server 1]
FIG. 4 is a diagram showing the configuration of the server 1. The server 1 has a communication unit 11, a storage unit 12, and a control unit 13. The control unit 13 includes a data acquisition unit 131, a display mode determination unit 132, and a display control unit 133.

The communication unit 11 has a communication interface for transmitting and receiving data between the plurality of cameras C and the user terminal 2 via the network N. The communication unit 11 inputs a plurality of captured image data and sound data received from the plurality of cameras C to the data acquisition unit 131. Further, the communication unit 11 transmits the captured image data and the sound data for distribution input from the display control unit 133 to the user terminal 2 via the network N.

The storage unit 12 has a storage medium such as a ROM (Read Only Memory), a RAM (Random Access Memory), and a hard disk. The storage unit 12 stores a program executed by the control unit 13. In addition, the storage unit 12 temporarily stores a plurality of captured image data received by the communication unit 11.

The control unit 13 has, for example, a CPU (Central Processing Unit), and functions as a data acquisition unit 131, a display mode determination unit 132, and a display control unit 133 by executing a program stored in the storage unit 12. ..

The data acquisition unit 131 includes a plurality of captured image data generated by a plurality of cameras C photographing a predetermined area via a communication unit 11, and a plurality of captured image data in which a plurality of imaging devices photograph a predetermined area. Acquires a plurality of sound data acquired at a position in association with each other. The data acquisition unit 131 acquires a plurality of sound data acquired by, for example, directional microphones provided in each of the plurality of cameras C. When a plurality of cameras C are installed in the stadium, the data acquisition unit 131 directs the camera C to shoot so that the captured image data to be conspicuously displayed is selected based on the cheers of the audience seats. A plurality of sound data acquired by a microphone having directivity in the opposite direction to the above may be acquired.

The data acquisition unit 131 may simultaneously acquire the captured image data output by the camera C and the sound data corresponding to the sound acquired at the position of the camera C, and the captured image data with common identification information is attached. And the sound data may be acquired separately. The data acquisition unit 131 inputs the acquired captured image data and sound data to the display mode determination unit 132. The data acquisition unit 131 may store the acquired captured image data and sound data in the storage unit 12.

The display mode determination unit 132 determines the display mode of the specific captured image data, which is the specific captured image data among the plurality of captured image data, based on the sound state indicated by at least a part of the sound data among the plurality of sound data. decide. The specific captured image data has a feature that the sound state corresponding to the sound data acquired by the data acquisition unit 131 in association with the captured image data is different from the sound state corresponding to the sound data associated with other captured image data. It is the captured image data to have.

The display mode determining unit 132 makes the probability that the user sees such a display mode of the specific captured image data higher than that of other captured image data. The display mode determination unit 132 determines, for example, a specific captured image data in a display mode larger than other captured image data, or a display mode with a special frame. In the case of the example shown in FIG. 2, the display mode determination unit 132 determines the display mode so that the specific captured image data is displayed in the area R1. The display mode determination unit 132 may display a frame having a color different from that of another area for displaying the captured image data in the area for displaying the specific captured image data, or may make the frame blink. The display mode determination unit 132 may display a mark that is not displayed in the area for displaying the other captured image data in the area for displaying the specific captured image data.

The display mode determination unit 132 determines the display mode based on the loudness of the sound corresponding to at least a part of the sound data. In this case, the sound state corresponding to the specific captured image data is, for example, a state including a loud cheering sound, and is a state at a level higher than the sound corresponding to other captured image data. As an example, the display mode determination unit 132 determines the second sound data corresponding to a sound larger than the display size of the first captured image data corresponding to the first sound data and larger than the first sound data among the plurality of sound data. The display mode is determined so that the display size of the second captured image data corresponding to the above is large. By operating the display mode determining unit 132 in this way, it becomes easier for the user to visually recognize the captured image data output by the camera C at the position where the great cheers are acquired, so that it is difficult for the user to overlook the scene that the user should pay attention to. Become.

The display mode determining unit 132 may use the captured image data corresponding to the volume equal to or higher than a predetermined threshold value as the specific captured image data, and may have a display mode different from the display mode of the other captured image data. The value above a predetermined threshold value is, for example, a value set by the user or a value corresponding to the volume of loud cheers. When the plurality of captured image data corresponds to the specific captured image data, the display mode determining unit 132 may display the plurality of specific captured image data in a display mode different from the display mode of the other captured image data. By operating the display mode determining unit 132 in this way, when there are a plurality of images that the user should pay attention to, the user can see the plurality of images.

The display mode determination unit 132 may determine the display mode based on the content of the sound corresponding to at least a part of the sound data. For example, the display mode determination unit 132 determines the display mode based on the state of sounds other than the predetermined sounds among the sounds included in the sound data. The display mode determining unit 132 performs voice recognition and analyzes the properties of the sound so that the content of the sound indicated by the sound data is a predetermined sound irrelevant to the position where the scene to be noticed by the user is shot. (For example, the voice of the announcement in the hall or the foreign sound) is determined. When the display mode determination unit 132 determines that the content of the sound indicated by the sound data is not related to the position where the scene to be noticed by the user is photographed, the sound indicated by such sound data is acquired at another position. Even if it is louder than the sound, the captured image data corresponding to such a sound is not displayed in a display mode different from that of other captured image data.

On the other hand, when the content of the specific sound is related to the position where the scene to be noticed by the user is shot (for example, a loud cheer), the display mode determining unit 132 cheers acquired at another position. Even if the sound is smaller than other sounds, the captured image data corresponding to the specific sound is displayed in a more conspicuous display mode than the other captured image data. By operating the display mode determining unit 132 in this way, it is possible to prevent an image that the user does not need to pay attention to from being displayed prominently.

The captured image data includes image pickup device identification information for identifying the camera C from which the captured image data has been acquired, and the sound data identifies a voice device (for example, a microphone) from which the sound data has been acquired. The voice device identification information for the purpose may be included. In this case, the display mode determination unit 132 identifies the sound data corresponding to the captured image data by referring to the related information stored in the storage unit 12 in which the voice device identification information and the image pickup device identification information are associated with each other. To do. Then, the display mode is determined based on the state of the sound indicated by the specified sound data. By operating the display mode determining unit 132 in this way, even when sound data is acquired by an external microphone not built in the camera C, the display mode can be set based on the sound state.

The captured image data includes the first position information indicating the position where the captured image data is acquired, and the sound data includes the second position information indicating the position where the sound data is acquired. You may. In this case, the display mode determination unit 132 determines the display mode based on the state of the sound data corresponding to the second position information corresponding to the position closest to the position indicated by the first position information.

That is, the display mode determination unit 132 is a microphone installed at the position closest to the camera C that outputs the captured image data when the data acquisition unit 131 acquires a plurality of sound data including the second position information. The display mode is determined based on the state of the sound indicated by the acquired sound data. By operating the display mode determining unit 132 in this way, even when sound data is acquired by a plurality of external microphones, it is possible to obtain a display mode based on the most suitable sound state, which is appropriate. It can be displayed in a display mode.

The display control unit 133 displays a plurality of captured image data in the display mode determined by the display mode determining unit 132 so as to display the specific captured image data which is the specific captured image data among the plurality of captured image data. The user terminal 2 is controlled so as to be displayed on the display of. The display control unit 133 transmits, for example, the imaged data corresponding to the sound data showing the loudest cheers to the user terminal 2 with a flag indicating that the image data is the specific imaged image data. The user terminal 2 enables the image corresponding to the specific captured image data to be displayed so that the user can easily pay attention to it. The display control unit 133 transmits the screen data configured in the display mode determined by the display mode determination unit 132 to the user terminal 2, so that the user can use the specific captured image data in the display mode determined by the display mode determination unit 132. It may be displayed on the terminal 2.

[Operation sequence in image processing system S]
FIG. 5 is a diagram showing an operation sequence of a plurality of cameras C, a server 1, and a user terminal 2. The plurality of cameras C transmit captured image data and sound data to the server 1. The display mode determination unit 132 identifies the sound state indicated by the sound data acquired by the data acquisition unit 131 (S11), and displays a plurality of images corresponding to the plurality of captured image data based on the specified sound state. The aspect is determined (S12). The display control unit 133 creates screen data corresponding to the display mode determined by the display mode determination unit 132 (S13), associates the created screen data with the sound data, and transmits the screen data to the user terminal 2. The user terminal 2 displays a screen based on the screen data received from the server 1 on the display (S14).

The plurality of cameras C, the server 1, and the user terminal 2 repeat the process shown in FIG. 5 while the plurality of cameras C transmit the captured image data and the sound data. By operating the plurality of cameras C, the server 1, and the user terminal 2 in this way, the user terminal 2 can perform a attention scene that attracts the attention of many users as shown in FIG. 2 (b). Can be displayed on the display for easy viewing.

<Second embodiment>
In the first embodiment, the server 1 determines the display mode based on the sound state, but the user terminal 2 may determine the display mode. In this case, the server 1 functions as a relay device that relays captured image data between the plurality of cameras C and the user terminal 2.

FIG. 6 is a diagram showing the configuration of the user terminal 2. The user terminal 2 has a display unit 20, a communication unit 21, a storage unit 22, and a control unit 23. The control unit 23 includes a data acquisition unit 231, a display mode determination unit 232, and a display control unit 233.

The display unit 20 is a display that displays an image based on a plurality of captured image data. The display unit 20 displays the screen data created by the display control unit 233.

The communication unit 21 is a communication interface for receiving captured image data and sound data from the server 1 via the network N. The communication unit 21 inputs the received captured image data and sound data to the data acquisition unit 231.

The storage unit 22 is a storage medium including a ROM and a RAM. The storage unit 22 stores a program executed by the control unit 23. The storage unit 22 may temporarily store the captured image data and the sound data received by the communication unit 21.

The control unit 23 has, for example, a CPU, and functions as a data acquisition unit 231, a display mode determination unit 232, and a display control unit 233 by executing a program stored in the storage unit 22.

The data acquisition unit 231 executes the same operation as the data acquisition unit 131 of the server 1 according to the first embodiment. For example, in the data acquisition unit 231, a plurality of captured image data generated by a plurality of cameras C photographing a predetermined area and a plurality of imaging devices are photographing a predetermined area via the communication unit 21. Acquires a plurality of sound data acquired at a plurality of positions in association with each other. The data acquisition unit 231 inputs the acquired captured image data and sound data to the display mode determination unit 232.

The display mode determining unit 232 executes the same operation as the display mode determining unit 132 of the server 1 according to the first embodiment. For example, the display mode determining unit 232 displays the specific captured image data which is the specific captured image data among the plurality of captured image data based on the sound state indicated by at least a part of the sound data among the plurality of sound data. Determine the aspect. The display mode determination unit 232 can also execute other operations executed by the data acquisition unit 131. The display mode determination unit 232 notifies the display control unit 233 of the determined display mode.

The display control unit 233 executes an operation equivalent to 133 that the server 1 according to the first embodiment has. For example, the display control unit 233 displays a plurality of captured image data so as to display the specific captured image data which is the specific captured image data among the plurality of captured image data in the display mode determined by the display mode determining unit 232. Displayed in unit 20. The display control unit 233 creates screen data as shown in FIG. 2 based on the display mode determined by the display mode determination unit 232, and transmits the created data to the display unit 20, for example, FIG. A screen as shown in is displayed on the display unit 20.

FIG. 7 is a diagram showing an operation sequence of the plurality of cameras C, the server 1, and the user terminal 2 in the second embodiment. The plurality of cameras C transmit captured image data and sound data to the server 1. The server 1 distributes the received captured image data and sound data to one or more user terminals 2 registered in advance.

The display mode determination unit 232 of the user terminal 2 specifies the sound state indicated by the sound data acquired by the data acquisition unit 231 (S21), and based on the specified sound state, a plurality of captured image data corresponding to the plurality of captured image data. The display mode of the image of (S22) is determined. The display control unit 233 creates screen data corresponding to the display mode determined by the display mode determination unit 232 (S23), and causes the display unit 20 to display the created screen data (S24).

The plurality of cameras C, the server 1, and the user terminal 2 repeat the process shown in FIG. 7 while the plurality of cameras C transmit the captured image data and the sound data. By operating the plurality of cameras C, the server 1, and the user terminal 2 in this way, the user terminal 2 can perform a attention scene that attracts the attention of many users as shown in FIG. 2 (b). Can be displayed on the display for easy viewing.

[Effect of image processing system S]
As described above, in the image processing system S, when the server 1 or the user terminal 2 acquires a plurality of captured image data and a plurality of sound data output by the plurality of cameras C, at least one of the plurality of sound data is obtained. Based on the state of the sound indicated by the sound data of the unit, the display mode of the specific captured image data, which is the specific captured image data among the plurality of captured image data, is determined. Then, as shown in FIG. 2B, the user terminal 2 displays the captured image data corresponding to the sound data including, for example, a loud cheer, larger than the other captured image data. By configuring the image processing system S in this way, for example, the user can view a plurality of moving images in a display mode suitable for the content of the moving image so that the user does not miss an image that the user should pay attention to. become.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes can be made within the scope of the gist thereof. is there. For example, all or a part of the device can be functionally or physically distributed / integrated in any unit. Also included in the embodiments of the present invention are new embodiments resulting from any combination of the plurality of embodiments. The effect of the new embodiment produced by the combination also has the effect of the original embodiment.

1 Server 2 User terminal 11 Communication unit 12 Storage unit 13 Control unit 20 Display unit 21 Communication unit 22 Storage unit 23 Control unit 131 Data acquisition unit 132 Display mode determination unit 133 Display control unit 231 Data acquisition unit 232 Display mode determination unit 233 Display Control unit

Claims (10)

A plurality of captured image data generated by a plurality of imaging devices photographing a predetermined area, a plurality of sound data acquired at a plurality of positions where the plurality of imaging devices are photographing the predetermined area, and a plurality of sound data. And the data acquisition part to be acquired by associating
Specific captured image data among the plurality of captured image data based on the state of sounds other than a predetermined sound among the sounds included in at least a part of the plurality of sound data. A display mode determination unit that determines the display mode of captured image data,
A display control unit that displays the plurality of captured image data on the display unit so that the specific captured image data is displayed in the display mode determined by the display mode determining unit.
An image processing device having. The display mode determining unit determines the display mode based on the loudness of the sound corresponding to at least a part of the sound data.
The image processing apparatus according to claim 1. Among the plurality of sound data, the display mode determining unit corresponds to a second sound having a size larger than the display size of the first captured image data corresponding to the first sound data in the display unit and larger than the first sound data. The display mode is determined so that the display size of the second captured image data corresponding to the sound data becomes large.
The image processing apparatus according to claim 2. The display mode determining unit determines the display mode based on the content of the sound corresponding to at least a part of the sound data.
The image processing apparatus according to any one of claims 1 to 3. The captured image data includes image pickup device identification information for identifying the image pickup device from which the captured image data was acquired, and the sound data is for identifying the device from which the sound data was acquired. Contains voice device identification information
The display mode determining unit determines the display mode by referring to the related information associated with the audio device identification information and the image pickup device identification information for identifying each of the plurality of image pickup devices.
The image processing apparatus according to any one of claims 1 to 4. The captured image data includes first position information indicating the position where the captured image data is acquired, and the sound data includes second position information indicating the position where the sound data is acquired. And
The display mode determining unit determines the display mode based on the state of the sound data corresponding to the second position information corresponding to the position closest to the position indicated by the first position information.
The image processing apparatus according to any one of claims 1 to 5. The data acquisition unit acquires the plurality of sound data acquired by the directional microphones provided in each of the plurality of imaging devices.
The image processing apparatus according to any one of claims 1 to 6. A plurality of captured image data generated by a plurality of imaging devices photographing a predetermined area, a plurality of sound data acquired at a plurality of positions where the plurality of imaging devices are photographing the predetermined area, and a plurality of sound data. And the data acquisition part to be acquired by associating
A display mode determination for determining a display mode of specific captured image data, which is specific captured image data among the plurality of captured image data, based on a sound state indicated by at least a part of the plurality of sound data. Department and
A display control unit that displays the plurality of captured image data on the display unit so that the specific captured image data is displayed in the display mode determined by the display mode determining unit.
Have a,
The captured image data includes first position information indicating the position where the captured image data is acquired, and the sound data includes second position information indicating the position where the sound data is acquired. And
The display mode determining unit is an image processing device that determines the display mode based on the state of the sound data corresponding to the second position information corresponding to the position closest to the position indicated by the first position information. The computer
A plurality of captured image data generated by a plurality of imaging devices photographing a predetermined area, a plurality of sound data acquired at a plurality of positions where the plurality of imaging devices are photographing the predetermined area, and a plurality of sound data. And the steps to get associated with
Specific captured image data among the plurality of captured image data based on the state of sounds other than a predetermined sound among the sounds included in at least a part of the plurality of sound data. Steps to determine the display mode of captured image data,
A step of displaying the plurality of captured image data on the display unit so as to display the specific captured image data in the determined display mode, and
Image processing method to execute. Computer,
A plurality of captured image data generated by a plurality of imaging devices photographing a predetermined area, a plurality of sound data acquired at a plurality of positions where the plurality of imaging devices are photographing the predetermined area, and a plurality of sound data. And the data acquisition part to be acquired by associating
Specific captured image data among the plurality of captured image data based on the state of sounds other than a predetermined sound among the sounds included in at least a part of the plurality of sound data. A display mode determination unit that determines the display mode of captured image data,
A display control unit that displays the plurality of captured image data on the display unit so that the specific captured image data is displayed in the display mode determined by the display mode determining unit.
A program to function as.

Images