JP2016178566A - Imaging controller, imaging control program and imaging control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To more accurately detect a lively atmosphere at an arbitrary position in a wide area.SOLUTION: An imaging controller according to an embodiment comprises: a communication part which performs radio communication; a position information acquisition part which acquires position information; a sound acquisition part which acquires an ambient sound; a sound processing part which performs a threshold determination on sound pressure level of a sound, and transmits notice including information indicating that at least the sound pressure level is equal to or more than a threshold and position information by the communication part based upon a determination result; a storage part which stores notice transmitted by other devices and received by the communication part; a determination part which determines whether there is a lively atmosphere region where a lively atmosphere is generated, based upon position information corresponding to the notice when the number of pieces of notice stored in the storage part in a period from the current time to past time by a predetermined time is a predetermined number; and an imaging control part which controls the imaging part to perform imaging when the determination part determines that a lively atmosphere region is present.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an imaging control device, an imaging control program, and an imaging control method.

  There are times when you want to shoot a scene where the audience is excited, such as when watching a sport in a stadium. The user, for example, determines where in the stadium is exciting according to the cheering of the audience, and performs shooting. Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique that automatically performs shooting when the sound pressure level of surrounding input sound exceeds a predetermined level.

  However, according to the technique of Patent Document 1, when using a single device to determine the excitement based on the sound pressure level of the input sound, an individual such as a sound generated alone near the user, such as a sneeze or a calling voice, It is difficult to distinguish between a sound that is a source of sound and a sound that many audiences cheer at once.

  For this reason, the conventional technique has a problem in that shooting is performed even in a scene that has nothing to do with excitement. In addition, even if there is a climax at a position far from the user's position and a cheering sound, the sound of this cheering is detected as a sound with a low sound pressure level at the user's position, and is not determined as a swell. .

  The present invention has been made in view of the above, and an object of the present invention is to make it possible to more accurately detect a bulge at an arbitrary position in a wide area.

  In order to solve the above-described problem, the present invention relates to a communication unit that performs wireless communication, a position information acquisition unit that acquires position information, a sound acquisition unit that acquires surrounding sounds, and a sound pressure level of sound. A sound processing unit that transmits a notification including at least information indicating that the sound pressure level is equal to or higher than the threshold and position information based on the determination result, and a communication unit that is transmitted from another device. A storage unit that stores the received notification, and a notification when the number of notifications stored in the storage unit in a period from the current time to a past time by a predetermined time is greater than or equal to the predetermined number A determination unit that determines whether or not a climax region where a climax occurs is present based on position information corresponding to, and an imaging unit that performs imaging when the determination unit determines that a bulge region exists Shooting to control And a control unit.

  According to the present invention, it is possible to more accurately detect a swell at an arbitrary position in a wide area.

FIG. 1 is a diagram for explaining a rising area. FIG. 2 is a diagram illustrating an example when a camera including the imaging control device according to the embodiment is used. FIG. 3 is a block diagram illustrating a configuration example of the terminal device according to the embodiment. FIG. 4 is an exemplary functional block diagram illustrating functions of the terminal device according to the embodiment. FIG. 5 is a diagram schematically illustrating an example of the temporal transition of the sound pressure level. FIG. 6 is a flowchart illustrating an example of determination processing by the sound processing unit according to the embodiment. FIG. 7 is a diagram illustrating a configuration of an example of a notification transmitted to the transmission unit according to the embodiment. FIG. 8 is a flowchart illustrating an example of the imaging control process according to the embodiment. FIG. 9 is a diagram for explaining communication processing according to the embodiment. FIG. 10 is a diagram illustrating an example of mapping according to the embodiment. FIG. 11 is a diagram for explaining condition determination for a cluster according to the embodiment.

  Hereinafter, embodiments of an imaging control device, an imaging control program, and an imaging control method will be described in detail with reference to the accompanying drawings.

  The imaging control apparatus according to the embodiment detects a region where a swell is generated with high accuracy, and enables imaging of the detected swell region.

  First, the rising area will be described with reference to FIG. For example, consider a field 10 having a certain size such as a baseball field or a stadium and including a large number of people (audiences). It is assumed that many people are cheering in the field 11 within this field 10. Further, it is assumed that loud sounds (sneezing and calling in the example of FIG. 1) are generated by individuals at positions 12 and 13 in the field 10, respectively. These cheers in the region 11 and the sounds at the positions 12 and 13 can be recognized as loud sounds.

  Here, a user 1 who wants to take an image of a scene in which the climax in the field 10 is generated using the camera 2 is considered. The user 1 determines that the area 11 where many people are cheering is raised, and performs imaging in the direction of the area 11 by the camera 2. On the other hand, it is considered that the user 1 does not recognize a loud sound generated by an individual such as a sneeze or a call as an excitement and does not perform imaging. In other words, it can be recognized that the area is raised when the condition that loud sounds of a certain degree or more are generated simultaneously with a certain positional spread.

  On the other hand, since the area 11 is far from the position of the user 1, the user 1 may not hear cheers and may not be able to recognize the excitement. In this case, the user 1 misses the imaging chance of the scene where the excitement occurs.

  FIG. 2 shows an example of using the camera (terminal device) including the imaging control device according to the embodiment in the situation of FIG. 1 described above. In FIG. 2, a user 1 holds a terminal device 100 as an imaging control device according to the embodiment. In the field 10, it is assumed that there are a plurality of other users (audiences) holding the same terminal device 100. It is assumed that other users holding the terminal device 100 exist at random positions within a predetermined range (for example, spectator seats) in the field 10.

  The terminal device 100 includes a microphone, for example, and can collect sound. In addition, the terminal device 100 further includes a communication unit that can communicate within a range of several tens of meters, for example. The terminal device 100 is, for example, a multi-function mobile phone (smart phone). However, the terminal device 100 may be a digital camera that includes a communication function and a microphone. The terminal device 100 may be a tablet terminal that includes a communication function and a microphone.

  When the sound pressure level of the sound collected by the microphone exceeds a certain level, the terminal device 100 uses communication means to indicate that the sound pressure level has reached a certain level (referred to as ON information), A notification 16 including at least the position information of the terminal device 100 is transmitted (broadcast). Moreover, the terminal device 100 receives the notifications 16, 16,... Transmitted from the other terminal devices 100. The terminal device 100 determines an area that satisfies the excitement condition based on the received notification 16 and controls imaging based on the determination result.

  In the example of FIG. 2, the region 11 satisfies a condition of excitement because loud sounds of a certain level or more are generated simultaneously with a certain positional spread. Therefore, the terminal device 100 captures an image according to the detection of the swell with respect to the region 11. On the other hand, the position 12 and the position 13 satisfy the point that the sound is louder than a certain degree, but since the sound generation is pointy and does not have a certain positional spread, It is not determined to be. Therefore, the terminal device 100 does not perform imaging according to the sound generated at the position 12 or the position 13.

(Configuration according to the embodiment)
FIG. 3 shows an exemplary configuration of the terminal device 100 according to the embodiment. In FIG. 3, the terminal device 100 includes a CPU (Central Processing Unit) 110, a ROM (Read Only Memory) 111, a RAM (Random Access Memory) 112, a display control unit 113, a storage 115, and a data I / F 116. An input device 117, a communication I / F 118, a GPS (Global Positioning System) unit 120, an imaging unit 121, an audio acquisition unit 123, and an audio processing unit 124, which can communicate with each other via the bus 101. Connected to.

  The CPU 110 controls the overall operation of the terminal device 100 using the RAM 112 as a work memory in accordance with a program stored in advance in the ROM 111 or the storage 115. The storage 115 is a non-volatile semiconductor memory such as a flash memory. The storage 115 may be configured using a hard disk drive. The display control unit 113 generates a display signal that can be displayed by the display device 114 in accordance with the display control signal generated by the CPU 110 according to the program. The display device 114 includes, for example, an LCD and a drive circuit that drives the LCD, and displays a screen according to a display signal supplied from the display control unit 113.

  The input device 117 receives an input by a user operation, and is, for example, a touch panel configured integrally with the display device 114. The data I / F 116 is an interface capable of performing data communication by the wireless communication 130 in a range of about several tens of meters, for example, and performs communication based on, for example, Bluetooth (registered trademark). The communication I / F 118 performs wireless communication with a network such as a LAN (Local Area Network).

  The GPS unit 120 receives a GPS signal and acquires the current position as latitude / longitude information. The imaging unit 121 includes an image sensor such as a CCD (Charge Coupled Device), an optical system that irradiates light to the image sensor, a drive circuit of the image sensor, and image processing that converts a signal output from the image sensor into image data. Part. The imaging unit 121 performs imaging in accordance with an instruction from the CPU 110 and outputs image data.

  The sound acquisition unit 123 receives an analog sound signal output from the microphone 122, converts the input sound signal into digital sound data, and outputs the digital sound data. The voice processing unit 124 performs processing on the sound data output from the voice acquisition unit 123 according to an instruction from the CPU 110.

  FIG. 4 is a functional block diagram illustrating an example of functions of the terminal device 100 according to the embodiment. In FIG. 4, the terminal device 100 includes a receiving unit 1000, a transmitting unit 1001, a storage unit 1002, an imaging control unit 1003, a sound processing unit 1004, a position information acquisition unit 1005, a comparison unit 1006, and position information. A processing unit 1007 and a determination unit 1008 are included. These receiving unit 1000, transmitting unit 1001, storage unit 1002, imaging control unit 1003, sound processing unit 1004, position information acquisition unit 1005, comparison unit 1006, position information processing unit 1007, and determination unit 1008 are programs that run on the CPU 110. This is realized by (imaging control application). However, the present invention is not limited to this, and some or all of these units may be configured by independent hardware.

  The receiving unit 1000 receives a notification transmitted from another device by the data I / F 116. The transmission unit 1002 transmits a notification using the data I / F 116. The saving unit 1002 saves the notification received by the receiving unit 1000 in the storage 115 or the RAM 112. The imaging control unit 1003 controls the imaging unit 121 to perform imaging. The sound processing unit 1004 performs an analysis process on the sound data processed by the sound processing unit 124.

  The location information acquisition unit 1005 controls the GPS unit 120 to acquire location information. The comparison unit 1006 compares the notification received by the reception unit 1000 with the notification stored in the storage unit 1002. The position information processing unit 1007 performs predetermined processing on the position information acquired by the position information acquisition unit 1005. The determination unit 1008 determines whether or not a rising area exists using the processing result of the sound processing unit 1004, the processing result of the position information processing unit 1007, and the like.

  These receiving unit 1000, transmitting unit 1001, storage unit 1002, imaging control unit 1003, sound processing unit 1004, position information acquisition unit 1005, comparison unit 1006, position information processing unit 1007, and determination unit 1008 are stored in, for example, the storage 115 or the ROM 111. It is stored and realized by an imaging control application that runs on the CPU 110. This imaging control application is a file in an installable or executable format that is recorded on a computer-readable recording medium such as a CD (Compact Disk), a flexible disk (FD), or a DVD (Digital Versatile Disk). Is done.

  Further, the imaging control application executed by the terminal device 100 of the embodiment may be configured to be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. Further, the imaging control application executed by the terminal device 100 according to the embodiment may be configured to be provided or distributed via a network such as the Internet. Furthermore, the imaging control application of the embodiment may be configured to be provided by being incorporated in advance in the ROM 111 or the like.

  The imaging control application executed in the terminal device 100 according to the embodiment includes the above-described units (reception unit 1000, transmission unit 1001, storage unit 1002, imaging control unit 1003, sound processing unit 1004, position information acquisition unit 1005, comparison unit 1006). The module configuration includes a position information processing unit 1007 and a determination unit 1008). As actual hardware, the CPU 110 reads out and executes the imaging control application from a storage medium such as the storage 115 and the ROM 111, so that each unit described above is loaded on the main storage device such as the RAM 112, and the reception unit 1000 transmits Unit 1001, storage unit 1002, imaging control unit 1003, sound processing unit 1004, position information acquisition unit 1005, comparison unit 1006, position information processing unit 1007, and determination unit 1008 are generated on the main storage device. .

(Processing according to the embodiment)
As described above, the terminal device 100 according to the embodiment detects ambient sound, transmits a notification according to the detection result, and receives a notification based on the result of sound detection performed in another terminal device 100. To do. Sound processing in the terminal device 100 according to the embodiment will be described with reference to FIGS. 5 and 6.

FIG. 5 schematically shows an example of the temporal transition of the sound pressure level due to the sound collected by the microphone 122. In FIG. 5, the vertical axis represents the sound pressure level, and the horizontal axis represents time t. In the example of FIG. 5, the sound pressure level increases from a certain level while slightly moving up and down, and then decreases to the first level, as indicated by the characteristic line 200. Here, the sound pressure level in the range 201 ₁ and scope 201 ₃ of FIG. 5, for example, the audience bustle considered to be a noise component which is constantly generated. Moreover, the range 201 ₂ between the range 201 ₁ and scope 201 ₃ has a high sound pressure level for stationary noise, the possibility of the sound pressure level with the excitement.

The sound processing unit 1004 uses, for example, a predetermined area of the RAM 112 as a buffer memory, stores sound data for a predetermined time t _avg (for example, several seconds) in the buffer memory, and stores the sound data stored in the buffer memory. Perform analysis processing. Here, the sound processing unit 1004 calculates the average value avg of the sound pressure levels for the sound data for the time t _avg stored in the buffer memory. Then, the sound processing unit 1004 performs threshold determination on the calculated average value avg.

  FIG. 6 is a flowchart illustrating an example of determination processing by the sound processing unit 1004 according to the embodiment. First, the sound processing unit 1004 sets the value of the flag FLAG to 0 in step S10. In the next step S11, the sound processing unit 1004 calculates an average value avg of the sound pressure levels for the sound data currently stored in the buffer memory. In the next step S12, the sound processing unit 1004 determines whether or not the calculated average value avg exceeds the threshold th.

  If the sound processing unit 1004 determines that the average value avg of the sound pressure levels exceeds the threshold th, the process proceeds to step S13. In step S13, the sound processing unit 1004 confirms the value of the flag FLAG. If the sound processing unit 1004 determines that the value of the flag FLAG is 1, the process returns to step S11.

On the other hand, if the sound processing unit 1004 determines in step S13 that the value of the flag FLAG is 0, the sound processing unit 1004 shifts the processing to step S14. In this case, for example, it can be determined that the average value avg of the sound pressure level indicated at time t ₀ in FIG. 5 has changed from a state below the threshold th to a state exceeding the threshold th. Therefore, in step S14, the sound processing unit 1004 transmits a notification including ON information indicating that the average value avg of the sound pressure levels has exceeded the threshold value th in the direction in which the sound pressure level increases. In other words, the ON information indicates the rising timing when the average value avg of the sound pressure level has increased. Then, the sound processing unit 1004 updates the value of the flag FLAG to 1 in step S15, and returns the process to step S11.

  If the sound processing unit 1004 determines that the average value avg of the sound pressure levels is equal to or less than the threshold th in step S12 described above, the sound processing unit 1004 shifts the processing to step S16. In step S16, the sound processing unit 1004 confirms the value of the flag FLAG. If the sound processing unit 1004 determines that the value of the flag FLAG is 0, the sound processing unit 1004 returns the process to step S11.

On the other hand, if the sound processing unit 1004 determines that the value of the flag FLAG is 1 in step S16, the sound processing unit 1004 shifts the processing to step S17. In this case, for example, it can be determined that the average value avg of the sound pressure level indicated at time t ₁ in FIG. 5 has changed from a state exceeding the threshold th to a state equal to or less than the threshold th. Therefore, in step S17, the sound processing unit 1004 transmits a notification including off information indicating that the average value avg of the sound pressure levels has exceeded the threshold value th in a direction in which the sound pressure level is lowered. That is, the off information indicates the falling timing when the average value avg of the sound pressure level is lowered. Then, the sound processing unit 1004 updates the value of the flag FLAG to 0 in step S18, and returns the process to step S11.

  Note that a predetermined value can be used as the threshold th. Not limited to this, the threshold th can be set according to a user operation. Further, the threshold th may be determined by calibration based on the result of measuring the sound pressure level for a certain time, for example.

  FIG. 7 illustrates an exemplary configuration of a notification transmitted to the transmission unit 1001 according to the embodiment. In FIG. 7, the notification 50 includes application identification information 500, activation flag 501, on / off information 502, detection ID 503, terminal identification information 504, and position information 505.

  The application identification information 500 is identification information common to an application program (hereinafter referred to as an imaging control application) including each function of the terminal device 100 illustrated in FIG. The activation flag 501 is 1-bit information and indicates whether or not the notification 50 is transmitted when the imaging control application is activated. The on / off information 502 is 1-bit information, and any one of the above-described on information and off information is applied. The detection ID 503 is a different value for each transmission of the notification 50 including the ON information, and is generated using, for example, a random number. The terminal identification information 504 is information for identifying the terminal device 100, and for example, the device ID of the terminal device 100 can be used. The position information 505 is position information (latitude and longitude) acquired by the position information acquisition unit 1005.

  The notification 50 can be transmitted using, for example, iBeacon technology provided by Apple Inc., USA. iBeacon broadcasts using Bluetooth (registered trademark) Low Energy. In iBeacon, a UUID (Universally Unique Identifier), a major value, and a minor value are placed on the transmitted radio wave. The UUID is a 128-bit value, and the major value and the minor value are each 16-bit integer values. In the embodiment, for example, the application identification information 500 is determined according to the UUID. In addition, the activation flag 501 and the on / off information 502, the detection ID 503, and the terminal identification information 504 are included in the major value. Further, the position information 505 is included in the minor value.

  FIG. 8 is a flowchart illustrating an example of the imaging control process according to the embodiment. When the imaging control app according to the embodiment is activated by a user operation or the like in step S30, the imaging control app acquires location information by the location information acquisition unit 1005 and notifies the acquired location information in next step S31. 50 is transmitted by the transmission unit 1001. At this time, the transmission unit 1001 transmits the notification 50 with the activation flag 501 set to a value indicating that the notification 50 is a notification transmitted at the time of activation.

  In the next step S <b> 32, the imaging control application determines whether or not the notification 50 from the other terminal device 100 is received by the receiving unit 1000. If it is determined that it has not been received, the process returns to step S32. On the other hand, when the imaging control application determines that the notification 50 from the other terminal device 100 has been received, the imaging control application shifts the processing to step S33.

  In step S <b> 33, the imaging control application determines whether or not the detection ID 503 included in the received notification 50 is different from the detection ID 503 already acquired by the comparison unit 1006. When it is determined that the imaging control application does not differ according to the comparison result of the comparison unit 1006, that is, the notification 50 that includes the same detection ID 503 as the detection ID 503 included in the received notification 50 has been received, the process proceeds to step S32. Return to. At this time, the received notification 50 is discarded.

  On the other hand, if the imaging control application determines in step S33 that they differ according to the comparison result of the comparison unit 1006, the imaging control application shifts the processing to step S34. In step S34, the imaging control application retransmits the notification 50 received in step S32 as it is using the transmission unit 1001. Then, in the next step S35, the imaging control application causes the storage unit 1002 to store the notification 50 received in step S32 in, for example, the RAM 112 in association with the time stamp indicating the time when the notification 50 was received.

The process of step S32 to step S35 will be described in more detail with reference to FIG. As an example, consider terminal devices a to f each having a function of the terminal device 100. At this time, according to the flowchart of FIG. 6 described above, the terminal device a transmits a notification 300 corresponding to the notification 50 of FIG. 7 including the ON information as detection ID = ID ₁ and position information = pos ₁ in step S14. Shall. This notification 300 is received by, for example, the terminal devices b, c, and f (step S32).

For example, when the terminal device c determines that the notification including the detection ID equal to ID ₁ of the received notification 300 has not been received in the past, that is, the notification 300 has not been stored in the past in step S35. Are retransmitted as notification 301 with detection ID = ID ₁ and position information = pos ₁ (step S34). The terminal device c stores the notification 300 in association with the time stamp (step S35).

The notification 301 retransmitted from the terminal device c is received by, for example, the terminal devices e and d (step S32). For example, in the same manner as described above, the terminal device e determines that the notification including the detection ID equal to the detection ID = ID ₁ of the received notification 301 has not been received in the past, that is, has not been stored in the past in step S35. If this is the case (step S33), this notification 301 is retransmitted as it is as a notification 302 with detection ID = ID ₁ and position information = pos ₁ (step S34).

This notification 302 is received by the terminal devices c, d, and f, for example. Here, the terminal device c has received a notification including the same detection ID as the detection ID = ID ₁ of the received notification 302 as the notification 300 in the past. Therefore, the terminal device c discards the newly received notification 302 according to the determination in step S33.

  Thus, for example, the notification 300 transmitted from the terminal device a is relayed sequentially to other terminal devices capable of communication while maintaining the content. Accordingly, the terminal devices a to f can share the notification contents among the terminal devices a to f.

In the example of FIG. 9, the terminal device f receives notifications 300 and 302 including the detection ID = ID ₁ from the terminal devices a and e, respectively. In this case, since the route through which the notification is relayed is different between the notification 300 and the notification 302, the terminal device f causes the notification 300 and the notification 302 to be different at different timings due to a delay due to communication processing in each terminal device that passes through the notification 300 and the notification 302. It is considered to receive. Therefore, the terminal device f stores the notification received earlier, discards the notification received later, and avoids having duplicate notifications with the same detection ID.

  In the next step S 36, the imaging control application is detected by the position information processing unit 1007 based on the value of the activation flag 501 included in the notification 50 received in step S 32. It is determined whether or not the notification 50 is transmitted at the time of activation. When the imaging control application determines that the notification 50 is transmitted at the time of activation, the imaging control application shifts the processing to step S37.

  In step S37, the imaging control application updates the map by the position information processing unit 1007 based on the position information 505 included in the notification 50 received in step S32. In the next step S38, the imaging control application performs clustering processing based on the updated map by the position information processing unit 1007.

  The processing of step S37 and step S38 will be described in more detail. The position information processing unit 1007 performs mapping based on the position information 505 included in the notification 50 saved in step S35. FIG. 10 shows an example of mapping according to the embodiment. Each point shown in FIG. 10 corresponds to the position information 505, and FIG. 10 shows the latitude and longitude in the position information 505 included in each notification 50 as points on the xy coordinates.

  The position information processing unit 1007 performs clustering processing based on the mapped information, and classifies each position information 505 into clusters. In the example of FIG. 10, a state in which each piece of position information 505 is classified into three clusters 400, 401, and 402 is shown. As a clustering method, existing techniques such as an NN (Nearest Neighbor) method and a K-NN (K Nearest Neighbor) method can be used. If the position information processing unit 1007 determines in step S36 that the notification 50 is sent at startup, the position information processing unit 1007 executes the processing in steps S37 and S38.

  The imaging control application returns the process to step S32 after the process of step S38 ends.

  If the position information processing unit 1007 determines that the notification 50 received in step S32 is not the notification 50 transmitted at the time of activation in step S36 described above, the imaging control application shifts the processing to step S40. In step S40, the imaging control application determines whether the on / off information 502 included in the notification 50 received in step S32 indicates on information or off information.

  If the imaging control application determines that the on / off information 502 included in the notification 50 indicates off information, the imaging control application shifts the processing to step S50. In step S50, the imaging control application deletes the notification 50 having the same detection ID as the detection ID included in the notification 50 determined to indicate off-information from the notifications 50 stored in step S35 described above. To do. After the process of step S50, the imaging control application returns the process to step S32.

  On the other hand, if the imaging control application determines in step S40 that the on / off information 502 included in the notification 50 indicates on information, the imaging control application shifts the processing to step S41. In step S41, the imaging control application determines whether or not the position information processing unit 1007 has received a certain number of notifications 50 including ON information within a predetermined past time. When it is determined that the imaging control application has not received, the process returns to step S32. Note that it is conceivable that the certain number or more that is the determination condition in step S41 is determined as a ratio when the number of position information 505 included in the map updated in step S37 is used as a parameter.

  If the imaging control application determines in step S41 that a predetermined number of notifications 50 including ON information have been received within the past predetermined time, the process proceeds to step S42. In step S42, the imaging control application updates the map by the position information processing unit 1007, and performs clustering processing in the next step S43. Since the process of step S42 and step S43 is the same as the process of step S37 and step S38 mentioned above, description here is abbreviate | omitted.

  In the next step S44, the imaging control application determines whether or not the cluster classified as a result of the clustering process in step S43 satisfies a predetermined condition (swelling condition) by the determination unit 1008.

  The condition determination for the cluster according to the embodiment will be described with reference to FIG. FIG. 11 corresponds to FIG. 10 described above, and shows how the position information 505 is classified into three clusters 400, 401 ′, and 402 ′ by the clustering process in step S <b> 43. In the example of FIG. 11, position information 505 is added to the clusters 401 and 402 shown in FIG. 10 described above to form clusters 401 ′ and 402 ′.

  As described above, in the case where a loud sound of a certain level or more is generated simultaneously with a certain positional spread as described above, the position information processing unit 1007, for example, uses the position information included in the cluster. It can be considered that the determination is performed on the condition of the number of 505 and the spread of the cluster based on the position information 505.

  In the example of FIG. 11, the clusters 400, 401 ', and 402' include 4, 10, and 6 pieces of position information, respectively. If the threshold value for the number of pieces of position information 505 included in the cluster is eight, the clusters 400 and 402 'do not satisfy the condition and are excluded.

The determination unit 1008 determines the spread of the remaining cluster 401 ′. For example, the determination unit 1008 includes the maximum value x ₁ and the minimum value x ₀ of the x coordinate and the maximum value y ₁ and the minimum value y _{0 of the} y coordinate for the range 410 including the position information 505 included in the cluster 401 ′. And the spread is determined based on the obtained coordinate values. As an example, if it exceeds the difference between the maximum value x ₁ and the minimum value x ₀ of the x-coordinate, respectively determined the difference between the maximum value y ₁ and the minimum value y ₀ of the y-coordinate, the one threshold, spread It may be determined that the above condition is satisfied.

  Note that the climax condition is not limited to the number and spread of the position information 505 included in the cluster. For example, the area related to the cluster, the density of the position information 505 included in the cluster, and the like may be used as the rising condition.

  If the determination unit 1008 determines that the predetermined condition is not satisfied in step S44, the imaging control application returns the process to step S32. On the other hand, when the determination unit 1008 determines that the predetermined condition is satisfied in step S44, the imaging control application shifts the process to step S45. In step S45, the imaging control application controls the imaging unit 121 by the imaging control unit 1003 to perform imaging processing.

  At this time, it is preferable that the imaging control application performs imaging when the orientation of the imaging unit 121 is in a direction corresponding to the cluster 401 ′ that satisfies the climax condition. For example, in the example of FIG. 11, since the imaging unit 121 faces the cluster 401 ′ in the terminal device 100, imaging is performed by the imaging control application. On the other hand, the imaging control application does not perform imaging when, for example, the cluster 402 ′ in the direction in which the imaging unit 121 does not face satisfies the swell condition. For example, the direction of the imaging unit 121 may be detected by providing a direction detection mechanism using a gyro or the like in the terminal device 100.

  When the imaging process is performed in step S45, the imaging control application returns the process to step S32.

  As described above, the terminal device 100 according to the embodiment determines the presence / absence of swell and the location (direction) where the swell occurs based on the sound detection results of the other terminal devices 100. For this reason, it is possible to more accurately determine the swell, and it is also possible to cope with a swell that occurs at a distant position.

  The above-described embodiment is a preferred embodiment of the present invention, but is not limited thereto, and various modifications can be made without departing from the scope of the present invention.

50, 300, 301, 302 Notification 100 Terminal device 110 CPU
112 RAM
116 Data I / F
120 GPS unit 121 Imaging unit 122 Microphone 123 Audio acquisition unit 124 Audio processing unit 400, 401, 401 ′, 402, 402 ′ Cluster 500 Application identification information 501 Activation flag 502 On / off information 503 Detection ID
504 Terminal identification information 505 Position information 1000 Reception unit 1001 Transmission unit 1002 Storage unit 1003 Imaging control unit 1004 Sound processing unit 1005 Position information acquisition unit 1006 Comparison unit 1007 Position information processing unit 1008 Determination unit

JP-A-4-317039

Claims (8)

A communication unit for performing wireless communication;
A location information acquisition unit for acquiring location information;
A sound acquisition unit that acquires ambient sounds;
Sound processing for performing threshold determination on the sound pressure level of the sound, and transmitting a notification including at least information indicating that the sound pressure level is equal to or higher than the threshold and the position information based on the determination result by the communication unit And
A storage unit for storing the notification transmitted from another device and received by the communication unit;
When the number of notifications stored in the storage unit in a period from the current time to a past time by a predetermined time is equal to or more than a predetermined number, based on the position information corresponding to the notification A determination unit for determining whether or not there is a rising region where the rising is generated;
An imaging control apparatus comprising: an imaging control unit that controls the imaging unit to perform imaging when the determination unit determines that the swell area exists. Clustering based on the position information, and further comprising a position information processing unit for obtaining the number of the position information included in the cluster and the spread of the cluster among the clustered clusters,
The determination unit
The imaging control device according to claim 1, wherein among the clusters, a cluster in which the number and the spread are equal to or greater than a certain value is determined as the swell region. The position information processing unit
The position information is transmitted by the communication unit at startup,
Update the cluster with the location information transmitted at startup, transmitted from the other device and received by the communication unit,
The determination unit
3. The determination according to claim 2, wherein the determination is performed when a ratio of the number of notifications stored in the storage unit in the period of each cluster to a number of the position information included in each cluster is equal to or greater than a certain value. Imaging control device. The communication unit is
The imaging control apparatus according to claim 1, further transmitting the notification received from the other device. The sound processing unit
The imaging control device according to claim 1, wherein different identification information for each notification based on the determination result is added to the notification and transmitted by the communication unit. The communication unit is
When the identification information added to the notification received from the other device is different from the identification information added to the notification stored in the storage unit, the notification received from the other device and the The imaging control apparatus according to claim 5, further transmitting position information. A communication step for performing wireless communication;
A location information acquisition step for acquiring location information;
A sound acquisition step for acquiring ambient sounds;
Sound processing for performing threshold determination on the sound pressure level of the sound and transmitting a notification including at least information indicating that the sound pressure level is equal to or higher than the threshold and the position information based on the determination result through the communication step Steps,
A storage step of storing the notification transmitted from another device and received by the communication unit in a storage unit;
When the number of notifications stored in the storage unit in a period from the current time to a past time by a predetermined time is equal to or more than a predetermined number, based on the position information corresponding to the notification A determination step for determining whether or not there is a rising region where the rising has occurred;
An imaging control program for causing a computer to execute an imaging control step of controlling an imaging unit so as to perform imaging when it is determined in the determination step that the rising area is present. A communication step for performing wireless communication;
A location information acquisition step for acquiring location information;
A sound acquisition step for acquiring ambient sounds;
Sound processing for performing threshold determination on the sound pressure level of the sound and transmitting a notification including at least information indicating that the sound pressure level is equal to or higher than the threshold and the position information based on the determination result through the communication step Steps,
A storage step of storing the notification transmitted from another device and received by the communication unit in a storage unit;
When the number of notifications stored in the storage unit in a period from the current time to a past time by a predetermined time is equal to or more than a predetermined number, based on the position information corresponding to the notification A determination step for determining whether or not there is a rising region where the rising has occurred;
An imaging control method comprising: an imaging control step of controlling an imaging unit so as to perform imaging when it is determined by the determination step that the swell area exists.

Images