JP4533118B2 - Network camera and network camera audio playback method - Google Patents

Description

  The present invention relates to a network camera and a network camera audio reproduction method, and more particularly to a technique suitable for use in an audio reproduction function of a surveillance system, for example.

  Conventionally, in a monitoring system, a sound reproduction function such as sounding a warning sound for an intruder has become popular as an additional function. For example, in the “remote monitoring video security system” described in Patent Document 1, when an intruder is detected due to a change in the state of a sensor, voice transmission / reception is started and registered in the supervisor or the monitoring center device. A technique has been proposed in which sound is reproduced and transmitted to a place where a surveillance camera is installed.

JP 2002-245572 A

  However, since the above-mentioned Patent Document 1 requires a human to check the video change of the camera, the maintenance cost (personnel cost) becomes enormous, and there is a possibility that audio reproduction cannot be performed due to a human error.

  In addition, since the audio file to be reproduced is arranged at the center, there is a problem that the essential audio cannot be reproduced when communication between the monitoring camera and the center cannot be established. Furthermore, since the sound volume at the time of audio reproduction is transmitted from the center at each reproduction, there is a problem that the sound volume is not a preferable setting depending on the audio file to be reproduced and the installation status of the network camera.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to make it possible to reproduce sound at an appropriate volume according to an event without using an external device.

The network camera of the present invention includes a receiving unit that receives from the client terminal device an audio file to be played when the event detecting unit detects an event, and a first storage unit that stores the audio file received by the receiving unit. A granting unit for giving a file name that does not overlap a file name of another voice file stored in the first storage unit to the voice file received from the client terminal device; and the event detection unit includes a first event Of the first storage means is output from the speaker at a first volume, and when the event detection means detects a second event, the first sound file is output from the speaker . as a second audio file of the audio files in the storage means is output from the speaker in the second volume, said application means The file name assigned to the first audio file is associated with the first event and the first volume, and the file name assigned to the second audio file by the assigning means and the second A second storage means for storing the event and the second sound volume in association with each other, a sound file and a sound volume corresponding to the event detected by the event detection means are searched from the second storage means, And reproducing means for outputting a sound corresponding to the retrieved audio file from the speaker at the retrieved volume.

The network camera audio reproduction method of the present invention includes an event detection step for detecting an event, a reception step for receiving an audio file to be reproduced when the event detection step detects an event, from the client terminal device, and the reception step. A first storage step for storing the received audio file, and a file name that is not duplicated with a file name of another audio file stored in the first storage step is assigned to the audio file received from the client terminal device A first audio file out of the audio files stored in the first storage step when the event detection step detects the first speaker, and the event is output from the speaker at a first volume; The second of the audio files stored in the first storage step when the detection step detects the second event. As voice file is output from the speaker in the second volume, it associates the file name assigned to the first audio file by the application step and the first event the first volume, A second storage step of storing the file name, the second event, and the second volume assigned to the second loudspeaker in association with each other, and an event detected by the event detection step; A reproduction step of retrieving the sound file corresponding to the sound volume and the volume from the data stored in the second storage step, and outputting the sound corresponding to the retrieved sound file from the speaker at the retrieved volume. It is characterized by having.

The computer program of the present invention includes an event detection step for detecting an event, a reception step for receiving an audio file to be reproduced when the event detection step detects an event, from a client terminal device, and the audio received in the reception step. A first storing step of storing a file, and an assigning step of giving a file name that does not overlap with a file name of another audio file stored in the first storing step to the audio file received from the client terminal device; When the event detection step detects the first event, the first audio file among the audio files stored in the first storage step is output from the speaker at a first volume, and the event detection step includes Of the audio files stored in the first storage step when the second event is detected, the second audio file is stored. As Le is output from the speaker in the second volume, associates the file name assigned to the first audio file by the application step and the first event the first volume, the A second storage step of storing the file name, the second event, and the second volume assigned to the second audio file in association with each other, and an event detected by the event detection step A reproduction step of retrieving the sound file corresponding to the sound volume and the volume from the data stored in the second storage step, and outputting the sound corresponding to the retrieved sound file from the speaker at the retrieved volume. The computer is executed.

  The recording medium of the present invention records the computer program described above.

ADVANTAGE OF THE INVENTION According to this invention, the audio | voice according to an event can be reproduced | regenerated with the volume according to an event with the speaker with which a network camera is equipped. Thereby, the audio | voice and sound volume output from a speaker can be varied according to the detected event .

  According to another feature of the present invention, even when audio files having the same file name are received from a plurality of client terminal devices, they can be prevented from overlapping.

  According to another aspect of the present invention, the file name of the reproduced audio file is changed to the client terminal device even when the file name is managed so that the file name of the audio file from the client terminal device is not duplicated. Can be notified by the file name when the client terminal device transmits.

(First embodiment)
FIG. 1 is a block diagram illustrating an example of a client terminal and a network camera according to an embodiment of the present invention.
In FIG. 1, 101 is a CPU that performs overall control, 102 is a camera, 103 is a video signal processing unit that processes image signals input from the camera 102, and 104 is a display unit that displays images and displays for operation. , 105 is a display control unit that controls the display unit 104, and 106 is an operation unit that is operated by a user, including buttons, keys, and a digitizer for pen input.

  Reference numeral 107 denotes an encoding / decoding unit that performs encoding and decoding of images and sounds, and one or more of them may be implemented by software stored in the program memory 111.

  Reference numeral 108 denotes a microphone that captures an audio signal, 109 an audio signal processing unit that controls sound input / output, 110 a speaker that outputs an audio signal such as voice or key touch sound, 111 a program memory that stores a program, and 112 a data Is a data memory for storing flash memory, SRAM, DRAM, and the like. Reference numeral 113 denotes an external storage device that stores still images and moving images, and may be constituted by a semiconductor storage device. The program memory 111 in the network camera has a processing program for detecting movement based on an image signal acquired from the camera, and a processing program for detecting the input of sound from the microphone 108.

Reference numeral 114 denotes an external storage control unit that controls the external storage device 113, and reference numeral 115 denotes a communication control unit that communicates with an external device or a network by wire or wirelessly. Reference numeral 116 denotes a bus for connecting each unit, and the network camera receives an event signal from each sensor or a request from a client terminal device.
In the network camera, the configuration of the display unit 104, the display control unit 105, and the operation unit 106 may be omitted. In the client terminal device, the configurations of the camera 102 and the video signal processing unit 103 may be omitted.

FIG. 2 is a block diagram illustrating a detailed configuration of the audio signal processing unit 109.
In FIG. 2, 201 is an audio codec, 202 is an audio codec control unit for controlling the audio codec 201, 203 is a control line for connecting the audio codec control unit 202 and the audio codec 201, such as I2C or synchronous serial Composed.

  Reference numeral 204 denotes an audio data control unit that exchanges audio data with the audio codec 201, 205 denotes a buffer memory (fifo) in which audio data is temporarily stored, and 206 denotes a data line that connects the audio data control unit 204 and the audio codec 201. It consists of I2S etc. Reference numeral 207 denotes a DMAC (Direct Memory Access Controller) for transmitting and receiving data between the buffer memory (fifo) 205 and the data memory 112.

3 to 5 show user interfaces when registering audio playback conditions, audio files, and playback volume in the client terminal device.
As shown in FIG. 3, when playing back an audio file at regular intervals by a timer, the playback sound name, volume, and playback interval are designated and registered. On the other hand, in the reproduction of an audio file triggered by an external sensor, the reproduction sound name and volume are designated and registered for each sensor by specifying at least one of when the sensor is detected as ON or when the sensor is detected as OFF.

  FIG. 5 shows an example of an audio file registration method. This is an example in which the audio file name “c: ¥ chime.Wav” on the storage of the client terminal device is registered as the playback sound name “Chime”. When the transmission button 51 is pressed, the contents of the file and the playback sound name are transmitted to the network camera.

  FIGS. 6A and 6B are diagrams illustrating an example of an event table indicating event information for reproducing sound, which is stored in the data memory 112 of the network camera. As shown in FIG. 6A, the event table is composed of “event” that triggers audio reproduction, “file” to be reproduced, and “volume” during reproduction.

  Also, as shown in FIG. 6B, there is a possibility that duplication may occur if the file name used by the client terminal device is used as it is. The file name is adopted. FIG. 6B shows an example in which “Pet name” is used as the file name.

  The file name to be notified to the client when notifying that playback is in progress refers to a table composed of a table for determining the correspondence between the playback sound name (Pet name) on the user interface and the actual file name. Get.

  FIG. 7 is a diagram showing a state of communication between the client terminal device and the network camera regarding the operation of the audio file reproduction request of the client terminal device. It is assumed that the window shown in FIG. 4 is displayed on the client terminal device. The processing in FIG. 7 is performed by the CPU executing in accordance with a program stored in a memory or the like in advance in each of the client terminal device and the network camera. When the audio playback button 41 displayed as a microphone icon is pressed on the client terminal device, an audio file playback request is sent to the network camera (step S71). The audio file playback request includes the playback sound name.

  When the network camera receives the audio file reproduction request, the network camera starts reproducing the audio and transmits an audio file reproduction response (step S72). The audio file reproduction response includes whether or not the audio file reproduction is accepted and the reproduction volume.

  Next, the network camera sends an audio file playback notification to the currently connected client terminal device (step S73). The sound file playback notification includes the playback sound name and the volume of the sound being played back.

  When the client terminal device receives the notification during audio reproduction, the client terminal device displays an indication that the audio is being reproduced and a volume, or reproduces the corresponding audio file on the client. Or you may display like a graphic equalizer.

  When the audio playback button is repeatedly pressed on the client terminal device, the client sends an audio file playback request (step S74). If the instructed playback sound is being played back, the network camera increases the playback volume and sends an audio file playback response together with a new playback volume (step S75). The client looks at the playback volume during the audio file playback response, updates the display, and changes the volume of the audio being played back locally.

  When the reproduction of the audio file is completed by the network camera, an audio file reproduction end notification including the reproduction sound name is transmitted (step S76). Upon receiving the audio file reproduction end notification, the client terminal device confirms the reproduction sound name and stops the corresponding display during reproduction or the local audio file reproduction on the client.

FIG. 8 is a flowchart for explaining the procedure of the audio file reproduction event process in the network camera.
First, when an event such as motion detection or voice detection is detected, the event table is searched to determine whether the event exists in the event table. If no event is found, it is determined as an error. The sequence ends (step S801).

  If the event is found in the event table as a result of the determination in step S801, the process advances to step S802 to determine whether the sound is currently being reproduced.

  As a result of the determination, if it is determined that the sound is being reproduced, the process proceeds to step S803, and the priority of the sound currently being reproduced and the event based on the priority table stored in the data memory 112 (not shown). Compare the priorities corresponding to. As a result of this comparison, if it is determined that the currently played audio has a higher priority than the event, this sequence is terminated.

  If it is determined in step S803 that the priority of the event is higher than that of the currently reproduced audio, the process proceeds to step S804 and the reproduction is interrupted. In this embodiment, the priority order of events follows a predetermined one. Of course, a priority order may be designated when an audio file playback event is registered.

  On the other hand, if it is determined in step S802 that the audio is not currently being reproduced, and if the audio interruption process in step S804 is completed, the process proceeds to step S805, where the audio device is set to reproduce the audio corresponding to the event. . The audio device setting includes clearing of the buffer memory (fifo) 205, setting of the DMAC 207, setting of a buffer for storing audio data arranged in the data memory 112, setting of the audio codec 201 by the audio codec control unit 202, for example, event For example, the volume setting obtained from the table.

  When the setting of the audio codec is completed, reproduction of the audio file corresponding to the event is started (step S806).

  Next, in step S807, it is determined whether the client terminal device is connected. As a result of this determination, if there is no connected client terminal device, this sequence is terminated as it is. If the client terminal device is connected, the process advances to step S808 to notify the client terminal device that audio reproduction is in progress and complete this sequence.

  FIG. 9 shows a user interface for registering audio playback conditions, audio files, and playback volume by motion detection corresponding to a plurality of motion detection areas in the client terminal device. When a motion detection area is designated, a playback sound name, a volume and a motion are detected, at least one of the motion stops is designated and registered. This makes it possible to set the playback sound or the playback volume according to the detection area.

(Second Embodiment)
FIG. 10 is a flowchart for explaining a processing procedure for receiving and playing back audio data from a client terminal device in the network camera.
First, it is determined whether or not sound reproduction is in progress (step S1001). If the result of this determination is that audio playback is in progress, playback is stopped (step S1002).

  Next, in step S1003, it is determined whether or not the received voice data is a file request (step S1003). If the file is a file request, the file is opened (step S1004).

  In step S1005, an audio device is set. Thereafter, it is determined whether or not audio data transmitted from the client terminal device has been received (step S1006). If the received data has not arrived as a result of this determination, the audio data receiving process (step S1006) is continued again.

  On the other hand, if the audio data is received as a result of the determination in step S1006, the reproduction process is executed by writing the received data to the audio device (step S1007).

  Next, the process proceeds to step S1008, where it is determined again whether or not it is a request for filing, and if it is a filing request, the received data is written to the file (step S1009), and then the voice data is received (step S1006). Return again.

  On the other hand, as a result of the determination in step S1006, if it is determined that the reception of the audio data is completed, the process proceeds to step S1010, and the audio device is closed. The closing of the audio device is a process for ending the setting of the audio codec 201 by the audio codec control unit 202, such as stopping the DMAC 207, releasing a buffer for storing audio data arranged in the data memory 112, and setting the volume to 0. .

  Next, it is determined again whether it is a file conversion request (step S1011), and if it is a file conversion request, the file is closed (step S1012). Thereafter, the file table is updated (step S1013), the event table is further updated (step S1014), and this sequence ends.

(Another embodiment according to the present invention)
Each means constituting the audio output device and each step of the audio output method in the embodiment of the present invention described above can be realized by operating a program stored in a RAM or ROM of a computer. This program and a computer-readable storage medium storing the program are included in the present invention.

  Further, the present invention can be implemented as, for example, a system, apparatus, method, program, or recording medium, and can be applied to a system composed of a plurality of devices. Moreover, you may apply to the apparatus which consists of one apparatus.

  In the present invention, a software program (in the embodiment, a program corresponding to the flowcharts shown in FIGS. 8 and 10) for realizing the functions of the above-described embodiments is directly or remotely supplied to the system or apparatus. In addition, it includes the case where the system or the computer of the apparatus is also achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of an object code, a program executed by an interpreter, script data supplied to the OS, or the like.

  As a recording medium for supplying the program, for example, floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card ROM, DVD (DVD-ROM, DVD-R) and the like.

  As another program supply method, a client computer browser is used to connect to an Internet homepage, and the computer program itself of the present invention or a compressed file including an automatic installation function is downloaded from the homepage to a recording medium such as a hard disk. Can also be supplied.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, the present invention includes a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. It is also possible to execute the encrypted program by using the key information and install the program on a computer.

  In addition to the functions of the above-described embodiments being realized by the computer executing the read program, the OS running on the computer based on the instructions of the program is used for the actual processing. The functions of the above-described embodiment can be realized by performing some or all of the processes.

  Furthermore, after the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion board or The CPU or the like provided in the function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

1 is a block diagram illustrating a configuration example of an audio output device according to a first embodiment of this invention. FIG. FIG. 3 is a block diagram illustrating a detailed configuration example of an audio signal processing unit according to the first embodiment of this invention. It is a figure which shows the 1st Embodiment of this invention and shows an example of GUI which registers timer audio | voice file reproduction | regeneration. It is a figure which shows the 1st Embodiment of this invention and shows an example of GUI which performs the audio | voice file reproduction | regeneration by the instruction | indication of a client. It is a figure which shows the 1st Embodiment of this invention and shows GUI of an example of the registration method of an audio | voice file. It is a figure which shows the 1st Embodiment of this invention and shows an example of an event table and a reproduction | regeneration sound name table. It is a figure which shows the 1st Embodiment of this invention and demonstrates the communication procedure of a client and a network camera. It is a flowchart which shows the 1st Embodiment of this invention and demonstrates an audio | voice file reproduction | regeneration event processing procedure. It is a figure which shows the 1st Embodiment of this invention and shows an example of the GUI of the audio | voice file reproduction registration by the motion detection corresponding to several motion detection area | regions. It is a flowchart which shows the 2nd Embodiment of this invention and demonstrates the procedure which receives audio | voice data, and reproduces | regenerates it into a file.

Explanation of symbols

101 CPU
102 Camera 103 Video signal processor (VPB)
104 Display Unit 105 Display Control Unit 106 Operation Unit 107 Encoding / Decoding Unit 108 Microphone 109 Audio Signal Processing Unit 110 Speaker 111 Program Memory 112 Data Memory 113 External Storage Device 114 External Storage Control Unit 115 Communication Control Unit 116 Bus 201 Audio Codec 202 Audio codec control unit 203 Control line 204 Audio data control unit 205 Buffer memory (fifo)
206 Data line 207 DMAC

Claims (10)

Receiving means for receiving from the client terminal device an audio file to be played when the event detecting means detects an event;
First storage means for storing an audio file received by the receiving means;
An assigning unit that gives a file name that is not duplicated to a file name of another audio file stored in the first storage unit to the audio file received from the client terminal device;
When the event detection means detects a first event, a first audio file of the first storage means is output from a speaker at a first volume, and the event detection means is a second event. Is added to the first sound file by the assigning means so that a second sound file of the sound files of the first storage means is output from the speaker at a second sound volume. The file name is associated with the first event and the first volume, and the file name assigned to the second audio file by the assigning means is associated with the second event and the second volume. Second storage means for storing the information;
An audio file and a volume corresponding to the event detected by the event detection unit are searched from the second storage unit, and an audio corresponding to the searched audio file is output from the speaker at the searched volume . A network camera.   The network camera according to claim 1, wherein the event detected by the event detection unit includes at least one of an instruction from a client terminal device, motion detection, and voice detection.   The network camera according to claim 2, wherein the reproduction unit increases the reproduction volume when an instruction from the client terminal device is continuously detected. An event detection process for detecting an event;
A reception step of receiving an audio file to be reproduced when the event detection step detects an event from a client terminal device;
A first storage step for storing the audio file received in the reception step;
An assigning step of assigning a file name that does not overlap with a file name of another audio file stored in the first storage step to the audio file received from the client terminal device;
When the event detection step detects the first event, the first audio file among the audio files stored in the first storage step is output from the speaker at a first volume, and the event detection step When the second event is detected, the second audio file is output from the speaker at the second volume among the audio files stored in the first storage step. The file name given to the audio file, the first event, and the first volume are associated with each other, and the file name, the second event, and the first event given to the second audio file by the assigning step. A second storage step for storing the volume of 2 in association with each other;
An audio file and a volume corresponding to the event detected by the event detection step are searched from the data stored in the second storage step, and an audio corresponding to the searched audio file is searched at the searched volume. A network camera sound reproduction method comprising: a reproduction step of outputting from the speaker .   5. The network camera audio reproduction method according to claim 4, wherein the event detected in the event detection step includes at least one of an instruction from a client terminal device, motion detection, and audio detection. An event detection process for detecting an event;
A reception step of receiving an audio file to be reproduced when the event detection step detects an event from a client terminal device;
A first storage step for storing the audio file received in the reception step;
An assigning step of assigning a file name that does not overlap with a file name of another audio file stored in the first storage step to the audio file received from the client terminal device;
When the event detection step detects the first event, the first audio file among the audio files stored in the first storage step is output from the speaker at a first volume, and the event detection step When the second event is detected, the second audio file is output from the speaker at the second volume among the audio files stored in the first storage step. The file name given to the audio file, the first event, and the first volume are associated with each other, and the file name, the second event, and the first event given to the second audio file by the assigning step. A second storage step for storing the volume of 2 in association with each other;
An audio file and a volume corresponding to the event detected by the event detection step are searched from the data stored in the second storage step, and an audio corresponding to the searched audio file is searched at the searched volume. A computer program for causing a computer to execute a reproduction step of outputting from the speaker . Determining means for determining whether a priority corresponding to an event newly detected by the event detecting means is higher than a priority of audio data being reproduced by the reproducing means;
When the playback unit determines that the priority corresponding to the event newly detected by the event detection unit is higher than the priority of the audio file being played back by the playback unit, the playback unit Interrupt the playback of the audio file, play the audio file corresponding to the newly detected event,
If it is determined that the priority of the audio file being played back by the playback means is higher than the priority corresponding to the event newly detected by the event detection means, the voice corresponding to the newly detected event The network camera according to claim 1, wherein the file is not reproduced. A determination step of determining whether or not a priority corresponding to the event newly detected by the event detection step is higher than a priority of audio data being reproduced by the reproduction step;
In the reproduction step, when it is determined that the priority corresponding to the event newly detected by the event detection step is higher than the priority of the audio file being reproduced by the reproduction step, Interrupt the playback of the audio file, play the audio file corresponding to the newly detected event,
If it is determined that the priority of the audio file being reproduced by the reproduction step is higher than the priority corresponding to the event newly detected by the event detection step, the audio corresponding to the newly detected event 5. The network camera audio reproduction method according to claim 4, wherein the file is not reproduced. Third storage means for storing the file name of the audio file received from the client terminal device in association with the file name assigned by the assigning means to the received audio file;
Notification means for notifying the client terminal device of the file name of the audio file received from the client terminal device with reference to the third storage means as the file name of the audio file reproduced by the reproducing means. The network camera according to claim 1. A third storage step of storing the file name of the audio file received from the client terminal device in association with the file name assigned to the received audio file in the assigning step;
Notification for notifying the client terminal device of the file name of the audio file received from the client terminal device with reference to the data stored in the third storage step as the file name of the audio file reproduced by the reproducing step 5. The network camera audio reproducing method according to claim 4, further comprising: a step.

Images