JP2005080100A - Movement monitoring system and movement monitor terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To construct a monitor system with retained security at low cost capable of forming a monitor image viewable in real time with an enlarged monitoring area without a dead angle at the time of monitoring. <P>SOLUTION: The monitor system includes an image data storage server 6a connected to a communication network 5, and having an authentication function and an encryption processing function; a radio base station 3a, 3b connected to the communication network 5; a moving monitor terminal 2 having a moving means, an imaging portion, an authentication function, an encryption processing function, and a radio communication function; and a radio terminal 1 performing radio communication with the moving monitor terminal 2, and having authentication and encryption processing functions. By an instruction from either the radio terminal 1 or the image data storage server 6a, the moving monitor terminal 2 is remotely controlled to move in the monitoring area. Image data captured by the imaging portion of the moving monitor terminal 2 are transmitted to the data storage server 6a, and stored therein. The image data are also displayed and monitored on a monitor 7. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a mobile monitoring system and a mobile monitoring terminal using wireless communication technology and network technology.

  As a conventional technique of the monitoring system, for example, an example of a building management system and a video monitoring system as shown in FIG. 15 is disclosed (for example, see Patent Document 1).

  In the conventional building management system and video monitoring system shown in FIG. 15, a video monitoring system 61, a monitor device 62, a disaster prevention system 64, a security system 65, an air conditioning system 66, and a power distribution system 67 are connected via a network 63. In particular, the video monitoring system 61, the monitor device 62, the disaster prevention system 64, and the security system 65, which are configured and connected to the network 63, constitute a monitoring system.

  Here, the video monitoring system 61 includes at least a sensor group 602 such as a security sensor 602c, a flame sensor 602b, and a smoke sensor 602a for detecting abnormality in disaster prevention and crime prevention, and a monitoring camera group 603 such as monitoring cameras 603a to 603c, A subsystem controller 601 to which the sensor group 602 and the monitoring camera group 603 are connected is configured. The monitoring camera group 603 is driven by an abnormal signal input from the sensor group 602 to capture a video signal, the video signal of the monitoring camera is compressed or subjected to video signal processing by pattern recognition, and the video is displayed on the monitor device 62. It is supposed to perform the operation.

  As another conventional technique, for example, an example of a mobile monitoring robot system in a nuclear power plant as shown in FIG. 16 is disclosed (for example, see Patent Document 2).

  The mobile monitoring robot system shown in FIG. 16 includes a voice input / output microphone 73, a speaker 74, an operator monitor, and an operator console 72 that controls and monitors a mobile inspection monitoring robot 71 that can run freely in a nuclear power plant. A display system 75 is provided, and an audio data processing device 76 is provided inside the operator console 72. A voice command is sent from the speaker 77 (77a to 77c) of the information processing device 84 (84a to 84c) to the robot 71 via a signal transmission cable that penetrates the partition wall 82 such as concrete.

  The robot 71 includes a traveling carriage 78 as an information processing sensor, an information processing system 81 including two TV cameras, a reception microphone, and a transmission speaker, and a sensor housing 80. Then, the voice command is captured by the reception microphone of the information processing system 81 and processed by signal processing, and the voice input / output device 84 (84a to 14c) is received from the transmission speaker of the information processing system 81 in accordance with the voice command. The response is made to the console 72 via the microphone 79 (79a to 79c). By the response by the voice, the work is performed while checking the inspection and monitoring work of the movement of the robot 71 and the measuring object 85 and the like.

  Furthermore, as another prior art, for example, an example of a remote monitoring system in a nuclear power plant as shown in FIG. 17 is disclosed (see, for example, Patent Document 3).

  In this remote monitoring system, the flight-type monitoring robot 91 is equipped with various sensors such as a camera and a microphone, and is fixed in a standby state in safety hangars 93a to 93c in a sealed room 90 where a normal person cannot enter. When an abnormality occurs, the fixing mechanism 95 of the robot 91 is released by the operation of the fixing mechanism release switch 94 provided outside the sealed room 90, thereby starting monitoring from various viewpoints by flying in the air. The flying surveillance robot 91 is controlled by a signal received from the controller antenna 97 of the controller 96 outside the sealed room 90. The position of the flying surveillance robot 91 is detected by communication between the fixed radio wave transmitter / receiver 98 installed in the sealed room 90 and the robot 91.

  By the way, in recent years, mobile communication using mobile phone devices, Internet communication using personal computers, and the like have become widespread, and various and economical communication services have been provided. On the other hand, crimes such as theft, picking and ATM theft, and shoplifting in stores such as supermarkets, department stores, and convenience stores are becoming commonplace. In addition, due to the rapid aging of the population, there is a need to economically monitor the situation of elderly people in the home, the situation of tight doors, or monitoring and intrusion monitoring in homes, stores and offices from a remote location. It is growing. Therefore, it is conceivable to perform such monitoring using the above-described conventional video monitoring system, remote monitoring system, or the like.

  However, in the above conventional video surveillance system, since the surveillance terminal is generally fixed on the ceiling or the like, the surveillance area is fixed. Even if the pedestal of the surveillance camera is a rotary type, the surveillance area is within the movable range of zoom and camera angle. In addition, there are problems such as the fact that there is a blind spot area for monitoring in the shadow when there are visibility obstructions such as display shelves and furniture. In addition, in order to avoid the generation of the blind spot area, many surveillance cameras have to be installed, and the price of the system tends to be expensive.

  In addition, the above conventional mobile monitoring robot system uses a microphone and a speaker twice on the transmission side and the reception side in order to give mobility to a mobile monitoring facility such as a camera. Since the pattern recognition comparison result of the video and the registered video is converted into audio transmission information and sent to the control monitor side, the direct monitoring video cannot be seen in real time. In addition, since it is a remote-controlled mobile monitoring robot using voice via a wired cable, cable wiring to a control monitor device and a microphone or speaker that is fixedly installed on the ceiling is required, as well as a broadcast speaker and a receiving microphone. In some cases, the movement range was limited to a range where the voice could reach clearly.

  Moreover, in the example of the conventional flight-type remote monitoring system, since it is configured by a dedicated flight-type monitoring robot and a wireless communication system, the price of the system becomes very expensive.

  Furthermore, the conventional monitoring system has only a one-way sensing data collection and does not have a function of providing voice and video data bidirectionally.

JP 11-213272 A (paragraphs [0013] to [0049]) JP-A-6-87204 (page 2-4) Japanese Patent Laid-Open No. 10-288689 (paragraphs [0018] to [0100])

  The present invention has been made in view of the above circumstances, can be constructed at low cost while maintaining the security of the system, can eliminate the blind spot at the time of monitoring, can widen the monitoring area, and can further monitor video in real time. An object is to provide a mobile monitoring system and a mobile monitoring terminal that can be seen.

  The movement monitoring system of the present invention includes a wireless terminal having wireless communication means for performing wireless communication with a communication network, an imaging means for acquiring video information, a moving means for moving the own apparatus, the communication network, and the wireless A mobile monitoring terminal having wireless communication means for performing wireless communication with the terminal; data storage means for storing data including the video information; and a data storage server having communication means for communicating with the communication network. The mobile monitoring terminal performs authentication between the encryption means for encrypting the communication data including the video information and the communication partner including the wireless terminal or the data storage server after the authentication according to an instruction from the authentication destination. Image data obtained by the imaging unit and encrypted by the encryption unit is controlled by the operation control including a moving operation by the unit. It is obtained by a control means for transmitting to the product server.

  With this configuration, a communication network, a data storage server, a wireless terminal, or the like that is commonly used is used, and communication between the mobile monitoring terminal and the data storage server, a wireless terminal and a mobile monitoring terminal, or a wireless terminal An existing communication means that is widely used for communication with a base station or the like can be used, and a monitoring system that can monitor a video in a predetermined area in real time can be easily and inexpensively constructed. In addition, a communication system with high spread can be obtained by using an existing authentication function and encryption communication function for communication between the mobile monitoring terminal and the data storage server, and communication between the wireless terminal and the mobile monitoring terminal or the wireless base station. Even if it is used, privacy-related information such as images cannot be seen or abused by a third party, and monitoring of homes, stores, offices, etc. can be performed safely day and night. In addition, the mobile monitoring terminal can be remotely operated from a wireless terminal or a data storage server to move the imaging range of the video information, so it is possible to remotely monitor and control the state of homes, stores, offices, etc. While expanding the area and increasing the degree of freedom, it is possible to eliminate the blind spot area at the monitoring site.

  Moreover, as one aspect of the present invention, in the above movement monitoring system, the movement monitoring terminal further includes sound collection means for acquiring sound information, and the data storage server includes the movement monitoring in the data storage means. Also included are those that store data including video information and sound information acquired by a terminal.

  With this configuration, since not only video information but also audio information can be used as monitoring information, it is possible to improve the sense of reality at the monitoring site and comprehensive understanding of the situation, and to improve the quality of monitoring.

  Further, as one aspect of the present invention, in the above mobile monitoring system, voice recognition means for performing voice recognition, voice response means for generating response information corresponding to the voice recognition result, communication with the communication network The mobile monitoring terminal includes sound collecting means for acquiring sound information and sound output means for outputting sound, and the sound information acquired by the sound collecting means is The sound output unit includes a sound that is transmitted to the sound processing server and outputs sound based on the response information received from the sound processing server.

  With this configuration, video information and audio information can be transmitted and received in both directions, so it is possible to identify audio request information from the monitoring site and perform an appropriate audio response from the mobile monitoring terminal. It is possible to realize a system capable of communicating with a supervisor or a user on the monitoring side, and to enhance the function of the monitoring system.

  Further, as one aspect of the present invention, in the above mobile monitoring system, content storage means for storing AV content including at least one of sound information and image information, and communication means for communicating with the communication network The mobile monitoring terminal includes a sound output unit that outputs a sound, and the sound output unit outputs a sound based on the sound information received from the AV content server.

  With this configuration, it is possible to provide not only monitoring by unidirectional information transmission of video and audio but also an on-demand service for sending appropriate AV content such as requested audio and music to the mobile monitoring terminal by the AV content server. In addition, AV contents including sound information can be appropriately acquired and used in the mobile monitoring terminal.

  Further, as one aspect of the present invention, in the above mobile monitoring system, content storage means for storing AV content including at least one of sound information and image information, and communication means for communicating with the communication network The mobile monitoring terminal includes an image projecting unit that projects an image, and the image projecting unit projects an image based on image information received from the AV content server.

  With this configuration, not only monitoring by unidirectional information transmission of video and audio but also AV content transmitted from the AV content server in the mobile monitoring terminal can be projected and reproduced as video, and AV content including video information Can be provided to a plurality of users on a large screen, for example.

  Note that the AV content server may be configured to have a function of simultaneously processing a plurality of contents such as voice, music, and video data. In this case, the AV content server can provide the mobile monitoring terminal with comprehensive AV content such as voice, musical sound, and video data that have been subjected to complex processing at the same time.

  Further, as one aspect of the present invention, in the above mobile monitoring system, charging processing means for performing charging processing on various information transmitted to or received from the mobile monitoring terminal, and communication with the communication network A thing provided with the accounting server which has a communication means is also contained.

  With this configuration, it is possible to easily perform charging processing related to transmission / reception of information such as charging for various information provided to the mobile monitoring terminal and charging for various information received and stored from the mobile monitoring terminal. It can be easily collected together with communication costs.

  Further, as one aspect of the present invention, in the above movement monitoring system, the movement monitoring terminal moves or arbitrarily moves a predetermined route according to an instruction from the wireless terminal or the data storage server by the moving unit. The one that moves to the position is also included.

  With this configuration, the movement of the mobile monitoring terminal can be remotely controlled by the wireless terminal or the data storage server, the blind spot area can be eliminated, and the desired position can be monitored.

  The moving means is, for example, a ceiling or aerial orbit type moving means provided with a track on the ceiling or in the air, a vehicle type moving means such as a minicar moving on the floor, or a walking type moving means such as a robot. Various moving forms can be realized by using a flying type moving means such as a mini-balloon or a ship type moving means such as a boat. Moreover, you may use the structure which performs the movement which combined the some movement form of these. As a result, it is possible to appropriately select the movement method and the movement area of the movement monitoring terminal, increase the degree of freedom of movement, expand the monitoring area, and eliminate the blind spot of monitoring.

  Moreover, as one aspect of the present invention, in the above mobile monitoring system, the wireless communication unit that performs wireless communication between the mobile monitoring terminal and the wireless terminal includes a short-range wireless communication that performs short-range communication. Those including communication means are also included. Examples of short-range wireless communication means include Bluetooth, UWB, and wireless LAN.

  With this configuration, depending on the distance between the mobile monitoring terminal and the wireless terminal, the communication infrastructure circumstances around the monitoring location, the communication load of the mutual communication information and the monitoring information, etc., the movement through the short-range wireless communication means and the wireless base station It is possible to construct a monitoring system by appropriately selecting and using wireless communication means such as switching between body communication means.

  The mobile monitoring terminal according to the present invention includes an imaging unit that acquires video information, a moving unit that moves the device itself, a wireless communication unit that performs wireless communication with a communication network and other wireless terminals, and a communication that includes the video information. After the authentication between the encryption means for encrypting the data and the communication partner including at least one of the wireless terminal and the data storage server for storing the data including the video information, the movement is performed according to an instruction from the authentication destination. Control means for performing operation control including movement operation by means, and transmitting the video data acquired by the imaging means and encrypted by the encryption means to the data storage server.

  With this configuration, a communication network, a data storage server, a wireless terminal, or the like that is commonly used is used, and communication between the mobile monitoring terminal and the data storage server, a wireless terminal and a mobile monitoring terminal, or a wireless terminal Existing communication means that are widely used for communication with a base station or the like can be used, and a monitoring system that can monitor video in a predetermined area in real time by this mobile monitoring terminal can be easily and inexpensively constructed. In addition, system security can be ensured by using an authentication function and an encryption communication function during communication. In addition, remote monitoring control can be performed by remotely operating the mobile monitoring terminal from a wireless terminal, a data storage server, etc., and the mobile monitoring terminal can be arbitrarily moved to expand the monitoring area and increase the degree of freedom. At the same time, it is possible to eliminate the blind spot area at the monitoring site.

  Further, as one aspect of the present invention, the mobile monitoring terminal further includes sound collecting means for acquiring sound information, and the video information acquired by the imaging means and the sound information acquired by the sound collecting means are This includes data sent to the data storage server.

  With this configuration, since not only video information but also audio information can be used as monitoring information, it is possible to improve the sense of reality at the monitoring site and comprehensive understanding of the situation, and to improve the quality of monitoring.

  According to another aspect of the present invention, the mobile monitoring terminal includes a sound collecting unit that acquires sound information and a sound output unit that outputs sound, and the sound information acquired by the sound collecting unit is A sound that is transmitted to a speech processing server having a recognition function and a speech response function that generates response information corresponding to the speech recognition result, and that outputs sound based on the response information received from the speech processing server by the sound output means. included.

  With this configuration, video information and audio information can be transmitted and received in both directions, so it is possible to identify audio request information from the monitoring site and perform an appropriate audio response from the mobile monitoring terminal. It is possible to realize a system capable of communicating with a supervisor or a user on the monitoring side, and to enhance the function of the monitoring system.

  According to another aspect of the present invention, the mobile monitoring terminal further includes a sound output unit that outputs sound, and is received from an AV content server that provides AV content including at least one of sound information and image information. What outputs the sound based on sound information by the said audio | voice output means is also contained.

  With this configuration, not only monitoring by unidirectional information transmission of video and audio, but also AV content including sound information such as playback of AV content such as audio and music provided by the AV content server on a mobile monitoring terminal, etc. It can be acquired and used as appropriate.

  According to another aspect of the present invention, the mobile monitoring terminal includes an image projecting unit that projects an image, and is received from an AV content server that provides AV content including at least one of sound information and image information. What projects the image based on image information by the said image projection means is also contained.

  With this configuration, not only monitoring by unidirectional information transmission of video and audio, but also projection and playback of AV content images provided by the AV content server on the mobile monitoring terminal, for example, to multiple users on a large screen AV content including video information can be acquired and used as appropriate.

  Further, as one aspect of the present invention, in the above mobile monitoring terminal, a predetermined route is determined by the moving means according to an instruction from a communication partner including at least one of the wireless terminal and the data storage server. Those that move or move to any position are also included.

  With this configuration, the movement monitoring terminal can be moved by remote operation based on an instruction from the wireless terminal or the data storage server, the blind spot area can be eliminated, and a desired position can be monitored.

  According to the present invention, a mobile monitoring system that can be constructed at low cost while maintaining the security of the system, can eliminate a blind spot at the time of monitoring, can widen a monitoring area, and can view a monitoring video in real time. And a mobile monitoring terminal.

(First embodiment)
FIG. 1 is a diagram showing a schematic configuration of a mobility monitoring system for explaining a first embodiment of the present invention.

  The mobile monitoring system according to the first embodiment includes a communication network 5, a video data storage server 6a and radio base stations 3a and 3b connected to the communication network 5, and a monitor connected to the video data storage server 6a. 7, a wireless terminal 1 in a house or store 11, and a movement monitoring terminal 2 a.

  FIG. 2 is a diagram showing an internal configuration of the mobile monitoring terminal 2a shown in FIG. The movement monitoring terminal 2a includes a data processing unit 14, a radio unit 18, and a moving unit 50. The wireless unit 18 includes an antenna duplexer 15, a receiving unit 16, and a transmitting unit 17. The data processing unit 14 includes an authentication unit 20, a power control unit 4, a baseband processing unit 19, an encryption processing unit 21, a data compression unit 22, A video signal processing unit 24 and an imaging unit 25 constituting a surveillance camera are included. The moving unit 50 includes a movement control unit 32, a position / distance line marker sensor unit 33, and a movable mechanism unit 34. As the external configuration of the movement monitoring terminal 2a, a walking robot type imitating an animal or the like as shown in the figure can be used.

  When the movement monitoring terminal 2a moves, the distance information from the object obtained from the position distance line marker sensor unit 33 of the moving unit 50, the detection information of the line marker on the floor surface, and the baseband processing unit 19 are used. Based on the received command information, the movement control unit 32 determines the movement distance and movement direction, and the movable mechanism unit 34 is controlled and driven to move the position of the terminal itself.

  In the mobile monitoring terminal 2a, only the receiving unit 16, the baseband processing unit 19 and the authentication unit 20 of the radio unit 18 are energized by the power control unit 4 during standby, and the other circuits are not energized and are stopped. is there. When the entire power ON command is received from the wireless terminal 1 and activated, the power supply control unit 4 energizes circuits other than the reception unit 16, the baseband processing unit 19, and the authentication unit 20 of the wireless unit 18.

  The mobile monitoring terminal 2a called from the wireless terminal 1 receives a radio wave by the receiving unit 16 of the wireless unit 18, and establishes a communication path by authenticating and confirming a communication partner with the baseband processing unit 19 and the authenticating unit 20. To do. The monitoring video obtained by the imaging unit 25 is digital signal processed by the video signal processing unit 24, compressed by the data compression unit 22, encrypted by the encryption processing unit 21, and then passed through the baseband processing unit 19. Is transmitted from the transmission unit 17 of the wireless unit 18.

  FIG. 3 is a diagram showing an internal configuration of the video data storage server 6a shown in FIG. The video data storage server 6a includes a communication network connection unit 35, a server control unit 36, an authentication unit 37, an encryption processing unit 38, and a data storage unit 39. When the video data storage server 6a is called through the communication network 5 shown in FIG. 1, the server control unit 36 is called through the communication network connection unit 35, and the authentication unit 37 operates to perform authentication confirmation with the connection partner. The encrypted received data is encrypted and decrypted, and various encrypted and decrypted data are stored in the data storage unit 39.

  Next, the operation in the mobility monitoring system of the first embodiment configured as described above will be described with reference to the flowchart of FIG.

  The wireless terminal 1 is turned on (step S1), and the movement monitoring terminal 2a is called wirelessly (step S2). The state of the mobile monitoring terminal 2a is confirmed (step S3). If communication is possible, authentication confirmation is first performed between the terminals (step S4). To power on and start all the circuits of the mobile monitoring terminal 2a, a power ON start command is issued from the wireless terminal 1 (steps S5 and S6).

  When all the circuits of the movement monitoring terminal 2a are powered on (step S5), the wireless terminal 1 issues an operation mode command to the movement monitoring terminal 2a (step S7), and confirms the state of the movement monitoring terminal 2a (step S8). Then, it is confirmed that the mobile monitoring terminal 2a is ready to operate in the designated mode (step S9).

  The mobile monitoring terminal 2a is activated by the activation command, receives the operation mode command from the wireless terminal 1, and then receives the video data storage server 6a and the wireless base station 3 connected to the communication network 5 in which the communication destination is specified in advance. A communication path is established via (3a-3b) (steps S10, S11). Then, after confirming the authentication between the mobile monitoring terminal 2a and the video data storage server 6a (step S12), the video data of the surveillance camera built in the mobile monitoring terminal 2a is encrypted and sent to the video data storage server 6a. The information is accumulated and displayed on the monitor 7 (step S13). At this time, the mobile monitoring terminal 2a can also transmit video to the wireless terminal 1 in accordance with the operation mode command from the wireless terminal 1 in parallel. The monitor 7 is installed in a center such as a security company, for example, and the security company's guards monitor the real-time monitoring video displayed on the monitor 7.

  In order to place the movement monitoring terminal 2a in a standby state, a power OFF command is issued from the wireless terminal 1. On the other hand, in the operation mode command from the wireless terminal 1, the movement monitoring terminal 2a is a predetermined pattern, in the case of autonomous movement that moves on a course, and in the pattern according to the instruction at that time, in the case of remote control movement that moves on a course There is.

  When the operation of the mobile monitoring terminal 2a is completed (step S14), the wireless terminal 1 transmits an end command to the mobile monitoring terminal 2a (step S15), further transmits a power OFF command (step S16), and the mobile monitoring terminal 2a Is confirmed (step S17). The above operation is continued until the mobile monitoring terminal 2a is powered off. When the mobile monitoring terminal 2a is powered off (step S18), the wireless terminal 1 is powered off (step S19).

  In the movement monitoring terminal 2a, movement information received by the baseband processing unit 19 shown in FIG. 2 is determined by the movement control unit 32, and in the case of autonomous movement, the movable mechanism is used with movement information built in the movement control unit 32 in advance. In the case of remote control movement, the movement control unit 32 controls the movable mechanism unit 34 according to the movement information received by the baseband processing unit 19.

  In performing the operation as described above, the receiving unit 16 and the transmitting unit 17 and the baseband processing unit 19 of the wireless unit 18 of the mobile monitoring terminal 2a are for short-range wireless communication such as Bluetooth, UWB, and wireless LAN. A configuration in which the transmission / reception unit and the baseband processing unit are shared for mobile communication is adopted. If the wireless unit and the baseband processing unit of the wireless terminal 1 have the same configuration, a normal mobile phone via the wireless base station 3 is used as a wireless communication means between the mobile monitoring terminal 2a and the wireless terminal 1 in FIG. The communication form by mobile communication as described above and the communication form by direct communication by short-range wireless communication can be taken. Further, the communication mode is automatically switched by identifying the received radio wave.

  In the first embodiment, what is commonly used as the video data storage server 6a or the communication network 5 is used, and the wireless terminal 1 and the mobile monitoring terminal 2a have a communication line such as a short-range wireless communication or a mobile phone. The mobile monitoring system is configured by using a mobile phone communication line between the wireless base stations 3a and 3b and the wireless terminal 1. Thereby, a monitoring system can be constructed inexpensively and easily, and the state of a house or a store 11 can be remotely monitored and controlled in real time from a distant place such as a home or a destination even at night or on holidays. Therefore, in a wide range of monitoring application fields such as homes, stores, and offices, it is possible to easily monitor the situation from homes to stores and offices or from offices to homes by remote control. Moreover, since the movement monitoring terminal 2a can be freely moved in the house or the store 11, the monitoring area can be expanded and the degree of freedom can be increased, and the blind spot of monitoring can be eliminated. Since mutual authentication is required in communication between the wireless terminal 1 and the mobile monitoring terminal 2a and in communication between the mobile monitoring terminal 2a and the video data storage server 6a, desired security can be ensured, and video by hacking from a third party, etc. It is possible to monitor safely without seeing privacy information such as.

(Second Embodiment)
FIG. 5 is a diagram showing a schematic configuration of a mobility monitoring system for explaining a second embodiment of the present invention. In addition, the same code | symbol is attached | subjected to the component similar to 1st Embodiment shown in FIG. 1, and the description is abbreviate | omitted suitably.

  The mobile monitoring system according to the second embodiment includes a communication network 5, a video / audio data storage server 6b, an audio processing server 8, and radio base stations 3a and 3b connected to the communication network 5, and a video / audio data storage. A monitor 7 connected to the server 6b, a wireless terminal 1 in a house or store 11, and a movement monitoring terminal 2b are configured. In the second embodiment, audio data is handled in addition to video data, and the mobile monitoring terminal 2b is constructed of a conversation robot type that speaks words and recognizes human words.

  FIG. 6 is a diagram showing an internal configuration of the mobile monitoring terminal 2b shown in FIG. The mobile monitoring terminal 2b of the second embodiment has an audio signal amplification unit 27, an audio processing unit 26, an audio amplifying unit 29, and an audio signal processing unit 28, compared to the mobile monitoring terminal 2a of the first embodiment. A voice input / output system configured as described above is added, and a compression / decompression unit 23 is provided instead of the data compression unit 22. Also, an audio signal amplification unit 27 and an audio processing unit 26 are provided as an audio input system from the microphone. After the microphone audio input is compressed by the compression / decompression unit 23, it is encrypted and transmitted via the baseband processing unit 22. Is done. Furthermore, the audio data received via the baseband processing unit 22 is decrypted, decompressed by the compression / decompression unit 23, and then amplified through the output system of the audio signal processing unit 28 and the audio amplification unit 29.

  FIG. 7 is a diagram showing an internal configuration of the voice processing server 8 shown in FIG. The voice processing server 8 includes a communication network connection unit 35, a server control unit 36, an authentication unit 37, an encryption processing unit 38, a voice data memory unit 40, a voice recognition unit 41, and a voice response unit 42. When the voice processing server 8 is called through the communication network 5, the server control unit 36 is called through the communication network connection unit 35, and the authentication unit 37 is activated to perform authentication confirmation with the connection partner. Then, the encrypted received data is decrypted and the decrypted voice data is temporarily stored in the voice data memory unit 40, and the voice recognition unit 41 performs voice recognition and semantic interpretation while reading the data. Then, in response to the result of the speech recognition and semantic interpretation, the corresponding response speech word is synthesized by the speech response unit 42 and temporarily stored in the speech data memory 40, and then encrypted by the encryption processing unit 38 to the communication network 5. Send it out.

  Next, the operation in the movement monitoring system of the second embodiment will be described. When the mobile monitoring terminal 2b activated from the wireless terminal 1 receives the authentication confirmation, the mobile monitoring terminal 2b encrypts video data and audio data collected by the built-in monitoring camera and microphone and communicates via the wireless base station 3 (3a-3b). The video and audio data storage server 6b connected to the network 5 is transmitted and stored. When the mobile monitoring terminal 2b makes a conversational voice response, the voice data among the encrypted video data and voice data sent to the video / audio data storage server 6b is used as the voice connected to the same communication network 5. The authentication confirmation is sent to the processing server 8 and sent simultaneously.

  In the voice processing server 8, the sent voice data is decrypted and the meaning of the voice data is decrypted by the built-in voice recognition unit 41, and appropriate answer voice data is generated by the voice response unit 42, and is sent via the communication network 5. The response voice data is sent back to the mobile monitoring terminal 2b and outputted from the built-in voice loudspeaker 29.

  In the second embodiment, since the mobile monitoring terminal 2b responds and speaks words, and is a robot type that understands human words and performs a monitoring operation, the communication with the user is enriched to the mobile monitoring terminal 2b. And monitoring results can be easily obtained. For this reason, when used in a store or an office, it is possible to reduce the number of personnel such as an inquiry window. Further, since the mobile monitoring terminal 2b collects the sound in the house or store in addition to the monitoring video data and stores it in the video / audio data storage server 6b, the visual monitoring information is compared with the first embodiment. As well as auditory monitoring information. For this reason, the monitoring range can be expanded to the voice region, and the quality of monitoring can be improved. Other effects are the same as those of the first embodiment.

  In the second embodiment, the video / audio data storage server 6b in FIG. 5 functions only as an audio data storage server, and does not have video monitoring system inputs such as the imaging unit 25 and the video signal processing unit 24 in FIG. The mobile monitoring system may be configured to perform remote monitoring only with auditory monitoring information. In this case, the movement monitoring system can be constructed more simply and inexpensively.

(Third embodiment)
FIG. 8 is a diagram showing the configuration of the mobility monitoring terminal in the third embodiment of the present invention. Compared to the mobile monitoring terminal 2a of the first embodiment, the mobile monitoring terminal 2c of the third embodiment is added with an audio input system configured to include an audio signal amplification unit 27 and an audio processing unit 26. A compression / decompression unit 23 is provided instead of the data compression unit 22. Others are the same as those of the first embodiment shown in FIG.

  In the third embodiment, an audio data input system is added to the configuration of the first embodiment in the mobile monitoring terminal 2c, and the monitoring video data captured by the mobile monitoring terminal 2c and the collected audio data are combined. In the direction, it is stored in the same video / audio data storage server 6b as in the second embodiment via the communication network 5. Therefore, as a mobile monitoring system, only the video / audio data storage server 6b is connected to the communication network 5, and the audio processing server 8 is not connected as shown in FIG.

  According to the third embodiment, the mobile monitoring terminal 2c collects the sound in the house or the store in addition to the monitoring video data, and stores it in the video / audio data storage server 6b. In comparison, not only visual monitoring information but also auditory monitoring information can be obtained, so that the monitoring range can be expanded to the voice region, and the quality of monitoring can be improved. Other effects are the same as those of the first embodiment.

  In the third embodiment, it is also possible to adopt a mobile monitoring system form that does not have video monitoring system inputs such as the imaging unit 25 and the video signal processing unit 24 of FIG. 8 and performs remote monitoring only by auditory monitoring information. it can. In this case, the movement monitoring system can be constructed more simply and inexpensively.

(Fourth embodiment)
FIG. 9 is a diagram showing a schematic configuration of a mobility monitoring system for explaining a fourth embodiment of the present invention. The mobility monitoring system of the fourth embodiment is a modification of the second embodiment shown in FIG. 5, and an AV content server 9 is additionally connected to the communication network 5 instead of the video / audio data storage server 6b. It is a form.

  FIG. 10 is a diagram showing an internal configuration of the mobile monitoring terminal 2d shown in FIG. The mobile monitoring terminal 2d of the fourth embodiment has a configuration in which a video output system including a video signal processing circuit 30 and a video projection unit 31 is added to the mobile monitoring terminal 2b of the second embodiment. It has become. The AV content data received via the baseband processing unit 22 is decrypted, decompressed by the compression / decompression unit 23, converted into a video signal by the video signal processing unit 30, and projected from the video projection unit 31.

  In addition, as a configuration example of the wireless terminal 1, a configuration in which the moving unit 50 is omitted from the configuration of the mobile monitoring terminal 2d in FIG. 10 and the video projection unit 31 is changed to a liquid crystal display unit can be employed.

  FIG. 11 is a diagram showing an internal configuration of the AV content server 9 shown in FIG. The AV content server 9 includes a communication network connection unit 35, a server control unit 36, an authentication unit 37, an encryption processing unit 38, and an AV content storage unit 43. The AV content server 46 searches for content to be served by the AV content storage unit 43, encrypts it with the encryption processing unit 38, and transmits the data to the communication network 5.

  In this case, the voice data collected from the mobile monitoring terminal 2d is sent to the voice processing server 8 via the communication network 5, the voice recognition unit 41 performs voice recognition and semantic analysis, and the voice response unit 42 responds. Data is generated. In parallel with the response voice data being sent to the mobile monitoring terminal 2d and being expanded, the requested AV content service is obtained from the request content that has been subjected to semantic analysis by the voice recognition unit 41 of the voice processing server 8. A communication path is formed between the AV content server 9 connected to the network 5 and the mobile monitoring terminal 2d. After the authentication, the AV content data is encrypted and sent to the mobile monitoring terminal 2d, and after being decrypted, projected from the built-in video projection unit 31.

  As a modification of the present embodiment, the AV content server 9 may be operated by a remote request command from the wireless terminal 1 to the AV content server 9 regardless of the audio data collected from the mobile monitoring terminal 2d. Good. In this case as well, AV content can be transmitted from the AV content server 9 to either the mobile monitoring terminal 2d or the wireless terminal 1.

  According to the fourth embodiment, it is possible to provide individual services such as voice, music, and video as AV content data from the AV content server 9 through the mobile monitoring terminal 2d, and to provide a user with a composite service at the same time. . By sophisticating the functions of the surveillance system in this way, it will be possible to provide comprehensive AV content on-demand services such as stories, storytelling, guidance, music, etc. by video, audio, home, hospital, school, library, temple. Various on-demand services for AV contents in stores, public places, offices, beaches, trains and other transportation systems can be realized using the monitoring system. Other effects are the same as those of the second embodiment.

(Fifth embodiment)
FIG. 12 is a diagram showing a schematic configuration of a mobility monitoring system for explaining a fifth embodiment of the present invention.

  In the fifth embodiment, all of the video / audio data storage server 6b, the monitor 7, the audio processing server 8, and the AV content server 9 described above are connected as servers connected to the communication network 5, and the accounting server 13 is further connected. The configuration is additionally connected.

  In this configuration, when the video / audio data storage server 6b or the audio processing server 8 is accessed from the mobile monitoring terminal 2d and the authentication is confirmed, the accounting server 13 is called by the server at the same time, and the accounting process is performed after the authentication is confirmed. Start operation. When the accounting server 13 is accessed again at the end of data accumulation by the server or at the end of AV content transmission, and the used server capacity is notified, the information is recorded as accounting information.

  When the allocated recording capacity in a server such as the video / audio data storage server 6b is a fixed amount, the connection of the mobile monitoring terminal 2d to the server is terminated when the fixed capacity is reached, and the charging server 13 and the mobile monitoring terminal 2d are notified accordingly. To be notified.

  In addition, the accounting server 13 of the present embodiment can also perform accounting processing based on information notification from each server for accounting for the communication amount using the communication network 5. The billing server 13 may be part of another server or may be a single server configuration suitable for an economical small-scale system in which all are integrated.

  The fifth embodiment has all the effects of the first to fourth embodiments described above, and can charge users who use the mobile monitoring system on the network.

  FIG. 13 is a diagram showing an example of the form of moving means in the movement monitoring terminals 2a to 2d (hereinafter, these are represented by reference numeral 2) shown in the first to fifth embodiments.

  In FIG. 13, (a) is an example of a ceiling track type installed on the ceiling, and includes an aerial track type suspended from the ceiling. (B) is an example of a vehicle type such as a minicar traveling at a low speed on the floor surface. (C) is an example of a walking robot type, such as a quadruped walking type or a biped walking type. (D) is an example of a flying body type including a mini helicopter, a Cessna aircraft, an airship, and the like. (E) is an example of a ship type, and includes a boat, a yacht, a mini cruiser, an inflatable boat, and the like.

  As a form of the moving means, there is a form in which these are combined with the above five forms. Examples of the external configuration of the mobile monitoring terminal 2 include robots, animals, birds, fish, popular anime characters and dolls such as idols, external shapes resembling small vehicles, flying objects, ships, etc. An external configuration in which these are combined and combined is also included.

  FIG. 14 is a diagram showing an example of the movable space in the movement monitoring terminal 2 shown in the first to fifth embodiments.

  The configuration example shown in FIG. 14 is an example in which the radio base station 3 is installed on the ceiling 47, and a concentric radio wave arrival zone having a constant radio wave intensity is formed around the antenna portion of the radio base station 3. The movement monitoring terminal 2 can arbitrarily move as a movable range within the floor surface 48 in the radio wave arrival zone.

  As described above, the moving means can be implemented in various embodiments, such as the situation of the monitoring place, the monitoring purpose, the monitoring target, the intimidation to the person, the intimacy, the privacy violation, and the like. In consideration of services and the like, it may be selected from various options. For example, depending on the location where the mobile monitoring terminal is installed and operated, the most intimidating, open feeling, stimulation, interest, attachment, etc. that emphasize communication with people are given to the person, without giving a sense of intimidation on monitoring. Select a suitable mobile monitoring terminal movement form and outer shape.

  In addition, depending on the use of the monitoring system, the scale of the system in consideration of economics, the stage of development of interactive services, or the changing needs of the monitoring location, a data storage server, a voice processing server, an AV content server, It is also possible to change the configuration as appropriate, such as providing various servers such as billing servers individually, adding them, or consolidating them into a single server. This makes it possible to easily optimize the cost performance of the server configuration as the mobile monitoring system.

  As described above, the present embodiment uses a device that is commonly used as a communication network, a video data storage server, a wireless base station, a wireless terminal, and the like, and communicates between the mobile monitoring terminal and the video data storage server. In addition, it is possible to use an existing and widely used communication means as a communication means between a wireless terminal and a mobile monitoring terminal or a wireless base station, so that a mobile monitoring system capable of monitoring video in real time can be easily and inexpensively constructed. Can do. In addition, existing authentication functions and encryption communication functions can be used for communication between the mobile monitoring terminal and the video data storage server, and communication between the wireless terminal and the mobile monitoring terminal or the wireless base station. Can be secured. In addition, the mobile monitoring terminal can be remotely operated from a distance to move the imaging range of the video information, so it is possible to remotely monitor and control the state of homes, stores, offices, etc. in real time, The degree of freedom can be increased and the blind spot area at the time of monitoring can be eliminated.

  Also, by providing and connecting an AV content server on the communication network, appropriate AV content such as voice, music, and video is sent from the AV content server to the mobile monitoring terminal in response to a request from the mobile monitoring terminal or wireless terminal. be able to. Therefore, by reproducing the transmitted AV content on the mobile monitoring terminal, not only the monitoring service but also various AV content providing services can be provided.

  The present invention can be constructed at a low cost while maintaining the security of the system, can eliminate the blind spot at the time of monitoring, can widen the monitoring area, and has an effect that the monitoring video can be viewed in real time. It is useful for mobile monitoring systems and mobile monitoring terminals using wireless communication technology and network technology.

The figure which shows schematic structure of the movement monitoring system for demonstrating the 1st Embodiment of this invention. The figure which shows the internal structure of the movement monitoring terminal of 1st Embodiment. The figure which shows the internal structure of the video data storage server of 1st Embodiment. The flowchart which shows the operation | movement procedure in the movement monitoring system of 1st Embodiment. The figure which shows schematic structure of the movement monitoring system for demonstrating the 2nd Embodiment of this invention. The figure which shows the internal structure of the movement monitoring terminal of 2nd Embodiment. The figure which shows the internal structure of the speech processing server of 2nd Embodiment. The figure which shows the structure of the movement monitoring terminal in the 3rd Embodiment of this invention. The figure which shows schematic structure of the movement monitoring system for describing the 4th Embodiment of this invention The figure which shows the internal structure of the movement monitoring terminal of 4th Embodiment. The figure which shows the internal structure of the AV content server of 4th Embodiment. The figure which shows schematic structure of the movement monitoring system for describing the 5th Embodiment of this invention The figure which showed the example of the form of the movement means in the movement monitoring terminal of this embodiment The figure which showed the example of the movable space in the movement monitoring terminal of this embodiment The figure which showed the structure of the conventional building management system and the video surveillance system Diagram showing the configuration of a mobile monitoring robot system in a conventional nuclear power plant Diagram showing the configuration of a remote monitoring system in a conventional nuclear power plant

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Wireless terminal 2, 2a, 2b, 2c, 2d Mobile monitoring terminal 3, 3a, 3b Wireless base station 4 Power supply control part 5 Communication network 6a Video data storage server 6b Video / audio data storage server 7 Monitor 8 Audio processing server 9 AV Content server 11 House or store 13 Billing server 14 Data processing unit 16 Reception unit 17 Transmission unit 18 Wireless unit 19 Baseband processing unit 20 Authentication unit 21 Encryption processing unit 22 Data compression unit 23 Compression / decompression unit 24, 30 Video signal processing unit 25 Imaging unit 26, 28 Audio signal processing unit 27 Audio signal amplification unit 29 Audio amplification unit 31 Video projection unit 32 Movement control unit 33 Position distance line marker sensor unit 34 Movable mechanism unit 50 Moving means

Claims (14)

A wireless terminal having wireless communication means for performing wireless communication with a communication network;
A mobile monitoring terminal having imaging means for acquiring video information, moving means for moving the device itself, and wireless communication means for performing wireless communication with the communication network and the wireless terminal;
A data storage server having data storage means for storing data including the video information, and a communication means for communicating with the communication network,
The mobile monitoring terminal is configured to encrypt the communication data including the video information and the mobile unit according to an instruction from the authentication destination after authentication between the wireless terminal or a communication partner including the data storage server. A movement monitoring system comprising: a control unit that performs a movement control including a moving operation according to the above and transmits video data acquired by the imaging unit and encrypted by the encryption unit to the data storage server. The movement monitoring system according to claim 1,
The mobile monitoring terminal further includes sound collecting means for acquiring sound information,
The data storage server is a mobile monitoring system that stores data including video information and sound information acquired by the mobile monitoring terminal in the data storage means. The movement monitoring system according to claim 1 or 2,
A voice processing server having voice recognition means for performing voice recognition, voice response means for generating response information corresponding to the voice recognition result, and communication means for communicating with the communication network;
The mobile monitoring terminal includes sound collection means for acquiring sound information and sound output means for outputting sound, and transmits the sound information acquired by the sound collection means to the sound processing server, and from the sound processing server. A movement monitoring system for outputting sound based on received response information by the sound output means. The mobile monitoring system according to any one of claims 1 to 3,
An AV content server having content storage means for storing AV content including at least one of sound information and image information, and communication means for communicating with the communication network;
The movement monitoring terminal includes a sound output unit that outputs sound, and the sound output unit outputs sound based on sound information received from the AV content server. The mobile monitoring system according to any one of claims 1 to 3,
An AV content server having content storage means for storing AV content including at least one of sound information and image information, and communication means for communicating with the communication network;
The movement monitoring terminal includes an image projecting unit that projects an image, and the image projecting unit projects an image based on image information received from the AV content server. The mobile monitoring system according to any one of claims 1 to 5,
A mobility monitoring system comprising a billing server having a billing processing unit that performs billing processing on various information transmitted to or received from the mobility monitoring terminal, and a communication unit that communicates with the communication network. The mobile monitoring system according to any one of claims 1 to 6,
The movement monitoring system is a movement monitoring system in which the movement monitoring terminal moves a predetermined route or moves to an arbitrary position according to an instruction from the wireless terminal or the data storage server by the moving means. The mobile monitoring system according to any one of claims 1 to 5,
The wireless monitoring means for performing wireless communication between the mobile monitoring terminal and the wireless terminal includes a short-range wireless communication means for performing short-range communication. Imaging means for acquiring video information;
Moving means for moving the device itself;
Wireless communication means for performing wireless communication with a communication network and other wireless terminals;
Encryption means for encrypting communication data including the video information;
After the authentication with the communication partner including at least one of the wireless terminal and the data storage server that stores the data including the video information, the operation control including the moving operation by the moving unit is performed in accordance with an instruction from the authentication destination. And a control means for transmitting the video data acquired by the imaging means and encrypted by the encryption means to the data storage server. The mobile monitoring terminal according to claim 9, wherein
A mobile monitoring terminal further comprising sound collection means for obtaining sound information, and transmitting the video information obtained by the imaging means and the sound information obtained by the sound collection means to the data storage server. The mobile monitoring terminal according to claim 9, wherein
A voice response function including a sound collecting means for acquiring sound information and a sound output means for outputting sound, and generating sound response information and response information corresponding to the sound recognition result from the sound information acquired by the sound collecting means. A mobile monitoring terminal that transmits to the sound processing server having sound and outputs sound based on the response information received from the sound processing server by the sound output means. The mobile monitoring terminal according to claim 9, wherein
A mobile monitoring terminal further comprising sound output means for outputting sound, wherein the sound output means outputs sound based on sound information received from an AV content server that provides AV content including at least one of sound information and image information. The mobile monitoring terminal according to claim 9, wherein
A mobile monitoring terminal that further includes an image projecting unit that projects an image, and that projects an image based on image information received from an AV content server that provides AV content including at least one of sound information and image information. The mobile monitoring terminal according to any one of claims 9 to 13,
A movement monitoring terminal that moves along a predetermined route or moves to an arbitrary position according to an instruction from a communication partner including at least one of the wireless terminal and the data storage server by the moving means.

Images