JP6836076B2 - Information processing equipment, its control method, and programs - Google Patents

Description

The present invention relates to an information processing device, a control method thereof, and a program thereof, and more particularly to a technique for facilitating management of a plurality of images of different resolutions taken by a network camera.

Conventionally, as a method of performing track maintenance work of a railway, a method of running a train and checking a track or the like is known.

Patent Document 1 proposes to monitor a traveling route with a camera provided at the head of an inspection vehicle or the like.

Japanese Unexamined Patent Publication No. 2007-38884

However, for example, when a person (user) who performs track maintenance work confirms a live image taken by a camera installed in a leading vehicle such as a train inside the company (a place other than a vehicle) and performs track maintenance work. It is conceivable to transmit the live video captured by the camera to a recording server on the network or the terminal of the user using a communication network such as LTE.

In this case, a high-resolution image is required for the track maintenance work performed by the user by checking the image displayed on the display, but the high-resolution image taken by the camera cannot be transmitted live. For example, it is difficult in the band of a communication network such as LTE.

Therefore, the network camera sends the low-resolution live video live to the recording server or the user's terminal, and the user checks the low-resolution video live, and if there is a place to check in detail, the high-resolution video. It is conceivable to confirm.

In this case, the high-resolution image taken by the network camera is recorded in the storage area of the information processing device in the vehicle connected to the network camera, and the recorded high-resolution image is sequentially recorded in the recording server. It is conceivable to transmit using the communication network.

In such a mechanism, the low-resolution live video and the port used for the acquisition request and transmission of the high-resolution video are different. As a result, the recording server recognizes the low-resolution image and the high-resolution image as images taken by different network cameras, and records both the low-resolution image and the high-resolution image. Become.

As a result, a large amount of memory area of the recording server is required, which increases the cost.

In addition, since the low-resolution live image and the high-resolution image are managed as images taken by different network cameras, the user can use the low-resolution live image and the high-resolution image taken by the same network camera. The image could not be confirmed easily.

In addition, it has become impossible for the user to easily grasp the time zone in which the high-resolution video can be viewed and the time zone in which the low-resolution video can be viewed.

An object of the present invention is to provide a mechanism for facilitating management of a plurality of images of different resolutions taken by a network camera.

The present invention includes an acquisition unit you get the first video network camera shot, a storage means for storing in the storage unit the first image acquired by the pre-Symbol acquiring unit, the acquisition unit, the after obtaining the first image, the high-resolution than the first image to obtain a second image in which the network camera is taken, the storage unit, the second image acquired by the acquisition unit, the storage The first image stored in the unit is overwritten, and the first image and the second image are images taken by the same network camera at the same time or in the same time zone .

Further, in the present invention, the first image taken by the network camera is transmitted to the network using the first port of the router, and the second image taken by the network camera has a higher resolution than the first image. Is an information processing device that is transmitted to a network using the second port of the router, acquires the first video and the second video transmitted to the network, and stores them in a storage unit, and transmits the second video to the network. The acquisition means includes an acquisition means for acquiring the first video, and a storage means for storing the first video acquired by the acquisition means in the storage unit, and the acquisition means has acquired the first video. Later, the second video was acquired, and the storage means used the port number of the first port of the router used when acquiring the first video and the router used when acquiring the second video. On the condition that the port number of the second port is stored in association with each other in advance, the acquired second video is stored as a video related to the first video, and the first video is stored. the second image and the same of the network camera, wherein the Ru video der the same time or the same time period were taken.
Further, the present invention includes an acquisition unit you get the first video network camera is captured, and a storage means for storing the first image in the storage unit acquired by the pre-Symbol acquisition means, said acquisition means , after acquiring the first image, said high-resolution than the first image to obtain a second image in which the network camera is captured, wherein the storage unit, which obtains the second image by the acquisition unit depending on, the second image obtained in the previous SL acquisition means, processing of storing a picture for the first image stored in the storage unit, and performs processing to erase the first image, the first image the second image and the same of the network camera, wherein the video der Rukoto the same time or the same time period were taken.

Further, the present invention is a control method in an information processing apparatus, which includes an acquisition step of acquiring a first image captured by a network camera and a storage step of storing the first image acquired by the acquisition step in a storage unit. After acquiring the first image, the acquisition step acquires a second image taken by the network camera having a resolution higher than that of the first image, and the storage process is performed by the acquisition step. The acquired second image is overwritten with the first image stored in the storage unit, and the first image and the second image are images taken by the same network camera at the same time or in the same time zone. It is characterized by being.

Further, in the present invention, the first image taken by the network camera is transmitted to the network using the first port of the router, and the second image taken by the network camera has a higher resolution than the first image. Is a control method in an information processing device that acquires the first video and the second video transmitted to the network using the second port of the router and stores the second video in a storage unit. The acquisition step includes an acquisition step of acquiring the first video transmitted to the network and a storage step of storing the first video acquired by the acquisition step in the storage unit, and the acquisition step is the first video. The second video is acquired after the acquisition of the above, and the storage step is used when the port number of the first port of the router used when acquiring the first video and when the second video is acquired. On the condition that the port number of the second port of the router that has been used is stored in association with each other in advance, the acquired second video is stored as a video related to the first video, and the process is performed. The first image and the second image are characterized by being images taken by the same network camera at the same time or in the same time zone.
Further, the present invention is a control method in an information processing apparatus, which includes an acquisition step of acquiring a first image captured by a network camera and a storage step of storing the first image acquired by the acquisition step in a storage unit. After acquiring the first image, the acquisition step acquires a second image captured by the network camera having a resolution higher than that of the first image, and the storage process is performed by the acquisition step. A process of storing the second image acquired in the acquisition step as an image related to the first image stored in the storage unit and a process of erasing the first image in response to the acquisition of the second image. The first image and the second image are images taken by the same network camera at the same time or in the same time zone.

Further, the present invention causes a computer, characterized by a program for functioning in the above-described information processing apparatus.

According to the present invention, it is possible to easily manage a plurality of images having different resolutions taken by a network camera.

An example of the system configuration of the information processing system of the present invention is shown. It is a block diagram which shows an example of the hardware composition of the information processing apparatus applicable to the recording server 107, the client terminal 108, and the information processing apparatus 104 shown in FIG. It is a figure which shows an example of the display screen 302 displayed on the display part of a client terminal 108. It is a figure which shows an example of the display screen 302 displayed on the display part of a client terminal 108. It is a figure which shows an example of the display screen 302 displayed on the display part of a client terminal 108. It is a figure which shows an example of the display screen 302 displayed on the display part of a client terminal 108. It is a flowchart which shows an example of the recording and display processing of a low resolution live image taken by a network camera 1 (105), and the recording process of a high resolution image taken by a network camera 1 (105). It is a flowchart which shows an example of the display processing of the recorded video (low resolution video, or high resolution video) stored in the recording server 107. It is a flowchart which shows an example of the display processing of the high-resolution recorded video of the period specified by the user. It is a flowchart which shows an example of the process which adds an annotation to a live video and displays the date and time when the annotation was added on the timeline. It is a figure which shows an example of the camera image management table 1101. It is a figure which shows an example of the image management table 1201 which a recording server 107 stores. It is a figure which shows an example of the image management table 1201 which a recording server 107 stores.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 shows an example of a system configuration of the information processing system of the present invention.

In FIG. 1, a railway in which the train 102 travels on the railroad track 103 using the electric power supplied from the overhead wire 101 will be described as an example, but it may be in the form of another railway or not in the form of a railway. May be good.

The information processing system shown in FIG. 1 includes a network camera 1 (105), an information processing device 104, a router 106, a recording server 107, and a client terminal 108.

The train 102 includes a router 106, a network camera 1 (105), and an information processing device 104.

The network camera 1 (105) and the information processing device 104 are connected to each other via a router 106 so as to be able to communicate with each other.

Further, the network camera 1 (105) and the information processing device 104 are communicably connected to a network 110 such as the Internet via a router 106.

The router 106 is, for example, an LTE router, in which "A" is set as the global IP address, and "A" is set as the port number of the port used for transmitting the low-resolution live image of the network camera 1 to the recording server 107. 1 "is set. Further, "2" is set as the port number of the port used for transmitting the high-resolution video of the network camera 1 to the recording server 107.

Further, for example, the network camera 1 (105) and the information processing device 104 can be combined into one housing to form one information processing device or network camera.

The network camera 1 (105) is installed in the leading car of the train car, and is provided so as to photograph the front in the traveling direction of the car.

The recording server 107 has a function of receiving and recording a video (video data of a low-resolution live video) transmitted from the network camera 1 (105) via the router 106, and a function of transmitting the video to the client terminal 108. I have.

Further, the recording server 107 has a function of receiving and recording a video (high-resolution video data) transmitted from the information processing device 104 via the router 106, and a function of transmitting the video to the client terminal 108. ..

The recording server 107 is communicably connected to the network 110, and is communicably connected to the client terminal 108 and the router 106 capable of communicating with the network 110.

When the network camera 1 (105) receives the live video acquisition request from the recording server 107, the network camera 1 (105) transmits the moving image data (low-resolution live video) of the live video to the recording server 107 via the router 106. When the recording server 107 receives the low-resolution live video, the recording server 107 stores the live video in the memory.

Further, the network camera 1 (105) transmits a low-resolution live video to the recording server 107 via the router 106, and also provides information on moving image data of a video having a higher resolution than the video at the same angle of view as the video. It is transmitted to the processing device 104.

That is, the first video (low-resolution live video) and the second video (high-resolution video) are videos taken by the same network camera at the same time or in the same time zone. The first image is an image displayed on the display unit as a live image.

The information processing device 104 is provided with a memory (external memory 211) such as an SSD that stores a high-resolution image, and when the high-resolution image (moving image data) is received from the network camera 1 (105), the image is displayed. Store in memory. Then, when the video for a predetermined time is stored and the acquisition request for the high-resolution video transmitted from the recording server 107 is received, the video is made into one video file and the video is made into one video file, and the video is converted into one video file via the recording server 107. Send to.

Then, when the recording server 107 receives the high-resolution video, it overwrites and registers the low-resolution live video shot by the same camera.

The recording server 107 transmits the low-resolution live video received by the recording server 107 and the high-resolution video to the client terminal 108, and the client terminal 108 transmits the video transmitted from the recording server 107 (low-resolution live video, It has a function to receive and display high-resolution video).

FIG. 2 is a block diagram showing an example of a hardware configuration of an information processing device applicable to the recording server 107, the client terminal 108, and the information processing device 104 shown in FIG.

As shown in FIG. 2, the information processing apparatus includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 203, a RAM (Random Access Memory) 202, an input controller 205, and a video controller 206 via a system bus 204. The memory controller 207 and the communication I / F controller 208 are connected.

The CPU 201 comprehensively controls each device and controller connected to the system bus 204.

The storage device such as the ROM 203 or the external memory 211 is a control program executed by the CPU 201, such as a BIOS (Basic Input / Output System) or an OS (Operating System), or a computer-readable and executable program for realizing the information processing method. And holds various necessary data (including data table).

The RAM 202 functions as a main memory, a work area, and the like of the CPU 201. The CPU 201 realizes various operations by loading a program or the like necessary for executing the process from the ROM 203 or the external memory 211 into the RAM 202 and executing the loaded program.

The input controller 205 controls the input from the input device 209 (input device). Examples of the input device 209 include pointing devices such as a keyboard, touch panel, and mouse.

When the input device 209 is a touch panel, the user can give various instructions by pressing (touching with a finger or the like) the icon, the cursor, or the button displayed on the touch panel.

Further, the touch panel may be a touch panel such as a multi-touch screen that can detect the position touched by a plurality of fingers.

The video controller 206 controls the display on an external output device such as the display device 210. The display shall include the display of a notebook computer integrated with the main body. The external output device is not limited to the display, and may be, for example, a projector. Further, as for the device that can be accepted by the above-mentioned touch operation, the input device 209 is provided.

The video controller 206 can control a video memory (VRAM) for display control, can use a part of the RAM 202 as a video memory area, or can provide a separate dedicated video memory. It is possible.

The memory controller 207 controls access to the external memory 211. External memory is connected to an external storage device (hard disk), flexible disk (FD), or PCMCIA card slot that stores boot programs, various applications, font data, user files, edit files, various data, etc. via an adapter. Compact flash (registered trademark) memory, etc. can be used.

The communication I / F controller 208 connects and communicates with an external device via a network, and executes communication control processing on the network. For example, communication using TCP / IP, Wi-Fi, and communication using a 3G line and an LTE line are possible.

A storage device such as the external memory 211 is a medium for permanently storing information, and its form is not limited to a storage device such as a hard disk. For example, it may be a medium such as SSD (Solid State Drive).

It can also be used as a temporary memory area during various processes performed by the communication terminal in this embodiment.

The CPU 201 enables display on the display device 210 by, for example, executing an outline font expansion (rasterization) process in the display information area in the RAM 202. Further, the CPU 201 enables a user instruction with a mouse cursor or the like (not shown) on the display device 210.

Next, the processes executed by the network camera 1 (105), the information processing device 104, the recording server 107, and the client terminal 108 will be described with reference to the flowchart of FIG. 7.

FIG. 7 is a flowchart showing an example of recording and display processing of a low-resolution live image taken by the network camera 1 (105) and recording processing of a high-resolution image taken by the network camera 1 (105).

The processes shown in S701 to S704 shown in FIG. 7 are realized by the CPU of the network camera 1 (105) reading and executing the program.

Further, the processes shown in S705 to S708 shown in FIG. 7 are realized by the CPU 201 of the client terminal 108 reading and executing the program.

Further, the processes shown in S709 to S713 and S717 to S720 shown in FIG. 7 are realized by the CPU 201 of the recording server 107 reading and executing the program.

Further, the processes shown in S714 to S716 shown in FIG. 7 are realized by the CPU 201 of the information processing apparatus 104 reading and executing the program.

The recording server 107 requests information on a combination of the IP address "A" (global IP address) of the router 106 and the port number "1" for low resolution as a request destination for requesting acquisition of low-resolution live video (simply). , Also called the address of a low-resolution camera), and the IP address "A" (global IP address) of the router 106 and the high-resolution image as the request destination for requesting the acquisition of high-resolution video. It stores information in combination with the port number "2" (simply referred to as the address of a high-resolution camera).

First, the recording server 107 has a timer function, and at a predetermined time, a request for acquisition of a live image taken by the network camera 1 (105) is sent to the network camera 1 (105) via the router 106. Do it. At this time, the recording server 107 transmits the acquisition request to the address (A: 1) of the low-resolution camera. When the router 106 receives the acquisition request at the address (A: 1) of the low-resolution camera, the router 106 transmits the acquisition request to the network camera 1 (105).

Upon receiving the acquisition request, the network camera 1 (105) photographs the vehicle in the forward direction in the traveling direction and acquires the captured image. Here, the network camera 1 (105) acquires, for example, VGA resolution moving image data as low-resolution video (moving image data) (S701). This low-resolution video is used not only for recorded video but also as video data for live video.

Further, the network camera 1 (105) acquires, for example, HD resolution moving image data as a high resolution image (moving image data) having the same angle of view as the low resolution image (S703).

Then, the network camera 1 (105) transmits the low-resolution video acquired in S701 to the recording server 107 (S702). Specifically, the network camera 1 (105) transmits the low-resolution video acquired in S701 to the router 106, and the router 106 transmits the low-resolution video from the port of the low-resolution camera address (A: 1). The resolution video is transmitted to the recording server 107. Further, in S702, information indicating the low resolution (for example, VGA (low resolution)) is also transmitted to the recording server 107.

Further, the network camera 1 (105) transmits the high-resolution video acquired in S703 to the information processing device 104 (S704). Further, in S704, information indicating high resolution (for example, HD (high resolution)) is transmitted to the information processing apparatus 104 as information indicating the resolution of the video (moving image data).

Then, the network camera 1 (105) returns the process to S701 and S703, and repeatedly executes the same process.

The network camera 1 (105) processes the processes of S701 and S702 and the processes of S703 and S704 in parallel.

When the information processing device 104 receives (acquires) the high-resolution video transmitted in S704 (S714), the information processing device 104 temporarily stores (records) the acquired video in a memory (external memory 211) such as an SSD (S715). In S714, information indicating the high resolution (for example, HD (high resolution)) is also received.

Then, when the video for a predetermined time (for example, 10 minutes) is temporarily recorded in S715, the information processing device 104 transmits the video as one video file to the recording server 107 via the router 106. (S716). At this time, the address of the high-resolution camera is also transmitted to the recording server 107.

Specifically, when the recording server 107 requests the acquisition of live video, it always requests the information processing apparatus 104 to acquire high-resolution video. The recording server 107 transmits a high-resolution video acquisition request to the low-resolution camera address (A: 2). When the router 106 receives the acquisition request at the address (A: 2) of the high-resolution camera, the router 106 transmits the acquisition request to the information processing apparatus 104. Then, when the information processing apparatus 104 receives the acquisition request, it transmits one high-resolution moving image file to the router 106, and the router 106 transmits the acquisition request to the recording server 107 from the port of the port number 2. The moving image file is transmitted (S716).

Then, the information processing device 104 returns the process to S714. In S716, the oldest video (the oldest shot video) is preferentially transmitted to the recording server 107. Further, in S716, information indicating the high resolution (for example, HD (high resolution)) is also transmitted.

Therefore, the second image acquisition means of S717 performs an acquisition process of sequentially acquiring the second image at the time most recently captured by the network camera.

The low-resolution live video is transmitted from the network camera 1 (105) to the recording server 107 in S702, but the video transmitted here is a video having a lower resolution than the video transmitted in S716, that is, that is, Since the data capacity transmitted in S702 is smaller than the data capacity transmitted in S716, it is possible to transmit in a transmission time shorter than the transmission time transmitted in S716.

The recording server 107 receives the low-resolution video transmitted from the network camera 1 (105) in S702 and the information indicating the low resolution (for example, VGA (low resolution)). At this time, the combined information (address of the low-resolution camera) of the port number “1” indicating the port transmitted from the router 106 and the IP address “A” of the router 106 is also received (S710).

S710 is an application example of the first video acquisition means of the present invention, and acquires a first video (low-resolution live video) captured by a network camera.

Then, the recording server 107 identifies the camera ID that identifies the network camera of the video from the received low-resolution camera address (A: 1) (S710).

Specifically, the recording server 107 refers to the camera image management table 1101 (FIG. 11) stored in the storage means of the external memory 211 of the recording server 107, and the address of the low-resolution camera received in S702. The camera ID (1) corresponding to (A: 1) is specified.

The camera image management table 1101 shows the "low resolution camera address (low resolution camera address)" of the port of the router 106 used when the low resolution image is transmitted from the router 106, and the high resolution camera address from the router 106. The "high resolution camera address (high resolution camera address)" of the port of the router 106 used when the resolution video is transmitted, the low resolution video, and the network that captured the high resolution video. This is an example of a table in which a camera ID for identifying the camera 1 (105) and a camera ID are stored in association with each other.

The camera image management table 1101 is an application example of the related information of the present invention, and is the first port (1 in the example of FIG. 11) of the acquisition destination (router) for acquiring the first image by the first image acquisition means, and the first port. 2 This is information associated with the second port (2 in the example of FIG. 11) of the acquisition destination (router) for acquiring the second image by the image acquisition means. Further, the camera image management table 1101 is stored in a storage means (related information storage means) such as a memory of the recording server 107.

When the recording server 107 identifies the camera ID stored in the camera image management table 1101 corresponding to the address of the low-resolution camera received in S710, it determines whether or not the client terminal 108 has received the live image display request. If the determination is made (S711) and it is determined that the display request is not accepted (S711: NO), the low-resolution video received in S710 is stored (registered) in the external memory 211 (S713).

S713 is an application example of the storage means of the present invention, and stores the first video acquired by the first video acquisition means. The memory for storing the first video is also an application example of the storage means of the present invention.

In S713, when the video for a predetermined time (for example, 10 minutes) is received in S710, it is registered as a moving image file for each predetermined time. Further, when the recording server 107 registers the moving image file in the predetermined time unit in S713, the recording server 107 newly registers the information about the moving image file in the video management table 1201 (A) shown in FIG. Here, the information about the moving image file is the information of each item constituting the record of the video management table 1201.

FIG. 12 is a diagram showing an example of the video management table 1201 stored in the recording server 107.

The video management table 1201 is composed of items of "file ID", "start time", "end time", "resolution", "annotation date and time", and "annotation position".

The video management table 1201 is a table stored for each specified camera ID.

The "file ID" stores identification information (file ID) that identifies a video (video data) file. In addition, the "start time" stores the start time of the video (video data). In addition, the "end time" stores the end time of the video (video data). In addition, the "resolution" stores the resolution of the video (moving image data). In the example here, VGA (low resolution) or HD (high resolution) is stored, but the present invention is not limited to this. In addition, the "annotation date and time" stores the date and time of the moving image in which the user gives an instruction to add annotation. In addition, the "annotation position" stores information indicating the position (position on the display screen) to which the annotation is added in the display screen on which the video is displayed. In the example here, the position information specified by the X-axis and the Y-axis (X, Y) of the display screen is stored.

In S713, a method of newly registering the information about the moving image file in one record of the video management table 1201 by the recording server 107 will be described.

Specifically, the recording server 107 sets the start time and end time of the video of the video file registered in S713 in the video management table 1201 of the camera ID specified in S710, respectively, as the "start time" of the video management table 1201. And "end time", and information indicating low resolution (for example, VGA (low resolution)) as information indicating resolution received in S710 was stored in "resolution" of the video management table 1201 and registered in S713. A file ID (identification information) for identifying a moving image file is numbered and stored in the "file ID" of the video management table 1201.

When the recording server 107 executes the process of S713, the process returns to S709.

Next, the processing of the client terminal 108 will be described.

The client terminal 108 requests the recording server 107 to transmit a video display screen in response to an instruction from the user, and when the recording server 107 receives the request, the display screen is sent to the client terminal 108. Send.

When the client terminal 108 receives the display screen, the client terminal 108 displays the display screen on the display unit.

FIG. 3A is a diagram showing an example of a display screen 302 displayed on the display unit of the client terminal 108.

The display screen 302 has a display field 301 for displaying a video (video), a timeline 303, a timeline playback date and time 304, a camera designation 305, a play button 306, a video resolution 307, and HD (high resolution). ) The period designation 309 of the video and the annotation button 311 are provided.

The timeline 303 is a timeline of the moving image to be played back.

The playback date / time 304 of the timeline is an object (line) indicating the playback date / time of the currently playing video. The timeline 303 is configured to move left and right (longitudinal direction of the timeline) so that the reproduction time of the image coincides with the reproduction date and time 304 when the image is reproduced. Further, the timeline 303 can be moved left and right (longitudinal direction of the timeline) according to a user's instruction, whereby an arbitrary time can be set at the position of the playback date and time 304. .. Further, when the playback button 306 is pressed by the user with an arbitrary time set to the reproduction date and time 304, the video can be reproduced from the set arbitrary time.

The camera designation 305 is a reception unit that allows the user to specify (select) a network camera that has captured a moving image (video) to be displayed in the display field 301 among a plurality of network cameras. In the example of FIG. 3A, "network camera 1" is designated. This reception unit is a pull-down, and is configured so that one network camera can be selected from a plurality of network cameras by being selected by the user. The plurality of network cameras displayed in this pull-down are network cameras identified by a plurality of camera IDs managed by the recording server 107.

The playback button 306 is a playback button that allows the user to receive an instruction to reproduce the video from the time indicated by the playback date and time 304 on the timeline.

The video resolution 307 is a display field for displaying whether the resolution of the video currently being played is VGA (low resolution) or HD (high resolution).

The HD (high resolution) video period designation 309 is a reception unit (for example, a text box) that allows the user to specify a period (time zone) in which the HD (high resolution) video is preferentially acquired and displayed. ..

The annotation button 311 is a reception unit that receives an annotation instruction from the user.

The client terminal 108 accepts the designation (selection) of the network camera that captured the moving image (video) to be displayed in the display field 301 by operating the camera designation 305 on the display screen 302 by the user.

When the timeline 303 is operated (moved) left and right (longitudinal direction of the timeline) by the user and the current time is set as an arbitrary time at the position of the playback date and time 304, the client terminal 108 displays a live image. It is determined that the display setting has been made.

The client terminal 108 receives the designation of the network camera that captured the moving image to be displayed by the user with the camera designation 305, and also receives the display request of the live image by the user (the timeline 303 is left and right (timeline by the user)). It is operated (moved) in the longitudinal direction of (S705), and it is determined whether or not the current position is set at the position of the playback date and time 304 (S705).

When the client terminal 108 accepts the designation of the network camera that captured the moving image to be displayed by the user with the camera designation 305 and the user receives the display request of the live image (S705: YES), the client terminal 108 makes the designation. The received live video display request of the network camera is transmitted to the recording server 107 (S706). Specifically, the client terminal 108 transmits the camera ID of the network camera that has received the designation and the display request of the live image of the network camera identified by the camera ID to the recording server 107.

When the recording server 107 receives the camera ID and the live image display request of the network camera identified by the camera ID from the client terminal 108 (S709), the recording server 107 receives the live image of the network camera identified by the camera ID. (S710). The recording server 107 determines whether or not the display request for the live image of the network camera identified by the camera ID has been received (received) in S709 (S711), and it is determined that the display request has been received in S709. In this case (S711: YES), the live video received in S710 (live video of the network camera identified by the camera ID) is transmitted to the client terminal 108 (S712). At this time, a display screen including a timeline in which the reproduction time of the video indicates the reproduction date and time 304 is transmitted to the client terminal 108. Then, the recording server 107 stores the moving image data of the live video in S713.

When the client terminal 108 receives the live image and the display screen transmitted in S712 (S707), the client terminal 108 displays the display screen on the display unit and of the network camera identified by the camera ID of the network camera that has received the designation. The live image is displayed in the display field 301 (S708).

When the recording server 107 does not receive the camera ID and the live image display request of the network camera identified by the camera ID from the client terminal 108, the processing of S709 is skipped and the processing of S710 is performed. Execute.

The display field 301 displayed in FIG. 3A is a diagram showing an example of the live image displayed in S708. In this way, the client terminal 108 continues to display the current live video. Then, the client terminal 108 returns the process to S705.

The recording server 107 receives the video transmitted in S716 and information (HD (high definition)) indicating the resolution of the video (S717).

At this time, the combined information (address of the high-resolution camera) of the port number "2" indicating the port transmitted from the router 106 and the IP address "A" of the router 106 is also received (S717).

S717 is an application example of the second video acquisition means of the present invention, in which a second video (high resolution video) taken by a network camera having a higher resolution than the first video acquired by the first video acquisition means is displayed. It is acquired after the first video is acquired by the first video acquisition means.

Then, the recording server 107 identifies the camera ID that identifies the network camera of the video from the received high-resolution camera address (A: 2).

Specifically, the recording server 107 refers to the camera image management table 1101 (FIG. 11) stored in the storage means of the external memory 211 of the recording server 107, and the address of the camera for high resolution received in S717. The camera ID (1) corresponding to (A: 2) is specified.

Regarding the images acquired in S701 and S703 at the same shooting time zone and the same angle of view, the data capacity of the video (low resolution video) transmitted in S702 is the data capacity of the video (high resolution video) transmitted in S716. The video transmitted in S702 (low resolution video) is registered in the recording server 107 before the video transmitted in S716 (high resolution video) in S713, and is registered in the video management table 1201. It is managed.

Therefore, the recording server 107 specifies the low-resolution video to be overwritten and registered in the high-resolution video received in S717 (S718). Specifically, the recording server 107 refers to the video management table 1201 of the specified camera ID (1), and obtains the file ID of the low-resolution video in the same time zone as the high-resolution video received in S717. Identify.

Then, the recording server 107 transmits the low-resolution video (low-resolution video at the same time (time zone) as the shooting time (shooting time zone) of the high-resolution video received in S717) specified in S718 in S717. Overwrite and register the received high-resolution video. Further, the recording server 107 updates (changes) the resolution of the record in the video management table 1201 corresponding to the overwritten video from VGA (low resolution) to HD (high resolution) (S719).

S719 is an application example of the registration means of the present invention, in which the second video acquired by the second video acquisition means is overwritten with the first video stored in the storage means and registered.

That is, the registration means acquires the second video acquired by the second video acquisition means from the first port associated with the acquisition destination of the second video with related information and stores it in the storage means. 1 Overwrite the video and register it.

For example, in the case where the recording server 107 has already recorded the video in S713 as shown in the video management table 1201 (A) of FIG. 12, in S717, the start time: 11:40 on January 1, 2018. Minutes to end time: When a high-resolution video is received until 11:50 on January 1, 2018, the file ID shown in the video management table 1201 (A) is a low-resolution video identified by 001. The moving image file (video) is overwritten and registered with the high-resolution video received in S717. Then, as shown in the video management table 1201 (B), the video with the file ID 001 is overwritten with the high-resolution video. Similarly, when high-resolution video is received in S717 from 11:50 on January 1, 2018 to 112:00 on January 1, 2018, the video management table The low-resolution moving image file (video) whose file ID shown in 1201 (A) is identified by 002 is overwritten and registered with the high-resolution video received in S717. In addition, when high-resolution video from start time: January 1, 2018 12:00 to end time: January 1, 2018 12:10 is received in S717, the video management table 1201 ( The low-resolution moving image file (video) whose file ID shown in A) is identified by 003 is overwritten and registered with the high-resolution video received in S717. In this way, when the video for a predetermined time (for example, 10 minutes) is overwritten and registered, the recording server 107 changes the resolution of the video management table 1201 corresponding to the overwritten video from VGA (low resolution) to HD ( Update (change) to (high resolution).

The video management table shown in 1201 (B) of FIG. 12 shows an updated video management table in which a low-resolution video having a file ID of 001 to 003 in the video management table 1201 (A) is overwritten and registered in a high-resolution video. This is just one example.

In this way, the recording server 107 overwrites and registers the high-resolution video on the low-resolution video without recognizing that the low-resolution video and the high-resolution video are images taken by different network cameras. As a result, the memory area of the recording server 107 can be reduced, and the cost can be reduced.

Further, in S719, since the high-resolution video is registered as the video related to the low-resolution video already registered in S713, the low-resolution live video and the high-resolution video are regarded as the video shot by the same network camera. Be managed. Therefore, the user can easily check the low-resolution live image and the high-resolution image taken by the same network camera. Therefore, the user can easily manage a plurality of images of different resolutions taken by the network camera.

As described above, the registration means of S719 includes the acquisition destination of the first video by the first video acquisition means (A: 1 in the example of FIG. 11) and the acquisition destination of the second video by the second video acquisition means (FIG. 11). In the example of, the second video acquired by the second video acquisition means is registered as the video related to the first video stored in the storage means according to A: 2).

Next, the recording server 107 can distinguish between the high-resolution video time zone 308 and the low-resolution video time zone 313 based on the updated resolution value of the video management table 1201 (B). A timeline to be used is generated, and a display screen including the timeline is transmitted to the client terminal 108 (S720). Then, the process returns to S717.

When the client terminal 108 receives the display screen transmitted in S720 (S707), the client terminal 108 displays the display screen (S708). At this time, the client terminal 108 continues to display the live video transmitted from the recording server 107, and displays only the timeline portion updated in S719.

For example, as shown in the video management table 1201 (B) of FIG. 12, the start time is from 11:40 on January 1, 2018 to 12:10 on January 1, 2018, which is a high-resolution video. As shown in the display screen 302 shown in FIG. 3B, the time zone 308 of the video in which the high-resolution video is overwritten and registered in order to identifiablely display that the subsequent video is a low-resolution video. The timeline of is identified and displayed in a color different from the timeline of the time zone 313 of the low-resolution video recorded on the recording server 107. For example, the timeline of the time zone 308 of the video in which the high-resolution video is overwritten is displayed in red, and the timeline of the time zone 313 of the low-resolution video recorded on the recording server 107 is blue. Display with.

In this way, since the time zone 308 of the video in which the high-resolution video is overwritten and registered and the time zone 313 of the low-resolution video recorded on the recording server 107 are displayed in an identifiable manner, the user can display the high-resolution video in a high resolution. It becomes possible to easily grasp the time zone in which the video can be viewed and the time zone in which the low-resolution video can be viewed, and the convenience of the user can be improved.

When the recording server 107 cannot specify the low-resolution image to be overwritten and registered in the high-resolution image received in S717 in S718, that is, the camera image corresponds to the address of the high-resolution camera received in S717. If it is not registered in the management table 1101 to the address of the low-resolution camera, it is determined that the video received in S717 is not the video to be overwritten, and the video received in S717 is not registered by overwriting. It is stored (registered) in a storage means such as a memory of the recording server 107. That is, the registration means registers the video acquired from the port that is not associated with the related information without overwriting.

Next, an example of display processing of the recorded video (low-resolution video or high-resolution video) stored in the recording server 107 will be described with reference to FIG.

FIG. 8 is a flowchart showing an example of display processing of the recorded video (low-resolution video or high-resolution video) stored in the recording server 107.

The processes shown in S801 to S804 shown in FIG. 8 are realized by the CPU 201 of the client terminal 108 reading and executing the program.

Further, the processes shown in S805 and S806 shown in FIG. 8 are realized by the CPU 201 of the recording server 107 reading and executing the program.

First, the client terminal 108 displays the shooting date and time (also referred to as shooting time) of the video (recorded video) recorded on the recording server 107 and the video of the shooting date and time via the display screen 302 displayed on the display unit. It is determined whether or not the user has accepted the instruction to be performed (S801).

Specifically, the client terminal 108 left and right (time) the timeline 303 by the user's operation, for example, from the display screen 302 shown in FIG. 3A to the display screen 302 shown in FIG. 4C. It is moved in the longitudinal direction of the line), and an arbitrary past time (shooting date and time) can be set at the position of the playback date and time 304. In the example of FIG. 4C, 12:24 on January 1, 2018 is set as the playback time (shooting date and time). Further, the client terminal 108 can receive a video display request for the shooting date and time by pressing the play button 306 by the user.

As a result, the client terminal 108 can receive the shooting time of the video recorded on the recording server 107 (for example, 12:24 on January 1, 2018) and the instruction to display the video at the shooting time by the user. it can.

When it is determined that the client terminal 108 has received the shooting date and time of the video recorded on the recording server 107 and the instruction to display the video of the shooting date and time via the display screen 302 (S801: YES). , The process is shifted to S802, and when it is determined that the instruction is not accepted (S801: NO), the process is shifted to S705.

The client terminal 108 transmits the shooting time received in S801 and the display request of the recorded video of the shooting time to the recording server 107 (S802).

When the recording server 107 receives the shooting time transmitted in S802 and the display request for the recorded video (S805), the recording server 107 identifies the moving image file of the video at the shooting time and transmits it to the client terminal 108 (S806).

Specifically, the recording server 107 specifies a record in which the shooting time received in S805 is included in the period from the start time to the end time of the video management table 1201, specifies the file ID of the record, and determines the file ID. Identify the video file indicated by the file ID. Then, the recording server 107 transmits the specified moving image file to the client terminal 108 (S806). In S806, a moving image file taken after the end time of the specified moving image file can also be transmitted.

For example, if the recording time of the recorded video requested to be displayed is 12:24 on January 1, 2018, the recording server 107 is a moving image file (low) having a file ID of 005 in the video management table 1201 (B). A moving image having a resolution) is transmitted to the client terminal 108 (S806).

When the client terminal 108 receives the video (video file) of the shooting time specified by the user from the recording server 107 (S803), the client terminal 108 reproduces the video from the shooting time specified by the user and reproduces the video from the shooting time specified by the user, and the display field of the display screen 302 It is displayed on 301 (S804).

In the example of FIG. 4C, in order to reproduce the low-resolution video, the display column of 307 indicates that the video currently being played is a VGA (low-resolution) video. When the client terminal 108 executes the process of S804, the client terminal 108 returns the process to S801.

FIG. 4C describes the display screen when a low-resolution video playback instruction is given from 12:24 on January 1, 2018, but FIG. 4D shows January 1, 2018. The display screen when the reproduction instruction of the high-resolution video from 12:08 is given will be described.

For example, from the display screen 302 shown in FIG. 3A, the client terminal 108 shifts the timeline 303 left and right (longitudinal direction of the timeline) by the user's operation as shown in the display screen 302 shown in FIG. 4D. It is possible to set an arbitrary past shooting time (reproduction time) at the position of the reproduction date and time 304. In the example of FIG. 4D, 12:08 on January 1, 2018 is set as the shooting time (reproduction time). Further, the client terminal 108 can receive a video display request for the shooting date and time (shooting time) by pressing the play button 306 by the user.

In the example of FIG. 4D, in order to reproduce a high-resolution image, the display column of 307 indicates that the currently reproduced image is an HD (high-resolution) image.

Next, the display processing of the high-resolution recorded video for the period specified by the user will be described with reference to FIG.

FIG. 9 is a flowchart showing an example of display processing of a high-resolution recorded video for a period specified by the user.

The processes shown in S901 to S904 shown in FIG. 9 are realized by the CPU 201 of the client terminal 108 reading and executing the program.

Further, the processes shown in S905 to S911 shown in FIG. 9 are realized by the CPU 201 of the recording server 107 reading and executing the program.

Further, the processes shown in S912 and S913 shown in FIG. 9 are realized by the CPU 201 of the information processing apparatus 104 reading and executing the program.

Here, an embodiment in which the process shown in FIG. 9 is started according to a user's instruction while displaying a live image in S708 will be described as an example.

The client terminal 108 receives the user from the reception unit of 309 of the display screen 302 to specify the period for which the high-resolution image is desired to be displayed.

For example, in S708, the client terminal 108 specifies a period during which a user wants to display a high-resolution image on the reception unit of 309 while the display screen 302 (FIG. 3 (B)) is displayed on the display unit. Accept.

For example, as shown in 309 of the display screen shown in FIG. 5 (E), the client terminal 108 accepts input for a period from 12:20 on January 1, 2018 to 12:30 on January 1, 2018.

The display screen 302 shown in FIGS. 3 (B) and 5 (E) is displayed based on the video management table 1201 (B) of FIG.

The client terminal 108 determines whether or not the user has accepted the designation (designated period) of the period for which the high-resolution video is desired to be displayed in the reception unit of 309 (S901). Then, when it is determined that the designated period is not accepted (S901: NO), the process is returned to S901. If it is determined that the designated period has been accepted (S901: YES), the period for accepting the input (designated period) is transmitted to the recording server 107 (S902).

Further, in S902, the camera ID of the network camera that has received the designation of the network camera that captured the moving image to be displayed by the user with the camera designation 305 is also transmitted to the recording server 107.

When the recording server 107 receives the camera ID and the specified period from the client terminal 108 (S905), the recording server 107 is an image taken by the network camera indicated by the camera ID, and the high-resolution image specified by the period is displayed. It is determined whether or not it is recorded (S906).

Specifically, the recording server 107 specifies the video management table 1201 of the camera ID (for example, 1) received in S905.

Then, the recording server 107 has a designated period received in S905 among the records of the specified video management table 1201 from the start time to the end time of the video management table 1201 (for example, FIG. 12B). By identifying the record included in the period and determining whether the resolution included in the record is HD (high resolution), it is determined whether or not the high resolution video specified in the period is recorded. To do.

When the recording server 107 determines that the high-resolution video specified for the period is being recorded (S906: YES), the recording server 107 shifts the processing to S912 and is indicated by the file ID of the specified record. The video file is transmitted to the client terminal 108 (S911).

Further, when the recording server 107 determines that the high-resolution video specified for the period has not been recorded (the resolution included in the specified record is VGA (low resolution)), the recording server 107 determines (S906: NO). ), The process shifts to S907.

In S907, the recording server 107 first identifies the address (A: 2) of the high-resolution camera stored in the camera image management table 1101 corresponding to the camera ID received in S905.

Then, the recording server 107 transmits the designated period received in S905 to the information processing device 104, and requests the acquisition of a high-resolution video (S907). Specifically, the recording server 107 transmits the specified period received in S905 to the address (A: 2) of the specified high-resolution camera, and requests to acquire the high-resolution video of the specified period. I do. Then, when the router 106 receives the acquisition request of the high-resolution video of the designated period and the designated period at the port of the port number 2, the information processing apparatus 104 acquires the high-resolution video of the designated period. Send the request.

FIG. 9 describes an embodiment in S907 in which the designated period received in S905 is transmitted to the information processing apparatus 104 to request the acquisition of a high-resolution video of the designated period.

When the information processing device 104 receives the acquisition request and the designated period from the recording server 107 (S912), the information processing apparatus 104 stops the current transmission of the high-resolution video in S716 and transmits the high-resolution video in S716. The high-resolution video in the designated period is transmitted to the recording server with priority over (S913). In S913, information indicating high resolution (for example, HD (high resolution)) is also transmitted.

Specifically, the information processing device 104 transmits a high-resolution video during the designated period to the router 106. Then, the router 106 transmits the high-resolution video in the designated period to the recording server 107 from the port of the port number 2. At this time, the address of the camera for high resolution is also transmitted.

Then, when the recording server 107 receives the high-resolution video, the address of the high-resolution camera, and the information indicating the high resolution (for example, HD (high resolution)) in the designated period (S908), the recording server 107 receives it in S908. The low-resolution image to be overwritten and registered in the high-resolution image is specified (S909).

Specifically, the recording server 107 refers to the camera image management table 1101 (FIG. 11) stored in the storage means of the external memory 211 of the recording server 107, and the address of the camera for high resolution received in S908. The camera ID (1) corresponding to (A: 2) is specified.

Then, with reference to the video management table 1201 of the specified camera ID (1), the file ID of the low-resolution video in the same time zone as the high-resolution video received in S908 is specified. In this way, the low-resolution video to be overwritten is specified.

Then, the recording server 107 transmits the low-resolution video specified in S909 (a low-resolution video at the same time (time zone) as the shooting time (shooting time zone) of the high-resolution video received in S908) in S908. Overwrite and register the received high-resolution video. Further, the recording server 107 updates (changes) the resolution of the record in the video management table 1201 corresponding to the overwritten video from VGA (low resolution) to HD (high resolution) (S910). Further, here as well, similarly to S719, the moving image file is overwritten and registered every predetermined time (for example, 10 minutes). Further, the recording server 107 changes the resolution of the video management table 1201 for a designated period to HD (high resolution) and updates it (S910).

Specifically, the resolution of the record whose file ID is 005 in the video management table 1201 (B) of FIG. 12 is changed from VGA (low resolution) to HD (high resolution). The video management table changed in this way is the video management table 1201 (C) of FIG.

The video management table 1201 (C) of FIG. 13 is a diagram showing an example of the video management table updated in S910. Based on the video management table 1201 (C) of FIG. 13, the display screen 302 shown in FIG. 5 (F) is displayed in S904.

The recording server 107 generates a timeline that distinguishably displays the high-resolution video time zone 308 and the low-resolution video time zone 313 based on the updated resolution value of the video management table 1201. Then, the display screen including the timeline is transmitted to the client terminal 108 (S911). Further, the recording server 107 transmits the high-resolution video of the specified time received in S908 to the client terminal 108 (S911).

When the client terminal 108 receives the display screen transmitted in S911 and the high-resolution video for a specified time (S903), the client terminal 108 displays the display screen. Further, the client terminal 108 displays a high-resolution image of the designated time in the display field 301 (S904). Then, the process returns to S901.

FIG. 5F is a diagram showing an example of the display screen 302 displayed in S904.

314 shown in FIG. 5 (F) is a timeline in which the period specified by 309 is changed to red in order to identify that it is a high-resolution image.

For example, as shown in the video management table 1201 (C) of FIG. 13, the start time is from 11:40 on January 1, 2018 to 12:10 on January 1, 2018, which is a high-resolution video. In addition, the video during the period specified in 309 (12:20 on January 1, 2018 to 12:30 on January 1, 2018) is a high-resolution video, and the other videos are low-resolution video. As shown in 308 of the display screen shown in FIG. 5 (F), the time of the high-resolution video recorded on the recording server 107 during the time zone (308, 314) is displayed so as to be identifiable. The line and the timeline of the time zone 313 of the low-resolution video recorded on the recording server 107 are identified and displayed in different colors. For example, the timeline of the high-resolution video time zone is displayed in red, and the timeline of the low-resolution video time zone is displayed in blue.

In this way, for example, even when the user is checking the low-resolution live video and wants to check the high-resolution video during the period when the high-resolution video is not yet recorded on the recording server. Since the high-resolution video of the period specified by the user is preferentially recorded on the recording server, the user can preferentially check the high-resolution video of the specified period. It is possible to improve the convenience of the user and efficiently perform the line maintenance work.

Next, a process of adding annotations to the live video and displaying the date and time when the annotations are added on the timeline will be described with reference to FIG.

FIG. 10 is a flowchart showing an example of a process of adding annotations to live video and displaying the date and time when the annotations are added on the timeline.

The processes shown in S1001 to S1004 shown in FIG. 10 are realized by the CPU 201 of the client terminal 108 reading and executing the program.

Further, the processes shown in S100 to S1012 shown in FIG. 10 are realized by the CPU 201 of the recording server 107 reading and executing the program.

Further, the processes shown in S1013 and S1014 shown in FIG. 10 are realized by the CPU 201 of the information processing apparatus 104 reading and executing the program.

Here, an embodiment in which the process shown in FIG. 10 is started according to a user's instruction while displaying a live image in S708 will be described as an example.

The client terminal 108 determines whether or not the user has received an instruction to add the annotation 310 to an arbitrary place in the display field 301 while the live image is displayed in the display field 301 of the display screen 302. (S1001).

FIG. 6G shows an example of the display screen 302 in which the user has received an instruction to add the annotation 310 to an arbitrary place in the display field 301 in S1001.

When the client terminal 108 determines that the user has received the instruction to add the annotation 310 to an arbitrary place in the display field 301 (S1001: YES), the client terminal 108 adds the annotation 310 to the place where the instruction is received and displays it. To do. For example, as shown in FIG. 6 (G), the annotation 310 is added to the position designated by the user in the display field 301 and displayed.

Then, the client terminal 108 transmits the shooting date and time to which the annotation is added and the position information indicating the position in the screen to which the annotation is added to the recording server 107 (S1002).

Further, in S1002, the camera ID of the network camera displaying the live image being displayed (the camera ID of the network camera designated by the camera designation 305) is also transmitted to the recording server 107.

Then, the recording server 107 receives the shooting date and time to which the annotation is added, the position information indicating the position in the screen to which the annotation is added (position information indicating the position in the image), and the camera ID from the client terminal 108. Upon reception (acquisition) (S1005), it is determined whether or not the video taken by the network camera indicated by the camera ID and the high-resolution video of the date and time to which the annotation is added is recorded on the recording server 107. Judgment (S1006).

Specifically, the recording server 107 processes the video management table 1201 of the camera ID received in S1005. An example of the video management table to be processed here is shown in the video management table 1201 (B) of FIG.

S1005 is an application example of the annotation acquisition means of the present invention, and indicates the time (shooting time) at which the annotation is input by the user in S1001 and the position in the image via the display screen (302) output by the output means. Get location information.

Then, the recording server 107 starts the shooting date and time (for example, 12:31 on January 1, 2018) to which the annotation is added from each record of the video management table 1201 (B) to be processed. By determining whether the resolution of the record included in the period up to the end time is HD (high resolution), it is determined whether or not the high-resolution video of the shooting date and time is recorded on the recording server 107. (S1006).

When it is determined that the high-resolution video of the shooting date and time is recorded on the recording server 107 (S1006: YES), the recording server 107 shifts the processing to S1011. On the other hand, if it is determined that the recording is not recorded (S1006: NO), the process shifts to S1007.

The recording server 107 specifies the address (A: 2) of the high-resolution camera stored in the camera image management table 1101 corresponding to the camera ID (for example, 1) received in S1005.

Then, the recording server 107 transmits the annotated shooting date and time to the information processing device 104 (S1014).

Specifically, the recording server 107 transmits the shooting date and time to the address (A: 2) of the specified high-resolution camera, and requests the acquisition of the high-resolution video of the shooting date and time. Then, when the router 106 receives the acquisition request of the high-resolution video of the shooting date and time and the shooting date and time at the port of port number 2, the information processing device 104 is notified of the high-resolution shooting date and time and the shooting date and time. Send a request to acquire the video of.

When the information processing apparatus 104 receives the annotated shooting date and time from the recording server 107 (S1013), the information processing apparatus 104 stops the current transmission of the high-resolution video in S716 and displays the high-resolution video in S716. Prioritizing transmission, a high-resolution video for a predetermined period (time zone) from the shooting date and time to which the annotation is added is transmitted to the recording server 107 (S1014).

In S1015, information indicating the high resolution (for example, HD (high resolution)) is also transmitted.

Specifically, the information processing apparatus 104 transmits a high-resolution image of the predetermined period (time zone) and information indicating the high resolution (for example, HD (high resolution)) to the router 106. Then, the router 106 transmits a high-resolution video of the predetermined period (time zone) and information indicating the high resolution (for example, HD (high-definition)) from the port of the port number 2 to the recording server 107. To do. At this time, the address of the camera for high resolution is also transmitted.

Then, when the recording server 107 receives the high-resolution video for a predetermined period from the annotated shooting date and time, the information indicating the high resolution (for example, HD (high resolution)), and the address of the high-resolution camera (S1008). ), The low-resolution video to be overwritten and registered in the high-resolution video received in S1008 is specified (S1009).

As described above, the second video acquisition means of S1008 prioritizes the acquisition of the second video at the time when the annotation is set by the setting means when the annotation is set by the setting means.

Specifically, the recording server 107 refers to the camera image management table 1101 (FIG. 11) stored in the storage means of the external memory 211 of the recording server 107, and the address of the camera for high resolution received in S1008. The camera ID (1) corresponding to (A: 2) is specified.

Then, with reference to the video management table 1201 of the specified camera ID (1), the file ID of the low-resolution video in the same time zone as the high-resolution video received in S1008 is specified. In this way, the low-resolution video to be overwritten is specified.

The low-resolution video specified in S1009 (the video (video file) at the same time (time zone) as the shooting time (time zone) of the high-resolution video received in S1008) is the high-resolution video received in S1008. Overwrite and register to. Further, the recording server 107 changes the resolution of the video in the period registered by overwriting the video management table 1201 to HD (high resolution) and updates it (S1010).

Specifically, the resolution of the record whose file ID is 006 in the video management table 1201 (D) of FIG. 13 is changed from VGA (low resolution) to HD (high resolution). The video management table changed in this way is the video management table 1201 (D) of FIG.

The video management table 1201 (D) of FIG. 13 is a diagram showing an example of the video management table updated in S1010. Based on the video management table 1201 (D) of FIG. 13, the display screen 302 shown in FIG. 6 (H) is displayed in S1004.

The recording server 107 updates the video management table 1201 (for example, the video management table 1201 (for example, the video management table 1201)) that updates the shooting date and time with the annotation and the position information indicating the position in the screen with the annotation received in S1005 in S1010. It is stored (set) in the "annotation date and time" and the "annotation position" of the record of D)) (S1011).

S1011 is an application example of the setting means of the present invention, in which the annotation is set at the time acquired in S1005 in the video and the position information of the annotation is set.

Further, the recording server 107 can also execute the process of S1011 at a timing between S1005 and S1006.

When, for example, the recording server 107 receives information from 12:31 on January 1, 2018 to 12:33 on January 1, 2018 as the annotated shooting date and time (time zone) in S1005. Stores (registers) information on the time zone in the "annotation date and time" as shown in the video management table 1201 (D) of FIG. Further, when the information of X (50) and Y (40) is received by S1005 as the position information indicating the position in the screen to which the annotation is added, it is shown in the video management table 1201 (D) of FIG. As described above, the position information is stored (registered) in the "annotation position" (S1011).

The recording server 107 can identify the high-resolution video time zone 308, the low-resolution video time zone 313, and the annotated time based on the resolution value of the updated video management table 1201. A timeline to be displayed in is generated, and a display screen including the timeline is transmitted to the client terminal 108 (S1012). Further, the recording server 107 transmits the high-resolution video received in S1008 to the client terminal 108 (S1012).

In S1012, the recording server 107 generates a timeline including information 312 indicating that the annotation is added to the time when the annotation is added in order to display the time when the annotation is added in an identifiable manner. To do.

S1012 is an application example of the generation means of the present invention, and generates a display screen including information (312) indicating that the annotation is set for the time when the annotation is set by the setting means on the timeline. To do.

Further, the recording server 107 added an annotation to the position in the display field 301 indicated by the position information (for example, X (50), Y (40)) on the high-resolution video received in S1008 in S1012. A high-resolution video is transmitted to the client terminal 108.

S1012 is an application example of the control means of the present invention, and when the second video acquired by the second video acquisition means of S1008 is reproduced on the display screen, the annotation is displayed on the second video. To control.

When the client terminal 108 receives the display screen transmitted in S1012 and the high-resolution video (S1003), the client terminal 108 displays the display screen. Further, the client terminal 108 displays the high-resolution image in the display field 301 (S1004). The display screen displayed in S1004 is the display screen 302 shown in FIG. 6H.

As shown in the display screen 302 of FIG. 6H, the client terminal 108 displays the timeline 303 including the information 312 indicating that the annotation is added with respect to the time when the annotation is added.

Further, as shown in the display screen 302 of FIG. 6H, the client terminal 108 has an annotation added to the position in the display field 301 indicated by the position information (for example, X (50), Y (40)). Display resolution video. Then, the process is returned to S1001.

In this way, for example, when the user instructs a part to be confirmed while checking the low-resolution live image, the high-resolution image of the instructed shooting time can be confirmed with priority. At the same time, since the part to be confirmed is displayed as an annotation on the high-resolution video, the convenience of the user can be improved and the track maintenance work can be performed efficiently.

S710, S717, S908, and S1008 are application examples of the acquisition means of the present invention, and acquire images taken by a network camera.

Further, S710 is an application example of the first video acquisition means of the present invention, and S717, S908, and S1008 are application examples of the second video acquisition means of the present invention.

S712, S720, S806, 911, and S1012 are display screens for displaying images stored in the storage means, and distinguish between the time zone of the first image stored in the storage means and the time zone of the second image. This is an application example of a generation means for generating a display screen to be displayed as possible.

Further, S712, S720, S806, 911, and S1012 are application examples of the output means of the present invention, and output a display screen generated by the generation means and an image stored in the storage means to be displayed on the display unit. To do. In addition, the generation means generates a display screen including a timeline that identifies the time zone (313) of the first video and the time zone (308) of the second video.

As described above, according to the present invention, it is possible to provide a mechanism for facilitating the management of a plurality of images having different resolutions taken by a network camera.

The present invention can be implemented as, for example, a system, an apparatus, a method, a program, a recording medium, or the like. Specifically, it may be applied to a system composed of a plurality of devices, or may be applied to a device composed of one device.

Further, the program in the present invention is a program in which a computer can execute the processing method of the illustrated flowchart, and the storage medium of the present invention stores a program in which the computer can execute the processing method. The program in the present invention may be a program for each processing method of each device.

As described above, a recording medium on which a program for realizing the functions of the above-described embodiment is recorded is supplied to the system or device, and the computer (or CPU or MPU) of the system or device stores the program in the recording medium. Needless to say, the object of the present invention can be achieved by reading and executing.

In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium on which the program is recorded constitutes the present invention.

Recording media for supplying programs include, for example, flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EEPROMs, and silicon. A disk or the like can be used.

Further, by executing the program read by the computer, not only the function of the above-described embodiment is realized, but also the OS (operating system) or the like running on the computer is actually operated based on the instruction of the program. Needless to say, there are cases where a part or all of the processing is performed and the processing realizes the functions of the above-described embodiment.

Further, the program read from the recording medium is written to the memory provided in the function expansion board inserted in the computer or the function expansion unit connected to the computer, and then the function expansion board is based on the instruction of the program code. It goes without saying that there are cases where the CPU or the like provided in the function expansion unit performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiment.

Further, the present invention may be applied to a system composed of a plurality of devices or a device composed of one device. It goes without saying that the present invention can also be applied when it is achieved by supplying a program to a system or device. In this case, by reading the recording medium in which the program for achieving the present invention is stored into the system or device, the system or device can enjoy the effect of the present invention.

Further, by downloading and reading a program for achieving the present invention from a server, database, or the like on the network by a communication program, the system or device can enjoy the effect of the present invention. It should be noted that all the configurations in which the above-described embodiments and modifications thereof are combined are also included in the present invention.

101 Overhead line 102 Train 103 Line 104 Information processing device 105 Network camera 1
106 Router 107 Recording server 108 Client terminal 110 Network 111 Network

Claims (12)

An acquisition method for acquiring the first image taken by a network camera,
A storage means for storing the first video acquired by the acquisition means in the storage unit, and
With
After acquiring the first image, the acquisition means acquires a second image captured by the network camera having a resolution higher than that of the first image.
The storage means overwrites the second video acquired by the acquisition means with the first video stored in the storage unit.
An information processing device characterized in that the first image and the second image are images taken by the same network camera at the same time or in the same time zone. Related information storage means for storing related information in which the first port of the acquisition destination from which the first video is acquired by the acquisition means and the second port of the acquisition destination from which the second video is acquired by the acquisition means are stored. With
The storage means acquires the second video acquired by the acquisition means from the second port of the acquisition destination of the second video and the first port associated with the related information and stores the second video in the storage unit. The information processing apparatus according to claim 1, wherein the first image is overwritten. The information processing apparatus according to claim 2, wherein the storage means stores the video acquired from a port that is not associated with the related information without overwriting the video. The information processing apparatus according to any one of claims 1 to 3, wherein the first image is an image displayed on a display unit as a live image. A display screen for displaying an image stored in the storage unit, which is a display screen for identifiablely displaying the time zone of the first image stored in the storage unit and the time zone of the second image. The generation means to generate and
An output means that outputs the display screen generated by the generation means to be displayed on the display unit, and
The information processing apparatus according to any one of claims 1 to 4, further comprising. 5. The generation means is characterized in that the display screen including a timeline for identifying the time zone of the first video and the time zone of the second video stored in the storage unit is generated. The information processing device described in. The first video captured by the network camera is transmitted to the network using the first port of the router, and the second video captured by the network camera, which has a higher resolution than the first video, is the second port of the router. An information processing device that acquires the first video and the second video transmitted to the network using the above and stores the second video in a storage unit.
An acquisition means for acquiring the first video transmitted to the network, and
A storage means for storing the first video acquired by the acquisition means in the storage unit, and
With
The acquisition means acquires the second video after acquiring the first video, and then obtains the second video.
The storage means includes the port number of the first port of the router used when acquiring the first video, and the port number of the second port of the router used when acquiring the second video. However, on condition that the second image is associated and stored in advance, the acquired second image is stored as an image related to the first image.
An information processing device characterized in that the first image and the second image are images taken by the same network camera at the same time or in the same time zone. An acquisition method for acquiring the first image taken by a network camera,
A storage means for storing the first video acquired by the acquisition means in the storage unit, and
With
After acquiring the first image, the acquisition means acquires a second image captured by the network camera having a resolution higher than that of the first image.
The storage means is a process of storing the second image acquired by the acquisition means as an image related to the first image stored in the storage unit in response to the acquisition of the second image by the acquisition means. , And the process of erasing the first video,
An information processing device characterized in that the first image and the second image are images taken by the same network camera at the same time or in the same time zone. It is a control method in an information processing device.
The acquisition process to acquire the first image taken by the network camera,
A storage step of storing the first video acquired in the acquisition step in the storage unit, and
With
In the acquisition step, after acquiring the first image, a second image having a resolution higher than that of the first image and taken by the network camera is acquired.
In the storage step, the second video acquired in the acquisition step is overwritten with the first video stored in the storage unit.
A control method characterized in that the first image and the second image are images taken by the same network camera at the same time or in the same time zone. The first video captured by the network camera is transmitted to the network using the first port of the router, and the second video captured by the network camera, which has a higher resolution than the first video, is the second port of the router. It is a control method in an information processing apparatus that acquires the first video and the second video transmitted to the network by using the above and stores the second video in a storage unit.
An acquisition process for acquiring the first video transmitted to the network, and
A storage step of storing the first video acquired in the acquisition step in the storage unit, and
With
In the acquisition step, after acquiring the first image, the second image is acquired, and the second image is acquired.
In the storage step, the port number of the first port of the router used when acquiring the first video and the port number of the second port of the router used when acquiring the second video are used. However, on the condition that it is associated and stored in advance, the acquired second video is stored as a video related to the first video.
A control method characterized in that the first image and the second image are images taken by the same network camera at the same time or in the same time zone. It is a control method in an information processing device.
The acquisition process to acquire the first image taken by the network camera,
A storage step of storing the first video acquired in the acquisition step in the storage unit, and
With
In the acquisition step, after acquiring the first image, a second image having a resolution higher than that of the first image and taken by the network camera is acquired.
The storage step is a process of storing the second image acquired in the acquisition step as an image related to the first image stored in the storage unit in response to the acquisition of the second image by the acquisition step. , And the process of erasing the first video,
A control method characterized in that the first image and the second image are images taken by the same network camera at the same time or in the same time zone. A program for causing a computer to function as the information processing device according to any one of claims 1 to 8.

Images