WO2007017987A1

WO2007017987A1 - Method of viewing image of pan and tilt function-equipped network camera from portable terminal, and pan and tilt function-equipped network camera

Info

Publication number: WO2007017987A1
Application number: PCT/JP2006/311630
Authority: WO
Inventors: Tsukasa Fujiwara
Original assignee: Megachips Corporation
Priority date: 2005-08-08
Filing date: 2006-06-09
Publication date: 2007-02-15
Also published as: JP4692138B2; JP2007049296A

Abstract

A pan and tilt function-equipped network camera in which a user can readily view an image after a pan and tilt control request is issued and can easily understand the position of the camera after pan and tilt are operated. When a pan and tilt control request is transmitted from a portable telephone, the network camera delivers only one frame of still image data that is the latest at the time when the pan and tilt control request is received. When the network camera receives the next image acquisition request sent from the portable telephone afterward, the camera delivers frames of still image data which frames include the latest still image data at the time when that next image acquisition request is received, and the portable telephone continuously playbacks the delivered frames of still image data (pseudo moving image).

Description

Specification

Pan / tilt function-equipped network camera equipped with portable terminal power and pan / tilt function-equipped network camera

Technical field

TECHNICAL FIELD [0001] The present invention relates to a technique for browsing images of a network camera equipped with a pan & tilt function, such as a mobile phone (hereinafter simply referred to as a mobile phone) or a mobile terminal such as a PDA.

Background art

[0002] Image browsing of a conventional network camera equipped with a pan-and-tilt function of mobile phone power is performed by the following process.

[0003] First, a user starts a web browser of a mobile phone, connects the mobile phone to a network camera equipped with a pan & tilt function via a network, and displays an image browsing page (C— HTML). After that, the user issues a pan & tilt function control request to the network camera by key operation on the mobile phone. In response to this command, the shooting direction of the network camera is controlled, and when the camera position reaches a predetermined shooting position, the network camera responds to an image acquisition request from the mobile phone, and the network camera receives one still image CFPEG data. ) And distribute the still image to the user's mobile phone. As a result, the mobile phone that has received the delivered still image decodes the received still image with the WEB function and then displays the still image on the display. Then, when updating the displayed still image, the user connects the mobile phone to the pan-tilt function-equipped network camera again, and performs the same operation to create a new still image (JPEG Data).

[0004] Non-Patent Document 1: Panasonic Communications Co., Ltd. website “Home Network Related Products” [Searched on July 22, 2005] <URL http://panasonic.co.jp/pcc/products/hnetwk/lineup / camera / b 丄一 c3l— contr.html

[0005] Normally, a network camera with a pan & tilt function has a plurality of functions via a network. Mobile terminals can be connected (see Figure 1 below in this regard). For this reason, even if one user intends to acquire one still image in the shooting direction as instructed by controlling the pan and tilt function, another user connected to the network camera will pan as well. When a & tilt function control request is issued, such a competitive state cannot be determined until the user connects to the network camera again to acquire the next still image. In other words, the user obtains a new image and obtains a single still image taken at a shooting angle different from the shooting direction of the lens commanded by the user. It can be recognized that the shooting direction of the network camera lens is not as specified.

[0006] Since the user is at a location remote from the network camera, even if a pan & tilt function control request is issued, the pan & tilt drive of the network camera is performed based on the pan & tilt function control request. It is difficult to correctly grasp the timing of completion. For this reason, the user needs to confirm how many times the force is correctly performed in the pan and tilt drive. In other words, in order to make it possible to actually acquire and view a still image shot at the correct shooting position after the panning and tilting operation of the network camera has been completed, the user has to manually operate the camera repeatedly. (The user manually operates the operation key of the mobile phone), connects the mobile phone to the network camera, and the still image on the mobile phone display is taken in the shooting direction as instructed. There is a need to continue updating the static screen on the mobile phone display until it can be confirmed. This kind of update work can be very troublesome for users who want to use the pan & tilt function of network cameras.

[0007] Power! In fact, it is difficult for a user to reliably determine whether or not the panning / tilting operation has ended by simply viewing a single still image on the mobile phone display. For this reason, the user is likely to issue an unnecessary pan & tilt function control request.

Disclosure of the invention

[0008] The present invention has been made in order to overcome the present technical problem, and the object of the present invention is to issue an unnecessary pan & tilt function control request. The point is to provide a method for easily viewing still images after controlling the Pan & Tilt function.

[0009] The subject of the present invention is a method for reproducing and browsing an image distributed via a network on a mobile terminal using a network camera function equipped with a network connection function, a server function, and a pan & tilt function. Each time the network camera receives an image acquisition request transmitted from the mobile terminal via the network, the still image data that the network camera is currently capturing in the memory of the network camera is received. A plurality of frames of still image data are distributed from the group to the mobile terminal, and the mobile terminal continuously reproduces the distributed still image data of the plurality of frames at a predetermined frame rate. In the process of realizing browsing, a control request for the mobile terminal power and the pan & tilt function is transmitted. In this case, the network camera delivers the latest still image data corresponding to one frame from the still image data group at the time of receiving the pan & tilt function control request to the mobile terminal. The mobile terminal displays the latest still image data for the one frame that has been distributed on the display, and is transmitted from the mobile terminal after receiving the pan & tilt function control request. Each time an image acquisition request is received, the network camera receives a plurality of frames of still image data including the latest still image data from the still image data group at the time of receiving the next image acquisition request. The mobile terminal distributes the plurality of frames of still image data at the time of reception of the next image acquisition request distributed to the predetermined frame. It is characterized by the fact that pseudo-moving video browsing is realized by continuous playback at a rate.

[0010] According to the first aspect of the present invention, an image captured by the camera after the pan & tilt function control request can be easily viewed in a moving image (pseudo moving image) format, and the camera after the pan & tilt function control is performed. As a result of easily and accurately grasping the position, unnecessary pan & tilt operations can be prevented from being performed thereafter.

[0011] According to the second aspect of the present invention, when the pan & tilt function control request is continuously transmitted, the network camera always transmits the latest one still image at that time. During that period, a plurality of still images before the latest still image are transmitted. As a result, there is an advantage that the pseudo moving image processing on the mobile terminal side need not be executed (the pseudo moving image processing can be temporarily terminated).

[0012] According to the third aspect of the present invention, the user of the mobile terminal can smoothly move the lens of the network camera equipped with the pan & tilt function as instructed during the pan & tilt function control! Because the screen can be viewed as a simulated video, you can view the images under pan & tilt function control evenly.

The objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description and the accompanying drawings.

Brief Description of Drawings

FIG. 1 is a diagram schematically showing an overall configuration of a network camera image browsing system equipped with a pan-and-tilt function provided by a mobile phone.

FIG. 2 is a block diagram schematically showing the configuration of a network camera with a pan & tilt function.

FIG. 3 is a block diagram schematically showing the core part of the configuration on the mobile phone side.

FIG. 4 is a flowchart showing the timing at which an image acquisition request is issued in a mobile phone application.

FIG. 5 is a flowchart showing processing operations performed in the present system in response to the presence / absence of a pan & tilt function control request.

FIG. 6 is a timing chart showing the process of pseudo moving image playback and still image acquisition in a mobile phone.

FIG. 7 is a diagram schematically showing still images distributed by the network camera according to the presence / absence of a pan & tilt function control request and the number of the still images.

BEST MODE FOR CARRYING OUT THE INVENTION

[0015] (Focus point)

In order to solve the above-mentioned problems, it is necessary to make the image that the user can view on the mobile phone display a moving image instead of a still image. To that end, the network camera with pan and tilt function delivers multiple still images according to the image acquisition request issued by the mobile phone application, and the mobile phone receives the multiple still images received. The surface should be automatic continuous playback (simulated video). This allows the user to view the simulated video that is automatically played on the mobile phone display, instead of manually updating the static screen, so that the camera drive state is controlled by the pan and tilt function. Can be grasped.

[0016] However, since the network camera simply delivers a plurality of screens stored in the ring buffer memory of the network camera to the mobile phone, it lacks real-time capability, so the user can pan and tilt with the mobile phone. Immediately after issuing a function control request, there arises a problem that a plurality of meaningless screens before the pan / tilt drive control of the camera is delivered. In consideration of this point, it is necessary to be able to view pseudo moving images.

Hereinafter, embodiments made based on the above-mentioned focus will be described in detail with reference to the drawings.

[0018] (Embodiment 1)

Fig. 1 is a diagram schematically showing the overall configuration of a system that enables browsing of mobile phone power network camera images.

In FIG. 1, a network camera 1 with a pan & tilt function has a network connection function and a WEB server function. And, network power with pan & tilt function is connected to camera 1 via Internet 2, telephone network 3, and base station 4 by driving multiple web phones 5, 5A, 5B by driving their web browser programs. Each mobile phone 5, 5A, 5B can automatically and periodically capture images by driving its own Java (registered trademark) application program (hereinafter simply referred to as an app). The acquisition request can be transmitted to the network camera 1 with the pan & tilt function. In addition, the user can operate the control unit 8 of the mobile phone 5, 5A, 5B to request the pan & tilt function control to change the shooting direction of the camera at any time (asynchronously with the image acquisition request). Can also be sent to the network camera 1 with non-tilt function.

In FIG. 1, reference numerals 6 and 7 denote the display and antenna of the mobile phones 5, 5A, 5B, respectively.

FIG. 2 is a block diagram schematically showing the configuration of the network camera 1 with a pan & tilt function shown in FIG. As shown in Fig. 2, the network camera 1 has a CPU 15 as its core, an image sensor (solid-state image sensor such as a CCD or CMOS sensor) 11, and the pan direction of the camera. And a pan & tilt function unit 12 for driving and controlling the tilt direction, an AZD converter 13, an image processing unit (DSP, etc.) 14, a memory 16, and a communication unit 17 for connecting to the Internet 2. Among them, the program 16P in the memory 16 includes a program for realizing the network connection function and the WEB server function, and a program for controlling each part 11, 12, 13, 14, etc. in the network camera 1. include. Further, the ring buffer memory of the memory 16 always holds a plurality of still image data (CFPEG data), and these still image data form a still image data group 16D. That is, the network camera 1 automatically and periodically drives the image sensor 11 to take a picture when the power is turned on, and the image processing condition (compression) of the image processing unit 14 that is fixed when the power is turned on. The image processing unit 14 performs predetermined image processing on each output data of the image sensor 11 based on the ratio, resolution, etc., and the compressed still image data (JPEG data) after image processing is stored in the memory. The 16 ring buffer memories are sequentially loaded into each address. When the user issues a request to change the condition of the image processing unit 14 for the mobile phone 5 as well, the network camera 1 sets the image processing conditions specified by the user in the image processing unit 14 and thereafter Also, the shooting is continued periodically, and each obtained still image data is taken into the ring buffer memory of the memory 16. When the CPU 15 of the network camera 1 receives an image acquisition request issued by the application of the mobile phone 5 via the communication unit 17, it receives still image data for the number of images (number of frames) specified by the application. It reads out from the still image data group 16D at the time, and distributes the read still image data for a plurality of frames to the mobile phone 5 through the communication unit 17.

FIG. 3 is a block diagram schematically showing the main part of the configuration of the mobile phone 5. In FIG. 3, the CPU (not shown) of the mobile phone 5 receives still image data for multiple frames transmitted as packet data from the network camera 1 based on the application download function. After being received in step 7, and stored in the communication buffer in the communication unit, the still image data for a plurality of frames is stored in the reproduction buffer memory. In the example of FIG. 3, five still image data are stored in the playback buffer memory of the mobile phone 5. Then, based on the display function of the application, the CPU of the mobile phone 5 continuously stores still image data for a plurality of frames stored in the reproduction buffer memory at a predetermined frame rate. Play 'display continuously', and allow the user to view the pseudo-video on the display 6.

[0023] Next, the operation 'function in this system will be described with reference to FIGS.

[0024] First, the user drives the WEB browser of the mobile phone 5 to connect the mobile phone 5 to the network camera 1 with the pan & tilt function shown in FIG. . Then, the user operates the operation unit 8 to drive the application of the mobile phone 5 (that is, the CPU of the mobile phone 5 executes the application program stored in the memory). Here, as illustrated in FIG. 4, the application automatically and periodically transmits an image acquisition request to the CPU 15 side of the network camera 1 with the pan & tilt function. At this time, the application designates the CPU 15 as the number of frames (the number of still images) to be distributed set by the user.

Next, referring to the flowchart of FIG. 5, it is assumed that the user now transmits a pan & tilt function control request from the mobile phone 5 (in the case of NO in step S 1). . In this case, when the CPU 15 of the network camera 1 with the pan & tilt function receives an image acquisition request from the mobile phone 5, only the number of still images specified by the application (here, 5 images are taken as an example). The latest image data, including the latest image data, is also read out from the ring buffer memory still image data group 16D and distributed to the mobile phone 5 side. If this point is illustrated in Fig. 7, when an image acquisition request is sent at time to, the CPU 15 of the network camera 1 with the pan & tilt function 1 will receive the ring buffer at time tO. Of the still image data group 16D that is always stored in the memory (in Fig. 7, the reference symbol SI indicates one frame of still image data stored in the ring buffer memory). In addition to the still image data NSI, the remaining four still image data SI captured and stored at a past point of time as viewed from the still image data NSI (hatched in Fig. 7). The still image data (SI) for each frame is also read and distributed to the mobile phone 5. Note that the distribution of multiple still image data SI at this point does not necessarily include the latest one frame of still image data NSI. [0026] On the mobile phone 5 side, the received still image data for a plurality of frames (5 frames in the example of FIG. 7) received and stored in the playback buffer memory The CPU of the telephone 5 performs pseudo moving image playback in the playback stage. However, in this embodiment, in order to increase the playback speed and make the user watch the video playback on the display, as shown in FIG. Is connected to the network camera 1 with pan & tilt function in the background while performing pseudo-video playback processing of multiple still image data already captured in the playback buffer memory. During the process, the app is driven to acquire the next still image data. Since such pseudo moving image processing is performed, the following advantages can be obtained. That is, since the mobile phone 5 can acquire a plurality of still image data with a single image acquisition request, the number of connections can be reduced and the playback speed can be improved. As a result, since multiple still image data acquired in one connection can be continuously played back at a predetermined frame rate, a moving image (pseudo moving image) can be realized for one user. The network camera 1 with pan and tilt function always captures still image data in the ring buffer memory, and when there is an image acquisition request, it stores multiple still image data stored in the memory. Therefore, the image acquisition time can be shortened. In particular, when sending multiple still image data, set the network camera 1 with pan & tilt function to send as many still image data as the maximum communication buffer capacity of the mobile app. It can be further reduced and the playback speed can be further improved.

[0027] It should be noted that even if the pseudo moving image reproduction of a plurality of still image data has been completed, the acquisition process for the next plurality of still image data has not been completed. If the video playback process is complete, but the acquisition process of the still image being processed in parallel with it has not been completed yet), the last still image is displayed on the display 6 of the mobile phone 5. However, by displaying on screen 6 that the next still image data is currently being acquired, the current status is communicated to the user.

[0028] Referring to Fig. 5 again, this time, it is assumed that the user operates the operation unit 8 of the mobile phone 5 and transmits a pan & tilt function control request from the mobile phone 5 (in step S1). If YES) In this case, CPU15 of network camera 1 with pan & tilt function When the pan & tilt function control request is received, the pan & tilt function control unit 12 is controlled in accordance with the request to change the shooting direction of the camera, and the imaging sensor 11 is also controlled to continue shooting. However, the CPU 15 of the network camera 1 with the pan & tilt function 1 stores a plurality of still image data from the still image data stored in the ring buffer memory when the pan & tilt function control request is received. Instead of transmitting to the mobile phone 5, only the latest one still image data at the time of receiving the pan & tilt function control request is always delivered to the mobile phone 5 (step S2). For example, in the case of FIG. 7, assuming that the CPU 15 of the network camera 1 with the pan & tilt function 1 receives the pan & tilt function control request at the time tl, the CPU 15 is stored in the ring buffer memory. Of the image data, only the latest still image data SNSI (image just before the camera starts moving by pan & tilt function control) at the time tl is read and distributed. By doing this, it is possible to avoid distributing to the mobile phone 5 a plurality of meaningless still image data past the time tl when the pan & tilt function control request was made (this process is here). Is defined as resetting the still image before pan & tilt function control.) O Through this reset process, the imaging sensor 11 is moving while the shooting direction is changed by the operation of the pan & tilt function control unit 12. Multiple still image data that are meaningful for the user, obtained by continuing to shoot, can be transmitted next. Through this reset process (step S2), the mobile phone 5 receives the still image data for the one sheet that has been distributed (still image data SNSI in Fig. 7 immediately before the camera starts to move by pan & tilt function control). (Video) alone is displayed on the display 6 (step S3).

When the CPU 15 receives the next image acquisition request sent from the mobile phone 5 app after receiving the pan & tilt function control request, the CPU 15 of the network camera 1 with the pan & tilt function receives the next image acquisition request. From the still image data group 16D at the time, multiple frames of still image data including the latest still image data are read from the ring buffer memory, and these still image data are distributed to the mobile phone 5 (step S4). The telephone 5 continuously reproduces the still image data of a plurality of frames at the time of receiving the next image acquisition request that has been distributed at a predetermined frame rate, and displays a pseudo moving image (step S5). These processes (steps S4 and S5) allow the user to Multiple still images taken in the shooting direction from the start and completion of the on-and-tilt function control can be viewed again as moving images (pseudo moving images). For example, in the case of FIG. 7, the CPU 15 of the network camera 1 with the pan & tilt function at time t2 receives the image acquisition request, and the still image data stored in the ring buffer memory at time t2. Group 1

In 6D, five still image data (still image data SI that has been hatched), which was obtained continuously from the past, including the latest one still image data NSI. Send to mobile phone 5. Therefore, the user browses one still screen at time tl (for example, one still screen is displayed in about 1 second), and then, at time t2, five still images played back continuously. You can view a simulated screen of image data (the time between the display of a single still screen and the start of simulated video playback is only a few seconds, for example), and the shooting screen is automatically controlled by the pan & tilt function. The user can easily recognize the situation that changes in a moving and animated manner.

[0030] As shown in FIG. 5, when the pan & tilt function control request is continuously transmitted from the mobile phone 5, the network camera 1 with the pan & tilt function always resets in step S2. Only the processing is performed, and the mobile phone 5 displays only one still image data that has been transmitted (step S3). That is, every time the CPU 15 receives a pan & tilt function control request, the CPU 15 always outputs the latest still image for one frame from the still image data group 16 D at the time when the pan & tilt function control request is received. Distribute only data to mobile phone 5. As a result, the network camera 1 only needs to send the latest still image at that time, and it is not necessary to send multiple still images before the latest still image during that period. As a result, it is not necessary to execute the pseudo moving image processing on the mobile phone 5 side.

[0031] In addition, in order to allow the user to view the pan / tilt function controlled image uniformly, the CPU 15 of the pan-and-tilt function-equipped network camera 1 has sent the previous transmission of multiple still image data to be transmitted. Still images from the still screen (video) to the latest video may be extracted and transmitted at equal intervals for the number of transmittable images. For example, in the case of FIG. 7, instead of distribution (A), a method (B) of extracting and distributing five still image data SI with a * symbol at equal intervals may be employed. Distribution (B) In this way, it is possible to recognize the situation in which the camera moves more smoothly in the process of reaching the predetermined shooting direction.

[0032] According to the present embodiment described above, the following effects can be obtained. In other words, when a pan & tilt function control request is received, the network camera 1 with pan & tilt function transmits only one still screen just before moving the camera to the mobile phone 5 in response to the pan & tilt function control request. Then, in response to subsequent image acquisition requests, a plurality of still image data including the latest image is transmitted to the mobile phone 5, and the mobile phone 5 continuously reproduces the received still image data including the latest image (pseudo). Therefore, the user can display multiple videos captured by the network camera 1 equipped with the pan & tilt function in the video (pseudo video) format before the camera is set to the desired shooting direction by controlling the pan & tilt function. This makes it easier to browse in real time. In this way, the user can view the images up to the end of the pan & tilt function control with a video, so the camera position after the pan & tilt function control is completed can be easily grasped, and unnecessary pan & There is no possibility of tilting.

Note that the “mobile terminal” referred to in the present invention includes a mobile information terminal such as a PDA (Personal Digital Assistant) in addition to a mobile phone (mobile phone terminal).

[0034] (Appendix)

The above has described and described the embodiments of the present invention in detail. The above description exemplifies aspects to which the present invention is applicable, and the present invention is not limited thereto. That is, various modifications and variations to the described aspects can be considered without departing from the scope of the present invention.

Industrial applicability

The present invention is suitable for application to pan / tilt function-equipped network camera image browsing with a portable terminal.

Claims

The scope of the claims

[1] A method for playing back and browsing on a mobile terminal an image distributed via a network from a network camera equipped with a network connection function, server function and pan & tilt function.

Each time the network camera receives an image acquisition request transmitted from the mobile terminal via the network, the network camera captures it in the memory of the network camera at that time! Internal force of image data group Distribute still image data of a plurality of frames to the mobile terminal, and the mobile terminal reproduces the distributed still image data of the plurality of frames continuously at a predetermined frame rate. In the process of realizing similar video browsing,

In the case where a control request for the pan & tilt function is transmitted, the network camera, from the still image data group at the time of receiving the pan & tilt function control request, The latest still image data for one frame is distributed to the mobile terminal, and the mobile terminal displays the latest still image data for the one frame that has been distributed on the display.

Each time the network camera receives the next image acquisition request transmitted after receiving the pan & tilt function control request, the network camera receives the still image data group at the time of receiving the next image acquisition request. A plurality of frames of still image data including the latest still image data is distributed to the mobile terminal, and the mobile terminal receives the next image acquisition request that has been distributed. Still image data is continuously played back at the predetermined frame rate to realize pseudo-video browsing,

Browsing and panning function built-in network camera image viewing method for mobile devices.

[2] A method for viewing a network camera image with a built-in pan-and-tilt function of mobile terminal power according to claim 1,

The network camera receives the pan & tilt function control request every time it receives the pan & tilt function control request when the mobile terminal power continuously receives the pan & tilt function control request. Within the still image data group at the time Only the latest still image data for one frame is always delivered to the mobile terminal.

[3] A method for viewing a network camera image with a pan-and-tilt function from a mobile terminal according to claim 1 or 2,

When the network camera receives the next image acquisition request after the pan & tilt function control request, the network camera selects the latest still image from the still image data group at the time of receiving the next image acquisition request. A method for browsing a network camera image equipped with a pan-and-tilt function that has the power of a portable terminal, wherein the still image data of the plurality of frames that are thinned out and extracted at equal intervals including the data is distributed to the portable terminal.

[4] A network camera equipped with a pan-and-tilt function having the capability of a portable terminal according to claim 1 or 2, characterized in that it is used in an image browsing method.

Network camera with pan & tilt function.