WO2004006581A1 - Image information management system to provide independent images for each user - Google Patents

Image information management system to provide independent images for each user Download PDF

Info

Publication number
WO2004006581A1
WO2004006581A1 PCT/KR2002/001275 KR0201275W WO2004006581A1 WO 2004006581 A1 WO2004006581 A1 WO 2004006581A1 KR 0201275 W KR0201275 W KR 0201275W WO 2004006581 A1 WO2004006581 A1 WO 2004006581A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
user
camera
computer
cameras
Prior art date
Application number
PCT/KR2002/001275
Other languages
French (fr)
Inventor
Deok-Woo Kim
Dae-Young Jeon
Original Assignee
Deok-Woo Kim
Dae-Young Jeon
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Deok-Woo Kim, Dae-Young Jeon filed Critical Deok-Woo Kim
Priority to AU2002318489A priority Critical patent/AU2002318489A1/en
Priority to PCT/KR2002/001275 priority patent/WO2004006581A1/en
Publication of WO2004006581A1 publication Critical patent/WO2004006581A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/58—Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Definitions

  • the present invention relates to an image information management system for providing independent image information to each user, and more particularly to a camera system which is capable of storing image information captured by cameras, and processing and sending the stored image information in response to requests from a plurality of users' computers connected thereto over a network so as to provide the image information to the plurality of users over the network.
  • cameras have been developed to provide images shot through cameras to many places over networks, and used in various environments, including a security system.
  • cameras may be installed in a nursery or kindergarten so that parents can view their children over the Internet from their home, in an entrance and exit so that visitors can be identified, or in a construction job-site so that the site can be monitored from a remote site over a network.
  • These camera systems may also be applied to a variety of fields such as a video teleconference, video chat, etc.
  • a management server is adapted to manage images captured by cameras in such a manner that the images are stored, processed and sent to a plurality of users' computers over a network.
  • the management server in response to requests from the users' computers connected thereto over the network, codes the images captured by the cameras in a predetermined coding manner and sends the coded images to the users' computers over the network.
  • the users' computers Upon receiving the coded images sent from the management server, the users' computers decode and reproduce the received images through specific video players .
  • priorities for the camera operation control are assigned to the users on the basis of arrival times of control commands from the respective users' computers.
  • the plurality of users accessing the camera system must wait for their control turn to view desired images, and undesired images are displayed on each user's computer under the control of the others .
  • the present invention has been made in view of the above problems, and it is an object of the present invention to provide an image information management system for providing independent image information to each user, wherein cameras with different image capture areas are one- dimensionally or two-dimensionally arrayed around the center, images captured by the cameras are synthesized in response to a virtual camera control command from a user' s computer connected to the system over a network, and the synthesized result is coded and sent to the user's computer.
  • an image information management system for providing independent image information to each user, wherein cameras with different image capture areas are one- dimensionally or two-dimensionally arrayed around the center, images captured by the cameras are synthesized in response to a virtual camera control command from a user's computer connected to the system over a network, and the synthesized result is coded and sent to the user's computer.
  • an image information management system for providing independent image information to each user, wherein images received and stored from cameras are partitioned into predetermined stages in rows and columns, images of each of the stages are synthesized in response to a virtual camera control command-by-stages from at least one user' s computer connected to the system via a network interface, and the synthesized result is coded in a predetermined coding manner and sent to the user' s computer via the network interface .
  • Fig. 1 is a block diagram showing the construction of an image information management system for providing independent image information to each user in accordance with the present invention
  • Fig. 2 is a view showing an example of a two- dimensional array of nine cameras
  • Fig. 3a is a view showing an example of image synthesis based on a pan left command
  • Fig. 3b is a view showing an example of image synthesis based on a pan right command
  • Fig. 3c is a view showing an example of image synthesis based on a pan upward command
  • Fig. 3d is a view showing an example of image synthesis based on a pan downward command
  • Fig. 3e is a view showing an example of image synthesis based on a pan upward left command
  • Fig. 3f is a view showing an example of image synthesis based on a pan downward left command
  • Fig. 3g is a view showing an example of image synthesis based on a pan upward right command
  • Fig. 3h is a view showing an example of image synthesis based on a pan downward right command.
  • Fig. 4 is a view showing an example of an image- synthesized result based on the pan left command under the condition that images captured by the nine cameras of the two-dimensional array are partitioned into ten stages in rows and columns .
  • the image information management system comprises image input means 10 and an image management server 20.
  • the image input means 10 is adapted to capture image information
  • the image management server 20 is adapted to store the image information captured by the image input means 10, synthesize the stored image information in response to virtual camera control commands from a plurality of users' computers 30 connected thereto over a network, code the synthesized results and send the coded results to the users' computers 30.
  • the users' computers 30 Upon receiving coded images sent from the image management server 20, the users' computers 30 decode and reproduce the received images through specific video players implemented in a software manner, respectively.
  • the image input means 10 includes a plurality of cameras with different image capture areas arrayed around the center.
  • the cameras in the image input means 10 are preferably at least three cameras one-dimensionally arrayed to be symmetrical left and right around the center.
  • the cameras in the image input means 10 may be at least nine cameras two-dimensionally arrayed to be symmetrical upward, downward, left and right around the center.
  • the image input means 10 including the plurality of cameras with such different image capture areas captures images from the respective cameras and sends the captured images to the image management server 20.
  • the image management server 20 receives and stores the images captured from the respective cameras in the image input means 10 and selectively provides the received images to at least one user gaining access thereto over the network.
  • the image management server 20 includes an image receiver 21, an image storage unit 22, a network interface 23 and an image synthesis/output unit 2 .
  • the image receiver 21 acts to receive the images from the respective cameras in the image input means 10.
  • the image storage unit 22 acts to store the images received by the image receiver 21.
  • the network interface 23 is connected with the users' computers 30 over the network to transmit and receive data thereto/therefrom.
  • the image synthesis/output unit 24 acts to synthesize the images stored in the image storage unit 22 in response to a virtual camera control command from at least one of the users' computers 30 connected to the server via the network interface 23, code the synthesized result in a predetermined coding manner and send the coded result to the corresponding user's computer via the network interface 23.
  • the image information management system for providing independent image information to each user receives images from the respective cameras in the image input means 10 through the image receiver 21, stores the received images in the image storage unit 22, synthesizes the images stored in the image storage unit 22 through the image synthesis/output unit 24 in response to a virtual camera control command from at least one of the users' computers 30 connected thereto via the network interface 23, codes the synthesized result in the predetermined coding manner and sends the coded result to the corresponding user's computer via the network interface 23.
  • a coded image sent to the corresponding user's computer in the above manner is decoded and reproduced by a specific video player softwarily implemented in the computer.
  • the users' computers 30 generate different virtual camera control commands according to different camera arrays.
  • Fig. 2 shows an example of a two-dimensional array of nine cameras .
  • the two-dimensional camera array includes a one- dimensional array of cameras installed left and right around the center and a one-dimensional array of cameras installed upward and downward around the center.
  • the entire operation of the one-dimensionally arrayed cameras corresponds to a part of the entire operation of the two- dimensionally arrayed cameras and a detailed description thereof will thus be omitted.
  • the cameras of the two-dimensional array are referred to as camera 1, camera 2, camera 3, camera 4, camera 5, camera 6, camera 7, camera 8 and camera 9 in order from the upper left to the lower right for the convenience of description.
  • the cameras are symmetrically arrayed above, below, and to the left and right around the camera 5.
  • the cameras have their unique image capture areas, respectively, each of which may overlap or not the image capture areas of the surrounding cameras .
  • Images captured respectively by the cameras arrayed in the above manner are received by the image receiver 21 in the image management server 20 and stored in the image storage unit 22.
  • a user accesses the image management server 20 via the network interface 23 therein using his/her computer 30 in order to receive the images captured by the cameras .
  • the image management server 20 determines whether the user's computer 30 has a specific video player softwarily implemented to reproduce the images captured by the cameras in the computer 30. If the user's computer 30 has the specific video player, the image management server 20 codes the image captured by the camera 5 located at the center as a basic image and sends the coded image to the user's computer 30. However, in the case where the user's computer 30 does not have the specific video player, the image management server 20 sends the specific video player to the user's computer 30 in the form of an installation program which is installed and executed in the computer 30 or a plug-in program which is present and executed in the image management server. Then, the image management server 20 codes the image captured by the camera 5 at the center as the basic image and sends the coded image to the user's computer 30.
  • the specific video player preferably has a control button for inputting a virtual camera control command for image control, selected by the user's operation.
  • the inputted virtual camera control command is sent to the image management server 20 over the network.
  • the image synthesis/output unit 24 in the image management server 20 synthesizes the images stored in the image storage unit 22, codes the synthesized result in the predetermined coding manner and sends the coded result to the user' s computer 30 via the network interface 23 to reproduce it through the specific video player.
  • the virtual camera control command may be, for example, a play command, stop command, pause command or zoom-in/zoom- out command for image control.
  • the virtual camera control command may be a pan/tilt command for camera control, such as a pan left command, pan right command, pan upward command, pan downward command, pan upward left command, pan downward left command, pan upward right command or pan downward right command.
  • the play command, stop command, pause command and zoom- in/zoom-out command are well known to those skilled in the art, and a description thereof will thus be omitted.
  • the technical concept of the present invention is as follows .
  • the same number of camera systems as users is conventionally required in terms of hardware to perform independent camera control operations for the respective users. However, realizing this requirement is next to impossible in terms of cost and economy.
  • a plurality of cameras with different image capture areas are installed and images captured therefrom are synthesized in a software manner, thereby providing the same effect as that of performing independent camera control operations for the respective users.
  • the inputted pan left command is sent to the image management server 20 over the network.
  • the image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the image captured by the camera 4 in response to the sent pan left command.
  • the image synthesis/output unit 24 selects and codes a desired range of the synthesized result and sends the coded result to the user's computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning to the left .
  • Fig. 3a shows an example of image synthesis based on the pan left command.
  • the inputted pan right command is sent to the image management server 20 over the network.
  • the image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the image captured by the camera 6 in response to the sent pan right command.
  • the image synthesis/output unit 24 selects and codes a desired range of the synthesized result and sends the coded result to the user' s computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning to the right .
  • Fig. 3b shows an example of image synthesis based on the pan right command.
  • the inputted pan upward command is sent to the image management server 20 over the network.
  • the image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the image captured by the camera 2 in response to the sent pan upward command.
  • the image synthesis/output unit 24 selects and codes a desired range of the synthesized result and sends the coded result to the user's computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning upward.
  • Fig. 3c shows an example of image synthesis based on the pan upward command.
  • the inputted pan downward command is sent to the image management server 20 over the network.
  • the image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the image captured by the camera 8 in response to the sent pan downward command.
  • the image synthesis/output unit 24 selects and codes a desired range of the synthesized result and sends the coded result to the user's computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning downward.
  • Fig. 3d shows an example of image synthesis based on the pan downward command.
  • the inputted pan upward left command is sent to the image management server 20 over the network.
  • the image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the images captured by the camera 1, camera 2 and camera 4 in response to the sent pan upward left command.
  • the image synthesis/output unit 24 selects and codes a desired range of the synthesized result and sends the coded result to the user's computer 30 over the network so as to reproduce it therein.
  • Fig. 3e shows an example of image synthesis based on the pan upward left command.
  • the inputted pan downward left command is sent to the image management server 20 over the network.
  • the image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the images captured by the camera 4, camera 7 and camera 8 in response to the sent pan downward left command.
  • the image synthesis/output unit 24 selects and codes a desired range of the synthesized result and sends the coded result to the user's computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning downward left.
  • Fig. 3f shows an example of image synthesis based on the pan downward left command.
  • the inputted pan upward right command is sent to the image management server 20 over the network.
  • the image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the images captured by the camera 2, camera 3 and camera 6 in response to the sent pan upward right command.
  • the image synthesis/output unit 24 selects and codes a desired range of the synthesized result and sends the coded result to the user's computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning upward right .
  • Fig. 3g shows an example of image synthesis based on the pan upward right command.
  • the inputted pan downward right command is sent to the image management server 20 over the network.
  • the image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the images captured by the camera 6, camera 8 and camera 9 in response to the sent pan downward right command.
  • the image synthesis/output unit 24 selects and codes a desired range of the synthesized result and sends the coded result to the user's computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning downward right .
  • Fig. 3h shows an example of image synthesis based on the pan downward right command.
  • the image synthesis/output unit in the image management server synthesizes the image captured by the camera 5 with the image captured by the camera 6, selects and codes a desired range of the synthesized result and sends the coded result to the first user over the network.
  • the image synthesis/output unit in the image management server synthesizes the image captured by the camera 5 with the images captured by the camera 2, camera 3 and camera 6, selects and codes a desired range of the synthesized result and sends the coded result to the second user over the network.
  • the users each have the effect of controlling a camera independently.
  • the present camera system can perform the image pan control operation in a software manner, resulting in simplification of system construction. Further, the present system can perform an independent camera control operation for each user that the conventional camera system cannot do. In the present system, even though the number of users increases significantly, only the amount of load on a computer system increases and the users need not wait for virtual camera control commands to be executed, thereby preventing the camera system from being overloaded. On the other hand, a pan function by stages can be provided against a significant increase in the number of users, so as to fix the amount of load on the computer system based on image synthesis.
  • images received and stored from cameras are partitioned into predetermined stages in rows and columns, images of each of the stages are synthesized in response to a virtual camera control command-by-stages from at least one user' s computer connected to the system via the network interface, and the synthesized result is coded in the predetermined coding manner and sent to the user's computer via the network interface.
  • the pan function by stages can be provided.
  • the image management server may prepare synthesized images of the respective stages in advance.
  • the image management server codes the synthesized images and sends the coded results to the users' computers, respectively.
  • the network has sufficient capacity, all users connected to the system each have the same effect as that of controlling a camera independently.
  • Fig. 4 shows an example of an image-synthesized result based on the pan left command under the condition that the images captured by the nine cameras of the two-dimensional array are partitioned into ten stages in rows and columns .
  • each of the left and right pans and upward and downward pans of each of them is carried out in ten steps at maximum.
  • the present system can respond to virtual camera control commands from all users' computers connected thereto.
  • the camera when a camera is connected to the Internet, hundreds or thousands of users may use the camera.
  • the pan function by stages is very effective.
  • the image information management system for providing independent image information to each user in accordance with the present invention can accomplish the above-presented objects.
  • the present invention provides an image information management system for providing independent image information to each user, wherein an image pan control operation can be performed in a software manner, resulting in simplification of system construction. Further, the present system has the effect of performing an independent camera control operation for each user. Moreover, even though the number of users increases significantly, the camera system can be prevented from being overloaded.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

An image information management system for providing independent image information to each user. Cameras with different image capture areas are one-dimensionally or two-dimensionally arrayed around the center, images captured by the cameras are synthesized in response to a virtual camera control command from a user’s computer connected to the system over a network, and the synthesized result is coded and sent to the user’s computer. Furthermore, images received and stored from the cameras are partitioned into predetermined stages in rows and columns, images of each of the stages are synthesized in response to a virtual camera control command-by-stages from at least one user’s computer connected to the system via a network interface, and the synthesized result is coded in a predetermined coding manner and sent to the user’s computer via the network interface.

Description

IMAGE INFORMATION MANAGEMENT SYSTEM TO PROVIDE INDEPENDENT IMAGES FOR EACH USER
Technical Field
The present invention relates to an image information management system for providing independent image information to each user, and more particularly to a camera system which is capable of storing image information captured by cameras, and processing and sending the stored image information in response to requests from a plurality of users' computers connected thereto over a network so as to provide the image information to the plurality of users over the network.
Background Art
Recently, camera systems have been developed to provide images shot through cameras to many places over networks, and used in various environments, including a security system. For example, cameras may be installed in a nursery or kindergarten so that parents can view their children over the Internet from their home, in an entrance and exit so that visitors can be identified, or in a construction job-site so that the site can be monitored from a remote site over a network. These camera systems may also be applied to a variety of fields such as a video teleconference, video chat, etc.
In such a conventional camera system, a management server is adapted to manage images captured by cameras in such a manner that the images are stored, processed and sent to a plurality of users' computers over a network.
The management server, in response to requests from the users' computers connected thereto over the network, codes the images captured by the cameras in a predetermined coding manner and sends the coded images to the users' computers over the network. Upon receiving the coded images sent from the management server, the users' computers decode and reproduce the received images through specific video players .
In the conventional camera system, however, most of the cameras installed remotely from the users are of a fixed type. Recently, a camera system has been proposed which is capable of providing a simple pan/tilt function or zoom function. This camera system capable of providing the simple pan/tilt function or zoom function, however, has a disadvantage in that it does not enable an independent camera control operation for each user.
That is, even though a plurality of users each can control the operations of cameras installed in remote locations, if one of them controls a desired one of the cameras using his/her computer, the screens of the others' computers also vary therewith.
In this camera system, priorities for the camera operation control are assigned to the users on the basis of arrival times of control commands from the respective users' computers. As a result, the plurality of users accessing the camera system must wait for their control turn to view desired images, and undesired images are displayed on each user's computer under the control of the others .
Consequently, the same number of camera systems as users is required to perform independent camera control operations for the respective users. However, realizing this requirement is next to impossible in terms of cost and economy.
Disclosure of the Invention
Therefore, the present invention has been made in view of the above problems, and it is an object of the present invention to provide an image information management system for providing independent image information to each user, wherein cameras with different image capture areas are one- dimensionally or two-dimensionally arrayed around the center, images captured by the cameras are synthesized in response to a virtual camera control command from a user' s computer connected to the system over a network, and the synthesized result is coded and sent to the user's computer. It is another object of the present invention to provide an image information management system for providing independent image information to each user, wherein images received and stored from cameras are partitioned into predetermined stages in rows and columns, images of each of the stages are synthesized in response to a virtual camera control command-by-stages from at least one user's computer connected to the system via a network interface, and the synthesized result is coded in a predetermined coding manner and sent to the user's computer via the network interface, so that the entire control operation can be performed more finely.
In accordance with one aspect of the present invention, the above and other objects can be accomplished by the provision of an image information management system for providing independent image information to each user, wherein cameras with different image capture areas are one- dimensionally or two-dimensionally arrayed around the center, images captured by the cameras are synthesized in response to a virtual camera control command from a user's computer connected to the system over a network, and the synthesized result is coded and sent to the user's computer.
In accordance with another aspect of the present invention, there is provided an image information management system for providing independent image information to each user, wherein images received and stored from cameras are partitioned into predetermined stages in rows and columns, images of each of the stages are synthesized in response to a virtual camera control command-by-stages from at least one user' s computer connected to the system via a network interface, and the synthesized result is coded in a predetermined coding manner and sent to the user' s computer via the network interface .
Brief Description of the Drawings
The above and other objects, features and other advantages of the present invention will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings, in which:
Fig. 1 is a block diagram showing the construction of an image information management system for providing independent image information to each user in accordance with the present invention; Fig. 2 is a view showing an example of a two- dimensional array of nine cameras;
Fig. 3a is a view showing an example of image synthesis based on a pan left command;
Fig. 3b is a view showing an example of image synthesis based on a pan right command; Fig. 3c is a view showing an example of image synthesis based on a pan upward command;
Fig. 3d is a view showing an example of image synthesis based on a pan downward command; Fig. 3e is a view showing an example of image synthesis based on a pan upward left command;
Fig. 3f is a view showing an example of image synthesis based on a pan downward left command;
Fig. 3g is a view showing an example of image synthesis based on a pan upward right command;
Fig. 3h is a view showing an example of image synthesis based on a pan downward right command; and
Fig. 4 is a view showing an example of an image- synthesized result based on the pan left command under the condition that images captured by the nine cameras of the two-dimensional array are partitioned into ten stages in rows and columns .
Best Mode for Carrying Out the Invention
With reference to Fig. 1, there is shown in block form the construction of an image information management system for providing independent image information to each user in accordance with the present invention. As shown in Fig. 1, the image information management system comprises image input means 10 and an image management server 20.
The image input means 10 is adapted to capture image information, and the image management server 20 is adapted to store the image information captured by the image input means 10, synthesize the stored image information in response to virtual camera control commands from a plurality of users' computers 30 connected thereto over a network, code the synthesized results and send the coded results to the users' computers 30. Upon receiving coded images sent from the image management server 20, the users' computers 30 decode and reproduce the received images through specific video players implemented in a software manner, respectively.
In detail, the image input means 10 includes a plurality of cameras with different image capture areas arrayed around the center. The cameras in the image input means 10 are preferably at least three cameras one-dimensionally arrayed to be symmetrical left and right around the center. Alternatively, the cameras in the image input means 10 may be at least nine cameras two-dimensionally arrayed to be symmetrical upward, downward, left and right around the center.
Accordingly, the image input means 10 including the plurality of cameras with such different image capture areas captures images from the respective cameras and sends the captured images to the image management server 20.
The image management server 20 receives and stores the images captured from the respective cameras in the image input means 10 and selectively provides the received images to at least one user gaining access thereto over the network. To this end, the image management server 20 includes an image receiver 21, an image storage unit 22, a network interface 23 and an image synthesis/output unit 2 .
The image receiver 21 acts to receive the images from the respective cameras in the image input means 10.
The image storage unit 22 acts to store the images received by the image receiver 21.
The network interface 23 is connected with the users' computers 30 over the network to transmit and receive data thereto/therefrom.
The image synthesis/output unit 24 acts to synthesize the images stored in the image storage unit 22 in response to a virtual camera control command from at least one of the users' computers 30 connected to the server via the network interface 23, code the synthesized result in a predetermined coding manner and send the coded result to the corresponding user's computer via the network interface 23.
Therefore, the image information management system for providing independent image information to each user in accordance with the present invention receives images from the respective cameras in the image input means 10 through the image receiver 21, stores the received images in the image storage unit 22, synthesizes the images stored in the image storage unit 22 through the image synthesis/output unit 24 in response to a virtual camera control command from at least one of the users' computers 30 connected thereto via the network interface 23, codes the synthesized result in the predetermined coding manner and sends the coded result to the corresponding user's computer via the network interface 23. A coded image sent to the corresponding user's computer in the above manner is decoded and reproduced by a specific video player softwarily implemented in the computer.
On the other hand, the users' computers 30 generate different virtual camera control commands according to different camera arrays.
Fig. 2 shows an example of a two-dimensional array of nine cameras .
The two-dimensional camera array includes a one- dimensional array of cameras installed left and right around the center and a one-dimensional array of cameras installed upward and downward around the center. In this regard, the entire operation of the one-dimensionally arrayed cameras corresponds to a part of the entire operation of the two- dimensionally arrayed cameras and a detailed description thereof will thus be omitted. In Fig. 2, the cameras of the two-dimensional array are referred to as camera 1, camera 2, camera 3, camera 4, camera 5, camera 6, camera 7, camera 8 and camera 9 in order from the upper left to the lower right for the convenience of description.
As shown, in' the present embodiment, the cameras are symmetrically arrayed above, below, and to the left and right around the camera 5.
The cameras have their unique image capture areas, respectively, each of which may overlap or not the image capture areas of the surrounding cameras .
Images captured respectively by the cameras arrayed in the above manner are received by the image receiver 21 in the image management server 20 and stored in the image storage unit 22.
A user accesses the image management server 20 via the network interface 23 therein using his/her computer 30 in order to receive the images captured by the cameras .
If the user accesses the image management server 20 using his/her computer 30 to request it to provide an image, the image management server 20 determines whether the user's computer 30 has a specific video player softwarily implemented to reproduce the images captured by the cameras in the computer 30. If the user's computer 30 has the specific video player, the image management server 20 codes the image captured by the camera 5 located at the center as a basic image and sends the coded image to the user's computer 30. However, in the case where the user's computer 30 does not have the specific video player, the image management server 20 sends the specific video player to the user's computer 30 in the form of an installation program which is installed and executed in the computer 30 or a plug-in program which is present and executed in the image management server. Then, the image management server 20 codes the image captured by the camera 5 at the center as the basic image and sends the coded image to the user's computer 30.
The basic image captured by the camera 5, sent to the user's computer 30 in the above manner, is decoded and reproduced through the specific video player. The specific video player preferably has a control button for inputting a virtual camera control command for image control, selected by the user's operation. The inputted virtual camera control command is sent to the image management server 20 over the network. In response to the sent virtual camera control command, the image synthesis/output unit 24 in the image management server 20 synthesizes the images stored in the image storage unit 22, codes the synthesized result in the predetermined coding manner and sends the coded result to the user' s computer 30 via the network interface 23 to reproduce it through the specific video player.
The virtual camera control command may be, for example, a play command, stop command, pause command or zoom-in/zoom- out command for image control. Or, the virtual camera control command may be a pan/tilt command for camera control, such as a pan left command, pan right command, pan upward command, pan downward command, pan upward left command, pan downward left command, pan upward right command or pan downward right command. The play command, stop command, pause command and zoom- in/zoom-out command are well known to those skilled in the art, and a description thereof will thus be omitted.
The technical concept of the present invention is as follows . The same number of camera systems as users is conventionally required in terms of hardware to perform independent camera control operations for the respective users. However, realizing this requirement is next to impossible in terms of cost and economy. In the present invention, a plurality of cameras with different image capture areas are installed and images captured therefrom are synthesized in a software manner, thereby providing the same effect as that of performing independent camera control operations for the respective users.
Such a technique capable of providing the same effect as that of performing independent camera control operations for respective users will hereinafter be described in detail with reference to Fig. 2.
First, if a user inputs the camera pan left command through the specific video player executed on the screen of his/her computer 30, then the inputted pan left command is sent to the image management server 20 over the network. The image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the image captured by the camera 4 in response to the sent pan left command. The image synthesis/output unit 24 then selects and codes a desired range of the synthesized result and sends the coded result to the user's computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning to the left .
Fig. 3a shows an example of image synthesis based on the pan left command.
The image synthesis and coding methods are well known to those skilled in the art, and a detailed description thereof will thus be omitted.
On the other hand, if the user inputs the camera pan right command through the specific video player executed on the screen of his/her computer 30, then the inputted pan right command is sent to the image management server 20 over the network. The image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the image captured by the camera 6 in response to the sent pan right command. The image synthesis/output unit 24 then selects and codes a desired range of the synthesized result and sends the coded result to the user' s computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning to the right .
Fig. 3b shows an example of image synthesis based on the pan right command.
On the other hand, if the user inputs the camera pan upward command through the specific video player executed on the screen of his/her computer 30, then the inputted pan upward command is sent to the image management server 20 over the network. The image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the image captured by the camera 2 in response to the sent pan upward command. The image synthesis/output unit 24 then selects and codes a desired range of the synthesized result and sends the coded result to the user's computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning upward.
Fig. 3c shows an example of image synthesis based on the pan upward command. On the other hand, if the user inputs the camera pan downward command through the specific video player executed on the screen of his/her computer 30, then the inputted pan downward command is sent to the image management server 20 over the network. The image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the image captured by the camera 8 in response to the sent pan downward command. The image synthesis/output unit 24 then selects and codes a desired range of the synthesized result and sends the coded result to the user's computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning downward.
Fig. 3d shows an example of image synthesis based on the pan downward command.
On the other hand, if the user inputs the camera pan upward left command through the specific video player executed on the screen of his/her computer 30, then the inputted pan upward left command is sent to the image management server 20 over the network. The image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the images captured by the camera 1, camera 2 and camera 4 in response to the sent pan upward left command. The image synthesis/output unit 24 then selects and codes a desired range of the synthesized result and sends the coded result to the user's computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning upward left . Fig. 3e shows an example of image synthesis based on the pan upward left command.
On the other hand, if the user inputs the camera pan downward left command through the specific video player executed on the screen of his/her computer 30, then the inputted pan downward left command is sent to the image management server 20 over the network. The image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the images captured by the camera 4, camera 7 and camera 8 in response to the sent pan downward left command. The image synthesis/output unit 24 then selects and codes a desired range of the synthesized result and sends the coded result to the user's computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning downward left.
Fig. 3f shows an example of image synthesis based on the pan downward left command.
On the other hand, if the user inputs the camera pan upward right command through the specific video player executed on the screen of his/her computer 30, then the inputted pan upward right command is sent to the image management server 20 over the network. The image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the images captured by the camera 2, camera 3 and camera 6 in response to the sent pan upward right command. The image synthesis/output unit 24 then selects and codes a desired range of the synthesized result and sends the coded result to the user's computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning upward right .
Fig. 3g shows an example of image synthesis based on the pan upward right command.
On the other hand, if the user inputs the camera pan downward right command through the specific video player executed on the screen of his/her computer 30, then the inputted pan downward right command is sent to the image management server 20 over the network. The image synthesis/output unit 24 in the image management server 20 synthesizes the image captured by the camera 5 with the images captured by the camera 6, camera 8 and camera 9 in response to the sent pan downward right command. The image synthesis/output unit 24 then selects and codes a desired range of the synthesized result and sends the coded result to the user's computer 30 over the network so as to reproduce it therein. As a result, an image is obtained as if a camera captures it while panning downward right .
Fig. 3h shows an example of image synthesis based on the pan downward right command. Assume that two users access the image management server at the same time, and the first user inputs the camera pan right command while the second user inputs the camera pan upward right command. In this case, the image synthesis/output unit in the image management server synthesizes the image captured by the camera 5 with the image captured by the camera 6, selects and codes a desired range of the synthesized result and sends the coded result to the first user over the network. Also, the image synthesis/output unit in the image management server synthesizes the image captured by the camera 5 with the images captured by the camera 2, camera 3 and camera 6, selects and codes a desired range of the synthesized result and sends the coded result to the second user over the network. Thus, the users each have the effect of controlling a camera independently.
Therefore, as compared with a conventional camera system which performs an image pan control operation in a hardware manner by driving a motor of a camera in response to a virtual camera control command to actually pan the camera, the present camera system can perform the image pan control operation in a software manner, resulting in simplification of system construction. Further, the present system can perform an independent camera control operation for each user that the conventional camera system cannot do. In the present system, even though the number of users increases significantly, only the amount of load on a computer system increases and the users need not wait for virtual camera control commands to be executed, thereby preventing the camera system from being overloaded. On the other hand, a pan function by stages can be provided against a significant increase in the number of users, so as to fix the amount of load on the computer system based on image synthesis.
Namely, images received and stored from cameras are partitioned into predetermined stages in rows and columns, images of each of the stages are synthesized in response to a virtual camera control command-by-stages from at least one user' s computer connected to the system via the network interface, and the synthesized result is coded in the predetermined coding manner and sent to the user's computer via the network interface. In this manner, the pan function by stages can be provided.
Alternatively, the image management server may prepare synthesized images of the respective stages in advance. In this case, in response to virtual camera control commands- by-stages from a plurality of users' computers connected to the system via the network, the image management server codes the synthesized images and sends the coded results to the users' computers, respectively. As long as the network has sufficient capacity, all users connected to the system each have the same effect as that of controlling a camera independently.
Fig. 4 shows an example of an image-synthesized result based on the pan left command under the condition that the images captured by the nine cameras of the two-dimensional array are partitioned into ten stages in rows and columns .
Provided that the images captured by the nine cameras of the two-dimensional array are partitioned into ten stages in rows and columns, each of the left and right pans and upward and downward pans of each of them is carried out in ten steps at maximum. Hence, the horizontal and vertical pans are carried out in twenty-one steps in total (the camera 5 at the center provides the basic image, not partitioned into stages) , thereby making it possible to provide a maximum of 441 (= 21x21) synthesized images.
Accordingly, as long as the network has sufficient capacity, the present system can respond to virtual camera control commands from all users' computers connected thereto. In general terms, when a camera is connected to the Internet, hundreds or thousands of users may use the camera. In this regard, the pan function by stages is very effective.
By doing so, the image information management system for providing independent image information to each user in accordance with the present invention can accomplish the above-presented objects.
Industrial Applicability
As apparent from the above description, the present invention provides an image information management system for providing independent image information to each user, wherein an image pan control operation can be performed in a software manner, resulting in simplification of system construction. Further, the present system has the effect of performing an independent camera control operation for each user. Moreover, even though the number of users increases significantly, the camera system can be prevented from being overloaded.
Although the preferred embodiments of the present invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims

Claims

Claims :
1. An image information management system for providing independent image information to each user, comprising: image input means including a plurality of cameras, said cameras having different image capture areas arrayed around a center; and an image management server for receiving and storing respective images from said cameras in said image input means, and selectively providing the received images to at least one user gaining access thereto over a network; said image management server including: an image receiver for receiving said respective images from said cameras in said image input means; an image storage unit for storing said images received by said image receiver; a network interface connected with said user's computer; and an image synthesis/output unit for synthesizing said images stored in said image storage unit in response to a virtual camera control command from said user's computer connected to said server via said network interface, coding the synthesized result in a predetermined coding manner and sending the coded result to said user's computer via said network interface.
2. The image information management system as set forth in claim 1, wherein said image input means includes at least three cameras arrayed to be symmetrical left and right around the center.
3. The image information management system as set forth in claim 1, wherein said image input means includes at least three cameras arrayed to be symmetrical upward and downward around the center.
4. The image information management system as set forth in claim 1, wherein said image input means includes at least nine cameras arrayed to be symmetrical upward, downward, left and right around the center.
5. The image information management system as set forth in claim 2, wherein said image synthesis/output unit is adapted to, if said virtual camera control command from said user's computer is a camera pan left command, sequentially synthesize an image received from a central camera with images received from cameras arrayed left from said central camera in the order of their array, code the synthesized result in said predetermined coding manner and send the coded result to said user's computer via said network interface.
6. The image information management system as set forth in claim 2, wherein said image synthesis/output unit is adapted to, if said virtual camera control command from said user's computer is a camera pan right command, sequentially synthesize an image received from a central camera with images received from cameras arrayed right from said central camera in the order of their array, code the synthesized result in said predetermined coding manner and send the coded result to said user's computer via said network interface.
7. The image information management system as set forth in claim 3 , wherein said image synthesis/output unit is adapted to, if said virtual camera control command from said user's computer is a camera pan upward command, sequentially synthesize an image received from a central camera with images received from cameras arrayed upward from said central camera in the order of their array, code the synthesized result in said predetermined coding manner and send the coded result to said user's computer via said network interface.
8. The image information management system as set forth in claim 3, wherein said image synthesis/output unit is adapted to, if said virtual camera control command from said user's computer is a camera pan downward command, sequentially synthesize an image received from a central camera with images received from cameras arrayed downward from said central camera in the order of their array, code the synthesized result in said predetermined coding manner and send the coded result to said user's computer via said network interface.
9. The image information management system as set forth in claim 4, wherein said image synthesis/output unit is adapted to, if said virtual camera control command from said user's computer is a camera pan left command, sequentially synthesize an image received from a central camera with images received from cameras arrayed left from said central camera in the order of their array, code the synthesized result in said predetermined coding manner and send the coded result to said user's computer via said network interface.
10. The image information management system as set forth in claim 4, wherein said image synthesis/output unit is adapted to, if said virtual camera control command from said user's computer is a camera pan right command, sequentially synthesize an image received from a central camera with images received from cameras arrayed right from said central camera in the order of their array, code the synthesized result in said predetermined coding manner and send the coded result to said user's computer via said network interface.
11. The image information management system as set forth in claim 4, wherein said image synthesis/output unit is adapted to, if said virtual camera control command from said user' s computer is a camera pan upward command, sequentially synthesize an image received from a central camera with images received from cameras arrayed upward from said central camera in the order of their array, code the synthesized result in said predetermined coding manner and send the coded result to said user's computer via said network interface.
12. The image information management system as set forth in claim 4, wherein said image synthesis/output unit is adapted to, if said virtual camera control command from said user's computer is a camera pan downward command, sequentially synthesize an image received from a central camera with images received from cameras arrayed downward from said central camera in the order of their array, code the synthesized result in said predetermined coding manner and send the coded result to said user's computer via said network interface.
13. The image information management system as set forth in claim 4, wherein said image synthesis/output unit is adapted to, if said virtual camera control command from said user's computer is a camera pan upward left command, sequentially synthesize an image received from a central camera with an image received from a camera arrayed upward left from said central camera and images received from cameras arrayed adjacent thereto in the order of their array, code the synthesized result in said predetermined coding manner and send the coded result to said user's computer via said network interface .
14. The image information management system as set forth in claim 4, wherein said image synthesis/output unit is adapted to, if said virtual camera control command from said user's computer is a camera pan downward left command, sequentially synthesize an image received from a central camera with an image received from a camera arrayed downward left from said central camera and images received from cameras arrayed adjacent thereto in the order of their array, code the synthesized result in said predetermined coding manner and send the coded result to said user' s computer via said network interface .
15. The image information management system as set forth in claim 4, wherein said image synthesis/output unit is adapted to, if said virtual camera control command from said user's computer is a camera pan upward right command, sequentially synthesize an image received from a central camera with an image received from a camera arrayed upward right from said central camera and images received from cameras arrayed adjacent thereto in the order of their array, code the synthesized result in said predetermined coding manner and send the coded result to said user's computer via said network interface.
16. The image information management system as set forth in claim 4, wherein said image synthesis/output unit is adapted to, if said virtual camera control command from said user's computer is a camera pan downward right command, sequentially synthesize an image received from a central camera with an image received from a camera arrayed downward right from said central camera and images received from cameras arrayed adjacent thereto in the order of their array, code the synthesized result in said predetermined coding manner and send the coded result to said user's computer via said network interface.
17. The image information management system as set forth in any one of claim 5 to claim 16, wherein said image synthesis/output unit is adapted to partition said respective images received and stored from said cameras into predetermined stages in rows and columns, synthesize images of each of the stages in response to a virtual camera control command-by-stages from said user' s computer connected to said server via said network interface, code the synthesized result in said predetermined coding manner and send the coded result to said user's computer via said network interface .
18. The image information management system as set forth in claim 1, wherein said network is the Internet.
PCT/KR2002/001275 2002-07-05 2002-07-05 Image information management system to provide independent images for each user WO2004006581A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU2002318489A AU2002318489A1 (en) 2002-07-05 2002-07-05 Image information management system to provide independent images for each user
PCT/KR2002/001275 WO2004006581A1 (en) 2002-07-05 2002-07-05 Image information management system to provide independent images for each user

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2002/001275 WO2004006581A1 (en) 2002-07-05 2002-07-05 Image information management system to provide independent images for each user

Publications (1)

Publication Number Publication Date
WO2004006581A1 true WO2004006581A1 (en) 2004-01-15

Family

ID=30113037

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2002/001275 WO2004006581A1 (en) 2002-07-05 2002-07-05 Image information management system to provide independent images for each user

Country Status (2)

Country Link
AU (1) AU2002318489A1 (en)
WO (1) WO2004006581A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1992017875A1 (en) * 1991-04-08 1992-10-15 Hitachi, Ltd. Method and apparatus for image or data processing, and monitoring method and apparatus using the same
KR20000072269A (en) * 2000-08-24 2000-12-05 김웅순 An Obtain and Display Method of Panorama Moving Picture having High Resolution
KR20010035015A (en) * 2000-08-17 2001-05-07 음용기 Method and system for displaying integrated image of multiple data

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1992017875A1 (en) * 1991-04-08 1992-10-15 Hitachi, Ltd. Method and apparatus for image or data processing, and monitoring method and apparatus using the same
KR20010035015A (en) * 2000-08-17 2001-05-07 음용기 Method and system for displaying integrated image of multiple data
KR20000072269A (en) * 2000-08-24 2000-12-05 김웅순 An Obtain and Display Method of Panorama Moving Picture having High Resolution

Also Published As

Publication number Publication date
AU2002318489A1 (en) 2004-01-23

Similar Documents

Publication Publication Date Title
CN100361532C (en) Camera control system, camera server, client, control method, and recording medium
US11086594B2 (en) Method and apparatus for controlling surveillance system with gesture and/or audio commands
EP0845904B1 (en) Camera control system
US7859571B1 (en) System and method for digital video management
US7161623B2 (en) Camera control system, camera server, camera client, control method, and storage medium
CN1255982C (en) Remote control of camera equipment
JP3581560B2 (en) Camera control system, computer terminal, control method thereof, and storage medium storing program for executing the control
US8429703B2 (en) Video distribution apparatus, viewer apparatus, video distribution system including these apparatuses, control method for the video distribution apparatus, control method for the viewer apparatus, and computer program for the apparatuses
US6812956B2 (en) Method and apparatus for selection of signals in a teleconference
CN102244724A (en) Control device, camera, method and computer program storage device
EP2124445B1 (en) Image display device and image display method
US20100169410A1 (en) Method and Apparatus for Distributing Multimedia to Remote Clients
US7296287B2 (en) Image down-loading apparatus and system, and image down-loading method
US20010024233A1 (en) Camera control system, camera server, camera client, control method, and storage medium
US20060070105A1 (en) Control of data distribution apparatus and data distribution system
JP2005045550A (en) Imaging device, its imaging system and method
CN102244723A (en) Control device, camera system and program
JP2009021983A (en) Monitor image recording apparatus
JP2003163914A (en) Monitor system and picture transmission unit
CN103782590A (en) Method and systems for providing video data streams to multiple users
WO2004006581A1 (en) Image information management system to provide independent images for each user
KR100402265B1 (en) Management system to providing independent pictures for each user
US6940544B2 (en) Camera operating apparatus
JP4733942B2 (en) Camera system
JP3372784B2 (en) Control system, server and client device, control method, and computer-readable storage medium

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP