JP2015144369A - Imaging system, imaging method, water tank and control terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To image, from a water tank in an aquarium, an operator outside the water tank over fish swimming in the water tank, according to an operation the operator.SOLUTION: An imaging system for imaging using an imaging apparatus 4 installed in a water tank 8 includes: a case body 82 which is partially or wholly transparent and is installed in the water tank 8 and includes an imaging apparatus 4 disposed inside; a control terminal 1 which has the imaging apparatus 4 connected through a radio communication network 51, and has a function to remotely control the imaging operation of the imaging apparatus 4; and a remote management unit 14a which is connected to the imaging apparatus 4 and the control terminal 1 through the radio communication network 51, to manage the remote control of the imaging apparatus 4 by the control terminal 1. The imaging apparatus 4 is installed in a manner to be capable of imaging liquid in the water tank 8 and imaging outside the water tank 8 through the transparent part of the case body 82.

Description

  The present invention relates to an imaging system, an imaging method, an aquarium, and a control terminal that perform imaging using an imaging device installed in a water tank such as an aquarium for raising a liquid.

  Conventionally, there are systems in which cameras are installed at key points in theme parks such as amusement parks and aquariums, and visitors are photographed, and photographic images extracted from the target visitors are provided to visitors (for example, patents) Reference 1). In the technology disclosed in Patent Document 1, when a camera is installed at a key point in a theme park, a tag is built in a receiver for remote operation, and tag detection data is received from the tag receiver. The absolute position of the tag on the absolute coordinates is calculated from the radio wave intensity data included in the image, and a CCD camera that includes the absolute position of the tag in the shooting range is selected and shot to automatically shoot the visitors.

JP 2009-124539 A

  However, since the technique disclosed in Patent Document 1 automatically captures a user, it cannot be captured at the timing intended by the user. Therefore, in the technique disclosed in Patent Document 1, for example, when photographing fishes in an aquarium in an aquarium, there is a demand for photographing at a timing intended by the user in accordance with the movement of fish swimming in the aquarium. I could not respond to.

  Therefore, the present invention has been made in view of the above points, and can photograph an operator outside the aquarium from the inside of the aquarium's aquarium through the fish swimming in the aquarium according to the operation by the operator. It is an object to provide a system, a photographing method, a water tank, and a control terminal.

  In order to solve the above problems, the present invention is a photographing system for photographing with a photographing device installed in a water tank, and a part or all of the photographing system is installed in the water tank and the photographing device is disposed inside. A transparent case body, a photographing device connected through a communication network, a control terminal having a function of remotely controlling a photographing operation of the photographing device, and a photographing device connected to the photographing device and the control terminal through the communication network. And a management unit that manages remote control of the camera, and the imaging device is installed so as to be able to capture images of the liquid in the water tank and the outside of the water tank through the transparent portion of the case body.

Another invention is a photographing method using the above photographing system,
(1) communication connection processing for connecting the imaging device and the control terminal through a communication network;
(2) photographing operation processing for remotely controlling the photographing operation of the photographing device by the control terminal;
(3) It is characterized by having an image data acquisition process in which the image data captured by the imaging device is acquired by the management unit.

  According to the present invention as described above, the imaging device installed inside the case body in the aquarium can be remotely operated through a control terminal outside the aquarium and photographed from the aquarium to the outside of the aquarium. . As a result, for example, according to the operation by the operator, the operator outside the aquarium can be photographed from the aquarium aquarium over the fish swimming in the aquarium.

  In the above invention, the communication network between the imaging device and the control terminal is wireless communication, the case body has an opening at the top, and the opening is arranged at a position higher than the water level of the liquid in the water tank. Is preferred. In this case, the control terminal and the photographing device can be connected by wireless communication using radio waves, and the photographing device can be remotely operated from the control terminal without using a troublesome cable or cord. At this time, since the opening of the case body is disposed higher than the water level of the liquid in the water tank, even when the photographing apparatus is disposed below the surface of the water, the remote operation can be performed well without being interrupted by radio waves. .

  In the above invention, it is preferable that the management unit includes an image transfer unit that acquires image data captured by the imaging apparatus and transfers the acquired image data to an external device. In this case, the image captured by the image capturing device can be viewed on the spot by transferring it to an external device such as a printing device or a display device. For example, a storage device installed on a communication network By transferring and accumulating the data or uploading it to a Web server, it can be viewed on another communication terminal or made public to a specific user.

  In the imaging system, a water tank and a control terminal which are other inventions as described below can be used. That is, a water tank used in the photographing system includes a water tank main body in which a liquid is stored, and a part or all of the case body in which the photographing apparatus is disposed inside and disposed in the water tank main body. The case body is installed through the transparent part of the case body so that the inside of the liquid in the water tank body and the outside of the water tank body can be photographed. Has been placed.

  According to such this invention, it can image | photograph from the inside of a water tank toward the exterior of a water tank through the imaging device installed in the case body inside a water tank. In particular, in the present invention, since the opening of the case body is arranged higher than the liquid level of the liquid in the water tank, even when the photographing apparatus is arranged below the surface of the water, the remote operation can be performed satisfactorily without blocking radio waves. be able to. As a result, since the control terminal and the photographing device can be connected by radio communication using radio waves, for example, according to the operation by the operator, from the aquarium aquarium to the fish swimming in the aquarium, The outside operator can be photographed.

  In addition, the control terminal used in the imaging system has a communication interface for accessing the imaging apparatus through a communication network, an authority acquisition unit for acquiring authority to remotely control the imaging apparatus, and an authority acquired by the authority acquisition unit. And a control execution unit for executing remote control.

  According to the present invention, through the control terminal outside the water tank, the authority to perform remote control on the photographing device installed inside the case body in the water tank is acquired, and remote control is performed based on the authority. Therefore, it is possible to take a picture from the inside of the water tank toward the outside of the water tank. As a result, for example, according to the operation by the operator, the operator outside the aquarium can be photographed from the aquarium aquarium over the fish swimming in the aquarium.

  As described above, according to the present invention, it is possible to freely operate the photographing device installed in the aquarium by remote operation, and swim in the aquarium from the aquarium aquarium according to the operation by the operator. An operator outside the aquarium can be photographed over the fish.

It is a conceptual diagram which shows the whole imaging | photography system which concerns on embodiment. It is a perspective view which shows the structure of the water tank and case body which concern on embodiment. (A) is explanatory drawing which shows the imaging device and drive device in the case body which concerns on embodiment, The same figure (b) is a top view which shows the structure of a base. It is a block diagram which shows the internal structure of the imaging device which concerns on embodiment. It is a block diagram which shows the internal structure of the control terminal which concerns on embodiment. It is a block diagram which shows the internal structure of the management server which concerns on embodiment. It is a block diagram which shows the internal structure of the administrator terminal which concerns on embodiment. (A)-(d) is explanatory drawing explaining the distortion elimination process which concerns on embodiment. (A) is the figure which showed typically the flow of the process of 1st Embodiment, and the same figure (b) is the figure which showed the flow of the process of 2nd Embodiment typically. It is a flowchart explaining the imaging | photography method in 1st Embodiment. It is a flowchart explaining the imaging | photography method in 2nd Embodiment. (A) And (b) is a perspective view which shows the structure of the water tank which concerns on the example of a change. (A) And (b) is explanatory drawing which shows operation | movement of the installation angle of the case body which concerns on the example of a change. It is a block diagram which shows the internal structure of the drive device which concerns on the example of a change. It is explanatory drawing which shows the distortion elimination process which concerns on the example of a change, The figure (a) shows the characteristic pattern given to the wall in an aquarium, The figure (b) is a photography apparatus including a wall. A photographed image is shown. It is explanatory drawing which shows the distortion correction method which concerns on a modification, (a) is a top view which shows the positional relationship of a water tank and a wall, The same figure (b) was image | photographed with the imaging device including the wall. An image is shown. (A) And (b) is a perspective view which shows the imaging device which concerns on a modification, The same figure (b) is a side view which shows an imaging device. (A) And (b) shows the hemispherical image image | photographed with the fisheye lens, The same figure (c) is explanatory drawing which shows the panoramic image which synthesize | combined two hemispherical images.

[Schematic configuration]
(Configuration of shooting system)
Embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram illustrating a schematic configuration of an imaging system according to the embodiment. In the present embodiment, “photographed image” is image data recorded when a shutter operation is performed by a user operation, and is intended to be recorded or printed on a storage medium such as a memory card. . On the other hand, the “through image” in the present embodiment is not intended for recording on a storage medium such as a memory card, but means a moving image for allowing the user to recognize the state of the subject. Image data captured by the device 4 and displayed on the control terminal 1 in real time.
As shown in FIG. 1, the photographing system according to the present embodiment is a photographing system that performs photographing with a photographing device 4 installed in an aquarium 8, and includes a water tank 8, a control terminal 1, and a print installed in an aquarium. The management server 2 including the device 9, the photographing device 4, and the administrator terminal 6 and arranged on the communication network can be used as necessary. Note that the photographing device 4, the printing device 9, the control terminal 1, the administrator terminal 6, and the management server 2 can be connected to each other through the communication network 5.

  The communication network 5 is an IP network using the communication protocol TCP / IP, and was developed as various communication lines (public lines such as telephone lines, ISDN lines, ADSL lines, optical lines, dedicated lines, and third generation). 3G line, which is a communication standard, 4G line, which is a communication standard developed as the fourth generation, LTE line, which is collectively referred to as “3.9G”, which plays a bridging role between 3G and 4G, and Wifi (registered trademark) , Bluetooth (registered trademark) and other wireless communication networks 51 to 53). This IP network includes a LAN such as an intranet (company network) or a home network based on 10BASE-T, 100BASE-TX, or the like.

  In the present embodiment, the control terminal 1 and the administrator terminal 6 and the photographing device 4 are wireless LANs typified by Wifi (registered trademark), and in particular, installed in the respective terminals here without using an access point. Alternatively, they are connected by an ad hoc wireless communication network 51 that performs direct communication with each other through a built-in wireless LAN adapter. Further, the control terminal 1 and the administrator terminal 6 and the printing apparatus are connected via a short-range wireless communication network 53 that performs direct communication with each other through a short-range wireless communication technology such as Bluetooth (registered trademark). Further, when the management server 2 is installed as necessary, the control terminal 1, the administrator terminal 6, and the management server 2 are of an infrastructure type in which communication is performed via the wireless base station 3 that functions as an access point. The wireless communication network 52 can connect.

  The management server 2 can be a server computer that operates a server application for providing a shooting service, or software having a function thereof. In this embodiment, the management server 2 holds a shooting program according to the present invention, and a control terminal. 1 can be distributed. The management server 2 is a server computer that transmits information such as an HTML (Hyper Text Markup Language) file, an image file, or a music file in a document system such as WWW (World Wide Web) or software having the function. It is also possible to store information such as an HTML document and a photographed image and transmit the information through a communication network 5 such as the Internet in response to a request from client software such as a Web browser.

  The control terminal 1 and the administrator terminal 6 are arithmetic processing devices that include a CPU and have a function of remotely controlling the photographing operation of the photographing device 4. In this embodiment, the control terminal 1 and the administrator terminal 6 are owned by the operator of the aquarium or the management server 2.・ It is to be managed. The control terminal 1 is a terminal used by a user at the time of photographing. For example, the control terminal 1 is a portable communication terminal that can perform wireless communication such as a smartphone, a mobile phone, and a mobile PC. The relay point such as the terminal and the terminal communicate with each other wirelessly and can receive a communication service such as a call or data communication while moving. On the other hand, the administrator terminal 6 is a terminal used when the aquarium administrator controls the entire system. The administrator terminal 6 can be realized by a general-purpose computer such as a personal computer or a dedicated device with specialized functions. A computer, a PDA (Personal Digital Assistance), and a mobile phone are included.

  The administrator terminal 6 can also receive a communication service such as a telephone call or data communication while the relay point of the wireless base station 3 or the like and the terminal communicate with each other wirelessly. As these communication systems, for example, 4G system, LTE system, 3G system, FDMA system, TDMA system, CDMA system, W-CDMA, PHS (Personal Handyphone System) system, Wi-Fi (registered trademark), Bluetooth. Wireless LAN systems such as (registered trademark) are listed. Further, the control terminal 1 and the administrator terminal 6 are equipped with functions such as an application software execution function or a GPS function, and also function as a portable information terminal.

  The wireless base station 3 is a base station device that relays wireless communication or connects to the communication network 5, and connects devices in the wireless network through a built-in routing function or a relay device (not shown). Alternatively, it is an apparatus that is connected to the communication network 5 and establishes a wireless communication connection among the control terminal 1, the administrator terminal 6, and the photographing apparatus 4 or provides data communication via the communication network 5. A relay device (not shown) is a node device such as a modem, a terminal adapter, or a gateway device for connecting to the communication network 5, performs communication path selection and mutual conversion of data (signal), Relay processing with the communication network 5 is performed. The wireless base station 3 and the relay device include a wireless router and an access point device.

  The photographing device 4 is a digital camera, a video camera or the like for photographing a still image or a moving image, and is disposed inside a case body 82 provided in the water tank 8. The photographing device 4 is composed of a lens, a fixed imaging device, and the like, and light representing an incident subject image is formed on the light receiving surface of the CCD and is controlled via a camera signal processing circuit, an A / D converter, and the like. Image data is transmitted to the terminal 1 or the management server 2. This image data includes a moving image (including a through image) and a still image, and the moving image data is transferred in a streaming format in which a large number of continuous images are converted into frames. In the present embodiment, the photographing apparatus 4 uses a retractable type in which a lens portion is extended from the main body in accordance with zoom processing, and the lens position is advanced and retracted in the optical axis direction by zooming. In this embodiment, the photographing apparatus 4 uses a retractable type, but may use a bent (optical) type without lens extension.

  The printing device 9 is a network printer that prints a print job received from the control terminal 1 through the communication network 5 in accordance with a print instruction based on a user operation. Various printing methods such as an inkjet method, a thermal transfer method, a thermal electronic method, or a photographic method are used. An apparatus can be used. In the present embodiment, the printing apparatus 9 has a short-range wireless communication function using Bluetooth (registered trademark), UWB (Ultra Wide Band), infrared, or the like. Print the captured image.

  Next, the configuration of the water tank 8 will be described. FIG. 2 is a perspective view showing the configuration of the water tank and the case body according to the present embodiment, and FIG. 3A is an explanatory view showing the imaging device and the drive device in the case body according to the embodiment. (B) is a top view which shows the structure of a base.

  The aquarium 8 is a container that is filled with liquid to house and nurture the fish to be reared (jellyfish 10 in FIG. 1), and is installed in the aquarium body 81 in which the liquid is stored, and the aquarium body 81. And a case body 82. The water tank body 81 is a case made of acrylic resin, plastic, glass or the like, and a part or all of it is a transparent case. In the present embodiment, the water tank main body 81 has a cylindrical shape, and at least the viewer-side surface is transparent. And the liquid is stored in the water tank main body 81, and the jellyfish 10 is put in the liquid. In addition, the shape and size of the water tank main body 81 can be arbitrarily changed according to the living thing housed and raised.

  The case body 82 installed in the water tank body 81 is formed of acrylic resin, plastic, glass, or the like, and a part or all of the case body 82 is a transparent case. As shown in FIG. 1, the case body 82 has a cylindrical shape, and has an opening 82 a that communicates the external space with the internal space of the case body 82. The opening 82a is designed to be higher than the water surface when the water tank body 81 is filled with water.

  Further, the lower portion of the case body 82 has a spherical shape, and the vertical section as a whole is formed in a substantially U shape, so that a sharp shape such as a corner is not formed on the outer peripheral surface of the case body 82. . Thereby, it is possible to avoid living organisms (such as the jellyfish 10) in the water tank 8 from being caught by a sharp shape such as a corner and damaging them, so that the living organisms can be reared safely.

  Such a case body 82 is disposed at an edge portion of the water tank body 81, and the opening 82a is disposed at a position higher than the water level of the liquid in the water tank 8, and the lower end is disposed below the water surface. It has become. In particular, in the present embodiment, as shown in FIG. 2, the case body 82 is fixed to the water tank body 81 at a predetermined angle at the end of the water tank body 81, and the water flow (see FIG. 2, the case body 82 prevents the water flow from being obstructed even when a water flow that circulates up and down in the water tank 8 occurs.

  In addition, the case body 82 is fixed to the water tank body 81 via a fixing member 85 and a jig 86 located on the upper part of the water tank body 81. The fixing member 85 is formed of acrylic resin, plastic, glass, or the like, and a part or all of the fixing member 85 is a transparent member. In the present embodiment, as shown in FIG. 2, the fixing member 85 is formed in a ring shape having an outer peripheral diameter that coincides with the water tank body 81 and has an opening 85 a penetrating vertically at the center portion. Is installed. Thus, by making the fixing member 85 into a ring shape, a portion that does not overlap with the aquarium main body 81 in the top view is formed, ensuring air permeability, and the fixing member 85 functions as a scaffold.

  As shown in FIG. 2, the fixing member 85 is provided with a jig 86 which is an inner portion of the ring shape. The jig 86 is a member that connects the fixing member 85 and the case body 82, and includes a fixing member holding portion 861 that holds a part of the ring-shaped fixing member 85 and a case body holding that holds the case body 82 from the outer periphery. Part 862.

  The fixing member gripping portion 861 has a substantially U-shape when viewed from the side, and is fitted into the fixing member 85 by inserting a plate-like fixing member 85 into the rectangular cross-sectional space and sandwiching it from above and below. On the other hand, the case body holding portion 862 is a ring-shaped member that grips the case body 82 so as to be wound from the outer periphery, and has a function of adjusting the inner diameter of the ring, and changes the position where the case body 82 is gripped. Thus, the depth of the case body 82 in the water tank main body 81 can be adjusted. The inner diameter adjustment function is, for example, a configuration in which the fixing member gripping portion 861 is formed of an elastic body such as rubber, and the inner diameter of the fixing member gripping portion 861 is set slightly smaller than the outer diameter of the case body 82 and tightened. Alternatively, it may be configured such that a cut is provided in a part of the ring and the fixing member gripping portion 861 is tightened with a screw or the like.

  In the present embodiment, the case body 82 is slanted so that the lower part thereof is in contact with the side surface of the water tank body 81. However, the present invention is not limited to this, and the water flow in the water tank 8 is not limited thereto. For example, it may be installed in contact with the inner surface of the water tank body 81 in a vertical state. In this case, the ring-shaped fixing member 85 serving as a scaffold is omitted or a through-hole penetrating a part of the fixing member 85 is provided, and the case body 82 is inserted and fixed in the through-hole.

  The photographing device 4 is installed inside the case body 82. Specifically, as shown in FIG. 3A, a pedestal 72 having a horizontal surface is installed at the bottom of the case body 82, and the imaging device 4 is connected via the drive device 7 installed on the pedestal 72. It is supported horizontally. Part or all of the side portion of the case body 82 is transparent, and the photographing device 4 is supported in the horizontal direction so that the position of the camera matches the transparent portion. As a result, through the transparent portion of the case body 82, the liquid is placed in the liquid in the water tank main body 81 and at the position where the outside of the water tank main body 81 can be photographed (lower part of the case body 82).

  Thus, the imaging device 4 is installed below the inside of the case body 82, and the opening 82a is provided on the upper portion of the case body 82, so that the imaging device 4 and the control terminal 1 inside the case body 82 are provided. Wireless communication connection is possible, and the imaging device 4 arranged in the aquarium 8 is remotely operated through the control terminal 1 outside the aquarium so as to shoot from the aquarium 8 to the outside of the aquarium 8. It has become.

  The photographing device 4 holds and fixes the photographing device 4 in the case body 82 and is supported by a driving device 7 that drives the photographing device 4. When the driving device 7 is driven, the photographing device 4 is The shooting direction can be changed. In the present embodiment, the photographing apparatus 4 can be manually rotated 360 degrees in the horizontal direction, and can also be rotated or lifted in the vertical direction.

  Specifically, as shown in FIG. 3A, a pedestal 72 having a horizontal surface is installed at the bottom of the case body 82, and the imaging device 4 is connected via the drive device 7 installed on the pedestal 72. It is supported horizontally. The pedestal 72 is a disk-shaped member that matches the diameter of the case body 82, and as shown in FIG. 3B, an elongated slide hole that penetrates the pedestal 72 from the approximate center of the pedestal 72 outward. 72a is formed, and a plurality of air holes 72b penetrating the pedestal 72 are formed around the slide hole 72a. The plurality of air holes 72 b have a function of releasing air on the bottom side of the case body 82 upward when the pedestal 72 is submerged in the bottom of the case body 82.

  As shown in FIG. 3A, the driving device 7 is inserted into the slide hole 72 a of the pedestal 72 and supported so as to be manually slidable on the pedestal 72. The driving device 7 includes a device main body 71 installed on a pedestal 72, a photographing device 4, a holding unit 74 that holds and fixes the photographing device 4, and a connection that connects the device main body 71 and the holding unit 74. The unit 73 is configured. The lower part of the apparatus main body 71 is inserted into the slide hole 72a, and is slidable along the longitudinal direction of the slide hole 72a (L1 in FIG. 3A). In the present embodiment, the apparatus main body 71 is fixed to a predetermined position on the pedestal 72 by being screwed with the pedestal 72 using screws 75 provided in the apparatus main body 71.

  On the other hand, the holding unit 74 is a pedestal having a horizontal plane, and the photographing device 4 is loaded on the pedestal, and fixes the photographing device 4 via a connecting member such as a screw. The connecting portion 73 is a rod-like member that connects the apparatus main body 71 and the holding portion 74, and can manually rotate the holding portion 74 in the horizontal direction (L2 in FIG. 3A) and manually. It can also be rotated or moved up and down in the vertical direction (L3 in FIG. 3A). Thus, by rotating the connecting portion 73 of the apparatus main body 71 and changing the position and orientation of the holding portion 74, the photographing device 4 installed on the holding portion 74 is rotated in the horizontal direction and the vertical direction. Can do.

  In the present embodiment, in the photographing apparatus 4, the installation position on the pedestal 72, the photographing direction, and the zoom ratio of the optical zoom are set to predetermined values in advance. The shooting direction is set so that the user's standing position and the lens 4a are on a straight line. In addition, as the predetermined value of the installation position on the pedestal 72 and the zooming magnification of the optical zoom, the surface of the lens 4a and the inner surface 82b of the case body 82 are in close contact when the lens 4a pops out according to the optical zoom. Is set to Thereby, distortion of an image photographed through the cylindrical case body 82 is reduced.

  And the imaging device 4 in the case body 82 is imaged from the inside of the water tank 8 to the outside of the water tank 8 by being remotely operated through the control terminal 1 or the manager terminal 6 outside the water tank. Then, the captured moving image is transmitted to the control terminal 1 or the administrator terminal 6 via the wireless communication network 51 such as Wi-Fi (registered trademark), and is displayed on the display screen of the control terminal 1 or the administrator terminal 6. It can be displayed in real time. Further, when the user performs a shutter operation on the control terminal 1 or the administrator terminal 6, the control signal is transmitted to the photographing device 4, and the photographing device 4 records a still image at the timing when the shutter is operated, The still image is distributed to the control terminal 1 or the administrator terminal 6.

(Internal structure of each device)
Next, the internal structure of each device constituting the system described above will be described. FIG. 4 is a block diagram illustrating a functional configuration of the photographing apparatus 4 according to the present embodiment, and FIG. 5 is a block diagram illustrating a functional configuration of the control terminal 1 according to the present embodiment. FIG. 6 is an explanatory diagram illustrating a functional configuration of the management server 2 according to the present embodiment, and FIG. 7 is a block diagram illustrating an internal configuration of the administrator terminal according to the present embodiment. The “module” used in the description refers to a functional unit that is configured by hardware such as an apparatus or a device, software having the function, or a combination thereof, and achieves a predetermined operation. .

(1) Imaging Device First, the functional configuration of the imaging device 4 will be described. As shown in FIG. 4, the photographing apparatus 4 includes a communication interface 41, a memory 45, a control unit 42, an optical mechanism unit 44, and an image sensor 43. The communication interface 41 is a module that transmits and receives data as packets through the communication network 5. In this embodiment, the communication interface 41 includes an adapter that performs wireless communication using a data communication protocol such as Wi-Fi (registered trademark). Communicate directly with the control terminal 1 without using an access point by an ad hoc method.

  The communication interface 41 may be directly connectable to a public mobile phone network such as a 4G line, LET line, 3G line, PHS, or other high-speed data communication network. It can also be connected to a mobile phone network. An operation signal is received from the control terminal 1 via the communication interface 11, and a through image or a captured image is transmitted to the control terminal 1.

  The optical mechanism unit 44 includes a lens, a shutter, a diaphragm, a focus mechanism, a zoom mechanism, and the like, and is a module that adjusts imaging light to be exposed by the image sensor 43. The exposure determined by the shutter speed and the aperture value can be set manually by an administrator or user, or can be automatically controlled by the image processing unit 42a.

  The image sensor 43 is a solid-state imaging device that photoelectrically converts light entering from the lens of the optical mechanism unit 44, and can be configured using a CCD (Charge Coupled Device Image Sensor) or a CMOS (Complementary Metal Oxide Semiconductor). By this image sensor 43, incident light representing the subject image is formed on the light receiving surface of the image sensor 43, and an output signal is generated. The generated output signal is input to the image processing unit 42a of the control unit 42.

  The memory 45 is a storage device that stores an OS (Operating System), programs for various applications, photographed through images, photographed images, and the like, and the photographing program according to the present invention is stored in the memory 45. Has been. In the present embodiment, the memory 45 temporarily stores a predetermined number of frames as a through image in a buffer. Specifically, while a predetermined number of through images are accumulated in the buffer, when the predetermined number is exceeded, old images are sequentially deleted and new image data is stored, and the latest image is retained. ing.

  The control unit 42 includes a processor such as a CPU and a DSP (Digital Signal Processor), a memory, hardware such as other electronic circuits, software such as a program having the function, or a combination thereof. Various function modules are virtually constructed by reading and executing programs as appropriate, and each function module constructed performs various processes related to image capturing, operation control of each unit, and various processes for user operations. Do. In the present embodiment, the control unit 42 includes an image processing unit 42a and a drive control unit 42b.

  The drive control unit 42b is a module that controls the driving of the optical mechanism unit 44. The drive control unit 42b controls the optical mechanism unit 44 based on a user operation signal, so that an image such as a lens, a shutter, an aperture, a focus mechanism, and a zoom mechanism is displayed. The imaging light to be exposed by the sensor 43 is adjusted.

  The image processing unit 42a is a module that performs conversion of image data necessary for image display and performs digital signal processing specialized for image processing, and is configured using a processing device such as a DSP (Digital Signal Processor). Can do. The image processing unit 42a performs various image processing such as A / D conversion, luminance, color difference signal conversion, gamma correction, sharpness correction, contrast correction, and white balance correction on the output signal of the image sensor 43. Image data is generated, and the image data is stored in the memory 45 as a through image or a captured image.

  In particular, the image processing unit 42a has a face recognition processing function, and can focus on the operator by recognizing the operator's face in the image data acquired from the optical mechanism unit 44 and the image sensor 43 ( (Autofocus function), automatic exposure adjustment (Automatic Exposure function), white balance correction (White Balance function), or the like.

  Here, the face recognition function is a technique that extracts the contour part of the face as a feature point. It is based on eigenfaces using principal component analysis, linear discriminant analysis, elastic bunch graph matching, hidden Markov models, and neuron motivation. Various techniques such as dynamic link matching can be used. In the present embodiment, in the photographing apparatus 4, the installation position on the pedestal 72, the photographing direction, and the zoom magnification are set to predetermined values in advance, and these values do not vary due to face recognition processing. Is set as follows.

  Further, the image processing unit 42a may be provided with a function of saving image data before and after the shutter operation as a captured image. Specifically, when the shutter operation is performed, the through image stored in the buffer is recorded in the flash memory as a captured image. At this time, the memory 15 stores a plurality of image data before and after the shutter operation, so that the optimum image data can be selected.

(2) Control terminal 1
Next, the functional configuration of the control terminal 1 will be described. As shown in FIG. 5, the control terminal 1 includes a communication interface 11, a memory 15, an application execution unit 14, an output interface 13, and an input interface 12.
The communication interface 11 is a module that transmits and receives data as packets through the communication network 5 and has a function of executing wireless communication. In this embodiment, the communication interface 11 includes an adapter that performs wireless communication using a Wi-Fi (registered trademark) data communication protocol, and does not pass through an access point by the ad hoc method. Direct communication is performed to send and receive image data and operation signals. The communication interface 11 also includes an adapter that executes wireless communication using a Bluetooth (registered trademark) data communication protocol, and directly communicates with the printing apparatus 9 to transmit a print image and an operation signal.

  The communication interface 11 may be directly connectable to a public mobile phone network such as a 4G line, LET line, 3G line, PHS or other high-speed data communication network. It can also be realized by something that can be connected to the network. Further, as the wireless communication, a UWB (Ultra Wide Band) method or infrared rays may be used.

  The input interface 12 is a device for inputting user operations such as operation buttons and a touch panel. The output interface 13 is a device that outputs video and sound, such as a display and a speaker. In particular, the output interface includes a display unit 13a such as a liquid crystal display, and a GUI (Graphical User Interface) constructed by an application is displayed on the display unit 13a.

  In the present embodiment, the display unit 13a uses a touch panel type display device, and in the shooting mode, a through image is displayed as necessary and used as an electronic viewfinder for viewing angle confirmation. On the screen, a shutter icon that causes the photographing apparatus 4 to perform photographing processing is displayed, and is used as a user interface when performing a setting operation. Furthermore, the display unit 13a is used as an image display panel for displaying a captured image in the playback mode.

  The memory 15 is a storage device that stores an OS (Operating System), programs for various applications, other data, and the like. In this memory 15, a shooting program according to the present invention is downloaded from the management server 2. Accumulated. In addition, the memory 15 temporarily stores the through image transmitted from the imaging device 4 in a buffer, and records the captured image in a flash memory or the like.

  The application execution unit 14 is a module that executes an application such as a general OS or browser software, and is usually realized by a CPU or the like. In the application execution unit 14, a remote management unit 14 a that is a module for managing the entire remote control for the imaging device 4 is constructed by executing the imaging program.

  The remote management unit 14a has a function of controlling a graphic user interface (GUI) for performing display and operation related to photographing, and performs screen display for the user, click operation and character input on the screen, and the like. Accept. Specifically, the remote management unit 14a acquires a through image that is currently captured by the image capturing device 4 and displays it on the entire window in real time, and also displays a shutter button icon. Further, the remote management unit 14a includes an image formation control function for controlling color conversion for converting image data into a display image to an RGB image, switching of image data, and the like, and controlling the entire image formation processing in the display unit 13a.

  The remote management unit 14a includes an authority acquisition unit 14c, a control execution unit 14d, and an image transfer unit 14b as a group of modules for photographing by remote operation. The authority acquisition unit 14 c is a module that acquires the authority to perform remote control on the imaging device 4. The authority acquisition by the authority acquisition unit 14c is to authenticate each other in order to maintain security in wireless communication, and is processed in advance by an aquarium worker. As a technique for acquiring the authority, for example, a method in which the control terminal 1 and the photographing device 4 are brought close to each other and authentication is automatically performed using NFC (proximity authentication), or authentication using an application of the control terminal 1 is used. Good. In the authentication method using this application, for example, a wireless signal from the imaging device 4 is monitored in a state where the application is activated on the control terminal 1, and an ESSID for identifying the imaging device 4 is detected. Based on this ESSID, an identifier (such as an IP address) for identifying the own device is transmitted to the imaging device 4 to be connected, and authentication is performed.

  The control execution unit 14d is a module that executes remote control based on the authority acquired by the authority acquisition unit 14c. Specifically, the control execution unit 14d generates a remote control signal according to the selection signal when the user selects an operation icon that is a GUI displayed on the display unit 13a, and transmits the remote control signal to the photographing device 4. To do. In the present embodiment, the user operation includes a shutter operation.

  The image transfer unit 14b is a module that acquires image data (captured image) captured by the image capturing device 4 and transfers the acquired image data to an external device that prints the image data. In the present embodiment, the image transfer unit 14 b transfers the captured image to the printing device 9 or the management server 2. When transmitting a captured image to the printing apparatus 9, the image transfer unit 14 b transfers the captured image to the printing apparatus 9 via the communication interface 11 using the Bluetooth (registered trademark) system.

  In addition, when transferring a captured image to the management server 2, the image transfer unit 14 b activates an image transfer application and transmits the management server 2 via the wireless base station 3 via the 4G line, the LTE line, or the 3G line. To upload to. Here, when the captured image is uploaded to the management server 2 side, the management server 2 transmits URL information indicating the storage destination of the uploaded print image to the control terminal 1. When the remote management unit 14a of the control terminal 1 acquires the URL information indicating the access destination of the captured image, the remote transfer unit 14a generates code data such as a QR code (registered trademark) incorporating the URL information, and the image transfer unit 14b This code data is transferred to the printing device 9. The printing apparatus 9 prints and outputs code information such as a QR code (registered trademark) displayed in a predetermined pixel pattern on a recording medium based on the code data.

  The operator who has received the paper on which the code information is printed uses a user terminal possessed by the operator to photograph the printed code information with the camera of the user terminal, thereby obtaining the URL described in the code information. Traces and accesses the management server 2. Access to the management server 2 can be performed by, for example, general browser software or an FTP server. If the mail address of the user terminal is acquired, the URL information may be distributed directly from the management server 2.

  The user terminal is an information processing apparatus connected to the communication network 5 and capable of executing browser software that receives Web page data such as HTML from the communication network 5 and displays the data on a monitor. The user terminal can be realized by a general-purpose computer such as a personal computer or a dedicated device specialized for a function as long as it is an information processing device having a CPU and an arithmetic processing function. Personal Digital Assistance) and mobile phones. Further, it is assumed that the user terminal has a digital camera function for reading the printed code information.

(3) Management server 2
Next, the functional configuration of the management server 2 will be described. In addition to a single server device, the management server 2 can be composed of a plurality of types of server groups such as a Web server and a database server. In the present embodiment, as shown in FIG. 22 and storage units 231 and 232 which are database groups for storing various types of information related to the system. The communication interface 21 is a communication interface that transmits and receives data to and from the control terminal 1 and each server device through the communication network 5.

  The terminal information database 232 is a memory device that stores information related to the control terminal 1 and the administrator terminal 6 installed in the aquarium. For example, an identifier (IP address, MAC address, etc.) that identifies the control terminal 1 and the administrator terminal 6 ), The location information of the installation location, the device information of the connected imaging device 4 and printing device 9, and the like are stored in association with each other.

  The display information storage unit 231 is a device that stores various display information (Web data, captured images, and the like), and an external server that executes a service for sharing captured images can be used. In the present embodiment, the display information storage unit 231 stores a captured image for each control terminal 1 or administrator terminal 6, and the URL on the Internet to be accessed differs depending on the control terminal 1. ing. The display information storage unit 231 may include subfolders so that the URLs on the communication network 5 are different for each folder. As a result, a plurality of different URLs can be created, and captured images captured by the same control terminal 1 can be classified for each operator.

  The control unit 22 includes a processor such as a CPU or DSP (Digital Signal Processor), a memory, hardware such as other electronic circuits, software such as a program having the function, or a combination thereof. It is a module, and various function modules are virtually constructed by appropriately reading and executing a program, and various processes for operation control of each unit and user operations are performed by the constructed function modules. In this embodiment, the control unit 22 includes an authentication unit 221, a member registration unit 222, a URL generation unit 223, a captured image acquisition unit 225, and a display information distribution unit 224.

  The authentication unit 221 is a computer that verifies the legitimacy of the accessor or software having the function, acquires an identifier such as the IP address of the control terminal 1 or the administrator terminal 6 through the communication network 5, and the terminal information database 232. Is a module for confirming whether or not the accessor has the right and whether or not the accessor is the person himself / herself.

  The member registration unit 222 is a module that processes member registration of an aquarium that uses this system, and as an identifier for identifying the control terminal 1 and the administrator terminal 6, the IP addresses of the control terminal 1 and the administrator terminal 6, The MAC address and the like are acquired and recorded in the terminal information database 232, and the identifier includes information on the location of the aquarium where the control terminal 1 and the administrator terminal 6 are installed, information on the connected imaging device 4 and printing device 9. Record the association.

  The captured image acquisition unit 225 is a module that acquires a captured image transmitted from the control terminal 1. Based on the identifier of the control terminal 1 acquired at the same time, the captured image is stored in the folder for the control terminal of the display information storage unit 231. To accumulate. At this time, the captured image acquisition unit 225 may generate a subfolder each time a captured image is acquired and accumulate the captured images acquired in the subfolder. In the present embodiment, the captured image is acquired from the control terminal 1, but the captured image may be acquired via the administrator terminal 6. In this case, the captured image acquisition unit 225 stores the print image in the control terminal folder of the display information storage unit 231 based on the identifier of the administrator terminal 6 acquired at the same time.

  The URL generation unit 223 is a module that generates address information (URL including a domain, folder name, file name, etc.) that is an access destination of the user terminal, and is stored in the display information storage unit 231 in this embodiment. URL information indicating the storage destination of each captured image is generated, and the generated URL information is transmitted to the control terminal 1 based on the identifier of the control terminal 1. In the present embodiment, the URL generation unit 223 is configured to transmit the generated URL information to the control terminal 1, but the URL information may be distributed to the administrator terminal 6. In this case, the URL generation unit 223 distributes the generated URL information to the administrator terminal 6 based on the identifier of the administrator terminal 6.

  The display information distribution unit 224 is a module that distributes display information according to the present system in response to an access from a user terminal possessed by an operator. In the present embodiment, the display information distribution unit 224 is based on address information incorporated in code data. Then, the captured image of the access destination is extracted from the display information storage unit 231 and distributed to the user terminal. At this time, the display information distribution unit 224 also distributes Web data and the like for arranging the photographed image on the Web page.

(4) Administrator terminal 6
Next, the functional configuration of the administrator terminal 6 will be described. As shown in FIG. 7, the administrator terminal 6 includes a communication interface 61, a memory 65, an application execution unit 64, an output interface 63, and an input interface 62.

  The communication interface 61 is a module that transmits and receives data as packets through the communication network 5 and has a function of executing wireless communication. In this embodiment, the communication interface 61 includes an adapter that performs wireless communication using a Wi-Fi (registered trademark) data communication protocol, and does not pass through an access point by an ad hoc method. It communicates directly with the control terminal 1 to send and receive image data and operation signals.

  The communication interface 61 also includes an adapter that performs wireless communication using a Bluetooth (registered trademark) data communication protocol, and directly communicates with the printing apparatus 9 to transmit a print image and an operation signal. Also equipped. The communication interface 61 may be directly connectable to a public mobile phone network such as a 4G line, LET line, 3G line, PHS, or other high-speed data communication network. It can also be realized by something that can be connected to the network. Further, as the wireless communication, a UWB (Ultra Wide Band) method or infrared rays may be used.

  The input interface 62 is a device for inputting user operations such as operation buttons and a touch panel. The output interface 63 is a device that outputs video and sound, such as a display and a speaker. In particular, the output interface includes a display unit 63a such as a liquid crystal display, and a GUI (Graphical User Interface) constructed by an application is displayed on the display unit 63a.

  In the present embodiment, the display unit 63a may use a touch panel type display device, and in the shooting mode, a through image is displayed as necessary and used as an electronic viewfinder for viewing angle. On the screen, a shutter icon that causes the photographing apparatus 4 to perform photographing processing is displayed, and is used as a user interface when performing a setting operation. Further, the display unit 63a is used as an image display panel for displaying a photographed photographed image and allowing the user to confirm it.

  The memory 65 is a storage device that stores an OS (Operating System), programs for various applications, other data, and the like. In this memory 65, a shooting program according to the present invention is downloaded from the management server 2. Accumulated. In addition, the memory 65 temporarily stores through images transmitted from the imaging device 4 in a buffer or records the captured images in a flash memory or the like.

  The application execution unit 64 is a module that executes an application such as a general OS or browser software, and is usually realized by a CPU or the like. In the application execution unit 64, a remote management unit 64a, which is a module for managing the entire remote control for the photographing apparatus 4, and a processing unit 64b are constructed by executing the photographing program.

  The remote management unit 64a is a module group having functions similar to those of the remote management unit 14a of the control terminal 1, and has a function of controlling a graphic user interface (GUI) for performing display and operation related to photographing. In addition, a through image currently captured by the image capturing device 4 is acquired at any time and displayed in real time on the entire window, and an icon of a shutter button is displayed, and a click operation or character input on the screen is accepted. .

  The remote management unit 64a also has the same function modules as the authority acquisition unit 14c, the control execution unit 14d, and the image transfer unit 14b of the control terminal 1 as a module group for photographing by remote operation. . Note that these functions of the remote management unit 64a are the same as those of the authority acquisition unit 14c, the control execution unit 14d, and the image transfer unit 14b, and thus description thereof is omitted.

  The processing unit 64b is a module that performs predetermined image processing on the acquired captured image. In the present embodiment, by performing this processing, distortion generated in the captured image is eliminated. That is, in this embodiment, since the outside is image | photographed from the imaging device 4 inside using the cylindrical water tank main body 81 and the case body 82, the image | photographed image is shown to Fig.8 (a). As described above, the central area 102 of the photographed image is a screen on which the jellyfish 10b and the photographer without distortion are displayed, and both end areas 101 and 101 of the photographed image 100 are curved of the water tank body 81 and the case body 82 on the cylinder. Distortion (aberration) occurs depending on the surface, and the jellyfish 10a and 10a photographed in the both end regions 101 and 101 are photographed so that the width is widened.

  Therefore, in the present embodiment, the processing for eliminating this distortion is executed using the image processing unit 64b of the imaging device 4 and the administrator terminal 6. Hereinafter, this distortion elimination processing will be described. In this distortion elimination function, as a premise, the user is caused to stand at a predetermined position in front of the water tank 8 so as to be in a straight line with the photographing device 4. Then, the photographing device 4 is fixed at a predetermined position on the base 72, and the horizontal direction and the vertical direction of the lens 4a are fixed in a predetermined direction. Under this condition, one of the following three processes is executed after shooting by the shooting device 4.

(A) Optical zoom method.

  The optical zoom method is an optical at the time of shooting by the image processing unit 42a so that only the central region 102 that is less affected by distortion due to the curvature of the inner wall surface of the aquarium is photographed in the range reflected in the captured image on the inner wall surface of the aquarium. The zoom magnification is fixed to a predetermined value. When this method is used, the position of the photographing device 4 on the pedestal 72 is such that the distance between the surface of the lens 4a of the photographing device 4 and the inner surface of the case body 82 is maximized when the photographing device 4 performs zoom processing. Set to be short (or close). By setting in this way, as shown in FIG. 8B, only the area 102 without distortion is displayed on the screen of the control terminal 1 on the screen. In this state, when the user presses the shutter button at an arbitrary timing, the captured image 100 that does not include the distorted portions of the both end regions 101 and 101 is acquired.

(B) Trimming Method As shown in FIG. 8A, the trimming method is a method in which both end regions 101, 101 are captured in the processing unit 64 b of the administrator terminal 6 after shooting in a state where both end regions 101, 101 are included. In this process, the image 101 is cut and processed into a captured image including only the central region 102 without distortion. In this case, clipping range information set in advance according to the position on the pedestal 72 of the photographing device 4 and the zoom ratio of the optical zoom is accumulated in the memory 65, and both end regions are extracted from the original image based on the clipping range. 101 and 101 are cut out. By performing such processing, as shown in FIG. 8C, the captured image 100 including only the region 102 without distortion can be acquired. At this time, the processing unit 64b may digitally zoom the cropped image to enlarge it to a predetermined size.

(C) Distortion Correction Processing As shown in FIG. 8A, distortion correction processing is performed in a state in which both end regions 101 and 101 are captured and then processed by the processing unit 64 b of the administrator terminal 6. This is a process of correcting the distortions 101 and 101 and converting the both end regions 101 and 101 into images without distortion. In this case, correction values set in advance according to the position on the pedestal 72 of the photographing apparatus 4 and the magnification of the optical zoom are stored in the memory 65, and the original image has distortion based on the correction values. The distortion of both end areas 101 and 101 is corrected. By performing such processing, as shown in FIG. 8D, the distortion of the both end areas 101, 101 is eliminated, and the captured image 100 including the jellyfish 10c without distortion in the area can be acquired. .

  In this distortion correction processing, in order to further improve the correction accuracy, for example, as shown in FIGS. 16 (a) and 16 (b), image correction is performed at a predetermined position in a range captured in an image captured by the camera. It is preferable to display the markings 110a and 81a. Specifically, the marking 110 a is drawn on the surface of the wall 110 located behind the user U, and the marking 81 a is drawn on the inner wall surface of the water tank 81. The markings 110a and 81a are rectangular marks, and their shapes are known on the image processing side. For this reason, the deformation of the markings 110a and 81a reflected in the image photographed by the camera 4 is measured, and an image deformation process is performed to restore the shape to a known shape, thereby further distorting the subject reflected in the surroundings. It can be corrected appropriately. In particular, in the example shown in FIG. 16, since the marking is drawn on the back of the user U and the inner wall surface 81 a of the water tank 81, the deformation rate between the marking 110 a outside the water tank 81 and the marking 81 a inside the water tank 81. The difference in refractive index between the inside and outside of the water tank 81 can be estimated by calculating the difference between the objects in the water tank 81 and the object outside the water tank 81 can be corrected with an appropriate deformation rate.

[First Embodiment]
Various embodiments based on the basic configuration of the present invention described above will be described. First, the first embodiment will be described. FIG. 9A is a diagram schematically showing a processing flow of the first embodiment, and FIG. 10 is a flowchart for explaining a photographing method in the first embodiment. In each of the following embodiments, the wireless communication between the control terminal 1 and the photographing device 4 is performed by an ad hoc method of Wi-Fi (registered trademark) wireless communication, and the control terminal 1 and the printing device 9 are It is assumed that Bluetooth (registered trademark) wireless communication is performed. Further, in each embodiment, it is assumed that the driving device 7 is disposed in advance at a predetermined position on the pedestal 72, and the photographing direction of the photographing device 4 and the zoom magnification are determined.

  In 1st Embodiment, as shown to Fig.9 (a), the imaging device 4 is remotely operated with the control terminal 1, the image containing the jellyfish in the water tank main body 81 is image | photographed, and the image | photographed captured image is The administrator terminal 6 processes the image without distortion. Then, a case will be described as an example in which the captured image D1 is output and distributed to the operator in the printing apparatus 9 installed in the aquarium.

  Here, first, an operator of the aquarium operates the control terminal 1 to perform an operation of acquiring the authority to perform remote control on the photographing device 4. Specifically, as shown in FIG. 10, an application for remote control of the control terminal 1 is activated (S101), and communication connection processing is performed by mutual authentication between the control terminal 1 and the imaging device 4 (S102). And S103). This mutual authentication may be performed automatically using NFC (proximity authentication), or an ESSID for identifying the imaging device 4 by monitoring a radio signal from the imaging device 4 while the application is activated. May be detected, and based on the ESSID, an identifier (such as an IP address) for identifying the own device may be transmitted to the imaging device 4 to be connected for authentication. It is assumed that pairing processing is executed with the control terminal 1 in the printing apparatus 9 and mutual authentication is performed. Similarly, the administrator terminal 6 performs communication connection processing with mutual authentication with the photographing apparatus 4.

  Thereafter, when the connection is approved, the photographing device 4 and the control terminal 1 are connected through the communication network 5 (S104 and S105). Thereafter, the worker lends the control terminal 1 to the aquarium visitor for a fee. Then, when the operator operates the control terminal 1 to activate a camera application for remote operation, the operation signal is transmitted to the photographing apparatus installed inside the case body 82 via the wireless communication network 51. (S106). At this time, since the opening 82a of the case body 82 is located above the water surface in the water tank 8, the radio signal can be transmitted to the inside of the case body 82 without being blocked.

  When this control signal is acquired, the imaging device 4 drives the optical mechanism unit 44 and the image sensor 43 (S107), and converts imaging light received from the lens as needed into an image signal. This image signal is input to the image processing unit 42a and subjected to various image processing, and image data digitized as a through image is generated. The through image is temporarily stored in the memory 45 and transmitted to the control terminal 1 via the communication interface 41 (S108). Note that the through image is updated so that a predetermined number of the latest image data is accumulated. In the control terminal 1, when this through image is acquired, it is temporarily stored in the buffer of the memory 15 and displayed as moving image data on the display unit 13a under the control of the remote management unit 14a (S109).

  Thereafter, the control terminal 1 performs a remote operation process for remotely controlling the photographing operation of the photographing device 4 in accordance with a user operation. Here, the shutter operation icon is displayed on the display unit 13a, and the shooting operation of the imaging device 4 is remotely controlled by selecting the shutter operation icon.

  The control execution unit 14d determines whether or not a shutter operation signal has been received (S110), and if there is no shutter operation selection, the setting operation or shutter operation is performed while the through image is displayed on the display unit 13a. It waits until it exists (“N” in S110).

  When the face recognition function is executed in the photographing apparatus 4, it is determined whether or not the operator's face is included in the image data acquired as a through image, and the operator's face is detected. In this case, focus or white balance may be adjusted.

  Thereafter, when an image having a composition that the operator likes is displayed on the display unit 13a and a shutter operation is performed on the control terminal 1 ("Y" in S110), the control execution unit 14d displays a shutter operation signal. And a shutter operation signal is transmitted to the photographing apparatus 4.

  When receiving the shutter operation signal (S111), the image processing unit 42a of the photographing device 4 performs a photographing process (S112). Specifically, when receiving the shutter operation signal, the image processing unit 42a records the image stored in the buffer as a print image in the flash memory. At this time, the image processing unit 42a may accumulate a predetermined number of image data before and after receiving the shutter operation signal.

  The control unit 42 distributes the captured image data stored in the flash memory to the administrator terminal 6 via the communication interface 41 (S113). When the captured image data is acquired, the administrator terminal 6 executes each process on the image data when either the trimming method or the distortion correction method is selected as the distortion elimination process. Then, the image data without distortion is processed (S115). At this time, the processing unit 64b acquires the range information indicating the cut-out range or the correction value of the distortion correction processing from the memory 65, and performs the processing (S115). The processed image data is distributed to the control terminal 1.

  In the present embodiment, the image data captured by the imaging device 4 is distributed to the administrator terminal 6 and processed, but the present invention is not limited to this, and the control terminal 1 The function of the processing unit 64b of the administrator terminal 6 is provided, and the image data before processing is directly transmitted from the photographing device 4 to the control terminal 1, and the control terminal 1 displays the image data that is processed and does not include distortion. The structure displayed on the part 13a may be sufficient. Further, when the optical zoom method is used as the distortion elimination processing, the administrator terminal 6 does not perform any processing on the image data, and may be distributed directly from the photographing device 4 to the control terminal 1.

  In the control terminal 1, the image data acquired from the administrator terminal 6 is acquired by the remote management unit 14a (S116). When acquiring the image data of the captured image, the control terminal 1 displays it as a still image on the display unit 13a and stores it in the memory 15 (S116). Thereafter, the control terminal 1 and the photographing device 4 repeatedly perform the above-described processing (S108 to S116) until an image transfer processing operation signal is received (“N” in S117).

  Next, when the control terminal 1 receives an image transfer operation from the user (“Y” in S117), the image transfer unit 14b uses the captured image data in the memory as print data via the communication interface 11 as a printing device 9. (S119). When the printing apparatus 9 acquires the print data, it executes a printing process for printing the image data on a predetermined sheet (S120). The printed print image is handed to the operator.

  After that, when the operator or an operator performs an application ending operation according to the present system (“Y” in S121), the application is ended in the control terminal 1 (S122). The connection with the control terminal 1 is released (S123).

[Second Embodiment]
Next, a second embodiment of shooting control of the shooting system will be described. The gist of the present embodiment is that the management server 2 is provided on the communication network 5, the photographed images are accumulated on the management server 2, and the photographed images are browsed or disclosed through the management server 2. To do. FIG. 9B is a diagram schematically illustrating a flow of processing according to the second embodiment, and FIG. 11 is a flowchart illustrating a photographing method according to the second embodiment.

  That is, in the second embodiment, as shown in FIG. 9B, the photographing device 4 is remotely operated by the control terminal 1 to photograph an image including the jellyfish in the water tank 8, and this photograph is taken. The image data is uploaded to the external management server 2, and the printing apparatus 9 installed in the aquarium outputs code information including URL information that is an access destination of the photographed image and distributes it to the operator. To do. Here, the process from the operation of operating the control terminal 1 to acquire the authority to perform remote control to the imaging device 4 until the captured image is acquired by the control terminal 1 according to the shutter operation (S101 to S117). Since the same processing as in the first embodiment is performed, it is omitted here.

  When the photographed image is determined by the user's operation and the photographed image is stored in the control terminal 1, the image transfer unit 14b uploads the photographed image data to the management server 2 as shown in FIG. 11 (S201). ). The administrator terminal 6 may upload the captured image to the management server 2. In this case, a user upload instruction signal is transmitted from the control terminal 1 to the administrator terminal 6, and a captured image stored in the remote management unit 64 a of the administrator terminal 6 is transmitted to the management server 2 in response to the instruction signal. To do.

  When the captured image data of the management server 2 is acquired, the captured image data is captured in the folder for the control terminal 1 in the display information storage unit 231 based on the identifier of the control terminal 1 or the administrator terminal 6. The image is saved (S202). When the captured image is stored in the display information storage unit 231, the URL generation unit 223 generates URL data as an access destination of each captured image stored in the display information storage unit 231 and controls the URL data. It transmits to the terminal 1 (S203).

  When the URL data is acquired, the remote management unit 14a of the control terminal 1 generates code data such as a QR code (registered trademark) in which the URL information is incorporated, and also generates a print queue including the code data (S204). . Thereafter, the image transfer unit 14b transfers the print queue including the code data to the printing apparatus 9 (S205). Upon receiving the print queue (S206), the printing apparatus 9 prints code information (two-dimensional code or the like) based on the code data in the print queue and outputs the paper D2 (S207), and the printed paper To the operator.

  After that, when the operator or an operator performs an application ending operation according to the present system (“Y” in S208), the application is ended in the control terminal 1 (S209). The connection with the control terminal 1 is released (S210).

(Action / Effect)
As described above, according to such an embodiment, the photographing device 4 installed inside the case body 82 in the aquarium 8 is remotely operated through the control terminal 1 outside the aquarium 8, To the outside of the water tank 8. As a result, for example, according to the operation by the operator, the operator outside the aquarium 8 can be photographed from the aquarium aquarium 8 over the fish swimming in the aquarium 8.

  Moreover, according to each said embodiment, the communication network 5 between the imaging device 4 and the control terminal 1 is radio | wireless communication, the case body 82 has the opening 82a in the upper part, and the opening 82a is in the water tank 8. Since it is arranged at a position higher than the water level of the liquid, the control terminal 1 and the photographing device 4 can be connected by radio communication using radio waves, and from the control terminal 1 without using a troublesome cable or cord. The photographing device 4 can be remotely operated. At this time, since the opening 82a of the case body 82 is disposed higher than the liquid level of the liquid in the water tank 8, even when the photographing apparatus 4 is disposed below the surface of the water, the remote operation can be satisfactorily performed without blocking radio waves. It can be carried out.

  Furthermore, in each said embodiment, after acquiring the authority which performs remote control with respect to the imaging device 4 installed in the case body 82 in the water tank 8 through the control terminal 1 outside the water tank 8, remote operation is performed. Therefore, it is possible to prevent remote operation by an irrelevant device and enhance security. And especially according to 1st Embodiment, since the picked-up image image | photographed with the imaging device 4 by remote operation is output on a paper with the printing apparatus 9 installed in the aquarium hall, for an operator, it is an aquarium. As a memorial to visit, you can browse the captured images on the spot.

  On the other hand, in the second embodiment, a photographed image that is remotely operated and photographed by the photographing device 4 is stored in the external management server 2, and a URL indicating an access destination of image data of the photographed image is displayed to the operator. Since the paper on which the information is printed is handed over, the operator can view the photographed image as a memorial to the aquarium on another communication terminal or open it to a specific user. Here, the photographed image is uploaded to an external Web server. However, the present invention is not limited to this. For example, the captured image is transferred to a storage device installed on the communication network 5 and held by the operator. And may be configured to accumulate.

  In the first embodiment described above, a print image is printed and distributed on paper or the like. In the second embodiment, code information to be accessed is distributed to an operation by uploading to an external Web server. The first embodiment and the second embodiment described above may be combined, and the printing apparatus 9 may be configured to simultaneously distribute the paper on which the print image is printed and the paper on which the code information is printed.

  In the above-described embodiment, the configuration in which the through image is displayed on the control terminal 1 in real time has been described. However, the configuration in which the through image is not displayed may be used. In this case, since the through image is not displayed on the display unit 13a, it is possible to prevent the operator from facing too much toward the display unit 13a of the control terminal 1, and as a result, an appropriate captured image in which the operator is directed toward the photographing device 4 side. Can be taken immediately.

[Example of change]
The description of each embodiment described above is an example of the present invention. For this reason, the present invention is not limited to the above-described embodiment, and various modifications can be made according to the design and the like as long as they do not depart from the technical idea of the present invention. FIGS. 12A and 12B are explanatory views showing the operation of the installation angle of the case body, and FIGS. 13A and 13B are perspective views showing the configuration of the water tank according to the modified example. In the present modification, the same components as those in the above-described embodiments are denoted by the same reference numerals, the functions thereof are the same unless otherwise specified, and the description thereof is omitted.

(Modification 1)
In the above-described embodiment, the case where the jellyfish 10 is housed and reared in the aquarium body 81 has been described as an example, but can be applied to other seafood. Here, in the above-described embodiment, since the jellyfish 10 that requires a water flow and is easily caught by the members installed inside is bred, the water flow is generated in the aquarium body 81 and is cylindrical and has a lower portion. The case body 82 having a hemispherical shape is placed at the end of the aquarium body 81. However, when raising other seafood, the case body 82 may be placed in the center of the aquarium body 81. Various shapes such as a rectangular parallelepiped may be used as the shape of the case body 82.

  For example, when the case body 82 is attached to the central portion of the water tank main body 81, the case body 82 is one of the fixing members 83 and 84 positioned at the upper part of the water tank main body 81 as shown in FIGS. It is fixed to the water tank main body 81 through this. The fixing members 83 and 84 are formed of acrylic resin, plastic, glass, or the like, and a part or all of them are transparent members. In the present embodiment, the fixing member 83 has a substantially cross shape in which plate-like members having the same length as the diameter of the water tank body 81 are orthogonal to each other, as shown in FIG. Thus, by making the fixing member 83 substantially cross-shaped, it is possible to load the water tank main body 81 at four points, and a portion that does not overlap the water tank main body 81 in the top view is formed to ensure air permeability. Yes.

  The fixing member 83 is a substantially central portion where two plate members intersect, and has a through hole 83 a that penetrates the fixing member 83 at a position corresponding to the case body 82. The through hole 83 a of the fixing member 83 has a shape that matches the outer periphery of the case body 82, and the case body 82 is inserted into the through hole 83 a in a state where the fixing member 83 is disposed on the upper part of the water tank body 81. The case body 82 is positioned with respect to the water tank main body 81.

  On the other hand, as shown in FIG. 12B, the fixing member 84 has a disk shape having the same length as the outer circumference of the water tank body 81, and a plurality of air holes 84b penetrating the fixing member 84 are formed. Ensures breathability. The fixing member 84 has a through hole 84 a that penetrates the fixing member 84 at a position corresponding to the case body 82.

  The through hole 84a of the fixing member 84 also has a shape that matches the outer periphery of the case body 82, and the case body 82 is inserted into the through hole 84a in a state where the fixing member 84 is disposed on the upper part of the water tank body 81. The case body 82 is positioned with respect to the water tank main body 81. The fixing members 83 and 84 are in contact with the outer edge of the water tank body 81. For example, a screw or the like is driven into the contact portion, or a weight or the like is disposed from the upper part of the fixing members 83 and 84. Thus, the fixing members 83 and 84 and the water tank body 81 are fixed. With such a configuration, the imaging device 4 installed inside the case body 82 is fixed to the water tank body 81 via the case body 82 and the fixing members 83 and 84. According to such a modified example, the case body 82 can be disposed in the central portion of the water tank main body 81, so that the degree of freedom such as the shooting direction and the shooting range can be increased.

(Modification 2)
Further, in the above-described embodiment, the case body 82 is configured to be fixed to the fixing member 85 via the jig 86 whose inclination angle is fixed, but the present invention is not limited to this, The position and angle of the case body 82 may be adjustable with respect to the water tank 8. In this case, as shown in FIGS. 13A and 13B, the jig 86a further connects the fixing member gripping portion 861 and the case body holding portion 862, and makes the case body holding portion 862 horizontal and vertical. A rotating portion 863 that rotates in the direction is formed.

  As the rotating portion 863, a pan head or the like that can arbitrarily adjust the angle of the predetermined member is used. The configuration of the rotating portion 863 is not limited. For example, a base body fixed to the fixing member gripping portion 861, a spherical ball portion that is rotatably held by the base body, and the ball portion And a support body to which the case body holding portion 862 is attached, and a locking portion for fitting the ball portion to the base body. The case body 82 held by the case body holding portion 862 can be tilted at an arbitrary angle with respect to the fixing member 85 by rotating the ball portion within the base body. Then, as shown in FIG.13 (b), it sets so that the bottom part of the case body 82 may incline toward the side surface side of the water tank main body 81. FIG. As described above, by allowing the case body 82 to be driven in the vertical direction and the horizontal direction, the angle and position of the photographing apparatus 4 can be easily changed.

(Modification 3)
Furthermore, in the above-described embodiment, the driving device 7 and the photographing device 4 are fixed at a previously fixed position and angle, and are configured to photograph the photographer in a state in which the zoom ratio of the optical zoom is determined. The present invention is not limited to this. For example, the position of the pedestal 72 of the driving device 7, the direction of the photographing device 4 and various settings can be changed by remote control from the control terminal 1 and the administrator terminal 6. Also good. Hereinafter, a case where the position of the pedestal 72 of the driving device 7 and the lens direction of the photographing device 4 are remotely controlled will be described as an example.

  First, in this modified example, as shown in FIG. 3A, the drive device 7 includes an apparatus main body 71, a holding unit 72, and a connecting unit 73, as in the above-described embodiment, and the holding unit 72 includes the photographing device 4. Is installed, and the apparatus main body 71 is inserted through the slide hole 72 a of the pedestal 72. In the apparatus main body 71, a drive mechanism is provided for driving in response to a remote operation signal from the control terminal 1 and the administrator terminal 6. For example, the apparatus main body 71 is provided with an apparatus position driving mechanism that is slidably driven on the pedestal 72, and the longitudinal direction of the slide hole 72 a according to a remote operation signal from the control terminal 1 and the administrator terminal 6. It can slide along (L1 in FIG. 3A).

  Further, the apparatus main body 71 includes a holding unit driving mechanism that drives the connecting unit 73 in the horizontal direction and the vertical direction, and the holding unit driving mechanism moves the holding unit 74 in the horizontal direction (FIG. 3) in response to a remote operation signal. It is possible to rotate 360 degrees in (L2) in (a), and also rotate or lift in the vertical direction (L3 in FIG. 3 (a)). In this way, by driving each drive mechanism of the apparatus main body 71, the photographing apparatus 4 installed on the holding portion 74 can be rotated in the horizontal direction or the vertical direction.

  Next, the internal configuration of the drive device 7 will be described. FIG. 14 is a block diagram illustrating an internal configuration of a driving apparatus according to a modification. The drive device 7 includes a communication interface 76, a drive control unit 77, a memory 78, and a drive mechanism unit 79.

  The communication interface 76 is a module that transmits and receives data as packets through the communication network 5. In this embodiment, the communication interface 76 includes an adapter that performs wireless communication using a data communication protocol such as Wi-Fi (registered trademark). In the ad hoc method, the control signal is obtained by directly communicating with the control terminal 1 or the administrator terminal 6 without using an access point. The communication interface 76 is connected to the imaging device 4 by wired communication or wireless communication, and acquires a control signal from the imaging device 4. The memory 78 is a storage device that stores various data related to drive control, and includes data for driving the device position drive mechanism 79a and the holding unit drive mechanism 79b in accordance with a control signal.

  The drive mechanism unit 79 is a device that drives the drive device 7. In the present embodiment, the drive mechanism unit 79 includes the device position drive mechanism 79a and the holding unit drive mechanism 79b described above. Then, the device position driving mechanism 79a and the holding portion driving mechanism 79b move the device main body 71 to a predetermined position on the slide hole 72a according to a control signal from the drive control portion 77, or move the holding portion 74 horizontally. It is driven in the direction and the vertical direction.

  The drive control unit 77 is configured by a processor such as a CPU or DSP (Digital Signal Processor), memory, hardware such as other electronic circuits, software such as a program having the function, or a combination thereof. It is an arithmetic module, and various function modules are virtually constructed by appropriately reading and executing a program. By the constructed function modules, processing related to image capturing, operation control of each unit, and various processes for user operations I do. In particular, in this modified example, when control signals from the control terminal 1, the administrator terminal 6, and the photographing device 4 are acquired, the device position driving mechanism 79a and the holding unit driving mechanism 79b are moved to a predetermined position and a predetermined position according to the control signals. It is driven at an angle.

  Specifically, the remote management unit 14a of the control terminal 1 or the remote management unit 64a of the administrator terminal 6 has a function of accepting user operations other than the shutter button, and the display unit 13a and the display unit 63a have shutters. In addition to the icons, operation icons for receiving various setting operations such as the shooting angle (direction), the position of the driving device 7, the aperture, the focus, the shutter speed, and the strobe are displayed. Then, the control execution unit 14d and the remote management unit 64a accept various setting operations such as an aperture, focus, shutter speed, and presence / absence of a strobe in addition to the shutter operation, and thereby send a remote operation signal corresponding to the operation to the imaging device 4. Send to. In addition, the control execution unit 14d and the remote management unit 64a receive an operation signal indicating the position of the drive device 7 or the shooting angle of the camera, and distribute the operation signal corresponding to the operation to the drive device 7.

  On the other hand, the image processing unit 42a of the image capturing device 4 has a function of capturing a panoramic image. The drive device 7 is controlled by the drive control unit 42b, and the connecting unit 73 is rotated 360 ° in the horizontal direction to rotate. During this time, a shooting process is performed in a moving image format, and a panoramic image is generated by combining the images.

  Further, the face recognition processing function is executed in the image processing unit 42a, and the operator's face is recognized within the frame by recognizing the operator's face in the image data acquired from the optical mechanism unit 44 and the image sensor 43. It is also possible to change the angle by driving the driving device 7 by the drive control unit 42b so as to be included in the predetermined position and rotating the photographing device 4 in the horizontal direction or the vertical direction.

  Here, the drive control unit 77 is included in the drive device 7, but the present invention is not limited to this. For example, the function of the drive control unit 77 is the drive control unit 42b of the photographing apparatus 4. The drive device 7 may be driven by the drive control unit 42b according to the control signal as described above.

  Next, a distortion elimination method when various settings of the photographing device 4 and the driving device 7 are remotely controlled will be described. In the present modification example, various settings of the photographing device 4 and the driving device 7 can be freely set, so it is necessary to eliminate distortion according to the settings. Therefore, in this modification, for example, a regular pattern may be applied to the wall 110 portion that is the background of the photographer to be photographed, and distortion may be corrected or the distortion portion may be trimmed based on the pattern. . For example, as shown in FIG. 15A, a square figure 111 having the same width d1 is arranged on the wall 110 in advance. When the photographing apparatus 4 photographs the outside from the inside of the case body 82 with such a wall 110 applied, an image as shown in FIG. 15B is obtained. In FIG. 15B, since the distortion is not generated in the central area 102, the figure 111a having the width d1 is displayed. However, since the distortion is generated in the both end areas 101 and 101, the width is wider than the width d1. A graphic 111b having d2 and d3 is displayed.

  When such a captured image is input to the administrator terminal 6, the processing unit 64b compares the width d1 of the graphic 111 located at the center of the screen with the widths d2 and d3 of the graphic 112 at both ends. A distortion region is specified according to the comparison result, and the distortion region is cut out by the trimming method, or distortion correction is performed so that the width of the distortion region is returned to d1. Specifically, when the distortion portion is cut out by the trimming method, an area having widths d2 and d3 wider than the width d1 is specified as the distortion area, and the area portion is cut out. On the other hand, when performing distortion correction, the ratio between the width d1 of the graphic 111 located at the center of the screen and the widths d2 and d3 of the graphic 111b at both ends is calculated, and both ends are calculated based on the calculated ratio. The images in the areas 101 and 101 are corrected.

  In this distortion correction processing, in order to further improve the correction accuracy, for example, as shown in FIGS. 16A and 16B, image correction is performed at a predetermined position in a range captured in an image captured by the camera. It is preferable to display the markings 110a and 81a. Specifically, the marking 110 a is drawn on the surface of the wall 110 located behind the user U, and the marking 81 a is drawn on the inner wall surface of the water tank 81. The markings 110a and 81a are rectangular marks, and their shapes are known on the image processing side.

  For this reason, the deformation of the markings 110a and 81a reflected in the image photographed by the camera 4 is measured, and an image deformation process is performed to restore the shape to a known shape, thereby further distorting the subject reflected in the surroundings. It can be corrected appropriately. In particular, in the example shown in FIG. 16, since markings are drawn on the back of the user U and on the inner wall surface 81a of the water tank 81, the marking 110a outside the water tank 81 and the marking 81a inside the water tank 81 are deformed. By calculating the difference in rate, the difference in refractive index between the inside and outside of the water tank 81 can be estimated, and the subject inside the water tank 81 and the subject outside the water tank 81 can each be corrected with an appropriate deformation rate. .

  Thus, in this modified example, even if the photographer changes the camera angle or zoom ratio, a regular pattern on a wall or the like is detected, and a distorted portion can be recognized from the pattern. Therefore, an appropriate image can be obtained.

  Furthermore, as another distortion elimination process, correction information corresponding to each setting condition of the imaging device 4 and the driving device 7 may be stored in the memory 65 in advance, and the distortion may be eliminated according to the set condition. The correction information is calculated based on setting information including the position of the driving device 7, the horizontal and vertical angles of the photographing device 4, and the optical zoom magnification. When performing the trimming method, the correction information is corrected. As the information, coordinate position information indicating a distortion portion calculated based on the setting information is used. On the other hand, when the distortion correction method is used, the distortion correction value at each coordinate position calculated based on the setting information is used as the correction information. Then, the processing unit 64b reads out each correction information from the memory 65 based on the setting information, and cuts off both end regions 101 and 101 and corrects distortion.

  Since various settings of the photographing device 4 and the driving device 7 can be set by the photographer, for example, the same magnification set by the optical zoom method is used as the initial setting screen, and the setting can be changed thereafter. May be. In this case, since the photographer can omit the process of setting all the settings by himself, the photographer can easily obtain a photographed image photographed through the fish swimming in the aquarium.

  Various settings by the control terminal 1 are performed after the through image of the above-described embodiment is displayed (S109) and before the shutter operation is received ("Y" in S110), and when the setting operation is received. The control signal is transmitted to the photographing device 4 or the driving device 7 and is subjected to a driving process in the control unit 42 of the photographing device 4 or the driving control unit 77 of the driving device 7. After the photographing device 4 or the driving device 7 is driven, an image photographed after driving is input again to the control terminal 1 as a through image, and this process is repeated until a shutter operation is accepted (“Y” in S110). Is called.

  According to this modified example, the position of the driving device 7 and the horizontal and vertical directions of the photographing device 4 can be changed, so that a photographed image at an angle intended by the photographer can be provided. It is possible to add value to services using this system. And in this example of a change, even if it is a case where the position of the drive device 7, and the horizontal direction and the vertical direction of the imaging device 4 can be changed, a distortion part can be eliminated based on setting information, and it is favorable. Only captured images can be provided.

(4) Modification 4
In the above-described embodiment, a standard lens is used as the lens of the photographing device 4. For example, as shown in FIGS. 17A and 17B, two fish-eye lenses 44 a, 44b can be used to take an omnidirectional image in which the luminance of light rays coming from one azimuth at 360 ° in the horizontal and vertical directions is recorded.

  Specifically, as shown in FIGS. 17A and 17B, the photographing device 40 is installed on a pedestal 72, and the housing of the photographing device 40 is paired with a front surface 40a and a side surface 40b facing each other. Fisheye lenses 44a and 44b are provided. Since the photographing device 40 can photograph all directions, the driving device 7 is omitted and is fixed on the pedestal 72. The pair of fish-eye lenses 44a and 44b of the photographing device 40 are wide-angle lenses each having an angle of view of 180 ° or more, and include photographing elements provided corresponding to the wide-angle lenses. Light entering from the fisheye lenses 44 a and 44 b is input to the image processing unit 42 a via the image sensor 43.

  In the image processing unit 42a, each image is obtained by imaging the light incident from each fisheye lens 44a, and the two images are combined to generate one omnidirectional image. Specifically, when the image is taken using the fisheye lens 44a, a hemispherical image 121 is acquired as shown in FIG. 18A, and when the image is taken using the fisheye lens 44b, as shown in FIG. 18B. A hemispherical image 122 is acquired. The hemispherical image is generated at a distance (image height) on a plane corresponding to the incident angle of the lens, and the relationship between the incident angle and the image height is determined by a projection function. The projection function differs depending on the nature of the fisheye lens.

  Then, these images are converted into a planar image by, for example, Mercator projection, and after distortion correction, a synthesis process for joining the images is performed, and a single panorama as shown in FIG. An image is generated. Here, the planar image 123 converted by the Mercator projection or the like is a drawing in which the spherical images shown in FIGS. 18A and 18B are developed on a plane. FIG. 18C illustrates a state in which an image 121 photographed using the fisheye lens 44 a is arranged at the center, and an image 122 photographed using the fisheye lens 44 b is connected to both ends of the image 121. . In this modified example, the image is converted into a planar image using the Mercator projection. However, the present invention is not limited to this. For example, the stereoscopic projection method, the equidistant projection method, the equal stereoscopic projection method, and the orthographic projection are used. Various projective transformation methods such as a method can be used.

  In this modified example, the fisheye lenses 44a and 44b are wide-angle lenses having an angle of view of 180 ° or more, and therefore, the edge portions of the hemispherical image are regions 124 and 124 that overlap with the hemispherical image acquired by the other fisheye lens. It has become. Thus, by making the edge part of two hemispherical images overlap, the image processing unit 42a generates a panoramic image without deviation by connecting the overlapped parts.

  Then, the image processing unit 42a creates an omnidirectional image from the synthesized panoramic image. As this processing, for example, using a 3D graphic application such as OpenGL ES (Open Graphics Library for Embedded Systems), a process of pasting a synthesized panoramic image on the surface of a virtual solid sphere is performed. Create an omnidirectional image.

  And in the control terminal 1, while displaying this omnidirectional image as an image at the time of seeing from the center of a sphere, it can accept user operation. When processing such as panning, tilting, and zooming is received from the user, the application execution unit 14 displays an omnidirectional image that can be rotated 360 ° in the horizontal direction and 180 ° in the vertical direction, and a partially enlarged image on the screen. Display above. Here, the omnidirectional screen is generated by the image processing unit 42a of the photographing device 4, but may be performed by, for example, the processing unit 64b of the administrator terminal 6 or by the application execution unit 14 of the control terminal 1. You may go.

  According to this modified example, since an image obtained by photographing all external directions from the inside of the aquarium can be provided to the user, a more realistic image can be provided to the user.

DESCRIPTION OF SYMBOLS 1 ... Control terminal 2 ... Management server 3 ... Wireless base station 4 ... Imaging device 4a ... Lens 5 ... Communication network 6 ... Administrator terminal 7 ... Drive device 8 ... Water tank 9 ... Printing device 10 (10a, 10b, 10c) ... Jellyfish DESCRIPTION OF SYMBOLS 11 ... Communication interface 12 ... Input interface 13 ... Output interface 13a ... Display part 14 ... Application execution part 14a ... Remote management part 14b ... Image transfer part 14c ... Authority acquisition part 14d ... Control execution part 15 ... Memory 21 ... Communication interface 22 ... Control unit 40: photographing apparatus 40a ... front surface 40b ... side surface 41 ... communication interface 42 ... control unit 42a ... image processing unit 42b ... drive control unit 43 ... image sensor 44 ... optical mechanism unit 44a, 44b ... fisheye lens 45 ... memory 51-53 ... Wireless communication network 61 ... Communication Interface 62 ... Input interface 63 ... Output interface 63a ... Display unit 64 ... Application execution unit 64a ... Remote management unit 64b ... Processing unit 65 ... Memory 71 ... Device main body 72 ... Holding unit 72 ... Base 72a ... Slide hole 72b ... Air Hole 73 ... Connecting portion 74 ... Holding portion 75 ... Screw 76 ... Communication interface 77 ... Drive control portion 79 ... Drive mechanism portion 79a ... Device position drive mechanism 79b ... Holding portion drive mechanism 81 ... Water tank body 82 ... Case body 82a ... Opening 82b ... inner surface 83, 84, 85 ... fixing member 83a, 84a ... through hole 84b ... air hole 85a ... opening 86, 86a ... jig 100 ... photographed image 101 ... both end region 102 ... central region 110 ... wall 121, 122 ... hemisphere Image 123 ... Planar image 124 ... Superimposed area 221 ... Authentication unit 222 Member registrar 223 ... URL generation unit 224 ... display the information distribution unit 225 ... captured image acquisition unit 231 ... display information storage unit 232 ... terminal information database 861 ... fixing member gripping portion 862 ... casing body holding portion 863 ... rotating portion

Claims (6)

A photographing system for photographing with a photographing device installed in a water tank,
A case body that is installed in the water tank and is partially or entirely transparent in which the photographing device is disposed;
A control terminal having a function of remotely controlling a photographing operation of the photographing device, wherein the photographing device is connected through a communication network;
A management unit that is connected to the imaging device and the control terminal through a communication network and manages remote control of the imaging device by the control terminal;
The photographing system is installed so as to be able to photograph the liquid in the water tank and the outside of the water tank through the transparent portion of the case body. The communication network between the imaging device and the control terminal is wireless communication,
The case body has an opening at the top,
The imaging system according to claim 1, wherein the opening is disposed at a position higher than a water level of the liquid in the water tank. The management unit
The imaging system according to claim 1, further comprising: an image transfer unit that acquires image data captured by the imaging apparatus and transfers the acquired image data to an external device. A water tank used in the photographing system according to any one of claims 1 to 3,
A water tank body in which liquid is stored;
A case body that is installed in the water tank main body and is partially or entirely transparent in which the photographing device is disposed,
With
The photographing device is installed through the transparent portion of the case body so as to photograph the liquid in the water tank body and the outside of the water tank body,
The case body has an opening at the top,
The water tank is characterized in that the opening is arranged at a position higher than the water level of the liquid in the water tank. A photographing method using the photographing system according to any one of claims 1 to 3,
A communication connection process for connecting the imaging device and the control terminal through a communication network;
A photographing operation process for remotely controlling a photographing operation of the photographing device by the control terminal;
An image data acquisition method comprising: acquiring image data captured by the image capturing device using the management unit. A control terminal used in the photographing system according to claim 1,
A communication interface for accessing the imaging device through the communication network;
An authority acquisition unit for acquiring authority to perform the remote control on the imaging device;
A control terminal comprising: a control execution unit that executes the remote control based on the authority acquired by the authority acquisition unit.