JP2018026642A - Image management system, image communication system, image management method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display and enable a user to view two-dimensional prescribed region image, i.e. part of an entire-celestial-sphere panoramic image, without installing an entire-celestial-sphere panoramic image viewer on a communication terminal of the user.SOLUTION: An image management system 5 does not store a prescribed region image, but stores prescribed region information. Upon receiving a transmission request for the prescribed region image from a communication terminal 7 (S41), the image management system creates a two-dimensional prescribed region image (S48) and transmits it to the communication terminal 7 (S49).SELECTED DRAWING: Figure 18

Description

  The present invention relates to an image management system, an image communication system, an image management method, and a program.

  In recent years, a special digital camera that obtains a 360 ° panoramic image at one time is provided. However, this special digital camera obtains an omnidirectional panoramic image, but the image is curved and displayed as it is, so that it is difficult for the user to view it. Therefore, a user installs software (viewer) for viewing a three-dimensional omnidirectional panoramic image on a communication terminal such as a smartphone or a PC, and uses this viewer to make a part of the omnidirectional panoramic image. In this case, a predetermined area image in a predetermined area that enters the field of view from a predetermined viewpoint is displayed. Thereby, the user can browse the two-dimensional predetermined area image as if he / she browsed a planar image close to an image photographed by a conventional digital camera.

  When the user wants to share the predetermined area image with other users, the user uploads the omnidirectional panoramic image and predetermined area information (parameter) indicating the predetermined area image to the server. Then, another user downloads the omnidirectional panoramic image and the predetermined area information from the server to his / her communication terminal, and browses the two-dimensional predetermined area image using the viewer (see Patent Document 1).

  However, since a viewer for partial display such as an omnidirectional panoramic image is not necessarily installed in the communication terminal of another user, a two-dimensional predetermined area image close to a planar image cannot be viewed. There may be cases. Also, on the server side where an image such as a panoramic image is uploaded, a predetermined area image is created and managed from the entire image, and other users are requested in response to requests from other users. When the predetermined area image is transmitted to the communication terminal, the server side requires a large number of storage areas to manage the predetermined area image data as the number of the predetermined area images increases.

  The invention according to claim 1 is an image management system for managing image data, wherein the storage means for storing the image data and the predetermined area information for indicating the predetermined area in the image related to the image data are managed. Area information management means, receiving means for receiving a request for a predetermined area image, which is an image of the predetermined area, from the predetermined communication terminal; and in response to the reception of the request, the predetermined area in the image data An image management system comprising: a predetermined area image creating unit that creates a predetermined area image of a predetermined area indicated by information; and a transmission unit that transmits the created predetermined area image to the predetermined communication terminal.

  As described above, according to the present invention, a predetermined area image is viewed on a communication terminal in which a viewer for displaying a part of an image is not installed while suppressing the use of a storage area of an image management system as a server. be able to.

(A) is a left side view of the photographing apparatus, (b) is a front view of the photographing apparatus, and (c) is a plan view of the photographing apparatus. It is a usage image figure of an imaging device. (A) is the hemispherical image (front) image | photographed with the imaging device, (b) is the hemispherical image (back) image | photographed with the imaging device, (c) is the figure which showed the image represented by the Mercator projection. (A) The conceptual diagram which showed the state which covers a sphere with a Mercator image, (b) The figure which showed the omnidirectional panoramic image. It is the figure which showed the position of the virtual camera and predetermined | prescribed area | region at the time of making an omnidirectional panoramic image into a three-dimensional solid sphere. (A) is the three-dimensional perspective view of FIG. 5, (b) is a figure which shows the state in which the image of the predetermined area | region is displayed on the display of the communication terminal. FIG. 6 is a diagram illustrating a relationship between predetermined area information and an image of a predetermined area T. 1 is a schematic diagram of an image communication system according to an embodiment of the present invention. It is a hardware block diagram of an imaging device. 2 is a hardware configuration diagram of a communication terminal 3. FIG. 2 is a hardware configuration diagram of an image management system 5 and a communication terminal 7. FIG. It is a functional block diagram of an image communication system. It is a conceptual diagram which shows a picked-up image management table. It is a conceptual diagram which shows a predetermined area image management table. It is a conceptual diagram which shows a thumbnail management table. FIG. 6 is a sequence diagram illustrating processing for uploading captured image data and predetermined area information. (A), (b) is a figure which shows the communication terminal by which the predetermined area image was displayed on the display. FIG. 6 is a sequence diagram illustrating a process of downloading predetermined area image data. (A) is a display example of thumbnails on the communication terminal 7, and (b) is a diagram showing a display example of a predetermined area image on the communication terminal 7.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<< Summary of Embodiment >>
<Generation method of panoramic image>
A method for generating an omnidirectional panoramic image will be described with reference to FIGS.

  First, the external appearance of the photographing apparatus 1 will be described with reference to FIG. The photographing apparatus 1 is a digital camera for obtaining a photographed image that is the basis of a panoramic image of a celestial sphere (360 °). 1A is a left side view of the photographing apparatus, FIG. 1B is a front view of the photographing apparatus, and FIG. 1C is a plan view of the photographing apparatus.

  As shown in FIG. 1A, the photographing apparatus 1 has a size that a human can hold with one hand. Further, as shown in FIGS. 1A, 1B, and 1C, the imaging device 103a and the back side (rear side) are arranged on the front side (front side) on the upper part of the photographing apparatus 1. ) Is provided with an image sensor 103b. These image sensors (image sensors) 103a and 103b are used in combination with an optical member (for example, fish-eye lenses 102a and 102b described later) that can capture hemispherical images (angle of view of 180 ° or more). Further, as shown in FIG. 1B, an operation unit 115 such as a shutter button is provided on the surface opposite to the front side of the photographing apparatus 1.

  Next, the usage situation of the imaging device 1 will be described with reference to FIG. FIG. 2 is a usage image diagram of the photographing apparatus. As shown in FIG. 2, the photographing apparatus 1 is used, for example, for photographing a subject around the user by holding it in his hand. In this case, two hemispherical images can be obtained by imaging the subject around the user by the imaging device 103a and the imaging device 103b shown in FIG.

  Next, an outline of processing until an omnidirectional panoramic image is created from an image photographed by the photographing apparatus 1 will be described with reference to FIGS. 3 and 4. 3A is a hemispheric image (front side) photographed by the photographing apparatus, FIG. 3B is a hemispheric image photographed by the photographing apparatus (rear side), and FIG. 3C is represented by Mercator projection. FIG. 6 is a diagram showing an image (hereinafter referred to as “Mercatl image”). FIG. 4A is a conceptual diagram showing a state in which a sphere is covered with a Mercator image, and FIG. 4B is a diagram showing an omnidirectional panoramic image.

  As shown in FIG. 3A, the image obtained by the image sensor 103a is a hemispherical image (front side) curved by a fish-eye lens 102a described later. Also, as shown in FIG. 3B, the image obtained by the image sensor 103b is a hemispherical image (rear side) curved by a fish-eye lens 102b described later. Then, the hemispherical image (front side) and the hemispherical image inverted by 180 degrees (rear side) are combined by the photographing apparatus 1 to create a Mercator image as shown in FIG.

  By using OpenGL ES (Open Graphics Library for Embedded Systems), as shown in FIG. 4A, the Mercator image is pasted so as to cover the spherical surface, and FIG. An omnidirectional panoramic image as shown is created. Thus, the omnidirectional panoramic image is represented as an image in which the Mercator image faces the center of the sphere. OpenGL ES is a graphics library used for visualizing 2D (2-Dimensions) and 3D (3-Dimensions) data. Note that the omnidirectional panoramic image may be a still image or a moving image.

  As described above, since the omnidirectional panoramic image is an image pasted so as to cover the spherical surface, it is uncomfortable when viewed by a human. Therefore, by displaying a predetermined area (hereinafter referred to as “predetermined area image”) of a part of the omnidirectional panoramic image as a flat image with little curvature, a display that does not give a sense of incongruity to humans can be achieved. This will be described with reference to FIGS.

  FIG. 5 is a diagram illustrating the positions of the virtual camera and the predetermined area when the panoramic image is a three-dimensional solid sphere. The virtual camera IC corresponds to the position of the viewpoint of the user who views the omnidirectional panoramic image displayed as a three-dimensional solid sphere. FIG. 6A is a three-dimensional perspective view of FIG. 5, and FIG. 6B is a diagram showing a predetermined area image when displayed on the display. In FIG. 6A, the omnidirectional panoramic image shown in FIG. 4 is represented by a three-dimensional solid sphere CS. If the omnidirectional panoramic image generated in this way is a solid sphere CS, the virtual camera IC is located outside the omnidirectional panoramic image as shown in FIG. The predetermined area T in the omnidirectional panoramic image is specified by predetermined area information of the position of the virtual camera IC in the omnidirectional panoramic image. This predetermined area information is indicated by coordinates (x (rH), y (rV), and angle of view α (angle)) or coordinates (X, Y, Z) in a three-dimensional virtual space. The zoom of the predetermined region T can be expressed by expanding or contracting the range (arc) of the angle of view α. The zoom of the predetermined area T can also be expressed by moving the virtual camera IC closer to or away from the panoramic image.

  Then, as shown in FIG. 6A, the image of the predetermined area T in the omnidirectional panoramic image is displayed on the predetermined display as the predetermined area image as shown in FIG. 6B. Is displayed. The image shown in FIG. 6B is an image represented by predetermined area information that is initially set (default). Here, description will be made using coordinates (x (rH), y (rV), and angle of view α (angle)).

  Next, the relationship between the predetermined area information and the image of the predetermined area T will be described with reference to FIG. FIG. 7 is a diagram showing the relationship between the predetermined region information and the relationship between the images of the predetermined region T. As shown in FIG. 7, the center point CP when the diagonal field angle of the predetermined area T represented by the field angle α of the virtual camera IC is 2L is the (x, y) parameter of the predetermined area information. Become. f is the distance from the virtual camera IC to the center point CP. In FIG. 7, a trigonometric function represented by the following formula (1) is generally established.

Lf = tan (α / 2) (Formula 1)
<Outline of image communication system>
Next, an outline of the configuration of the image communication system according to the present embodiment will be described with reference to FIG. FIG. 8 is a schematic diagram of the configuration of the image communication system of the present embodiment.

  As shown in FIG. 8, the image communication system according to the present embodiment includes an imaging device 1, a communication terminal 3, an image management system 5, and a communication terminal 7.

Among these, the imaging device 1 is a digital camera for obtaining an omnidirectional panoramic image as described above. Note that the photographing apparatus 1 may be a general digital camera, and when the communication terminal 3 has a camera, the communication terminal 3 can be a digital camera. Note that the photographing apparatus 1 and the communication terminal 3 may be integrated and configured as a single terminal.
In the present embodiment, in order to make the description easy to understand, the imaging device 1 will be described as a digital camera for obtaining an omnidirectional panoramic image. The communication terminal 3 is, for example, a mobile terminal such as a mobile phone or a smartphone, and performs data communication with the photographing apparatus 1 using a wireless communication technology such as WiFi. Further, the communication terminal 3 can perform data communication with the image management system 5 via the communication network 9. The communication network 9 may be either wireless or wired as a connection form, for example, the Internet.

  The image management system 5 is a server computer, for example, and can perform data communication with the communication terminals 3 and 7 via the communication network 9. OpenGL ES is installed in the image management system 5 and creates a panoramic image. Further, the image management system 5 creates predetermined area information indicating a partial area of the omnidirectional panoramic image (or a predetermined area image that is an image indicated by the predetermined area information), and transmits the captured image data to the communication terminal 7. In addition, the image management system 5 may be constructed by a single computer, or arbitrarily divides each unit (function, means, or storage unit). It may be constructed by a plurality of assigned computers.

  The communication terminal 7 is, for example, a notebook PC (Personal Computer), and can perform data communication with the image management system 5 via the communication network 9. The image management system 5 may be configured by a single server computer or may be configured by a plurality of server computers.

  Further, the photographing device 1 and the communication terminal 3 are used by the photographer X. The communication terminal 7 is used by the viewer Y. The image management system 5 is installed in a service company that provides a service for providing the communication terminal 7 with captured image data sent from the communication terminal 3 at each site.

<Hardware Configuration of Embodiment>
Next, the hardware configuration of the imaging device 1, the communication terminals 3 and 7, and the image management system 5 according to the present embodiment will be described in detail with reference to FIGS.

  First, the hardware configuration of the photographing apparatus 1 will be described with reference to FIG. FIG. 9 is a hardware configuration diagram of the photographing apparatus. In the following, the photographing apparatus 1 is an omnidirectional (omnidirectional) photographing apparatus using two imaging elements, but the number of imaging elements may be two or more. In addition, it is not always necessary to use an apparatus dedicated to omnidirectional imaging. By attaching a retrofit omnidirectional imaging unit to a normal digital camera, smartphone, or the like, the apparatus may have substantially the same function as the imaging apparatus 1. .

  As shown in FIG. 9, the imaging apparatus 1 includes an imaging unit 101, an image processing unit 104, an imaging control unit 105, a microphone 108, a sound processing unit 109, a CPU (Central Processing Unit) 111, a ROM (Read Only Memory). ) 112, SRAM (Static Random Access Memory) 113, DRAM (Dynamic Random Access Memory) 114, operation unit 115, network I / F 116, communication unit 117, and antenna 117a.

  Among these, the imaging unit 101 includes wide-angle lenses (so-called fish-eye lenses) 102a and 102b each having an angle of view of 180 ° or more for forming a hemispherical image, and two imaging units provided corresponding to the wide-angle lenses. Elements 103a and 103b are provided. The image sensors 103a and 103b are image sensors such as a CMOS (Complementary Metal Oxide Semiconductor) sensor and a CCD (Charge Coupled Device) sensor that convert an optical image obtained by the fisheye lenses 102a and 102b into image data of an electric signal and output the image data. A timing generation circuit for generating a horizontal or vertical synchronization signal, a pixel clock, and the like, and a register group in which various commands and parameters necessary for the operation of the image sensor are set.

  The imaging elements 103a and 103b of the imaging unit 101 are each connected to the image processing unit 104 via a parallel I / F bus. On the other hand, the imaging elements 103 a and 103 b of the imaging unit 101 are connected to a serial I / F bus (I2C bus or the like) separately from the imaging control unit 105. The image processing unit 104 and the imaging control unit 105 are connected to the CPU 111 via the bus 110. Further, ROM 112, SRAM 113, DRAM 114, operation unit 115, network I / F 116, communication unit 117, and electronic compass 118 are connected to the bus 110.

  The image processing unit 104 takes in the image data output from the image sensors 103a and 103b through the parallel I / F bus, performs predetermined processing on the respective image data, and then combines these image data. Then, data of a Mercator image as shown in FIG.

  In general, the imaging control unit 105 sets a command or the like in a register group of the imaging elements 103a and 103b using the I2C bus with the imaging control unit 105 as a master device and the imaging elements 103a and 103b as slave devices. Necessary commands and the like are received from the CPU 111. The imaging control unit 105 also uses the I2C bus to capture status data and the like of the register groups of the imaging elements 103a and 103b and send them to the CPU 111.

  The imaging control unit 105 instructs the imaging elements 103a and 103b to output image data at the timing when the shutter button of the operation unit 115 is pressed. Some photographing apparatuses 1 may have a preview display function by a display (for example, a display of the communication terminal 3) or a function corresponding to a moving image display. In this case, output of image data from the image sensors 103a and 103b is continuously performed at a predetermined frame rate (frame / min).

  Further, as will be described later, the imaging control unit 105 also functions as a synchronization control unit that synchronizes the output timing of image data of the imaging elements 103a and 103b in cooperation with the CPU 111. In the present embodiment, the photographing apparatus 1 is not provided with a display unit (display), but a display unit may be provided.

  The microphone 108 converts sound into sound (signal) data. The sound processing unit 109 takes in the sound data output from the microphone 108 through the I / F bus and performs predetermined processing on the sound data.

  The CPU 111 controls the overall operation of the photographing apparatus 1 and executes necessary processes. The ROM 112 stores various programs for the CPU 111. The SRAM 113 and the DRAM 114 are work memories, and store programs executed by the CPU 111, data being processed, and the like. In particular, the DRAM 114 stores image data being processed by the image processing unit 104 and processed Mercator image data.

  The operation unit 115 is a general term for various operation buttons, a power switch, a shutter button, a touch panel that has both display and operation functions, and the like. The user inputs various shooting modes and shooting conditions by operating the operation buttons.

  The network I / F 116 is a general term for an interface circuit (USB I / F or the like) with an external medium such as an SD card or a personal computer. The network I / F 116 may be wireless or wired. Mercator image data stored in the DRAM 114 is recorded on an external medium via the network I / F 116 or transmitted to an external device such as the communication terminal 3 via the network I / F 116 as necessary. To do.

  The communication unit 117 communicates with an external device such as the communication terminal 3 by a short-range wireless technology such as WiFi (Wireless Fidelity) or NFC via the antenna 117 a provided in the photographing apparatus 1. The communication unit 117 can also transmit Mercator image data to an external device of the communication terminal 3.

  The electronic compass 118 calculates the azimuth and tilt (Roll rotation angle) of the photographing apparatus 1 from the earth's magnetism, and outputs azimuth / tilt information. This azimuth / tilt information is an example of related information (metadata) along Exif, and is used for image processing such as image correction of a captured image. Note that the related information includes each data of the image capturing date and time and the data capacity of the image data.

  Next, the hardware configuration of the communication terminal 3 will be described with reference to FIG. FIG. 10 is a hardware configuration diagram of the communication terminal 3. As shown in FIG. 10, the communication terminal 3 includes a CPU 301 that controls the operation of the entire communication terminal 3, a ROM 302 that stores basic input / output programs, and a RAM (Random Access Memory) 303 that is used as a work area for the CPU 301. , An EEPROM (Electrically Erasable and Programmable ROM) 304 that reads or writes data according to the control of the CPU 301, a CMOS sensor 305 as an image sensor that captures an image of the subject and obtains image data according to the control of the CPU 301, and an electronic magnetic compass that detects geomagnetism , A gyro compass, various acceleration / direction sensors 306 such as an acceleration sensor, and a media drive 308 that controls reading or writing (storage) of data with respect to a recording medium 307 such as a flash memory. In accordance with the control of the media drive 308, the recording medium 307 from which data that has already been recorded is read or to which data is newly written and stored is detachable.

  The EEPROM 304 stores an operating system (OS) executed by the CPU 301, other programs, and various data. A CCD sensor may be used instead of the CMOS sensor 305.

  Further, the communication terminal 3 includes a voice input unit 311 that converts voice into a voice signal, a voice output unit 312 that converts voice signal into voice, an antenna 313a, and a wireless communication signal that uses the antenna 313a. Receives a GPS signal including position information (latitude, longitude, and altitude) of the communication terminal 3 by a communication unit 313 that communicates with a station or the like, a GPS (Global Positioning Systems) satellite, or an IMES (Indoor MEssaging System) as an indoor GPS. GPS receiver 314, a liquid crystal display or an organic EL display 315 for displaying an image of a subject, various icons, etc., which is mounted on this display 315, is constituted by a pressure-sensitive or electrostatic panel, and is formed by a finger or a touch pen A touch panel 316 for detecting a touch position on the display 315 by touch, and each of the above And it includes an address bus, a data bus, and the like of the bus line 310 for electrically connecting the.

  Note that the voice input unit 311 includes a microphone that inputs voice, and the voice output unit 312 includes a speaker that outputs voice.

  Next, the hardware configuration of the communication terminal 7 in the case of the image management system 5 and the notebook PC will be described with reference to FIG. FIG. 11 is a hardware configuration diagram of the image management system 5 and the communication terminal 7. Since the image management system 5 and the communication terminal 7 are both computers, the configuration of the image management system 5 will be described below, and the description of the configuration of the communication terminal 7 will be omitted.

  The image management system 5 includes a CPU 501 that controls the overall operation of the image management system 5, a ROM 502 that stores programs used to drive the CPU 501 such as an IPL, a RAM 503 that is used as a work area for the CPU 501, and a program for the image management system 5. For reading various data such as HD504, HDD (Hard Disk Drive) 505 for controlling the reading or writing of various data to the HD504 in accordance with the control of the CPU 501, and data reading or writing (storage) for a recording medium 506 such as a flash memory. A media drive 507 to be controlled, a display 508 for displaying various information such as a cursor, menu, window, character, or image, and a network I / F 509 for data communication using the communication network 9 An example of a keyboard 511 having a plurality of keys for inputting characters, numerical values, various instructions, a mouse 512 for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like, and a removable recording medium A CD-ROM drive 514 for controlling the reading or writing of various data to / from a CD-ROM (Compact Disc Read Only Memory) 513, and the above-mentioned components are electrically connected as shown in FIG. A bus line 510 such as an address bus or a data bus.

  Note that a recording medium such as a CD-ROM in which the above programs are stored, and an HD 504 in which these programs are stored can be provided domestically or abroad as a program product.

<< Functional Configuration of Embodiment >>
Next, the functional configuration of this embodiment will be described with reference to FIGS. FIG. 12 is a functional block diagram of the imaging device 1, the communication terminal 3, the image management system 5, and the communication terminal 7 that constitute a part of the image communication system of the present embodiment. In FIG. 12, the image management system 5 can perform data communication with the communication terminal 3 and the communication terminal 7 via the communication network 9.

<Functional configuration of photographing apparatus 1>
As illustrated in FIG. 12, the imaging device 1 includes a reception unit 12, an imaging unit 13, a sound collection unit 14, a communication unit 18, and a storage / readout unit 19. Each of these units is a function or means realized by any one of the constituent elements shown in FIG. 9 being operated by a command from the CPU 111 in accordance with a program for the photographing apparatus expanded from the SRAM 113 to the DRAM 114. It is.

  Further, the photographing apparatus 1 has a storage unit 1000 constructed by the ROM 112, the SRAM 113, and the DRAM 114 shown in FIG.

(Each functional configuration of the photographing apparatus 1)
Next, each functional configuration of the photographing apparatus 1 will be described in more detail with reference to FIGS. 9 and 12.

  The accepting unit 12 of the photographing apparatus 1 is mainly realized by the processing of the operation unit 115 and the CPU 111 shown in FIG. 9 and accepts an operation input from a user (photographer X in FIG. 8).

  The imaging unit 13 is realized mainly by the processing of the imaging unit 101, the image processing unit 104, the imaging control unit 105, and the CPU 111 shown in FIG. 9, and images a landscape and the like to obtain captured image data.

  The sound collecting unit 14 is realized by the processing of the CPU 108, the sound processing unit 109, and the CPU 111 shown in FIG. 9, and collects sounds around the photographing apparatus 1.

  The communication unit 18 is mainly realized by the processing of the CPU 111 and is performed by the communication unit 38 of the communication terminal 3 and short-range wireless technology such as NFC (Near Field Communication) standard, BlueTooth (registered trademark), WiFi (Wireless Fidelity), and the like. Can communicate.

  The storage / reading unit 19 is realized mainly by the processing of the CPU 111 shown in FIG. 9, and stores various data (or information) in the storage unit 1000 or stores various data (or information) from the storage unit 1000. Read out.

<Functional configuration of communication terminal 3>
As illustrated in FIG. 12, the communication terminal 3 includes a transmission / reception unit 31, a reception unit 32, a display control unit 33, a determination unit 34, a communication unit 38, and a storage / readout unit 39. Each of these units is a function or means realized by any one of the constituent elements shown in FIG. 10 operating according to a command from the CPU 301 according to the communication terminal 3 program expanded from the EEPROM 304 onto the RAM 303. It is.

  Further, the communication terminal 3 includes a storage unit 3000 constructed by the ROM 302, the RAM 303, and the EEPROM 304 shown in FIG.

(Each functional configuration of the communication terminal 3)
Next, each functional configuration of the communication terminal 3 will be described in more detail with reference to FIGS. 10 and 12.

  The transmission / reception unit 31 of the communication terminal 3 is mainly realized by the processing of the communication unit 313 and the CPU 301 shown in FIG. 10, and transmits / receives various data (or information) to / from the image management system 5 via the communication network 9. I do.

  The accepting unit 32 is realized mainly by processing by the touch panel 316 and the CPU 301, and accepts various selections or inputs from the user. The touch panel 316 may be shared with the display 315. Further, input means (buttons) other than the touch panel may be used.

  The display control unit 33 is realized mainly by the processing of the CPU 301 and performs control for displaying various images and characters on the display 315.

  The determination unit 34 is realized mainly by the processing of the CPU 301 and performs various determinations.

  The communication unit 38 is mainly realized by the processing of the CPU 301, and can communicate with the communication unit 18 of the photographing apparatus 1 by a short-range wireless technology such as NFC standard, BlueTooth, WiFi, or the like. In addition, although the communication part 38 and the transmission / reception part 31 demonstrated the structure which has a communication unit separately, of course, a shared structure may be sufficient.

  The storage / reading unit 39 is mainly realized by the processing of the CPU 301 shown in FIG. 10, and stores various data (or information) in the storage unit 3000 or stores various data (or information) from the storage unit 3000. Read out.

<Functional configuration of image management system>
Next, each functional configuration of the image management system 5 will be described in detail with reference to FIGS. 11 and 12. The image management system 5 includes a transmission / reception unit 51, a thumbnail creation unit 53, a predetermined area image creation unit 54, and a storage / readout unit 59. Each of these units is a function realized by any of the constituent elements shown in FIG. 11 being operated by an instruction from the CPU 501 according to the image management system 5 program expanded from the HD 504 to the RAM 503, or Means.

  Further, the image management system 5 includes a storage unit 5000 constructed by the RAM 503 and the HD 504 shown in FIG. In the storage unit 5000, a captured image management DB 5001, a predetermined area information management DB 5002, and a thumbnail management DB 5003 are constructed. Among these, the photographed image management DB 5001 is configured by a photographed image management table shown in FIG. The predetermined area information management DB 5002 is configured by a predetermined area information management table shown in FIG. The thumbnail management DB 5003 is configured by a thumbnail management table shown in FIG.

(Shooting image management table)
FIG. 13 is a conceptual diagram showing a captured image management table. In this photographed image management table, a user ID, a photographed image ID, a photographed image data file name, and a photographed date and time are stored and managed in association with each other. Among these, the user ID is an example of user identification information for identifying each photographer. When the photographer and the uploader are different, the user ID may be information for identifying the person who uploads the captured image instead of the photographer. The photographed image ID is an example of photographed image identification information for identifying each photographed image (spherical panoramic image). The shooting date and time indicates the date and time when the photographer took a picture and obtained the shot image.

(Predetermined area information management table)
FIG. 14 is a conceptual diagram showing a predetermined area information management table. In the predetermined area information management table, a predetermined area image ID, a captured image ID, and predetermined area information are stored and managed in association with each other. Among these, the predetermined area image ID is an example of predetermined area image identification information for identifying each predetermined area image. As described above, the predetermined area information is information for specifying the predetermined area T in the omnidirectional panoramic image, and includes, for example, coordinates x (rH), coordinates y (rV), and angle of view α (angle). Indicated by the parameter.

(Thumbnail management table)
FIG. 15 is a conceptual diagram showing a thumbnail management table. In this thumbnail management table, a thumbnail ID, a predetermined area image ID, and a file name of thumbnail data are stored and managed in association with each other. Among these, the thumbnail ID is an example of thumbnail identification information for identifying each thumbnail. It is an example of predetermined area image ID and predetermined area image identification information for identifying a predetermined area image (or predetermined area information).

(Each functional configuration of the image management system)
Next, each functional configuration of the image management system 5 will be described in detail with reference to FIGS. 11 and 12.

  The transmission / reception unit 51 of the image management system 5 is realized mainly by the processing of the network I / F 509 and the CPU 501 illustrated in FIG. 11, and the communication terminal 3 or the communication terminal 7 and various data ( Or information).

  The thumbnail creation unit 53 is realized mainly by the processing of the CPU 501 shown in FIG. 11. For example, the thumbnail creation unit 53 is based on photographed image data whose file format is RAW (raw, raw), and the file format is JPEG (Joint A thumbnail of a predetermined area image that is a Photographic Experts Group) is created.

  The predetermined area image creation unit 54 is realized mainly by the processing of the CPU 501 shown in FIG. 11. For example, based on the captured image data whose file format is RAW, a predetermined area image whose file format is JPEG is generated. create. The file format may be JPEG instead of RAW. Further, instead of JPEG, a file format such as TIFF (Tagged Image File Format), BMP (Bitmap), or GIF (Graphics Interchange Format) may be used.

  The storage / reading unit 59 is mainly realized by the processing of the HDD 505 and the CPU 501 shown in FIG. 11, and stores various data (or information) in the storage unit 5000 or various data (or information) from the storage unit 5000. Information).

<Functional configuration of communication terminal 7>
Next, the functional configuration of the communication terminal 7 will be described in detail with reference to FIGS. 11 and 13. The communication terminal 7 includes a transmission / reception unit 71, a reception unit 72, a determination unit 74, a display control unit 73, and a storage / readout unit 79. Each of these units is a function or means realized by any one of the constituent elements shown in FIG. 11 operating according to a command from the CPU 501 according to the communication terminal 7 program expanded from the HD 504 to the RAM 503. It is.

  In addition, the communication terminal 7 includes a storage unit 7000 constructed by the RAM 503 and the HD 504 shown in FIG.

(Each functional configuration of the communication terminal 7)
Next, each functional configuration of the communication terminal 7 will be described in detail with reference to FIG.

  The transmission / reception unit 71 of the communication terminal 7 is realized mainly by the processing of the network I / F 509 and the CPU 501 shown in FIG. 11, and transmits / receives various data (or information) to / from the image management system 5 via the communication network 9. I do.

  The accepting unit 72 is realized mainly by the processing of the keyboard 511 and mouse 512 and the CPU 501 shown in FIG. 11, and accepts an operation input from a user (browser Y in FIG. 8).

  The display control unit 73 is mainly realized by the processing of the CPU 501 illustrated in FIG. 11 and performs control for displaying various images on the display 508 of the communication terminal 7.

  The determination unit 74 is realized mainly by the processing of the CPU 501 shown in FIG. 11 and makes various determinations.

  The storage / reading unit 79 is realized mainly by the processing of the HDD 505 and the CPU 501 shown in FIG. 11, and stores various data (or information) in the storage unit 7000 or various data (or information) from the storage unit 7000. Information).

<< Processing or Operation of Embodiment >>
Next, the processing or operation of this embodiment will be described with reference to FIGS. First, processing for uploading captured image data and predetermined area information will be described with reference to FIGS. 16 and 17. FIG. 16 is a sequence diagram illustrating processing for uploading captured image data and predetermined area information. FIGS. 17A and 17B are diagrams illustrating a communication terminal in which a predetermined area image is displayed on the display.

As illustrated in FIG. 16, when the reception unit 32 receives the operation of the photographer X, the communication unit 38 acquires captured image data from the communication unit 18 of the imaging device 1 (step S21). In this case, the captured image data is image data in which the file format of the omnidirectional panoramic image as shown in FIGS. 3A and 3B is RAW.
Next, when the reception unit 32 receives the operation of the photographer X, as shown in FIG. 6B, the display control unit 33 uses the predetermined region information that is initially set to display a predetermined region on the display 315. The image P1 is displayed (step S22). Then, when the reception unit 32 receives a touch and slide on the display 315 by the photographer X, the display control unit 33 displays the predetermined area image P2 on the display 315 as illustrated in FIG. Is displayed (step S23). Here, when the photographer X shares the predetermined area image P2 with other users, the "area determination" button B1 is pressed, and the receiving unit 32 receives predetermined area information indicating the predetermined area image P2 (step S1). S24). As described above, when the photographer X repeatedly selects a predetermined area image to be shared and finally presses the “upload” button B 2, the accepting unit 32 accepts an upload request, and the transmission / reception unit 31 sends to the image management system 5. The photographed image data and each predetermined area information received in step S24 are transmitted (step S25). In this case, the captured image data is image data in which the file format remains as RAW. The transmission / reception unit 31 also transmits user ID, the file name of the captured image data, and shooting date / time information indicating the shooting date / time of the shot image, together with the shot image data and the predetermined area information. Thereby, the transmission / reception unit 51 of the image management system 5 receives the captured image data, the predetermined area information, the user ID, the file name of the captured image data, and the captured date / time information. Note that when the “cancel” button B3 in FIG. 17 is pressed, the latest predetermined area information received by the receiving unit 32 is canceled.

  Next, the storage / reading unit 59 of the image management system 5 stores the captured image data received in step S25 in the storage unit 5000 with the file format being RAW (step S26). The storage / readout unit 59 assigns a captured image ID to the captured image data received in step S25, and also includes the captured image ID, the user ID received in step S25, and the file name of the captured image data. And the shooting date and time information are associated with each other and stored and managed in the shot image management table (see FIG. 13) (step S27). Further, the storage / reading unit 59 assigns a predetermined area image ID to the predetermined area information received in step S25, and receives the predetermined area image ID, the captured image ID assigned in step S27, and the step 25. The predetermined area information is associated and stored in the predetermined area information management table (see FIG. 14) for management (step S28). In FIG. 14, a plurality of different predetermined area information is managed for the same captured image data (captured image ID “p0001”). This completes the process of uploading the captured image data and the predetermined area information.

  Subsequently, the process of downloading the predetermined area image data will be described with reference to FIGS. 18 and 19. FIG. 6 is a sequence diagram illustrating a process of downloading predetermined area image data.

  First, when the accepting unit 72 of the communication terminal 7 accepts the operation of the viewer Y, the transmitting / receiving unit 71 sends a request for a thumbnail of a predetermined area image to the image management system 5 (step S41). This thumbnail request includes the user ID of the photographer desired by the viewer Y. As a result, the transmission / reception unit 51 of the image management system 5 receives the thumbnail request.

  Next, in response to receiving the request in step S41, the thumbnail creating unit 53 creates thumbnail data of a predetermined area indicated by the predetermined area information in the image related to the captured image data (step S42). More specifically, the storage / reading unit 59 searches the photographed image management table (see FIG. 13) using the user ID received in step S41 as a search key, thereby corresponding photographed image ID and photographed image data. Read the file name. Then, the storage / reading unit 59 reads the captured image data having the read file name from the storage unit 5000. Further, the storage / reading unit 59 reads the corresponding predetermined region image ID and the predetermined region information by searching the predetermined region information management table (see FIG. 14) using the read captured image ID as a search key. As a result, the thumbnail creating unit 53 creates a thumbnail of a portion of the predetermined area image indicated by the read predetermined area information, among the images related to the read captured image data.

  next. The storage / reading unit 59 assigns a thumbnail ID for each thumbnail, and associates the thumbnail ID with the predetermined region image ID read in step S42 and the file name of the created thumbnail, thereby storing a predetermined region information management table (FIG. 14). Reference) and manage. (Step S43). At this time, the storage / readout unit 59 stores the thumbnail data created by the thumbnail creation unit 53 in the storage unit 5000.

  Next, the transmission / reception unit 51 transmits each thumbnail data created by the thumbnail creation unit 53 to the communication terminal 7 (step S44). Each thumbnail data includes a thumbnail ID for identifying the thumbnail data. Thereby, the transmission / reception part 71 of the communication terminal 7 receives each thumbnail data.

  Next, in the communication terminal 7, the display control unit 73 displays a download image selection screen showing each thumbnail as shown in FIG. 19A on the display 508 of the communication terminal 7 (step S45). ). On this download image selection screen, a thumbnail and a selection column for selecting each thumbnail are displayed. Then, the accepting unit 72 accepts selection of thumbnails of predetermined area images to be downloaded from the viewer Y (step S46). FIG. 19A shows a case where the viewer Y has selected the upper right thumbnail from among the four thumbnails. When the viewer Y presses the “download” button b1, the reception unit 72 receives the download, and the transmission / reception unit 71 transmits a request for a predetermined area image to the image management system 5 (step S47). . This request includes a thumbnail ID indicating the thumbnail selected in step S46. Thereby, the transmission / reception unit 51 of the image management system 5 receives the request for the predetermined area image.

  Next, in the image management system 5, the predetermined area image creation unit 54 creates the requested predetermined area image based on the thumbnail ID received in step S47. More specifically, the storage / reading unit 79 reads the corresponding predetermined area image ID by searching the thumbnail management table (see FIG. 15) using the thumbnail ID received in step S47 as a search key. Then, the storage / readout unit 79 reads the corresponding photographed image ID and the predetermined region information by searching the predetermined region information management table (see FIG. 14) using the read predetermined region image ID as a search key. Further, the storage / reading unit 79 retrieves the file name of the corresponding photographed image data by searching the photographed image management table (see FIG. 13) using the read photographed image ID as a search key, and the photographed image having this file name is read. Data is read from the storage unit 5000. As a result, the predetermined area image creating unit 54 creates a predetermined area image indicated by the read predetermined area information from among the images related to the read captured image data. The file format of the predetermined area image is JPEG (TIFF, BMP (Bitmap), GIF), not RAW.

  Next, the transmission / reception unit 51 transmits the predetermined area image created in step S48 to the communication terminal 7 (step S48). Thereby, the transmission / reception unit 71 of the communication terminal 7 receives the predetermined area image.

  Next, in the communication terminal 7, the display control unit 73 displays the predetermined area image p2 on the display 508 of the communication terminal 7 as shown in FIG. 19B (step S30). The “return” button b2 is a button for returning to the initial screen, and the “return” button b3 is a button for returning to the download image selection screen shown in FIG. The received predetermined area image may be stored in the storage unit 7000.

<< Main effects of this embodiment >>
As described above, according to the present embodiment, the image management system 5 does not store the predetermined area image, stores the predetermined area information, receives the download request from the communication terminal 7, and then receives the two-dimensional image. A predetermined area image is created and transmitted to the communication terminal 7. Thereby, while suppressing the storage capacity of the storage unit 5000, the predetermined area image can be displayed / viewed even on a communication terminal in which a viewer for displaying / viewing the panoramic image is not installed.

DESCRIPTION OF SYMBOLS 1 Imaging device 3 Communication terminal 5 Image management system 7 Communication terminal 9 Communication network 51 Transmission / reception part (an example of a transmission means, an example of a reception means)
53 Thumbnail creation part (an example of thumbnail creation means)
54 Predetermined area image creating unit (an example of creating a predetermined area image)

JP 2014-131215 A

Claims (10)

An image management system for managing image data,
Storage means for storing the image data;
Predetermined area information managing means for managing predetermined area information for indicating a predetermined area in an image related to the image data;
Receiving means for receiving a transmission request for a predetermined area image, which is an image of the predetermined area, from a predetermined communication terminal;
Predetermined area image creating means for creating predetermined area image data of a predetermined area indicated by the predetermined area information in an image related to the image data in response to reception of the transmission request;
Transmitting means for transmitting the created predetermined area image data to the predetermined communication terminal;
An image management system. The image management system according to claim 1,
In response to receiving the transmission request, thumbnail creation means for creating predetermined thumbnail data of a predetermined area indicated by the predetermined area information in the image related to the image data;
Thumbnail management means for associating and managing the created predetermined thumbnail data and predetermined thumbnail identification information for identifying the predetermined thumbnail data;
Have
The transmission means transmits the predetermined thumbnail data and the predetermined thumbnail identification information to the predetermined communication terminal,
The receiving means receives specific thumbnail identification information transmitted from the predetermined communication terminal in response to transmission of the predetermined thumbnail data and the predetermined thumbnail identification information;
The image management system for creating the predetermined area image data indicated by the predetermined area information on which the specific thumbnail data indicated by the specific thumbnail identification information is generated. The receiving means receives the image data and the predetermined area information transmitted from another communication terminal,
The storage means stores the received image data,
The image management system according to claim 1, wherein the predetermined area information management unit manages predetermined area information for indicating a predetermined area in an image related to the image data.   4. The image data according to claim 1, wherein the image data is omnidirectional panoramic image data, and the predetermined area image data is image data of a partial area of an image related to the omnidirectional panoramic image data. 5. Image management system.   The image management system according to any one of claims 1 to 4, wherein the file format of the image data is RAW, and the file format of the predetermined area image data is JPEG, TIFF, BMP, or GIF. An image management system according to any one of claims 1 to 5,
A photographing device that transmits the image data obtained by photographing to the predetermined communication terminal;
An image communication system. An image management method executed by an image management system for managing image data,
The image management system includes:
Storage means for storing the image data;
Predetermined area information managing means for managing predetermined area information for indicating a predetermined area in an image related to the image data;
Have
The image management system includes:
Receiving a transmission request for a predetermined area image, which is an image of the predetermined area, from a predetermined communication terminal;
In response to receiving the transmission request, create predetermined area image data of a predetermined area indicated by the predetermined area information in the image related to the image data,
An image management method for transmitting by transmitting the created predetermined area image data to the predetermined communication terminal. The image management method according to claim 7, comprising:
The image management system includes:
In response to receiving the transmission request, create predetermined thumbnail data of a predetermined area indicated by the predetermined area information in the image related to the image data,
The created predetermined thumbnail data and the predetermined thumbnail identification information for identifying the predetermined thumbnail data are associated with each other and managed by the thumbnail management means.
Transmitting the predetermined thumbnail data and the predetermined thumbnail identification information to the predetermined communication terminal;
In response to the transmission of the predetermined thumbnail data and the predetermined thumbnail identification information, the specific thumbnail identification information transmitted from the predetermined communication terminal is received,
An image management method for creating predetermined area image data indicated by predetermined area information based on which specific thumbnail data indicated by the specific thumbnail identification information is generated. Receiving the image data and the predetermined area information transmitted from another communication terminal;
Storing the received image data in the storage means;
The image management method according to claim 7 or 8, wherein the predetermined area information management unit manages predetermined area information for indicating a predetermined area in an image related to the image data.   A program for causing a computer to execute the image management method according to any one of claims 7 to 9.

Images