JP6115113B2 - Predetermined area management system, predetermined area management method, and program - Google Patents

Description

  The present invention relates to a predetermined area management system capable of communicating with a predetermined communication terminal, a predetermined area management method executed by the predetermined area management system, and a program for executing the method.

  In recent years, an image taken by a digital camera or the like is uploaded by a user to an image management server on the Internet, while another user downloads the image from the image management server, so that a plurality of users can share the same image. Has been provided (see Patent Document 1).

  In recent years, SNS (Social Networking Service) such as Facebook has rapidly spread. With this SNS, users can post comments on their shared images so that multiple users can view the comments.

  Here, the comment will be described with reference to FIG. As shown in FIG. 38, with respect to the intersection image uploaded by user A, user B pays attention to a sharer a part of the intersection image (here, “image of the first building”). When he / she wants to encourage the user, the user B can post a part of the image as a comment. Further, when user B wants to encourage the sharer to pay attention to a part of the image at the intersection (here, “image of the second building”), user B posts a part of the image as a comment. be able to. Then, the sharer can view the posted comment as shown in FIG.

  In FIG. 38, each of the characters “intersection image”, “first building image”, and “second building image” is hypertext so that image data managed by the SNS image management server can be accessed. A link is set up.

  However, when a plurality of notable parts are registered for one image and each notable part is close, a plurality of similar images are registered, which is difficult for a sharer to understand. The problem arises.

The invention according to claim 1 is a predetermined area management system capable of communicating with a communication terminal, wherein the storage means stores first predetermined area information indicating a first position in a three-dimensional coordinate system of image data; Receiving means for receiving the second predetermined area information transmitted from the communication terminal and indicating the second position of the image data in the three-dimensional coordinate system, and indicated by the second predetermined area information received by the receiving means. Calculating means for calculating a distance between the second position and the first position indicated by the first predetermined area information stored in the storage means, and the distance calculated by the calculating means in advance When the distance is not more than a predetermined distance, the second predetermined area information is not stored in the storage means, and when the distance calculated by the calculation means exceeds the predetermined distance, Second A storage processing means for storing a constant area information in the storage means is a predetermined area management system characterized by having a.

  As described above, according to the present invention, the calculation means calculates the distance between the second position and the first position. If the calculated distance is less than or equal to a predetermined distance, the second predetermined area information indicating the second position is not stored in the storage means, and the calculated distance is determined in advance. When the distance exceeds the predetermined distance, the second predetermined area information indicating the second position is stored in the storage means. As a result, it is possible to prevent a plurality of similar images from being registered, and thus it is possible to solve the problem that it is difficult for a sharer to understand.

1 is a schematic diagram of an image sharing system according to an embodiment of the present invention. (A) is a left side view of the photographing apparatus, (b) is a front view of the photographing apparatus, and (c) is a plan view of the photographing apparatus. It is the image figure which showed the use condition of an imaging device. (A) is the hemispherical image (front) image | photographed with the imaging device, (b) is the hemispherical image (back) image | photographed with the imaging device, (c) is the figure which showed the image represented by the Mercator projection. (A) is the figure which showed the part of the image represented by Mercator projection, and the image for share selection, (b) is the figure which showed the image for share selection. It is a figure of the picked-up image selection list | wrist which showed the image for a share selection. It is the figure which showed the omnidirectional panoramic image. It is the figure which showed the position of the virtual camera and predetermined | prescribed area | region at the time of making an omnidirectional panoramic image into a three-dimensional solid sphere. (A) is the three-dimensional perspective view of FIG. 7, (b) is a figure which shows the communication terminal by which the image of the predetermined area | region was displayed on the display. FIG. 10A is a diagram showing a predetermined area image (partial image P) in which each attention point is shown. FIG. 10B includes an arbitrary attention point and shows the periphery of this attention point. It is the figure which showed the predetermined area image (partial image P1). (A), (b) is the figure which showed the predetermined area | region image. It is the figure which showed the relationship between a predetermined area | region and an attention point. It is a hardware block diagram of an imaging device. It is a hardware block diagram of a communication terminal. It is a hardware block diagram of a predetermined area management system and an image management system. It is a functional block diagram of a communication terminal, a predetermined area management system, and an image management system according to the embodiment. It is a conceptual diagram which shows a predetermined area management table. It is a conceptual diagram which shows an image management table. It is a conceptual diagram which shows a related person management table. It is a conceptual diagram which shows an album management table. It is a conceptual diagram which shows the image management table in an album. FIG. 6 is a sequence diagram illustrating processing for uploading a captured image. It is the figure which showed the image object. It is the sequence diagram which showed the process which posts a predetermined area | region as a comment to an image management system. It is the figure which showed the content of the comment object. It is the sequence diagram which showed the process which registers a predetermined area | region into a predetermined area | region management system. It is the figure which showed the content of the predetermined area object. FIG. 10 is a sequence diagram showing processing from when an interested party list is requested until an image list is displayed. It is a figure which shows the related person list displayed on the display. It is a figure which shows the album list displayed on the display. It is a figure which shows the image list displayed on the display. FIG. 6 is a sequence diagram illustrating a process of downloading image data and objects in a predetermined area list. It is the figure which showed the content of the image object. It is the figure which showed the content of the object of a predetermined area | region list. It is the conceptual diagram which showed each attention point on a solid sphere. It is the flowchart which showed the registration propriety judgment. It is the conceptual diagram which showed the process of primary narrowing down. It is the conceptual diagram which showed the process of secondary narrowing down. It is a figure which shows the posted comment.

  The embodiment of the present invention will be described below with reference to FIGS.

<< Summary of Embodiment >>
First, the outline of the present embodiment will be described with reference to FIGS. FIG. 1 is a schematic diagram of an image sharing system according to the present embodiment.

  As shown in FIG. 1, the image sharing system of the present embodiment is constructed by a photographing apparatus 1, a plurality of communication terminals (3 a, 3 b), a predetermined area management system 5, and an image management system 7. Each communication terminal (3a, 3b) is used by a user (A, B), respectively. Further, in the present embodiment, the case where the photographing apparatus 1 is operated by the user A is shown. In the following, an arbitrary communication terminal among the plurality of communication terminals (3a, 3b) is represented as “communication terminal 3”.

  The photographing apparatus 1 is a digital camera for obtaining an omnidirectional panoramic image. The communication terminal 3 is a computer such as a smartphone, a tablet terminal, a notebook personal computer, a desktop personal computer, or a PDA (Personal Data Assistance). Further, the predetermined area management system 5 and the image management system 7 are respective server computers.

  In addition, the photographing apparatus 1 can communicate with the communication terminal 3 by a short-range wireless technology based on NFC (Near Field Communication) standard. Further, the communication terminal 3 can communicate with the predetermined area management system 5 and the image management system 7 via the communication network 9. The communication network 9 is constructed by a wireless communication network such as 3G (3rd Generation), WiMAX (Worldwide Interoperability for Microwave Access), LTE (Long Term Evolution), and the like, each base station (9a, 9b, 9c), and the Internet. . Note that wired communication may be performed between the photographing apparatus 1 and the communication terminal 3, and between the communication terminal 3 and the communication network 9, respectively.

  Next, the external appearance of the imaging device 1 will be described with reference to FIG. 2A is a left side view of the photographing apparatus, FIG. 2B is a front view of the photographing apparatus, and FIG. 2C is a plan view of the photographing apparatus.

  As shown in FIG. 2A, the photographing apparatus 1 has a size that a human can hold with one hand. Further, as shown in FIGS. 2A, 2B, and 2C, at the upper part of the photographing apparatus 1, an image sensor 103a is provided on the front side (front side) and an image sensor is provided on the back side (rear side). 103b is provided. Further, as shown in FIG. 2B, an operation unit 115 such as a shutter button is provided on the front side of the photographing apparatus 1.

  Next, the usage situation of the imaging device 1 will be described with reference to FIG. FIG. 3 is an image diagram showing a usage state of the photographing apparatus. As shown in FIG. 3, the photographing device 1 is used for photographing a subject around the user with the hand held by the user. In this case, two hemispherical images can be obtained by imaging the subject around the user by the imaging device 103a and the imaging device 103b shown in FIG.

  Next, an image photographed by the photographing apparatus 1 and a synthesized image will be described with reference to FIG. 4A is a hemispheric image (front side) photographed by the photographing apparatus, FIG. 4B is a hemispheric image photographed by the photographing apparatus (rear side), and FIG. 4C is represented by Mercator projection. FIG. 6 is a diagram showing an image (hereinafter referred to as “Mercatl image”).

  As shown in FIG. 4A, the image obtained by the image sensor 103a is a hemispherical image (front side) curved by a fish-eye lens 102a described later. Also, as shown in FIG. 4B, the image obtained by the image sensor 103b is a hemispherical image (rear side) curved by a fish-eye lens 102b described later. Then, the hemispherical image (front side) and the hemispherical image inverted by 180 degrees (rear side) are combined by the photographing apparatus 1 to create a Mercator image as shown in FIG.

  Next, the relationship between the Mercator image and the shared selection image used for selecting the image will be described with reference to FIGS. 5 and 6. FIG. 5A is a diagram showing a portion of a Mercator image and a share selection image, and FIG. 5B is a diagram showing a share selection image. FIG. 6 is a view of a photographed image selection list showing the image for sharing selection.

  By using the portion indicated by the broken line on the Mercator image in FIG. 5A, the shared selection image in FIG. 5B is created. This share selection image is transmitted from the photographing apparatus 1 shown in FIG. 1 to the communication terminal 3a. Then, on the display 315 of the communication terminal 3a, as shown in FIG. 6, a shared image selection list SL showing each share selection image CE is displayed. For example, a building in a commercial area is displayed as the sharing selection image CE, and the shooting date and time (September 20, 2011, 11:21), the image data size of the shot image (13.1 MB), and the attention point described below are included. The set number (0) is displayed.

  Next, when the user A selects a desired share selection image CE, the communication terminal 3a acquires a photographed image (Merkattle image) related to the selected share selection image CE from the photographing apparatus 1.

  The acquired captured image is shown in FIG. 7 from the Mercator image shown in FIG. 4C by using OpenGL ES (Open Graphics Library for Embedded Systems) in the communication terminal 3a. A panoramic image is created. OpenGL ES is a graphics library used for visualizing 2D (2-Dimensions) and 3D (3-Dimensions) data. FIG. 7 is a diagram showing an omnidirectional panoramic image. The omnidirectional panoramic image may be a still image or a moving image.

  Next, processing for creating and displaying an image of a predetermined area (hereinafter referred to as “predetermined area image”) in the omnidirectional panoramic image will be described with reference to FIGS. 8 and 9. FIG. 8 is a diagram illustrating the positions of the virtual camera and the predetermined area when the panoramic image is a three-dimensional solid sphere. 9A is a three-dimensional perspective view of FIG. 8, and FIG. 9B is a diagram showing a communication terminal in which a predetermined area image is displayed on the display.

  If the omnidirectional panoramic image shown in FIG. 7 is a three-dimensional solid sphere CS, the virtual camera IC is located at the center of the omnidirectional panoramic image as shown in FIG. Three-axis rotation can be performed: rotation from the center up and down, left and right, and rotation from the viewpoint (ROLL). The predetermined area T in the omnidirectional panoramic image is specified by predetermined area information of the position of the virtual camera IC in the omnidirectional panoramic image. This predetermined area information includes coordinates x (rH), coordinates y (rV), and angle of view α (angle). The zoom of the predetermined area T can be expressed by expanding or contracting the range (arc) of the angle of view α.

  Then, as shown in FIG. 9A, the image of the predetermined area T in the omnidirectional panoramic image is displayed on the display 315 of the communication terminal 3a as shown in FIG. 9B. It is displayed as a region image. The predetermined area image in this case is a partial image P showing a part of the omnidirectional panoramic image. On the display 315, a predetermined area image display area 3110 for displaying a predetermined area image, a thumbnail display area 3120 for displaying a thumbnail of the predetermined area image, and a comment display area 3130 for displaying a user's comment on the predetermined area image are displayed. Has been.

  On the other hand, the captured image shown in FIG. 4C can be uploaded to the image management system 7 via the communication network 9 from the communication terminal 3a. For example, the user B uses the communication terminal 3 b to download the captured image from the image management system 7 via the communication network 9. Thereby, each user can share a captured image.

  Also, as shown in FIG. 10, in the image sharing system of the present embodiment, it is possible to set a point of interest that each user is paying attention to the captured image. FIG. 10A is a diagram showing a predetermined area image (partial image P) in which each attention point is shown. FIG. 10B includes the attention point AP1 and the periphery of the attention point AP1. It is the figure which showed the predetermined area image (partial image P1) which showed.

  As shown in FIG. 10A, on the display 315 of the communication terminal 3b, a plurality of attention points set by attention by a single or a plurality of users using the image sharing system of the present embodiment. (AP1, AP2, AP3, AP4) is displayed. Furthermore, thumbnails (T1, T2, T3, T4) of images (predetermined region images) of a predetermined region T in a certain range including each attention point (AP1, AP2, AP3, AP4) are displayed at the bottom of the display 315, respectively. Is done. When the user B selects the thumbnail T1, for example, as shown in FIG. 10B, a predetermined region image (here, the partial image P1) that is the original image of the thumbnail T1 is displayed on the display 315. Will be displayed. In the following, of the attention points (AP1, AP2, AP3, AP4), an arbitrary attention point is represented as “attention point AP”.

  It is also possible to set a point of interest for the predetermined area image shown in FIG. In this case, a thumbnail of a predetermined area image including the set attention point is displayed.

  Here, the relationship between the predetermined region T and the point of interest AP will be described with reference to FIG. FIG. 11 is a diagram showing the relationship between the predetermined area and the point of interest. As shown in FIG. 11, the center point of the diagonal view angle 2L of the predetermined area T represented by the view angle α of the virtual camera IC is represented as the attention point AP. That is, when the user sets the attention point AP, the predetermined area information (coordinates x (rH), coordinates y (rV), and angle of view α (angle)) is managed by the predetermined area management system 5, and the predetermined area information The attention point AP is displayed on the display 315 based on the above. That is, the attention point AP can be represented by a relational database using a predetermined area management table as shown in FIG. Note that f is the distance from the virtual camera IC to the point of interest AP. In FIG. 11, a trigonometric function represented by the following formula (1) is generally established.

Lf = tan (α / 2) Expression (1)
In the above description, the communication terminal 3b downloads the captured image. However, the present invention is not limited to this, and the communication terminal 3a may download the captured image.

<< Hardware Configuration of Embodiment >>
Next, the hardware configuration of the imaging apparatus, communication terminal, predetermined area management system, and image management system of this embodiment will be described in detail with reference to FIGS.

  First, the hardware configuration of the photographing apparatus 1 will be described with reference to FIG. FIG. 12 is a hardware configuration diagram of the photographing apparatus. In the following, the photographing apparatus 1 is an omnidirectional photographing apparatus using two imaging elements, but the number of imaging elements may be three or more. In addition, it is not always necessary to use an apparatus dedicated to omnidirectional imaging. By attaching a retrofit omnidirectional imaging unit to a normal digital camera, smartphone, or the like, the apparatus may have substantially the same function as the imaging apparatus 1. .

  As shown in FIG. 12, the imaging apparatus 1 includes an imaging unit 101, an image processing unit 104, an imaging control unit 105, a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, an SRAM (Static Random Access). Memory (RAM) 113, DRAM (Dynamic Random Access Memory) 114, operation unit 115, network I / F 116, communication unit 117, and antenna 117a.

  Among these, the imaging unit 101 includes wide-angle lenses (so-called fish-eye lenses) 102a and 102b each having an angle of view of 180 ° or more for forming a hemispherical image, and two imaging units provided corresponding to the wide-angle lenses. Elements 103a and 103b are provided. The image sensors 103a and 103b are image sensors such as a CMOS (Complementary Metal Oxide Semiconductor) sensor and a CCD (Charge Coupled Device) sensor that convert an optical image obtained by a fisheye lens into image data of an electric signal and output the image data. A timing generation circuit for generating a vertical synchronization signal, a pixel clock, and the like, and a register group in which various commands and parameters necessary for the operation of the image sensor are set.

  The imaging elements 103a and 103b of the imaging unit 101 are each connected to the image processing unit 104 via a parallel I / F bus. On the other hand, the imaging elements 103 a and 103 b of the imaging unit 101 are connected to a serial I / F bus (I2C bus or the like) separately from the imaging control unit 105. The image processing unit 104 and the imaging control unit 105 are connected to the CPU 111 via the bus 110. Further, ROM 112, SRAM 113, DRAM 114, operation unit 115, network I / F 116, communication unit 117, and electronic compass 118 are connected to the bus 100.

  The image processing unit 104 takes in the image data output from the image sensors 103a and 103b through the parallel I / F bus, performs predetermined processing on the respective image data, and then combines these image data. Then, data of a Mercator image as shown in FIG.

  In general, the imaging control unit 105 sets a command or the like in a register group of the imaging elements 103a and 103b using the I2C bus with the imaging control unit 105 as a master device and the imaging elements 103a and 103b as slave devices. Necessary commands and the like are received from the CPU 111. The imaging control unit 105 also uses the I2C bus to capture status data of the register groups of the imaging elements 103a and 103b and send it to the CPU 111.

  The imaging control unit 105 instructs the imaging elements 103a and 103b to output image data at the timing when the shutter button of the operation unit 115 is pressed. Some photographing apparatuses have a preview display function by a display and a function corresponding to a moving image display. In this case, output of image data from the image sensors 103a and 103b is continuously performed at a predetermined frame rate (frame / min).

  Further, as will be described later, the imaging control unit 105 also functions as a synchronization control unit that synchronizes the output timing of image data of the imaging elements 103a and 103b in cooperation with the CPU 111. In the present embodiment, the photographing apparatus is not provided with a display unit, but a display unit may be provided.

  The CPU 111 controls the overall operation of the photographing apparatus 1 and executes necessary processes. The ROM 112 stores various programs for the CPU 111. The SRAM 113 and the DRAM 114 are work memories, and store programs executed by the CPU 111, data being processed, and the like. In particular, the DRAM 114 stores image data being processed by the image processing unit 104 and processed Mercator image data.

  The operation unit 115 is a general term for various operation buttons, a power switch, a shutter button, a touch panel that has both display and operation functions, and the like. The user inputs various shooting modes and shooting conditions by operating the operation buttons.

  The network I / F 116 is a general term for an interface circuit (USB I / F or the like) with an external medium such as an SD card or a personal computer. Further, the network I / F 116 may be a network interface regardless of wireless or wired. The data of the Mercator image stored in the DRAM 114 is recorded on an external medium via the network I / F 116 or, if necessary, the communication terminal 3 via the network I / F 116 serving as a network I / F. To the external device.

  The communication unit 117 communicates with an external device such as the communication terminal 3 by a short-range wireless technology such as WiFi (wireless fidelity) or NFC via the antenna 117 a provided in the photographing apparatus 1. The communication unit 117 can also transmit Mercator image data to an external device of the communication terminal 3.

  The electronic compass 118 calculates the azimuth and tilt (Roll rotation angle) of the photographing apparatus 1 from the earth's magnetism, and outputs azimuth / tilt information. This azimuth / tilt information is an example of metadata along Exif, and is used for image processing such as image correction of a captured image. The metadata also includes image data thumbnails, image shooting date and time, and image data data capacity.

  Next, the hardware configuration of the communication terminal 3 will be described with reference to FIG. FIG. 13 is a hardware configuration diagram when the communication terminal is a smartphone.

  As shown in FIG. 13, the communication terminal 3 includes a CPU 301 that controls the operation of the entire communication terminal 3, a ROM 302 that stores basic input / output programs, and a RAM (Random Access Memory) 303 that is used as a work area for the CPU 301. , An EEPROM (Electrically Erasable and Programmable ROM) 304 that reads or writes data according to the control of the CPU 301, a CMOS sensor 305 as an image sensor that captures an image of the subject and obtains image data according to the control of the CPU 301, and an electronic magnetic compass that detects geomagnetism , A gyro compass, various acceleration / direction sensors 306 such as an acceleration sensor, and a media drive 308 that controls reading or writing (storage) of data with respect to a recording medium 307 such as a flash memory. In accordance with the control of the media drive 308, the recording medium 307 from which data that has already been recorded is read or to which data is newly written and stored is detachable.

  The EEPROM 304 stores an operating system (OS) executed by the CPU 301, other programs, and various data. A CCD sensor may be used instead of the CMOS sensor 305.

  Further, the communication terminal 3 includes a voice input unit 311 that converts voice into a voice signal, a voice output unit 312 that converts voice signal into voice, an antenna 313a, and a wireless communication signal that uses the antenna 313a. A GPS signal including position information (latitude, longitude, and altitude) of the communication terminal 3 by a communication unit 313 that communicates with the station 9a and the like, a GPS (Global Positioning Systems) satellite, or IMES (Indoor MEssaging System) as an indoor GPS. A GPS receiver 314 for receiving, a display 315 such as a liquid crystal display or an organic EL display for displaying an image of a subject, various icons, and the like, and a pressure-sensitive or electrostatic panel placed on the display 315 and configured by a finger, a touch pen, etc. A touch panel 316 for detecting a touch position on the display 315 by touching with the And it includes an address bus, a data bus, and the like of the bus line 310 for electrically connecting the respective units.

  Note that the voice input unit 311 includes a microphone that inputs voice, and the voice output unit 312 includes a speaker that outputs voice.

  Next, the hardware configuration of the predetermined area management system 5 and the image management system 7 will be described with reference to FIG. FIG. 14 is a hardware configuration diagram of the predetermined area management system 5 and the image management system 7. Since both the predetermined area management system 5 and the image management system 7 are general server computers, the configuration of the predetermined area management system 5 will be described below, and the description of the configuration of the image management system 7 will be omitted.

  The predetermined area management system 5 includes a CPU 501 that controls the operation of the entire predetermined area management system 5, a ROM 502 that stores a program used to drive the CPU 501 such as an IPL, a RAM 503 that is used as a work area for the CPU 501, and a predetermined area management system 5. HD 504 for storing various data such as programs for data, HDD (Hard Disk Drive) 505 for controlling the reading or writing of various data to the HD 504 according to the control of the CPU 501, data reading or writing to a recording medium 506 such as a flash memory ( Media drive 507 for controlling storage, a display 508 for displaying various information such as a cursor, menu, window, character, or image, and a network for data communication using the communication network 9 / F509, keyboard 511 having a plurality of keys for inputting characters, numerical values, various instructions, etc., mouse 512 for selecting and executing various instructions, selecting a processing target, moving the cursor, etc., removable recording medium As an example, a CD-ROM drive 514 that controls the reading or writing of various data to a CD-ROM (Compact Disc Read Only Memory) 513, and the above components are electrically connected as shown in FIG. A bus line 510 such as an address bus or a data bus for connection is provided.

<< Functional Configuration of Embodiment >>
Next, the functional configuration of the present embodiment will be described with reference to FIG. FIG. 15 is a functional block diagram of the communication terminal 3, the predetermined area management system 5, and the image management system 7 that constitute a part of the image sharing system of the present embodiment. In FIG. 15, the communication terminal 3, the predetermined area management system 5, and the image management system 7 can perform data communication via the communication network 9.

<Functional configuration of communication terminal>
As illustrated in FIG. 15, the communication terminal 3 includes a transmission / reception unit 31, an operation input reception unit 32, a creation unit 33, a display control unit 34, and a storage / extraction unit 39. Each of these units is a function realized by any one of the constituent elements shown in FIG. 12 being operated by a command from the CPU 111 according to the program for the communication terminal 3 developed from the SRAM 113 to the DRAM 114, or Means.

  Further, the communication terminal 3 has a storage unit 3000 constructed by the ROM 112, the SRAM 113, and the DRAM 114 shown in FIG.

(Functional configuration of communication terminal)
Next, each functional configuration of the communication terminal 3 will be described in more detail with reference to FIGS. 13 and 15.

  The transmission / reception unit 31 of the communication terminal 3 is mainly realized by the processing of the communication unit 313 and the CPU 301 shown in FIG. 13, and the predetermined area management system 5 or the image management system 7 and various data via the communication network 9. (Or information) is sent and received.

  The operation input receiving unit 32 is realized mainly by the processing by the touch panel 316 and the CPU 301, and receives various selections or inputs from the user.

  The creation unit 33 is realized mainly by the processing of the CPU 301, and based on the user's designation or selection received by the operation input reception unit 32, as shown in FIG. Create an image. The creation unit 33 creates thumbnails as shown in FIGS. 11A and 11B based on the predetermined area image.

  The display control unit 34 is realized mainly by the processing of the CPU 301 and performs control for displaying various images, characters, and the like on the display 315.

  The storage / extraction unit 39 stores various data (or information) in the storage unit 3000 and extracts various data (or information) from the storage unit 3000. The storage / extraction unit 39 records, for example, each data such as a photographed image, a shared selection image, or a predetermined area image in the storage unit 3000 or extracts it from the storage unit 3000.

<Functional configuration of the predetermined area management system>
Next, each functional configuration of the predetermined area management system 5 will be described in detail with reference to FIG. The predetermined area management system 5 includes a transmission / reception unit 51, a determination unit 52, a creation unit 53, a calculation unit 54, and a storage / extraction unit 59. Each of these units is realized by any one of the components shown in FIG. 14 operating according to a command from the CPU 501 in accordance with a program for the predetermined area management system 5 developed from the HD 504 onto the RAM 503. It is a function or means.

  Further, the predetermined area management system 5 includes a storage unit 5000 constructed by the RAM 503 and the HD 504 shown in FIG. In the storage unit 5000, a predetermined area management DB 5001 configured by a predetermined area management table described later is constructed.

(Predetermined area management table)
FIG. 16 is a conceptual diagram showing a predetermined area management table. In this predetermined area management table, user identification information for identifying a user, image identification information for identifying image data, predetermined area information, and registration rejection number information are stored and managed in association with each other. Among these, the registration refusal number information is information indicating that the predetermined area management system 5 cannot newly store the predetermined area information in the predetermined area management table because the predetermined area information is already stored. For example, it indicates the number of times the request for determining whether or not to register the predetermined area information is rejected. Specifically, when the registration of the newly requested predetermined area information is rejected because the predetermined area information that has already been registered exists in the determination of whether or not to register the newly requested predetermined area information. The number of registrations rejected for the predetermined area information already registered that caused the rejection is managed.

  Also, as shown in FIG. 10A, when a plurality of points of interest are set in a single captured image, a plurality of predetermined points are assigned to a single image identification information in FIG. Area information is associated.

  In FIG. 16, a user ID (Identification) is shown as an example of the user identification information. However, if the user can be specified, the user ID is not necessary. For example, the user identification information includes employee numbers, student ID numbers, national numbers based on the national gross number system, and the like. In FIG. 16, an image ID is shown as an example of the image identification information. However, if the image data can be specified, it is not necessary to be an image ID. For example, the image identification information includes the file name of the image data.

(Each functional configuration of the specified area management system)
Next, each functional configuration of the predetermined area management system 5 will be described in detail with reference to FIGS. 14 and 15.

  The transmission / reception unit 51 of the predetermined area management system 5 is realized mainly by the processing of the network I / F 509 and the CPU 501 shown in FIG. 14, and is connected to the communication terminal 3 or the image management system 7 via the communication network 9. Send and receive data (or information).

  The determination unit 52 is realized mainly by the CPU 501 shown in FIG. 14, and uses the attention point AP (an example of the second position) indicated by the predetermined area information newly requested to determine whether registration is possible as the center of gravity. It is determined whether or not an attention point (an example of a first position) indicated by predetermined position information that has already been registered is included in the area to be processed. The region in this case is a rectangular parallelepiped (including a cube) having the center of gravity as the point of interest AP (an example of the second position).

  The calculation unit 54 is realized mainly by the CPU 501 illustrated in FIG. 14, and the point of interest AP (an example of the second position) indicated by the predetermined region information received by the transmission / reception unit 51 and the predetermined region management table. The distance from the point of interest AP (an example of the first position) indicated by the predetermined area information stored in (see FIG. 16) is calculated. In particular, the calculation unit 54 determines whether or not only the attention point (an example of the first position) determined by the determination unit 52 to be included in the region is between the attention point (an example of the second position). Calculate the distance.

  The storage / extraction unit 59 stores various data (or information) in the storage unit 5000 and extracts various data (or information) from the storage unit 5000. If the distance calculated by the calculation unit 54 is equal to or less than a predetermined distance, the predetermined area information already registered (an example of the first predetermined area information) is already stored in the predetermined area management table (FIG. 16). Therefore, the predetermined area information (an example of the second predetermined area information) newly requested to determine whether or not to register can not be stored in the predetermined area management table. In this case, the storage / extraction unit 59 has the predetermined area information (first predetermined area information) that causes the registration of the predetermined area information (an example of the second predetermined area information) to be rejected in the predetermined area management table. In contrast, the registration rejection number is increased by one. The storage / extraction unit 59 in this case is an example of a storage processing unit.

<Functional configuration of image management system>
Next, the functional configuration of the image management system 7 will be described in detail with reference to FIGS. 14 and 15. The image management system 7 includes a transmission / reception unit 71, a creation unit 73, and a storage / extraction unit 79. Each of these units is a function realized by any one of the constituent elements shown in FIG. 14 operating according to a command from the CPU 501 according to the program for the image management system 7 expanded from the HD 504 onto the RAM 503. Or means.

  In addition, the image management system 7 includes a storage unit 7000 constructed by the RAM 503 and the HD 504 shown in FIG. The storage unit 7000 includes an image management DB 7001 configured by an image management table to be described later, a party management DB 7002 configured by a party management table, an album management DB 7003 configured by an album management table, and an in-album An in-album image management DB 7004 configured by the image management table is constructed.

(Image management table)
FIG. 17 is a conceptual diagram showing an image management table. This image management table includes user identification information for identifying a user, a user name, image identification information for identifying an image, and a URL (Uniform Resource) that is a storage location of image data related to the image identification information in the storage unit 7000. URL information indicating Locator), attribute information, comment ID for identifying a comment by the user, comment content (text data), and posting date of the comment are managed in association with each other.

  Note that the user identification information and the image identification information shown in FIG. 17 have the same concept as the user identification information and the image identification information shown in FIG.

(Stakeholder management table)
FIG. 18 is a conceptual diagram showing a related party management table. In this party management table, user identification information for identifying users belonging to this group is managed in association with each group such as friends. In addition, as an example of a related person, a friend, a family, the employee of the same company, etc. are mentioned. The user identification information shown in FIG. 18 has the same concept as the user identification information shown in FIG.

(Album management table)
FIG. 19 is a conceptual diagram showing an album management table. In this album management table, a user name and album identification information are associated and managed for each user identification information. Note that the user identification information shown in FIG. 19 has the same concept as the user identification information shown in FIG. As an example of album identification information, FIG. 20 shows an album ID.

(Image management table in album)
FIG. 20 is a conceptual diagram showing an in-album image management table. In this in-album image management table, the album name and the image identification information of the image data included in the album are managed in association with each album identification information. Note that the album identification information shown in FIG. 20 has the same concept as the album identification information shown in FIG. Further, the image identification information shown in FIG. 20 has the same concept as the image identification information shown in FIG.

(Each functional configuration of the image management system)
Next, each functional configuration of the image management system 7 will be described in detail with reference to FIG.

  The transmission / reception unit 71 of the image management system 7 is realized mainly by the processing of the network I / F 509 and the CPU 501 shown in FIG. 14, and is connected to the communication terminal 3 or the predetermined area management system 5 via the communication network 9. Send and receive data (or information).

  The management unit 72 assigns image identification information to the image data in order to manage the image data sent from the communication terminal 3 by the image management system 7, and assigns the image identification information to the header portion of the image data. To do.

  The creation unit 73 creates an image object, a related party list object, an album object, and an in-album image object. Each of these objects will be described later.

  The storage / extraction unit 79 stores various data (or information) such as image data in the storage unit 7000 and extracts various data (or information) such as image data from the storage unit 5000.

<< Processing or Operation of Embodiment >>
Next, a process in which the user A uploads image data using the communication terminal 3a will be described with reference to FIGS. FIG. 21 is a sequence diagram illustrating processing for uploading a captured image. FIG. 22 shows an image object.

  Note that the communication protocol via the communication network 9 between the communication terminal 3, the predetermined area management system 5, and the image management system 7 is HTTP communication based on the hypertext communication protocol (HTTP). The communication terminal 3a corresponds to an HTTP client, and the predetermined area management system 5 and the image management system 7 correspond to an HTTP server.

  Hereinafter, unless otherwise specified, the arrows from the communication terminal 3a to the predetermined area management system 5 and the image management system 7 in each sequence diagram correspond to HTTP requests, and from the predetermined area management system 5 and the image management system 7 to the communication terminal 3a. The arrow to indicates an HTTP response.

  First, the user A captures image data from the photographing apparatus 1 into the storage unit 3000 of the communication terminal 3a.

  Next, when the user A selects image data to be uploaded, the operation input reception unit 32 of the communication terminal 3a receives selection of the image data to be uploaded (step S1). Then, the transmission / reception unit 31 of the communication terminal 3 a sends the image data including the user identification information of the user A, the user name of the user A, and attribute information to the image management system 7 via the communication network 9, and a file of the image data By transmitting the name data, the image data is uploaded (step S2). As a result, the transmission / reception unit 71 of the image management system 7 receives the user identification information, the user name, the image data, and the file name data.

  Next, the management unit 72 of the image management system 7 assigns image identification information to the image data so that the image management system 7 manages the image data sent from the communication terminal 3a. Image identification information is given to the header portion (step S3).

  Next, the storage / extraction unit 79 stores and manages each data (excluding image data) received in step S2 and the image identification information given in step S3 in the image management table (see FIG. 17). At the same time, the image data is stored and managed in the storage unit 7000 (step S4).

  Next, the creating unit 73 creates an image object as shown in FIG. 22 based on the image management table managed in step S4 (step S5). This image object includes image identification information, file name, URL information, and attribute information included in the image data. Of these, the URL information indicates the location of the storage unit 7000 where the image data is stored. Then, the transmission / reception unit 71 transmits the image object data to the communication terminal 3a via the communication network 9 (step S6). Thereby, the transmission / reception unit 31 of the communication terminal 3a receives the data of the image object.

  Next, the transmission / reception unit 31 of the communication terminal 3a transmits the user identification information and image identification information of the image object received in step S6 to the management system 5 via the communication network 9 (step S7). Thereby, the transmission / reception unit 51 of the predetermined area management system 5 receives the user identification information and the image identification information.

  Next, the storage / extraction unit 59 of the predetermined area management system 5 associates the user identification information and the image identification information received in step S7, and newly stores and manages them in the predetermined area management table (see FIG. 16). (Step S8). Then, the transmission / reception unit 51 transmits the image identification information together with the result indicating that the management of the user identification information and the image identification information is completed to the communication terminal 3a via the communication network 9 (step S9). Thus, a series of image data upload processing is completed.

  Next, a process of posting a predetermined area (including a point of interest) as a comment on the image data uploaded by the user A to the image management system 7 will be described with reference to FIGS. FIG. 23 is a sequence diagram showing processing for posting a predetermined area as a comment to the image management system. FIG. 24 shows the contents of the image object.

  First, the user A accesses the image management system 7 through the communication terminal 3a, acquires and browses the image data managed in step S5, and then performs a process of posting a comment on the image data. The operation input reception unit 32 of the communication terminal 3a receives a posted comment (step S21). In this case, the user A inputs a URI of a predetermined area image (partial image P1) including the attention point AP1 as shown in FIG. 11 and a thumbnail of the predetermined area image as comments.

  Next, the transmission / reception unit 31 of the communication terminal 3a transmits the image acceptance information received in step S21 and the image identification information of the image data to which the comment is attached to the image management system 7 via the communication network 9 (step S22). ). As a result, the transmission / reception unit 71 of the image management system 7 receives the comment and the image identification information.

  Next, the storage / extraction unit 79 of the image management system 7 adds the record part of the image identification information managed in the image management table (see FIG. 17) based on the comment and the image identification information received in step S22. The comment ID, the comment content, and the posting date of the comment are stored and managed (step S23). The comment ID is an ID given by the image management system 7 when the comment content is managed in step S23.

  Next, the creating unit 73 creates a comment object as shown in FIG. 24 based on the various information managed in step S23 (step S24). The comment object data includes a URI of a predetermined area, a comment ID in the image management system 7, a user name and user identification information of the user A, a character string in the posted comment, and a comment posted (created). Date and time is included. As a result, a comment is posted.

  Then, the transmission / reception unit 71 transmits the comment object data to the communication terminal 3a via the communication network 9 (step S25). Thereby, the transmission / reception unit 31 of the communication terminal 3a receives the data of the comment object.

  Here, in this state, as described above, as shown in FIG. 39, the comment is only associated with the image 1000 in one direction. Therefore, a process for associating the image 1000 and the comment 1001 bidirectionally will be described next with reference to FIGS. 25 and 26. FIG. 25 is a sequence diagram showing processing for registering a predetermined area in the predetermined area management system 5. FIG. 26 is a diagram showing the contents of the predetermined area object.

  First, when the user A selects predetermined area information to be registered in the predetermined area management system 5, the operation input reception unit 32 of the communication terminal 3a receives selection of the predetermined area information to be registered (step S41). The transmission / reception unit 31 of the communication terminal 3a transmits the image identification information received in step S25, the user identification information of the user A, and the predetermined area information to the image management system 7 via the communication network 9. Then, it is requested to determine whether or not the predetermined area information can be registered (step S42). As a result, the transmission / reception unit 71 of the image management system 7 receives the image identification information, the user identification information, and the predetermined area information.

  Next, the predetermined area management system 5 performs a process of determining whether registration is possible (step S43). Details of step S43 will be described later.

  And the transmission / reception part 51 transmits the judgment result of the said step S43 to the communication terminal 3b via the communication network 9 (step S44). Thereby, the transmission / reception unit 31 of the communication terminal 3b receives the determination result. This determination result includes three pieces of information (image identification information, user identification information, and predetermined area information) sent to the predetermined area management system 5 in step S42.

  If the determination result indicates “registration permitted”, the transmission / reception unit 31 of the communication terminal 3b sends the image identification information received in step S44 and the predetermined information to the image management system 7 via the communication network 9. By transmitting the region information, registration of the predetermined region information is requested (step S45). Thereby, the transmission / reception unit 71 of the image management system 7 receives the image identification information and the predetermined area information. If the determination result indicates “registration refusal”, the processes in steps S45 to S48 are not performed.

  Next, the storage / extraction unit 59 of the predetermined area management system 5 is managed together with the user identification information in the predetermined area management table (see FIG. 16) based on the image identification information and the predetermined area information received in step S45. The predetermined area information is stored and registered in the record portion of the image identification information (step S46).

  Next, the creation unit 53 creates a predetermined area object as shown in FIG. 26 based on the information of the predetermined area management table (see FIG. 16) (step S47). The data of the predetermined area object includes predetermined area information (coordinate x, coordinate y, angle of view α) and image identification information.

  Then, the transmission / reception unit 51 transmits the data of the predetermined area object to the communication terminal 3a via the communication network 9 (step S48). Thereby, the transmission / reception part 31 of the communication terminal 3a receives the data of the predetermined area object.

  Next, with reference to FIG. 27 to FIG. 30, a process from User B requesting a participant list using the communication terminal 3 b to displaying an image list will be described. FIG. 27 is a sequence diagram showing processing from when an interested party list is requested until an image list is displayed. FIG. 28 is a diagram showing a related party list displayed on the display. FIG. 29 is a diagram showing an album list displayed on the display. FIG. 30 is a diagram showing an image list displayed on the display.

  First, when the user B performs an operation of requesting a related party list of the user B by the communication terminal 3b, the operation input receiving unit 32 of the communication terminal 3b receives a request for the related party list (step S61). Then, the transmission / reception unit 31 of the communication terminal 3b requests the related list object of the user B by transmitting the user identification information of the user B to the image management system 7 via the communication network 9 (step S62). As a result, the transmission / reception unit 71 of the image management system 7 receives the user identification information.

  Next, the storage / extraction unit 79 of the image management system 7 searches the related person management table (see FIG. 18) using the user identification information of the user B received in step S62 as a search key, so that the user B's By extracting all the user identification information in the record including the user identification information, and further searching the album management table (see FIG. 19) using each of the extracted user identification information as a search key, the corresponding user Name data is extracted (step S63). Then, the creation unit 73 creates an unillustrated party object based on all the user identification information and user names extracted in step S63 (step S64).

  Next, the transmission / reception unit 71 transmits the data of the party object to the communication terminal 3b via the communication network 9 (step S65). Thereby, the transmission / reception part 31 of the communication terminal 3b receives the data of a participant object.

  Next, the display control unit 34 of the communication terminal 3b displays a related party list as shown in FIG. 28 on the display 315 based on the related party object, so that the related party is displayed to the user B. Is prompted (step S66).

  Next, when the user B selects the user A (here, “James”) by the communication terminal 3b, the operation input reception unit 32 of the communication terminal 3b receives the selection of the person concerned (step S67). Then, the transmission / reception unit 31 of the communication terminal 3b requests the user A's album object by transmitting the user identification information of the user A to the image management system 7 via the communication network 9 (step S68). As a result, the transmission / reception unit 71 of the image management system 7 receives the user identification information.

  Next, the storage / extraction unit 79 of the image management system 7 searches the album management table (see FIG. 19) by using the user identification information of the user A received in step S68 as a search key, so that the user A's user By extracting all the user identification information in the record including the identification information, and further searching the in-album image management table (see FIG. 20) using the extracted album identification information as a search key, it is possible to respond. Album name data is extracted (step S69). Then, the creation unit 73 creates an album object (not shown) based on all the album identification information and album name extracted in step S69 (step S70).

  Next, the transmitting / receiving unit 71 transmits the album object data to the communication terminal 3b via the communication network 9 (step S71). Thereby, the transmission / reception unit 31 of the communication terminal 3b receives the data of the album object.

  Next, the display control unit 34 of the communication terminal 3b displays the album list as shown in FIG. 29 on the display 315 based on the album object, so that the user B can select an album. Prompt (step S72).

  Next, when the user B selects an album name (here, “album 11”) by the communication terminal 3b, the operation input reception unit 32 of the communication terminal 3b receives the selection of the album (step S73). Then, the transmission / reception unit 31 of the communication terminal 3b requests the in-album image object by transmitting the album identification information of the album 11 to the image management system 7 via the communication network 9 (step S74). Thereby, the transmission / reception unit 71 of the image management system 7 receives the album identification information.

  Next, the storage / extraction unit 79 of the image management system 7 searches the in-album image management table (see FIG. 20) using the album identification information received in step S74 as a search key, thereby identifying the album of the album 11. All the image identification information in the record including the information is extracted, and the corresponding URL information is extracted by searching the image management table (see FIG. 17) using the extracted image identification information as a search key. Further, the metadata of the image data managed in the storage unit 7000 is extracted with the extracted URL information (step S75). Then, the creation unit 73 creates an in-album image object (not shown) based on the metadata of the image data extracted in step S75 (step S76). Note that the metadata includes the thumbnail of the image data and the shooting date / time of the image, as described above.

  Next, the transmission / reception unit 71 transmits the image object data in the album to the communication terminal 3b via the communication network 9 (step S77). As a result, the transmission / reception unit 31 of the communication terminal 3b receives the data of the image object in the album.

  Next, the display control unit 34 of the communication terminal 3b displays the image list as shown in FIG. 30 on the display 315 based on the in-album image object, so that the album 11 is displayed to the user B. The user is prompted to select the image data (step S78). In the image list IL shown in FIG. 30, thumbnails, shooting dates, and shooting times of each image data are displayed.

  Subsequently, using FIG. 31 to FIG. 33, the user B obtains image data using the communication terminal 3b, and on the display 315 as shown in FIGS. 11 (a) and 11 (b). A process until image data, a point of interest, a predetermined area including the point of interest, and a thumbnail are displayed will be described. FIG. 31 is a sequence diagram showing processing from when image data is acquired by the communication terminal 3b until image data, a point of interest, a predetermined area including the point of interest, and a thumbnail are displayed on the display 315. FIG. 32 shows the contents of the image object. FIG. 33 is a diagram showing the contents of objects in the predetermined area list.

  First, when the user B performs an operation of requesting image data by selecting a desired thumbnail from the thumbnails illustrated in FIG. 30, the operation input reception unit 32 of the communication terminal 3 b causes the desired image to be displayed. A request for data is received (step S81). Then, the transmission / reception unit 31 of the communication terminal 3b requests the image object by transmitting the image identification information of the desired image data to the image management system 7 via the communication network 9 (step S82). Thereby, the transmission / reception unit 71 of the image management system 7 receives the image identification information.

  Next, the storage / extraction unit 79 of the image management system 7 searches the image management table (see FIG. 17) using the image identification information received in step S82 as a search key, whereby the image identification information, the file name, URL information, attribute information included in image data, ID of comment in image management system 7, user name and user identification information of user A, posted comment content, date and time when comment was posted (created) Is extracted (step S83). Then, the creation unit 73 creates an image object including a comment object as shown in FIG. 32 based on the various types of information extracted in step S83 (step S84). This image object is data in which the image object shown in FIG. 22 and the comment object shown in FIG. 24 are combined.

  Next, the transmitting / receiving unit 71 transmits image object data to the communication terminal 3b via the communication network 9 (step S85). Thereby, the transmission / reception unit 31 of the communication terminal 3b receives the data of the image object.

  Subsequently, the transmission / reception unit 31 of the communication terminal 3b requests the image data by transmitting the URL information acquired in step S85 to the image management system 7 via the communication network 9 (step S86). Thereby, the transmission / reception unit 71 of the image management system 7 receives the URL information.

  Next, the storage / extraction unit 79 of the image management system 7 extracts the corresponding image data by searching the storage unit 7000 using the URL information received in step S86 as a search key (step S87). Then, the transmission / reception unit 71 transmits the image data to the communication terminal 3b via the communication network 9 (step S88). Thereby, the transmission / reception part 31 of the communication terminal 3b receives image data.

  Subsequently, the transmission / reception unit 31 of the communication terminal 3b transmits the same image identification information as the image identification information transmitted in step S82 to the predetermined area management system 5 via the communication network 9, thereby obtaining a list of predetermined areas. A request is made (step S89). Thereby, the transmission / reception unit 51 of the predetermined area management system 5 receives the image identification information.

  Next, the storage / extraction unit 59 of the predetermined area management system 5 searches the predetermined area management table (see FIG. 16) using the image identification information received in step S89 as a search key, thereby corresponding corresponding area information. Is extracted (step S90). Then, the creation unit 53 creates a predetermined area list object as shown in FIG. 33 based on the predetermined area information extracted in step S90 (step S91). In the predetermined area list object, the captured image is associated with a predetermined area including a target point set for the captured image. In addition, when a plurality of attention points are set, a single captured image is associated with a plurality of predetermined areas including each of the plurality of attention points.

  Next, the transmitting / receiving unit 51 transmits the data of the predetermined area list object to the communication terminal 3b via the communication network 9 (step S92). As a result, the transmission / reception unit 31 of the communication terminal 3b receives the data of the predetermined area list object.

  Next, the display control unit 34 of the communication terminal 3b displays a predetermined area image (partial image P) on the display 315, as shown in FIG. 9, based on the image data received in step S88. (Step S93).

  Next, the creating unit 33 creates a thumbnail of each predetermined area image based on the image data received in step S88 and the predetermined area list object received in step S92 (step S94). Then, the display control unit 34 displays the thumbnail created in step S94 as a thumbnail T1 as shown in FIG. 11A (step S95).

  Finally, the display control unit 34 displays the attention point AP1 as shown in FIG.

  Next, the process of step S43 in FIG. 25 will be described in detail with reference to FIGS. 15 and 34 to 37. FIG. 34 is a conceptual diagram showing each point of interest on the solid sphere. In the present embodiment, as shown in FIG. 34, when each predetermined area information indicating the attention point (AP11, AP12, AP13) is already registered in the predetermined area management table (see FIG. 16). A case will be described in which a new determination is made as to whether or not the predetermined area information indicating the attention point AP14 can be registered. Note that the attention points (AP11, AP12, AP13) are an example of the first position, and the attention point AP14 is an example of the second position. Each predetermined area information indicating the attention point (AP11, AP12, AP13) is an example of first position information, and the predetermined area information indicating the attention point AP14 is an example of second position information.

  First, as shown in FIG. 36, the creation unit 53 shown in FIG. 15 includes the components (x, x, x) in the three-dimensional coordinates of the predetermined area information (attention point AP14) requested to be registered. A query (here, “virtual rectangular parallelepiped”) having a range extending from the center of gravity to x ± L, y ± L, and α ± kL is created using y, α) as the center of gravity (step S43-1).

  Note that “L” is a value predetermined by the administrator or manufacturer of the predetermined area management system 5 and can be derived from the above equation (1). That is, when the above equation (1) is modified, the following equation is obtained.

L = 1 / f · tan (α / 2)
Note that L varies with the distance f. That is, the diagonal field angle 2L is small (that is, the sphere is small) near the virtual camera IC, and the diagonal field angle 2L is large (that is, the sphere is large) when the focal length f is large. This principle is the same as the relationship between the image sensor (virtual camera IC) of the digital camera and the subject (attention point AP). “K” is a constant, and when k = 1, the virtual rectangular parallelepiped is a virtual cube.

  In FIG. 36, a virtual cube whose side is 2L is shown for ease of explanation. FIG. 36 is a conceptual diagram showing the primary narrowing process. FIG. 37 is a conceptual diagram showing the secondary narrowing process.

Next, as shown in FIG. 36, the storage / extraction unit 59 stores all the attention points AP included in the virtual cube centered on the attention point AP14 with respect to the predetermined area management table (see FIG. 16). (Predetermined area information) is searched (step S43-2). More specifically, the storage / extraction unit 59 adds ± L to each component (x ₁₄ , y ₁₄ , α ₁₄ ) in the three-dimensional coordinates of the target point AP ₁₄ (x ₁₄ ± L, y ₁₄ +/- L, α ₁₄ +/- L), the point of interest AP (predetermined area information) in which all the components (x, y, α) are all included is determined from the predetermined area management table (see FIG. 16). Extract. For example, when the component of the attention point AP14 is (x = 100, y = 100, α = 34) and L = 50, x ± L = 50 to 150, y ± L = 50 to 150, α ± L = Attention points AP having all the constituent elements included in the ranges of −26 to 84 are extracted from the predetermined area management table.

  Next, the determination unit 52 determines whether or not there is another attention point AP (attention point AP other than the attention point AP serving as the center of gravity) in the virtual cube (step S43-3). If there is no other attention point AP in the virtual cube (NO), no attention point AP that has already been registered is close to the attention point AP14 that is requested to be registered. Therefore, the determination unit 52 permits registration of the attention point AP14 (step S43-4). On the other hand, if at least one other attention point AP exists in the virtual cube in step S43-3 (YES), the process proceeds to the next step S43-5. Note that steps S43-1 to S43-3 are primary narrowing processing. Here, the case where the attention point AP12 and the attention point AP13 are included in the virtual rectangular parallelepiped IR, but the attention point AP11 is not included will be described.

  As shown in FIG. 37, the creation unit 53 uses the component (x, y, α) in the three-dimensional coordinates of the predetermined area information (attention point AP14) requested to be registered as a center of gravity as the center of gravity. An L virtual sphere IS is created (step S43-5).

  Next, the determination unit 53 determines whether or not the target point (AP12, AP13) narrowed down by the primary narrowing process is included in the virtual sphere IS. More specifically, the calculation unit 54 determines the position in the three-dimensional coordinates of the attention point AP14 for which the registration permission determination is requested, and the three-dimensional coordinates of the attention points (AP12, AP13) narrowed down in the primary narrowing-down process. The distance (L2, L3) between each position in is calculated (step S46-6). Then, the determination unit 53 determines whether or not the calculated distance (L2, L3) is equal to or less than a predetermined distance L (step S43-7). The distances (L2, L3) are derived by the following equation (2).

L2 (L3) = | Δx, Δy, kΔα | (2)
Δx, Δy, and Δα are the components of the already registered three-dimensional coordinates of the target point AP12 and the three-dimensional coordinates of the three-dimensional coordinates of the target point AP14 that is newly requested to be registered. Indicates the difference. The attention point AP13 is also handled in the same manner as the attention point AP12.

  Next, if the distances (L2, L3) are not less than or equal to the predetermined distance L by the process of step S43-7 (NO), the registered points of interest AP are registered. Since there is nothing close to the target point AP14 for which the determination of availability is requested, the determination unit 52 permits the registration of the target point AP14 as in the process of step S43-4.

  On the other hand, if the distance (L2, L3) is equal to or less than a predetermined distance by the process of step S43-7, a determination as to whether or not to register among the points of interest AP already registered is requested. Since there is something close to the attention point AP14, the determination unit 52 rejects registration of the attention point AP14 (step S43-8). Here, as shown in FIG. 37, the case where the attention point AP12 is not included in the virtual sphere IS but the attention point AP13 is included will be described.

  If the attention point AP14 is not registered because the attention point AP13 has already been registered, the storage / extraction unit 59 causes the registration of the attention point 14 to be rejected in the predetermined area management table (see FIG. 16). The registration rejection number is increased by one for the predetermined area information indicating the attention point 13 that has become. Thereby, for example, the administrator of the predetermined area management system 5 can obtain an effect that the attention point AP having a large number of registration refusals can be recognized as being noticed by various users.

  Thus, the process of step S43 illustrated in FIG. 25 ends.

<< Main effects of this embodiment >>
As described above, according to the present embodiment, the determination unit 52 has already registered an attention point (in the virtual rectangular parallelepiped region having the center of gravity as the attention point AP14 for which a determination of whether or not registration is required ( By determining whether or not AP11, AP12, and AP13) are included, primary narrowing down is performed. As a result, it is not necessary to calculate the distance between the two points of interest as in the second-order narrowing down, and as shown in the process of step S43-2, within the numerical range (x ₁₄ ± L, y ₁₄ ± Since it is only necessary to search for each numerical value (x, y, α) included in L, α ₁₄ ± L), it is possible to perform primary narrowing in a relatively short time compared to secondary narrowing (secondary retrieval). There is an effect that can be done.

  Note that the primary narrowing (primary search) narrows down in a relatively short time by using the characteristic that the point of interest AP is represented by a relational database using a predetermined area management table as shown in FIG. Is going.

  In addition, after the primary narrowing down, the calculation unit 54 specifically calculates the distance between two points of interest, and if the distance is less than a predetermined distance, registration is rejected and the predetermined distance is exceeded. Registration is permitted. As a result, as shown in FIG. 10A, the attention points AP displayed on the display 315 are close to each other, so that the problem that it is difficult for the user to understand can be solved.

  Further, the predetermined area management system 5 stores the image identification information and the predetermined area information in association with each other (see FIG. 16), and transmits the predetermined area information corresponding to the image identification information received from the communication terminal 3 to the communication terminal. By doing so (see step S92 in FIG. 31), the communication terminal 3 can display the image data and the predetermined area image in association with each other (see FIG. 11A).

[Supplement of Embodiment]
In the above embodiment, as shown in FIG. 35, the secondary narrowing is performed after the primary narrowing, but the present invention is not limited to this. For example, the primary narrowing may be omitted and only the secondary narrowing may be performed. In this case, the calculation unit 54 calculates the distance from the attention point AP for which registration is newly determined for all the attention points AP already registered in the predetermined area management table (see FIG. 16). .

  Further, in the above embodiment, after a request for determining whether or not the predetermined area information (attention point AP) can be registered is made at step S42, a request for registration of the predetermined area information (attention point AP) is made at step S45. However, it is not limited to this. For example, if a registration request is suddenly made in step S42 in step S42 and registration is permitted in step S43, the permitted predetermined area information (attention point AP) is stored in the predetermined area management table. May be additionally registered.

  Furthermore, in the above embodiment, as shown in FIGS. 36 and 37, the position of the attention point AP in the three-dimensional coordinate system is calculated as an example of the multi-dimensional coordinate system. However, the present invention is not limited to this. Absent. For example, the position of the point of interest AP in the two-dimensional coordinate system (x, y) may be calculated as an example of a multi-dimensional coordinate system by fixing the angle of view α. In this case, the area centered on the point of interest AP14 indicated by the predetermined area information that is newly requested to be registered is a rectangle (including a square).

  Furthermore, the predetermined area management system 5 and the image management system 7 in the above embodiment may be constructed by a single computer, or each unit (function, means, or storage unit) is divided and arbitrarily assigned. It may be constructed by a plurality of computers.

  In addition, a recording medium such as a CD-ROM in which the programs of the above-described embodiments are stored, and the HD 504 in which these programs are stored may be provided domestically or abroad as a program product. it can.

DESCRIPTION OF SYMBOLS 1 Image pick-up device 3a Communication terminal 3b Communication terminal 5 Predetermined area management system 7 Image management system 9 Communication network 9a Base station 9b Base station 31 Transmission / reception part 32 Operation input reception part 33 Creation part 34 Display control part 35 Acquisition part 38 Image processing part 39 Storage / extraction unit 51 Transmission / reception unit (an example of transmission means, an example of reception means)
52 Judgment Unit (Example of Judgment Unit)
53 Creation unit (an example of creation means)
54 Calculation unit (an example of calculation means)
59 Storage / Extraction Unit (an example of storage processing means)
71 Transmission / Reception Unit 72 Creation Unit 79 Storage / Extraction Unit 315 Display 3000 Storage Unit 5000
5001 Predetermined area management DB (an example of storage means)
7000 storage unit 7001 image management DB

JP 2011-120201 A

Claims (7)

A predetermined area management system capable of communicating with a communication terminal,
Storage means for storing first predetermined area information indicating a first position in a three-dimensional coordinate system of image data;
Receiving means for receiving second predetermined area information transmitted from the communication terminal and indicating a second position of the image data in the three-dimensional coordinate system ;
Calculate the distance between the second position indicated by the second predetermined area information received by the receiving means and the first position indicated by the first predetermined area information stored in the storage means Calculation means to
If the distance calculated by the calculating means is equal to or less than a predetermined distance, the second predetermined area information is not stored in the storage means, and the distance calculated by the calculating means is determined in advance. A storage processing unit for storing the second predetermined area information in the storage unit when the distance exceeds a predetermined distance;
A predetermined area management system comprising: The predetermined area management system according to claim 1, further comprising:
Determining means for determining whether or not the first position indicated by the first predetermined area information is included in an area having the second position indicated by the second predetermined area information as a center of gravity;
The predetermined area management system characterized in that the calculation means calculates a distance between the second position and only the first position determined to be included in the area by the determination means. .   When the distance calculated by the calculating means is equal to or less than a predetermined distance, the storage processing means has the first predetermined area information already stored for the first predetermined area information. 3. The predetermined area management system according to claim 1, wherein information indicating that the second predetermined area information cannot be stored in the storage unit is associated and stored. 4. The predetermined area management system according to claim 3 , wherein the area having the center of gravity of the second position is a rectangular parallelepiped having the center of gravity of the second position. The predetermined area management system according to any one of claims 1 to 4, wherein the three-dimensional coordinate system is represented by a polar coordinate system. A predetermined area management method executed by a predetermined area management system capable of communicating with a communication terminal and having storage means for storing first predetermined area information indicating a first position in a three-dimensional coordinate system of image data,
The predetermined area management system includes:
A reception step of receiving second predetermined region information transmitted from the communication terminal and indicating a second position of the image data in the three-dimensional coordinate system ;
The distance between the second position indicated by the second predetermined area information received by the receiving step and the first position indicated by the first predetermined area information stored in the storage means is calculated. A calculation step to
If the distance calculated by the calculating step is equal to or less than a predetermined distance, the second predetermined area information is not stored in the storage means, and the distance calculated by the calculating step is the predetermined distance. A storage processing step of storing the second predetermined area information in the storage means when the distance exceeds a predetermined distance;
A predetermined area management method comprising: A program that causes a computer to execute the steps according to claim 6 .

Images