JP2016143269A - Content search device, content search method, content storage device and content storage method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a visual content relevant to a subject of a shooting object to be easily searched for.SOLUTION: A content providing device 3 searching for a visual content comprises: a content DB32 in which shooting range information indicative of a shooting range of the visual content is stored in association with the visual content; a search request reception unit 44 that acquires a collection position serving as a reference upon searching therefor, or acquires a collection range indicative of a specific space, and calculates the collection position from the acquired collection range; and a search execution unit 45 that determines whether the collection position is included in the shooting range of the visual content to be stored in the content DB32, and acquires the visual content included in the shooting range from the content DB32.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a content search device, a content search method, a content storage device, and a content storage method used in a service for collecting and distributing visual content such as photographs and videos.

  In recent years, social networking services (SNS: Social Networking Service) for building social connections using the Internet have been advanced. In the SNS, viewers ask for information such as tags (meta information such as #helloween, # mt.fuji, etc.) attached to photos, comments, poster names, and responses (like) from browse names. There are those having a function of providing content (for example, Instagram (registered trademark) and Flickr (registered trademark)) (see FIG. 11). The above-described function realizes a simple search function by using a value explicitly set by a poster or a viewer. Thus, the user can acquire visual content (for example, an image of Mt. Fuji) corresponding to the specified tag by performing a search by specifying a tag (for example, meta information of # mt.fuji). It is.

  Conventionally, the location, direction, and time information of the photo, the location, and the time information are provided from the site, and the location and direction of the past and present photos (tourism, construction site, disaster site) of the past and present on the map. A system that provides a viewer with a format that can be seen at a glance has been developed (see Patent Document 1). As a result, it is possible to search from the past and present positions on the map and in what direction the photographed images are.

JP 2007-52809 A

  However, in the search function of SNS, when a user posts an image, it is necessary to set a tag himself. Therefore, there is a problem that setting a tag is troublesome for a user who posts an image.

  On the other hand, since the technique described in Patent Document 1 searches for a photograph taken from which position and in what direction in the past and present, it is possible to search for a photograph by subject unit. could not. That is, with this technique, since it is not assumed that a photograph is searched for in units of subjects, there is a problem that it is difficult to appropriately specify a slight shift in the position of the subject and the shooting direction.

  The present invention has been made in view of the above problems, and provides a content search device, a content search method, a content storage device, and a content storage method that can easily search visual content related to a subject to be photographed. The issue is to provide.

  In order to solve the above problems, a content search device according to the present invention is a content search device that searches for visual content, and stores shooting range information that indicates a shooting range of the visual content in association with the visual content. And a search request accepting unit that acquires a collection position serving as a reference when searching, or acquires a collection range indicating a specific space, and calculates the collection position from the acquired collection range; A search execution unit that determines whether or not the collection position is included in the shooting range of the visual content stored in the storage unit, and acquires the visual content included in the shooting range from the storage unit. Features.

  By doing so, the content search device according to the present invention stores shooting range information indicating the shooting range of visual content in the storage unit in association with the visual content. Then, when searching for visual content, it is determined whether or not a collection position serving as a reference for searching the visual content shooting range is included using this shooting range information, and the shooting position includes the collection position. Acquire (collect) visual content. Therefore, the content search device according to the present invention can easily search related visual content in units of subjects that have captured the visual content.

  In order to solve the above-described problem, the content search device according to the present invention is configured such that the shooting range information stored in the storage unit includes a shooting position, a shooting distance, a shooting direction, and a field angle of the visual content. The search execution unit calculates whether the relative distance from the shooting position to the collection position is within the shooting distance, and the relative direction from the shooting position to the collection position is the shooting position. It is characterized in that it is determined whether or not the collection position is included in the shooting range of the visual content by calculating whether it is within the width.

  In this way, the content search device according to the present invention stores in the storage unit information indicating the shooting width including the shooting position, shooting distance, shooting direction, and angle of view of the visual content in association with the visual content. Keep it. Then, when searching for visual content, it is determined whether or not a collection position serving as a reference for searching in the shooting range of visual content is included using these pieces of information, and a visual position in which the shooting position is included in the shooting range is determined. Acquire (collect) content. Therefore, the content search device according to the present invention can easily search related visual content in units of subjects that have captured the visual content.

  Further, the content search device according to the invention acquires the visual content and the shooting range information stored in the storage unit, the shooting range information indicating the visual content and the shooting range of the visual content, or the A storage execution unit that acquires visual content and shooting device information of a shooting device that has shot the visual content, and stores the shooting range information from the acquired shooting device information to store in the storage unit; It is characterized by.

  By doing in this way, the content search device according to the present invention can acquire shooting range information used for visual content search from Exif data. Therefore, the shooting range information can also be acquired by posting the content.

  The content storage device according to the present invention is a content storage device that stores visual content, a storage unit that stores the visual content in association with partition information indicating a preset partition, and the visual Shooting range information indicating the shooting range of the content and the visual content is acquired, or shooting device information of the shooting device that shot the visual content and the visual content is acquired, and the shooting range is acquired from the acquired shooting device information. A storage execution unit that calculates information, calculates a section including the shooting range from the sections stored in the storage unit, and stores the visual content in the storage unit in association with the section; It is characterized by providing.

  In this way, the content storage device according to the present invention specifies the shooting range of each visual content when storing the visual content, and stores the visual content in association with the section including the shooting range. That is, the content storage device according to the present invention performs processing in advance using the shooting range information so that visual content related to a subject can be easily narrowed down when searching for visual content that is a precondition for search. Keep going. Therefore, the time required for the visual content search process can be shortened compared to the case where the shooting range is specified at the time of search.

  In the content storage device according to the present invention, the section information stored in the storage unit includes a section reference position serving as a reference for specifying the section, and the shooting range information includes the visual content. Information indicating an imaging width including an imaging position, an imaging distance, an imaging direction and an angle of view, and the storage execution unit determines whether a relative distance from the imaging position to the section reference position is within the imaging distance. And calculating whether the relative range from the photographing position to the section reference position is within the photographing width, thereby calculating the section including the photographing range. .

  In this way, the content storage device according to the present invention specifies the shooting range of each visual content from the information indicating the shooting width including the shooting position, shooting distance, shooting direction, and angle of view when storing the visual content. The visual content is stored in association with the section including the shooting range. Therefore, the time required for the visual content search process can be shortened compared to the case where the shooting range is specified at the time of search.

  In addition, the content storage device according to the invention acquires a collection position serving as a reference for the search, or acquires a collection range indicating a specific space, and calculates the collection position from the acquired collection range A request receiving unit; and a search execution unit that determines the section including the collection position and acquires the visual content corresponding to the section determined to be included from the storage unit.

  By doing so, the content storage device according to the present invention acquires (collects) visual content corresponding to a section determined to include a reference collection position when searching for visual content. Therefore, it is possible to easily search for related visual contents in units of subjects that have taken visual contents.

  According to the content search device, the content search method, the content storage device, and the content storage method according to the present invention, it is possible to easily search for visual content related to a subject that is a photographing target.

It is a block diagram of the content provision system which concerns on 1st Embodiment. It is a figure which shows the information which the content provision apparatus which concerns on 1st Embodiment has, (a) is a data block diagram of collection range DB, (b) is a data block diagram of content DB. It is a figure for demonstrating the process of the search execution part of the content provision apparatus which concerns on 1st Embodiment. It is a sequence diagram which shows operation | movement of the content provision system which concerns on 1st Embodiment. It is a figure for demonstrating the effect of the content provision system which concerns on 1st Embodiment. It is a block diagram of the content provision system which concerns on 2nd Embodiment. It is a figure which shows the information which the content provision apparatus which concerns on 2nd Embodiment has, (a) is a data block diagram of imaging | photography division DB, (b) is a data block diagram of content DB. It is a figure for demonstrating the process of the storage execution part of the content provision apparatus which concerns on 2nd Embodiment. It is a sequence diagram which shows operation | movement of the content provision system which concerns on 2nd Embodiment. It is a figure for demonstrating the effect of the content provision system which concerns on a modification. It is a figure for demonstrating the conventional content provision system.

[Overview]
The present invention acquires shooting range information (eg, shooting position, shooting distance, shooting direction, angle of view, etc.) indicating the shooting range of visual content (still images such as photographs, moving images such as videos) together with the visual content. The visual content related to the subject is narrowed down using the shooting range information.
Specifically, in the first embodiment, when searching, visual content related to a subject is narrowed down using shooting range information. Further, in the second embodiment, processing is performed in advance using shooting range information when visual content that is a precondition for search is stored so that visual content related to the subject can be easily narrowed down during search. .

Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings as appropriate.
Each figure is only schematically shown so that the invention can be fully understood. Therefore, the present invention is not limited to the illustrated example. In the present embodiment, descriptions of configurations not directly related to the present invention and known configurations may be omitted. In addition, in each figure, about the same component or the same component, the same code | symbol is attached | subjected and those overlapping description is abbreviate | omitted.

[First Embodiment]
<< Configuration of Content Providing System According to First Embodiment >>
A content providing system 1 according to the first embodiment will be described with reference to FIG.
The content providing system 1 includes one or more user terminals 2 and a content providing device 3 that is communicably connected to each user terminal 2 via a network NW.

  The content providing system 1 is requested by the user from a storage function for storing visual content posted (transmitted) from the user terminal 2 in the content providing device 3 and a visual content stored in response to a request from the user terminal 2. A search function for providing (replying) a thing to the user terminal 2. Here, the visual content may be a still image such as a photograph, a moving image such as a video, and a time lapse. The content providing system 1 is, for example, a visual content posting type SNS, and will be described here assuming a case where a photograph (image data) is posted as visual content.

<User terminal>
The user terminal 2 is a terminal operated by a contributor (user) who contributes visual content to the content providing device 3 or a viewer (user) who browses visual content posted on the content providing device 3. The user terminal 2 may be, for example, a smartphone (multifunctional mobile phone), a PDA (personal digital assistant), a video camera, or the like.
Here, what is operated by the contributor is “posting user terminal 2a”, and what is operated by the viewer is “viewing user terminal 2b”, and the minimum functions are described. Therefore, the user terminal 2 may include a function of the posting user terminal 2a and a function of the browsing user terminal 2b. Note that if the content providing system stores visual content in advance, the posting-side user terminal 2a for posting visual content may be omitted.

The posting user terminal 2 a includes a touch display 11, a digital camera 12, a GPS receiver 13, a visual content creation unit 21, and a storage request unit 22. Note that the touch display 11 may be configured as separate devices such as a display unit (for example, a liquid crystal monitor) for displaying information and an operation unit (for example, a keyboard or a mouse) for inputting information. Further, as in the case where the digital camera 12 is assumed as the posting-side user terminal 2a, the posting-side user terminal 2a may not have the touch display 11.
The control unit having the visual content creation unit 21 and the storage request unit 22 is realized by, for example, a program execution process by a CPU (Central Processing Unit) provided in the posting-side user terminal 2a, a dedicated circuit, or the like. When realized by the program execution process, a program for realizing the visual content creation unit 21 and the storage request unit 22 is stored in a storage unit (not shown) provided in the posting-side user terminal 2a.

The touch display 11 is, for example, a touch panel laminated on the surface of a display that is a liquid crystal display device. The touch display 11 displays various information to the user and accepts a touch operation input by the operator.
The digital camera 12 incorporates a lens (not shown) and an image sensor (imaging device), refracts light emitted from the subject by the lens, and converts the refracted light into an electrical signal by the image sensor. The digital camera 12 may be a CCD camera or a CMOS camera, for example.
The GPS receiver 13 receives radio waves from GPS satellites and calculates the current position (latitude, longitude, altitude) and time.

  The visual content creation unit 21 creates visual content (for example, JPEG data) from the electrical signal converted by the digital camera 12. Further, the visual content creation unit 21 acquires information, position information, and the like related to the digital camera 12 that is a photographing device that has photographed visual content from the digital camera 12, the GPS receiver 13, and the like, and photographing that is additional information of the visual content. Device information (for example, Exif data) is created. Additional information (for example, Exif data) includes, for example, information about image data (OtfIFD), information about shooting conditions (for example, ExifIFD), information about shooting locations (for example, GPSIFD), thumbnail data obtained by reducing image data, and the like. included. The additional information may be included and stored in the image data.

  The information relating to image data (OtfIFD) includes data items (tags) such as the manufacturer name of the image input device, the model name of the image input device, and the image direction. The information (for example, Exif IFD) related to the imaging condition includes data items (tags) such as a manufacturer note, a lens focal length, lens specification information, a lens manufacturer name, and a lens model name. The information on the shooting location (for example, GPS IFD) includes data items (tags) such as latitude, longitude, altitude, destination latitude, destination longitude, destination direction.

  The storage request unit 22 transmits the visual content (for example, JPEG data) held by itself to the content providing device 3 and imaging device information (for example, Exif data) that is additional information of the visual content. Is requested to be stored (storage request). For example, the storage request unit 22 displays a visual content posting screen on the touch display 11, and issues a storage request for visual content and the like held by the user (contributor) by the visual content posting operation using the posting screen. It transmits to the content providing apparatus 3.

  The browsing-side user terminal 2 b includes a touch display 11, a search request unit 23, and a visual content display unit 24. Here, the control unit including the search request unit 23 and the visual content display unit 24 is realized by, for example, a program execution process by a CPU (Central Processing Unit), a dedicated circuit, or the like. When realized by the program execution process, a program for realizing the search request unit 23 and the visual content display unit 24 is stored in a storage unit (not shown) provided in the browsing-side user terminal 2b. The touch display 11 is the same as that described in the posting-side user terminal 2a.

  The search request unit 23 requests the visual content stored in the content providing apparatus 3 by being posted to the content providing apparatus 3. The search request unit 23 receives a collection position (for example, coordinates (latitude, longitude)) serving as a reference when performing a search, or receives a collection range indicating a specific space. Then, the search request unit 23 transmits the received collection position or collection range to the content providing apparatus 3, and requests a search for visual content corresponding to these pieces of information (search request).

  The search request unit 23 displays a visual content browsing screen on the touch display 11, for example. Then, the search request unit 23 transmits a visual content search request to the content providing apparatus 3 by a visual content browsing operation using a browsing screen by a user (browser). Here, in the browsing operation of visual content by the user (viewer), for example, input of coordinates (latitude, longitude) or input of a collection position by an operation of selecting one point of the map displayed on the touch display 11, Or the input of the collection range by the operation which selects the area | region of the map displayed on the touch display 11 or input of the name and address of facilities, such as a building, is included.

  The visual content display unit 24 displays the visual content provided as a search result from the content providing device 3 on the touch display 11. For example, when a plurality of visual contents are received as search results from the content providing device 3, the visual content display unit 24 displays thumbnails of these visual contents on the touch display 11. When visual content that matches the search condition cannot be received as a search result from the content providing device 3, a message indicating that there is no visual content to be searched is displayed on the touch display 11.

<Content providing device>
The content providing device 3 stores visual content posted in response to a poster (user) storage request, and provides stored visual content in response to a viewer (user) search request. The content providing device 3 may be, for example, a server owned by an administrator who manages a visual content posting type SNS. The content providing device 3 stores a visual content stored in response to a search request from a viewer (user) and a content storage device that stores visual content posted in response to a storage request from a poster (user). You may comprise as a separate apparatus with the content search apparatus to search.

The content providing apparatus 3 includes a collection range DB 31, a content DB 32, a storage request receiving unit 41, a storage executing unit 42, a storage response unit 43, a search request receiving unit 44, a search executing unit 45, and a search response unit. 46.
Here, the collection range DB 31 and the content DB 32 are stored in a storage unit including a storage medium such as a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), and a flash memory. The control unit having the storage request receiving unit 41, the storage executing unit 42, the storage response unit 43, the search request receiving unit 44, the search executing unit 45, and the search response unit 46 is, for example, a content providing device. 3 is realized by a program execution process by a CPU (Central Processing Unit) included in the CPU 3 or a dedicated circuit. When realized by the program execution process, a program for realizing these functions is stored in the storage unit included in the content providing device 3.

  In FIG. 1, the components related to the present invention are described, and the content providing apparatus 3 may have functions other than those described in FIG. 1. When the content providing device 3 is a visual content posting type SNS (for example, Instagram (registered trademark) or Flickr (registered trademark)) server, for example, it has a function of posting a comment or a reaction (Like). May be.

  The collection range DB 31 stores collection positions (coordinates) serving as a reference when searching for visual content. The collection range DB 31 is created in advance by the administrator of the content providing system 1. The collection range DB 31 stores a collection range and a collection position in association with each other. The configuration of the collection range DB 31 is illustrated in FIG. Here, the collection range DB 31 includes collection range identification information, the number of collection position points, and a collection position.

  The collection range identification information is information for identifying the collection range, and may be, for example, the name, address, area name, or the like of a facility such as a building. This collection range identification information is information input by a viewer when a search for visual content is requested. The collection position score is information indicating the number of collection positions set in the collection range, and may be, for example, a predetermined number of 1 or more. The number of collection position points may be set to increase the number of large collection points compared to the small collection range. The collection position is information indicating the coordinates (longitude, latitude) of the collection position set in the collection range. For example, when the name or address of a facility such as a building is given as the collection range, the center or center of gravity, Or it may be a point constituting the outline of the facility. This collection position is a reference when searching for visual contents.

  The content DB 32 is used when searching for visual content. Information is added to the content DB 32 by the processing of the storage execution unit 42 when a visual content is posted by a contributor. The content DB 32 stores visual content and shooting range information indicating the shooting range of the visual content in association with each other. The configuration of the content DB 32 is illustrated in FIG. Here, the content DB 32 includes visual content and shooting range information, and the shooting range information further includes four elements of a shooting position, a shooting distance, a shooting direction, and a field angle. In addition to the four elements of the shooting position, the shooting distance, the shooting direction, and the angle of view, the shooting range information includes information that can calculate these four elements (for example, the focus, film size, and focus of the digital camera 12 that is the shooting device). Distance).

  The shooting position is a position (coordinates) where the visual content is shot. The shooting distance is a distance (distance in the depth direction) from the shooting position shot in the visual content to the subject. The shooting direction is the direction (degree) in which the visual content is shot. The angle of view is an angle representing a range captured by an image sensor (imaging device) when visual content is photographed.

  The storage request receiving unit 41 receives a visual content storage request from the posting-side user terminal 2a when the posting operation of the visual content is performed by the poster. The storage request receiving unit 41 receives visual content (for example, JPEG data) and imaging device information (for example, Exif data), which is additional information of the visual content, together with the storage request from the posting-side user terminal 2a, and receives the received information. The data is transferred to the storage execution unit 42.

  The storage execution unit 42 adds the visual content posted by the contributor and the shooting range information related to the posted visual content to the content DB 32. For example, the storage execution unit 42 stores the information stored in the “longitude” and “latitude” items in the Exif file of the posted visual content at the shooting position of the content DB 32. Further, the storage execution unit 42 stores the shooting distance information stored in the “maker note” item in the Exif file of the visual content to be posted in the shooting distance of the content DB 32. The items in the Exif file described in the embodiment are merely examples. Therefore, information stored in items other than those described here in the Exif file can be stored in the shooting range information of the content DB 32 (the same applies hereinafter). For example, information calculated from the “altitude”, “elevation” items, “lens name”, and “model name” items in the Exif file may be stored in the shooting distance of the shooting range information.

  The storage execution unit 42 stores the information stored in the “direction of destination” item in the Exif file of the visual content to be posted in the shooting direction of the content DB 32. Further, the storage execution unit 42 calculates the angle of view ψ by using the definition of the general angle trigonometric function shown below using the focal length f and the image sensor size z in the Exif file of the visual content to be posted. The obtained angle of view ψ is stored in the angle of view of the photographing range information.

  The storage response unit 43 transmits the storage result of the visual content in the content DB 32 to the posting-side user terminal 2a. Here, for example, when the required data is not included in the Exif data of the visual content, the storage response unit 43 may transmit information indicating that in the storage result.

  The search request reception unit 44 receives a visual content search request from the browsing-side user terminal 2b when a visual content browsing operation is performed by a viewer. The search request receiving unit 44 receives a collection position (for example, coordinates (latitude, longitude)) or a collection range indicating a specific space as a reference when searching visual content from the browsing-side user terminal 2b. When receiving the collection range, the search request receiving unit 44 refers to the collection range DB 31 and calculates a collection position corresponding to the received collection range. Then, the search request receiving unit 44 passes the collection position to the search execution unit 45.

The search execution unit 45 refers to the content DB 32 to determine whether or not the collection position is included in the shooting range of the visual content stored in the content DB 32 and acquires the visual content included in the shooting range from the content DB 32 ( collect. Hereinafter, specific processing of the search execution unit 45 will be described.
By using four elements of the shooting position (x, y), shooting distance λ, shooting direction φ, and angle of view ψ stored in the content DB 32, a fan-shaped shooting range L as shown in FIG. 3 can be drawn. . The search execution unit 45 calculates the relative distance K from the shooting position (x, y) to the collection position (α, β) by the following three-square theorem.

  Further, the search execution unit 45 calculates the relative direction θ from the imaging position (x, y) to the collection position (α, β) according to the definition of a general angle trigonometric function shown below.

  The search execution unit 45 then sets the relative distance K from the shooting position (x, y) to the collection position (α, β) within the shooting distance λ (K ≦ λ) and from the shooting position (x, y). Visual content whose relative direction θ to the collection position (α, β) is within the imaging width (φ−ψ / 2 ≦ θ ≦ φ + ψ / 2) is acquired (collected) from the content DB 32. Note that the order of the determination of the relative distance K and the determination of the relative direction θ is not particularly limited.

  The search response unit 46 transmits the visual content acquired (collected) by the search execution unit 45 to the browsing-side user terminal 2b. Here, for example, when the visual content that matches the search condition cannot be searched, the search response unit 46 may transmit information indicating the search result to the viewing-side user terminal 2b.

<< Operation of Content Providing System According to First Embodiment >>
With reference to FIG. 4, the content storage processing and content search processing of the content providing system 1 according to the first embodiment will be described.
Here, it is assumed that the posting-side user terminal 2a stores visual content (for example, JPEG data) and photographing device information (for example, Exif data) that is additional information of the visual content in advance. The visual content or the like may be created by the visual content creation unit 21 by, for example, an operation of the touch display 11 by the user (contributor) of the posting-side user terminal 2a. It may be received from a device. Note that the visual content may include photographing apparatus information (for example, Exif data) (for example, a JPEG file).

<Content storage processing>
First, the storage request unit 22 displays a visual content posting screen on the touch display 11 by an operation of the touch display 11 by a user (contributor) of the posting-side user terminal 2a (step S11). Subsequently, the storage request unit 22 accepts a user (contributor) visual content posting operation performed in accordance with the posting screen (step S12). As a result, the storage request unit 22 transmits the visual content held by itself and the storage request for the visual content to the content providing apparatus 3 (step S13).

  When receiving the visual content and the storage request for the visual content from the posting-side user terminal 2a, the storage request receiving unit 41 of the content providing device 3 requests the storage execution unit 42 to store the received visual content in the content DB 32. To do. Accordingly, the storage execution unit 42 stores the visual content in the content DB 32 (step S14). Specifically, the storage execution unit 42 stores the image data and stores the contents of the Exif data in the shooting range information.

  Subsequently, the storage response unit 43 transmits the storage result of the visual content in the content DB 32 to the posting-side user terminal 2a (step S15). Here, for example, when the required data is not included in the Exif data of the visual content, the storage response unit 43 may transmit information indicating that in the storage result. The storage request unit 22 of the posting-side user terminal 2a displays the received storage result on the touch display 11 (step S16). This is the end of the content storage process.

<Content search processing>
First, the search request unit 23 displays a visual content browsing screen on the touch display 11 by an operation of the touch display 11 by a user (viewer) of the browsing-side user terminal 2b (step S21). Subsequently, the search request unit 23 receives a visual content browsing operation of the user (browser) performed according to the browsing screen (step S22). Here, the browsing operation includes input of collection range information. Thereby, the search request unit 23 transmits a search request for visual content including the collection range to the content providing apparatus 3 (step S23).

  When the search request receiving unit 44 of the content providing device 3 receives a search request for visual content from the browsing-side user terminal 2b, the search request receiving unit 44 receives the visual content search request from the search execution unit 45 using the collection range information included in the search request. Request a search. Accordingly, the search execution unit 45 has a relative distance K between the shooting position (x, y) of the visual content stored in the content DB 32 and the collection position (α, β) acquired from the collection range DB 31 based on the collection range information. Then, the relative direction θ is calculated (step S24). And the search execution part 45 acquires the visual content which includes a collection position in the imaging | photography range L (step S25).

  Subsequently, the search response unit 46 transmits the acquired visual content to the browsing-side user terminal 2b (step S26). Here, for example, when the visual content that matches the search condition cannot be searched, the search response unit 46 may transmit information indicating the search result to the viewing-side user terminal 2b. The search request unit 23 of the browsing-side user terminal 2b delivers the received visual content to the visual content display unit 24, and the visual content display unit 24 displays this visual content on the touch display 11 (step S27). This completes the content distribution process.

  As described above, the content providing system 1 according to the first embodiment stores the shooting range information indicating the shooting range of the visual content in association with the visual content when storing the visual content in the content DB 32. Therefore, when searching for visual content, the content providing system 1 refers to the content DB 32 to determine whether or not the collection position is included in the shooting range of the visual content stored in the content DB 32, and the shooting range is included in the shooting range. Visual content including the collection position can be acquired (collected) from the content DB 32. Therefore, it is possible to easily search for related visual contents in units of subjects that have taken visual contents.

  In particular, by applying the content providing system 1 according to the first embodiment to a photo posting type SNS, a new photo posting type SNS as shown in FIG. 5 can be realized. In other words, when a user posts an image, a post image of another user including a subject (for example, Mt. Fuji) captured in the posted image is automatically searched and extracted without using a tag set by the user. , A system to return to the user can be realized. Thereby, for example, the user can automatically view the appearance of the past subject and the appearance of the subject at other times and seasons that cannot be seen at the moment when the user takes a picture. Moreover, since it is unnecessary for the user to set a tag at the time of posting, it can be expected to improve the motivation to post an image without increasing labor.

[Second Embodiment]
The content providing system 1 according to the first embodiment narrows down visual content related to a subject by using shooting range information stored in the content DB 32 when searching. In the second embodiment, in order to easily narrow down visual contents related to a subject at the time of searching, processing is performed in advance using shooting range information when storing visual contents as a precondition for searching. Specifically, for each preset shooting section, a list of visual contents in which the shooting section is captured is held.

<< Configuration of Content Providing System According to Second Embodiment >>
A content providing system 1A according to the second embodiment will be described with reference to FIG.
The content providing system 1A includes one or more user terminals 2 and a content providing apparatus 3A that is communicably connected to each user terminal 2 via a network NW.

  Similar to the content providing system 1 according to the first embodiment, the content providing system 1A stores a visual content posted (transmitted) from the user terminal 2 in the content providing apparatus 3A, and requests from the user terminal 2. A search function for providing (replying) to the user terminal 2 what is desired by the user from among the stored visual contents. Here, the visual content may be a still image such as a photograph, a moving image such as a video, and a time lapse. The content providing system 1A is, for example, a visual content posting type SNS, and will be described here assuming a case where a photograph is posted as visual content.

  The difference between the content providing system 1 according to the first embodiment and the content providing system 1A according to the second embodiment is that the configuration of the content providing apparatus 3A is different. The content providing apparatus 3A according to the second embodiment is different from the content providing apparatus 3 according to the first embodiment in the content of the content DB 32A of the storage unit, and further includes a shooting section DB 33. Further, the content providing device 3A differs from the content providing device 3 according to the first embodiment in the functions of the storage execution unit 42A and the search execution unit 45A of the control unit. Hereinafter, differences from the content providing apparatus 3 according to the first embodiment will be described.

The shooting section DB 33 stores information related to the shooting section C (see FIG. 8) obtained by dividing the map into a grid. The shooting section DB 33 is created in advance by the administrator of the content providing system 1A. The configuration of the shooting section DB 33 is illustrated in FIG. The shooting section DB 33 includes shooting section identification information, section reference position points, and section reference positions.
The shooting section identification information is information for identifying the shooting section C, and may be names such as “first section”, “second section”,. The section reference position score is information indicating the number of section reference positions set in the photographing section C, and may be, for example, a predetermined number of 1 or more. The section reference position is information indicating the coordinates (longitude, latitude) of the section reference position set in the shooting section C, and may be, for example, a point constituting the center, the center of gravity, or the contour of the shooting section C. This section reference position is a reference when searching for visual contents.

  The content DB 32A is used when searching for visual content. Information is added to the content DB 32A by the processing of the storage execution unit 42A when the visual content is posted by the contributor. In the content DB 32A, the shooting section C and visual content are stored in association with each other. The configuration of the content DB 32A is illustrated in FIG. Here, the content DB 32A includes shooting section identification information and visual content.

The storage execution unit 42A refers to the shooting section DB 33, calculates the one including the shooting range of the visual content acquired from the shooting section C, and associates the visual content with the included shooting section C as content. Store in DB32A. The determination as to whether or not the shooting section C is included in the shooting range of the visual content may be obtained by, for example, replacing the processing collection position described in the search execution unit 45 with the section reference position. That is, the search execution unit 45 uses the four elements of the shooting position (x, y), the shooting distance λ, the shooting direction φ, and the angle of view ψ of the posted visual content to create a fan-shaped shooting range L ( The photographing section C in which the section reference position is included in (see FIG. 3) is calculated. Then, the storage execution unit 42A stores the visual content in association with the shooting section identification information calculated by the content DB 32A. For example, the photograph (visual content) showing the shooting range shown in FIG. 8 includes a sixth shooting section C ₆ , a seventh shooting section C ₇ , an eighth shooting section C ₈ , a tenth shooting section C ₁₀ , and an eleventh shooting section. in association with the C ₁₁ are stored in the content DB 32a.

  The search execution unit 45A determines the shooting section C including the collection position, and acquires (collects) visual content corresponding to the shooting section determined to be included from the content DB 32A.

<< Operation of Content Providing System According to Second Embodiment >>
With reference to FIG. 9, the content storage processing and content search processing of the content providing system 1A according to the second embodiment will be described.
Here, as in the first embodiment, the posting-side user terminal 2a stores visual content (for example, JPEG data) and imaging device information (for example, Exif data), which is additional information of the visual content, in advance. It shall be. The visual content or the like may be created by the visual content creation unit 21 by, for example, an operation of the touch display 11 by the user (contributor) of the posting-side user terminal 2a. It may be received from a device. Note that the visual content may include photographing apparatus information (for example, Exif data) (for example, a JPEG file).

<Content storage processing>
The process of step S31-step S33 is the same as the process (refer FIG. 4) of step S11-step S13 of 1st Embodiment. Moreover, the process of step S37-step S38 is the same as the process (refer FIG. 4) of step S15-step S16 of 1st Embodiment.
Subsequent to step S33, the storage execution unit 42A calculates the relative distance K and the relative direction θ between the imaging position (x, y) of the posted visual content and the segment reference position (α ′, β ′) (step S33). S34). Subsequently, the storage execution unit 42A calculates a shooting section that includes the section reference position (α ′, β ′) in the shooting range (step S35). Then, the storage execution unit 42A stores the visual content in association with the shooting section identification information calculated by the content DB 32A (step S36).

<Content search processing>
The process of step S41-step S43 is the same as the process (refer FIG. 4) of step S21-step S23 of 1st Embodiment. Moreover, the process of step S46-step S47 is the same as the process (refer FIG. 4) of step S26-step S27 of 1st Embodiment.
Subsequent to step S43, the search execution unit 45A determines the shooting section C including the collection position (step S44). Then, the search execution unit 45A acquires (collects) the visual content registered in the shooting section C determined to be included in step S44 from the content DB 32A (step S45).

  As described above, the content providing system 1A according to the second embodiment stores visual content in association with the shooting section C when storing visual content in the content DB 32A. Accordingly, when searching for visual content, the content providing system 1A can acquire (collect) the visual content registered in the shooting section C including the collection position from the content DB 32A with reference to the content DB 32A. Therefore, it is possible to easily search for related visual contents in units of subjects that have taken visual contents.

  It should be noted that the content providing system 1A according to the second embodiment uses the shooting range information in advance when storing the visual content that is the premise of the search so that the visual content related to the subject can be easily narrowed during the search. Process it. Therefore, the time required for the visual content search process can be shorter than that of the content providing system 1 according to the first embodiment.

[Modification]
As mentioned above, although embodiment of this invention was described, this invention is not limited to this, It can implement in the range which does not change the meaning of a claim. The modification of embodiment is shown below.

  The content providing system 1 according to the first embodiment and the content providing system 1A according to the second embodiment include one or more user terminals 2 and contents that are communicably connected to each user terminal 2 via a network NW. And providing device 3. However, the configuration of the content providing systems 1 and 1A is not limited to this. For example, the function provided in the content providing device 3 may be added to the user terminal 2, and the processing described in the embodiment may be applied to visual content search performed in the user terminal 2.

  In the first embodiment and the second embodiment, it is assumed that the shooting range information includes four elements, that is, a shooting position, a shooting distance, a shooting direction, and a field angle. However, the shooting range information is not limited to these elements. For example, the shooting range information may include the shooting time, and accordingly, the collection position or the collection range may be specified and the visual content may be searched in consideration of the shooting time.

  In the first embodiment and the second embodiment, the space is approximated two-dimensionally for ease of explanation, but a three-dimensional space may be considered. In this case, for example, altitude is considered in addition to longitude and latitude as the shooting position of the shooting range information. The angle of view should also consider the vertical direction (elevation angle).

  In the second embodiment, a uniform square is assumed as the shooting section C, but the shape and size of the shooting section C are not limited to this. The shooting section C may be, for example, a rectangle or a triangle. Further, the shooting sections C may be uneven. For example, the number of shooting sections C where there are many subjects is increased (the shooting section C is reduced), and the number of shooting sections C where there are few subjects is reduced. (The shooting section C may be enlarged).

Furthermore, the function of searching for a photograph (visual content) showing a subject that is realized by the first embodiment and the second embodiment makes it possible to realize a new service that cannot be realized by a conventional system. Hereinafter, an assumed usage scene will be described with reference to FIG.
<Use scene 1>
For example, by designating the tornado path to the content providing systems 1 and 1A, it is possible to collect visual content obtained by photographing the tornado. Therefore, the content providing systems 1 and 1A can be used for elucidating the tornado generation mechanism.
<Use scene 2>
Further, by specifying the range of soccer and baseball fields in the content providing systems 1 and 1A, it is possible to collect play images taken from all angles of 360 degrees. Therefore, the content providing systems 1 and 1A can be used for creating free viewpoint content.
<Usage scene 3>
In addition, the restaurant manager can search for photos taken at his / her own store by designating his / her own store in the content providing systems 1 and 1A. Therefore, the content providing system 1 or 1A can be used for sales promotion activities using feedback and photographs to the photographer.
<Use scene 4>
In addition, by taking a picture at a point in the content providing system 1 or 1A, it is possible to search past pictures taken of the subject in the picture. Therefore, the content providing systems 1 and 1A can be used for acquiring time-series information of the subject.

1, 1A content providing system 2 user terminal 3 content providing device (content storage device, content search device)
DESCRIPTION OF SYMBOLS 11 Touch display 12 Digital camera 13 GPS receiver 21 Visual content creation part 22 Storage request part 23 Search request part 24 Visual content display part 31 Collection range DB
32, 32A content DB (storage unit)
33 Shooting section DB
41 Storage Request Reception Unit 42, 42A Storage Execution Unit 43 Storage Response Unit 44 Search Request Reception Unit 45, 45A Search Execution Unit 46 Search Response Unit

Claims (8)

A content search device for searching visual contents,
A storage unit that stores shooting range information indicating a shooting range of the visual content in association with the visual content;
A search request accepting unit that acquires a collection position serving as a reference when searching, or acquires a collection range indicating a specific space, and calculates the collection position from the acquired collection range;
A search execution unit that determines whether or not the collection position is included in the shooting range of the visual content stored in the storage unit, and acquires the visual content included in the shooting range from the storage unit;
A content search apparatus comprising: The shooting range information stored in the storage unit includes information indicating a shooting width including a shooting position, a shooting distance, a shooting direction, and a field angle of the visual content,
The search execution unit calculates whether a relative distance from the photographing position to the collection position is within the photographing distance, and whether a relative direction from the photographing position to the collection position is within the photographing width. By calculating, it is determined whether or not the collection position is included in the shooting range of the visual content.
The content search apparatus according to claim 1. The visual content stored in the storage unit and the shooting range information are acquired as shooting range information indicating the shooting range of the visual content and the visual content, or shooting of the visual content and the visual content is shot. A storage execution unit that acquires the shooting device information of the device and calculates the shooting range information from the acquired shooting device information, and stores the shooting range information in the storage unit;
The content search apparatus according to claim 1, further comprising: A content search method of a content search device for searching visual contents,
The content search device includes a storage unit that stores shooting range information indicating a shooting range of the visual content in association with the visual content,
Obtain a collection position that serves as a reference when searching, or obtain a collection range indicating a specific space, calculate the collection position from the obtained collection range,
Determining whether or not the collection position is included in a shooting range of visual content stored in the storage unit, and acquiring the visual content included in the shooting range from the storage unit;
A content search method characterized by the above. A content storage device for storing visual content,
A storage unit in which the visual content is stored in association with section information indicating a section set in advance;
Obtaining the visual content and photographing range information indicating a photographing range of the visual content, or obtaining photographing device information of the photographing device that photographed the visual content and the visual content, and obtaining the photographing device information from the obtained photographing device information. Calculate shooting range information,
A storage execution unit that calculates the range including the shooting range from the sections stored in the storage unit, and stores the visual content in the storage unit in association with the section;
A content storage device comprising: The section information stored in the storage unit includes a section reference position serving as a reference when specifying the section, and the shooting range information includes a shooting position, a shooting distance, a shooting direction, and an image of the visual content. Including information indicating the shooting width, consisting of corners,
The storage execution unit calculates whether a relative distance from the photographing position to the section reference position is within the photographing distance, and a relative direction from the photographing position to the section reference position is within the photographing width. By calculating or calculating what includes the shooting range from the section,
The content storage device according to claim 5. A search request accepting unit that acquires a collection position serving as a reference when searching, or acquires a collection range indicating a specific space, and calculates the collection position from the acquired collection range;
A search execution unit that determines the section including the collection position and acquires the visual content corresponding to the section determined to be included from the storage unit;
The content storage device according to claim 5, further comprising: A content storage method of a content storage device for storing visual content,
The content storage device includes a storage unit that stores the visual content in association with partition information indicating a preset partition,
Obtaining the visual content and photographing range information indicating a photographing range of the visual content, or obtaining photographing device information of the photographing device that photographed the visual content and the visual content, and obtaining the photographing device information from the obtained photographing device information. Calculate shooting range information,
Calculating one including the shooting range from the sections stored in the storage unit, and storing visual content in the storage unit in association with the section;
A content storage method characterized by the above.

Images