JP6625341B2 - Video search device, video search method, and program - Google Patents

Description

  The present invention relates to a moving image search device that searches for a moving image based on a shooting time and the like.

  2. Description of the Related Art Conventionally, a service has been developed in which a large number of users can upload a moving image photographed by themselves and view the uploaded moving image (see Non-Patent Document 1).

“YouTube”, [online], YouTube, LLC, [Search March 9, 2015], Internet [URL; https://www.youtube.com/]

  Conventionally, it has not been possible to search for a desired moving image from two or more moving images based on the time or position at which the moving image was captured.

  The moving image search device according to the first invention is a search condition receiving unit that receives a search condition that is a condition having at least one of a shooting time condition that is a condition regarding a shooting time and a shooting position condition that is a condition regarding a shooting position. And at least one of the moving images satisfying the search condition, wherein the moving image satisfies the search condition. The moving image satisfies the search condition. The moving image search device includes a shooting moving image acquisition unit that obtains a shooting moving image and an output unit that outputs the shooting moving image obtained by the shooting moving image acquisition unit.

  With such a configuration, a desired moving image can be searched from two or more moving images based on the time or position at which the moving image was captured.

  Further, the moving image search device according to the second invention is a moving image search device according to the first invention, in which the shooting position includes the altitude at the time of shooting.

  With such a configuration, a desired moving image can be searched from two or more moving images based on a position including the time at which the moving image was captured or the altitude.

  Further, in the moving image search device according to the third aspect, in the first aspect, the search condition is a condition having a shooting setting condition which is a condition relating to a camera setting at the time of shooting, and the shooting information is The moving image search device is information that also includes shooting setting information that is information indicating camera settings at the time.

  With such a configuration, a desired moving image is selected from two or more moving images based on at least one of the time at which the moving image was shot, the position at which the moving image was shot, and the camera setting at the time of shooting the moving image. Can be searched.

  Further, in the moving image search device according to the fourth aspect of the present invention, the search condition according to any one of the first to third aspects, wherein the search condition is a condition having an object attribute condition which is a condition relating to an attribute of a captured object. The photographing information is a moving image search device that is information that also has object attribute information that is information indicating the attribute of the object that has been photographed.

  With such a configuration, a desired moving image can be searched from two or more moving images based on the attribute of the captured target object.

  Further, in the moving image search device according to the fifth invention, in any one of the first to fourth inventions, the photographed moving image acquisition unit is configured to determine, from one or more photographed moving images satisfying the search condition, a portion satisfying the search condition. And the output unit is a moving image search device that also acquires one or more partial moving images that are a part of the captured moving image and outputs one or both of the captured moving image and the partial moving image acquired by the captured moving image acquisition unit. .

  With such a configuration, a desired moving image can be searched from two or more moving images based on the time at which the moving image was captured.

  Further, the moving image search device according to the sixth aspect of the present invention is the video search device according to any one of the first to fifth aspects, wherein the shooting information is added to the shooting moving image when the shooting moving image is acquired by shooting. Device.

  With such a configuration, the time at which the moving image was shot can be added to the moving image at the time of shooting the moving image.

  Further, the moving image search device according to the seventh aspect of the present invention provides the moving image search device according to any one of the fourth to sixth aspects, wherein the photographed moving image is stored in a predetermined storage area, This is a moving image search device to which object attribute information indicating an attribute of a captured object is added.

  With such a configuration, the attribute of the captured object can be added to the moving image after the moving image is accumulated.

  Also, the moving image search device of the eighth aspect of the present invention further includes a captured moving image storage unit in which two or more captured moving images are stored, according to any one of the first to seventh inventions, The search condition is received from the terminal device, the photographed moving image acquisition unit acquires one or more photographed moving images satisfying the search condition from the photographed moving image storage unit, and the output unit transmits the photographed moving image acquired by the photographed moving image acquisition unit to the terminal device. This is a moving image search device to be transmitted.

  With such a configuration, a desired moving image can be searched from two or more moving images based on the time at which the moving image was captured.

  Further, in the moving image search device of the ninth invention, in any one of the first to seventh inventions, the photographed moving image acquisition unit is configured to provide the two or more server devices holding two or more photographed moving images, A transmitting unit that transmits the search condition received by the search condition receiving unit; and a receiving unit that receives, from the two or more server devices, one or more captured moving images satisfying the search condition in response to the transmission of the search condition. The unit is a moving image search device that outputs the captured moving image received by the receiving unit.

  With such a configuration, a desired moving image can be searched from two or more moving images based on the time at which the moving image was captured.

  The moving image search device of the tenth invention is the moving image search device according to any one of the first to ninth inventions, wherein the shooting time condition is a condition having a shooting time zone.

  With such a configuration, a moving image captured at a time included in a designated time zone can be searched from two or more moving images.

  ADVANTAGE OF THE INVENTION According to the moving image search apparatus etc. by this invention, a desired moving image can be searched from two or more moving images based on the time or position at which the moving image was shot.

Conceptual diagram of moving image search system 1 according to Embodiment 1 Block diagram of the moving image search device 11 and the terminal device 12 Flowchart for explaining the overall operation of the video search device 11 Flowchart for explaining the overall operation of the terminal device 12 Diagram showing an example of the same shooting video The figure which shows the input example of the same search condition Block diagram of the terminal device 12 Conceptual diagram of moving image search system 2 according to Embodiment 2. Block diagram of the video search device 21 and the server device 22 Flowchart for explaining the overall operation of the video search device 21 Flowchart for explaining the overall operation of the server device 22 Block diagram of the video search device 21 Conceptual diagram of moving image search system 1 according to Embodiment 1 Block diagram of the photographing device 31 Conceptual diagram of moving image search system 2 according to Embodiment 2. Overview of computer system in the above embodiment Block diagram of computer system in the above embodiment

  Hereinafter, embodiments of a moving image search device and the like according to the present invention will be described with reference to the drawings. Note that components denoted by the same reference numerals in the embodiments perform the same operation, and thus the description thereof may not be repeated. Further, the format and content of each information described in the present embodiment are merely examples, and any format and content can be used as long as the meaning of each information can be shown.

(Embodiment 1)
In the present embodiment, a moving image search system 1 including one or more moving image search devices 11 and one or two or more terminal devices 12 will be described. The moving image search device 11 acquires a moving image that satisfies the search condition received from the terminal device 12. Then, the moving image search device 11 transmits the moving image to the terminal device 12. In addition, the terminal device 12 transmits the search condition to the moving image search device 11. Then, the terminal device 12 receives a moving image satisfying the search condition from the moving image search device 11. Then, the terminal device 12 outputs the moving image.

  FIG. 1 is a conceptual diagram of a moving image search system 1 according to the present embodiment. In FIG. 1, one or more video search devices 11 and one or more terminal devices 12 can communicate with each other via a communication unit 13. The moving image search device 11 is a server that receives and stores one or more moving images from one or more terminal devices 12 and devices other than the terminal device 12, for example. Further, the moving image search device 11 may be, for example, a server for operating a site for uploading a moving image or viewing the uploaded moving image (a so-called moving image site). The terminal device 12 is, for example, a mobile terminal such as a mobile phone, a smartphone, a PDA, and a tablet PC. The terminal device 12 may be, for example, a notebook PC, a desktop PC, or the like. Examples of devices other than the terminal device 12 are the same as those of the terminal device 12. Further, it is preferable that the device other than the terminal device 12 is a device having a moving image shooting function, such as a digital camera and a video camera. The communication unit 13 is a wireless or wired communication line. The communication unit 13 is, for example, the Internet, an intranet, a LAN, a public telephone network, or the like.

  FIG. 2 is a block diagram of the moving image search device 11 and the terminal device 12 according to the present embodiment. The moving image search device 11 includes a captured moving image storage unit 111, a search condition receiving unit 112, a captured moving image storage unit 113, a captured moving image acquisition unit 114, and an output unit 115. The terminal device 12 includes a terminal receiving unit 121, a terminal transmitting unit 122, a terminal receiving unit 123, and a terminal output unit 124.

  The captured moving image storage unit 111 stores two or more captured moving images. The photographed moving image is a moving image acquired by photographing. In other words, a shot moving image is a shot moving image. Further, the captured moving image usually has one or more processing units. In other words, the captured moving image is a moving image composed of one or more processing units. The processing unit is a unit in which processing is performed. The content of the process does not matter. The processing may be so-called signal processing, image processing, or the like. One processing unit is usually one frame. A frame may be considered to be, for example, a still image (a so-called image). The frame may be, for example, a field. Further, one processing unit may be, for example, two or more frames. That is, for example, when one processing unit is one frame, a captured moving image usually has two or more processing units. In addition, for example, when one processing unit is two or more frames, a captured moving image usually has one or more processing units.

  Further, the size of each of the one or more processing units included in the captured moving image may be the same or different. The same means that the size of one or more processing units is fixed. Also, different means that the size of one or more processing units fluctuates. Further, the data format of the captured moving image is not limited.

  In addition, shooting information is usually added to the shooting moving image. The term “added” includes, for example, being embedded, associated, having, and the like, and is widely understood. The shooting information is information related to shooting. The shooting information is, for example, shooting time information, shooting position information, shooting setting information, target object attribute information, and the like. The shooting time information is information indicating the time at which the shooting moving image was obtained (hereinafter, appropriately referred to as shooting time). The shooting position information is information indicating a position at which the shooting moving image is obtained (hereinafter, appropriately referred to as a shooting position). Further, the shooting setting information is information indicating a setting when a shooting moving image is acquired (hereinafter, appropriately referred to as a setting at the time of shooting). The settings are usually camera settings. The object attribute information is information indicating an attribute of a captured object. The “photographed object” can be said to be, for example, an object appearing in a captured moving image. The “photographed object” is a so-called subject. Hereinafter, details of such information will be described in order.

  The shooting time information is information indicating a time. The time may be, for example, date and time. The date and time are a date (year, month, day) and time. The shooting time information may be, for example, information indicating a time zone. Further, the time zone may be, for example, a time zone from the time when the shooting of the moving image starts to the time when the shooting of the moving image ends. That is, the photographing time information may be, for example, information having information indicating each of the two times. The two times are, for example, a time at which the shooting of the moving image is started and a time at which the shooting of the moving image is finished.

  The shooting position information is information indicating a position. The position is usually in latitude and longitude. The position may be, for example, coordinates on a map, a name of a point, an address, a name of an administrative division, or the like. The administrative divisions are, for example, prefectures, municipalities, and so on. Further, the position may include, for example, altitude (height).

  The shooting setting information is, for example, information indicating a shooting direction, a focal length, a subject distance, and the like. The shooting directions are, for example, the left-right direction and the up-down direction. The left-right direction and the up-down direction are, for example, angles with respect to a reference direction. That is, for example, in the left-right direction, when the north is the reference (0 °), the east is 90 °, the south is 180 °, and the west is 270 °. Further, for example, when the horizontal is a reference (0 °) in the up-down direction, the upper right is + 90 ° and the lower right is −90 °. Further, the left-right direction may be a so-called azimuth. The up-down direction may be, for example, “upward 45 °”, “downward 30 °”, or the like. Further, the left-right direction is hereinafter referred to as a horizontal direction as appropriate. The vertical direction is hereinafter referred to as a vertical direction as appropriate.

  Further, the shooting setting information may include, for example, information indicating the name of the device that has taken the image. The name of the photographed device is, for example, a so-called model name.

  The object attribute information is, for example, information indicating the size of the object, the type of the object, the name of the object, and the like.

  The size of the object is one or both of the vertical width and the horizontal width. The vertical width is a so-called height. The size of the target object is, for example, (1) a size based on the size (dimension) of the captured moving image, or (2) an actual size. In the case of (1), the object attribute information indicating the size of the object is, for example, (1-1) “80%”, (1-2) “1/2”, (1-3) “800pix × 600 pix ". (1-1) indicates that, for example, the size of the target object is 80% of the size of the captured moving image. Also, (1-2) indicates that, for example, the size of the target object is half the size of the captured moving image. Also, (1-3) indicates that the size of the target object is “800 pix × 600 pix”, for example. In the case of (2), the object attribute information indicating the size of the object is, for example, (2-1) “120 cm”, (2-2) “3 m”, and the like. (2-1) indicates that the height of the object is 120 cm, for example. (2-2) indicates that the height of the object is 3 m, for example.

  Further, the type of the target object may be, for example, a genre, a category, or the like. The object attribute information indicating the type of the object is, for example, “person”, “building”, “object”, “landscape”, and the like.

  The object attribute information indicating the name of the object is, for example, “XX tower”, “、 temple”, “XX mountain”, or the like.

  From the above, it can be said that among the information included in the shooting information, the shooting time information, the shooting position information, and the shooting setting information are information corresponding to so-called Exif information.

  The photographing information only needs to include at least photographing time information and photographing position information. That is, the shooting information does not need to include, for example, shooting setting information and target object attribute information.

  Further, one shooting information may be added to, for example, one shooting moving image. Further, one shooting information may be added to, for example, one or more processing units included in one shooting moving image. Further, one shooting information may be added to, for example, one or more processing units among one or more processing units included in one shooting moving image.

  In addition, a moving image that is part of one captured moving image and includes one or two or more processing units that are temporally continuous is hereinafter appropriately referred to as a partial moving image.

  The shooting information is added, for example, at the time of obtaining a shooting moving image (at the time of shooting). Further, among the information included in the shooting information, the object attribute information is added to the shooting moving image, for example, after the shooting moving image is accumulated in a predetermined storage area. The predetermined storage area may be, for example, the captured moving image storage unit 111 or a storage unit included in the device that has acquired the captured moving image.

  Further, the captured moving image storage unit 111 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. Further, the process in which the predetermined information is stored in the captured moving image storage unit 111 or the like does not matter. For example, the predetermined information may be stored in the captured moving image storage unit 111 or the like via a recording medium, a communication line, an input device, or the like.

  The search condition receiving unit 112 receives a search condition. The search condition is a condition for searching a captured moving image from the captured moving image storage unit 111. The reception performed by the search condition receiving unit 112 is usually reception. That is, in the present embodiment, the search condition receiving unit 112 normally receives the search condition from the terminal device 12.

  Note that accepting means obtaining information input from an input device such as a touch panel or a keyboard, reading information stored in a recording medium such as an optical disk, a magnetic disk, or a semiconductor memory, or via a wired or wireless communication line. The concept may include reception of transmitted information.

  Further, the search condition is a condition relating to photographing information added to the photographed moving image. That is, the search condition is, for example, a condition having any one or more of a shooting time condition, a shooting position condition, a shooting setting condition, and an object attribute condition. The shooting time condition is a condition relating to the shooting time. In addition, it can be said that the shooting time condition is, for example, a condition related to shooting time information included in shooting information added to a shooting moving image. The shooting position condition is a condition related to the shooting position. Also, it can be said that the shooting position condition is, for example, a condition relating to shooting position information included in the shooting information added to the shooting moving image. Further, the shooting setting condition is a condition regarding a setting at the time of shooting. In addition, it can be said that the shooting setting conditions are, for example, conditions relating to shooting setting information included in shooting information added to a shooting moving image. The object attribute condition is a condition relating to the attribute of the photographed object. In addition, it can be said that the object attribute condition is, for example, a condition relating to the object attribute information included in the shooting information added to the shot moving image.

  Further, for example, when the search condition includes two or more conditions among the conditions included in the search condition, the search condition is a combination of the two or more conditions. The combination is, for example, a logical product (AND), a logical sum (OR), or the like.

  (1) The shooting time conditions include, for example, (1-1) a condition indicated by two shooting times, (1-2) a condition indicated by one shooting time, (1-3) one shooting time, and the times And conditions indicated by the time before and after. The condition (1-1) is, for example, “14: 00 ≦ photographing time ≦ 14: 30”. This condition means that the photographing time is after 14:00 and before 14:30. In addition, it can be said that the condition is a condition having a shooting time zone. The condition (1-2) is, for example, “imaging time = 13: 30”. The condition means that the photographing time is 13:30. The condition (1-3) is, for example, “imaging time = 13: 30 ± 5 minutes”. The condition means that the photographing time is between 5 minutes before 13:30 and before 5 minutes after 13:30 (from 13:25 to before 13:35).

  (2) The shooting position conditions include, for example, (2-1) a condition indicated by two shooting positions, (2-2) a condition indicated by one shooting position, (2-3) one shooting position, and the position And conditions indicated by the distance from the vehicle. The condition (2-1) is, for example, “(X1, Y1) ≦ photographing position ≦ (X2, Y2)”. This condition means that the shooting position is within the range of a rectangle having (X1, Y1) and (X2, Y2) as diagonal vertices. The condition of (2-2) is, for example, “imaging position = (X3, Y3)”, “imaging position = XX prefecture XX city”, and the like. The former condition means that the shooting position is (X3, Y3). The latter condition means that the shooting position is XX prefecture XX city. The condition (2-3) is, for example, “imaging position = (X4, Y4), 1 km”. This condition means that the shooting position is within a circle with a radius of 1 km centered at (X4, Y4).

  (3) The shooting setting conditions include, for example, (3-1) “Shooting direction: (south-southwest ≦ horizontal direction ≦ south-southeast) & (+ 10 ° ≦ vertical direction ≦ −10 °)”, (3-2) “50 mm ≦ focal point Distance ≦ 100 mm ”and (3-3)“ 3 m ≦ subject distance ≦ 5 m ”. The condition (3-1) means that the horizontal shooting direction is in the range from south-southwest to south-southeast, and the vertical shooting direction is in the range from the upper oblique 10 ° to the lower oblique 10 °. . The condition (3-2) means that the focal length is 50 mm or more and 100 mm or less. The condition (3-3) means that the subject distance is 3 m or more and 5 m or less.

  (4) The object attribute conditions are, for example, (4-1) “(60% ≦ size ≦ 80%) & (type = person)”, (4-2) “name = (XX tower | XX) Bridge) "and (4-3)" type = landscape ". The condition (4-1) means that the size of the target is 60% or more and 80% or less of the size of the captured moving image, and the type of the target is a person. The condition (4-2) means that the name of the target object is XX tower or XX bridge. The condition (4-3) means that the type of the object is landscape.

  The object attribute condition may be, for example, an image. The image is an image in which an object considered to be captured in the captured moving image is captured. In other words, the image is an image in which an object to be searched is shown.

The search condition is, for example, a condition configured by combining any one or more of a shooting time condition, a shooting position condition, a shooting setting condition, and an object attribute condition so as to satisfy the following user needs. It is.
(A) I missed a competitive scene at a children's athletic meet, and I want to find a video that shows the competitive scene from videos taken by other parents.
(B) I want to find a video that shows myself from the videos of the events I took.
(C) I want to find a video that shows a criminal from videos shot by a security camera in the city.

  Further, the search condition received by the search condition receiving unit 112 may be associated with, for example, device identification information. The device identification information is information for identifying a device. The device identified by the device identification information is the terminal device 12. The device identification information is, for example, an IP address, a MAC address, an individual identification number, a telephone number, a mail address, and the like. Further, the device identification information associated with the search condition may be, for example, information for identifying a user.

  The captured moving image storage unit 113 stores the captured moving image in the captured moving image storage unit 111. The captured moving image storage unit 113 receives, for example, one or more captured moving images from an external device. The external device is, for example, the terminal device 12. The external device may be, for example, a device other than the terminal device 12. Then, the captured moving image storage unit 113 stores the received captured moving image in the captured moving image storage unit 111. The reception of the captured moving image may be performed by, for example, a receiving unit (not illustrated).

  Further, the captured moving image received by the captured moving image storage unit 113 may be associated with, for example, device identification information. The device identification information is usually information for identifying the terminal device 12. The device identification information may be, for example, information for identifying a user.

  In addition, the photographed moving image received by the photographed moving image storage unit 113 usually includes photographing information and object attribute information.

  In addition, the captured moving image storage unit 113 adds, for example, target object attribute information to the received captured moving image. Specifically, the captured moving image storage unit 113 determines, for example, whether or not the object attribute information is added to the received captured moving image. If not added, the captured moving image storage unit 113 obtains, using the captured moving image, object attribute information indicating the attribute of the object appearing in the captured moving image when storing the captured moving image. I do. The “at the time of storing the captured moving image” may be “before storing the captured moving image” or may be “after storing the captured moving image”. Then, the captured moving image storage unit 113 adds the acquired target object attribute information to the captured moving image. For example, when the object attribute information is acquired before the captured moving image is stored, the captured moving image storage unit 113 adds the object attribute information to the captured moving image, for example, and adds the object attribute information. The captured video is stored. In this case, for example, the captured moving image storage unit 113 adds the object attribute information to the captured moving image after storing the captured moving image.

  For example, it is assumed that a specific person (hereinafter, appropriately referred to as a person A) is captured from a first frame to a last frame of the captured moving image. In such a case, for example, the captured moving image storage unit 113 acquires the target attribute information “person” indicating the type of the target using the captured moving image. Then, the captured moving image storage unit 113 adds the target object attribute information to the captured moving image. At this time, the captured moving image storage unit 113 may, for example, add the acquired target object attribute information to one or more frames included in the captured moving image.

  Further, for example, it is assumed that, in the photographed moving image, the person A in the image is moving, and the size of the person A is changed by the movement. In such a case, for example, the captured moving image storage unit 113 acquires, using one or more frames included in the captured moving image, object attribute information indicating the size of a person appearing in the frame. Then, the captured moving image storage unit 113 adds the target object attribute information to the corresponding frame.

  Further, for example, it is assumed that "OO tower" is captured from the first frame of the captured moving image to the 300th frame. It is also assumed that “xx bridge” is captured from the 301st frame to the last frame of the captured moving image. In such a case, the captured moving image storage unit 113 acquires, for example, target attribute information “XX tower” indicating the name of the target. Then, the captured moving image storage unit 113 adds the object attribute information to frames from the first frame to the 300th frame. In addition, the captured moving image storage unit 113 acquires, for example, object attribute information “xx bridge” indicating the name of the object. Then, the captured moving image storage unit 113 adds the object attribute information to the frames from the 301st frame to the last frame.

  Note that the captured moving image storage unit 113 may include, for example, a captured moving image receiving unit, a target object attribute information adding unit, and a captured moving image storage unit. The photographed moving image receiving means receives one or more photographed moving images from an external device. The object attribute information adding unit adds object attribute information to the captured moving image received by the captured moving image receiving unit. Further, the captured moving image storage unit stores the captured moving image received by the captured moving image receiving unit in the captured moving image storage unit 111. The details of the processing performed by the photographed moving image receiving means, the object attribute information adding means, and the photographed moving image accumulating means are the same as described above, and will not be described.

  The captured moving image acquisition unit 114 acquires a moving image that satisfies the search condition from the captured moving image storage unit 111. The search condition is the search condition received by the search condition receiving unit 112. In addition, the moving image that satisfies the search condition is one or both of a captured moving image to which imaging information satisfying the search condition is added and a partial moving image to which imaging information satisfying the search condition is added.

  When acquiring a captured moving image, the captured moving image acquisition unit 114 determines, for example, for one or more captured moving images stored in the captured moving image storage unit 111, the captured information added to the captured moving image is a search condition. It is determined whether or not is satisfied. Then, the captured moving image acquisition unit 114 acquires, from the captured moving image storage unit 111, the captured moving image to which the imaging information determined to satisfy the search condition is added.

  When acquiring a partial moving image, the captured moving image acquisition unit 114 first acquires a captured moving image that satisfies the first search condition from the captured moving image storage unit 111. Then, for each of the one or more processing units included in each of the obtained captured moving images, the captured moving image acquisition unit 114 determines whether the imaging information added to the processing unit satisfies the second search condition. to decide. Then, the photographed moving image acquiring unit 114 is a processing unit to which the photographing information determined to satisfy the second search condition is added, and a partial moving image composed of one or two or more temporally continuous processing units. , From the captured moving image.

  When acquiring a partial moving image, the captured moving image acquisition unit 114 may acquire a partial moving image without acquiring a captured moving image satisfying the first search condition, for example. In this case, for example, the photographed moving image acquisition unit 114 may include, for one or more processing units included in the one or more photographed moving images stored in the photographed moving image storage unit 111, the photographing information added to the processing unit. Judge whether the second search condition is satisfied. Then, the photographed moving image acquiring unit 114 is a processing unit to which the photographing information determined to satisfy the second search condition is added, and a partial moving image composed of one or two or more temporally continuous processing units. , From the captured moving image storage unit 111.

  The first search condition and the second search condition are, for example, the same. In this case, the first search condition and the second search condition are the search conditions received by the search condition receiving unit 112.

  Further, the first search condition and the second search condition may not be the same, for example. In this case, the first search condition and the second search condition are any one or more of the two or more conditions included in the search condition received by the search condition receiving unit 112, and have an exclusive relationship. Condition. That is, for example, when the search conditions received by the search condition receiving unit 112 include a shooting time condition and a shooting position condition, the first search condition is, for example, a shooting position condition, and the second search condition is For example, it is a shooting time condition. Further, for example, when the search condition received by the search condition receiving unit 112 includes a shooting time condition, a shooting position condition, and an object attribute condition, the first search condition is, for example, a shooting time condition, and Are, for example, a photographing position condition and an object attribute condition.

  The partial moving image acquired by the captured moving image acquisition unit 114 may be, for example, information indicating a range of the partial moving image in the captured moving image. The information is hereinafter appropriately referred to as partial moving image range information. The range may be, for example, a position, a location, a time, and the like. For example, it is assumed that the captured moving image acquisition unit 114 determines that the 100th to 500th frames satisfy the search condition for the captured moving image including 1000 frames. In such a case, the captured moving image acquisition unit 114 acquires, for example, partial moving image range information “100th frame to 500th frame”. It is also assumed that the 100th to 500th frames correspond to, for example, 10:00 to 10:30, which is the time from the start of reproduction of the captured moving image. In such a case, the captured moving image acquisition unit 114 may acquire, for example, the partial moving image range information “10: 00: 10-10: 30”.

  The output unit 115 outputs the moving image acquired by the captured moving image acquisition unit 114. The moving image is one or both of the photographed moving image and the partial moving image. The output performed by the output unit 115 is usually transmission. That is, in the present embodiment, the output unit 115 normally transmits the moving image acquired by the captured moving image acquisition unit 114 to the terminal device 12.

  Note that output means display on a display, projection using a projector, sound output, transmission to an external device, storage in a recording medium, delivery of a processing result to another processing device or another program, and the like. It may be a concept including. Further, regarding transmission, accumulation, and delivery of the processing result, it is assumed that the output target is finally presented to the user.

  The output unit 115 transmits the moving image to the terminal device 12 identified by the device identification information associated with the search condition. That is, the output unit 115 transmits the moving image to the terminal device 12 identified by the device identification information associated with the search condition used by the captured moving image acquiring unit 114 to acquire the moving image.

  The terminal receiving unit 121 receives a search condition.

  The terminal transmission unit 122 transmits the search condition to the moving image search device 11. The search condition is a search condition received by the terminal receiving unit 121. Further, the terminal transmitting unit 122 transmits the search condition in association with the device identification information. For example, the device identification information is held in advance by the terminal transmission unit 122. The device identification information is stored in, for example, a predetermined storage area.

  The terminal transmitting unit 122 is generally realized by a wireless or wired communication unit, but may be realized by a broadcasting unit.

  The terminal receiving unit 123 receives a moving image from the moving image search device 11. The moving image is one or both of the photographed moving image and the partial moving image. In addition, the terminal receiving unit 123 normally receives a moving image in response to the transmission of the search condition by the terminal transmitting unit 122.

  The terminal receiving section 123 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

  The terminal output unit 124 outputs the moving image received by the terminal receiving unit 123. For example, when the terminal receiving unit 123 receives a captured moving image, the terminal output unit 124 outputs the captured moving image. Further, for example, when the terminal receiving unit 123 receives the partial moving image, the terminal output unit 124 outputs the partial moving image.

  The input means for information, instructions, and the like in the search condition receiving unit 112 and the terminal receiving unit 121 may be anything using a menu screen, a keyboard, or the like. The search condition receiving unit 112 and the terminal receiving unit 121 can be realized by control software for a menu screen, a device driver of input means such as a keyboard, or the like.

  In addition, the captured moving image storage unit 113 and the captured moving image acquisition unit 114 can be generally realized by an MPU, a memory, or the like. Further, the processing procedure of the photographed moving image storage unit 113 and the photographed moving image acquisition unit 114 is generally realized by software, and the software is recorded on a recording medium such as a ROM. Note that the captured moving image storage unit 113 and the captured moving image acquisition unit 114 may be realized by hardware (dedicated circuit).

  Further, the output unit 115 and the terminal output unit 124 may or may not include output devices such as a display and a speaker. The output unit 115 and the terminal output unit 124 can be realized by driver software for an output device, or driver software for an output device and an output device.

  Next, the overall operation of the moving image search system 1 will be described using a flowchart. The i-th information in the predetermined information is described as “information [i]”. First, the overall operation of the moving image search device 11 will be described with reference to the flowchart in FIG.

  (Step S301) The captured moving image storage unit 113 determines whether a captured moving image has been received from the terminal device 12. If received, the process proceeds to step S302; otherwise, the process proceeds to step S305.

  (Step S302) The captured moving image storage unit 113 determines whether the target attribute information is added to the captured moving image received in step S301. If added, the process proceeds to step S304; otherwise, the process proceeds to step S303.

  (Step S303) The captured moving image storage unit 113 acquires target object attribute information using the captured moving image received in Step S301. Then, the captured moving image storage unit 113 adds the target object attribute information to the captured moving image received in step S301.

  (Step S304) The captured moving image storage unit 113 stores the captured moving image received in step S301 in the captured moving image storage unit 111.

  (Step S305) The captured moving image acquisition unit 114 determines whether the search condition receiving unit 112 has received the search condition from the terminal device 12. If received, the process proceeds to step S306; otherwise, the process returns to step S301. It is assumed that the search condition is associated with device identification information for identifying the terminal device 12.

  Here, it is assumed that m captured moving images are stored in the captured moving image storage unit 111.

  (Step S306) The captured moving image acquisition unit 114 sets 1 to a counter i.

  (Step S307) The photographed moving image acquisition unit 114 determines that the photographing information [i] that is the photographing information added to the photographed moving image [i] stored in the photographed moving image storage unit 111 matches the search condition received in step S305. It is determined whether or not the condition is satisfied. If so, the process proceeds to step S308; otherwise, the process proceeds to step S309.

  (Step S308) The captured moving image acquisition unit 114 acquires the captured moving image [i] from the captured moving image storage unit 111.

  (Step S309) The captured moving image acquisition unit 114 determines whether i is m. If m, the process proceeds to step S311; otherwise, the process proceeds to step S310.

  (Step S310) The captured moving image acquisition unit 114 increments the counter i by one. Then, the process returns to step S307.

  (Step S311) The output unit 115 transmits the captured moving image acquired in step S308 to the terminal device 12 identified by the device identification information associated with the search condition received in step S305. The terminal device 12 is the terminal device 12 that has transmitted the search condition received in step S305. Then, the process returns to step S301.

  In the flowchart of FIG. 3, the processing may be terminated by powering off or interruption for terminating the processing.

  In addition, in step S308 of the flowchart in FIG. 3, the captured moving image acquiring unit 114 may acquire a partial moving image that satisfies the search condition from the acquired captured moving image [i].

  Next, the overall operation of the terminal device 12 will be described with reference to the flowchart in FIG.

  (Step S401) The terminal device 12 determines whether or not the terminal receiving unit 121 has received a power-on instruction. If accepted, the process proceeds to step S402; otherwise, the process returns to step S401.

  (Step S402) The terminal device 12 performs power-on processing.

  (Step S403) The terminal transmitting unit 122 determines whether the terminal receiving unit 121 has received a search condition. If accepted, the process proceeds to step S404; otherwise, the process proceeds to step S407.

  (Step S404) The terminal transmission unit 122 transmits the search condition received in Step S403 to the moving image search device 11.

  (Step S405) The terminal output unit 124 determines whether the terminal receiving unit 123 has received a captured moving image from the moving image search device 11. The moving image search device 11 is the moving image search device 11 that transmitted the search condition in step S404. If a captured moving image has been received, the process proceeds to step S406; otherwise, the process returns to step S405.

  (Step S406) The terminal output unit 124 outputs the captured moving image received in Step S405.

  (Step S407) The terminal device 12 determines whether or not the terminal receiving unit 121 has received a power-off instruction. If accepted, the process proceeds to step S408; otherwise, the process returns to step S403.

  (Step S408) The terminal device 12 performs power-off processing. Then, the process returns to step S401.

  In the flowchart of FIG. 4, the processing may be terminated by powering off or interruption for terminating the processing.

  In addition, in step S405 of the flowchart in FIG. 4, the terminal receiving unit 123 may receive one or both of the captured moving image and the partial moving image from the moving image search device 11. In this case, the terminal output unit 124 outputs the moving image received by the terminal receiving unit 123 in step S406 of the flowchart in FIG.

  The overall operation of the moving image search system 1 described above is only an example. That is, the overall operation of the video search system 1 is not limited to the above description.

(Concrete example)
Next, a specific example of the operation of the moving image search system 1 will be described. In this specific example, it is assumed that the moving image search device 11 is a server for operating a so-called moving image site (hereinafter, appropriately referred to as a server).

(Example 1)
In this example, an example in which one or more captured moving images are stored in the moving image search device 11 will be described.

  First, it is assumed that a certain user (hereinafter, appropriately referred to as a user A) starts photographing “XX Tower” using his / her smartphone. The smartphone is the terminal device 12. The smartphone may be, for example, a device other than the terminal device 12.

  Next, it is assumed that the user A has finished capturing the image of “XX Tower”. Then, the photographed moving image is stored in a predetermined storage area of the smartphone. The shooting moving image is added with shooting time information, shooting position information, and shooting setting information. The shooting time information is information indicating a shooting start time and a shooting end time.

  Next, it is assumed that the user A performs an operation for transmitting a moving image of “XX Tower” to the server on his / her smartphone. Then, the terminal receiving unit 121 receives a shooting moving image transmission instruction. The shooting moving image transmission instruction is an instruction to transmit the shooting moving image. Then, the terminal transmission unit 122 acquires the captured moving image selected by the captured moving image transmission instruction from a predetermined storage area. The photographed moving image is a moving image of “XX Tower” as described above. Then, the terminal transmitting unit 122 transmits the acquired captured moving image to the server.

  Next, the captured moving image storage unit 113 of the server receives the captured moving image. Then, the captured moving image storage unit 113 adds the object attribute information “XX tower” to the received captured moving image. Then, the captured moving image storage unit 113 stores the captured moving image in the captured moving image storage unit 111.

  It is also assumed that the captured moving image storage unit 113 of the server has received another captured moving image from a smartphone possessed by another user (hereinafter, appropriately referred to as user B). The smartphone is a device other than the moving image search device 11 and the terminal device 12. In addition, it is assumed that the photographed moving image is a moving image of “xx bridge”. Then, the captured moving image storage unit 113 adds the object attribute information “xx bridge” to the captured moving image. Then, the captured moving image storage unit 113 stores the captured moving image in the captured moving image storage unit 111.

  It is also assumed that the captured moving image storage unit 113 of the server has received another captured moving image from a notebook PC owned by another user (hereinafter, appropriately referred to as user C). The notebook PC is a device other than the moving image search device 11 and the terminal device 12. It is also assumed that the photographed moving image is a moving image that has been photographed by a video camera possessed by the user C and transferred to the notebook PC. In addition, it is assumed that the photographed moving image is a moving image of the state of the athletic meet in which the son of the user C participated. Then, the captured moving image storage unit 113 adds object attribute information “person” to the captured moving image. Then, the captured moving image storage unit 113 stores the captured moving image in the captured moving image storage unit 111.

  The captured moving image stored in the captured moving image storage unit 111 by the captured moving image storage unit 113 as described above is, for example, FIG. Note that the captured moving image in FIG. 5 is represented by a file name that is information for identifying the captured moving image. In addition, the shooting moving image includes an ID for uniquely identifying a record, shooting time information (item name: start time, end time), shooting position information (item name: position), and shooting setting information (item Name: setting) and object attribute information (item name: object).

(Example 2)
In this example, an example in which the terminal device 12 receives one or more captured moving images from the moving image search device 11 and outputs the received moving images will be described. In this example, it is assumed that two or more captured moving images including the captured moving image in FIG. 5 are stored in the captured moving image storage unit 111.

  First, it is assumed that the user has performed an operation to display a screen for inputting search conditions on his / her smartphone. The smartphone is the terminal device 12. Then, the terminal output unit 124 displays the screen. The screen is, for example, FIG.

  Next, it is assumed that the user inputs search conditions on the screen of FIG. 6 and clicks an “OK” button. Then, terminal accepting section 121 accepts the search condition input on the screen of FIG. The search condition is, for example, “(2015/3/19 13: 00 ≦ photographing start time ≦ 2015/3/19 15:00) & (photographing position = (N35.1395, E135.2885), 1 km) & ( Shooting direction = west) & (model name: VDCamF03) & (object type = person) ". In addition, the search condition is that the shooting start time is after 13:00 on March 19, 2015 and before 15:00 on March 19, 2015, and the shooting position is (N35. 1395, E135.2885), within a circle with a radius of 1 km, the photographing direction is west, the name of the device used for photographing is “VDCamF03”, and the object The type means a person. Then, the terminal transmitting unit 122 transmits the search condition received by the terminal receiving unit 121 to the server.

  Next, the search condition receiving unit 112 of the server receives the search condition transmitted by the smartphone. Then, the photographed moving image acquiring unit 114 acquires, from the photographed moving image storage unit 111, a photographed moving image to which photographing information satisfying the search condition is added. Here, it is assumed that the captured video acquisition unit 114 determines that the captured information added to the captured video of “ID = 013” in FIG. 5 satisfies the search condition. Then, the photographed moving image acquisition unit 114 acquires the photographed moving image of “ID = 013” in FIG. Then, the output unit 115 transmits the captured moving image to the smartphone.

  Next, the terminal receiving unit 123 of the smartphone receives the captured moving image of “ID = 013” in FIG. Then, the terminal output unit 124 outputs the captured moving image. The output is, for example, a display of one frame (image) of the captured moving image. The output is, for example, the reproduction of the photographed moving image.

  As described above, according to the moving image search system 1 according to the present embodiment, a desired moving image can be searched from two or more moving images based on the time or position at which the moving image was shot. Accordingly, the user has missed, for example, a competitive scene of a children's athletic meet, and thus can search for a moving image in which the competitive scene is captured from videos taken by other parents. In addition, for example, the user can search for a moving image in which he or she is captured from a moving image in which a state of a participating event is captured. In addition, the user can, for example, search for a moving image in which a criminal is captured from moving images captured by a security camera in the city.

  Note that in the present embodiment, the terminal device 12 may acquire a captured moving image. In this case, the terminal device 12 further includes a terminal imaging unit 125. FIG. 7 is a block diagram of the terminal device 12 in a case where the terminal device 12 is further provided. In addition, the terminal photographing unit 125 acquires a photographed moving image by photographing. Further, the terminal photographing unit 125 adds photographing information to the photographed moving image, for example, when acquiring the photographed moving image. Note that the method and procedure for adding the shooting information to the shooting moving image are not limited. The terminal photographing unit 125 usually acquires photographing information in a so-called real-time manner, and adds the acquired photographing information to the acquired photographed moving image.

For example, at the start of shooting, the terminal shooting unit 125 acquires shooting time information indicating the time of the start. Then, for example, at the end of the shooting, the terminal shooting unit 125 acquires shooting time information indicating the end time. The end end imaging unit 125, the photographing video obtained by the shooting, adding shooting time information indicating an end time of the shooting time information and the shooting showing the start time of the shooting.

Further, for example, at the start of shooting, the terminal shooting unit 125 acquires shooting position information indicating the position at the start. Then, for example, at the end of the shooting, the terminal shooting unit 125 acquires shooting position information indicating the position at the end of the shooting. The end end imaging unit 125, the photographing video obtained by the shooting, adding the shooting position information indicating the end position of the photographing start imaging position information and the shooting showing a position.

  In addition, for example, the terminal imaging unit 125 acquires imaging position information at a predetermined timing from the start of imaging to the end of imaging. The timing is, for example, periodically, each time the position changes, and the like. Then, the terminal photographing unit 125 adds the photographing position information to one processing unit acquired at the time of acquiring the photographing position information, for example. Further, the terminal photographing unit 125 adds, for example, one or more photographing position information acquired during the acquisition of the photographed moving image (from the start of photographing to the end of photographing) to the acquired photographed moving image. I do.

Further, for example, at the time of starting shooting, the terminal shooting unit 125 acquires shooting setting information indicating the setting at the start. Then, for example, at the end of shooting, the terminal shooting unit 125 acquires shooting setting information indicating the setting at the end of shooting. The end end imaging unit 125, the photographing video obtained by the shooting, adding the shooting information indicating the termination time of the setting of the shooting start the shooting information and the shooting showing a configuration.

  In addition, for example, the terminal imaging unit 125 acquires imaging setting information at a predetermined timing from the start of imaging to the end of imaging. The timing is, for example, periodically, every time the setting changes, and the like. Then, the terminal photographing unit 125 adds the photographing setting information to one processing unit acquired at the time of acquiring the photographing setting information, for example. Further, the terminal photographing unit 125 adds, for example, one or more photographing setting information acquired during the acquisition of the photographed moving image (from the start of photographing to the end of photographing) to the acquired photographed moving image. I do.

  Further, for example, each time the terminal imaging unit 125 acquires one processing unit constituting a captured moving image, the terminal imaging unit 125 acquires imaging time information indicating a time at the time of the acquisition, imaging position information indicating a position at the time of the acquisition, Of any one or more pieces of shooting setting information indicating shooting setting. Then, the terminal photographing unit 125 adds the photographing information acquired at the time of acquiring the one processing unit to the one acquired processing unit.

  Further, for example, after acquiring the photographed moving image, the terminal photographing unit 125 acquires the object attribute information using the photographed moving image. Then, the terminal imaging unit 125 adds the acquired target object attribute information to the acquired captured moving image. The method and procedure for adding the object attribute information are the same as the method and procedure for adding the object attribute information to the received moving image received by the captured moving image storage unit 113, and thus the description is omitted.

  Further, the acquisition of the photographing information may be performed by, for example, a terminal photographing information acquiring unit (not shown). Further, the addition of the shooting information to the shooting moving image may be performed by, for example, a terminal shooting information adding unit (not shown). In addition, the terminal device 12 includes the terminal photographing information acquiring unit and the terminal photographing information adding unit.

  In addition, the terminal photographing unit 125 can be generally realized by an image sensor (solid-state image sensor) such as a CMOS or a CCD, a camera (digital still camera, digital video camera) using the image sensor, or the like. The processing procedure of the terminal photographing unit 125 is generally realized by software, and the software is recorded on a recording medium such as a ROM.

  When the terminal device 12 includes the terminal photographing unit 125, the terminal transmitting unit 122 transmits the photographed moving image obtained by the terminal photographing unit 125 and the photographing information added thereto to the moving image search device 11.

(Embodiment 2)
In the present embodiment, a moving image search system 2 including one or more moving image search devices 21 and one or more server devices 22 will be described. The moving image search device 21 transmits the search condition to the server device 22. Then, the moving image search device 21 receives a moving image satisfying the search condition from the server device 22. Then, the moving image search device 21 outputs the moving image. In addition, the server device 22 acquires a moving image that satisfies the search condition received from the moving image search device 21. Then, the server device 22 transmits the moving image to the moving image search device 21.

  FIG. 8 is a conceptual diagram of the moving image search system 2 according to the present embodiment. In FIG. 8, one or two or more moving image search devices 21 and one or two or more server devices 22 can communicate with each other via a communication unit 23. The moving image search device 21 is a mobile terminal such as a mobile phone, a smartphone, a PDA, and a tablet PC. The moving image search device 21 may be, for example, a notebook PC, a desktop PC, or the like. The server device 22 is a server that receives and accumulates one or more moving images from one or more moving image search devices 21 and devices other than the moving image search device 21, for example. The server device 22 may be, for example, a server for operating a site (a so-called video site) for uploading a video or viewing the uploaded video. Examples of devices other than the moving image search device 21 are the same as those of the moving image search device 21. It is preferable that the devices other than the moving image search device 21 are devices having a moving image shooting function, such as a digital camera and a video camera. The communication unit 23 is a wireless or wired communication line. The communication means 23 is, for example, the Internet, an intranet, a LAN, a public telephone network, or the like.

  FIG. 9 is a block diagram of the moving image search device 21 and the server device 22 according to the present embodiment. The moving image search device 21 includes a search condition receiving unit 211, a captured moving image acquisition unit 212, and an output unit 213. Further, the captured moving image acquisition unit 212 includes a transmission unit 2121 and a reception unit 2122. The server device 22 includes a server storage unit 221, a server reception unit 222, a server storage unit 223, a server acquisition unit 224, and a server transmission unit 225.

  The search condition receiving unit 211 receives a search condition. The input means for information, instructions, and the like in the search condition receiving unit 211 may be anything such as a menu screen, a keyboard, or the like. The search condition receiving unit 211 can be realized by control software for a menu screen, a device driver of input means such as a keyboard, or the like.

  The captured moving image acquisition unit 212 acquires a captured moving image that satisfies the search condition. Specifically, the captured moving image acquiring unit 212 acquires the captured moving image by receiving the captured moving image from the server device 22. Further, the photographed moving image acquisition unit 212 acquires the photographed moving image by each unit described below.

  The transmission unit 2121 transmits the search condition to one or more server devices 22. The search condition is a search condition received by the search condition receiving unit 211. The transmitting unit 2121 transmits the search condition in association with the device identification information. The device identified by the device identification information is the moving image search device 21. In addition, the device identification information is held in advance by the transmission unit 2121, for example. The device identification information is stored in, for example, a predetermined storage area.

  Further, for example, when transmitting to two or more server devices 22, the transmission unit 2121 may simultaneously transmit the search condition to each of the two or more server devices 22. In this case, for example, the transmitting unit 2121 may separately transmit the search condition to each of the two or more server devices 22.

  The transmitting unit 2121 is usually realized by a wireless or wired communication unit, but may be realized by a broadcasting unit.

  The receiving unit 2122 receives a moving image from the server device 22. The moving image is one or both of the photographed moving image and the partial moving image. The receiving unit 2122 normally receives a moving image in response to the transmission of the search condition by the transmitting unit 2121. The moving image is a moving image that satisfies the search condition. Further, the receiving unit 2122 receives a moving image satisfying the search condition from the server device 22 to which the transmitting unit 2121 has transmitted the search condition.

  In addition, the receiving unit 2122 is generally realized by a wireless or wired communication unit, but may be realized by a unit for receiving a broadcast.

  The output unit 213 outputs the moving image acquired by the captured moving image acquisition unit 212. The moving image is, specifically, a moving image received by the receiving unit 2122. For example, when the captured moving image acquisition unit 212 acquires a captured moving image, the output unit 213 outputs the captured moving image. Further, for example, when the captured moving image acquisition unit 212 receives a partial moving image, the output unit 213 outputs the partial moving image.

  The output unit 213 may or may not include an output device such as a display or a speaker. The output unit 213 can be realized by driver software for an output device, or driver software for an output device and an output device.

  The server storage unit 221 stores two or more captured moving images. Further, the server storage unit 221 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. The process in which the predetermined information is stored in the server storage unit 221 does not matter. For example, the predetermined information may be stored in the server storage unit 221 or the like via a recording medium, a communication line, an input device, or the like.

  The server receiving unit 222 receives the search condition from the moving image search device 21. For example, device identification information may be associated with the search condition. The device identified by the device identification information is the moving image search device 21.

  The server receiving unit 222 is generally realized by a wireless or wired communication unit, but may be realized by a unit for receiving a broadcast.

  The server storage unit 223 stores the captured moving image in the server storage unit 221. The server storage unit 223 receives, for example, one or more captured moving images from an external device. The external device may be, for example, the moving image search device 21. In addition, the external device may be, for example, a device other than the moving image search device 21. Then, the server storage unit 223 stores the received captured moving image in the server storage unit 221. The reception of the captured moving image may be performed by, for example, the server receiving unit 222.

  Further, the captured moving image received by the server storage unit 223 may be associated with, for example, device identification information. The device identification information is usually information for identifying the moving image search device 21. The device identification information may be, for example, information for identifying a user.

  In addition, the server storage unit 223 adds, for example, target object attribute information to the received captured moving image. The method and procedure for adding the object attribute information are the same as the method and procedure for adding the object attribute information by the captured moving image storage unit 113, and thus the description is omitted.

  In addition, the server storage unit 223 includes, for example, a server captured moving image receiving unit, a server target object attribute information adding unit, and a server captured moving image storage unit. Information may be added, a captured moving image may be stored, and the like. The processes performed by the respective units are the same as the processes performed by the captured moving image receiving unit, the object attribute information adding unit, and the captured moving image storage unit, respectively, and thus description thereof is omitted.

  The server obtaining unit 224 obtains a moving image satisfying the search condition from the server storage unit 221. The search condition is a search condition received by the server receiving unit 222. The moving image is one or both of the photographed moving image and the partial moving image. The method and procedure for acquiring a moving image that satisfies the search condition are the same as the method and procedure for acquiring a moving image by the captured moving image acquiring unit 114, except that the moving image is acquired from the server storage unit 221, and a description thereof will be omitted. I do.

  The server transmission unit 225 transmits the moving image acquired by the server acquisition unit 224 to the moving image search device 21. The moving image is one or both of the photographed moving image and the partial moving image.

  Further, the server transmission unit 225 transmits the moving image to the moving image search device 21 identified by the device identification information associated with the search condition. That is, the server transmission unit 225 transmits the moving image to the moving image search device 21 identified by the device identification information associated with the search condition used by the server obtaining unit 224 to obtain the moving image.

  Further, server transmitting section 225 is generally realized by wireless or wired communication means, but may be realized by broadcasting means.

  Note that the server storage unit 223 and the server acquisition unit 224 can be generally realized by an MPU, a memory, or the like. Further, the processing procedure of the server storage unit 223 and the server acquisition unit 224 is usually realized by software, and the software is recorded on a recording medium such as a ROM. Note that the server storage unit 223 and the server acquisition unit 224 may be realized by hardware (dedicated circuit).

  Next, the overall operation of the moving image search system 2 will be described using a flowchart. The i-th information in the predetermined information is described as “information [i]”. First, the overall operation of the moving image search device 21 will be described with reference to the flowchart in FIG.

  (Step S1001) The moving image search device 21 determines whether or not an instruction receiving unit (not shown) has received an instruction to turn on the power. If accepted, the process proceeds to step S1002; otherwise, the process returns to step S1001.

  (Step S1002) The moving image search device 21 performs power-on processing.

  (Step S1003) The captured moving image acquisition unit 212 determines whether the search condition receiving unit 211 has received the search condition. If accepted, the process proceeds to step S1004; otherwise, the process proceeds to step S1007.

  (Step S1004) The transmitting unit 2121 transmits the search condition received in Step S1003 to the server device 22.

  (Step S1005) The output unit 213 determines whether or not the receiving unit 2122 has received a captured moving image from the server device 22. The server device 22 is the server device 22 that transmitted the search condition in step S1004. If a captured moving image has been received, the process advances to step S1006; otherwise, the process returns to step S1005.

  (Step S1006) The output unit 213 outputs the captured moving image received in Step S1005.

  (Step S1007) The moving image search device 21 determines whether an instruction receiving unit (not shown) has received an instruction to turn off the power. If accepted, the process proceeds to step S1008; otherwise, the process returns to step S1003.

  (Step S1008) The moving image search device 21 performs power-on processing. Then, the process returns to step S1001.

  In the flowchart of FIG. 10, the processing may be terminated by turning off the power or interrupting the termination of the processing.

  In step S1005 of the flowchart in FIG. 10, the receiving unit 2122 may receive one or both of the captured moving image and the partial moving image from the server device 22. In this case, the output unit 213 outputs the moving image received by the receiving unit 2122 in step S1006 of the flowchart in FIG.

  Next, the overall operation of the server device 22 will be described with reference to the flowchart in FIG.

  (Step S1101) The server storage unit 223 determines whether the server receiving unit 222 has received a captured moving image from the moving image search device 21. If received, the process proceeds to step S1102; otherwise, the process proceeds to step S1105.

  (Step S1102) The server storage unit 223 determines whether or not the target attribute information is added to the captured moving image received in Step S1101. If added, the process proceeds to step S1104; otherwise, the process proceeds to step S1103.

  (Step S1103) The server storage unit 223 acquires target object attribute information using the captured moving image received in Step S1101. Then, the server storage unit 223 adds the target object attribute information to the captured moving image received in step S1101.

  (Step S1104) The server storage unit 223 stores the captured moving image received in step S1101 in the server storage unit 221.

  (Step S1105) The server acquisition unit 224 determines whether or not the server receiving unit 222 has received the search condition from the moving image search device 21. If received, the process proceeds to step S1106; otherwise, the process returns to step S1101. It is assumed that the search condition is associated with device identification information for identifying the moving image search device 21.

  Here, it is assumed that the server storage unit 221 stores m photographed moving images.

  (Step S1106) The server acquisition unit 224 sets 1 to a counter i.

  (Step S1107) The server obtaining unit 224 determines whether the shooting information [i], which is shooting information added to the shooting moving image [i] stored in the server storage unit 221 satisfies the search condition received in step S1105. Determine whether or not. If so, the process proceeds to step S1108; otherwise, the process proceeds to step S1109.

  (Step S1108) The server storage unit 223 acquires the captured moving image [i] from the server storage unit 221.

  (Step S1109) The server acquisition unit 224 determines whether i is m. If m, the process proceeds to step S1111; otherwise, the process proceeds to step S1110.

  (Step S1110) The server acquisition unit 224 increments the counter i by one. Then, the process returns to step S1107.

  (Step S1111) The server transmission unit 225 transmits the captured moving image acquired in step S1108 to the moving image search device 21 identified by the device identification information associated with the search condition received in step S1105. The moving image search device 21 is the moving image search device 21 that has transmitted the search condition received in step S1105. Then, the process returns to step S1101.

  In the flowchart of FIG. 11, the processing may be ended by turning off the power or interrupting the end of the processing.

  In addition, in step S1108 of the flowchart in FIG. 11, the server acquisition unit 224 may acquire a partial moving image that satisfies the search condition from the acquired captured moving image [i].

  The overall operation of the moving image search system 2 described above is only an example. That is, the overall operation of the moving image search system 2 is not limited to the above description.

(Concrete example)
Next, a specific example of the operation of the moving image search system 2 will be described. In this specific example, it is assumed that the server device 22 is a server for operating a so-called video site (hereinafter, appropriately referred to as a server).

(Example 1)
In this example, an example in which one or more photographed moving images are stored in the server device 22 will be described.

  First, it is assumed that a certain user (hereinafter, appropriately referred to as a user A) starts photographing “XX Tower” using his / her smartphone. The smartphone is the moving image search device 21.

  Next, it is assumed that the user A has finished capturing the image of “XX Tower”. Then, the photographed moving image is stored in a predetermined storage area of the smartphone. The shooting moving image is added with shooting time information, shooting position information, and shooting setting information. The shooting time information is information indicating a shooting start time and a shooting end time.

  Next, it is assumed that the user A performs an operation for transmitting a moving image of “XX Tower” to the server on his / her smartphone. Then, the instruction receiving unit (not shown) receives the captured moving image transmission instruction. The shooting moving image transmission instruction is an instruction to transmit the shooting moving image. Then, the transmitting unit (not shown) acquires the captured moving image selected by the captured moving image transmission instruction from a predetermined storage area. The photographed moving image is a moving image of “XX Tower” as described above. Then, the transmitting unit (not shown) transmits the acquired captured moving image to the server.

  Next, the server receiving unit 222 of the server receives the captured moving image. Then, the server storage unit 223 adds the object attribute information “XX tower” to the captured moving image received by the server receiving unit 222. Then, the server storage unit 223 stores the captured moving image in the server storage unit 221.

  It is also assumed that the server receiving unit 222 of the server has received another captured moving image from a smartphone owned by another user (hereinafter, appropriately referred to as user B). The smartphone is a device other than the moving image search device 21 and the server device 22. In addition, it is assumed that the photographed moving image is a moving image of “xx bridge”. Then, the server storage unit 223 adds the object attribute information “xx bridge” to the captured moving image. Then, the server storage unit 223 stores the captured moving image in the server storage unit 221.

  It is also assumed that the server receiving unit 222 of the server has received another captured moving image from a notebook PC owned by another user (hereinafter, appropriately referred to as user C). The notebook PC is a device other than the moving image search device 21 and the server device 22. It is also assumed that the photographed moving image is a moving image that has been photographed by a video camera possessed by the user C and transferred to the notebook PC. In addition, it is assumed that the photographed moving image is a moving image of the state of the athletic meet in which the son of the user C participated. Then, the server storage unit 223 adds the object attribute information “person” to the captured moving image. Then, the server storage unit 223 stores the captured moving image in the server storage unit 221.

  The captured moving image stored in the server storage unit 221 by the server storage unit 223 as described above is, for example, FIG.

(Example 2)
In this example, an example in which the moving image search device 21 receives one or more captured moving images from the server device 22 and outputs the received moving images will be described. In this example, it is assumed that two or more photographed moving images including the photographed moving image in FIG. 5 are stored in the server storage unit 221.

  First, it is assumed that the user has performed an operation to display a screen for inputting search conditions on his / her smartphone. The smartphone is the moving image search device 21. Then, the output unit 213 displays the screen. The screen is, for example, FIG.

  Next, it is assumed that the user inputs search conditions on the screen of FIG. 6 and clicks an “OK” button. Then, the search condition receiving unit 211 receives the search condition input on the screen of FIG. The search condition is, for example, “(2015/3/19 13: 00 ≦ photographing start time ≦ 2015/3/19 15:00) & (photographing position = (N35.1395, E135.2885), 1 km) & ( Shooting direction = west) & (model name: VDCamF03) & (object type = person) ". In addition, the search condition is that the shooting start time is after 13:00 on March 19, 2015 and before 15:00 on March 19, 2015, and the shooting position is (N35. 1395, E135.2885), within a circle with a radius of 1 km, the photographing direction is west, the name of the device used for photographing is “VDCamF03”, and the object The type means a person. Then, the transmitting unit 2121 transmits the search condition received by the search condition receiving unit 211 to the server.

  Next, the server receiving unit 222 of the server receives the search condition transmitted by the smartphone. Then, the server acquisition unit 224 acquires, from the server storage unit 221, a captured moving image to which imaging information satisfying the search condition is added. Here, it is assumed that the server acquisition unit 224 determines that the shooting information added to the shooting moving image of “ID = 013” in FIG. 5 satisfies the search condition. Then, the server acquisition unit 224 acquires the captured moving image of “ID = 013” in FIG. Then, the server transmission unit 225 transmits the captured moving image to the smartphone.

  Next, the receiving unit 2122 of the smartphone receives the captured moving image of “ID = 013” in FIG. Then, the output unit 213 outputs the captured moving image. The output is, for example, a display of one frame (image) of the captured moving image. The output is, for example, the reproduction of the photographed moving image.

  As described above, according to the moving image search system 2 according to the present embodiment, a desired moving image can be searched from two or more moving images based on the time or position at which the moving image was shot. Accordingly, the user has missed, for example, a competitive scene of a children's athletic meet, and thus can search for a moving image in which the competitive scene is captured from videos taken by other parents. In addition, for example, the user can search for a moving image in which he or she is captured from a moving image in which a state of a participating event is captured. In addition, the user can, for example, search for a moving image in which a criminal is captured from moving images captured by a security camera in the city.

  Note that, in the present embodiment, the moving image search device 21 may acquire a captured moving image. In this case, the moving image search device 21 further includes an imaging unit 214 and a transmission unit 215. FIG. 12 is a block diagram of the moving image search device 21 further including the imaging unit 214 and the transmission unit 215. Further, the photographing unit 214 acquires a photographed moving image by photographing. The photographing unit 214 adds photographing information to the photographed moving image, for example, when acquiring the photographed moving image. Note that the method and procedure for adding the shooting information to the shooting moving image are not limited. The photographing unit 214 usually acquires photographing information in a so-called real-time manner, and adds the acquired photographing information to the acquired photographed moving image. Also, the timing of obtaining the shooting information, the timing of adding the shooting information to the shooting video, and the like are the same as the timing of the terminal shooting unit 125 obtaining the shooting information, the timing of the terminal shooting unit 125 adding the shooting information, and the like. The description is omitted.

  The acquisition of the shooting information may be performed by, for example, a shooting information obtaining unit (not shown). The addition of the shooting information to the shooting moving image may be performed by, for example, a shooting information adding unit (not shown). The moving image search device 21 includes the shooting information acquisition unit and the shooting information addition unit.

  The imaging unit 214 can be generally realized by an image sensor (solid-state imaging device) such as a CMOS or a CCD, a camera (digital still camera, digital video camera) using the image sensor, and the like. The processing procedure of the photographing unit 214 is generally realized by software, and the software is recorded on a recording medium such as a ROM.

  Further, the transmission unit 215 transmits to the server device 22 the captured moving image obtained by the imaging unit 214 and having the imaging information added thereto. The transmitting unit 215 is generally realized by a wireless or wired communication unit, but may be realized by a broadcasting unit.

  In the first embodiment, the moving image search system 1 may include one or more photographing devices 31. In this case, the moving image search device 11 (the photographed moving image storage unit 113) receives one or more photographed moving images from the photographing device 31. Further, the imaging device 31 includes a moving image photographing unit 311 and a moving image transmitting unit 312. The moving image photographing unit 311 acquires a photographed moving image. The other processes and operations performed by the moving image capturing unit 311 are the same as the processes and operations performed by the terminal capturing unit 125 or the capturing unit 214, and a description thereof will not be repeated. The moving image transmitting unit 312 transmits the captured moving image acquired by the moving image capturing unit 311 to the moving image search device 11. Then, the moving image search device 11 (the captured moving image storage unit 113) receives the captured moving image transmitted by the moving image transmission unit 312.

  FIG. 13 is a conceptual diagram of the moving image search system 1 provided with the imaging device 31, for example. FIG. 14 is a block diagram of the photographing device 31, for example. The photographing device 31 is, for example, a digital camera, a video camera, or the like. Further, the image capturing device 31 may be, for example, a mobile phone, a smartphone, a tablet PC, or the like having a moving image capturing function.

  In the second embodiment, the moving image search system 2 may include one or more photographing devices 32. In this case, the server device 22 (the server storage unit 223) receives one or more captured moving images from the capturing device 32. The photographing device 32 includes a moving image photographing unit 321 and a moving image transmitting unit 322. The moving image photographing unit 321 acquires a photographed moving image. The other processes and operations performed by the moving image photographing unit 321 are the same as the processes and operations performed by the moving image photographing unit 311 and the description thereof is omitted. The moving image transmitting unit 322 transmits the captured moving image acquired by the moving image capturing unit 321 to the server device 22. Then, the server device 22 (the server storage unit 223) receives the captured moving image transmitted by the moving image transmitting unit 322.

  FIG. 15 is a conceptual diagram of the moving image search system 2 including the imaging device 32, for example. The block diagram of the photographing device 32 is the same as that of FIG. In other words, the block diagram of the photographing device 32 is obtained by replacing the photographing device 31 with the photographing device 32, the moving image photographing unit 311 with the moving image photographing unit 321 and the moving image transmitting unit 312 with the moving image transmitting unit 322 in FIG. Further, the imaging device 32 may be, for example, a mobile phone, a smartphone, a tablet PC, or the like having a moving image imaging function.

  Also, in each of the above embodiments, it goes without saying that two or more communication means existing in one device may be physically realized by one medium.

  Further, in each of the above embodiments, each process or each function may be realized by being centrally processed by a single device or a single system, or may be distributed by a plurality of devices or a plurality of systems. It may be realized by being processed.

  Further, in each of the above embodiments, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

  The software that implements the moving image search device according to each of the above embodiments is, for example, the following program. In other words, the program causes the computer to execute a search condition receiving unit that receives a search condition that is a condition having at least one of a shooting time condition that is a condition regarding a shooting time and a shooting position condition that is a condition regarding a shooting position. One or more photographed moving images to which a moving image to which photographing information that is information having photographing time information that is information indicating time and photographing position information that is information indicating a photographing position is added, and that satisfies the search condition is added. Is a program for causing the camera to function as a photographed moving image acquiring unit that acquires a moving image, and an output unit that outputs the photographed moving image acquired by the photographed moving image acquiring unit.

  Note that, in the above-described program, functions realized by the program do not include functions that can be realized only by hardware.

  The above program may be executed by being downloaded from a server or the like, or a program recorded on a predetermined recording medium (for example, an optical disk such as a CD-ROM, a magnetic disk, a semiconductor memory, or the like) may be read. May be performed by Further, this program may be used as a program constituting a program product.

  The computer that executes the program may be a single computer or a plurality of computers. That is, centralized processing or distributed processing may be performed.

  FIG. 13 is a schematic diagram of a computer system 9 that executes the above-described program to realize the moving image search device and the like of the above-described embodiment. The above-described embodiments can be realized by computer hardware and a computer program executed thereon.

  13, the computer system 9 includes a computer 901 including a CD-ROM drive 9011, a keyboard 902, a mouse 903, and a monitor 904.

  FIG. 14 is a block diagram of the computer system 9. 14, a computer 901 is connected to an MPU 9012, a ROM 9013 for storing a program such as a boot-up program, and a MPU 9012 in addition to a CD-ROM drive 9011, and temporarily stores instructions of an application program. A RAM 9014 for providing a temporary storage space, a hard disk 9015 for storing application programs, system programs, and data, and a bus 9016 for mutually connecting a CD-ROM drive 9011, an MPU 9012, and the like are provided. Although not shown here, the computer 901 may further include a network card that provides a connection to a LAN.

  A program that causes the computer system 9 to execute the functions of the moving image search device or the like according to the above-described embodiment may be stored in the CD-ROM 9101, inserted into the CD-ROM drive 9011, and further transferred to the hard disk 9015. Alternatively, the program may be transmitted to the computer 901 via a network (not shown) and stored in the hard disk 9015. The program is loaded into the RAM 9014 at the time of execution. The program may be loaded directly from the CD-ROM 9101 or a network.

  The program does not necessarily include an operating system (OS) or a third-party program that causes the computer 901 to execute the function of the moving image search device or the like in the above-described embodiment. The program need only include a part of an instruction for calling an appropriate function (module) in a controlled manner and obtaining a desired result. It is well known how the computer system 9 operates, and a detailed description will be omitted.

  In addition, the present invention is not limited to the above embodiments, and various modifications are possible, and it goes without saying that they are also included in the scope of the present invention.

  As described above, the moving image search device according to the present invention has an effect that a desired moving image can be searched from two or more moving images based on the time or position at which the moving image was shot. It is useful as a server device that operates a computer, a mobile terminal that accesses a video site, and the like.

1, 2 video search system 11, 21 video search device 12 terminal device 22 server device 111 captured video storage unit 112, 211 search condition receiving unit 113 captured video storage unit 114, 212 captured video acquisition unit 115, 213 output unit 121 terminal reception Unit 122 terminal transmission unit 123 terminal reception unit 124 terminal output unit 125 terminal imaging unit 214 imaging unit 215 transmission unit 221 server storage unit 222 server reception unit 223 server storage unit 224 server acquisition unit 225 server transmission unit 2121 transmission unit 2122 reception unit

Claims (8)

A search that accepts a search condition that includes at least an object attribute condition that is a first image including an object to be searched and a shooting setting condition that includes a subject distance at the time of shooting in a camera setting at the time of shooting. A condition reception unit,
A moving image to which shooting information including shooting time information indicating shooting time, shooting position information indicating a shooting position, and shooting setting information including a subject distance at the time of shooting is added, and an object attribute included in the search condition Acquisition of a photographic image including a photographic image including an object appearing in a first image as a condition and to which photographic setting information including a subject distance satisfying the photographic setting condition included in the search condition is added. Department and
The photographing video search device Ru and an output unit for moving image obtaining unit outputs the imaging videos acquired. The moving image search device according to claim 1 , wherein the shooting information is target attribute information indicating an attribute of the shot target object, and also includes target object attribute information that is a second image . The search condition receiving unit receives a search condition having at least a shooting setting condition including a focal length at the time of shooting in the setting of the camera at the time of shooting,
The shooting setting information includes a focal length at the time of shooting,
3. The moving image search device according to claim 1 , wherein the captured moving image acquisition unit acquires a captured moving image that also satisfies the shooting setting condition including the focal length . 4. The captured moving image acquisition unit is a portion that satisfies the search condition from the captured moving image determined to satisfy the search condition, and also obtains a partial moving image that is a part of the captured moving image,
4. The moving image search device according to claim 1, wherein the output unit outputs one or both of the photographed moving image and the partial moving image acquired by the photographed moving image acquiring unit. 5. The camera further includes a shooting moving image storage unit in which two or more shooting moving images are stored,
The search condition receiving unit receives the search condition from a terminal device,
The captured moving image acquiring unit acquires the captured moving image satisfying the search condition from the captured moving image storage unit,
The moving image search device according to claim 1, wherein the output unit transmits the captured moving image acquired by the captured moving image acquisition unit to the terminal device. A transmitting unit configured to transmit the search condition received by the search condition receiving unit to two or more server devices holding two or more of the captured moving images, and a transmission unit that transmits the search condition. Receiving means for receiving the captured moving image satisfying the search condition from the two or more server devices,
The moving image search device according to claim 1, wherein the output unit outputs the captured moving image received by the receiving unit. A moving image search method performed using a search condition receiving unit, a captured moving image acquisition unit, and an output unit,
The search condition receiving unit , an object attribute condition is a first image of the object to be searched is captured , and shooting setting conditions including the subject distance at the time of shooting in the camera settings at the time of shooting , A search condition receiving step of receiving at least a search condition having;
The moving image acquisition unit is a moving image to which shooting information including shooting time information indicating a shooting time, shooting position information indicating a shooting position, and shooting setting information including a subject distance at the time of shooting is added. A photographed image including a target object appearing in a first image that is a target attribute condition included in a condition, and a photographed image to which photographing setting information including a subject distance satisfying the photographing setting condition included in the search condition is added. A shooting video obtaining step for obtaining a video,
The output unit, video search method and an output step of outputting the captured video obtained by the photographing video acquisition step. Computer
A search that accepts a search condition that includes at least an object attribute condition that is a first image including an object to be searched and a shooting setting condition that includes a subject distance at the time of shooting in a camera setting at the time of shooting. Condition reception department,
A moving image to which shooting information including shooting time information indicating shooting time, shooting position information indicating a shooting position, and shooting setting information including a subject distance at the time of shooting is added, and an object attribute included in the search condition Acquisition of a photographic image including a photographic image including an object appearing in a first image as a condition and to which photographic setting information including a subject distance satisfying the photographic setting condition included in the search condition is added. Department,
A program for functioning as an output unit that outputs the captured moving image acquired by the captured moving image acquisition unit.

Images