WO2020003584A1 - Recording control device, vehicle photography device, recording control method, and program - Google Patents

Recording control device, vehicle photography device, recording control method, and program Download PDF

Info

Publication number
WO2020003584A1
WO2020003584A1 PCT/JP2019/005419 JP2019005419W WO2020003584A1 WO 2020003584 A1 WO2020003584 A1 WO 2020003584A1 JP 2019005419 W JP2019005419 W JP 2019005419W WO 2020003584 A1 WO2020003584 A1 WO 2020003584A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
video data
photo
tendency
analysis
Prior art date
Application number
PCT/JP2019/005419
Other languages
French (fr)
Japanese (ja)
Inventor
丈介 石川
伸吾 東谷
Original Assignee
株式会社Ｊｖｃケンウッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社Ｊｖｃケンウッド filed Critical 株式会社Ｊｖｃケンウッド
Publication of WO2020003584A1 publication Critical patent/WO2020003584A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording

Definitions

  • the present invention relates to a recording control device, a vehicle photographing device, a recording control method, and a program.
  • the present invention has been made in view of the above, and has an object to record, for example, landscapes, buildings, stores, installations, plants, animals, moving objects, and the like that match the user's preferences.
  • a recording control device includes a video data acquisition unit that acquires video data from a photographing unit that photographs a surrounding scenery, and a user who is interested.
  • An interest specifying unit for specifying an object
  • an analyzing unit for analyzing a tendency of the target of interest specified by the interest specifying unit, and a trend analyzed by the analyzing unit from the video data acquired by the video data acquiring unit.
  • a search unit that searches for video data included in the search unit; and a recording processing unit that, when the search unit determines that there is video data included in the tendency analyzed by the analysis unit, records the video data. It is characterized by the following.
  • a vehicle photographing device includes the above-described recording control device and a photographing unit that photographs surrounding scenery.
  • the recording control method includes: a video data obtaining step of obtaining video data from a photographing unit that captures a surrounding scenery; an interest specifying step of specifying an object of interest to a user; An analyzing step of analyzing a tendency of an object of interest identified by the step; a searching step of searching video data acquired by the video data acquiring step for video data included in the trend analyzed by the analyzing step; When it is determined that there is video data included in the tendency analyzed by the analysis step, the recording step includes recording the video data.
  • the program according to the present invention includes: a video data obtaining step of obtaining video data from a shooting unit that captures a surrounding landscape; an interest specifying step of specifying an object of interest to the user; and the interest specifying step.
  • An analyzing step of analyzing the tendency of the identified object of interest a search step of searching for video data included in the trend analyzed by the analysis step, from the video data obtained by the video data obtaining step, If the analysis step determines that there is video data included in the analyzed tendency, a recording processing step of recording the video data is performed by a computer operating as a recording control device.
  • FIG. 1 is a block diagram illustrating a configuration example of a vehicular photographing apparatus having a recording control device according to the first embodiment.
  • FIG. 2 is a flowchart illustrating a flow of processing in the recording control device according to the first embodiment.
  • FIG. 3 is a flowchart illustrating a flow of processing in the recording control device according to the first embodiment.
  • FIG. 4 is a block diagram illustrating a configuration example of a vehicular photographing apparatus having a recording control device according to the second embodiment.
  • FIG. 5 is a flowchart illustrating a processing flow in the recording control device according to the second embodiment.
  • FIG. 6 is a flowchart showing the flow of processing in the photo analysis server.
  • FIG. 1 is a block diagram illustrating a configuration example of a vehicular photographing apparatus having a recording control device according to the first embodiment.
  • FIG. 2 is a flowchart illustrating a flow of processing in the recording control device according to the first embodiment.
  • FIG. 3 is a flowchart
  • FIG. 7 is a block diagram illustrating a configuration example of a vehicle photographing apparatus having a recording control device according to the third embodiment.
  • FIG. 8 is a flowchart illustrating a processing flow in the recording control device according to the third embodiment.
  • FIG. 9 is a block diagram illustrating a configuration example of a vehicular photographing apparatus having a recording control device according to the fourth embodiment.
  • FIG. 10 is a flowchart illustrating a flow of processing in the recording control device according to the fourth embodiment.
  • FIG. 11 is a block diagram showing a configuration example of a vehicular photographing apparatus having a recording control device according to the fifth embodiment.
  • FIG. 12 is a flowchart illustrating a processing flow in the recording control device according to the fifth embodiment.
  • FIG. 13 is a flowchart illustrating a flow of processing in the recording control device according to the fifth embodiment.
  • FIG. 1 is a block diagram illustrating a configuration example of a vehicular photographing apparatus having a recording control device according to the first embodiment.
  • the vehicle photographing apparatus 1 photographs and records, for example, a landscape, a building, a store, an installed object, a plant, an animal, a moving object, or the like that matches the user's preference from video data obtained by photographing the periphery of the vehicle. To match the user's preference is to match the user's interests. In the present embodiment, it is assumed that the object of interest of the user is analyzed from the photograph data stored in the user terminal device 100.
  • the user terminal device 100 is a portable electronic device including, for example, a smartphone, which is carried by the user and brought into the vehicle.
  • the vehicle photographing device 1 may be a portable device that can be used in a vehicle, in addition to the device mounted on the vehicle.
  • the vehicle photographing apparatus 1 includes a camera (photographing unit) 20, a storage unit 30, a first communication unit 40, and a control unit (recording control device) 50.
  • the camera 20 is a camera that captures a scene around the vehicle.
  • the camera 20 is described as a camera capable of photographing the entire 360 ° circumference, but is not limited to this, and may be a plurality of camera groups that respectively photograph the periphery of the vehicle.
  • the camera 20 is disposed, for example, above a windshield of a vehicle.
  • the camera 20 constantly captures a landscape around the vehicle from the start of the operation of the vehicle to the stop thereof, such as when the engine is started.
  • the camera 20 outputs the captured video data to the video data acquisition unit 51 of the control unit 50.
  • the video data is, for example, a moving image composed of 30 frames per second.
  • the storage unit 30 is used for temporarily storing data in the vehicular photographing apparatus 1 or the like.
  • the storage unit 30 includes a buffer memory 31 and a memory 32.
  • the buffer memory 31 temporarily stores the video data captured by the camera 20 based on the control of the recording processing unit 56 of the control unit 50.
  • the buffer memory 31 is, for example, a RAM (Random Access Memory).
  • the memory 32 records video data captured by the camera 20 under the control of the recording processing unit 56.
  • the memory 32 is, for example, a semiconductor memory device such as a flash memory (Flash @ Memory), or a hard disk or an optical disk. Alternatively, the memory 32 may be an external storage unit wirelessly connected via a communication device (not shown).
  • the first communication unit 40 is a communication unit.
  • the first communication unit 40 connects to the user terminal device 100 so that data can be transmitted and received.
  • the first communication unit 40 is capable of short-range wireless communication including, for example, Near Field Communication (NFC) or Bluetooth (registered trademark).
  • NFC Near Field Communication
  • Bluetooth registered trademark
  • the control unit 50 is an arithmetic processing device (control device) including, for example, a CPU (Central Processing Unit).
  • the control unit 50 loads the program stored in the storage unit 30 into the memory, and executes an instruction included in the program.
  • the control unit 50 includes a video data acquisition unit 51, a first communication control unit 52, a photograph identification unit (interest and interest identification unit) 53, an analysis unit 54, a search unit 55, and a recording processing unit 56.
  • the control unit 50 includes an internal memory (not shown), and the internal memory is used for temporary storage of data in the control unit 50 and the like.
  • the video data acquisition unit 51 acquires video data around the vehicle. More specifically, the video data acquisition unit 51 acquires the video data output by the camera 20. The video data acquisition unit 51 outputs the acquired video data to the search unit 55 and the recording processing unit 56.
  • the first communication control unit 52 controls communication via the first communication unit 40.
  • the first communication control unit 52 connects to the user terminal device 100 via the first communication unit 40 under the control of the photo specifying unit 53.
  • the photo specifying unit 53 is an interest specifying unit that specifies a target that the user is interested in. In the present embodiment, an object that the user is interested in is specified by the photograph data.
  • the photo specifying unit 53 specifies photo data relating to the user as an analysis target. In the present embodiment, the photograph data related to the user is photograph data of a photograph taken by the user.
  • the photo specifying unit 53 outputs the specified photo data to the analyzing unit 54.
  • the photo specifying unit 53 specifies photo data captured by the user and recorded in the user terminal device 100 connected via the first communication unit 40. Whether the photograph data is photographed by the user can be determined by, for example, photographing terminal information of the photograph data, photographer information, or a folder in which the photograph data is stored. Alternatively, all of the photograph data recorded in the user terminal device 100 may be photograph data photographed by the user.
  • the photo specifying unit 53 may specify the object to be photographed in a limited number of pieces of the photograph data photographed by the user.
  • the subject of the photograph data may be specified based on tag information indicating the type of the subject, which is recorded together with the photograph data at the time of photographing or recording.
  • tag information indicating the type of the subject, which is recorded together with the photograph data at the time of photographing or recording.
  • the user terminal device 100 performs image processing to extract only the photo data of the specific object. You may do so.
  • a signal for acquiring landscape photograph data is output from the photo specifying unit 53 to the user terminal device 100, and image processing is performed in the user terminal device 100 to extract landscape photograph data. May be performed.
  • the analysis unit 54 analyzes the tendency of the photo data specified by the photo specification unit 53. In other words, the analysis unit 54 analyzes the tendency of the user's preference by analyzing the tendency of the user's interest based on the photograph data specified by the photograph specifying unit 53.
  • the analysis unit 54 analyzes the tendency of the user's preference according to the tendency of the photographed object in the photograph data. Further, for example, the analysis unit 54 may analyze the tendency of the user's preference based on the tendency of the color of the photograph data. Further, for example, the analysis unit 54 may analyze the tendency of the user's preference based on the tendency of the configuration of the photograph data. The analysis unit 54 outputs the analysis result to the search unit 55 as trend information.
  • the analysis unit 54 analyzes the tendency of the photograph data after recognizing the photographed object when the photographed object of the specified photograph data is not limited.
  • the analysis unit 54 performs image processing on the specified photograph data, recognizes the photographed object using the recognition dictionary data, and analyzes the tendency based on the number of photographs for each photographed object.
  • the analysis unit 54 analyzes an object that the user is interested in based on the number of photographs for each object to be photographed or the number of photographs in the latest months.
  • the analysis unit 54 analyzes a subject having a large number of photographs as having high interest. It should be noted that the objects to be imaged may be counted by roughly classifying roughly similar objects into a large classification or by fine classification.
  • the analysis unit 54 analyzes that, for example, when there is a lot of photographic data of a natural landscape or a cityscape, the interest in the landscape is high. Alternatively, for example, the analysis unit 54 may analyze the natural scenery or the cityscape with a fine classification if the interest is high.
  • the analysis unit 54 analyzes that if there is a lot of photographic data of a landmark such as a castle or a bridge, or a building having a characteristic shape such as a historic building or a skyscraper, the building is of high interest. I do.
  • the analysis unit 54 may analyze, for example, a castle, a bridge, a historic building, or a high-rise building with a high degree of interest in a fine classification.
  • the analysis unit 54 analyzes that, for example, when there is a large amount of photographic data of the exterior or interior of the store, the store is highly interested in the store. Furthermore, if the analysis unit 54 can specify the type of store such as a ramen shop or a confectionery store from the photograph data of the store or the photograph data of food including food, the analysis unit 54 is interested in a particular type of store. May be analyzed as high.
  • the analysis unit 54 analyzes that, for example, when there is a lot of photographic data of food including food, the interest is high in the food.
  • the analysis unit 54 analyzes that there is a high interest in a special signboard, a manhole, a sign, a sign, or a bulletin board. I do.
  • the analysis unit 54 analyzes that there is a high degree of interest in plants when there are many photographic data of plants that have reached their peak, such as cherry blossoms and autumn leaves, or rare plants. Alternatively, the analysis unit 54 may analyze, for example, cherry, autumn leaves, or unusual plants with a high degree of interest in a fine classification.
  • the analysis unit 54 analyzes that there is a high interest in an animal when there is a lot of photographic data of an animal such as a dog, a cat, a bird, a deer, a monkey, or a bear.
  • the analysis unit 54 may analyze, for example, a dog, a cat, a bird, a deer, a monkey, or a bear that has a high interest level in a fine classification.
  • the analysis unit 54 analyzes that the interest in the moving object is high when there are many pieces of photographic data of the moving object such as an automobile, a motorcycle, a special vehicle, a train, or an airplane.
  • the analysis unit 54 may analyze, for example, a car, a motorcycle, a special vehicle, a train, or an airplane with a high degree of interest in a fine classification.
  • the analysis unit 54 may analyze the tendency of the photographic data by using AI (Artificial Intelligence) processing.
  • AI Artificial Intelligence
  • the analysis unit 54 may determine the subject based on the similarity with other photographic data obtained by analyzing the subject.
  • the analysis unit 54 may limit the trend to the landscape photo data by using the AI process and then analyze the tendency.
  • the analysis unit 54 analyzes that, for example, photograph data in which a person is largely reflected, photograph data in which a large number of persons are photographed, and photograph data in which an object such as a vehicle or a dish is largely reflected are not landscape photograph data.
  • the analysis unit 54 may determine the landscape photo data based on the similarity with other photo data analyzed as the landscape photo data.
  • the analysis unit 54 may analyze the tendency of the photograph data based on the tendency of the color of the photograph data.
  • the analysis unit 54 analyzes the tendency of the color of high interest.
  • the analysis unit 54 may analyze the tendency of the color of the landscape photograph data.
  • the analysis unit 54 performs image processing on the landscape photo data, obtains the number of pixels for each color information with respect to the total number of pixels of the landscape photo data, and analyzes the color tendency based on the ratio of the color information.
  • the color tendency is, for example, a color with a high ratio among red, yellow, orange, green, cyan, blue, magenta, brown, beige, black, white, dark gray, and light gray. And In the color information, similar colors are grouped into roughly classified large colors.
  • the analysis unit 54 may analyze the configuration of the photographic data using AI processing.
  • the analysis unit 54 may analyze the configuration based on the similarity with other photographic data whose configuration has been analyzed.
  • the analysis unit 54 analyzes the tendency of the configuration having high interest.
  • the analysis unit 54 may use AI processing to analyze the configuration of the landscape photograph data.
  • the analysis unit 54 for example, based on the similarity with other photograph data that is considered to be landscape photograph data, can include sea landscape photograph data, valley landscape photograph data, mountain landscape photograph data, and cityscape landscape photograph.
  • a class having a particularly high ratio in the classification of the data or the scenery photograph data of the sunset may be of high interest.
  • the search unit 55 searches the video data acquired by the video data acquisition unit 51 for video data included in the tendency analyzed by the analysis unit 54.
  • the search unit 55 continuously determines whether or not the video data acquired by the video data acquisition unit 51 is included in the tendency analyzed by the analysis unit 54 while the vehicle imaging device 1 is shooting. In other words, the search unit 55 continuously determines whether or not the video data acquired by the video data acquisition unit 51 matches the user's preference while the vehicle imaging device 1 is shooting.
  • continuous means, for example, every predetermined frame such as every frame of video data, every 5 to 10 frames, or every predetermined time such as every 1 second.
  • the search unit 55 determines that the video data acquired by the video data acquisition unit 51 is included in the tendency analyzed by the analysis unit 54, the search unit 55 issues a storage request instruction to the recording processing unit 56. In other words, when video data matching the user's preference is captured, the search unit 55 issues a storage request instruction to the recording processing unit 56.
  • the search unit 55 may be configured to search the video data acquisition unit 51 temporarily stored in the buffer memory 31 for video data included in the tendency analyzed by the analysis unit 54.
  • ⁇ ⁇ Being included in the trend may include not only those having the same tendency but also those having the similar tendency.
  • the search unit 55 searches the video data acquired by the video data acquisition unit 51 for video data in which an object included in the tendency analyzed by the analysis unit 54 is shown.
  • the search unit 55 searches the video data acquired by the video data acquisition unit 51 for video data showing the landscape.
  • the search unit 55 searches the video data acquired by the video data acquisition unit 51 for video data showing the ramen shop.
  • the search unit 55 has a line in front of the store in the video data acquired by the video data acquisition unit 51, or The video data showing the ramen shop where the parking lot is crowded may be searched.
  • the search unit 55 searches the video data acquired by the video data acquisition unit 51 for video data on which the special signboard is projected.
  • the search unit 55 searches the video data acquired by the video data acquisition unit 51 for video data of color information included in the tendency analyzed by the analysis unit 54.
  • the search unit 55 displays the orange or red sunset scene in the video data acquired by the video data acquisition unit 51. Search for the video data that is present.
  • the search unit 55 searches the video data acquired by the video data acquisition unit 51 for video data having a configuration included in the tendency analyzed by the analysis unit 54.
  • the recording processing unit 56 records the video data in the memory 32 of the storage unit 30 in response to a save request instruction from the search unit 55. More specifically, the recording processing unit 56 includes, in the video data obtained by the video data obtaining unit 51 based on the search result of the search unit 55, video data of the subject included in the tendency analyzed by the analysis unit 54. In this case, the video data is recorded in the memory 32 of the storage unit 30. When there is video data included in the color tendency analyzed by the analysis unit 54 based on the search result of the search unit 55, the recording processing unit 56 records the video data. When there is video data included in the configuration tendency analyzed by the analysis unit 54 based on the search result of the search unit 55, the recording processing unit 56 records the video data.
  • the recording processing unit 56 transmits the video data captured by the camera 20 to the buffer memory 31 while the storage unit 30 is operating or after receiving the storage request instruction from the search unit 55, for example, for 60 seconds. Then, a video file is generated for each video of a predetermined period, such as a video, and stored in the memory 32. When the capacity of the memory 32 becomes full, the recording processing unit 56 may perform a loop recording process of overwriting the oldest video data.
  • the recording processing unit 56 when the recording processing unit 56 receives the storage request instruction from the search unit 55, the recording processing unit 56 continues the video data for a predetermined period of about 10 seconds before or after the reception of the storage request instruction, or continues the storage request instruction.
  • the video data during the receiving period is recorded in the memory 32 so as not to be overwritten, or transmitted to the user terminal device 100 via an external recording device (not shown), the first communication unit 40 or the like, and recorded.
  • the video data recorded by the recording processing unit 56 in response to the storage request instruction is, for example, the same moving image data as the loop-recorded video data, or still image data for each predetermined frame constituting the moving image data.
  • the video data to be recorded may be still image data when recorded in the memory 32, and may be moving image data when recorded on an external recording device or the user terminal device 100.
  • FIG. 2 is a flowchart illustrating a flow of processing in the recording control device according to the first embodiment.
  • FIG. 3 is a flowchart illustrating a flow of processing in the recording control device according to the first embodiment.
  • the camera 20 photographs video data around the vehicle including the periphery of the vehicle.
  • the video data acquisition unit 51 constantly acquires video data captured by the camera 20.
  • the vehicle imaging device 1 and the user terminal device 100 are connected to be able to transmit and receive data.
  • a case in which extraction is limited to landscape photograph data will be described.
  • the control unit 50 determines whether there is a paired user terminal device 100 (Step S101). More specifically, the control unit 50 determines whether the first communication unit 60 has a user terminal device 100 paired by, for example, an NFC connection and connected by Bluetooth.
  • the connection form of the first communication unit 60 with the user terminal device 100 is not limited to the Bluetooth connection, and is simply described as connection below.
  • the control unit 50 specifies, by the photo specifying unit 53, photo data captured by the user and stored in the connected user terminal device 100 (step S102). The control unit 50 proceeds to Step S103.
  • the control unit 50 extracts the landscape photograph data from the photograph data specified by the analysis unit 54 (step S103). The control unit 50 proceeds to Step S104.
  • the control unit 50 analyzes the tendency of the extracted landscape photograph data by the analysis unit 54 (step S104). More specifically, the control unit 50 analyzes the landscape photograph data by using the recognition dictionary data and performing the AI processing by the analysis unit 54. Further, the control unit 50 may use the analysis unit 54 to analyze at least one of the color tendency and the composition tendency of the landscape photograph data. In this manner, the control unit 50 causes the analysis unit 54 to analyze the user's preference tendency based on the photo data specified by the photo specification unit 53. The control unit 50 ends the processing.
  • the control unit 50 starts loop recording by the recording processing unit 56 (step S111). More specifically, the control unit 50 stores the video data captured by the camera 20 in the buffer memory while the storage unit 30 is operating or after the storage request instruction is received from the search unit 55 by the recording processing unit 56. For example, a video file is generated for each video of a predetermined period, such as every 60 seconds, and stored in the memory 32. The control unit 50 proceeds to Step S112.
  • the control unit 50 uses the search unit 55 to determine whether there is video data that is close to the trend information, in other words, that matches the user's interest and interest (step S112). More specifically, the control unit 50 uses the search unit 55 to search for video data included in the trend information that is the analysis result analyzed by the analysis unit 54. When the search unit 55 searches for video data included in the trend information (Yes in step S112), the control unit 50 proceeds to step S113. When the search unit 55 has not searched for the video data included in the trend information (No in Step S112), the control unit 50 proceeds to Step S114.
  • control unit 50 When there is video data close to the trend information (Yes in step S112), the control unit 50 causes the recording processing unit 56 to record video data or still image data close to the trend information in the memory 32 of the storage unit 30 (step S113). ). The control unit 50 causes the recording processing unit 56 to record video data or still image data matching the user's interest. The control unit 50 proceeds to Step S114.
  • the control unit 50 determines whether to end the loop recording (Step S114). More specifically, the control unit 50 ends the loop recording when an operation of stopping the recording of the video data is performed or when a control signal for stopping the recording is received from the recording processing unit 56 (Yes in step S114). And terminate the processing. When the operation of stopping the recording of the video data is not performed and the control signal for stopping the recording is not received from the recording processing unit 56 (No in Step S114), the control unit 50 returns to Step S112. Execute the process again.
  • the tendency of the user's interest is analyzed from the photograph data of the photograph taken by the user stored in the user terminal device 100. If the captured video data is close to the analyzed tendency, it is recorded in the memory 32 of the storage unit 30 or the like without overwriting.
  • the tendency of the user's interest is analyzed from the photograph data of the photograph taken by the user stored in the user terminal device 100.
  • the captured video data if it is close to the analyzed tendency, it can be recorded in the memory 32 of the storage unit 30 or the like without overwriting.
  • landscapes, buildings, stores, installed objects, plants, animals, moving objects, and the like that match the user's preferences can be automatically recorded.
  • the tendency of the user's interest is analyzed from the photographed object, the color tendency, and the composition tendency of the photograph data. Accordingly, the present embodiment can more appropriately analyze the tendency of the user's preference.
  • FIG. 4 is a block diagram illustrating a configuration example of a vehicular photographing apparatus having a recording control device according to the second embodiment.
  • FIG. 5 is a flowchart illustrating a processing flow in the recording control device according to the second embodiment.
  • FIG. 6 is a flowchart showing the flow of processing in the photo analysis server.
  • the basic configuration of the vehicle photographing apparatus 1A is the same as that of the vehicle photographing apparatus 1 of the first embodiment.
  • the same components as those of the vehicle photographing apparatus 1 are denoted by the same reference numerals or corresponding reference numerals, and detailed description thereof will be omitted.
  • the vehicle photographing apparatus 1A has a second communication unit 42A that is connected to the SNS (Social Networking Service) server apparatus 110 and the photo analysis server apparatus 120 so as to be able to communicate with each other, and the processing in the control unit 50A.
  • SNS Social Networking Service
  • the object of interest of the user is to specify and analyze photo data from a photo sharing site such as SNS as photo data related to the user.
  • the SNS server device 110 is, for example, a server device of a photo sharing site.
  • the photo analysis server device 120 has the function of the analysis unit 54 in the first embodiment.
  • the photo analysis server device 120 analyzes the tendency of the user's preference based on the photo data specified by the photo specifying unit 53A.
  • the photo analysis server device 120 outputs the analysis result to the control unit 50A.
  • the vehicle imaging device 1A includes the camera 20, the storage unit 30, the first communication unit 40, the second communication unit 42A, and the control unit 50A.
  • the second communication unit 42A is a communication unit.
  • the second communication unit 42A connects to the SNS server device 110 so that data can be transmitted and received.
  • the second communication unit 42A is capable of wireless communication such as Wi-Fi (registered trademark), 4G, and 5G.
  • the control unit 50A includes a video data acquisition unit 51, a first communication control unit 52, a photo identification unit 53A, an analysis unit 54A, a search unit 55, a recording processing unit 56, and a second communication control unit 57A. Have.
  • the photo specifying unit 53A acquires information for specifying the photo data that the user has published on the web via the photo sharing site.
  • the photo specifying unit 53A acquires site information including account information and connection destination information of the photo sharing site stored in the user terminal device 100 connected via the first communication unit 40.
  • the photo specifying unit 53A acquires information for specifying the photo data in the photo sharing site that is frequently viewed by the user in the photo sharing site where the third party discloses the photo data on the web. More specifically, the photo specifying unit 53A stores a third-party photo sharing site, such as a browsing history of a photo sharing site or a bookmark, stored in the user terminal device 100 connected via the first communication unit 40. Get site information including connection destination information.
  • a third-party photo sharing site such as a browsing history of a photo sharing site or a bookmark
  • the photo specifying unit 53A outputs the site information to the analyzing unit 54A, and causes the analyzing unit 54A to execute a photo analysis.
  • the analysis unit 54A When the analysis unit 54A receives the analysis instruction and the site information from the photo identification unit 53A, the analysis unit 54A instructs the photo analysis server device 120 to extract a photo and perform a trend analysis via the second communication unit 42A.
  • the analysis unit 54A provides the photo analysis server device 120 with information for specifying the photo data, for example, site information on the web.
  • the analysis unit 54A connects to the photo sharing site via the second communication unit 42A based on the site information.
  • the analysis unit 54A specifies and analyzes the photo data posted in the user account on the photo sharing site.
  • the analysis unit 54A connects to the photo sharing site via the second communication unit 42A based on the site information.
  • the analysis unit 54A identifies and analyzes photo data that is posted on a photo sharing site by a third party and is frequently viewed by the user.
  • the analysis unit 54 ⁇ / b> A publishes a photo published by the user on the web via the photo sharing site, or a third party publishes the photo on the web via the photo sharing site, and the user frequently browses the photo.
  • analysis may be limited to landscape photo data.
  • the second communication control unit 57A controls communication via the second communication unit 42A.
  • the second communication control unit 57A connects to the SNS server device 110 via the second communication unit 42A under the control of the photo specifying unit 53A.
  • the second communication control unit 57A connects to the photo analysis server device 120 via the second communication unit 42A under the control of the analysis unit 54A.
  • step S201 performs the same process as step S101 in the flowchart shown in FIG.
  • step S101 in the flowchart shown in FIG.
  • the control unit 50A acquires the site information of the photo sharing site by the photo specifying unit 53A (Step S202). More specifically, the control unit 50A acquires the site information of the photo sharing site stored in the user terminal device 100 connected via the first communication unit 40 by the photo specifying unit 53A. Alternatively, the control unit 50A may store, for example, a browsing history of a photo sharing site, a third party such as a bookmark stored in the user terminal device 100 connected via the first communication unit 40 by the photo specifying unit 53A. Get the site information of the photo sharing site.
  • the control unit 50A causes the analysis unit 54A to instruct the photo analysis server device 120 to extract a photo and perform a trend analysis via the second communication unit 42A (step S203).
  • the control unit 50A determines whether the trend information, which is the analysis result of the trend analysis, has been received from the photo analysis server device 120 via the second communication unit 42A (step S204). When receiving the trend information from the photo analysis server device 120 via the second communication unit 42A (Yes in step S204), the control unit 50A proceeds to step S205. If the control unit 50A has not received the trend information from the photo analysis server device 120 via the second communication unit 42A (No in Step S204), the control unit 50A executes the process of Step S204 again.
  • the control unit 50A acquires the analysis result of the trend analysis from the photo analysis server device 120 via the second communication unit 42A (Step S205).
  • the photo analysis server device 120 extracts the landscape photo data from the specified photo sharing site based on the site information from the analysis unit 54A of the control unit 50A (step S211). More specifically, the photo analysis server device 120 connects to the photo sharing site via the second communication unit 42A based on the site information, and converts the landscape photo data posted on the photo sharing site with the user's account. Extract. Alternatively, the photo analysis server device 120 connects to the photo sharing site via the second communication unit 42A based on the site information, is posted on the photo sharing site by a third party, and the user browses frequently. Scenery photo data is extracted.
  • the photo analysis server device 120 analyzes the tendency of the extracted landscape photo data (step S212).
  • the photo analysis server device 120 transmits the analysis result to the control unit 50A via the second communication unit 42A (Step S213).
  • the user can start from the photo data published on the web by the user via the photo sharing site or the photo data posted on the photo sharing site by a third party and frequently viewed by the user. Analyze trends in interests of interest.
  • FIG. 7 is a block diagram illustrating a configuration example of a vehicle photographing apparatus having a recording control device according to the third embodiment.
  • FIG. 8 is a flowchart illustrating a processing flow in the recording control device according to the third embodiment.
  • the basic configuration of the vehicle photographing apparatus 1B is the same as that of the vehicle photographing apparatus 1 of the first embodiment.
  • the vehicle imaging device 1B differs from the first embodiment in that the control unit 50B includes a verification unit 58B.
  • the verification unit 58B verifies whether the video data searched by the search unit 55 is a correct search result.
  • the verification unit 58B for example, based on at least one of shooting location information, shooting date and time information, map information, and vehicle direction information of the video data searched by the search unit 55, determines that the video data is correct. Verify that it is data.
  • the verification unit 58B reflects the sea if the shooting location information, the map information, and the vehicle orientation information of the video data are places where the sea can be seen. It is determined that the image data is correct, and if it is a place where the sea is not visible, it is determined that the video data is not an image of the sea but is erroneously searched.
  • the analysis unit 54 analyzes the tendency of the sunset as a landscape, if the shooting date and time information of the video data is before and after sunset, the verification unit 58B determines that the video data reflects the sunset and is correct.
  • the verification unit 58B instructs the recording processing unit 56 to output a storage request instruction.
  • steps S301, S302, S304, and S305 is similar to the processing of steps S111, S112, S113, and S114 of the flowchart shown in FIG.
  • the control unit 50B determines whether the video data is incorrect video data using the verification unit 58B (step S303). When the verification unit 58B determines that the video data is not the video data that was erroneously searched (Yes in Step S303), the control unit 50B proceeds to Step S304. When the verification unit 58B determines that the video data is video data that has been erroneously searched (No in Step S303), the control unit 50B proceeds to Step S305.
  • the search unit 55 verifies whether the searched video data is a correct search result, and when it is determined that the video data is correct, the captured video data is stored in the memory 32 of the storage unit 30 or the like. Record without overwriting.
  • the captured video data can be recorded in the memory 32 of the storage unit 30 without overwriting. According to the present embodiment, the validity of video data to be recorded can be increased.
  • FIG. 9 is a block diagram illustrating a configuration example of a vehicular photographing apparatus having a recording control device according to the fourth embodiment.
  • FIG. 10 is a flowchart illustrating a flow of processing in the recording control device according to the fourth embodiment.
  • the basic configuration of the vehicle photographing apparatus 1C is the same as that of the vehicle photographing apparatus 1 of the first embodiment.
  • the vehicle photographing apparatus 1C differs from the first embodiment in that the control unit 50C includes a second communication control unit 57C and a photo disclosure unit 59C, and the processing in the search unit 55C.
  • the search unit 55C issues a storage request instruction to the recording processing unit 56
  • the search unit 55C issues a disclosure request instruction to the photo publication unit 59C.
  • the second communication control unit 57C controls communication via the second communication unit 42C.
  • the second communication control unit 57C connects to the SNS server device 110 via the second communication unit 42C under the control of the photo disclosure unit 59C.
  • the photo publishing unit 59C publishes the moving image data or the still image data recorded by the recording processing unit 56 on the web via the second communication unit 42C via the photo sharing site used by the user. .
  • the photo publishing unit 59C sends moving image data or still image data to the user terminal device 100 via the first communication unit 40, and is used by the user via wireless communication such as 4G or 5G provided in the user terminal device 100. It may be made public on the web via a photo sharing site.
  • steps S401 to S403 and S405 are the same as those in steps S111 to S113 and S114 in the flowchart shown in FIG.
  • the control unit 50C transmits the moving image data or the still image data recorded by the recording processing unit 56 by the photo publishing unit 59C via the second communication unit 42C via a photo sharing site used by the user. It is made public on the web (step S404).
  • the captured video data is close to the analyzed tendency, it is recorded in the memory 32 of the storage unit 30 or the like without overwriting, and automatically recorded on the web via the photo sharing site used by the user. Publish in.
  • the data is recorded in the memory 32 of the storage unit 30 and the like without overwriting, and is automatically released on the web via the photo sharing site used by the user. can do.
  • the present embodiment automatically records, for example, landscapes, buildings, stores, installed objects, plants, animals, moving objects, and the like that match the user's preference, and also stores the images on the web via a photo sharing site. Can be published automatically.
  • FIG. 11 is a block diagram showing a configuration example of a vehicular photographing apparatus having a recording control device according to the fifth embodiment.
  • FIG. 12 is a flowchart illustrating a processing flow in the recording control device according to the fifth embodiment.
  • FIG. 13 is a flowchart illustrating a flow of processing in the recording control device according to the fifth embodiment.
  • the basic configuration of the vehicle photographing apparatus 1D is the same as that of the vehicle photographing apparatus 1 of the first embodiment.
  • the vehicle imaging device 1D differs from the first embodiment in that the control unit 50D includes an interest specifying unit 53D and the processing in the analysis unit 54D.
  • the interest / interest identification unit 53D identifies, based on the text data, a target that the user is interested in.
  • the interest specifying unit 53D may be configured to input text data of the input history of the user terminal device 100 connected via the first communication unit 40, text data included in schedule information, text data included in mail, or a user. Specifies the text data posted on the SNS as an analysis target.
  • the interest specifying unit 53 ⁇ / b> D may specify a target to which the user has an interest based on browsing history information of a site on the web in the user terminal device 100 connected via the first communication unit 40.
  • the interest specifying unit 53 ⁇ / b> D may specify a target that the user is interested in, based on action history information that can be acquired from the user terminal device 100 connected via the first communication unit 40.
  • the action history information that can be acquired from the user terminal device 100 includes, for example, history information of current location information of the user terminal device 100 or history information of route guidance.
  • the interest specifying unit 53D may specify a target that the user is interested in based on the history information of the destination or the travel route of the navigation device connected via the first communication unit 40. .
  • the analysis unit 54D analyzes the tendency of the text data specified by the interest specifying unit 53D. More specifically, the analysis unit 54D may analyze the tendency of the user's preference from the words included in the specified text data. For example, based on the identified text data, the analysis unit 54D analyzes that the user is highly interested in the sea when a plurality of words indicating the sea are included.
  • the analysis unit 54D analyzes the tendency of the site specified by the browsing history information of the site specified by the interest specifying unit 53D. More specifically, based on the browsing history information of the specified site, the analysis unit 54D connects to the server via a communication device (not shown), and extracts the photo data on the site or words included in the text data from the site. The tendency of the user's preference may be analyzed. For example, based on the browsing history information of the specified site, the analysis unit 54D frequently browses a site in which a plurality of manhole photo data is posted or a site in which a plurality of words indicating a manhole are included. If yes, it is analyzed that the user is interested in the manhole.
  • the analysis unit 54D analyzes the tendency of the action history information specified by the interest specifying unit 53D. More specifically, the analyzing unit 54D analyzes the tendency of the user's preference from the place where the user visits frequently and stays for a predetermined time or more, or the tendency of the place based on the specified action history information. Good. For example, based on the specified action history information, the analysis unit 54D analyzes that the user has a high interest in ramen when staying at the ramen shop for 20 minutes or more every week.
  • the analysis unit 54D analyzes the tendency of the history information of the destination or the history information of the traveling route specified by the interest specifying unit 53D. More specifically, the analysis unit 54D analyzes the tendency of the user's preference from the frequently visited places or the tendency of the places based on the history information of the specified destination or the history information of the travel route. Is also good. For example, based on the history information of the specified destination or the travel route, the analysis unit 54D analyzes that the user is highly interested in cherry blossoms when visiting the place where cherry blossoms are in full bloom multiple times. .
  • steps S501 and S504 perform the same processes as steps S101 and S104 of the flowchart shown in FIG.
  • a case will be described in which text related to landscape is extracted from the text data of the input history.
  • the control unit 50D specifies the text of the input history of the connected user terminal device 100 by the interest specifying unit 53D (step S502).
  • the control unit 50D extracts text related to the landscape from the text data specified by the analysis unit 54D (step S503).
  • steps S511, S513, and 514 are the same as those of steps S111, S113, and S114 of the flowchart shown in FIG.
  • the control unit 50D determines whether there is video data close to the trend information by the search unit 55 (step S512). More specifically, the control unit 50 causes the search unit 55 to search for video data related to the text data indicating the interest analyzed by the analysis unit 54. When the search unit 55 searches for video data related to the text data indicating interest and interest (Yes in step S512), the control unit 50 proceeds to step S513. When the search unit 55 does not search for video data related to the text data indicating interest and interest (No in step S512), the control unit 50 proceeds to step S514.
  • text data that can be acquired from the user terminal device 100 site browsing history information, action history information, destination history information that can be acquired from the navigation device, or travel other than photo data From the route history information, it is possible to analyze the tendency of the user's interest.
  • the tendency of the user's interest is analyzed, and for example, landscapes, buildings, stores, installations, plants, animals, Moving objects and the like can be automatically recorded.
  • each device is not limited to the one shown in the figure, and all or a part of each device may be functionally or physically dispersed or integrated in arbitrary units according to the processing load and usage status of each device. You may.
  • the configuration of the vehicle photographing apparatus 1 is realized by, for example, a program or the like loaded into a memory as software.
  • the description has been given as the function block realized by the cooperation of the hardware or the software. That is, these functional blocks can be realized in various forms by only hardware, only software, or a combination thereof.
  • the storage unit 30 and the control unit 50 may be included in, for example, a recording control server device placed at home as long as the camera 20 is disposed in the vehicle.
  • vehicle photographing device 20 camera (photographing unit) Reference Signs List 30 storage unit 40 first communication unit 50 control unit (recording control device) 51 Video Data Acquisition Unit 52 First Communication Control Unit 53 Photo Identification Unit 54 Analysis Unit 55 Search Unit 56 Recording Processing Unit

Abstract

Provided is a recording control device comprising: a video data acquisition part 51 for acquiring video data from a camera 20 for photographing a view of the surroundings; a photograph identification part 53 for identifying photographic data photographed by a user; an analysis part 54 for analyzing a trend of the photographic data identified by the photograph identification part 53; a search part 55 for searching for video data included in the trend analyzed by the analysis part 54 from the video data acquired by the video data acquisition part 51; and a recording processing part 56 for, if it has been determined by the search by the search part 55 that the video data included in the trend analyzed by the analysis part 54 is present, recording said video data.

Description

記録制御装置、車両用撮影装置、記録制御方法およびプログラムRecording control device, vehicle photographing device, recording control method, and program
　本発明は、記録制御装置、車両用撮影装置、記録制御方法およびプログラムに関する。 The present invention relates to a recording control device, a vehicle photographing device, a recording control method, and a program.
　従来より、車両の周囲を撮影するカメラで映像を録画し、運転中の事故発生を検知したり、駐車中の防犯上の異常を検知したりしたとき、映像を記録することが可能な車載用のカメラに関する技術がある。カメラの画質が向上していることから、事故発生時の記録の他の用途で使用する技術が知られている（例えば、特許文献１参照。）。特許文献１に記載の技術は、多数の人が現在関心を寄せている場所において自動撮影を可能にする。 Conventionally, video is recorded with a camera that captures the surroundings of the vehicle, and it is possible to record the video when detecting an accident during driving or detecting an abnormality in crime prevention while parking There are technologies related to cameras. Since the image quality of a camera has been improved, a technique used for another purpose of recording at the time of occurrence of an accident is known (for example, see Patent Document 1). The technique described in Patent Literature 1 enables automatic photographing in a place where many people are currently interested.
特開２０１５－１７０９０６号公報JP-A-2005-170906
　特許文献１に記載の技術では、多数の人が現在関心を寄せている場所でなければ、ユーザの嗜好に合った場所であっても自動撮影がされない。そこで、走行中に、ユーザの嗜好に合った、例えば、風景、建造物、店舗、設置物、植物、動物、移動体などの興味関心の対象物を車窓に臨めた場合、自動撮影されることが好ましい。 In the technology described in Patent Literature 1, automatic shooting is not performed even in a place that matches the user's preference unless the place is where many people are currently interested. Therefore, when an object of interest, such as a landscape, a building, a store, an installed object, a plant, an animal, or a moving object, which meets a user's preference, is brought to a vehicle window during traveling, automatic photographing may be performed. Is preferred.
　本発明は、上記に鑑みてなされたものであって、ユーザの嗜好に合った、例えば、風景、建造物、店舗、設置物、植物、動物、移動体などを記録することを目的とする。 The present invention has been made in view of the above, and has an object to record, for example, landscapes, buildings, stores, installations, plants, animals, moving objects, and the like that match the user's preferences.
　上述した課題を解決し、目的を達成するために、本発明に係る記録制御装置は、周囲の風景を撮影する撮影部からの映像データを取得する映像データ取得部と、ユーザが興味関心を有する対象を特定する興味関心特定部と、前記興味関心特定部が特定した興味関心の対象の傾向を分析する分析部と、前記映像データ取得部が取得した映像データから、前記分析部が分析した傾向に含まれる映像データを検索する検索部と、前記検索部の検索によって前記分析部が分析した傾向に含まれる映像データがあると判定した場合、その映像データを記録する記録処理部と、を備えることを特徴とする。 In order to solve the above-described problems and achieve the object, a recording control device according to the present invention includes a video data acquisition unit that acquires video data from a photographing unit that photographs a surrounding scenery, and a user who is interested. An interest specifying unit for specifying an object, an analyzing unit for analyzing a tendency of the target of interest specified by the interest specifying unit, and a trend analyzed by the analyzing unit from the video data acquired by the video data acquiring unit. A search unit that searches for video data included in the search unit; and a recording processing unit that, when the search unit determines that there is video data included in the tendency analyzed by the analysis unit, records the video data. It is characterized by the following.
　本発明に係る車両用撮影装置は、上記の記録制御装置と、周囲の風景を撮影する撮影部とを備えることを特徴とする。 車 両 A vehicle photographing device according to the present invention includes the above-described recording control device and a photographing unit that photographs surrounding scenery.
　本発明に係る記録制御方法は、周囲の風景を撮影する撮影部からの映像データを取得する映像データ取得ステップと、ユーザが興味関心を有する対象を特定する興味関心特定ステップと、前記興味関心特定ステップによって特定した興味関心の対象の傾向を分析する分析ステップと、前記映像データ取得ステップによって取得した映像データから、前記分析ステップによって分析した傾向に含まれる映像データを検索する検索ステップと、前記検索ステップによって前記分析ステップが分析した傾向に含まれる映像データがあると判定した場合、その映像データを記録する記録処理ステップと、を含む。 The recording control method according to the present invention includes: a video data obtaining step of obtaining video data from a photographing unit that captures a surrounding scenery; an interest specifying step of specifying an object of interest to a user; An analyzing step of analyzing a tendency of an object of interest identified by the step; a searching step of searching video data acquired by the video data acquiring step for video data included in the trend analyzed by the analyzing step; When it is determined that there is video data included in the tendency analyzed by the analysis step, the recording step includes recording the video data.
　本発明に係るプログラムは、周囲の風景を撮影する撮影部からの映像データを取得する映像データ取得ステップと、ユーザが興味関心を有する対象を特定する興味関心特定ステップと、前記興味関心特定ステップによって特定した興味関心の対象の傾向を分析する分析ステップと、前記映像データ取得ステップによって取得した映像データから、前記分析ステップによって分析した傾向に含まれる映像データを検索する検索ステップと、前記検索ステップによって前記分析ステップが分析した傾向に含まれる映像データがあると判定した場合、その映像データを記録する記録処理ステップと、を記録制御装置として動作するコンピュータに実行させる。 The program according to the present invention includes: a video data obtaining step of obtaining video data from a shooting unit that captures a surrounding landscape; an interest specifying step of specifying an object of interest to the user; and the interest specifying step. An analyzing step of analyzing the tendency of the identified object of interest, a search step of searching for video data included in the trend analyzed by the analysis step, from the video data obtained by the video data obtaining step, If the analysis step determines that there is video data included in the analyzed tendency, a recording processing step of recording the video data is performed by a computer operating as a recording control device.
　本発明によれば、ユーザの嗜好に合った、例えば、風景、建造物、店舗、設置物、植物、動物、移動体などを記録することができるという効果を奏する。 According to the present invention, there is an effect that it is possible to record, for example, landscapes, buildings, stores, installations, plants, animals, moving objects, and the like that match the user's preferences.
図１は、第一実施形態に係る記録制御装置を有する車両用撮影装置の構成例を示すブロック図である。FIG. 1 is a block diagram illustrating a configuration example of a vehicular photographing apparatus having a recording control device according to the first embodiment. 図２は、第一実施形態に係る記録制御装置における処理の流れを示すフローチャートである。FIG. 2 is a flowchart illustrating a flow of processing in the recording control device according to the first embodiment. 図３は、第一実施形態に係る記録制御装置における処理の流れを示すフローチャートである。FIG. 3 is a flowchart illustrating a flow of processing in the recording control device according to the first embodiment. 図４は、第二実施形態に係る記録制御装置を有する車両用撮影装置の構成例を示すブロック図である。FIG. 4 is a block diagram illustrating a configuration example of a vehicular photographing apparatus having a recording control device according to the second embodiment. 図５は、第二実施形態に係る記録制御装置における処理の流れを示すフローチャートである。FIG. 5 is a flowchart illustrating a processing flow in the recording control device according to the second embodiment. 図６は、写真分析サーバにおける処理の流れを示すフローチャートである。FIG. 6 is a flowchart showing the flow of processing in the photo analysis server. 図７は、第三実施形態に係る記録制御装置を有する車両用撮影装置の構成例を示すブロック図である。FIG. 7 is a block diagram illustrating a configuration example of a vehicle photographing apparatus having a recording control device according to the third embodiment. 図８は、第三実施形態に係る記録制御装置における処理の流れを示すフローチャートである。FIG. 8 is a flowchart illustrating a processing flow in the recording control device according to the third embodiment. 図９は、第四実施形態に係る記録制御装置を有する車両用撮影装置の構成例を示すブロック図である。FIG. 9 is a block diagram illustrating a configuration example of a vehicular photographing apparatus having a recording control device according to the fourth embodiment. 図１０は、第四実施形態に係る記録制御装置における処理の流れを示すフローチャートである。FIG. 10 is a flowchart illustrating a flow of processing in the recording control device according to the fourth embodiment. 図１１は、第五実施形態に係る記録制御装置を有する車両用撮影装置の構成例を示すブロック図である。FIG. 11 is a block diagram showing a configuration example of a vehicular photographing apparatus having a recording control device according to the fifth embodiment. 図１２は、第五実施形態に係る記録制御装置における処理の流れを示すフローチャートである。FIG. 12 is a flowchart illustrating a processing flow in the recording control device according to the fifth embodiment. 図１３は、第五実施形態に係る記録制御装置における処理の流れを示すフローチャートである。FIG. 13 is a flowchart illustrating a flow of processing in the recording control device according to the fifth embodiment.
　以下に添付図面を参照して、本発明に係る記録制御装置、車両用撮影装置、記録制御方法およびプログラムの実施形態を詳細に説明する。なお、以下の実施形態により本発明が限定されるものではない。 Hereinafter, embodiments of a recording control device, a vehicle photographing device, a recording control method, and a program according to the present invention will be described in detail with reference to the accompanying drawings. The present invention is not limited by the following embodiments.
［第一実施形態］
　図１は、第一実施形態に係る記録制御装置を有する車両用撮影装置の構成例を示すブロック図である。車両用撮影装置１は、車両の周囲を撮影した映像データから、ユーザの嗜好に合った、例えば、風景、建造物、店舗、設置物、植物、動物、移動体などを撮影し記録する。ユーザの嗜好に合うとは、ユーザの興味関心の対象に合うことである。本実施形態では、ユーザの興味関心の対象は、ユーザ端末装置１００に記憶されている写真データから分析するものとする。 [First embodiment]
FIG. 1 is a block diagram illustrating a configuration example of a vehicular photographing apparatus having a recording control device according to the first embodiment. The vehicle photographing apparatus 1 photographs and records, for example, a landscape, a building, a store, an installed object, a plant, an animal, a moving object, or the like that matches the user's preference from video data obtained by photographing the periphery of the vehicle. To match the user's preference is to match the user's interests. In the present embodiment, it is assumed that the object of interest of the user is analyzed from the photograph data stored in the user terminal device 100.
　ユーザ端末装置１００は、ユーザが携帯して車両に持ち込みする、例えば、スマートフォンを含む携帯用電子機器である。 The user terminal device 100 is a portable electronic device including, for example, a smartphone, which is carried by the user and brought into the vehicle.
　車両用撮影装置１は、車両に載置されているものに加えて、可搬型で車両において利用可能な装置であってもよい。車両用撮影装置１は、カメラ（撮影部）２０と、記憶部３０と、第一通信部４０と、制御部（記録制御装置）５０とを有する。 The vehicle photographing device 1 may be a portable device that can be used in a vehicle, in addition to the device mounted on the vehicle. The vehicle photographing apparatus 1 includes a camera (photographing unit) 20, a storage unit 30, a first communication unit 40, and a control unit (recording control device) 50.
　カメラ２０は、車両の周囲の風景を撮影するカメラである。本実施形態では、カメラ２０は、３６０°の全天周を撮影可能なカメラとして説明するが、これに限定されず、車両の周囲をそれぞれに撮影する複数のカメラ群であってもよい。本実施形態では、カメラ２０は、例えば、車両のウィンドシールド上部などに配置されている。カメラ２０は、エンジンの始動など、車両の動作開始から停止するまでの間、車両の周囲の風景を常時撮影する。カメラ２０は、撮影した映像データを制御部５０の映像データ取得部５１へ出力する。映像データは、例えば毎秒３０フレームの画像から構成される動画像である。 The camera 20 is a camera that captures a scene around the vehicle. In the present embodiment, the camera 20 is described as a camera capable of photographing the entire 360 ° circumference, but is not limited to this, and may be a plurality of camera groups that respectively photograph the periphery of the vehicle. In the present embodiment, the camera 20 is disposed, for example, above a windshield of a vehicle. The camera 20 constantly captures a landscape around the vehicle from the start of the operation of the vehicle to the stop thereof, such as when the engine is started. The camera 20 outputs the captured video data to the video data acquisition unit 51 of the control unit 50. The video data is, for example, a moving image composed of 30 frames per second.
　記憶部３０は、車両用撮影装置１におけるデータの一時記憶などに用いられる。記憶部３０は、バッファメモリ３１と、メモリ３２とを含む。バッファメモリ３１は、制御部５０の記録処理部５６の制御に基づいて、カメラ２０が撮影した映像データを一時的に記録する。バッファメモリ３１は、例えば、ＲＡＭ（Ｒａｎｄｏｍ　Ａｃｃｅｓｓ　Ｍｅｍｏｒｙ）である。メモリ３２は、記録処理部５６の制御に基づいて、カメラ２０が撮影した映像データを記録する。メモリ３２は、例えば、フラッシュメモリ（Ｆｌａｓｈ　Ｍｅｍｏｒｙ）などの半導体メモリ素子、または、ハードディスク、光ディスクなどである。または、メモリ３２は、図示しない通信装置を介して無線接続される外部記憶部であってもよい。 The storage unit 30 is used for temporarily storing data in the vehicular photographing apparatus 1 or the like. The storage unit 30 includes a buffer memory 31 and a memory 32. The buffer memory 31 temporarily stores the video data captured by the camera 20 based on the control of the recording processing unit 56 of the control unit 50. The buffer memory 31 is, for example, a RAM (Random Access Memory). The memory 32 records video data captured by the camera 20 under the control of the recording processing unit 56. The memory 32 is, for example, a semiconductor memory device such as a flash memory (Flash @ Memory), or a hard disk or an optical disk. Alternatively, the memory 32 may be an external storage unit wirelessly connected via a communication device (not shown).
　第一通信部４０は、通信ユニットである。第一通信部４０は、ユーザ端末装置１００とデータを送受信可能に接続する。第一通信部４０は、例えば、ＮＦＣ（Ｎｅａｒ　Ｆｉｅｌｄ　Ｃｏｍｍｕｎｉｃａｔｉｏｎ）、または、Ｂｌｕｅｔｏｏｔｈ（登録商標）を含む近距離無線通信が可能である。第一通信部４０は、ユーザ端末装置１００とＮＦＣ接続またはＢｌｕｅｔｏｏｔｈ接続によってペアリング可能である。 The first communication unit 40 is a communication unit. The first communication unit 40 connects to the user terminal device 100 so that data can be transmitted and received. The first communication unit 40 is capable of short-range wireless communication including, for example, Near Field Communication (NFC) or Bluetooth (registered trademark). The first communication unit 40 can be paired with the user terminal device 100 through an NFC connection or a Bluetooth connection.
　制御部５０は、例えば、ＣＰＵ（Ｃｅｎｔｒａｌ　Ｐｒｏｃｅｓｓｉｎｇ　Ｕｎｉｔ）などで構成された演算処理装置（制御装置）である。制御部５０は、記憶部３０に記憶されているプログラムをメモリにロードして、プログラムに含まれる命令を実行する。制御部５０は、映像データ取得部５１と、第一通信制御部５２と、写真特定部（興味関心特定部）５３と、分析部５４と、検索部５５と、記録処理部５６とを有する。制御部５０には図示しない内部メモリが含まれ、内部メモリは制御部５０におけるデータの一時記憶などに用いられる。 The control unit 50 is an arithmetic processing device (control device) including, for example, a CPU (Central Processing Unit). The control unit 50 loads the program stored in the storage unit 30 into the memory, and executes an instruction included in the program. The control unit 50 includes a video data acquisition unit 51, a first communication control unit 52, a photograph identification unit (interest and interest identification unit) 53, an analysis unit 54, a search unit 55, and a recording processing unit 56. The control unit 50 includes an internal memory (not shown), and the internal memory is used for temporary storage of data in the control unit 50 and the like.
　映像データ取得部５１は、車両の周囲の映像データを取得する。より詳しくは、映像データ取得部５１は、カメラ２０が出力した映像データを取得する。映像データ取得部５１は、取得した映像データを検索部５５と記録処理部５６とに出力する。 The video data acquisition unit 51 acquires video data around the vehicle. More specifically, the video data acquisition unit 51 acquires the video data output by the camera 20. The video data acquisition unit 51 outputs the acquired video data to the search unit 55 and the recording processing unit 56.
　第一通信制御部５２は、第一通信部４０を介した通信を制御する。第一通信制御部５２は、写真特定部５３からの制御によって第一通信部４０を介してユーザ端末装置１００と接続する。 The first communication control unit 52 controls communication via the first communication unit 40. The first communication control unit 52 connects to the user terminal device 100 via the first communication unit 40 under the control of the photo specifying unit 53.
　写真特定部５３は、ユーザが興味関心を有する対象を特定する興味関心特定部である。本実施形態では、写真データによって、ユーザが興味関心を有する対象を特定する。写真特定部５３は、ユーザに関係する写真データを分析対象として特定する。本実施形態では、ユーザに関係する写真データとは、ユーザが撮影した写真の写真データである。写真特定部５３は、特定した写真データを分析部５４に出力する。 (4) The photo specifying unit 53 is an interest specifying unit that specifies a target that the user is interested in. In the present embodiment, an object that the user is interested in is specified by the photograph data. The photo specifying unit 53 specifies photo data relating to the user as an analysis target. In the present embodiment, the photograph data related to the user is photograph data of a photograph taken by the user. The photo specifying unit 53 outputs the specified photo data to the analyzing unit 54.
　写真特定部５３は、第一通信部４０を介して接続されているユーザ端末装置１００に記録されている、ユーザが撮影した写真データを特定する。ユーザが撮影した写真データであるかは、例えば、写真データの撮影端末情報、撮影者情報、または、写真データが保存されているフォルダによって判定可能である。または、ユーザ端末装置１００に記録されている写真データはすべてユーザが撮影した写真データであるとしてもよい。 (4) The photo specifying unit 53 specifies photo data captured by the user and recorded in the user terminal device 100 connected via the first communication unit 40. Whether the photograph data is photographed by the user can be determined by, for example, photographing terminal information of the photograph data, photographer information, or a folder in which the photograph data is stored. Alternatively, all of the photograph data recorded in the user terminal device 100 may be photograph data photographed by the user.
　さらに、写真特定部５３は、ユーザが撮影した写真データのうち、被撮影物を限定して特定してもよい。 Furthermore, the photo specifying unit 53 may specify the object to be photographed in a limited number of pieces of the photograph data photographed by the user.
　写真データの被撮影物は、撮影時または記録時などに写真データとともに記録された、被撮影物の種類を示すタグ情報に基づいて、特定してもよい。または、写真特定部５３からユーザ端末装置１００に特定の被撮影物の写真データを取得する信号を出力すると、ユーザ端末装置１００において画像処理を行って特定の被撮影物の写真データのみを抽出するようにしてもよい。 The subject of the photograph data may be specified based on tag information indicating the type of the subject, which is recorded together with the photograph data at the time of photographing or recording. Alternatively, when a signal for acquiring photo data of a specific object is output from the photo specifying unit 53 to the user terminal device 100, the user terminal device 100 performs image processing to extract only the photo data of the specific object. You may do so.
　例えば、風景写真データに限定して特定する場合、写真データのタグ情報が「風景」である風景写真データを特定すればよい。または、風景写真データに限定して特定する場合、写真特定部５３からユーザ端末装置１００に風景写真データを取得する信号を出力して、ユーザ端末装置１００において画像処理を行って風景写真データが抽出されるようにしてもよい。 For example, in the case of specifying only landscape photo data, it is sufficient to specify landscape photo data whose tag information is "landscape". Alternatively, in the case of specifying only landscape photograph data, a signal for acquiring landscape photograph data is output from the photo specifying unit 53 to the user terminal device 100, and image processing is performed in the user terminal device 100 to extract landscape photograph data. May be performed.
　分析部５４は、写真特定部５３が特定した写真データの傾向を分析する。言い換えると、分析部５４は、写真特定部５３が特定した写真データに基づいて、ユーザの興味関心の対象の傾向を分析することでユーザの嗜好の傾向を分析する。 The analysis unit 54 analyzes the tendency of the photo data specified by the photo specification unit 53. In other words, the analysis unit 54 analyzes the tendency of the user's preference by analyzing the tendency of the user's interest based on the photograph data specified by the photograph specifying unit 53.
　例えば、分析部５４は、写真データの被撮影物の傾向によって、ユーザの嗜好の傾向を分析する。また、例えば、分析部５４は、写真データの色の傾向によって、ユーザの嗜好の傾向を分析してもよい。また、例えば、分析部５４は、写真データの構成の傾向によって、ユーザの嗜好の傾向を分析してもよい。分析部５４は、分析結果を傾向情報として検索部５５に出力する。 For example, the analysis unit 54 analyzes the tendency of the user's preference according to the tendency of the photographed object in the photograph data. Further, for example, the analysis unit 54 may analyze the tendency of the user's preference based on the tendency of the color of the photograph data. Further, for example, the analysis unit 54 may analyze the tendency of the user's preference based on the tendency of the configuration of the photograph data. The analysis unit 54 outputs the analysis result to the search unit 55 as trend information.
　分析部５４は、特定した写真データの被撮影物が限定されていない場合、被撮影物を認識してから、写真データの傾向を分析する。分析部５４は、特定した写真データに画像処理を行って、認識辞書データを使用して被撮影物を認識して、被撮影物ごとの写真数によって傾向を分析する。分析部５４は、このような被撮影物ごとの写真数、または、最新数か月の写真数などによって、ユーザが興味関心を有する対象を分析する。分析部５４は、写真数が多い被撮影物を、興味関心が高いと分析する。なお、被撮影物は、類似するものをまとめて大きな区分の大まかな分類でカウントしてもよいし、細かい分類でカウントしてもよい。 The analysis unit 54 analyzes the tendency of the photograph data after recognizing the photographed object when the photographed object of the specified photograph data is not limited. The analysis unit 54 performs image processing on the specified photograph data, recognizes the photographed object using the recognition dictionary data, and analyzes the tendency based on the number of photographs for each photographed object. The analysis unit 54 analyzes an object that the user is interested in based on the number of photographs for each object to be photographed or the number of photographs in the latest months. The analysis unit 54 analyzes a subject having a large number of photographs as having high interest. It should be noted that the objects to be imaged may be counted by roughly classifying roughly similar objects into a large classification or by fine classification.
　分析部５４は、例えば、自然の景観または街並みの写真データが多い場合、風景に興味関心が高いと分析する。または、分析部５４は、例えば、自然の景観、または、街並みに興味関心が高いと細かい分類で分析してもよい。 The analysis unit 54 analyzes that, for example, when there is a lot of photographic data of a natural landscape or a cityscape, the interest in the landscape is high. Alternatively, for example, the analysis unit 54 may analyze the natural scenery or the cityscape with a fine classification if the interest is high.
　分析部５４は、例えば城または橋のような名所、または、歴史的な建造物または高層ビルのような外形に特徴のある建造物の写真データが多い場合、建造物に興味関心が高いと分析する。または、分析部５４は、例えば、城、橋、歴史的な建造物、または、高層ビルに興味関心が高いと細かい分類で分析してもよい。 The analysis unit 54 analyzes that if there is a lot of photographic data of a landmark such as a castle or a bridge, or a building having a characteristic shape such as a historic building or a skyscraper, the building is of high interest. I do. Alternatively, the analysis unit 54 may analyze, for example, a castle, a bridge, a historic building, or a high-rise building with a high degree of interest in a fine classification.
　分析部５４は、例えば、店舗の外観または内装の写真データが多い場合、店舗に興味関心が高いと分析する。さらに、分析部５４は、店舗の写真データ、または、料理を含む食べ物の写真データから、ラーメン屋、お菓子屋のような店舗の種類を特定可能であれば、特定の種類の店舗に興味関心が高いと分析してもよい。 The analysis unit 54 analyzes that, for example, when there is a large amount of photographic data of the exterior or interior of the store, the store is highly interested in the store. Furthermore, if the analysis unit 54 can specify the type of store such as a ramen shop or a confectionery store from the photograph data of the store or the photograph data of food including food, the analysis unit 54 is interested in a particular type of store. May be analyzed as high.
　分析部５４は、例えば、料理を含む食べ物の写真データが多い場合、その食べ物に興味関心が高いと分析する。 The analysis unit 54 analyzes that, for example, when there is a lot of photographic data of food including food, the interest is high in the food.
　分析部５４は、例えば、看板、マンホール、標識、標示、または、掲示板のような設置物の写真データが多い場合、特殊な看板、マンホール、標識、標示、または、掲示板に興味関心が高いと分析する。 For example, when there is a lot of photographic data of an installation such as a signboard, a manhole, a sign, a sign, or a bulletin board, the analysis unit 54 analyzes that there is a high interest in a special signboard, a manhole, a sign, a sign, or a bulletin board. I do.
　分析部５４は、例えば、桜、紅葉のような見頃を迎えた植物、または、めずらしい植物の写真データが多い場合、植物に興味関心が高いと分析する。または、分析部５４は、例えば、桜、紅葉、または、珍しい植物に興味関心が高いと細かい分類で分析してもよい。 The analysis unit 54 analyzes that there is a high degree of interest in plants when there are many photographic data of plants that have reached their peak, such as cherry blossoms and autumn leaves, or rare plants. Alternatively, the analysis unit 54 may analyze, for example, cherry, autumn leaves, or unusual plants with a high degree of interest in a fine classification.
　分析部５４は、例えば、犬、猫、鳥、鹿、猿、または、熊のような動物の写真データが多い場合、動物に興味関心が高いと分析する。または、分析部５４は、例えば、犬、猫、鳥、鹿、猿、または、熊に興味関心が高いと細かい分類で分析してもよい。 The analysis unit 54 analyzes that there is a high interest in an animal when there is a lot of photographic data of an animal such as a dog, a cat, a bird, a deer, a monkey, or a bear. Alternatively, the analysis unit 54 may analyze, for example, a dog, a cat, a bird, a deer, a monkey, or a bear that has a high interest level in a fine classification.
　分析部５４は、例えば、自動車、二輪車、特殊車両、電車、または、飛行機のような移動体の写真データが多い場合、移動体に興味関心が高いと分析する。または、分析部５４は、例えば、自動車、二輪車、特殊車両、電車、または、飛行機に興味関心が高いと細かい分類で分析してもよい。 The analysis unit 54 analyzes that the interest in the moving object is high when there are many pieces of photographic data of the moving object such as an automobile, a motorcycle, a special vehicle, a train, or an airplane. Alternatively, the analysis unit 54 may analyze, for example, a car, a motorcycle, a special vehicle, a train, or an airplane with a high degree of interest in a fine classification.
　分析部５４は、ＡＩ（Ａｒｔｉｆｉｃｉａｌ　Ｉｎｔｅｌｌｉｇｅｎｃｅ）処理を使用して、写真データの傾向を分析してもよい。分析部５４は、被撮影物を分析した他の写真データとの類似性に基づいて被撮影物を判定してもよい。 The analysis unit 54 may analyze the tendency of the photographic data by using AI (Artificial Intelligence) processing. The analysis unit 54 may determine the subject based on the similarity with other photographic data obtained by analyzing the subject.
　例えば、分析部５４は、特定した写真データが風景写真データに限定されていない場合、ＡＩ処理を使用して風景写真データに限定してから、傾向を分析してもよい。分析部５４は、例えば、人物が大きく映っている写真データ、人物が多数映っている写真データ、車両または料理などの物体が大きく映っている写真データなどは、風景写真データではないと分析する。または、分析部５４は、風景写真データであると分析した他の写真データとの類似性に基づいて風景写真データを判定してもよい。 For example, when the specified photo data is not limited to the landscape photo data, the analysis unit 54 may limit the trend to the landscape photo data by using the AI process and then analyze the tendency. The analysis unit 54 analyzes that, for example, photograph data in which a person is largely reflected, photograph data in which a large number of persons are photographed, and photograph data in which an object such as a vehicle or a dish is largely reflected are not landscape photograph data. Alternatively, the analysis unit 54 may determine the landscape photo data based on the similarity with other photo data analyzed as the landscape photo data.
　分析部５４は、写真データの色の傾向によって、写真データの傾向を分析してもよい。分析部５４は、興味関心が高い色の傾向を分析する。 The analysis unit 54 may analyze the tendency of the photograph data based on the tendency of the color of the photograph data. The analysis unit 54 analyzes the tendency of the color of high interest.
　例えば、分析部５４は、風景写真データの色の傾向を分析してもよい。分析部５４は、風景写真データに画像処理を行って、風景写真データの総ピクセル数に対する色情報ごとのピクセル数を取得して色情報の比率によって色の傾向を分析する。色の傾向は、例えば、赤、黄、オレンジ、緑、シアン、青、マゼンタ、茶、ベージュ、黒、白、ダークグレー、ライトグレーの中で、比率が高い色をその風景写真データの色の傾向とする。なお、色情報は、類似する色をまとめて大きな区分の大まかな色分けとする。 For example, the analysis unit 54 may analyze the tendency of the color of the landscape photograph data. The analysis unit 54 performs image processing on the landscape photo data, obtains the number of pixels for each color information with respect to the total number of pixels of the landscape photo data, and analyzes the color tendency based on the ratio of the color information. The color tendency is, for example, a color with a high ratio among red, yellow, orange, green, cyan, blue, magenta, brown, beige, black, white, dark gray, and light gray. And In the color information, similar colors are grouped into roughly classified large colors.
　分析部５４は、ＡＩ処理を使用して写真データの構成を分析してもよい。分析部５４は、構成を分析した他の写真データとの類似性に基づいて構成を分析してもよい。分析部５４は、興味関心が高い構成の傾向を分析する。 The analysis unit 54 may analyze the configuration of the photographic data using AI processing. The analysis unit 54 may analyze the configuration based on the similarity with other photographic data whose configuration has been analyzed. The analysis unit 54 analyzes the tendency of the configuration having high interest.
　例えば、分析部５４は、ＡＩ処理を使用して、風景写真データの構成を分析してもよい。分析部５４は、例えば、風景写真データであるとされている他の写真データとの類似性に基づいて、海の風景写真データ、渓谷の風景写真データ、山の風景写真データ、街並みの風景写真データ、または、夕焼けの風景写真データなどの分類で特に比率の高い分類を興味関心が高いとしてもよい。 For example, the analysis unit 54 may use AI processing to analyze the configuration of the landscape photograph data. The analysis unit 54, for example, based on the similarity with other photograph data that is considered to be landscape photograph data, can include sea landscape photograph data, valley landscape photograph data, mountain landscape photograph data, and cityscape landscape photograph. A class having a particularly high ratio in the classification of the data or the scenery photograph data of the sunset may be of high interest.
　検索部５５は、映像データ取得部５１が取得した映像データから、分析部５４が分析した傾向に含まれる映像データを検索する。検索部５５は、車両用撮影装置１の撮影中、映像データ取得部５１が取得した映像データが、分析部５４が分析した傾向に含まれるか否かを継続的に判定する。言い換えると、検索部５５は、車両用撮影装置１の撮影中、映像データ取得部５１が取得した映像データが、ユーザの嗜好に合っているか否かを継続的に判定する。継続的とは、例えば、映像データのフレームごと、５以上１０以下のフレームごとなどの所定フレームごと、または、１秒ごとなどの所定時間ごとである。検索部５５は、映像データ取得部５１が取得した映像データが、分析部５４が分析した傾向に含まれていると判定した場合、記録処理部５６に保存要求指示を行う。言い換えると、検索部５５は、ユーザの嗜好に合っている映像データが撮影されると、記録処理部５６に保存要求指示を行う。検索部５５は、バッファメモリ３１に一時的に記憶された映像データ取得部５１から、分析部５４が分析した傾向に含まれる映像データを検索する構成としてもよい。 The search unit 55 searches the video data acquired by the video data acquisition unit 51 for video data included in the tendency analyzed by the analysis unit 54. The search unit 55 continuously determines whether or not the video data acquired by the video data acquisition unit 51 is included in the tendency analyzed by the analysis unit 54 while the vehicle imaging device 1 is shooting. In other words, the search unit 55 continuously determines whether or not the video data acquired by the video data acquisition unit 51 matches the user's preference while the vehicle imaging device 1 is shooting. The term “continuous” means, for example, every predetermined frame such as every frame of video data, every 5 to 10 frames, or every predetermined time such as every 1 second. When the search unit 55 determines that the video data acquired by the video data acquisition unit 51 is included in the tendency analyzed by the analysis unit 54, the search unit 55 issues a storage request instruction to the recording processing unit 56. In other words, when video data matching the user's preference is captured, the search unit 55 issues a storage request instruction to the recording processing unit 56. The search unit 55 may be configured to search the video data acquisition unit 51 temporarily stored in the buffer memory 31 for video data included in the tendency analyzed by the analysis unit 54.
　傾向に含まれるとは、傾向が一致するものだけではなく、傾向が類似するものを含んでもよい。 含 ま Being included in the trend may include not only those having the same tendency but also those having the similar tendency.
　例えば、検索部５５は、映像データ取得部５１が取得した映像データのうち、分析部５４が分析した傾向に含まれる被撮影物が映されている映像データを検索する。検索部５５は、ユーザが風景に興味関心が高いと分析された場合、映像データ取得部５１が取得した映像データのうち、風景が映されている映像データを検索する。検索部５５は、ユーザがラーメン屋またはラーメンに興味関心が高いと分析された場合、映像データ取得部５１が取得した映像データのうち、ラーメン屋が映されている映像データを検索する。さらに、検索部５５は、ユーザがラーメン屋またはラーメンに興味関心が高いと分析された場合、映像データ取得部５１が取得した映像データのうち、店舗の前に行列ができている、または、店舗の駐車場が混雑しているラーメン屋が映されている映像データを検索してもよい。検索部５５は、ユーザが特殊な看板に興味関心が高いと分析された場合、映像データ取得部５１が取得した映像データのうち、特殊な看板が映されている映像データを検索する。 For example, the search unit 55 searches the video data acquired by the video data acquisition unit 51 for video data in which an object included in the tendency analyzed by the analysis unit 54 is shown. When the user is analyzed to be interested in the landscape, the search unit 55 searches the video data acquired by the video data acquisition unit 51 for video data showing the landscape. When it is analyzed that the user has a high interest in the ramen shop or the ramen, the search unit 55 searches the video data acquired by the video data acquisition unit 51 for video data showing the ramen shop. Furthermore, when it is analyzed that the user has a high interest in the ramen shop or the ramen, the search unit 55 has a line in front of the store in the video data acquired by the video data acquisition unit 51, or The video data showing the ramen shop where the parking lot is crowded may be searched. When it is analyzed that the user is interested in the special signboard, the search unit 55 searches the video data acquired by the video data acquisition unit 51 for video data on which the special signboard is projected.
　例えば、検索部５５は、映像データ取得部５１が取得した映像データのうち、分析部５４が分析した傾向に含まれる色情報の映像データを検索する。検索部５５は、ユーザがオレンジ色または赤色の夕焼けの風景に興味関心が高いと分析された場合、映像データ取得部５１が取得した映像データのうち、オレンジ色または赤色の夕焼けの風景が映されている映像データを検索する。 For example, the search unit 55 searches the video data acquired by the video data acquisition unit 51 for video data of color information included in the tendency analyzed by the analysis unit 54. When it is determined that the user is highly interested in the orange or red sunset scene, the search unit 55 displays the orange or red sunset scene in the video data acquired by the video data acquisition unit 51. Search for the video data that is present.
　例えば、検索部５５は、映像データ取得部５１が取得した映像データのうち、分析部５４が分析した傾向に含まれる構成の映像データを検索する。 For example, the search unit 55 searches the video data acquired by the video data acquisition unit 51 for video data having a configuration included in the tendency analyzed by the analysis unit 54.
　記録処理部５６は、検索部５５からの保存要求指示によって映像データを記憶部３０のメモリ３２に記録する。より詳しくは、記録処理部５６は、検索部５５の検索結果に基づいて、映像データ取得部５１が取得した映像データに、分析部５４が分析した傾向に含まれる被撮影物の映像データがある場合、その映像データを記憶部３０のメモリ３２に記録する。記録処理部５６は、検索部５５の検索結果に基づいて、分析部５４が分析した色の傾向に含まれる映像データがある場合、その映像データを記録する。記録処理部５６は、検索部５５の検索結果に基づいて、分析部５４が分析した構成の傾向に含まれる映像データがある場合、その映像データを記録する。 (4) The recording processing unit 56 records the video data in the memory 32 of the storage unit 30 in response to a save request instruction from the search unit 55. More specifically, the recording processing unit 56 includes, in the video data obtained by the video data obtaining unit 51 based on the search result of the search unit 55, video data of the subject included in the tendency analyzed by the analysis unit 54. In this case, the video data is recorded in the memory 32 of the storage unit 30. When there is video data included in the color tendency analyzed by the analysis unit 54 based on the search result of the search unit 55, the recording processing unit 56 records the video data. When there is video data included in the configuration tendency analyzed by the analysis unit 54 based on the search result of the search unit 55, the recording processing unit 56 records the video data.
　記録処理部５６は、記憶部３０が動作している間、または、検索部５５から保存要求指示を受信してから、カメラ２０が撮影した映像データをバッファメモリ３１に送信し、例えば、６０秒ごとのような所定期間の映像ごとに映像ファイルを生成し、メモリ３２に記憶させる。記録処理部５６は、メモリ３２の容量が一杯になった場合、最も古い映像データに上書きするループ記録処理を行ってもよい。 The recording processing unit 56 transmits the video data captured by the camera 20 to the buffer memory 31 while the storage unit 30 is operating or after receiving the storage request instruction from the search unit 55, for example, for 60 seconds. Then, a video file is generated for each video of a predetermined period, such as a video, and stored in the memory 32. When the capacity of the memory 32 becomes full, the recording processing unit 56 may perform a loop recording process of overwriting the oldest video data.
　より詳しくは、記録処理部５６は、検索部５５から保存要求指示を受信した場合、例えば、保存要求指示を受信した時点の前後１０秒程度の所定期間の映像データ、または、保存要求指示を継続して受信している期間の映像データを、メモリ３２に上書き禁止に記録、または、図示しない外部の記録装置や、第一通信部４０等を介してユーザ端末装置１００に送信して記録させる。 More specifically, when the recording processing unit 56 receives the storage request instruction from the search unit 55, the recording processing unit 56 continues the video data for a predetermined period of about 10 seconds before or after the reception of the storage request instruction, or continues the storage request instruction. The video data during the receiving period is recorded in the memory 32 so as not to be overwritten, or transmitted to the user terminal device 100 via an external recording device (not shown), the first communication unit 40 or the like, and recorded.
　記録処理部５６が保存要求指示に応じて記録する映像データは、例えば、ループ記録している映像データと同一の動画像データ、または、動画像データを構成する所定フレームごとの静止画像データである。また、記録する映像データは、メモリ３２に記録する場合、静止画像データとし、外部の記録装置やユーザ端末装置１００に記録する場合、動画像データとしてもよい。 The video data recorded by the recording processing unit 56 in response to the storage request instruction is, for example, the same moving image data as the loop-recorded video data, or still image data for each predetermined frame constituting the moving image data. . The video data to be recorded may be still image data when recorded in the memory 32, and may be moving image data when recorded on an external recording device or the user terminal device 100.
　次に、図２、図３を用いて、制御部５０における処理の流れについて説明する。図２は、第一実施形態に係る記録制御装置における処理の流れを示すフローチャートである。図３は、第一実施形態に係る記録制御装置における処理の流れを示すフローチャートである。車両用撮影装置１の起動中、カメラ２０は、車両の周囲を含む車両周辺の映像データを撮影する。車両用撮影装置１は、映像データ取得部５１によって、カメラ２０が撮影した映像データを常時取得する。車両用撮影装置１の起動中、車両用撮影装置１とユーザ端末装置１００とはデータを送受信可能に接続されている。ここでは、風景写真データに限定して抽出する場合について説明する。 Next, the flow of processing in the control unit 50 will be described with reference to FIGS. FIG. 2 is a flowchart illustrating a flow of processing in the recording control device according to the first embodiment. FIG. 3 is a flowchart illustrating a flow of processing in the recording control device according to the first embodiment. During the activation of the vehicular photographing apparatus 1, the camera 20 photographs video data around the vehicle including the periphery of the vehicle. In the vehicular photographing apparatus 1, the video data acquisition unit 51 constantly acquires video data captured by the camera 20. During the activation of the vehicle imaging device 1, the vehicle imaging device 1 and the user terminal device 100 are connected to be able to transmit and receive data. Here, a case in which extraction is limited to landscape photograph data will be described.
　まず、図２を用いて、ユーザの嗜好、言い換えると、ユーザの興味関心の対象を特定する処理について説明する。制御部５０は、ペアリングされているユーザ端末装置１００があるかを判定する（ステップＳ１０１）。より詳しくは、制御部５０は、第一通信部６０によって、例えば、ＮＦＣ接続によってペアリングされ、Ｂｌｕｅｔｏｏｔｈ接続されているユーザ端末装置１００があるかを判定する。第一通信部６０によるユーザ端末装置１００との接続形態は、Ｂｌｕｅｔｏｏｔｈ接続に限らないため、以下では単に接続と記載する。制御部５０は、接続されているユーザ端末装置１００がある場合（ステップＳ１０１でＹｅｓ）、ステップＳ１０２に進む。制御部５０は、接続されているユーザ端末装置１００がない場合（ステップＳ１０１でＮｏ）、ステップＳ１０１の処理を再度実行または本処理を終了する。 First, a process of specifying a user's preference, in other words, an object of interest of the user will be described with reference to FIG. The control unit 50 determines whether there is a paired user terminal device 100 (Step S101). More specifically, the control unit 50 determines whether the first communication unit 60 has a user terminal device 100 paired by, for example, an NFC connection and connected by Bluetooth. The connection form of the first communication unit 60 with the user terminal device 100 is not limited to the Bluetooth connection, and is simply described as connection below. When there is a connected user terminal device 100 (Yes in step S101), the control unit 50 proceeds to step S102. When there is no connected user terminal device 100 (No in step S101), the control unit 50 executes the process of step S101 again or ends this process.
　制御部５０は、写真特定部５３によって、接続されているユーザ端末装置１００に保存されている、ユーザが撮影した写真データを特定する（ステップＳ１０２）。制御部５０は、ステップＳ１０３に進む。 The control unit 50 specifies, by the photo specifying unit 53, photo data captured by the user and stored in the connected user terminal device 100 (step S102). The control unit 50 proceeds to Step S103.
　制御部５０は、分析部５４によって、特定された写真データのうち、風景写真データを抽出する（ステップＳ１０３）。制御部５０は、ステップＳ１０４に進む。 The control unit 50 extracts the landscape photograph data from the photograph data specified by the analysis unit 54 (step S103). The control unit 50 proceeds to Step S104.
　制御部５０は、分析部５４によって、抽出された風景写真データの傾向を分析する（ステップＳ１０４）。より詳しくは、制御部５０は、分析部５４によって、認識辞書データを使用したりＡＩ処理を行ったりして、風景写真データを分析する。さらに、制御部５０は、分析部５４によって、風景写真データの色の傾向と、構成の傾向との少なくともどちらかを分析してもよい。このようにして、制御部５０は、分析部５４によって、写真特定部５３が特定した写真データに基づいて、ユーザの嗜好の傾向を分析する。制御部５０は、処理を終了する。 The control unit 50 analyzes the tendency of the extracted landscape photograph data by the analysis unit 54 (step S104). More specifically, the control unit 50 analyzes the landscape photograph data by using the recognition dictionary data and performing the AI processing by the analysis unit 54. Further, the control unit 50 may use the analysis unit 54 to analyze at least one of the color tendency and the composition tendency of the landscape photograph data. In this manner, the control unit 50 causes the analysis unit 54 to analyze the user's preference tendency based on the photo data specified by the photo specification unit 53. The control unit 50 ends the processing.
　つづいて、図３を用いて、撮影した映像データのうち、ユーザの嗜好、言い換えると、ユーザの興味関心の対象に合致する映像データを記録する処理について説明する。制御部５０は、記録処理部５６によって、ループ記録を開始する（ステップＳ１１１）。より詳しくは、制御部５０は、記録処理部５６によって、記憶部３０が動作している間、または、検索部５５から保存要求指示を受信してから、カメラ２０が撮影した映像データをバッファメモリ３１に送信し、例えば、６０秒ごとのような所定期間の映像ごとに映像ファイルを生成し、メモリ３２に記憶させる。制御部５０は、ステップＳ１１２に進む。 Next, a process of recording video data that matches the user's preference, in other words, the user's interest and interest, from the captured video data will be described with reference to FIG. The control unit 50 starts loop recording by the recording processing unit 56 (step S111). More specifically, the control unit 50 stores the video data captured by the camera 20 in the buffer memory while the storage unit 30 is operating or after the storage request instruction is received from the search unit 55 by the recording processing unit 56. For example, a video file is generated for each video of a predetermined period, such as every 60 seconds, and stored in the memory 32. The control unit 50 proceeds to Step S112.
　制御部５０は、検索部５５によって、傾向情報に近い、言い換えると、ユーザの興味関心の対象に合致する映像データがあるかを判定する（ステップＳ１１２）。より詳しくは、制御部５０は、検索部５５によって、分析部５４が分析した分析結果である傾向情報に含まれる映像データがあるかを検索する。制御部５０は、検索部５５によって、傾向情報に含まれる映像データが検索された場合（ステップＳ１１２でＹｅｓ）、ステップＳ１１３に進む。制御部５０は、検索部５５によって、傾向情報に含まれる映像データが検索されなかった場合（ステップＳ１１２でＮｏ）、ステップＳ１１４に進む。 The control unit 50 uses the search unit 55 to determine whether there is video data that is close to the trend information, in other words, that matches the user's interest and interest (step S112). More specifically, the control unit 50 uses the search unit 55 to search for video data included in the trend information that is the analysis result analyzed by the analysis unit 54. When the search unit 55 searches for video data included in the trend information (Yes in step S112), the control unit 50 proceeds to step S113. When the search unit 55 has not searched for the video data included in the trend information (No in Step S112), the control unit 50 proceeds to Step S114.
　傾向情報に近い映像データがある場合（ステップＳ１１２でＹｅｓ）、制御部５０は、記録処理部５６によって、傾向情報に近い映像データまたは静止画像データを記憶部３０のメモリ３２に記録する（ステップＳ１１３）。制御部５０は、記録処理部５６によって、ユーザの興味関心の対象に合致する映像データまたは静止画像データを記録する。制御部５０は、ステップＳ１１４に進む。 When there is video data close to the trend information (Yes in step S112), the control unit 50 causes the recording processing unit 56 to record video data or still image data close to the trend information in the memory 32 of the storage unit 30 (step S113). ). The control unit 50 causes the recording processing unit 56 to record video data or still image data matching the user's interest. The control unit 50 proceeds to Step S114.
　制御部５０は、ループ記録を終了するかを判定する（ステップＳ１１４）。より詳しくは、制御部５０は、映像データの記録を停止する操作がされた場合、または、記録処理部５６から記録を停止する制御信号を受信した場合（ステップＳ１１４でＹｅｓ）、ループ記録を終了して処理を終了する。制御部５０は、映像データの記録を停止する操作がされていない場合、かつ、記録処理部５６から記録を停止する制御信号を受信していない場合（ステップＳ１１４でＮｏ）、ステップＳ１１２に戻って処理を再度実行する。 The control unit 50 determines whether to end the loop recording (Step S114). More specifically, the control unit 50 ends the loop recording when an operation of stopping the recording of the video data is performed or when a control signal for stopping the recording is received from the recording processing unit 56 (Yes in step S114). And terminate the processing. When the operation of stopping the recording of the video data is not performed and the control signal for stopping the recording is not received from the recording processing unit 56 (No in Step S114), the control unit 50 returns to Step S112. Execute the process again.
　このようにして、ユーザ端末装置１００に保存されたユーザが撮影した写真の写真データから、ユーザの興味関心の対象の傾向を分析する。そして、撮影された映像データが、分析した傾向に近ければ、記憶部３０のメモリ３２等に上書き禁止で記録する。 In this way, the tendency of the user's interest is analyzed from the photograph data of the photograph taken by the user stored in the user terminal device 100. If the captured video data is close to the analyzed tendency, it is recorded in the memory 32 of the storage unit 30 or the like without overwriting.
　上述したように、本実施形態は、ユーザ端末装置１００に保存されたユーザが撮影した写真の写真データから、ユーザの興味関心の対象の傾向を分析する。本実施形態では、撮影された映像データが分析した傾向に近ければ、記憶部３０のメモリ３２等に上書き禁止で記録することができる。このように、本実施形態は、ユーザの嗜好に合った、例えば、風景、建造物、店舗、設置物、植物、動物、移動体などを自動で記録することができる。 As described above, in the present embodiment, the tendency of the user's interest is analyzed from the photograph data of the photograph taken by the user stored in the user terminal device 100. In the present embodiment, if the captured video data is close to the analyzed tendency, it can be recorded in the memory 32 of the storage unit 30 or the like without overwriting. As described above, in the present embodiment, for example, landscapes, buildings, stores, installed objects, plants, animals, moving objects, and the like that match the user's preferences can be automatically recorded.
　本実施形態は、写真データの被撮影物、色の傾向、構成の傾向から、ユーザの興味関心の対象の傾向を分析する。これにより、本実施形態は、より適切にユーザの嗜好の傾向を分析することができる。 In the present embodiment, the tendency of the user's interest is analyzed from the photographed object, the color tendency, and the composition tendency of the photograph data. Accordingly, the present embodiment can more appropriately analyze the tendency of the user's preference.
［第二実施形態］
　図４ないし図６を参照しながら、本実施形態に係る車両用撮影装置１Ａについて説明する。図４は、第二実施形態に係る記録制御装置を有する車両用撮影装置の構成例を示すブロック図である。図５は、第二実施形態に係る記録制御装置における処理の流れを示すフローチャートである。図６は、写真分析サーバにおける処理の流れを示すフローチャートである。車両用撮影装置１Ａは、基本的な構成は第一実施形態の車両用撮影装置１と同様である。以下の説明においては、車両用撮影装置１と同様の構成要素には、同一の符号または対応する符号を付し、その詳細な説明は省略する。車両用撮影装置１Ａは、第二通信部４２Ａを介して、ＳＮＳ（Ｓｏｃｉａｌ　Ｎｅｔｗｏｒｋｉｎｇ　Ｓｅｒｖｉｃｅ）サーバ装置１１０と写真分析サーバ装置１２０と通信可能に接続されている点と、制御部５０Ａにおける処理とが第一実施形態と異なる。本実施形態では、ユーザの興味関心の対象は、ユーザに関係する写真データとしてＳＮＳのような写真共有サイトから写真データを特定して分析するものとする。 [Second embodiment]
4 to 6, a description will be given of a vehicle photographing apparatus 1A according to the present embodiment. FIG. 4 is a block diagram illustrating a configuration example of a vehicular photographing apparatus having a recording control device according to the second embodiment. FIG. 5 is a flowchart illustrating a processing flow in the recording control device according to the second embodiment. FIG. 6 is a flowchart showing the flow of processing in the photo analysis server. The basic configuration of the vehicle photographing apparatus 1A is the same as that of the vehicle photographing apparatus 1 of the first embodiment. In the following description, the same components as those of the vehicle photographing apparatus 1 are denoted by the same reference numerals or corresponding reference numerals, and detailed description thereof will be omitted. The vehicle photographing apparatus 1A has a second communication unit 42A that is connected to the SNS (Social Networking Service) server apparatus 110 and the photo analysis server apparatus 120 so as to be able to communicate with each other, and the processing in the control unit 50A. Different from one embodiment. In the present embodiment, it is assumed that the object of interest of the user is to specify and analyze photo data from a photo sharing site such as SNS as photo data related to the user.
　ＳＮＳサーバ装置１１０は、例えば、写真共有サイトのサーバ装置である。 The SNS server device 110 is, for example, a server device of a photo sharing site.
　写真分析サーバ装置１２０は、第一実施形態における分析部５４の機能を有する。写真分析サーバ装置１２０は、写真特定部５３Ａが特定した写真データに基づいて、ユーザの嗜好の傾向を分析する。写真分析サーバ装置１２０は、分析結果を制御部５０Ａに出力する。 The photo analysis server device 120 has the function of the analysis unit 54 in the first embodiment. The photo analysis server device 120 analyzes the tendency of the user's preference based on the photo data specified by the photo specifying unit 53A. The photo analysis server device 120 outputs the analysis result to the control unit 50A.
　車両用撮影装置１Ａは、カメラ２０と、記憶部３０と、第一通信部４０と、第二通信部４２Ａと、制御部５０Ａとを有する。 The vehicle imaging device 1A includes the camera 20, the storage unit 30, the first communication unit 40, the second communication unit 42A, and the control unit 50A.
　第二通信部４２Ａは、通信ユニットである。第二通信部４２Ａは、ＳＮＳサーバ装置１１０とデータを送受信可能に接続する。第二通信部４２Ａは、例えば、Ｗｉ－ｆｉ（登録商標）、４Ｇ、５Ｇなどの無線通信が可能である。 The second communication unit 42A is a communication unit. The second communication unit 42A connects to the SNS server device 110 so that data can be transmitted and received. The second communication unit 42A is capable of wireless communication such as Wi-Fi (registered trademark), 4G, and 5G.
　制御部５０Ａは、映像データ取得部５１と、第一通信制御部５２と、写真特定部５３Ａと、分析部５４Ａと、検索部５５と、記録処理部５６と、第二通信制御部５７Ａとを有する。 The control unit 50A includes a video data acquisition unit 51, a first communication control unit 52, a photo identification unit 53A, an analysis unit 54A, a search unit 55, a recording processing unit 56, and a second communication control unit 57A. Have.
　写真特定部５３Ａは、ユーザが写真共有サイトを介してｗｅｂ上で公開している写真データを特定するための情報を取得する。写真特定部５３Ａは、第一通信部４０を介して接続されたユーザ端末装置１００に記憶されている写真共有サイトのアカウント情報と接続先情報とを含むサイト情報を取得する。 (5) The photo specifying unit 53A acquires information for specifying the photo data that the user has published on the web via the photo sharing site. The photo specifying unit 53A acquires site information including account information and connection destination information of the photo sharing site stored in the user terminal device 100 connected via the first communication unit 40.
　または、写真特定部５３Ａは、第三者がｗｅｂ上で写真データを公開している写真共有サイトにおいて、ユーザによる閲覧頻度の高い写真共有サイトにおける写真データを特定するための情報を取得する。より詳しくは、写真特定部５３Ａは、第一通信部４０を介して接続されたユーザ端末装置１００に記憶されている、例えば、写真共有サイトの閲覧履歴、ブックマークなどの第三者の写真共有サイトの接続先情報を含むサイト情報を取得する。 Alternatively, the photo specifying unit 53A acquires information for specifying the photo data in the photo sharing site that is frequently viewed by the user in the photo sharing site where the third party discloses the photo data on the web. More specifically, the photo specifying unit 53A stores a third-party photo sharing site, such as a browsing history of a photo sharing site or a bookmark, stored in the user terminal device 100 connected via the first communication unit 40. Get site information including connection destination information.
　本実施形態では、写真特定部５３Ａは、分析部５４Ａにサイト情報を出力して、分析部５４Ａにおいて写真の分析を実行させる。 In the present embodiment, the photo specifying unit 53A outputs the site information to the analyzing unit 54A, and causes the analyzing unit 54A to execute a photo analysis.
　分析部５４Ａは、写真特定部５３Ａから分析指示とサイト情報とを受信すると、第二通信部４２Ａを介して写真分析サーバ装置１２０に写真の抽出と傾向分析とを指示する。分析部５４Ａは、写真分析サーバ装置１２０に、写真データを特定する情報、例えば、ｗｅｂ上のサイト情報を提供する。 When the analysis unit 54A receives the analysis instruction and the site information from the photo identification unit 53A, the analysis unit 54A instructs the photo analysis server device 120 to extract a photo and perform a trend analysis via the second communication unit 42A. The analysis unit 54A provides the photo analysis server device 120 with information for specifying the photo data, for example, site information on the web.
　分析部５４Ａは、サイト情報に基づいて、第二通信部４２Ａを介して当該写真共有サイトに接続する。分析部５４Ａは、写真共有サイトにユーザのアカウントで掲載されている写真データを特定して分析する。 The analysis unit 54A connects to the photo sharing site via the second communication unit 42A based on the site information. The analysis unit 54A specifies and analyzes the photo data posted in the user account on the photo sharing site.
　または、分析部５４Ａは、サイト情報に基づいて、第二通信部４２Ａを介して当該写真共有サイトに接続する。分析部５４Ａは、第三者によって写真共有サイトに掲載され、ユーザが高い頻度で閲覧している写真データを特定して分析する。 Alternatively, the analysis unit 54A connects to the photo sharing site via the second communication unit 42A based on the site information. The analysis unit 54A identifies and analyzes photo data that is posted on a photo sharing site by a third party and is frequently viewed by the user.
　分析部５４Ａは、ユーザが写真共有サイトを介してｗｅｂ上で公開している写真、または、第三者が写真共有サイトを介してｗｅｂ上で公開して、ユーザが高い頻度で閲覧している写真データのうち、風景写真データに限って分析してもよい。 The analysis unit 54 </ b> A publishes a photo published by the user on the web via the photo sharing site, or a third party publishes the photo on the web via the photo sharing site, and the user frequently browses the photo. Of the photo data, analysis may be limited to landscape photo data.
　第二通信制御部５７Ａは、第二通信部４２Ａを介した通信を制御する。第二通信制御部５７Ａは、写真特定部５３Ａからの制御によって第二通信部４２Ａを介してＳＮＳサーバ装置１１０と接続する。第二通信制御部５７Ａは、分析部５４Ａからの制御によって第二通信部４２Ａを介して写真分析サーバ装置１２０と接続する。 The second communication control unit 57A controls communication via the second communication unit 42A. The second communication control unit 57A connects to the SNS server device 110 via the second communication unit 42A under the control of the photo specifying unit 53A. The second communication control unit 57A connects to the photo analysis server device 120 via the second communication unit 42A under the control of the analysis unit 54A.
　次に、図５を用いて、制御部５０Ａにおける処理の流れについて説明する。ステップＳ２０１の処理は、図２に示すフローチャートのステップＳ１０１と同様の処理を行う。ここでは、風景写真データに限定して抽出する場合について説明する。 Next, the flow of processing in the control unit 50A will be described with reference to FIG. The process in step S201 performs the same process as step S101 in the flowchart shown in FIG. Here, a case in which extraction is limited to landscape photograph data will be described.
　制御部５０Ａは、写真特定部５３Ａによって、写真共有サイトのサイト情報を取得する（ステップＳ２０２）。より詳しくは、制御部５０Ａは、写真特定部５３Ａによって、第一通信部４０を介して接続されたユーザ端末装置１００に記憶されている写真共有サイトのサイト情報を取得する。または、制御部５０Ａは、写真特定部５３Ａによって、第一通信部４０を介して接続されたユーザ端末装置１００に記憶されている、例えば、写真共有サイトの閲覧履歴、ブックマークなどの第三者の写真共有サイトのサイト情報を取得する。 The control unit 50A acquires the site information of the photo sharing site by the photo specifying unit 53A (Step S202). More specifically, the control unit 50A acquires the site information of the photo sharing site stored in the user terminal device 100 connected via the first communication unit 40 by the photo specifying unit 53A. Alternatively, the control unit 50A may store, for example, a browsing history of a photo sharing site, a third party such as a bookmark stored in the user terminal device 100 connected via the first communication unit 40 by the photo specifying unit 53A. Get the site information of the photo sharing site.
　制御部５０Ａは、分析部５４Ａによって、第二通信部４２Ａを介して写真分析サーバ装置１２０に写真の抽出と傾向分析とを指示する（ステップＳ２０３）。 The control unit 50A causes the analysis unit 54A to instruct the photo analysis server device 120 to extract a photo and perform a trend analysis via the second communication unit 42A (step S203).
　制御部５０Ａは、第二通信部４２Ａを介して写真分析サーバ装置１２０から傾向分析の分析結果である傾向情報を受信したかを判定する（ステップＳ２０４）。制御部５０Ａは、第二通信部４２Ａを介して写真分析サーバ装置１２０から傾向情報を受信すると（ステップＳ２０４でＹｅｓ）、ステップＳ２０５に進む。制御部５０Ａは、第二通信部４２Ａを介して写真分析サーバ装置１２０から傾向情報を受信していないと（ステップＳ２０４でＮｏ）、ステップＳ２０４の処理を再度実行する。 The control unit 50A determines whether the trend information, which is the analysis result of the trend analysis, has been received from the photo analysis server device 120 via the second communication unit 42A (step S204). When receiving the trend information from the photo analysis server device 120 via the second communication unit 42A (Yes in step S204), the control unit 50A proceeds to step S205. If the control unit 50A has not received the trend information from the photo analysis server device 120 via the second communication unit 42A (No in Step S204), the control unit 50A executes the process of Step S204 again.
　制御部５０Ａは、第二通信部４２Ａを介して写真分析サーバ装置１２０から傾向分析の分析結果を取得する（ステップＳ２０５）。 The control unit 50A acquires the analysis result of the trend analysis from the photo analysis server device 120 via the second communication unit 42A (Step S205).
　図６を用いて、写真分析サーバ装置１２０における処理の流れについて説明する。 The flow of processing in the photo analysis server device 120 will be described with reference to FIG.
　写真分析サーバ装置１２０は、制御部５０Ａの分析部５４Ａからのサイト情報に基づいて、指定された写真共有サイトから風景写真データを抽出する（ステップＳ２１１）。より詳しくは、写真分析サーバ装置１２０は、サイト情報に基づいて、第二通信部４２Ａを介して当該写真共有サイトに接続して、写真共有サイトにユーザのアカウントで掲載されている風景写真データを抽出する。または、写真分析サーバ装置１２０は、サイト情報に基づいて、第二通信部４２Ａを介して当該写真共有サイトに接続して、第三者によって写真共有サイトに掲載され、ユーザが高い頻度で閲覧している風景写真データを抽出する。 The photo analysis server device 120 extracts the landscape photo data from the specified photo sharing site based on the site information from the analysis unit 54A of the control unit 50A (step S211). More specifically, the photo analysis server device 120 connects to the photo sharing site via the second communication unit 42A based on the site information, and converts the landscape photo data posted on the photo sharing site with the user's account. Extract. Alternatively, the photo analysis server device 120 connects to the photo sharing site via the second communication unit 42A based on the site information, is posted on the photo sharing site by a third party, and the user browses frequently. Scenery photo data is extracted.
　写真分析サーバ装置１２０は、抽出した風景写真データの傾向を分析する（ステップＳ２１２）。 (4) The photo analysis server device 120 analyzes the tendency of the extracted landscape photo data (step S212).
　写真分析サーバ装置１２０は、分析結果を第二通信部４２Ａを介して、制御部５０Ａに送信する（ステップＳ２１３）。 The photo analysis server device 120 transmits the analysis result to the control unit 50A via the second communication unit 42A (Step S213).
　このようにして、ユーザが写真共有サイトを介してｗｅｂ上で公開している写真データ、または、第三者によって写真共有サイトに掲載され、ユーザが高い頻度で閲覧している写真データから、ユーザの興味関心の対象の傾向を分析する。 In this way, the user can start from the photo data published on the web by the user via the photo sharing site or the photo data posted on the photo sharing site by a third party and frequently viewed by the user. Analyze trends in interests of interest.
　上述したように、本実施形態は、ユーザが写真共有サイトを介してｗｅｂ上で公開している写真データ、または、第三者によって写真共有サイトに掲載され、ユーザが高い頻度で閲覧している写真データから、ユーザの興味関心の対象の傾向を分析することができる。これにより、本実施形態は、より適切にユーザの嗜好の傾向を分析することができる。 As described above, in the present embodiment, the photograph data published by the user on the web via the photograph sharing site, or posted on the photograph sharing site by a third party, and the user browses frequently. From the photograph data, it is possible to analyze the tendency of the user's interest. Accordingly, the present embodiment can more appropriately analyze the tendency of the user's preference.
［第三実施形態］
　図７、図８を参照しながら、本実施形態に係る車両用撮影装置１Ｂについて説明する。図７は、第三実施形態に係る記録制御装置を有する車両用撮影装置の構成例を示すブロック図である。図８は、第三実施形態に係る記録制御装置における処理の流れを示すフローチャートである。車両用撮影装置１Ｂは、基本的な構成は第一実施形態の車両用撮影装置１と同様である。車両用撮影装置１Ｂは、制御部５０Ｂが検証部５８Ｂを備える点が第一実施形態と異なる。 [Third embodiment]
The vehicle photographing device 1B according to the present embodiment will be described with reference to FIGS. FIG. 7 is a block diagram illustrating a configuration example of a vehicle photographing apparatus having a recording control device according to the third embodiment. FIG. 8 is a flowchart illustrating a processing flow in the recording control device according to the third embodiment. The basic configuration of the vehicle photographing apparatus 1B is the same as that of the vehicle photographing apparatus 1 of the first embodiment. The vehicle imaging device 1B differs from the first embodiment in that the control unit 50B includes a verification unit 58B.
　検証部５８Ｂは、検索部５５が検索した映像データが正しい検索結果であるかを検証する。検証部５８Ｂは、例えば、検索部５５が検索した映像データを撮影した撮影場所情報と、撮影日時情報と、地図情報と、車両の向き情報との少なくともいずれかに基づいて、映像データが正しい映像データであるかを検証する。 The verification unit 58B verifies whether the video data searched by the search unit 55 is a correct search result. The verification unit 58B, for example, based on at least one of shooting location information, shooting date and time information, map information, and vehicle direction information of the video data searched by the search unit 55, determines that the video data is correct. Verify that it is data.
　例えば、検証部５８Ｂは、分析部５４が分析した傾向が海であるとき、映像データの撮影場所情報と地図情報と車両の向き情報とが海が見える場所であれば映像データが海を映したものであり正しいと判定し、海が見えない場所であれば、映像データが海を映したものではなく誤って検索されたと判定する。例えば、検証部５８Ｂは、分析部５４が分析した傾向が夕焼けの風景であるとき、映像データの撮影日時情報が日没前後の時刻であれば映像データが夕焼けを映したものであり正しいと判定し、日没前後以外の時刻であれば映像データが夕焼けを映したものではなく誤って検索されたと判定する。検証部５８Ｂは、映像データが正しいと判定したとき、記録処理部５６に保存要求指示を出力するよう指示する。 For example, when the tendency analyzed by the analysis unit 54 is the sea, the verification unit 58B reflects the sea if the shooting location information, the map information, and the vehicle orientation information of the video data are places where the sea can be seen. It is determined that the image data is correct, and if it is a place where the sea is not visible, it is determined that the video data is not an image of the sea but is erroneously searched. For example, when the analysis unit 54 analyzes the tendency of the sunset as a landscape, if the shooting date and time information of the video data is before and after sunset, the verification unit 58B determines that the video data reflects the sunset and is correct. However, if the time is other than before and after sunset, it is determined that the video data is not the one showing the sunset, but is erroneously searched. When determining that the video data is correct, the verification unit 58B instructs the recording processing unit 56 to output a storage request instruction.
　次に、図８を用いて、制御部５０Ｂにおける処理の流れについて説明する。ステップＳ３０１、ステップＳ３０２、ステップＳ３０４、ステップＳ３０５の処理は、図３に示すフローチャートのステップＳ１１１、ステップＳ１１２、ステップＳ１１３、ステップＳ１１４と同様の処理を行う。 Next, the flow of processing in the control unit 50B will be described with reference to FIG. The processing of steps S301, S302, S304, and S305 is similar to the processing of steps S111, S112, S113, and S114 of the flowchart shown in FIG.
　制御部５０Ｂは、検証部５８Ｂによって、映像データが誤った映像データではないかを判定する（ステップＳ３０３）。制御部５０Ｂは、検証部５８Ｂによって、映像データが誤って検索された映像データではないと判定された場合（ステップＳ３０３でＹｅｓ）、ステップＳ３０４に進む。制御部５０Ｂは、検証部５８Ｂによって、映像データが誤って検索された映像データであると判定された場合（ステップＳ３０３でＮｏ）、ステップＳ３０５に進む。 The control unit 50B determines whether the video data is incorrect video data using the verification unit 58B (step S303). When the verification unit 58B determines that the video data is not the video data that was erroneously searched (Yes in Step S303), the control unit 50B proceeds to Step S304. When the verification unit 58B determines that the video data is video data that has been erroneously searched (No in Step S303), the control unit 50B proceeds to Step S305.
　このようにして、検索部５５が検索した映像データが正しい検索結果であるかを検証して、正しい映像データであると判定されたとき、撮影された映像データを記憶部３０のメモリ３２等に上書き禁止で記録する。 In this manner, the search unit 55 verifies whether the searched video data is a correct search result, and when it is determined that the video data is correct, the captured video data is stored in the memory 32 of the storage unit 30 or the like. Record without overwriting.
　上述したように、本実施形態は、検索部５５が検索した映像データの正当性が検証されたとき、撮影された映像データを記憶部３０のメモリ３２等に上書き禁止で記録することができる。本実施形態によれば、記録する映像データの正当性を高めることができる。 As described above, in the present embodiment, when the validity of the video data retrieved by the retrieval unit 55 is verified, the captured video data can be recorded in the memory 32 of the storage unit 30 without overwriting. According to the present embodiment, the validity of video data to be recorded can be increased.
［第四実施形態］
　図９、図１０を参照しながら、本実施形態に係る車両用撮影装置１Ｃについて説明する。図９は、第四実施形態に係る記録制御装置を有する車両用撮影装置の構成例を示すブロック図である。図１０は、第四実施形態に係る記録制御装置における処理の流れを示すフローチャートである。車両用撮影装置１Ｃは、基本的な構成は第一実施形態の車両用撮影装置１と同様である。車両用撮影装置１Ｃは、制御部５０Ｃが第二通信制御部５７Ｃと写真公開部５９Ｃとを備える点と、検索部５５Ｃにおける処理が第一実施形態と異なる。 [Fourth embodiment]
With reference to FIG. 9 and FIG. 10, a vehicle photographing device 1C according to the present embodiment will be described. FIG. 9 is a block diagram illustrating a configuration example of a vehicular photographing apparatus having a recording control device according to the fourth embodiment. FIG. 10 is a flowchart illustrating a flow of processing in the recording control device according to the fourth embodiment. The basic configuration of the vehicle photographing apparatus 1C is the same as that of the vehicle photographing apparatus 1 of the first embodiment. The vehicle photographing apparatus 1C differs from the first embodiment in that the control unit 50C includes a second communication control unit 57C and a photo disclosure unit 59C, and the processing in the search unit 55C.
　検索部５５Ｃは、記録処理部５６に保存要求指示を行う際に、写真公開部５９Ｃに公開要求指示を行う。 When the search unit 55C issues a storage request instruction to the recording processing unit 56, the search unit 55C issues a disclosure request instruction to the photo publication unit 59C.
　第二通信制御部５７Ｃは、第二通信部４２Ｃを介した通信を制御する。第二通信制御部５７Ｃは、写真公開部５９Ｃからの制御によって第二通信部４２Ｃを介してＳＮＳサーバ装置１１０と接続する。 The second communication control unit 57C controls communication via the second communication unit 42C. The second communication control unit 57C connects to the SNS server device 110 via the second communication unit 42C under the control of the photo disclosure unit 59C.
　写真公開部５９Ｃは、第二通信部４２Ｃを介して、記録処理部５６が記録した動画像データ、または、静止画像データを、ユーザが利用している写真共有サイトを介してｗｅｂ上で公開する。写真公開部５９Ｃは、第一通信部４０を介してユーザ端末装置１００に動画像データ、または、静止画像データを送り、ユーザ端末装置１００が備える４Ｇや５Ｇなどの無線通信を介してユーザが利用している写真共有サイトを介してｗｅｂ上で公開させるようにしてもよい。 The photo publishing unit 59C publishes the moving image data or the still image data recorded by the recording processing unit 56 on the web via the second communication unit 42C via the photo sharing site used by the user. . The photo publishing unit 59C sends moving image data or still image data to the user terminal device 100 via the first communication unit 40, and is used by the user via wireless communication such as 4G or 5G provided in the user terminal device 100. It may be made public on the web via a photo sharing site.
　次に、図１０を用いて、制御部５０Ｃにおける処理の流れについて説明する。ステップＳ４０１ないしステップＳ４０３、ステップＳ４０５の処理は、図３に示すフローチャートのステップＳ１１１ないしステップＳ１１３、ステップＳ１１４と同様の処理を行う。 Next, the flow of processing in the control unit 50C will be described with reference to FIG. The processes in steps S401 to S403 and S405 are the same as those in steps S111 to S113 and S114 in the flowchart shown in FIG.
　制御部５０Ｃは、写真公開部５９Ｃによって、第二通信部４２Ｃを介して、記録処理部５６が記録した動画像データ、または、静止画像データを、ユーザが利用している写真共有サイトを介してｗｅｂ上で公開する（ステップＳ４０４）。 The control unit 50C transmits the moving image data or the still image data recorded by the recording processing unit 56 by the photo publishing unit 59C via the second communication unit 42C via a photo sharing site used by the user. It is made public on the web (step S404).
　このようにして、撮影された映像データが、分析した傾向に近ければ、記憶部３０のメモリ３２等に上書き禁止で記録するとともに、ユーザが利用している写真共有サイトを介してｗｅｂ上に自動で公開する。 In this manner, if the captured video data is close to the analyzed tendency, it is recorded in the memory 32 of the storage unit 30 or the like without overwriting, and automatically recorded on the web via the photo sharing site used by the user. Publish in.
　上述したように、本実施形態は、分析した傾向に近ければ、記憶部３０のメモリ３２等に上書き禁止で記録するとともに、ユーザが利用している写真共有サイトを介してｗｅｂ上に自動で公開することができる。このように、本実施形態は、ユーザの嗜好に合った、例えば、風景、建造物、店舗、設置物、植物、動物、移動体などを自動で記録するとともに、写真共有サイトを介してｗｅｂ上に自動で公開することができる。 As described above, in the present embodiment, if the tendency is close to the analyzed tendency, the data is recorded in the memory 32 of the storage unit 30 and the like without overwriting, and is automatically released on the web via the photo sharing site used by the user. can do. As described above, the present embodiment automatically records, for example, landscapes, buildings, stores, installed objects, plants, animals, moving objects, and the like that match the user's preference, and also stores the images on the web via a photo sharing site. Can be published automatically.
［第五実施形態］
　図１１ないし図１３を参照しながら、本実施形態に係る車両用撮影装置１Ｄについて説明する。図１１は、第五実施形態に係る記録制御装置を有する車両用撮影装置の構成例を示すブロック図である。図１２は、第五実施形態に係る記録制御装置における処理の流れを示すフローチャートである。図１３は、第五実施形態に係る記録制御装置における処理の流れを示すフローチャートである。車両用撮影装置１Ｄは、基本的な構成は第一実施形態の車両用撮影装置１と同様である。車両用撮影装置１Ｄは、制御部５０Ｄが興味関心特定部５３Ｄを備える点と、分析部５４Ｄにおける処理とが第一実施形態と異なる。 [Fifth embodiment]
With reference to FIGS. 11 to 13, a description will be given of a vehicle photographing apparatus 1D according to the present embodiment. FIG. 11 is a block diagram showing a configuration example of a vehicular photographing apparatus having a recording control device according to the fifth embodiment. FIG. 12 is a flowchart illustrating a processing flow in the recording control device according to the fifth embodiment. FIG. 13 is a flowchart illustrating a flow of processing in the recording control device according to the fifth embodiment. The basic configuration of the vehicle photographing apparatus 1D is the same as that of the vehicle photographing apparatus 1 of the first embodiment. The vehicle imaging device 1D differs from the first embodiment in that the control unit 50D includes an interest specifying unit 53D and the processing in the analysis unit 54D.
　興味関心特定部５３Ｄは、テキストデータによって、ユーザが興味関心を有する対象を特定する。例えば、興味関心特定部５３Ｄは、第一通信部４０を介して接続されているユーザ端末装置１００の入力履歴のテキストデータ、スケジュール情報に含まれるテキストデータ、メールに含まれるテキストデータ、または、ユーザがＳＮＳ上に投稿したテキストデータを分析対象として特定する。 (4) The interest / interest identification unit 53D identifies, based on the text data, a target that the user is interested in. For example, the interest specifying unit 53D may be configured to input text data of the input history of the user terminal device 100 connected via the first communication unit 40, text data included in schedule information, text data included in mail, or a user. Specifies the text data posted on the SNS as an analysis target.
　または、興味関心特定部５３Ｄは、第一通信部４０を介して接続されているユーザ端末装置１００におけるｗｅｂ上のサイトの閲覧履歴情報によって、ユーザが興味関心を有する対象を特定してもよい。 Alternatively, the interest specifying unit 53 </ b> D may specify a target to which the user has an interest based on browsing history information of a site on the web in the user terminal device 100 connected via the first communication unit 40.
　または、興味関心特定部５３Ｄは、第一通信部４０を介して接続されているユーザ端末装置１００から取得可能な行動履歴情報によって、ユーザが興味関心を有する対象を特定してもよい。ユーザ端末装置１００から取得可能な行動履歴情報は、例えば、ユーザ端末装置１００の現在地情報の履歴情報、または、経路案内の履歴情報を含む。 Alternatively, the interest specifying unit 53 </ b> D may specify a target that the user is interested in, based on action history information that can be acquired from the user terminal device 100 connected via the first communication unit 40. The action history information that can be acquired from the user terminal device 100 includes, for example, history information of current location information of the user terminal device 100 or history information of route guidance.
　または、興味関心特定部５３Ｄは、第一通信部４０を介して接続されているナビゲーション装置の目的地の履歴情報または走行経路の履歴情報によって、ユーザが興味関心を有する対象を特定してもよい。 Alternatively, the interest specifying unit 53D may specify a target that the user is interested in based on the history information of the destination or the travel route of the navigation device connected via the first communication unit 40. .
　分析部５４Ｄは、興味関心特定部５３Ｄが特定したテキストデータの傾向を分析する。より詳しくは、分析部５４Ｄは、特定したテキストデータに含まれる単語から、ユーザの嗜好の傾向を分析してもよい。例えば、分析部５４Ｄは、特定したテキストデータに基づいて、海を示す単語が複数含まれている場合、ユーザが海に興味関心が高いと分析する。 The analysis unit 54D analyzes the tendency of the text data specified by the interest specifying unit 53D. More specifically, the analysis unit 54D may analyze the tendency of the user's preference from the words included in the specified text data. For example, based on the identified text data, the analysis unit 54D analyzes that the user is highly interested in the sea when a plurality of words indicating the sea are included.
　分析部５４Ｄは、興味関心特定部５３Ｄが特定したサイトの閲覧履歴情報で特定されるサイトの傾向を分析する。より詳しくは、分析部５４Ｄは、特定したサイトの閲覧履歴情報に基づいて、図示しない通信装置を介して当該サーバに接続して、サイト上の写真データ、または、テキストデータに含まれる単語から、ユーザの嗜好の傾向を分析してもよい。例えば、分析部５４Ｄは、特定したサイトの閲覧履歴情報に基づいて、マンホールの写真データが複数掲載されているサイト、または、マンホールを示す単語が複数含まれているサイトを高い頻度で閲覧している場合、ユーザがマンホールに興味関心が高いと分析する。 The analysis unit 54D analyzes the tendency of the site specified by the browsing history information of the site specified by the interest specifying unit 53D. More specifically, based on the browsing history information of the specified site, the analysis unit 54D connects to the server via a communication device (not shown), and extracts the photo data on the site or words included in the text data from the site. The tendency of the user's preference may be analyzed. For example, based on the browsing history information of the specified site, the analysis unit 54D frequently browses a site in which a plurality of manhole photo data is posted or a site in which a plurality of words indicating a manhole are included. If yes, it is analyzed that the user is interested in the manhole.
　分析部５４Ｄは、興味関心特定部５３Ｄが特定した行動履歴情報の傾向を分析する。より詳しくは、分析部５４Ｄは、特定した行動履歴情報に基づいて、高い頻度で訪れて、所定時間以上滞在している場所、または、場所の傾向から、ユーザの嗜好の傾向を分析してもよい。例えば、分析部５４Ｄは、特定した行動履歴情報に基づいて、毎週、２０分以上、ラーメン屋に滞在している場合、ユーザがラーメンに興味関心が高いと分析する。 The analysis unit 54D analyzes the tendency of the action history information specified by the interest specifying unit 53D. More specifically, the analyzing unit 54D analyzes the tendency of the user's preference from the place where the user visits frequently and stays for a predetermined time or more, or the tendency of the place based on the specified action history information. Good. For example, based on the specified action history information, the analysis unit 54D analyzes that the user has a high interest in ramen when staying at the ramen shop for 20 minutes or more every week.
　分析部５４Ｄは、興味関心特定部５３Ｄが特定した目的地の履歴情報または走行経路の履歴情報の傾向を分析する。より詳しくは、分析部５４Ｄは、特定した目的地の履歴情報または走行経路の履歴情報に基づいて、高い頻度で訪れている場所、または、場所の傾向から、ユーザの嗜好の傾向を分析してもよい。例えば、分析部５４Ｄは特定した目的地の履歴情報または走行経路の履歴情報に基づいて、桜が見ごろを迎えた場所を複数回訪れている場合、ユーザが桜に興味関心が高いと分析する。 The analysis unit 54D analyzes the tendency of the history information of the destination or the history information of the traveling route specified by the interest specifying unit 53D. More specifically, the analysis unit 54D analyzes the tendency of the user's preference from the frequently visited places or the tendency of the places based on the history information of the specified destination or the history information of the travel route. Is also good. For example, based on the history information of the specified destination or the travel route, the analysis unit 54D analyzes that the user is highly interested in cherry blossoms when visiting the place where cherry blossoms are in full bloom multiple times. .
　次に、図１２、図１３を用いて、制御部５０Ｄにおける処理の流れについて説明する。図１２においてステップＳ５０１、ステップＳ５０４の処理は、図２に示すフローチャートのステップＳ１０１、ステップＳ１０４と同様の処理を行う。ここでは、入力履歴のテキストデータによって、風景に関連するテキストを抽出する場合について説明する。 Next, the flow of processing in the control unit 50D will be described with reference to FIGS. In FIG. 12, the processes of steps S501 and S504 perform the same processes as steps S101 and S104 of the flowchart shown in FIG. Here, a case will be described in which text related to landscape is extracted from the text data of the input history.
　制御部５０Ｄは、興味関心特定部５３Ｄによって、接続されているユーザ端末装置１００入力履歴のテキストを特定する（ステップＳ５０２）。 The control unit 50D specifies the text of the input history of the connected user terminal device 100 by the interest specifying unit 53D (step S502).
　制御部５０Ｄは、分析部５４Ｄによって、特定されたテキストデータのうち、風景に関連するテキストを抽出する（ステップＳ５０３）。 The control unit 50D extracts text related to the landscape from the text data specified by the analysis unit 54D (step S503).
　図１３において、ステップＳ５１１、ステップＳ５１３、ステップ５１４の処理は、図３に示すフローチャートのステップＳ１１１、ステップＳ１１３、ステップＳ１１４と同様の処理を行う。 In FIG. 13, the processes of steps S511, S513, and 514 are the same as those of steps S111, S113, and S114 of the flowchart shown in FIG.
　制御部５０Ｄは、検索部５５によって、傾向情報に近い映像データがあるかを判定する（ステップＳ５１２）。より詳しくは、制御部５０は、検索部５５によって、分析部５４が分析した興味関心を示すテキストデータに関連する映像データがあるかを検索する。制御部５０は、検索部５５によって、興味関心を示すテキストデータに関連する映像データが検索された場合（ステップＳ５１２でＹｅｓ）、ステップＳ５１３に進む。制御部５０は、検索部５５によって、興味関心を示すテキストデータに関連する映像データが検索されなかった場合（ステップＳ５１２でＮｏ）、ステップＳ５１４に進む。 The control unit 50D determines whether there is video data close to the trend information by the search unit 55 (step S512). More specifically, the control unit 50 causes the search unit 55 to search for video data related to the text data indicating the interest analyzed by the analysis unit 54. When the search unit 55 searches for video data related to the text data indicating interest and interest (Yes in step S512), the control unit 50 proceeds to step S513. When the search unit 55 does not search for video data related to the text data indicating interest and interest (No in step S512), the control unit 50 proceeds to step S514.
　このようにして、写真データ以外にも、ユーザ端末装置１００から取得可能なテキストデータ、サイトの閲覧履歴情報、行動履歴情報、ナビゲーション装置から取得可能な目的地の履歴情報、または、走行経路の履歴情報から、ユーザの興味関心の対象の傾向を分析する。 In this manner, in addition to the photograph data, text data that can be obtained from the user terminal device 100, site browsing history information, action history information, destination history information that can be obtained from the navigation device, or travel route history From the information, the tendency of the user's interest is analyzed.
　上述したように、本実施形態は、写真データ以外の、ユーザ端末装置１００から取得可能なテキスト、サイトの閲覧履歴情報、行動履歴情報、ナビゲーション装置から取得可能な目的地の履歴情報、または、走行経路の履歴情報から、ユーザの興味関心の対象の傾向を分析することができる。本実施形態によれば、写真データがない場合でも、ユーザの興味関心の対象の傾向を分析して、ユーザの嗜好に合った、例えば、風景、建造物、店舗、設置物、植物、動物、移動体などを自動で記録することができる。 As described above, in the present embodiment, text data that can be acquired from the user terminal device 100, site browsing history information, action history information, destination history information that can be acquired from the navigation device, or travel other than photo data From the route history information, it is possible to analyze the tendency of the user's interest. According to the present embodiment, even when there is no photo data, the tendency of the user's interest is analyzed, and for example, landscapes, buildings, stores, installations, plants, animals, Moving objects and the like can be automatically recorded.
　さて、これまで本発明に係る車両用撮影装置１について説明したが、上述した実施形態以外にも種々の異なる形態にて実施されてよいものである。 Although the vehicle photographing apparatus 1 according to the present invention has been described above, the present invention may be implemented in various different forms other than the above-described embodiment.
　図示した車両用撮影装置１の各構成要素は、機能概念的なものであり、必ずしも物理的に図示の如く構成されていなくてもよい。すなわち、各装置の具体的形態は、図示のものに限られず、各装置の処理負担や使用状況などに応じて、その全部または一部を任意の単位で機能的または物理的に分散または統合してもよい。 The components of the vehicle photographing apparatus 1 shown in the drawings are functionally conceptual, and need not necessarily be physically configured as shown in the drawings. In other words, the specific form of each device is not limited to the one shown in the figure, and all or a part of each device may be functionally or physically dispersed or integrated in arbitrary units according to the processing load and usage status of each device. You may.
　車両用撮影装置１の構成は、例えば、ソフトウェアとして、メモリにロードされたプログラムなどによって実現される。上記実施形態では、これらのハードウェアまたはソフトウェアの連携によって実現される機能ブロックとして説明した。すなわち、これらの機能ブロックについては、ハードウェアのみ、ソフトウェアのみ、または、それらの組み合わせによって種々の形で実現できる。 構成 The configuration of the vehicle photographing apparatus 1 is realized by, for example, a program or the like loaded into a memory as software. In the above-described embodiment, the description has been given as the function block realized by the cooperation of the hardware or the software. That is, these functional blocks can be realized in various forms by only hardware, only software, or a combination thereof.
　上記した構成要素には、当業者が容易に想定できるもの、実質的に同一のものを含む。さらに、上記した構成は適宜組み合わせが可能である。また、本発明の要旨を逸脱しない範囲において構成の種々の省略、置換または変更が可能である。 構成 The above-mentioned components include those that can be easily assumed by those skilled in the art and those that are substantially the same. Further, the above-described configurations can be appropriately combined. Further, various omissions, substitutions, or changes in the configuration can be made without departing from the spirit of the present invention.
　車両用撮影装置１は、カメラ２０が車両に配置されていれば、記憶部３０と制御部５０とは例えば自宅に置かれた記録制御サーバ装置に含まれていてもよい。 In the vehicular photographing apparatus 1, the storage unit 30 and the control unit 50 may be included in, for example, a recording control server device placed at home as long as the camera 20 is disposed in the vehicle.
　１　　　　車両用撮影装置
　２０　　　カメラ（撮影部）
　３０　　　記憶部
　４０　　　第一通信部
　５０　　　制御部（記録制御装置）
　５１　　　映像データ取得部
　５２　　　第一通信制御部
　５３　　　写真特定部
　５４　　　分析部
　５５　　　検索部
　５６　　　記録処理部 1 vehicle photographing device 20 camera (photographing unit)
Reference Signs List 30 storage unit 40 first communication unit 50 control unit (recording control device)
51 Video Data Acquisition Unit 52 First Communication Control Unit 53 Photo Identification Unit 54 Analysis Unit 55 Search Unit 56 Recording Processing Unit

Claims (10)

  1. 　周囲の風景を撮影する撮影部からの映像データを取得する映像データ取得部と、
    　ユーザが興味関心を有する対象を特定する興味関心特定部と、
    　前記興味関心特定部が特定した興味関心の対象の傾向を分析する分析部と、
    　前記映像データ取得部が取得した映像データから、前記分析部が分析した傾向に含まれる映像データを検索する検索部と、
    　前記検索部の検索によって前記分析部が分析した傾向に含まれる映像データがあると判定した場合、その映像データを記録する記録処理部と、
    　を備えることを特徴とする、記録制御装置。     A video data acquisition unit that acquires video data from a shooting unit that shoots a surrounding landscape;
    An interest specifying unit that specifies an object of interest to the user;
    An analysis unit that analyzes the tendency of the interest of interest identified by the interest identification unit,
    From the video data obtained by the video data acquisition unit, a search unit that searches for video data included in the tendency analyzed by the analysis unit,
    When it is determined that there is video data included in the tendency analyzed by the analysis unit by the search of the search unit, a recording processing unit that records the video data,
    A recording control device comprising:
  2. 　前記興味関心特定部は、ユーザに関係する写真データを特定する写真特定部であり、
    　前記分析部は、前記写真特定部が特定した写真データの傾向を分析する、
    　請求項１に記載の記録制御装置。     The interest specifying unit is a photo specifying unit that specifies photo data related to the user,
    The analysis unit analyzes the tendency of the photo data specified by the photo specification unit,
    The recording control device according to claim 1.
  3. 　前記写真特定部は、前記ユーザが撮影した写真データを特定する、
    　請求項２に記載の記録制御装置。     The photo specifying unit specifies photo data taken by the user,
    The recording control device according to claim 2.
  4. 　前記写真特定部は、前記ユーザが写真共有サイトを介してｗｅｂ上で公開している写真データを特定する、
    　請求項２に記載の記録制御装置。     The photo specifying unit specifies photo data that the user has published on the web via a photo sharing site.
    The recording control device according to claim 2.
  5. 　前記写真特定部は、第三者がｗｅｂ上で写真データを公開している写真共有サイトにおいて、前記ユーザによる閲覧頻度の高い写真共有サイトにおける写真データを特定する、
    　請求項２に記載の記録制御装置。     In the photo sharing site in which a third party publishes the photo data on the web, the photo specifying unit specifies the photo data in the photo sharing site frequently viewed by the user.
    The recording control device according to claim 2.
  6. 　前記写真特定部は、風景が撮影された風景写真データを特定し、
    　前記記録処理部は、前記映像データ取得部が取得した映像データに、前記分析部が分析した傾向に含まれる風景の映像データがある場合、その映像データを記録する、
    　請求項２から５のいずれか１項に記載の記録制御装置。     The photograph specifying unit specifies landscape photograph data in which a landscape is captured,
    The recording processing unit, when the video data obtained by the video data acquisition unit, if there is a video data of a landscape included in the tendency analyzed by the analysis unit, records the video data,
    The recording control device according to claim 2.
  7. 　前記分析部は、特定された風景写真データの色の傾向を分析し、
    　前記記録処理部は、前記分析部が分析した色の傾向に含まれる風景の映像データがある場合、その映像データを記録する、
    　請求項６に記載の記録制御装置。     The analysis unit analyzes a color tendency of the identified landscape photograph data,
    The recording processing unit, when there is video data of a landscape included in the color tendency analyzed by the analysis unit, records the video data,
    The recording control device according to claim 6.
  8. 　前記分析部は、特定された風景写真データの構成の傾向を分析し、
    　前記記録処理部は、前記分析部が分析した構成の傾向に含まれる風景の映像データがある場合、その映像データを記録する、
    　請求項６または７に記載の記録制御装置。     The analysis unit analyzes a tendency of the configuration of the identified landscape photograph data,
    The recording processing unit, when there is video data of a landscape included in the tendency of the configuration analyzed by the analysis unit, records the video data,
    The recording control device according to claim 6.
  9. 　周囲の風景を撮影する撮影部からの映像データを取得する映像データ取得ステップと、
    　ユーザが興味関心を有する対象を特定する興味関心特定ステップと、
    　前記興味関心特定ステップによって特定した興味関心の対象の傾向を分析する分析ステップと、
    　前記映像データ取得ステップによって取得した映像データから、前記分析ステップによって分析した傾向に含まれる映像データを検索する検索ステップと、
    　前記検索ステップによって前記分析ステップが分析した傾向に含まれる映像データがあると判定した場合、その映像データを記録する記録処理ステップと、
    　を含む記録制御方法。     A video data obtaining step of obtaining video data from a shooting unit for shooting the surrounding landscape;
    An interest identification step of identifying an object of interest to the user;
    An analysis step of analyzing the tendency of the object of interest identified by the interest identification step,
    From the video data obtained by the video data obtaining step, a search step of searching for video data included in the tendency analyzed by the analysis step,
    When determining that there is video data included in the tendency analyzed by the analysis step by the search step, a recording processing step of recording the video data,
    A recording control method including:
  10. 　周囲の風景を撮影する撮影部からの映像データを取得する映像データ取得ステップと、
    　ユーザが興味関心を有する対象を特定する興味関心特定ステップと、
    　前記興味関心特定ステップによって特定した興味関心の対象の傾向を分析する分析ステップと、
    　前記映像データ取得ステップによって取得した映像データから、前記分析ステップによって分析した傾向に含まれる映像データを検索する検索ステップと、
    　前記検索ステップによって前記分析ステップが分析した傾向に含まれる映像データがあると判定した場合、その映像データを記録する記録処理ステップと、
    　を記録制御装置として動作するコンピュータに実行させるためのプログラム。     A video data obtaining step of obtaining video data from a shooting unit for shooting the surrounding landscape;
    An interest identification step of identifying an object of interest to the user;
    An analysis step of analyzing the tendency of the object of interest identified by the interest identification step,
    From the video data obtained by the video data obtaining step, a search step of searching for video data included in the tendency analyzed by the analysis step,
    When determining that there is video data included in the tendency analyzed by the analysis step by the search step, a recording processing step of recording the video data,
    For causing a computer that operates as a recording control device to execute.
PCT/JP2019/005419 2018-06-25 2019-02-14 Recording control device, vehicle photography device, recording control method, and program WO2020003584A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018-119895 2018-06-25
JP2018119895A JP2020003857A (en) 2018-06-25 2018-06-25 Record controller, imaging device for vehicle, record control method and program

Publications (1)

Publication Number Publication Date
WO2020003584A1 true WO2020003584A1 (en) 2020-01-02

Family

ID=68986384

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/005419 WO2020003584A1 (en) 2018-06-25 2019-02-14 Recording control device, vehicle photography device, recording control method, and program

Country Status (2)

Country Link
JP (1) JP2020003857A (en)
WO (1) WO2020003584A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10336576A (en) * 1997-05-29 1998-12-18 Yamaha Motor Co Ltd Image recording system
US20130142435A1 (en) * 2010-05-26 2013-06-06 Sony Mobile Communications Ab Camera system and method for taking photographs that correspond to user preferences
US20150373258A1 (en) * 2014-06-24 2015-12-24 Cyberlink Corp. Systems and Methods for Automatically Capturing Digital Images Based on Adaptive Image-Capturing Templates

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10336576A (en) * 1997-05-29 1998-12-18 Yamaha Motor Co Ltd Image recording system
US20130142435A1 (en) * 2010-05-26 2013-06-06 Sony Mobile Communications Ab Camera system and method for taking photographs that correspond to user preferences
US20150373258A1 (en) * 2014-06-24 2015-12-24 Cyberlink Corp. Systems and Methods for Automatically Capturing Digital Images Based on Adaptive Image-Capturing Templates

Also Published As

Publication number Publication date
JP2020003857A (en) 2020-01-09

Similar Documents

Publication Publication Date Title
JP6675770B2 (en) Map update method and in-vehicle terminal
US20200349839A1 (en) Image data integrator for addressing congestion
US10021254B2 (en) Autonomous vehicle cameras used for near real-time imaging
JP6815262B2 (en) Traffic violation detectors, systems, traffic violation detection methods and programs
US11481991B2 (en) System and method for detecting and transmitting incidents of interest of a roadway to a remote server
US10832567B2 (en) Systems and methods for generating composite real-time traffic images based on triggering events using data from vehicle borne sensors
TWI684938B (en) Guidance system
US10827725B2 (en) Animal rescue system and animal rescue method, and server used for animal rescue system and animal rescue method
US9922049B2 (en) Information processing device, method of processing information, and program for processing information
US20200076895A1 (en) Data collection apparatus, on-vehicle device, data collection system, and data collection method
CN102447886A (en) Visualizing video within existing still images
CN107636685A (en) Automatic meta-tag in image
CN111476179B (en) Behavior prediction method for key target, AI tracking camera and storage medium
WO2022083259A1 (en) Substitute autonomous vehicle data
WO2018061176A1 (en) Drone control system, drone control method, and program
JP2021177317A (en) Three-dimensional model construction system and three-dimensional model construction method
WO2020003584A1 (en) Recording control device, vehicle photography device, recording control method, and program
JP7180457B2 (en) Data Acquisition Device, Data Acquisition System, Data Acquisition Method and Program
JP6658040B2 (en) Vehicle information acquisition system, vehicle information acquisition method, vehicle information acquisition program, storage medium for storing vehicle information acquisition program
KR102300349B1 (en) Unmanned drone for automatically setting moving path according to detection situation, and operating method thereof
JP6134457B1 (en) Proposal server, proposal system, proposal method, program, and non-transitory computer-readable information recording medium
KR102648582B1 (en) Method for monitoring using integrated module based on ladar and camera and system using the same
KR101762514B1 (en) Method and apparatus for providing information related to location of shooting based on map
JP2008242682A (en) Automatic meta information imparting system, automatic meta information imparting method, and automatic meta information imparting program
WO2019163119A1 (en) Computer system, drone control method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19824490

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19824490

Country of ref document: EP

Kind code of ref document: A1