CN115461729A - Content selection device, content display system, content selection method, and content selection program - Google Patents
Content selection device, content display system, content selection method, and content selection program Download PDFInfo
- Publication number
- CN115461729A CN115461729A CN202080100115.1A CN202080100115A CN115461729A CN 115461729 A CN115461729 A CN 115461729A CN 202080100115 A CN202080100115 A CN 202080100115A CN 115461729 A CN115461729 A CN 115461729A
- Authority
- CN
- China
- Prior art keywords
- content
- playback
- unit
- content selection
- person
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
Abstract
A content selection apparatus having: an image acquisition unit that acquires a captured image; a person detection unit that detects a person included in the image; an attribute determination unit that determines an attribute of the person detected by the person detection unit; a content selection section that selects a content based on the attribute; and a playback control unit that prepares playback of the plurality of contents selected by the content selection unit until a first content being played back ends, and plays back a second content that is any one of the plurality of contents when the first content ends.
Description
Technical Field
The invention relates to a content selection device, a content display system, a content selection method, and a content selection program.
Background
Conventionally, various techniques have been proposed for detecting a feature of an object included in an image captured by an imaging device and displaying a content such as an advertisement suitable for the detected feature on a display device.
For example, patent document 1 listed below discloses a technique for detecting a feature of a viewer (object) of a digital signage by face recognition processing of a captured image and determining a content corresponding to the feature as a content of an output object.
Prior art documents
Patent document
Patent document 1: japanese patent laid-open publication No. 2016-174330
Disclosure of Invention
Problems to be solved by the invention
However, when there is time left until the next content is determined to be played back during playback of the content, the object may move out of the area where the content can be visually confirmed or a new object may be detected during the time. As an example of a factor that causes a time to elapse from the determination of the next content to the playback, preparation (e.g., decoding) for playing back the content after the determination of the next content may be performed. Thereby, it is possible to play back content that does not fit the characteristics of the object.
In view of the above-described problems, it is an object of the present invention to provide a content selection device, a content display system, a content selection method, and a content selection program that can prevent playback of content that is not suitable for the characteristics of an object.
Means for solving the problems
In order to solve the above problem, a content selection device according to an aspect of the present invention includes: an image acquisition unit that acquires a captured image; a person detection unit that detects a person included in the image; an attribute determination unit configured to determine an attribute of the person detected by the person detection unit; a content selection section that selects a content based on the attribute; and a playback control unit that prepares playback of the plurality of contents selected by the content selection unit until a first content being played back ends, and when the first content ends, plays back a second content that is one of the plurality of contents.
A content display system according to an aspect of the present invention includes: a shooting part; an image acquisition unit that acquires the image captured by the imaging unit; a person detection unit that detects a person included in the image; an attribute determination unit configured to determine an attribute of the person detected by the person detection unit; a content selection section that selects a content based on the attribute; a playback control unit that prepares playback of the plurality of contents selected by the content selection unit until a first content being played back ends, and plays back a second content that is any one of the plurality of contents when the first content ends; and a display unit that displays the reproduced second content.
In a content selection method according to an aspect of the present invention, a captured image is acquired, a person included in the image is detected, attributes of the detected person are determined, a content is selected based on the attributes, playback of a plurality of selected contents is prepared until a first content being played back ends, and a second content that is any one of the plurality of contents is played back when the first content ends.
A content selection program according to an aspect of the present invention causes a computer to execute the steps of: an image acquisition step of acquiring a captured image; a person detection step of detecting a person included in the image; an attribute determination step of determining an attribute of the person detected by the person detection step; a content selection section that selects a content based on the attribute; and a playback control step section that prepares playback of the plurality of contents selected in the content selection step until a first content being played back ends, and plays back a second content that is any one of the plurality of contents when the first content ends.
Effects of the invention
According to the present invention, playback of content that does not fit the characteristics of an object can be prevented.
Drawings
Fig. 1 is a diagram showing an example of the configuration of a content display system according to an embodiment of the present invention.
Fig. 2 is a block diagram showing an example of a functional configuration of a content selection device according to an embodiment of the present invention.
Fig. 3 is a diagram showing an example of state transition of the playback unit according to the embodiment of the present invention.
Fig. 4 is a flowchart showing an example of the flow of processing in the content selection device according to the embodiment of the present invention.
Fig. 5 is a flowchart showing an example of a detailed flow of the content preparation process according to the embodiment of the present invention.
Fig. 6 is a sequence diagram showing an example of a flow of processing in preparation of contents according to the embodiment of the present invention.
Fig. 7 is a sequence diagram showing an example of a flow of processing in preparation of a content according to the embodiment of the present invention.
Fig. 8 is a sequence diagram showing an example of a flow of processing in the playback of content according to the embodiment of the present invention.
Fig. 9 is a block diagram showing a minimum configuration of the content selection apparatus of the present invention.
Detailed Description
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the drawings, an X axis, a Y axis, and a Z axis orthogonal to each other are shown as necessary. The X, Y and Z axes are common in all figures. In each axis, a direction in which an arrow extends is referred to as a "positive direction", and a direction opposite to the positive direction is referred to as a "negative direction".
<1. First embodiment >
First, a first embodiment of the present invention will be explained.
<1. Structure of content display System >
An example of the configuration of the content display system according to the present embodiment will be described with reference to fig. 1. Fig. 1 is a diagram showing an example of the configuration of a content display system according to the present embodiment. As shown in fig. 1, the content display system 1 includes a camera 10, a content selection device 20, a server 30, and a display device 40.
Each device included in the content display system 1 is connected via a network NW so as to be capable of transmitting and receiving information.
For example, the content selection device 20 and the server device 30 are connected via a Wide Area Network (WAN). The WAN is implemented, for example, through an internet connection.
For example, the imaging device 10 and the content selection device 20, and the content selection device 20 and the display device 40 are connected by a Local Area Network (LAN). The LAN may be implemented by wired connection, or may be implemented by wireless connection such as bluetooth (registered trademark) or Wi-Fi (registered trademark).
The imaging device 10 is an example of the "imaging unit" included in the content display system 1. The display device 40 is an example of the "display unit" included in the content display system 1.
(1) Imaging device 10
The imaging device 10 is a device that acquires an image (hereinafter, also referred to as "captured image") obtained by capturing an image of the pedestrian 2 (2 a, 2b, 2 c). The imaging device 10 is, for example, a camera. The imaging device 10 transmits the captured image to the content selection device 20 via the network NW. In the present embodiment, the imaging device 10 transmits the captured images to the content selection device 20 at predetermined time intervals. The predetermined time interval is, for example, 1/60 second interval. The predetermined time interval is not limited to the above example. The pedestrians imaged by the imaging device 10 are not limited to the three pedestrians 2a to 2 c. The photographing device 10 can photograph an arbitrary number of pedestrians.
The pedestrian 2 is a person walking in an arbitrary direction at an arbitrary speed. For example, as shown in FIG. 1, a pedestrian 2a is walking at a walking speed v a1 Walking in the positive direction of the X-axis. The pedestrian 2b is walking at a walking speed v b1 Walking in the positive direction of the X-axis. The pedestrian 2c is walking at a walking speed v c1 Walking in the positive direction of the X-axis.
(2) Content selection device 20
The content selection apparatus 20 is a terminal that controls the display of content on the display apparatus 40. For example, the content selection device 20 selects the content displayed on the display device 40 based on the captured image received from the imaging device 10. The content selection device 20 transmits the selected content to the display device 40 via the network NW. Here, the content is, for example, an image (still picture/moving picture) displaying an advertisement. The processing performed by the content selection apparatus 20 may be performed by the server apparatus 30.
(3) Server device 30
The server device 30 is a device that performs processing related to various kinds of information. For example, the server apparatus 30 generates content used in the content selection apparatus 20. Further, the server device 30 may generate information associating the attribute of the person with the content. The server apparatus 30 transmits the generated information to the content selection apparatus 20 and stores the information. The server apparatus 30 may update the information stored in the content selection apparatus 20. The attribute is information representing a feature of a person. For example, attributes include gender, age group, occupation, clothing, carrying items, and the like.
(4) Display device 40
The display device 40 is a device for displaying content (images) on the display screen 42. The display device 40 is, for example, a digital signage, and displays content representing an advertisement. The display screen 42 is, for example, any one of a liquid crystal display, a plasma display, an Organic EL (Organic Electro-Luminescence) display, and the like. The digital signage may be realized by a device that displays content by projecting the content from a projector onto a screen.
<2. Functional Structure of content selection apparatus >
In the above, an example of the configuration of the content display system 1 according to the embodiment of the present invention is described. Next, an example of the functional configuration of the content selection device according to the embodiment of the present invention will be described with reference to fig. 2. Fig. 2 is a block diagram showing an example of a functional configuration of a content selection device according to an embodiment of the present invention. As shown in fig. 2, the content selection device 20 includes a communication unit 21, a control unit 23, and a storage unit 25.
(1) Communication unit 21
The communication unit 21 transmits and receives various kinds of information. For example, the communication unit 21 transmits a control signal to the imaging device 10 and receives a captured image from the imaging device 10. The communication unit 21 inputs the received captured image to the control unit 23. The communication unit 21 transmits the content input from the control unit 23 to the display device 40.
(2) Control section 23
The control unit 23 controls the entire operation of the content selection apparatus 20. The control Unit 23 is realized by causing a CPU (Central Processing Unit) provided as hardware in the content selection device 20 to execute a program. As shown in fig. 2, the control unit 23 includes an image acquisition unit 230, a detection unit 231, an attribute determination unit 232, a content selection unit 233, a content playback control unit 234, and a display processing unit 235.
(2-1) image acquiring section 230
The image acquisition unit 230 acquires a captured image captured by the imaging device 10. For example, the image acquisition unit 230 acquires the captured image transmitted from the imaging device 10 via the network NW. The image acquisition unit 230 inputs the acquired captured image to the detection unit 231. The image acquisition unit 230 may temporarily hold the captured image transmitted from the imaging device 10 and then input the captured image to the detection unit 231.
(2-2) detection part 231
The detection unit 231 detects a person and detects a person's action. As shown in fig. 2, the detection unit 231 includes a human detection unit 2310, a direction detection unit 2311, and a speed detection unit 2312.
(2-2-1) human detection section 2310
The person detection unit 2310 detects a person included in the captured image. For example, the person detection unit 2310 detects a person included in the captured image through image recognition processing of the captured image input from the image acquisition unit 230. The process of the person detection unit 2310 detecting a person from the captured image is hereinafter also referred to as "person detection process".
When a person is detected by the person detection process, the person detection section 2310 extracts an image of the detected person from the captured image. The person detection unit 2310 inputs the extracted image of the person (hereinafter also referred to as "person image") to the attribute determination unit 232, and performs person detection processing on the captured image that is input next. The human detection unit 2310 may input the human image or the result of human detection to the direction detection unit 2311 and the speed detection unit 2312. On the other hand, in the case where no person is detected by the person detection processing, the person detection portion 2310 performs the person detection processing on the captured image which is input next.
(2-2-2) orientation detection section 2311
The direction detection unit 2311 detects the direction of the face of the person included in the captured image, in accordance with the movement of the person. For example, the direction detection unit 2311 performs image recognition processing on the human image input from the human detection unit 2310 to detect the direction of the face of the human detected by the human detection unit 2310. The process of the orientation detection unit 2311 detecting the orientation of the face of the person from the person image is hereinafter also referred to as "orientation detection process".
When the orientation of the face of the person is detected by the orientation detection process, the orientation detection unit 2311 inputs the detection result to the content selection unit 233.
(2-2-3) speed detection section 2312
The speed detection unit 2312 detects the walking speed of the person included in the captured image, in response to the movement of the person. For example, the speed detection unit 2312 performs image recognition processing on the captured image input from the image acquisition unit 230 based on the detection result of the person input from the person detection unit 2310, and detects the walking speed of the person detected by the person detection unit 2310. The process of the speed detection unit 2312 detecting the walking speed of the person from the captured image is hereinafter also referred to as "speed detection process".
When the walking speed of the person is detected by the speed detection process, the speed detection unit 2312 inputs the detection result to the content selection unit 233.
(2-3) Attribute determination unit 232
The attribute determination unit 232 determines the attribute of the person detected by the person detection unit 2310. For example, the attribute determination unit 232 determines the attribute of the detected person by image recognition processing for the person image input from the person detection unit 2310. The attribute determination unit 232 inputs attribute information indicating the determined attribute to the content selection unit 233. When determining attributes of a plurality of detected persons, the attribute determination unit 232 inputs attribute information including the determined attributes to the content selection unit 233.
The process of determining the attribute of the person from the person image by the attribute determination unit 232 is hereinafter also referred to as "attribute determination process". The attribute determined by the attribute determination processing is, for example, information representing a feature of a person. Examples of the characteristics of a human include sex, age group, occupation, clothing, and articles to be carried.
(2-4) content selecting section 233
The content selection unit 233 selects a content based on the attribute determined by the attribute determination unit 232. The content selection unit 233 selects a content based on the attribute information input from the attribute determination unit 232. The content selection unit 233 may select a plurality of contents. The plurality of contents are selected based on the plurality of attributes determined by the attribute determination unit 232 for the plurality of persons detected by the person detection unit 2310.
For example, when a plurality of attributes are obtained, the content selection unit 233 selects a plurality of contents by selecting the contents for each attribute. For example, the content selection unit 233 selects a content based on attributes of "age" and "gender". Specifically, "male in the age of 20", "female in the age of 30", and "female in the age of 40" are input as attribute information. In this case, the content selection unit 233 selects, for example, content for 20's, content for 30's, content for 40's, content for male, content for female, and the like.
The content selection unit 233 may select the content based on a combination of the attributes. In this case, the content selection unit 233 selects, in addition to the above-described contents, a content for males aged 20, a content for females aged 30, a content for females aged 40, and the like.
The content selection unit 233 may select a plurality of contents based on the action of the detected person in addition to the attribute of the detected person. For example, the content selection unit 233 selects an attribute based on the orientation of the detected face of the person, and selects content based on the selected attribute. For example, the content selection unit 233 selects an attribute of a person facing the front, and selects a content based on the attribute. This is because the probability that the person facing the front is viewing the content is high. On the other hand, the content selection unit 233 does not select the attribute of the person facing downward. This is because the smartphone or the like is being operated and is facing downward, and the possibility of viewing the content is low.
For example, the content selection unit 233 selects an attribute based on the detected walking speed of the person, and selects a content based on the selected attribute. For example, the content selection unit 233 selects an attribute of a person whose walking speed is equal to or less than a predetermined speed, and selects a content based on the attribute. This is because the slower the walking speed is, the higher the possibility that the person views the content is. On the other hand, the content selection unit 233 does not select an attribute of a person whose walking speed is not equal to or less than the predetermined speed. This is because the higher the walking speed, the lower the possibility that the person will view the content.
The content selection unit 233 may select a content based on the walking speed of the detected person. For example, when the walking speed is equal to or less than a predetermined speed, the content selection unit 233 selects a content whose playback time is long. This is because the detected person has a slow walking speed, and has a long time to pass in front of the display device 40, and there is a high possibility that the time to view the content is also long. On the other hand, when the walking speed is not equal to or less than the predetermined speed, the content selection unit 233 selects a content whose playback time is long. This is because the detected walking speed of the person is high, the time for passing in front of the display device 40 is short, and the possibility that the time for viewing the content is also short is high.
The content selection unit 233 obtains scores for each of the selected plurality of contents. For example, the content selecting unit 233 refers to the number of each attribute included in the attribute information input from the attribute determining unit 232, and assigns a higher score to the content associated with the attribute having the larger number. This is because the larger the number of attributes contained in the attribute information, the more people having the attributes, the more people who are likely to view the content exist.
Specifically, "male aged 20", "female aged 30", and "female aged 40" are input as attribute information. The number of attributes included in the attribute information is "female" 3, "20's old" 2, "male" 1, "30's old" 1, "40's old" 1. When the attributes are combined, 1 each of "male aged 20", "female aged 30", and "female aged 40" is used. In this case, the content selection unit 233 finds the highest score for the content selected based on the attribute of "women". Then, the content selection unit 233 determines the score of the content selected based on the attribute of "20 s" to be the second highest. The content selection unit 233 then determines the lowest score of the content selected based on the attribute other than "female" or "20's old".
The content selection unit 233 may obtain the score of the content based on the action of the person. For example, when selecting a content based on the attribute of a person facing the front, the content selection unit 233 obtains a higher score for the content. This is because the probability that the person facing the front is viewing the content is high. On the other hand, when selecting a content based on the attribute of a person who is not facing the front, the content selection unit 233 lowers the score of the content. This is because the probability of viewing the content is low for people not facing the front.
When a content is selected based on the attribute of a person with a low walking speed, the content selection unit 233 obtains a high score for the content. This is because the possibility that a person who walks at a slower speed views the content is high. On the other hand, when selecting a content based on the attribute of a person with a high walking speed, the content selection unit 233 determines the score of the content to be low. This is because the possibility that the content is viewed by the person who walks at a high speed is low.
The content selection unit 233 inputs the selection result of the content and the score of the selected content to the content playback control unit 234.
(2-5) content playback control section 234
The content playback control unit 234 performs control related to the content displayed on the display device 40. As shown in fig. 2, the content playback control unit 234 includes a playback unit 2340 and a playback control unit 2345.
(2-5-1) playback unit 2340
The playback unit 2340 performs processing relating to playback of the content. The playback unit 2340 is realized by a device capable of playing back content, such as a movie player. The content reproduced by the reproduction unit 2340 (moving picture player) is displayed on the display device 40.
The playback portion 2340 has at least three playback portions that are capable of transitioning to any one of a stopped state, a ready state, and a playback state. For example, as shown in fig. 2, the playback unit 2340 includes three playback units, i.e., a first playback unit 2341A, a second playback unit 2341B, and a third playback unit 2341C. The number of playback units is not limited to the above example.
The stop state is a state in which playback of the content is finished and no preparation for playback of the content is made.
The ready state is a state in which playback preparation of the content is performed.
The playback state is a state in which playback of the content is being performed.
The reproduction unit in the stop state or the ready state, which is a reproduction unit other than the reproduction state, is hereinafter also referred to as a "preliminary reproduction unit". The spare playback unit is a spare playback unit that can prepare for a content to be played back next even when the content is being played back by the playback unit in the playback state.
Here, an example of state transition of the playback unit according to the embodiment of the present invention will be described with reference to fig. 3. Fig. 3 is a diagram showing an example of state transition of the playback unit according to the embodiment of the present invention.
When the playback unit in the "stopped state" opens the content (S1), the state of the playback unit shifts to the "ready state".
When the playback unit in the "ready state" starts playback of the content (S2), the state of the playback unit shifts to the "playback state".
When the playback unit in the "playback state" ends playback of the content (S3), the state of the playback unit transitions to the "stop state".
When the playback unit in the "ready state" closes the content (S4), the state of the playback unit transitions to the "stop state". The operation of closing the content by the playback unit is an example of an operation of changing the state of the playback unit from the ready state to the "stop state".
(2-5-2) playback control unit 2345
The playback control unit 2345 performs control relating to playback of the content. For example, the playback control unit 2345 prepares playback of the plurality of contents selected by the content selection unit 233 until the end of the content being played back (first content). The playback control unit 2345 plays back the content (second content) that is any one of the plurality of contents when the content being played back ends. The first content is hereinafter also referred to as "content under playback". The second content is hereinafter also referred to as "next content".
The next content is, for example, a content selected based on the attribute of the person detected by the person detection portion 2310 after the playback of the content under playback is started. In this case, the playback control unit 2345 plays back the content selected by the content selection unit 233 after the playback of the content being played back is started, as the next content.
The next content is, for example, the content that has been selected last by the content selection unit 233 from among the plurality of contents. As an example of the content selected last by the content selection unit 233, a content selected immediately before the end of the content being played back can be cited. In this case, the playback control unit 2345 plays back the content selected by the content selection unit 233 immediately before the end of the content being played back, from among the plurality of contents, as the next content.
The playback control unit 2345 controls the playback unit included in the playback unit 2340. For example, the playback control unit 2345 controls the playback units based on the selection result and the score of the content input from the content selection unit 233. As shown in fig. 2, the playback control unit 2345 includes a first playback control unit 2346 and a second playback control unit 2347.
(2-5-2-1) first playback control portion 2346
The first playback control unit 2346 issues various instructions to the playback units. The various indications are, for example, any of a preparation indication, a stop indication, or a playback indication.
(preparation indication)
For example, the first playback control unit 2346 issues a preparation instruction to any one of the playback units to prepare for playback of the selected content, based on the selection result and the score of the content input from the content selection unit 233.
The first playback control unit 2346 issues a preparation instruction to the preliminary playback unit. For example, when the spare playback unit includes a playback unit in a stopped state, the first playback control unit 2346 issues a preparation instruction to the stopped playback unit to prepare for playback of a content with a high priority based on the score of the selected content.
The first playback control unit 2346 issues a preparation instruction to the playback unit in the stopped state to prepare for playback of the content selected from the time when playback of the content being played back by the playback unit in the playback state ends to the time before the time when decoding processing is performed, the decoding processing being processing required to play back the content.
(stop indication)
When the first playback control unit 2346 issues the preparation instruction, the first playback control unit issues a stop instruction to close the content to any one of the playback units in the standby state if there is no playback unit in the stopped state. After the state of the playback unit that has issued the stop instruction has shifted to the stopped state, the first playback control unit 2346 issues a preparation instruction to the playback unit that has shifted to the stopped state in response to the stop instruction.
In the case where there is no playback unit in the stopped state, the first playback control unit 2346 issues a stop instruction to a playback unit in the standby state that is in the standby state of the content that does not match any of the plurality of selected contents. After the state of the playback unit that has issued the stop instruction has shifted to the stopped state, the first playback control unit 2346 issues a preparation instruction to the playback unit that has shifted to the stopped state in response to the stop instruction.
In addition, when there is no reproduction unit in the stopped state, the first reproduction control unit 2346 may issue a stop instruction to a reproduction unit that has been in the ready state for the longest time period from the transition of the reproduction unit in the ready state. After the state of the playback unit that issued the stop instruction has shifted to the stop state, the first playback control unit 2346 issues a preparation instruction to the playback unit that shifted to the stop state in response to the stop instruction.
(playback instruction)
When receiving a completion notification indicating that the playback by the playback unit in the playback state is completed, the first playback control unit 2346 issues a playback instruction to play back the content to be played back next to any of the playback units.
The first playback control unit 2346 issues a playback instruction to the spare playback unit. For example, the first playback control unit 2346 issues a playback instruction to the playback unit of the preliminary playback unit that has completed the preparation of the content selected by the second playback control unit 2347.
(2-5-2-2) second playback control unit 2347
The second playback control unit 2347 determines the content to be played back next based on the selection result and the score of the content input from the content selection unit 233. For example, the second playback control unit 2347 determines the content with the highest score among the plurality of contents selected by the content selection unit 233 as the content to be played back next. The second playback control unit 2347 holds the content name of the content determined to be played back next in the predetermined holding area. The second playback control unit 2347 determines the content to be played back next each time the content selection unit 233 inputs the selection result and score of the content, and updates the content name of the holding area.
The second playback control unit 2347 determines the content to be played back next at a predetermined timing. For example, the second playback control unit 2347 determines the content to be played back next at the timing when the content preparation process ends. The second playback control unit 2347 selects, based on the score, a content to be played back next from among the contents for which the preparation for playback has been completed.
For example, the second playback control unit 2347 selects, as the next content, the content selected at the timing corresponding to the timing of playing back the next content from the playback unit in the ready state. The timing corresponding to the timing of playing back the next content is, for example, immediately before the end of the content being played back. The second playback control portion 2347 decides the content for which playback is ready to be completed as the content to be played back next immediately before the content in playback ends.
The second playback control unit 2347 selects the next content from the playback unit that is in the ready state and that has prepared the content selected based on the captured image captured at the predetermined timing. Here, the predetermined timing is any timing from the time when the playback of the content by the playback unit based on the playback state is completed to the time before the time when the decoding process, which is a process necessary for playing back the content, is performed.
(2-6) display processing section 235
The display processing unit 235 controls display of content on the display device 40. For example, the display processing unit 235 causes the display device 40 to display the content being played back, which is input from the content playback control unit 234. The display processing unit 235 causes the content under playback displayed on the display device 40 to be transmitted from the communication unit 21 to the display device 40.
(3) Storage unit 25
The storage unit 25 is configured by a storage medium such as an HDD (Hard Disk Drive), a flash Memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), a RAM (Random Access/write Memory), a ROM (Read Only Memory), or any combination of these storage media. The storage unit 25 can use, for example, a nonvolatile memory.
The storage unit 25 stores various information. As shown in fig. 2, the storage unit 25 has a content pool 250. The content pool 250 is a memory for storing content. The content pool 250 stores a plurality of contents such as a content 251A, a content 251B, a content 251E, a content 251R, and the like. Each content stored in the content pool 250 is associated with the attribute information corresponding to each content. Thus, the content selection unit 233 and the content playback control unit 234 can select, prepare, or play back the content corresponding to the attribute determined by the attribute determination unit 232 by referring to the attribute information associated with each content.
The storage unit 25 may store the captured image acquired by the image acquisition unit 230.
<3. Procedure of treatment >
In the above, an example of the functional configuration of the content selection device 20 according to the present embodiment is described. Next, an example of the flow of processing in the content selection device 20 according to the present embodiment will be described with reference to fig. 4 to 8. The area for temporarily storing the content name of the next content is hereinafter referred to as "next content (temporary area)".
(1) Flow of processing in content selection apparatus 20
An example of the flow of processing in the content selection apparatus 20 according to the embodiment of the present invention will be described with reference to fig. 4. Fig. 4 is a flowchart showing an example of the flow of processing in the content selection device 20 according to the embodiment of the present invention.
First, the image acquisition unit 230 of the content selection device 20 acquires a captured image (S102).
Next, the person detection section 2310 of the content selection device 20 performs a person detection process (S104).
Next, the attribute determination unit 232 of the content selection device 20 performs an attribute determination process (S106).
Next, the content selecting unit 233 of the content selecting apparatus 20 performs score calculation processing (S108).
After the score is calculated, the content selection unit 233 performs a content selection process based on the score (S110).
Next, the first playback control unit 2346 of the content selection apparatus 20 performs a content preparation process (S112). The flow of the detailed process in the content preparation process will be described later.
After the content preparation processing, the second playback control unit 2347 sets the content name of the next content in the next content (temporary area) based on the result of the content preparation processing (S114).
After the content name of the next content is set, the playback control unit 2345 determines whether or not the content being played back has ended (S116). When the content being played back is not completed (S116/no), the playback control unit 2345 repeats the process from S102.
On the other hand, when the content being played back ends (S116/yes), the playback control unit 2345 causes the playback unit that prepared the next content to play back the next content (S118).
Next, the playback control unit 2345 transitions the state of each playback unit according to the post-playback state of the next content (S120).
Next, the playback control unit 2345 clears the content name set in the next content (temporary area) (S122), and repeats the process from S102.
(2) Detailed flow of processing in content preparation processing
An example of a flow of detailed processing in the content preparation processing according to the embodiment of the present invention will be described with reference to fig. 5. Fig. 5 is a flowchart showing an example of a detailed flow of the content preparation process according to the embodiment of the present invention. The content preparation processing is the processing of S112 in the flowchart shown in fig. 4.
First, the first playback control unit 2346 of the content selection apparatus 20 receives a preparation request for n pieces of content from the content selection unit 233 (S202).
Next, the first playback control unit 2346 determines whether all of the n pieces of content for which the preparation request has been received are prepared (S204).
When all the contents are prepared (S204/yes), the first playback control unit 2346 ends the content preparation process.
On the other hand, when all the contents are not prepared (S204/no), the first playback control unit 2346 determines whether or not there is a playback unit in a stopped state (S206).
If there is a playback unit in a stopped state (S206/yes), the first playback control unit 2346 instructs the playback unit in a stopped state to open the content that is not ready among the n pieces of content (S208). After the instruction, the first playback control unit 2346 ends the content preparation process.
On the other hand, if there is no reproduction unit in the stopped state (S206/no), the first reproduction control unit 2346 determines whether there is a reproduction unit that has prepared a content other than the n contents that have received the preparation request (S210).
When there is a playback unit that prepares content other than the n pieces of content that have received the preparation request (S210/yes), the first playback control unit 2346 causes the playback unit that prepares content other than the n pieces of content that have received the preparation request to close the content (S212).
On the other hand, if there is no reproduction unit that prepares contents other than the n contents that have received the preparation request (S210/no), the first reproduction control unit 2346 closes the contents for the reproduction unit that has first been in the preparation state (S214).
After the processing in either S212 or S214, the first playback control unit 2346 instructs the playback unit that has been in the stopped state to open the content that is not ready among the n pieces of content (S216). After the instruction, the first playback control unit 2346 ends the content preparation process.
(3) Flow of processing in preparation of content
An example of the flow of processing in preparation of contents according to the embodiment of the present invention will be described with reference to fig. 6 and 7. Fig. 6 and 7 are sequence diagrams showing an example of a flow of processing in preparation of a content according to the embodiment of the present invention. Fig. 6 shows an example in which the second playback portion 2341B prepares for content. Fig. 7 shows an example in which the third playback portion 2341C prepares for content. In the following, for example, preparation of the content in the second retransmission portion 2341B is set to be followed by preparation of the content in the third retransmission portion 2341C.
(preparation of content in second playback unit 2341B)
First, preparation of contents in the second retransmission part 2341B is described with reference to fig. 6. Before the description of the flow of the processing, examples of various states at the start of the processing will be described.
The state of the next content (temporary area) is an unset state in which the content name is unset (S302).
The state of the first playback unit 2341A is the "playback state" (S304). The first playback unit 2341A is playing back the content 251B (S306).
The state of the second retransmission part 2341B is the "stop state" (S308).
The state of the third amplifying portion 2341C is the "stop state" (S310).
The flow of the processing will be described below.
First, the content selection unit 233 performs a content selection process (S312). For example, the content selection unit 233 selects the content 251R.
After the selection process, the content selection unit 233 inputs a preparation request for the selected content 251R to the playback control unit 2345 (S314).
Upon receiving the preparation request, the playback control unit 2345 performs content preparation processing (S316). For example, the playback control unit 2345 determines that the second playback unit 2341B is instructed to turn on the content 251R in the content preparation process.
After the content preparation processing, the playback control unit 2345 issues an instruction to the second playback unit 2341B to turn on the content 251R (S318).
The second playback unit 2341B that has received the instruction accesses the content pool 250 of the storage unit 25 and opens the content 251R (S320). The second playback unit 2341B prepares to play back the opened content 251R (S322). After the preparation for playback, the second playback unit 2341B transitions the state to the "ready state" (S324).
After the state transition, the second playback portion 2341B notifies the playback control portion 2345 that the preparation of the content 251R is completed (S326).
The playback control unit 2345 receiving the notification sets the content 251R as the content name of the content to be played back next in the next content (temporary area) (S328).
(preparation of contents in third playback unit 2341C)
Next, preparation of contents in the third playback portion 2341C is described with reference to fig. 7. Before the description of the flow of the processing, examples of various states at the start of the processing will be described.
The state of the next content (temporary area) is a state in which "content 251R" is set as the content name (S402).
The state of the first playback unit 2341A is the "playback state" (S404). The first playback portion 2341A is playing back the content 251B (S406).
The state of the second retransmission part 2341B is the "ready state" (S408). The second playback portion 2341B prepares the content 251R (S410).
The state of the third amplifying portion 2341C is the "stop state" (S412).
The flow of the processing will be described below.
First, the content selection unit 233 performs a content selection process (S414). For example, the content selection unit 233 selects the content 251E.
After the selection process, the content selection unit 233 inputs a preparation request for the selected content 251E to the playback control unit 2345 (S416).
The playback control unit 2345 that has received the preparation request performs the content preparation process (S418). For example, the playback control unit 2345 determines that the third playback unit 2341C is instructed to open the content 251E during the content preparation process.
After the content preparation processing, the playback control unit 2345 instructs the third playback unit 2341C to open the content 251E (S420).
The third playback unit 2341C that has received the instruction accesses the content pool 250 of the storage unit 25 and opens the content 251E (S422). The third playback unit 2341C prepares to play back the opened content 251E (S424). After the playback preparation, the third playback portion 2341C transitions the state to the "ready state" (S426).
After the state transition, the third playback portion 2341C notifies the playback control portion 2345 that the preparation of the content 251E is completed (S428).
The playback control unit 2345 that received the notification sets the content 251E as the content name of the content to be played back in the next content (temporary area) (S430).
(4) Flow of processing in playback of content
An example of the flow of processing in the playback of content according to the embodiment of the present invention will be described with reference to fig. 8. Fig. 8 is a sequence diagram showing an example of a flow of processing in the playback of content according to the embodiment of the present invention. In the following, as an example, processing in reproduction of the content described below is set after preparation of the content in the third playback unit 2341C described with reference to fig. 7.
Before the description of the flow of the processing, examples of various states at the start of the processing will be described.
The state of the next content (temporary area) is a state in which "content 251E" is set as the content name (S502).
The state of the first playback unit 2341A is the "playback state" (S504). The first playback unit 2341A is playing back the content 251B (S506).
The state of the second retransmission part 2341B is the "ready state" (S508). The second playback portion 2341B prepares the content 251R (S510).
The state of the third amplifying portion 2341C is the "ready state" (S512). The third playback portion 2341C prepares the content 251E (S514).
The flow of the processing will be described below.
First, the content selection unit 233 performs a content selection process (S516). For example, the content selection unit 233 selects the content 251R.
After the selection process, the content selection unit 233 inputs a preparation request for the selected content 251R to the playback control unit 2345 (S518).
Upon receiving the preparation request, the playback control unit 2345 performs content preparation processing (S520). The playback control unit 2345 determines that the content 251R is ready in the content preparation process, and therefore does not instruct any of the spare playback units to turn on the content 251R.
After the content preparation processing, the playback control unit 2345 sets the content 251R as the content name of the content to be played back next in the next content (temporary area) (S522).
While the playback control unit 2345 is performing the content preparation process, the playback of the content 251B in the first playback unit 2341A is completed (S524). After the playback of the content 251B is ended, the first playback unit 2341A transitions the state to the "stopped state" (S526).
After the state transition, the first playback portion 2341A notifies the playback control portion 2345 that playback of the content 251B has ended (S528). Note that, as an example, the playback control unit 2345 is notified by the first playback unit 2341A after the processing set in S522.
Upon receiving the notification, the playback control unit 2345 instructs the second playback unit 2341B to play back the content 251R (S530). The playback control unit 2345 then instructs the third playback unit 2341C to turn off the content 251E (S532).
The second playback unit 2341B receiving the instruction starts playback of the content 251R (S534). After the start of playback, the second playback unit 2341B changes state to "playback state" (S536).
The third playback unit 2341C that has received the instruction closes the content 251E (S538). After the content 251E is closed, the third playback portion 2341C transits the state to the "stop state" (S540).
After the state transition, the second playback portion 2341B notifies the playback control portion 2345 that the content 251R is being played back (S542).
Upon receiving the notification, the playback control unit 2345 clears the content name set for the next content (temporary area) (S544).
In the above, an example of the flow of processing in the content selection apparatus 20 of the present embodiment is described. As described above, the content selection device 20 according to the present embodiment acquires a captured image and detects a person included in the image.
The content selection means 20 determines the attributes of the detected person and selects the content based on the attributes.
The content selection device 20 prepares for playback of the selected plurality of contents until the end of the first content being played back, and plays back a second content, which is any one of the plurality of contents, when the first content ends.
With the above configuration, the content selection device 20 according to the present embodiment selects the postamble of a plurality of next contents and prepares for playback of the selected plurality of contents. Thus, the content selection apparatus 20 can avoid the need to secure a time period for preparing the next content from the determination of the next content to the playback. Therefore, the content selection device 20 can postpone the decision of the next content until immediately before the end of the playback of the content under playback. That is, the content selection device 20 can select the content suitable for the characteristics of the object immediately before the end of the playback of the content being played back.
From the above, the content selection device 20 of the present embodiment can prevent playback of content that does not fit the characteristics of the object.
<2. Second embodiment >
The first embodiment of the present invention has been described above. Next, a second embodiment of the present invention will be described with reference to fig. 9. Fig. 9 is a block diagram showing a minimum configuration of the content selection apparatus. As shown in fig. 9, the content selection device 90 may include at least an image acquisition unit 91, a person detection unit 92, an attribute determination unit 93, a content selection unit 94, and a playback control unit 95.
The image acquisition unit 91 acquires the captured image.
The person detection unit 92 detects a person included in the image acquired by the image acquisition unit 91.
The attribute determination unit 93 determines the attribute of the person detected by the person detection unit 92.
The content selection unit 94 selects a content based on the attribute determined by the attribute determination unit 93.
The playback control unit 95 prepares for playback of the selected plurality of contents until the end of the first content being played back, and plays back a second content that is any one of the plurality of contents when the first content ends.
With the above configuration, the content selection device 90 of the present embodiment selects the postambles of a plurality of next contents and prepares for playback of the selected plurality of contents. Thus, the content selection device 90 can avoid the need to secure time for preparing the next content until the next content is played back after the next content is determined. Therefore, the content selection device 90 can postpone the decision of the next content until immediately before the end of the playback of the content under playback. That is, the content selection device 90 can select content suitable for the characteristics of the object immediately before the end of playback of the content under playback.
From the above, the content selection device 90 of the present embodiment can prevent playback of content that does not fit the characteristics of the object.
The embodiments of the present invention have been described above. All or a part of the functions of the content display system 1 and the content selection device 90 in the embodiments described above may be implemented by a computer. In this case, the functions can be realized by recording a program for realizing the functions in a computer-readable recording medium, and causing a computer system to read and execute the program recorded in the recording medium. The "computer system" herein includes hardware such as an OS and peripheral devices. The "computer-readable recording medium" refers to a removable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage device such as a hard disk built in a computer system. The "computer-readable recording medium" may include a medium that dynamically holds a program for a short period of time, such as a communication line in the case where the program is transmitted via a network such as the internet or a communication line such as a telephone line, or a medium that holds the program for a certain period of time, such as a volatile memory inside a server or a computer system serving as a client in this case. The program may be used to implement a part of the functions described above, may be combined with a program already recorded in a computer system to implement the functions described above, or may be implemented using a Programmable logic device such as an FPGA (Field Programmable Gate Array).
While the embodiments of the present invention have been described in detail with reference to the drawings, the specific configuration is not limited to the above, and various design changes and the like can be made without departing from the scope of the present invention.
Description of the reference symbols
1. Content display system
2. Pedestrian
10. Image capturing apparatus
20. Content selection apparatus
21. Communication unit
23. Control unit
25. Storage unit
30. Server device
40. Display device
42. Display picture
90. Content selection apparatus
91. Image acquisition unit
92. Human detection part
93. Attribute determination unit
94. Content selection unit
95. Reproduction control unit
230. Image acquisition unit
231. Detection part
232. Attribute determination unit
233. Content selection unit
234. Content reproduction control unit
235. Display processing unit
250. Content pool
251A content
251B content
251E content
251R content
2310. Human detection part
2311. Orientation detection unit
2312. Speed detection unit
2340. Reproducing unit
2341A first reproduction section
2341B second playback part
2341C third repeater
2345. Reproduction control unit
2346. First reproduction control section
2347. Second playback control unit
Claims (17)
1. A content selection apparatus having:
an image acquisition unit that acquires a captured image;
a person detection unit that detects a person included in the image;
an attribute determination unit that determines an attribute of the person detected by the person detection unit;
a content selection section that selects a content based on the attribute; and
and a playback control unit that prepares playback of the plurality of contents selected by the content selection unit until a first content being played back ends, and plays back a second content that is any one of the plurality of contents when the first content ends.
2. The content selection apparatus according to claim 1,
the second content is selected based on an attribute of the person detected by the person detection section after playback of the first content is started.
3. The content selection apparatus according to claim 1 or 2,
the second content is a content that is selected last by the content selection unit among the plurality of contents.
4. The content selection apparatus according to any one of claims 1 to 3,
the plurality of contents are selected based on the plurality of attributes determined by the attribute determination section for the plurality of persons detected by the person detection section.
5. The content selection apparatus according to any one of claims 1 to 4,
the content selection apparatus further includes at least three playback sections capable of shifting to any one of a stop state, a ready state, and a playback state,
the reproduction control section includes a first reproduction control section and a second reproduction control section,
the first playback control unit instructs a playback unit in a stopped state among the playback units, the playback unit being different from the playback unit in a playback state in which the first content is being played back, to prepare for playback of the selected content,
the second playback control portion selects, from the ready-state playback portion, a content selected at a timing corresponding to a timing of playing back a next content as the second content to be played back next.
6. The content selection apparatus according to claim 5,
the first playback control unit instructs any one of the playback units in the standby state to stop if there is no playback unit in the stopped state, and instructs the playback unit that has been brought into the stopped state in response to the instruction to prepare for playback of the selected second content.
7. The content selection apparatus according to claim 5 or 6,
the first playback control unit, upon receiving a completion notification indicating that playback by the playback unit in the playback state has been completed, instructs the playback unit selected by the second playback control unit to play back the second content.
8. The content selection apparatus according to any one of claims 5 to 7,
the content selection unit obtains a score for each of a plurality of contents selected based on the attributes,
the first playback control unit instructs the playback unit in the stopped state to prepare for playback of a content having a high priority based on the score of the selected content.
9. The content selection apparatus according to claim 8,
when a plurality of attributes are obtained, the content selection unit selects a plurality of contents by selecting the contents for each attribute, and obtains a score for each selected content.
10. The content selection apparatus according to claim 8,
the content selection unit selects a plurality of contents based on the attributes and the detected human actions, and obtains a score for each of the selected contents.
11. The content selection apparatus according to any one of claims 5 to 10,
the first playback control unit, when there is no playback unit in the stopped state, instructs a playback unit in the ready state, which is a content that does not match any of the plurality of selected contents, to be in the stopped state, and instructs a playback unit that has been shifted to the stopped state in response to the instruction to prepare for playback of the selected second content.
12. The content selection apparatus according to any one of claims 5 to 10,
the first playback control unit, in the case where there is no playback unit in the stopped state, issues an instruction to bring the playback unit that has reached the standby state for the longest time among the playback units in the standby state into the stopped state, and issues an instruction to perform playback preparation of the selected second content to the playback unit that has reached the stopped state in response to the instruction.
13. The content selection apparatus according to any one of claims 5 to 12,
the first playback control unit instructs the playback preparation of the selected second content to be performed before a time from a time point at which the playback of the first content by the playback unit based on the playback state is completed to a time point at which a decoding process is performed, the decoding process being a process necessary for playing back the second content.
14. The content selection apparatus according to any one of claims 5 to 13,
the second playback control unit selects the second content to be played back next from the playback unit in the ready state, from a content obtained from an image captured at any timing within a period from a time point at which playback of the first content by the playback unit based on the playback state ends to a time point before a time at which decoding processing is performed, the decoding processing being processing required to play back the second content.
15. A content display system having:
a shooting part;
an image acquisition unit that acquires the image captured by the imaging unit;
a person detection unit that detects a person included in the image;
an attribute determination unit configured to determine an attribute of the person detected by the person detection unit;
a content selection section that selects a content based on the attribute;
a playback control unit that prepares playback of the plurality of contents selected by the content selection unit until a first content being played back ends, and plays back a second content that is any one of the plurality of contents when the first content ends; and
and a display unit that displays the reproduced second content.
16. A method of content selection, wherein,
the image obtained by the image-taking device is obtained,
detecting a person contained in the image,
-determining an attribute of the detected person or persons,
the content is selected on the basis of said properties,
the selected plurality of contents are prepared for playback until the end of the first content being played back, and a second content, which is any one of the plurality of contents, is played back when the first content ends.
17. A content selection program for causing a computer to execute the steps of:
an image acquisition step of acquiring a captured image;
a person detection step of detecting a person included in the image;
an attribute determination step of determining an attribute of the person detected by the person detection step;
a content selection step of selecting a content based on the attribute; and
a playback control step of preparing playback of the plurality of contents selected by the content selection step until a first content being played back ends, and playing back a second content that is any one of the plurality of contents when the first content ends.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/JP2020/018316 WO2021220485A1 (en) | 2020-04-30 | 2020-04-30 | Content selection device, content display system, content selection method, and content selection program |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115461729A true CN115461729A (en) | 2022-12-09 |
Family
ID=78331895
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202080100115.1A Pending CN115461729A (en) | 2020-04-30 | 2020-04-30 | Content selection device, content display system, content selection method, and content selection program |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN115461729A (en) |
| WO (1) | WO2021220485A1 (en) |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003339024A (en) * | 2002-05-22 | 2003-11-28 | Sony Corp | Reproducing apparatus, digital storage apparatus, reproducing method, and recording method |
| KR20160013266A (en) * | 2011-04-11 | 2016-02-03 | 인텔 코포레이션 | Personalized advertisement selection system and method |
| JP5797549B2 (en) * | 2011-12-28 | 2015-10-21 | 東芝テック株式会社 | Information display device and program |
-
2020
- 2020-04-30 CN CN202080100115.1A patent/CN115461729A/en active Pending
- 2020-04-30 WO PCT/JP2020/018316 patent/WO2021220485A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021220485A1 (en) | 2021-11-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11074436B1 (en) | Method and apparatus for face recognition | |
| US8762659B2 (en) | Storage apparatus and method, program, and playback apparatus and method | |
| US8004573B2 (en) | Imaging apparatus, imaged picture recording method, and storage medium storing computer program | |
| CN105989361A (en) | Information processor and face recognition method | |
| CN101262561B (en) | Imaging apparatus and control method thereof | |
| JP2008123416A (en) | Subject tracking program, subject tracking device, and camera | |
| WO2010113666A1 (en) | Video data recording device, video data playing device, video data recording method, and video data playing method | |
| JP2006109119A (en) | Moving image recorder and moving image reproducing apparatus | |
| WO2017197882A1 (en) | Video playing method and device | |
| JP2011103588A (en) | Electronic apparatus, and image display method | |
| JP2011090411A (en) | Image processing apparatus and image processing method | |
| TW202121250A (en) | Method and apparatus for controlling a display object, electronic device and storage medium | |
| JPWO2016199483A1 (en) | Image processing apparatus, image processing method, and program | |
| JP5317710B2 (en) | Image processing apparatus, control method therefor, program, and recording medium | |
| JP6054140B2 (en) | Message management apparatus, message presentation apparatus, message management apparatus control method, and message presentation apparatus control method | |
| WO2017026154A1 (en) | Information processing device, information processing method, and program | |
| KR20130105322A (en) | Image processor, image processing method, control program, and recording medium | |
| JP4110323B2 (en) | Information output method and apparatus, program, and computer-readable storage medium storing information output program | |
| JP2010109567A (en) | Information processor and information processing method | |
| CN111491124B (en) | Video processing method and device and electronic equipment | |
| CN115461729A (en) | Content selection device, content display system, content selection method, and content selection program | |
| JP5267136B2 (en) | Electronic camera | |
| CN115280402B (en) | Display control system, display control method, and program | |
| JP2009087004A (en) | Image retrieval device and image retrieval method | |
| JP5279520B2 (en) | Moving image processing apparatus, moving image processing method, program, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |