JP2015023459A - Projection system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To notify an owner of baggage of having forgotten the baggage in an easily understandable manner.SOLUTION: A projection system comprises: positional relationship detection means 40 that detects baggage 3 and an owner 4 of the baggage having entered a predetermined area, and detects a positional relationship between the baggage 3 and the owner 4; and projection means 50 that performs predetermined projection when the positional relationship detected by the positional relationship detection means 40 becomes a predetermined state.

Description

  The present invention relates to a projection system.

  There is known a forgotten item prevention system that detects a forgotten item and generates an alarm sound (see Patent Document 1). In this left-behind item prevention system, radio waves are transmitted from a transmitter carried by the owner of the luggage, and the radio waves are received by a receiver attached to the luggage, and the transmitter and receiver are separated and received by the receiver. When the electric field strength of the received radio wave is below the reference strength, this is detected and an alarm sound is generated.

JP-A-8-161653

  In the above prior art, for example, in a crowded place or in a noisy place, the alarm sound may be mixed with the surrounding noise and the owner of the luggage may not be able to recognize the alarm sound. It was not possible to report.

According to a first aspect of the present invention, there is provided a projection system comprising: a positional relationship detection unit that detects a package and a baggage holder that are in a predetermined area; and detects a positional relationship between the package and the carrier; and a positional relationship detection unit. And a projection unit that performs a predetermined projection when the detected positional relationship is in a predetermined state.
According to a ninth aspect of the present invention, there is provided a projection system that detects a person performing a predetermined action in a predetermined area, and a detection unit that detects a person performing the predetermined action when the detection means detects the person performing the predetermined action. And projection means for performing projection.

  According to the present invention, it is possible to easily notify the owner of a baggage of a forgotten baggage.

It is a figure which shows the structure of the projection system which concerns on 1st Embodiment. It is a figure explaining the projection operation | movement which concerns on 1st Embodiment. It is a flowchart explaining the flow of the projection operation | movement which concerns on 1st Embodiment. It is a flowchart explaining the flow of the projection operation | movement which concerns on the modification 1 of 1st Embodiment. It is a flowchart explaining the flow of the projection operation | movement which concerns on the modification 2 of 1st Embodiment. It is a figure which shows the structure of the projection system which concerns on 2nd Embodiment. It is a figure explaining the projection operation | movement which concerns on 2nd Embodiment. It is a flowchart explaining the flow of the projection operation | movement which concerns on 2nd Embodiment. It is a figure which shows the structure of the projection system which concerns on 3rd Embodiment. It is a figure explaining the projection operation | movement which concerns on 3rd Embodiment. It is a flowchart explaining the flow of the projection operation | movement which concerns on 3rd Embodiment.

-First embodiment-
A first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a projection system 1 according to the first embodiment. The projection system 1 according to the present embodiment is installed in a train and projects an image for preventing passengers from forgetting luggage. The projection system 1 is provided at a plurality of locations so as to prevent passengers from forgetting luggage on the entire train. For example, the projection system 1 is provided corresponding to each net shelf installed in a train. The projection system 1 includes a control device 10, a door opening / closing detection device 20, a luggage detection device 30, a camera 40, and a projector 50.

  The control device 10 includes a CPU, a memory, and other peripheral circuits, and controls the operation of the entire projection system 1 based on a control program stored in the memory. The control device 10 communicates with the door opening / closing detection device 20, the package detection device 30, the camera 40, and the projector 50 by, for example, wireless communication.

  The door open / close detection device 20 detects the open / closed state of the train door, and outputs a signal indicating the detection result to the control device 10.

  The luggage detection device 30 detects whether or not the luggage is placed on the net shelf and outputs a signal indicating the detection result to the control device 10. Further, when it is detected that a load is placed on the net shelf, the load detection device 30 detects the position where the load is placed and outputs a signal indicating the detection position to the control device 10. As a method for detecting that the load is placed on the net shelf by the baggage detection device 30, for example, a method of detecting the pressure applied to the net shelf by a pressure sensor may be used. Further, for example, a method of detecting by the light receiving unit that light from the light emitting unit is blocked by the package when a package is placed on the net shelf, such as a photo interrupter, may be used. Alternatively, the net shelf may be continuously photographed with a camera, and it may be detected that a load has been placed when the current captured image has changed significantly from the immediately preceding captured image. Note that the package detection apparatus 30 may use a camera 40 described later.

  The camera 40 is installed on a ceiling or the like, for example, has an imaging optical system 41, an imaging element 42, and an imaging control circuit 43, and performs imaging according to an instruction from the control device 10. The imaging optical system 41 forms a subject image on the imaging surface of the imaging element 42. As the image sensor 42, a CCD, a CMOS, or the like is used. The imaging control circuit 43 controls driving of the imaging device 42 according to an instruction from the control device 10 and performs predetermined signal processing on an image signal output from the imaging device 42. Further, the installation position and the installation angle of the camera 40 are adjusted so that a person in the vicinity of the net shelf can take a picture. The camera 40 continuously captures images at a predetermined frame rate by the image sensor 42 and outputs captured images to the control device 10 in real time.

  The projector 50 is installed, for example, on the ceiling of a train, has a projection optical system 51, a liquid crystal panel 52, an LED light source 53, and a projection control circuit 54, and performs projection according to instructions from the control device 10. The LED light source 53 illuminates the liquid crystal panel 52 with brightness according to the supply current. The liquid crystal panel 52 generates a light image according to the drive signal from the projection control circuit 54. The projection optical system 51 projects the light image emitted from the liquid crystal panel 52 onto an external projection surface. The projection control circuit 54 sends a control signal for projecting information instructed from the control device 10 to the LED light source 53 and the liquid crystal panel 52. The projector 50 is configured to be able to change the projection direction, and can change the position at which the image is projected.

  Next, the projection operation by the projection system 1 will be described with reference to FIG. FIG. 2A and FIG. 2B show the situation inside the train. As shown in FIG. 2A, when the luggage 3 is placed on the net shelf 2, the control device 10 recognizes that the luggage 3 is placed on the net shelf 2 based on a detection signal from the luggage detection device 30. Then, the control device 10 specifies the owner of the luggage 3 based on the position where the luggage 3 is detected detected by the luggage detection device 30 and the image captured by the camera 40. Specifically, the control device 10 detects the person 4 closest to the luggage 3 when the luggage 3 is detected by the luggage detection device 30 from the image captured by the camera 40 and identifies it as the owner of the luggage 3. To do. As a method for detecting a person, clothes worn by the person may be detected when the camera 40 is photographing a person from the back, and if the camera 40 can photograph a person's face, the person is detected. May be detected. The control device 10 associates the information on the luggage 3 (for example, the position where the luggage 3 is placed) and the information on the person 4 (for example, the image of the person 4, the color of clothes, the facial feature amount, etc.), and is not shown. Store in the memory. Thereafter, the control device 10 recognizes that the owner of the luggage 3 is the person 4 based on the linked information.

  Thereafter, the control device 10 sequentially detects the position of the person 4 based on the image captured by the camera 40, and calculates the distance between the detected position of the person 4 and the position of the luggage 3 detected by the luggage detection device 30. To do. Then, the control device 10 determines whether or not the calculated distance between the person 4 and the luggage 3 is greater than a predetermined threshold (for example, a distance at which the person 4 cannot reach the luggage 3).

  As shown in FIG. 2B, when the distance between the person 4 and the baggage 3 is more than a predetermined threshold, the control device 10 sends an instruction to the projector 50 to project an image 5 for notifying that the baggage is forgotten. Let The image 5 is an image that displays a text that informs the user that the user has forgotten the baggage, such as “Caution for forgotten things!”. At this time, the control device 10 calculates a projection direction based on the image captured by the camera 40 so that the image 5 can be projected to a position in the vicinity of the person 4 who is the baggage holder without being blocked by another person. The projector 50 is controlled so that the projection direction is the calculated projection direction. As a result, the image 5 is projected on a position in the vicinity of the person 4 who is the owner of the luggage without being blocked by other persons, and the person 4 can be made aware of the misplacement of the luggage 3. In addition, the projection surface on which the image 5 is projected is not limited to a floor or a wall, and may be a ceiling, a window, a hanging leather, a hanging advertisement, or the like.

The distance L between the person 4 and the luggage 3 may be calculated using, for example, the following formula (1). In Expression (1), Lx is a horizontal distance between the person 4 and the luggage 3, and Ly is a vertical distance between the person 4 and the luggage 3.

  However, in order to detect misplacement of the luggage 3, the distance between the person 4 and the luggage 3 is more important in terms of the distance in the horizontal direction than the distance in the vertical direction. Only the distance may be used.

  Also, when passengers get off the train, it is likely that they will forget to put their luggage on the rack, so the distance between the luggage and its owner is better when the train door is open than when the door is closed. Is likely to leave. Therefore, when the control device 10 recognizes that the door of the train is open based on the detection signal from the door open / close detection device 20, the control device 10 determines that the baggage and its owner are more likely than when the door is closed. By shortening the time interval for calculating the distance between the two, the accuracy of detecting whether or not the distance between the baggage and its owner is more than a predetermined threshold is increased. For example, when the door is closed, the control device 10 calculates the distance between the luggage and its owner every 5 seconds (first time), and when the door is open, the luggage and its owner. Is calculated every 0.5 seconds (second time shorter than the first time). Further, by increasing the resolution of the captured image of the camera 40 used for calculating the distance, the accuracy of detecting whether or not the distance is more than a predetermined threshold value may be increased. Note that the predetermined threshold may be different depending on whether the door is open or closed. For example, the predetermined threshold may be set shorter when the door is open than when the door is closed. That is, when the door is open, the predetermined threshold is set to the first distance, and when the door is closed, the predetermined threshold is set to a second distance longer than the first distance. If the door is open, the owner may get off the train, so by shortening the predetermined threshold, an image for notifying the owner of forgotten luggage is quickly projected. It becomes possible. The second distance is, for example, a distance that is about twice as long as the distance that the owner cannot reach the luggage. Note that the second distance may be a distance that makes it impossible to simultaneously detect the baggage and its owner with a camera.

  In addition, the time interval for detecting whether a load is placed on the net shelf by the load detection device 30 may be shortened when the door is open. In this case, when the control device 10 recognizes that the train door is open based on the detection signal from the door opening / closing detection device 20, the control device 10 sends an instruction to the luggage detection device 30 to detect the luggage. By shortening, the accuracy of detecting the luggage is further increased.

  Next, the flow of the projection operation of the projection system 1 described above will be described using the flowchart shown in FIG. The process illustrated in FIG. 3 is repeatedly performed by the control device 10. In step S <b> 1, the control device 10 determines whether or not the load has been placed on the net shelf based on the detection signal from the load detection device 30. If it is not detected by the package detection device 30 that the package has been placed, the control device 10 makes a negative determination in step S1 and repeats the process in step S1. On the other hand, when it is detected by the package detection device 30 that the package has been placed, the control device 10 makes a positive determination in step S1 and proceeds to step S2.

  In step S2, the control device 10 identifies the person closest to the baggage at the time when the baggage is detected in step S1, based on the image captured by the camera 40, and proceeds to step S3. move on.

  In step S <b> 3, the control device 10 determines whether or not the distance between the luggage and the person who is the owner of the luggage is greater than or equal to a predetermined threshold based on the image captured by the camera 40. When the distance is less than the predetermined threshold, the control device 10 makes a positive determination in step S3 and proceeds to step S5. On the other hand, when the distance is equal to or greater than the predetermined threshold, the control device 10 makes a negative determination in step S3 and proceeds to step S4.

  In step S <b> 4, the control device 10 determines based on the detection signal from the baggage detection device 30 whether or not the baggage continues to be placed on the net shelf. When it is continuously detected that the package is placed by the package detection device 30, the control device 10 makes a positive determination in step S4 and returns to step S3. On the other hand, when it is no longer detected that the parcel is placed by the parcel detection device 30, the control device 10 makes a negative determination in step S4 and ends the processing of FIG. In such a case, since it is considered that the owner of the luggage took the luggage off the net shelf, the projection by the projector 50 is not performed.

  On the other hand, if the distance between the baggage and the person who is the owner of the baggage is equal to or greater than a predetermined threshold value, the control device 10 sends an instruction to the projector 50 in step S5 that proceeds with an affirmative determination in step S3. An image for informing the user that the package has been forgotten is projected, and the processing in FIG. 3 ends. That is, when proceeding to step S5, since it is considered that the owner of the luggage has left the luggage on the net shelf, projection by the projector 50 is performed to notify the owner of the luggage of forgetting the luggage.

According to the first embodiment described above, the following operational effects can be obtained.
(1) In the projection system 1, the luggage detection device 30 detects a luggage placed on a net shelf in a train. Based on the image captured by the camera 40, the control device 10 identifies a person in the vicinity of the baggage as the baggage holder when the baggage detected by the baggage detection device 30 is detected. Then, the control device 10 calculates the distance between the luggage and the owner, and causes the projector 50 to project an image for notifying that the luggage is forgotten when the distance is more than a predetermined distance. As a result, the projection system 1 can notify the owner of the luggage that the luggage has been forgotten.

(2) In the projection system 1, the door open / close detection device 20 detects whether the luggage and the owner can enter and exit the train (that is, the train door is open). When it is detected that the train door is open, the control device 10 does not detect that the train door is open (that is, the train door is closed). The accuracy of detecting the distance between the luggage and the owner is increased. As a result, the projection system 1 can accurately detect a forgotten baggage when the forgotten baggage is likely to occur.

(Modification 1 of the first embodiment)
In the above-described embodiment, the example in which the projector 50 projects an image for notifying the user of the baggage when the distance between the baggage and the owner exceeds a predetermined threshold has been described. It does not need to be limited to. For example, when the owner of the luggage goes out of the train from the door (that is, gets off the train), an image for notifying the user of forgetting the luggage may be projected.

  In the case of the first modification, the projector 50 is installed on the roof of the train or the platform of the station in order to project an image outside the train (for example, the platform of the station).

  FIG. 4 is a flowchart for explaining the flow of the projection operation in the first modification. In steps S11 to S12 of FIG. 4, the control device 10 performs the same processing as steps S1 to S2 of FIG. 3 described above. That is, the control device 10 recognizes that a load has been placed on the net shelf based on a detection signal from the load detection device 30, and specifies a person who is the load carrier based on an image captured by the camera 40.

  In step S <b> 13, the control device 10 determines whether the person specified in step S <b> 12 has gone out of the train based on the image captured by the camera 40. As a method for determining whether or not a person has gone out of the train, for example, a camera 40 is installed so that a door is included in the shooting range, and a method for detecting that the person has gone out of the door is detected. May be used. If the shooting range of the camera 40 does not include a door, for example, if a state in which the person is not detected from an image captured by the camera 40 continues for a predetermined time, it is determined that the person has left the train. It may be.

  If the person is not on the train (that is, inside the train), the control device 10 makes a negative determination in step S13 and proceeds to step S14. In step S14, the control apparatus 10 performs the same process as step S4 of FIG. 3 described above. That is, the control device 10 returns to step S13 when the luggage is continuously placed on the net shelf, and ends the process of FIG. 4 when the luggage is unloaded from the net shelf. On the other hand, when the person goes out of the train, the control device 10 makes a positive determination in step S13 and proceeds to step S15. In step S15, the control device 10 recognizes that the train door is closed based on the detection signal from the door open / close detection device 20, and then sends an instruction to the projector 50 to project an image for notifying the user of forgotten luggage. Then, the process of FIG. 4 is terminated. At this time, for example, the projector 50 projects an image for notifying the user of forgotten luggage near the feet of the person who has gone out of the train and got off at the platform of the station.

  As described above, in the projection system 1 according to the first modification, the control device 10 notifies the projector 50 that the luggage has been forgotten when the baggage is in the train and the owner has left the train. The image of was projected. As a result, the projection system 1 can notify the owner of the luggage that the luggage has been forgotten.

  In Modification 1, the reason for projecting an image for notifying of forgetting of luggage when the owner of the luggage gets off the train is as follows. If the passenger forgets the luggage placed on the net and moves away from the luggage, it is considered that the passenger is getting off the train. As in the first embodiment described above, when an image for notifying a luggage is projected when the distance between the luggage and the owner is more than a predetermined distance, the owner who is about to get off the train has forgotten the luggage. You will notice and return to pick up your luggage. However, since the time when the train stops and the door is open is limited, the owner of the baggage may return to pick up the baggage and miss the timing to get off the train. Therefore, in the first modification, an image for notifying a forgotten baggage is projected after the baggage owner gets off the train and closes the door so that the baggage owner does not miss the timing to get off the train. I tried to do it.

  However, in the case of the first modification, unlike the first embodiment described above, the owner of the luggage cannot return the forgotten luggage to the train immediately. It is necessary to pick up luggage again after being collected. Therefore, when the image for notifying the baggage is projected in step S15, the control device 10 may store a captured image showing the owner who forgets the baggage in a storage medium (not shown). Then, at the forgotten item center that delivers the left item on the train to the owner, authentication is performed using the stored captured image at the time of identity verification for the owner who has come to pick up the left item. For example, the control device 10 of the projection system 1 transmits the stored captured image to an authentication device that performs authentication processing for identity verification installed in a forgotten object center or the like. The authentication device performs authentication processing for identity verification based on the captured image transmitted from the projection system 1.

  Moreover, there is a risk that the luggage left on the net shelf will be taken to a person other than the owner. Therefore, the projection system 1 monitors the baggage placed on the net shelf until a predetermined person such as a station employee or a conductor picks up the baggage, and warns if a person other than the predetermined person takes the baggage. An image to be projected may be projected.

  In this case, the control device 10 monitors the detection signal from the baggage detection device 30 even after projecting an image for notifying the baggage forgetting in step S15. When the control device 10 detects that the load is unloaded from the net shelf based on the detection signal from the load detection device 30, the control device 10 is a person in the vicinity of the load based on the image captured by the camera 40, that is, a person who takes the load. Whether or not is the predetermined person. In the case of the predetermined person, the control device 10 ends the monitoring of the luggage placed on the net shelf. When the predetermined apparatus is not the predetermined person, the control device 10 sends an instruction to the projector 50 and near the person who takes the luggage. Project an image to warn you not to bring your luggage.

  As a method for determining whether or not the person is the predetermined person, for example, an image of the face of the predetermined person may be stored in a storage medium (not shown) and used for the determination. A feature amount of a predetermined person's uniform (that is, a uniform of a station worker or a conductor) may be stored in a storage medium (not shown) and used for determination. Alternatively, a station clerk, a conductor, or the like may transmit a radio wave that cancels the warning from the mobile terminal to the camera 40, and when the camera 40 receives the radio wave, the warning image may not be projected.

(Modification 2 of the first embodiment)
In the above-described embodiment, the example in which the projector 50 projects an image for notifying the user of the baggage when the distance between the baggage and the owner exceeds a predetermined threshold has been described. It does not need to be limited to. For example, at the timing when the owner of the luggage places the luggage on the net shelf, the projector 50 may perform a projection for notifying the owner of the luggage that the luggage has been placed on the net shelf.

  FIG. 5 is a flowchart for explaining the flow of the projection operation in the second modification. In steps S21 to S22 of FIG. 5, the control device 10 performs the same processing as steps S1 to S2 of FIG. 3 described above. That is, the control device 10 recognizes that a load has been placed on the net shelf based on a detection signal from the load detection device 30, and specifies a person who is the load carrier based on an image captured by the camera 40.

  In step S <b> 23, the control device 10 sends an instruction to the projector 50 to cause the person who is the owner of the luggage to perform a projection for notifying that the luggage has been placed on the net shelf. At this time, for example, the projector 50 projects light, not an image, onto the face of the person who is the owner of the luggage. A person can recognize that he / she has now put a load on a net shelf by feeling that the light has been applied. Since the light is dazzling when entering the eyes of the person, the control device 10 determines the person's face based on the captured image of the camera 40 so that the light is projected to a position below the eyes on the person's face. The eye position is detected and a projection instruction is sent to the projector 50.

(Modification 3 of the first embodiment)
In the above-described embodiment, an example of detecting a load placed on a net shelf has been described, but the detected load is not limited to this. For example, an umbrella hung on a handrail may be detected.

  In the case of the third modification, the luggage detection device 30 is a camera, for example, and is installed in the vicinity of the handrail, and the installation position and the installation angle are adjusted so that an umbrella hung on the handrail can be photographed. For example, the baggage detection device 30 continues to photograph a handrail with a camera, and detects that an umbrella is hung when the current captured image changes significantly from the previous captured image.

  When the control device 10 recognizes that the umbrella is hung on the basis of the detection signal of the luggage detection device 30, the person who is closest to the handrail on which the umbrella is hung based on the image captured by the camera 40 As specified. Then, the control device 10 includes information on the umbrella (for example, the image of the umbrella and the position of the handrail on which the umbrella is hung) and the information on the specified person (for example, the image of the person 4, the color of clothes, the feature amount of the face, etc.) ) And stored in a memory (not shown). Thereafter, the control device 10 recognizes that the owner of the umbrella is the specified person based on the linked information.

  The control device 10 calculates the distance between the umbrella and the holder based on the image captured by the camera 40, and sends an instruction to the projector 50 when the calculated distance is more than a predetermined threshold. An image for paying attention to forgetting is projected in the vicinity of the owner. In the case of an umbrella, the umbrella and its owner are often in the vicinity as compared to the case of a baggage placed on the net shelf described above, and therefore the predetermined threshold is smaller (that is, shorter) than in the first embodiment described above. Value (for example, about 50 cm).

  When the umbrella holder is sitting in the seat, the control device 10 is careful to forget to forget the umbrella at the time of recognizing that the holder has stood based on the image captured by the camera 40. The image may be projected in the vicinity of the owner.

  The control device 10 may acquire weather information from the Internet or the like via a communication unit (not shown). For example, when the control device 10 recognizes that the day's weather is weather with an umbrella (rain, snow, etc.) based on the acquired weather information, the luggage detection device 30 detects the umbrella. Make it. On the other hand, when it is recognized that the weather of the day is not weather with an umbrella (such as sunny weather), the control device 10 does not cause the package detection device 30 to detect the umbrella. Note that the baggage detection device 30 may detect the umbrella regardless of the weather. In this case, if the umbrella is detected by the luggage detection device 30, but the weather of the day is not weather that has an umbrella (such as sunny), there is a high possibility that the owner of the umbrella is not nearby. . Therefore, when the control device 10 detects that the umbrella is detected by the baggage detection device 30 but the weather of the day is not a weather that has an umbrella (such as sunny weather), there is an umbrella forgotten item. May be notified to a predetermined person such as a station staff or a conductor by transmitting to the communication terminal confirmed by the station staff or the conductor.

(Modification 4 of the first embodiment)
There may be passengers on the train who intentionally leave newspapers and magazines that have been read on the net shelf. Therefore, when the luggage placed on the net shelf is a newspaper or a magazine, the projection system 1 projects an image that warns that the newspaper or magazine is left unattended when the owner moves away from the luggage. Good. In this case, the parcel detection device 30 photographs a parcel placed on the net shelf using a camera, and detects whether the parcel is a newspaper or a magazine based on the photographed image. When it is detected that the baggage placed on the net shelf is a newspaper or magazine, the control device 10 is not an image for notifying that a normal baggage is forgotten when the owner is away from the baggage by a predetermined distance or more. The projector 50 causes the projector 50 to project an image for noting the neglect of the luggage (for example, an image displaying text such as “Do not leave a newspaper or magazine”).

(Modification 5 of the first embodiment)
In the above-described embodiment, an example in which the projector 50 projects an image for displaying a text for notifying the user of forgetting the luggage has been described. However, the projected image is not limited to this. For example, an image obtained by picking up the luggage may be projected by the projector 50. In this case, the parcel detection device 30 is a camera, which captures an image of the parcel placed on the net shelf and detects the parcel based on the captured image. The control device 10 causes the projector 50 to project a captured image captured by the package detection device 30 when the distance between the package and the owner exceeds a predetermined threshold. As a result, it is possible to easily notify the owner of the luggage of forgetting the luggage. Note that the image captured by the package detection device 30 may be projected as it is, or only the package area may be extracted from the captured image by image processing and projected. Moreover, you may make it project the image which shows the said load with animation instead of the picked-up image itself.

  Further, the projector 50 may project light having the same color as the color of the luggage. In this case, the package detection device 30 detects the color of the package based on the captured image of the package with the camera. The control device 10 causes the projector 50 to project light having the same color as the color of the package detected by the package detection device 30 when the distance between the package and the owner exceeds a predetermined threshold. As a result, it is possible to easily notify the owner of the luggage of forgetting the luggage.

(Modification 6 of the first embodiment)
In the above-described embodiment, the example in which the image for notifying the user of the luggage is projected near the owner of the luggage has been described. However, the location where the image is projected is not limited to this. For example, the control device 10 detects the direction of the eye line of the holder based on the image captured by the camera 40, controls the projector 50 based on the detected direction of the eye line, and projects the image on the tip of the eye line. You may make it make it.

  Further, the control device 10 detects the traveling direction of the holder based on the image captured by the camera 40, controls the projector 50 based on the detected traveling direction, and moves the image toward the traveling direction side of the owner. May be projected.

  In addition, the control device 10 may control the projector 50 to project the image on the tip of the owner's line of sight or on the traveling direction side, and then project the image in the vicinity of the owner. .

(Modification 7 of the first embodiment)
In the above-described embodiment, the example in which the package detection device 30 detects the package placed on the net shelf has been described, but the package to be detected is not limited to this. For example, based on an image captured by the camera 40, it may be detected that a person has entered the train, and the baggage that has entered the train together with the person may be detected as the baggage possessed by the person.

(Modification 8 of the first embodiment)
In the above-described embodiment, the example in which the owner of the luggage placed on the net shelf is detected by the camera has been described. However, the apparatus for detecting the owner of the luggage is not limited to this. For example, a pressure sensor is installed on the floor in front of the net shelf to detect the owner of the luggage. In this case, when the pressure detected by the pressure sensor is equal to or greater than a predetermined threshold, the control device 10 determines that the owner of the luggage is in the vicinity of the luggage. On the other hand, when the pressure detected by the pressure sensor becomes less than the predetermined threshold, the control device 10 determines that the owner has moved away from the luggage and projects an image for notifying the projector 50 that the luggage has been forgotten. Let

(Variation 9 of the first embodiment)
In the projection system 1 described above, the control device 10 may cause the projector 50 to project the image 5 only when the train door is open based on the detection signal from the door opening / closing detection device 20.

(Modification 10 of the first embodiment)
In the above-described embodiment, an example of detecting forgetting a baggage on a train has been described. However, the location for detecting forgetting a baggage is not limited to this. For example, forgetting luggage may be detected in a predetermined area such as a vehicle such as a bus or a ship, a predetermined room, or a building, and an image for notifying the luggage may be projected.

-Second Embodiment-
Next, a second embodiment of the present invention will be described with reference to the drawings. FIG. 6 is a block diagram showing the configuration of the projection system 100 according to the second embodiment. Projection system 100 according to the present embodiment is installed in a train and projects an image for paying attention to a manner violation (for example, sitting on the floor). Projection systems 100 are provided at a plurality of locations so that the entire train can be alerted to violations of manners. Projection system 100 includes a control device 10, a camera 40, and a projector 50. In addition, since the control apparatus 10, the camera 40, and the projector 50 are the structures similar to the projection system 1 of 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  Next, a projection operation by the projection system 100 of the present embodiment will be described using FIG. The installation position and the installation angle of the camera 40 are adjusted so that a person sitting on the floor of the train can take a picture. The camera 40 continuously captures images at a predetermined frame rate by the image sensor 42 and outputs captured images to the control device 10 in real time. The control device 10 detects the person 105 sitting on the train floor based on the image captured by the camera 40. As a method for detecting whether a person is sitting or standing on the floor, for example, the height of the face when the person enters the train is detected based on an image captured by the camera 40 and stored in a memory (not shown). A method is used for storing and detecting that a person is sitting on the floor when the height of the current face is lower than the stored face height by a predetermined threshold or more. In the case of storing an image of a person, an image with a resolution reduced enough to distinguish a person may be stored, or only an edge image that can distinguish a person may be stored. . The stored image of the person may be deleted from the memory when it is detected that the person has got off the train based on the image captured by the camera 40.

  The control device 10 sends an instruction to the projector 50 to project an image 106 for noting the act of sitting on the floor in the vicinity of the person 105 sitting on the floor. The image 106 is, for example, an image that displays text with content that warns of the act of sitting on the floor, such as “Do not sit on the floor!”. At this time, the control device 10 calculates a projection direction based on the image captured by the camera 40 so that the image 106 can be projected to a position in the vicinity of the person 105 sitting on the floor without being blocked by other persons. Control is performed so that the projection direction of the projector 50 becomes the calculated projection direction. Thereby, the image 106 is projected on a position in the vicinity of the person 105 sitting on the floor without being obstructed by other persons, and the person 105 can recognize that the action of sitting on the floor is warned. The projection surface on which the image 106 is projected is not limited to a floor or a wall, and may be, for example, a ceiling, a window, a suspended leather, a suspended advertisement, or the like.

  In addition, as an image for paying attention to the act of sitting, for example, by projecting an image that makes it impossible for a person to sit on the floor, the sitting action itself may be guided to stop. An image that makes a person unable to sit on the floor is, for example, an image that is not suitable for the environment of the place, for example, an image such as pink that makes a person stand out.

  Next, the flow of the projection operation of the projection system 100 described above will be described using the flowchart shown in FIG. The process shown in FIG. 8 is repeatedly performed by the control device 10. In step S101, the control device 10 determines whether or not a person sitting on the floor of the train has been detected based on an image captured by the camera 40. When a person sitting on the floor is not detected, the control device 10 makes a negative determination in step S101 and repeats the process of step S101. On the other hand, if a person sitting on the floor is detected, the control device 10 makes a positive determination in step S101 and proceeds to step S102.

  In step S <b> 102, the control device 10 determines whether the state of sitting on the floor of the person detected in step S <b> 101 has continued for a predetermined time (for example, about 1 minute) based on the image captured by the camera 40. If the control device 10 detects that the person detected in step S101 stops sitting on the floor before the predetermined time has elapsed, the control device 10 makes a negative determination in step S102 and ends the processing in FIG. To do. In such a case, it is considered that the person detected in step S101 has temporarily lowered his / her face height, for example, by picking up a baggage dropped on the floor, and the person does not violate manners. Therefore, projection by the projector 50 is not performed. On the other hand, if the control device 10 detects that the person detected in step S101 has been sitting on the floor for a predetermined time or longer, the control device 10 makes a positive determination in step S102 and proceeds to step S103. In this case, since the person detected in step S101 continues to sit on the floor, it is considered that the person is violating manners.

  In step S103, the control device 10 sends an instruction to the projector 50 to project an image for paying attention to the act of sitting on the floor in the vicinity of the person sitting on the floor, and ends the processing of FIG.

According to the second embodiment described above, the following operational effects can be obtained.
(1) In the projection system 100, the control device 10 detects a person performing an act of sitting on the floor in a train based on an image captured by the camera 40, and pays attention to the projector 50 about the act of sitting on the floor. Project an image. Thereby, the projection system 100 can be careful of the act with respect to the person who is performing the act of sitting on the floor.

(2) In the projection system 100, the control device 10 detects the person performing the act of sitting on the floor, and then, when the state of the person performing the act continues for a predetermined time, Project an image to pay attention to the act of sitting. Thereby, the projection system 100 can prevent erroneously paying attention to a person who does not continue to act on the floor.

(Modification 1 of the second embodiment)
In the above-described embodiment, an example in which an image for noting the act of sitting on the floor is projected in the vicinity of a person sitting on the floor has been described. However, the location where the image is projected is not limited to this. .

  For example, the control device 10 detects the position of a person sitting on the floor based on an image captured by the camera 40, controls the projector 50 based on the detected position, and displays the image using the person as a projection plane. You may make it project. Preferably, the image may be projected onto the person's face.

  Further, the control device 10 detects the direction of the line of sight of the person sitting on the floor based on the image captured by the camera 40, and controls the projector 50 based on the detected direction of the line of sight, so An image may be projected.

  In addition, the control device 10 may control the projector 50 to project the image on the tip of a person sitting on the floor and then project the image near the person.

(Modification 2 of the second embodiment)
In the projection system 100 described above, when the person sitting on the floor is a child, an image that the child likes (for example, an image of an anime character that draws the child's attention) is projected and guided to the seat. You may make it move the said image so that. In this case, when the control apparatus 10 detects a person sitting on the floor based on an image captured by the camera 40, the control apparatus 10 determines whether the person is an adult or a child. A known method may be used for this determination. When the control device 10 determines that the person sitting on the floor is a child, the projector 50 projects an image preferred by the child in the vicinity of the child by the projector 50, and after a predetermined time has elapsed, the child The image is moved to a vacant seat in the vicinity of. In addition, when guiding a child, if an image that a child such as a character likes is projected, the child may be absorbed in the image and distract from the surroundings in some cases. Therefore, the projector 50 may control the projector 50 to project the image only when the surrounding safety is detected in advance by the camera 40 of the projection system 100 and it is determined to be safe.

(Modification 3 of the second embodiment)
In the above-described embodiment, the example of detecting the person who performs the act of sitting on the floor and projecting an image that pays attention to the action has been described. However, the person who performs the act of violating other manners is detected. Then, an image noting the action may be projected. For example, the control device 10 sits in a priority seat or a person performing an act of sitting on the seat with the elbows and knees extended more than necessary, an action of lying down on the seat, an action of crossing legs, etc. A young person or the like may be detected based on an image captured by the camera 40, and an image that warns about the act may be projected on the projector 50.

(Modification 4 of the second embodiment)
In the projection system 100 described above, a person who has fallen to the floor due to illness or the like may be detected, and an image in which the person is left as it is may be projected. In this case, the control device 10 detects the height of the person's face based on the image captured by the camera 40, and the detected face height is lower than a predetermined height (for example, the height of the seating surface of the seat). In this case, it is determined that the person has fallen due to illness. Then, the control device 10 causes the projector 50 to project an image of the content for notifying that there is a person who has fallen on the people around the person who has been determined to have fallen.

  Further, the temperature of a person in the train may be detected by thermography, a person having a bad physical condition may be detected based on the detection result, and an image may be projected to leave the person to the effect.

(Modification 5 of the second embodiment)
In the projection system 100 described above, when the control device 10 determines that the person entering the train is old based on the image captured by the camera 40, the control apparatus 10 notifies the vacant seat near the person. The image may be projected on the projector 50.

(Modification 6 of the second embodiment)
In the projection system 100 described above, for example, when the control device 10 detects a person sitting in the seat and sleeping on the basis of an image captured by the camera 40 when the train arrives at the end point, the projector 50 sleeps. Light may be projected onto the face of a person. Thereby, the person who is sleeping can be awakened.

(Modification 7 of the second embodiment)
For example, when a wheelchair user is waiting for a train at the platform of the previous station, the person is detected by a detection device such as a camera and transmitted to the projection system 100, or the station staff is transmitted by a communication terminal or the like. This may be transmitted to the projection system 100. When the projection system 100 receives that the wheelchair user is present, the projection system 100 projects light onto the wheelchair space in the train by the projector 50 to prompt the surrounding passengers to open the space for the wheelchair in advance.

(Modification 8 of the second embodiment)
When the inside of a train becomes crowded, there is a high possibility that there is no space for projecting an image, or even if an image is projected, the subject cannot see it. Therefore, the projection system 100 may stop the projection by the projector 50 when detecting that the inside of the train is congested based on the image captured by the camera 40.

(Variation 9 of the second embodiment)
In the above-described embodiment, an example of detecting a manner violation violation in a train has been described. However, the place for detecting a manner violation violation is not limited to this. For example, it is possible to detect an act of violation of manners in a predetermined area such as a vehicle such as a bus or a ship, a predetermined room or a building, and project an image for paying attention to the violation of manners. May be.

-Third embodiment-
Next, a third embodiment of the present invention will be described with reference to the drawings. FIG. 9 is a block diagram showing a configuration of a projection system 200 according to the third embodiment. Projection system 200 of the present embodiment is installed in a train and projects an image for suppressing criminal acts (for example, molesting, voyeurism, picking). Projection systems 200 are provided at a plurality of locations so that criminal acts can be suppressed throughout the train. Projection system 200 includes control device 10, camera 40, and projector 50. In addition, since the control apparatus 10, the camera 40, and the projector 50 are the structures similar to the projection system 1 of 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  In the present embodiment, a victim of criminal activity or a person around it informs the projection system 200 that the criminal activity is being carried out by a portable terminal 60 (for example, a mobile phone or a tablet computer) possessed by the victim. Be able to.

  Next, a projection operation by the projection system 200 of the present embodiment will be described using FIG. For example, it is assumed that the criminal 205 is performing a molesting act on the victim 206. The victim 206 transmits criminal information indicating that a criminal act is being performed to the control device 10 of the projection system 200 installed in the vicinity by the portable terminal 60 owned by the victim 206. The crime information includes position information of the mobile terminal 60 (for example, position information acquired by GPS).

  When receiving the crime information from the mobile terminal 60, the control device 10 sends an instruction to the projector 50 based on the position information of the mobile terminal 60 to project an image 207 for suppressing the criminal act in the vicinity of the victim 206. In addition, as a method for the control device 10 to specify the position of the victim 206, for example, the portable terminal 60 may transmit the crime information including the position information of the portable terminal 60. The position information of the portable terminal 60 may be acquired by GPS, for example, or the control device 10 transmits the position of the projector 50 to the portable terminal 60, and the portable terminal 60 measures the distance to the projector 50 using the camera function. You may acquire by distance. The image 207 is an image that displays text such as “Criminal attention!”, For example, and it is desirable that the criminal stops the crime voluntarily by viewing the image 207.

  In the case of a molester act, the victim 206 may not want to be identified as a surrounding person if he / she is a victim of the molester act. Therefore, for example, by projecting the image 207 on a plurality of locations such as a floor or a wall in a train or expanding the projection range of the image 207, the victim 206 may not be identified as a surrounding person. Further, the projection plane onto which the image 207 is projected is not limited to a floor or a wall, and may be, for example, a ceiling, a window, hanging leather, a hanging advertisement, or the like.

  Further, when a surrounding person discovers that the criminal 205 is performing a molesting act on the victim 206, the control apparatus 10 of the projection system 200 outputs the criminal information by the portable terminal 60 owned by the surrounding person. You may make it transmit to. In this case, surrounding persons may take a picture of the criminal 205 face by the camera function of the portable terminal 60 and include the photographed image in the crime information and transmit it to the control device 10. When the captured image of the criminal 205 is transmitted from the mobile terminal 60, the control device 10 determines the position of the criminal 205 based on the captured image of the criminal 205 and the captured image of the camera 40 that captures the inside of the train. Is identified. Then, the control device 10 sends an instruction to the projector 50 based on the identified position of the criminal 205, and causes the criminal 205 to project light directly (for example, using the criminal 205's face as a projection plane). Thereby, it is considered that the criminal perceives that the criminal act is identified by feeling dazzled by the light of the projector 50 and voluntarily stops the criminal act. In the above description, the criminal 205 is photographed by the camera function of the portable terminal 60, and the crime information is sent by transmitting the photographed photographed image to the control device 10, but the through image is not photographed. You may make it transmit to. Advantages of transmitting a through image include a large amount of information and a time change. In addition, the mobile terminal 60 makes a sound when the shutter is released, but does not make a sound when the through image is acquired. Therefore, the information provider is not known to the criminal 205 and the information provider is safe. There is also an advantage of being.

  Next, the flow of the projection operation of the projection system 200 described above will be described using the flowchart shown in FIG. The process illustrated in FIG. 11 is repeatedly performed by the control device 10. In step S <b> 201, the control device 10 determines whether crime information has been received from the mobile terminal 60. As described above, the crime information includes position information of the portable terminal 60, a photographed image of the criminal's face, and the like. If the crime information is not received, the control device 10 makes a negative determination in step S201 and repeats the process of step S201. On the other hand, when the crime information is received, the control device 10 makes a positive determination in step S201 and proceeds to step S202.

  In step S202, the control device 10 determines whether or not the criminal information includes a photographed image of the face of the criminal 205. If the captured image is included, the control device 10 makes a positive determination in step S202 and proceeds to step S203. On the other hand, if the captured image is not included, the control device 10 makes a negative determination in step S202 and proceeds to step S204.

  In step S <b> 203, the control device 10 specifies the position of the criminal based on the image taken by the criminal and the image taken by the camera 40. Then, the control device 10 sends an instruction to the projector 50 based on the identified position of the criminal, causes the criminal to directly project light, and ends the process of FIG.

  On the other hand, in step S204, the control device 10 sends an instruction to the projector 50 based on the position information of the mobile terminal 60, projects an image for suppressing criminal acts near the victim, and performs the process of FIG. finish.

According to the third embodiment described above, the following operational effects can be obtained.
In the projection system 200, the control device 10 detects a person performing a criminal act on the train based on the criminal information from the mobile terminal 60 and causes the projector 50 to project an image for suppressing the criminal act. . Thereby, the projection system 200 can prompt the person who is performing the criminal act to stop the act.

(Modification 1 of 3rd Embodiment)
In the above-described embodiment, the example in which the projection system 200 detects criminal activity by receiving criminal information from the portable terminal 60 has been described. However, the method of detecting criminal activity is not limited thereto. It does not have to be. For example, when the temperature of a person in a train is detected by thermography and a person having a predetermined temperature or more is detected, it may be detected that the person is performing a criminal act. In this case, since there is a risk of erroneous detection of a criminal act, the projector 50 does not directly project an image or light on the detected person, but rather a relatively wide area in the vicinity of the detected person. Project light.

  In addition, a specific gesture for notifying the projection system 200 that a criminal act victim or a person in the vicinity of the criminal act is present (predetermined gesture indicating a criminal act such as a pervert act) ) May be detected based on the image captured by the camera 40 that a criminal act is being performed.

  Further, a victim of a criminal act or a person in the vicinity thereof may be able to notify the projection system 200 that the criminal act is being performed by pulling a hanging leather or a hanging advertisement.

(Modification 2 of the third embodiment)
For example, criminal acts such as voyeurism and pick-up may be performed without the victim's knowledge. Therefore, the projection system 200 may project an image that prompts the victim to move. Note that an image that prompts movement is, for example, an image in which the projection location is moved after being projected onto the victim's eye. Further, in addition to projecting the image, the victim may be prompted to move by vibrating a hanging leather gripped by the victim.

(Modification 3 of the third embodiment)
In addition, the projection system 200 takes a surrounding image including a criminal with the camera 40, marks a criminal's face in the photographed image with a circle or the like, and causes the projector 50 to project the image. May be.

(Modification 4 of the third embodiment)
Further, the projection system 200 may detect the position of the criminal's eyes from the captured image of the camera 40 and cause the projector 50 to project light to the criminal's eyes.

(Modification 5 of the third embodiment)
The projection system 200 is based on the image captured by the camera 40, and places where there is a high risk of criminal acts (for example, places where there is a high risk of pervert acts include men around crowded places and women. It is also possible to detect a large number of locations) and project an image by the projector 50 in the vicinity of the detected locations.

  In addition, the projection system 200 may move a location where an image is projected by the projector 50 in a train. At that time, the projection system 200 may make the residence time of the projection image longer than the other part at a place where the risk of the criminal acts as described above is high.

(Modification 6 of the third embodiment)
The projection system 200 may project the advertisement image by the projector 50 in the normal mode. When the projection system 200 detects a person who is performing a criminal act on the train based on the crime information from the mobile terminal 60, the projection system 200 switches to the SOS mode, for example, "Let's take care of the pervert". For example, an image closely related to a crime that is predicted to be currently performed may be projected.

(Modification 7 of the third embodiment)
In the above-described embodiment, an example of detecting a criminal act on a train has been described. However, the location where a criminal act is detected is not limited to this. For example, a criminal act may be detected in a predetermined area such as a vehicle such as a bus or a ship, a predetermined room or a building, and an image for paying attention to the criminal act may be projected.

-Other variations-
You may make it combine the 1st-3rd embodiment mentioned above and each modification suitably. For example, the projection system 1 according to the first embodiment has a function of projecting an image that pays attention to annoying acts such as acts of violation of manners and criminal acts, as in the second and third embodiments. It may be.

  Although various embodiments and modifications have been described above, the present invention is not limited to these contents. Other embodiments conceivable within the scope of the technical idea of the present invention are also included in the scope of the present invention.

DESCRIPTION OF SYMBOLS 1,100,200 ... Projection system, 10 ... Control apparatus, 20 ... Door opening / closing detection apparatus, 30 ... Baggage detection apparatus, 40 ... Camera, 50 ... Projector, 60 ... Portable terminal

Claims (10)

A positional relationship detecting means for detecting a package that has entered a predetermined area and a holder of the package, and detecting a positional relationship between the package and the owner;
Projection means for performing a predetermined projection when the positional relation detected by the positional relation detection means is in a predetermined state;
A projection system comprising: The projection system according to claim 1, wherein
The projection system according to claim 1, wherein the predetermined state is a state in which a distance between the luggage and the owner is a predetermined distance or more. The projection system according to claim 1, wherein
The projection system according to claim 1, wherein the predetermined state is a state in which the baggage is in the predetermined region and the owner has left the predetermined region. In the projection system according to any one of claims 1 to 3,
The positional relationship detecting means includes
A load detection means for detecting a load placed at a predetermined location in the predetermined area;
Owner identification means for identifying a person in the vicinity of the luggage at the time when the luggage is detected by the luggage detection means as an owner of the luggage;
A projection system comprising: In the projection system according to any one of claims 1 to 4,
A state detecting means for detecting whether or not the baggage and the owner can enter and leave the predetermined area;
The positional relationship detection means detects the positional relationship when the state detection means detects that the state is accessible, rather than when it is not detected that the state is accessible. A projection system characterized by increasing the accuracy to be performed. In the projection system according to any one of claims 1 to 4,
A state detecting means for detecting whether or not the baggage and the owner can enter and leave the predetermined area;
The projection system performs the predetermined projection when it is detected by the state detection unit that the state is accessible. In the projection system according to any one of claims 1 to 6,
It further comprises imaging means for imaging the luggage,
The projection system projects an image captured by the imaging unit when the positional relationship detected by the positional relationship detection unit is in a predetermined state. In the projection system according to any one of claims 1 to 6,
Color detecting means for detecting the color of the luggage;
The projection system projects light of the color detected by the color detection unit when the positional relationship detected by the positional relationship detection unit reaches a predetermined state. Detecting means for detecting a person performing a predetermined action in a predetermined region;
A projection means for performing a predetermined projection when a person performing the predetermined action is detected by the detection means;
A projection system comprising: The projection system according to claim 9, wherein
The projection system, wherein the projection unit performs the predetermined projection when a state in which the person is performing the predetermined action continues for a predetermined time or more.

Images