JP4710778B2 - In-train information display system with small camera - Google Patents

Description

  The present invention relates to an in-train information display system including a plurality of information display devices, a relay transmission device connectable to the information display device and an on-board network, an on-board server device connectable to the on-board network, and a wireless device. About.

  2. Description of the Related Art In recent years, there is an in-train information display system in which an LCD display or an LED display is installed in a train (moving body) to display information such as advertisements, next station or destination information.

  As described in [Patent Document 1], in this type of in-train information display system, information content such as advertisements stored in the ground server device is delivered to the on-board server device using a wireless device or a memory card medium, Advertisements for passengers and next station guidance are displayed on information display devices such as LED displays and LCD displays.

  In this train information display system, it is described that the images and sound devices such as cameras and microphones installed in the subway car are remotely operated to grasp the crime and congestion situation. On the other hand, it is a one-way guidance system that displays unilaterally and does not take into account how many people are viewing advertisements.

  As a technique for changing a display item by a person, there is a system that recognizes the facial expression of a person who is looking at an advertisement image and displays an optimum advertisement image as described in [Patent Document 2]. However, this technique uses only one target person, reads the expression of one person, and determines the display object based on the result. In addition, when the person is not watching, the display is not performed in the idle mode. In addition, a camera for crime prevention is used in the vehicle, and no in-vehicle monitoring is performed to check passengers.

JP 2004-297420 A JP 2005-267611 A

  Since the conventional techniques described in [Patent Document 1] and [Patent Document 2] can provide information only in one direction, information corresponding to the audience rating referred to on a television cannot be obtained. In addition, there are some that monitor by installing a camera in the car, but the information display system in the train and the monitoring system in the train are different in purpose and use, so the information displayed on the information display device It is impossible to obtain information about what the passengers are most interested in, what kind of people were interested in how many people were watching, and information on TV ratings for traders who place advertisements.

  It is an object of the present invention to analyze a train when an information display device is equipped with a small camera, thereby analyzing when, where and who is interested in which information, and to the information display device. It is to realize an appropriate information display content instruction.

  In order to achieve the above object, an in-train information display system equipped with a small camera according to the present invention includes a plurality of information display devices mounted on the upper side of the vehicle and mounted with a small camera, and a relay connected to the information display device. A transmission device and an on-vehicle network, an on-board server device and a wireless device connected to the on-vehicle network, and a content distribution server, audience rating statistics server, and in-vehicle monitoring storage server arranged on the ground side, Information of a person who is watching the content displayed on the display screen of the information display device is acquired and analyzed.

  In addition, since the information display device is installed at a position that can be seen by the passengers of the train, it is possible to monitor the situation inside the train from a small camera mounted on the information display device.

  Further, the advertisement information is displayed on the information display device, and the gender, number, and time information of the person who is watching the information display device based on the video data photographed by the small camera are displayed on the vehicle server device and the vehicle interior. If the number of passengers analyzed and monitored by the monitoring storage server is less than the preset number of people, content is actively sent to passengers by making a sound from the information display device or flashing the display screen. Will increase the degree of attention and enable effective advertisement display.

  According to the present invention, for a train information display system, by mounting a small camera on an information display device, it is analyzed when, where, and who is interested in which information, Appropriate information display content instructions can be realized.

  Also, it functions as an in-train monitoring system and realizes improved face authentication efficiency.

  A small camera-equipped in-train information display system according to an embodiment of the present invention will be described with reference to FIGS.

  FIG. 1 is a configuration diagram of the in-train information display system with a small camera according to the present embodiment.

  As shown in FIG. 1, a content distribution server 107, audience rating statistics server 108, and in-vehicle monitoring storage server 109 are installed on the ground side, and the on-board server 105 connected to the wireless device 106 installed on the upper side of the vehicle. The relay transmission device 103 is connected to the on-board server 105 via the on-board network 104 and installed in each vehicle, and a plurality of information display devices 102 are connected to the relay transmission device 103. Each server on the ground side and the on-board server 105 on the vehicle upper side are communicated with each other via, for example, a wireless device installed along the track.

  A plurality of display screens 101 and a small camera 100 are mounted on the information display device 102. This information display device 102 is installed in a train used by a large number of passengers such as a commuter train, in the position of a hanging advertisement that is most easily seen by passengers, in the vicinity of the entrance door, or in a wife section where the train and the train are connected. Has been.

  The relay transmission device 103 and the on-board network 104 enable communication between the display screen 101 and the small camera 100 and the on-board server 105.

  An on-vehicle server 105 on the upper side of the vehicle is equipped with an image processing device (not shown). The image processing apparatus includes an image processing control circuit, an image processing circuit, a memory, and the like.

  In the small camera 100, the subject image formed on the imaging surface of the imaging element made of a CCD (Charge Couple Device) or the like is converted into an electrical signal by light conversion processing and output by the imaging lens. The output electrical signal is converted into a digital signal by the A / D conversion circuit and input to the image processing apparatus.

  FIG. 2 is a diagram illustrating a flow of information between the servers. It is assumed that a plurality of passengers are watching an advertisement displayed on the information display device 102 by a plurality of passengers. This state is photographed by the small camera 100 mounted on the display screen 101, and as indicated by reference numeral 110, the image processing circuit of the image processing apparatus of the display screen 101 is used to watch the display screen 101 from the photographed video data. Identify face information, number of people, and gender.

  The image processing circuit extracts a person from the digitally converted image information and confirms the number of persons. A process of electronically zooming the face portion from the identified person is performed to determine the direction of the line of sight. In addition, the hair characteristics that identify the color of the person's clothes are extracted to determine the gender. Here, for extracting a person, for example, a method of identifying a person by matching with a person's template from the shading information of the image is used. In order to determine the direction of the line of sight, the orientation of the face and its temporal change Etc. in combination.

The face information, the number of persons, and the sex information of the person who is gazing at the display screen 101 identified in this way are associated with the time information and the vehicle identification information taken by the small camera 100, and stored in the memory. Is remembered. Information regarding these images is referred to as image processing data for convenience. As indicated by reference numeral 114, the image processing data is accumulated in the on-board server 105, periodically transmitted via the wireless device 106, and transmitted to the content distribution server 107, audience rating statistics server 108, and in-vehicle monitoring accumulation server 109. And analyzed.

  The image processing may be performed by the on-board server 105 on the vehicle side, the audience rating statistics server 109 on the ground side, and the in-vehicle monitoring storage server 109.

  As indicated by reference numeral 116, the in-vehicle monitoring accumulation server 109 transmits the received image processing data to the audience rating statistics server 108, while accumulating the image processing data to confirm the presence / absence of crimes and the crime prevention situation. use. In addition to the image processing data, the captured image is also sent to the in-vehicle monitoring storage server 109, detects a motion vector including a person's limbs, etc., and identifies the crime situation together with image analysis.

  Also, the characteristics of the face (eye, nose, mouth shape, skin color, etc.) of the person who is watching the information display device are compared with the face information database stored in the on-board server 105 or the in-vehicle monitoring storage server 109. And by performing face authentication, it becomes possible to improve the security in the train. For example, it can be realized by analyzing an image of a time when a molester occurs from a plurality of videos.

  When it is determined that a crime has occurred, as shown by reference numeral 117, the crime is prevented beforehand by associating with shooting time information and vehicle information and providing evidence or emergency notification when the crime occurs.

  In the audience rating statistics server 108, as indicated by reference numeral 118, by analyzing the image processing data, the number of people who were interested while being displayed on the display screen 101, the time distribution, and the information of the people who were watching And the correlation with the displayed information can be acquired. In addition, in trains with different age groups and occupational groups, such as commuter trains, analysis data can be acquired for each displayed information, so those that were less interested by time zone, It becomes possible to sort out things that interest you.

  In addition, since the audience rating of the information displayed on the display screen 101 can be calculated, it is possible to calculate the advertisement posting cost, and the advertising cost is settled from the predetermined relationship between the audience rating and the advertisement cost. As indicated by reference numeral 119, for example, the monthly audience rating and the settlement amount are presented to the advertiser. In addition, an answer from the advertiser for this presentation is recorded as advertiser information.

  These pieces of information are transmitted to the content distribution server 107, and as indicated by reference numeral 115, a schedule for distribution is created, and the corresponding content is distributed to the on-board server. The on-board server 105 receives the distributed schedule and content as indicated by reference numeral 112, and displays the content suitable for the person concerned as indicated by reference numerals 113 and 111. In addition, if the number of people watching the information display device is analyzed to be less than a preset number of people, a sound is generated that illuminates the display screen.

  As described above, it is possible to perform selection support of information to be displayed and content determination support based on the analysis data. In particular, in the case of an advertisement, the analysis data is reported to the advertisement provider, and it becomes possible to support the determination of the advertisement time zone and contents more effectively from the next time.

  In addition, by placing the small camera near the information display screen, it is possible to obtain front-view information of passengers gazing at the screen, improving the accuracy of face authentication and reducing the time required for face authentication Can be achieved.

  Also, by mounting a small camera on the information display device, analyze when, where, who is interested in which information, and realize appropriate information display content instructions to the information display device Is possible.

  In addition, when the number of people watching the information display device is small, it is possible to attract the attention of the passengers by the display screen glowing or sound.

  This is an effective support for information that the railway operator wants to inform a plurality of passengers, such as accident information, for example, information on accidents and final transfers.

  In addition, it is possible to identify passengers by acquiring information on the face of the person who is watching the information display screen, and collating it with face authentication data accumulated in the on-board server device or the ground server device It becomes possible.

1 is a configuration diagram of an in-train information display system equipped with a small camera according to an embodiment of the present invention. It is a processing flow figure of the information of the whole in-train information display system.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Small camera 101 Display screen 102 Information display apparatus 103 Relay transmission apparatus 104 Car network 105 Car server 106 Radio | wireless apparatus 107 Content delivery server

Claims (4)

A plurality of information display devices mounted with a small camera, a relay transmission device connected to the information display device, an on-vehicle network, an on-vehicle server device connected to the on-vehicle network, and A wireless device;
An in-train information display system configured to include a ground server device arranged on the ground side,
With identifying the face information and the number of people who are watching the display screen of the information display device by the image processing circuit from the video data captured by the small camera, of the person and the displayed on the display screen content The face information and the number of people and the display time of the content are associated with each other and stored as image processing data,
The ground server device creates a display schedule for displaying the content on the information display device from the analysis data for each content created based on the image processing data,
An in-train information display system equipped with a small camera that determines contents to be displayed on the information display device based on the display schedule .   Display advertisement information on the information display device and notify the advertiser of the gender, number of people and time information of the person who was watching the information display device identified based on the video data taken by the small camera The in-train information display system with a small camera according to claim 1.   When the number of passengers who have been watching the information display device, identified based on the video data captured by the small camera, is less than the preset number of people, displaying advertisement information on the information display device The in-train information display system with a small camera according to claim 1 or 2, wherein a sound is emitted from the information display device or a display screen is flashed.   Features of the face of a person who has displayed the advertising information on the information display device and watched the information display device based on video data taken by the small camera, and the on-board server device or the ground server The in-train information display system with a small camera according to claim 1, wherein face authentication is performed by comparing with a face information database stored in the vehicle.

Images