JP7329829B2 - Processors, systems and programs - Google Patents

Description

The present invention relates to a processing device, system, and program.

A device is known that installs a video camera in a train car and extracts and displays the boarding rate from the image of the video camera (for example, Patent Document 1).

JP-A-5-254440

One of the objects of the present invention is to provide a technique for utilizing images captured inside a moving body. For example, moving objects such as trains, buses, elevators, etc. may be equipped with display devices for displaying, for example, commercials or other content. It is also an object of the present invention to provide a technique for utilizing an image captured inside a moving body in which content is displayed in this case.

The purpose of the invention of the present application is not limited to this, and we intend to acquire rights for the structure aiming to obtain the effect produced by the structure disclosed in the specification and drawings, etc. by divisional application, amendment, etc. . For example, the present specification discloses a problem in which the phrase "can be done" is read as "is the problem." The problems are described as independent ones, and we have the intention to independently acquire the rights for the structure for solving the problems by filing a divisional application, an amendment, etc. Even if the problem is implicitly grasped from the description of the specification, the applicant intends to claim part of the configuration described in this specification in an amended or divisional application. Also disclosed is a combination of these independent tasks.

(1) A selection function for selecting content to be displayed on a display device placed inside a moving body from among a plurality of contents based on an image captured by a camera that captures the inside of the moving body, and an image captured by the camera. It is preferable that the processing device has at least one function of an evaluation information acquisition function of acquiring information serving as a basis for evaluating the content displayed on the display device based on the above.

In this way, it is possible to select the content to be displayed based on the image of the inside of the moving body, or to acquire the information serving as the basis for evaluating the content. It is possible to provide technology for utilizing

(2) The processing device may include at least the selection function, and the selection function may include a function of selecting content based on at least one of attributes and actions of a person in the moving object.

In this way, content can be selected according to at least one of the attributes and actions of the person in the moving object.

(3) At least the selection function is provided, and the selection function detects a person looking at the display device based on the image captured by the camera, and directs the line of sight to the display device. It is preferable that the processing device has a function of selecting content to be displayed on the display device based on the attributes of the person.

In this way, it is possible to cause the display device to display content corresponding to the person who is actually looking at the display device.

(4) The camera is arranged on a moving object operated so as to sequentially pass through a plurality of stops where people get on and off, the processing device has at least the selection function, and the selection function includes: The processing device may include a function of selecting content for each travel section between the stops and displaying the selected content corresponding to the travel section on the display device while the travel section is traveled. .

In this way, when the person present in the moving object may change for each traveling section, it is possible to select and display the content corresponding to the current person inside the moving object on the display device.

(5) At least the evaluation information acquisition function is provided, and the evaluation information acquisition function is at least a person looking at the display device based on an image captured by the camera while content is being displayed on the display device. It is preferable that the processing device includes a function of obtaining information about the number of

In this way, it is possible to obtain information about the number of people in the moving object during display of content as information that serves as a basis for evaluating content.

(6) The evaluation information acquisition function may be a processing device including a function of detecting the number of people in the moving object and the line of sight of the person based on the image captured by the camera.

In this way, it is possible to acquire information about the number of people in the moving object during display of the content and the line of sight of the people as information serving as a basis for evaluating the content.

(7) A processing device further comprising a function of associating and recording an image captured by the camera, information identifying content displayed on the display device, and information serving as a basis for evaluating the content. good.

In this way, the content and the information that serves as the basis for evaluating the content can be recorded in association with each other.

(8) A person looking at the display device is detected based on the image captured by the camera, and the person looking at the display device is associated with the content displayed on the display device. It is preferable that the processing device further includes a function of recording information specifying the .

In this way, it is possible to associate and record the content and the information identifying the person who is actually looking at the display device.

(9) The apparatus further comprises a function of detecting a position in the display device to which a person is looking, and recording the content displayed on the display device and the position viewed by the person in association with each other. It is preferable to use a processing device with a

In this way, it is possible to record information for knowing which position in the video content the person in the moving object is looking at.

(10) It is preferable that the processing device includes at least the evaluation information acquisition function, and the evaluation information acquisition function evaluates the content based on the information acquired by the evaluation information acquisition function.

In this way, the content displayed on the display device arranged in the vehicle can be evaluated.

(11) Based on the image captured by the camera, for each person who has boarded the moving object, a moving route in the moving object from getting on to getting off the vehicle is detected, information on the boarding point, the movement The processing device may further have a function of recording the detection result of the movement route inside the body and the information of the getting-off point.

In this way, it is possible to record information for knowing how a person moves from getting on the moving object to getting off the vehicle.

The function of the processing device described in (11) above may be realized by a processing device that does not have the functions of the processing devices described in (1) to (10).

(12) A processing device further comprising a function of causing the display device to display an image captured by the camera or an image obtained by processing the image, instead of or in combination with displaying content on the display device. should be

In this way, an image captured by the camera can be shown to the person in the moving body in place of or in combination with the content.

(13) A lock mechanism is provided in the luggage storage area, and the lock mechanism is set to either a locked state or an unlocked state based on the characteristics of a person visiting the luggage storage area in the image captured by the camera. It is preferable to use a processing device that

In this way, it is possible to prevent the luggage placed in the luggage storage area from being stolen.

(14) A processing device further comprising a function of performing image processing that prevents visual recognition or recognition of a specified area in an image captured by the camera, and recording the image on a recording medium. should be

In this way, it is possible to make the information contained in the designated area of the image captured by the camera less visible or recognizable.

(15) A function of recording an image captured by the camera in a recording device, reading out the image recorded in the recording device, and performing predetermined image processing on a person's face, resulting in image data, or the predetermined image. The processing device may further include a function of selectively outputting unprocessed image data.

In this way, it is possible to perform predetermined image processing on a person's face included in an image before outputting the image, or to output the image without performing image processing.

(16) The moving body includes a plurality of vehicles, and the moving body travels through a plurality of stops in order, and operates such that the plurality of vehicles stop at respective prescribed stop positions at each of the plurality of stops. a function of calculating the congestion rate for each vehicle based on the image captured by the camera; The processing device may further have a function of selecting content to be displayed on the station display device arranged as a stop position for each of the prescribed stop positions.

In this way, it is possible to guide the movement of the person who is about to ride the moving object by selecting the content to be displayed on the station display device.

(17) The above-described processing device and a photographing device are provided, and the photographing device includes the camera, a housing that houses the camera, and a lens of the camera that is fixed to the housing by changing the direction of the lens of the camera. It is preferable that the system has an attitude adjustment mechanism for adjusting the posture.

In this way, the orientation of the camera can be adjusted while the housing is fixed to the moving body.

(18) The attitude adjustment mechanism has an intermediate support member rotatably supported with respect to the housing, the camera is rotatably supported with respect to the intermediate support member, and Preferably, the axis of rotation of the intermediate support member and the axis of rotation of the camera with respect to the intermediate support member are orthogonal to each other.

In this way, the posture of the camera can be adjusted with respect to each direction of at least two axes.

(19) The housing includes a support for supporting the camera and a cover for covering the camera supported by the support, and records an image taken by the camera. and an opening through which the external storage medium passes when the external storage medium is attached to the reader/writer and the external storage medium is removed from the reader/writer. It is preferable that the system has a rotatable cover that can be rotated to close the opening and to open the opening.

In this way, the external storage medium can be protected against theft by the cover and the rotary lid.

(20) It is preferable to provide a program for causing a computer to implement the functions of the processing device according to any one of (1) to (19) above.

The inventions shown in (1) to (19) above can be combined arbitrarily. For example, a configuration may be adopted in which at least part of the configuration of at least one of the following inventions (2) is added to all or part of the configuration of the invention shown in (1). In particular, the invention shown in (1) may be added with at least a part of the configuration of at least one invention after (2). Also, arbitrary configurations may be extracted from the inventions shown in (1) to (19) and the extracted configurations may be combined. The applicant of this application intends to obtain rights to inventions including these configurations.

(21) A function to acquire data of images taken by cameras respectively attached to a plurality of cars of a train, and display information about the configuration of the connection of a plurality of cars of the train and the mounting positions of the cameras in the cars. The image reproducing device may be provided with a function of displaying information on a screen and selecting a specific camera from the information displayed on the display screen, and a function of displaying an image captured by the selected camera on the display screen. .

In this way, the operator of the image reproducing device can easily select the camera that has captured the image he wants to see.

(22) a function of acquiring sensor detection information detected by a sensor installed in the vehicle and associated with data of an image captured by the camera, an image captured by the camera, and the sensor detection information; may be further provided with a function of associating and displaying on a display device.

In this way, the image captured by the camera can be associated with the sensor detection information.

(23) It is preferable to provide a program for causing a computer to implement the functions of the image display device described in (21) or (22) above.

According to the invention of the present application, an image captured inside a moving object can be utilized for content selection and content evaluation.

The effect of the invention of the present application is not limited to this, and the effect produced by the parts of the configuration disclosed in the specification, drawings, etc. is also disclosed, and the configuration that produces the effect is also acquired by divisional application, amendment, etc. have the intention to For example, in this specification, the description of "can be done" is a description that clearly shows the effect, and there are parts showing the effect even if there is no description of "can be done". Moreover, even without such a description, there is an effect that can be grasped by the configuration.

FIG. 1A is a side view of the inside of one car of a train in which a photographing device and a display device are installed, and FIG. 1B is a view showing the interior of the processing device. 1 is a diagram showing a planar layout of the interior of one car of a train in which an imaging device and a display device are mounted; FIG. FIG. 2A is a perspective view of an imaging device in which a processing device according to an embodiment is housed, and FIG. 2B is a perspective view of the imaging device with a cover removed. 3A, 3B, 3C, 3D, 3E, and 3F are a plan view, a left side view, a front view, a right side view, a bottom view, and a rear view, respectively, of the imaging device. FIG. 4 is a block diagram of a processing device according to an embodiment. FIG. 5 is a flowchart illustrating content selection functionality based on passenger attributes. FIG. 6 is a flowchart illustrating content selection functionality based on passenger actions. FIG. 7 is a flow chart showing the function of acquiring the evaluation information of the content displayed on the display device. FIG. 8 is a flow chart showing the function of performing image processing and recording. FIG. 9A is a flow chart showing a function of recording a moving image captured by a camera, and FIG. 9B is a flow chart showing a function of outputting image data. 10A and 10B are perspective views of the lock mechanism provided in the luggage storage area in the electric vehicle in the unlocked state and locked state, respectively. 11A and 11B are a front view and a plan view, respectively, of another lock mechanism provided in the baggage storage space in the electric vehicle. 12A and 12B are schematic diagrams showing a train on a track, a station display device installed on a station platform, and a queue of passengers. FIG. 13 is a perspective view of the photographing device (FIGS. 2A and 2B) according to another configuration example with the cover removed.

A processing apparatus according to an embodiment will be described with reference to FIGS. 1A to 13. FIG. The processing device according to the embodiment constitutes a photographing device housed in a common housing together with a camera. This photographing device is mounted on a train together with a display device. In this embodiment, a description will be given by exemplifying a case in which the moving object is a train car. A train car is an example of a vehicle that carries an unspecified number of passengers. In this example, the persons in the vehicle are assumed to be train passengers.

FIGS. 1A and 1B are a side view of the inside of one car of a train in which a photographing device and a display device in which processing devices are accommodated according to respective embodiments are mounted, and a plan view of the inside of one car. 1 is a diagram showing a simple layout; FIG. A plurality of doors 21 are arranged on both left and right side surfaces of a vehicle body 20 of the vehicle in the traveling direction. A display device (which may be called a vehicle digital signage) 22 and a box-shaped photographing device 23 are attached to a wall surface (called a curtain board) above the door 21 . The photographing device 23 is attached, for example, to either the left or right side of the display device 22 .

In this embodiment, three doors 21 are arranged on each side of the vehicle. The display device 22 is attached to the panel above all the doors 21 . The display device 22 is arranged at a predetermined position in the vehicle, and it is preferable that the display device 22 is arranged at a position where passengers in the vehicle can easily see the displayed image. For example, on the basis of the position of the floor of the vehicle, it may be arranged at a position higher than the height of a general person. The display device 22 may be a liquid crystal display device, an organic EL display device, or a display device having other display elements. The display device 22 is not limited to being installed on the wall surface of the vehicle, and may be implemented by, for example, a digital signage placed inside the vehicle, a hanging advertisement converted into electronic paper, or other display device.

The photographing device 23 is attached to the curtain plate on one of the left and right doors 21 arranged at the same position with respect to the traveling direction. On the wall surface on the right side of the vehicle (upper side surface in FIG. 1B), a photographing device 23 is attached above odd-numbered doors 21 . On the wall surface on the left side of the vehicle (lower wall surface in FIG. 1B), a photographing device 23 is attached above even-numbered doors 21 . By using these multiple photographing devices 23, it is possible to photograph almost the entire area inside the vehicle.

FIG. 2A is a perspective view of the imaging device 23 housing the processing device according to the embodiment, and FIG. 2B is a perspective view of the imaging device 23 with the cover removed. 3A, 3B, 3C, 3D, 3E, and 3F are a top view, a left side view, a front view, a right side view, a bottom view, and a rear view of the imaging device 23, respectively.

The supporting portion 31 and the cover 32 constitute a housing of the photographing device 23 . A camera 35 and a recording unit main body 34 are accommodated in the housing of the photographing device 23 . The recording section main body 34 is fixed to the support section 31 on the front side of the support section 31 . The recording section main body 34 covers substantially the lower half of the front side of the support section 31 . The camera 35 is located on the front side of the support section 31 and above the recording section main body 34 . The camera 35 is supported by the supporting portion 31 via the recording portion main body 34 . An electronic circuit board and the like of the processing device are accommodated in the recording section main body 34 . The support portion 31 is fixed to the wall surface of the vehicle. The cover 32 covers the camera 35 and the recording section main body 34 from the front side of the support section 31 .

The support portion 31 is made of metal, for example. The cover 32 is supported by the support portion 31 and covers the camera 35 . The cover 32 has a translucent region on the front side. This is because the cover 32 does not interfere with the photographing of the camera 35 . The translucent region is, for example, a region provided with a transparent member (for example, resin or glass) in the opening of the cover 32 . Other parts of the cover 32 are made of die-cast aluminum, for example. The camera 35 takes an image through a translucent area. The cover 32 is attached to the support 31 with Torx screws 33 . The upward facing surface of the cover 32 is inclined downward toward the front.

The camera 35 captures and generates image data representing the captured image. Camera 35 includes, for example, a CCD, CMOS, or other imager and a lens that focuses light at the location of the imager. The camera 35 has a function of capturing moving images, and preferably has a function of capturing still images. As the camera 35, a camera having a wide-angle lens is preferably used in order to photograph a wide range as much as possible. If a single camera cannot capture the entire interior of the vehicle, a plurality of cameras should be installed to eliminate blind spots within the vehicle. If a plurality of display devices 22 are arranged in the vehicle, at least one camera 35 should be arranged for each display device 22 . If it is necessary to photograph a wider range with one camera 35, a 360-degree camera such as a semi-spherical camera or an omnidirectional camera may be used.

It should be noted that if the camera 35 placed in the vehicle is directed toward the passenger, the passenger may feel uneasy as if he or she is being constantly monitored. When the camera 35 is housed in the housing, it becomes difficult for the passengers of the vehicle to recognize the orientation of the camera 35, and it is difficult to give such anxiety to the passengers.

The camera 35 is supported by the recording section main body 34 via an attitude adjustment mechanism 36 . The attitude adjustment mechanism 36 is a mechanism that changes the orientation of the lens of the camera 35 with respect to the housing of the photographing device 23 and fixes it. With the attitude adjustment mechanism 36, the orientation of the camera 35 can be adjusted while the housing is fixed to the wall surface of the train or the like.

In general, in order to increase the maximum value of the swing angle of the camera posture, it is necessary to increase the size of the housing that accommodates the camera. Conversely, if the maximum swing angle of the camera posture is too small, there may be a case where the desired range cannot be included within the angle of view of the camera with the housing fixed in the electric vehicle. For this reason, it is conceivable that the direction of the camera 35 can be changed within a range of ±10 degrees for normal use in a vehicle.

The attitude adjustment mechanism 36 includes an intermediate support member 36A. The intermediate support member 36A is here L-shaped. One side of the intermediate support member 36A extending in the horizontal direction when the photographing device 23 is viewed from the front is a plate-like portion along the upper surface of the recording unit main body 34. As shown in FIG. One side of the intermediate support member 36A extends in the horizontal direction when the photographing device 23 is viewed from the front, and is rotatably supported with respect to the housing of the photographing device 23 and the recording section main body 34 . The other side of the intermediate support member 36A is located on the left side when the photographing device 23 is viewed from the front, and is a plate-shaped portion along the left side surface of the camera 35 . The camera 35 is rotatably supported with respect to the other side of the intermediate support member 36A. The rotation axis 36B of the intermediate support member 36A with respect to the housing of the photographing device 23 and the recording unit main body 34 and the rotation axis 36C of the camera 35 with respect to the intermediate support member 36A intersect (perpendicularly in this embodiment). The rotary shaft 36B extends directly upward from the recording unit main body 34 . The rotating shaft 36C passes through the other side of the intermediate support member 36A. The rotation angles of the rotary shafts 36B and 36C can be varied between a plurality (eg, three) of scale positions and fixed at each scale position. In this manner, the camera 35 has two rotation axes with respect to the recording unit main body 34, and can rotate in two mutually intersecting directions. In this embodiment, the rotating shaft 36B is vertical (that is, up and down), and the rotating shaft 36C is horizontal (that is, left and right). In this way, the camera 35 can adjust its posture in the horizontal direction and the vertical direction.

It is preferable that the intermediate support member 36A or the housing be provided with a scale so that the degree of rotation of the camera 35 with respect to the housing from the reference posture can be visually checked. The scale should be marked, for example, in increments of 5 degrees. The orientation of the camera 35 with respect to the housing may be common to, for example, the type of vehicle in which the photographing device 23 is mounted and the mounting location. If this common posture is known in advance, it is preferable to adjust the posture of the camera 35 to the optimum position before shipment from the factory. This eliminates the need to adjust the posture of the camera 35 at the site, making it possible to improve work efficiency at the site.

FIG. 4 is a block diagram of a processing device 40 according to an embodiment. The processing device 40 includes a central processing unit (for example, CPU, hereinafter referred to as “CPU”) 41 , reader/writer 42 , storage device 43 , and image data output terminal 44 . A program executed by the CPU 41 is stored in the storage device 43 . The CPU 41 functions as control means for realizing various functions of the processing device 40 by executing this program. The storage device 43 includes a main storage device used as a work area for arithmetic processing, an auxiliary storage device exemplified by a hard disk device, and the like.

The reader/writer 42 is an SD card reader/writer that reads and writes image data and the like to/from an SD card attached to the reader/writer 42 under the control of the CPU 41 . An SD card for recording images taken by the camera 35 is attached to the reader/writer 42 . An SD card is an example of an external storage medium or removable medium. The CPU 41 outputs an image signal from the image data output terminal 44 . The operator can connect a monitor to the image data output terminal 44 and check the imaging range of the camera 35 when attaching the imaging device 23 to the wall surface of the vehicle.

The image data output terminal 44 is a terminal for outputting image data, such as an NTSC output terminal. The operator can connect an image monitor device to the image data output terminal 44 and adjust the attitude of the camera 35 while checking the current image. In order to facilitate confirmation of the current image, the image data output terminal 44 is preferably provided in front of the processing device 40 with the photographing device 23 fixed to the wall surface of the vehicle. In order to be able to see the image even while the photographing device 23 is in operation, it is preferable to pull out the cable above the housing and connect it to the image signal cable provided in the vehicle.

Image data representing an image captured by the camera 35 is input to the processing device 40 . The processing device 40 selects content to be displayed on the display device 22 based on this image data. The processing device 40 outputs information specifying the selected content (hereinafter referred to as “content type information”) to the display device 22 . The display device 22 displays video content specified by the content identification information input from the processing device 40 . The video content is assumed to be stored in the display device 22, but may be stored in the storage device 43 or another storage device. In the latter case, the processing device 40 should output the content data to the display device 22 .

The processing device 40 may be arranged, for example, in the same vehicle in which the camera 35 is arranged. It is preferable that the camera 35 and the processing device 40 are housed in the same housing and used as one piece of equipment. For example, when the display device 22 has already been installed in the vehicle by the owner of the vehicle (a railway operator in this embodiment), a device integrating the camera 35 and the processing device 40 may be retrofitted to the vehicle. Further, the display device 22 and the processing device 40 may be housed in the same housing to form one device. For example, if the camera 35 has already been installed in the vehicle by the owner of the vehicle, the vehicle may be retrofitted with a device that integrates the display device 22 and the processing device 40 .

Next, the operation of this embodiment will be described. It should be noted that the expression "the processing device 40 is" as an execution subject of control may be read as "the CPU 41 is".

[A. Content selection function based on passenger attributes]
Next, referring to FIG. 5, a content selection function based on passenger attributes will be described as one of the functions of the processing device 40 and the display device 22. FIG.

FIG. 5 is a flowchart illustrating content selection functionality based on passenger attributes. Each time the processing device 40 detects that the train has left the station, the processing shown in FIG. 5 is executed. The method of detecting that the train leaves the station does not matter. to detect that the vehicle has left the station. When the train leaves the station, the processor 40 first acquires image data from the camera 35 (step SA1).

The processing device 40 performs image analysis on the obtained image data and determines attributes of the passenger (step SA2). For the image analysis, it is preferable to use a known image analysis technique such as a technique using a neural network technique. Passenger attributes include, for example, gender and age. The processing device 40, for example, ages 0 and under 10, ages 10 and under 20, ages 20 and under 30, ages 30 and under 40, ages 40 and under 50, ages 50 and over. It is divided into eight age groups: under 60 years old, 60 to 70 years old, and 70 years old and over. The processing device 40 counts the number of men and women for each age group. The processor 40 counts the number of passengers for a total of 16 age and gender groups.

The processing device 40 selects one or a plurality of contents to be displayed from a plurality of commercial contents registered in advance in the storage device 43, for example, according to the distribution of the number of passengers for each age group and gender group ( Step SA3). The processing device 40 selects, for example, a plurality of contents that are likely to attract the interest of people of the age and sex of the largest group. The processing device 40 notifies the identification information of the selected content to the display device 22 (step SA4).

Here, the processing device 40 causes the display screen of the display device 22 to sequentially display images of a plurality of contents selected from pre-registered contents. Thus, the processing device 40 has a function of dynamically changing the content displayed on the display device 22 according to the current passenger attributes.

The content that the processing device 40 causes the display device 22 to display may be video content such as moving images and still images. In particular, it is preferable that the display device 22 displays commercial images introducing products and services of a company, company introduction images introducing the company itself, job information, and information to attract the attention of passengers. In addition, the processing device 40 may select, from a plurality of contents prepared in advance, contents that are considered to be of interest to a plurality of passengers appearing in the image, and cause the display device 22 to display the selected contents. The processing device 40 may select the content according to the attributes of the majority of the passengers appearing in the image. Passenger attributes are not limited to gender and age, and clothing and other attributes may also be used.

Since the processing device 40 discriminates the attributes of passengers each time they depart from a station, content can be selected based on the attributes of new passengers after the passengers have changed at the station. Therefore, the processing device 40 can display highly appealing content in accordance with the attributes of the passengers at the present time.

The processing device 40 selects content for each travel section between stops (in this embodiment, between stations) of the vehicle, and selects content corresponding to the travel section while the vehicle travels in the travel section. should be displayed on the display device 22 . In this way, even if the passengers of the vehicle change at the stop, it is possible to display preferable content on the display device 22 according to the current passengers.

[B. Variation of content selection function based on passenger attributes]
(B-1) The processing device 40 may adjust the time distribution of the types of content to be displayed on the display device 22 according to the ratio of the number of passengers for each attribute. For example, the processing device 40 preferably increases the display time of the content selected according to the attribute as the ratio of passengers having a certain attribute increases.

For example, if most of the passengers are women, the processing device 40 may select commercials for women, such as commercials for cosmetics and women's magazines, as the content to be displayed on the display device 22 . If the majority of the passengers are elderly, it is preferable to select commercials for the elderly, such as canes and nursing care products, as the content to be displayed on the display device 22 . If most of the passengers are wearing ties, the processing device 40 may select economic commercials as the content to be displayed on the display device 22 . If it is determined that many of the passengers like games, based on the ages of the passengers, the processing device 40 may select game commercials as content to be displayed on the display device 22 . If many of the passengers are reading a book, it is preferable to select a commercial for the book as the content to be displayed on the display device 22 . If many of the passengers are operating smartphones, the processing device 40 may select, as content to be displayed on the display device 22, smartphone app commercials, job advertisements of app production companies, and the like.

A processing device 40 causes a display device 22 to display an image of content likely to attract the interest of many passengers by means of a content selection function based on attributes of passengers, thereby enhancing the appealing effect of content for a content provider. be able to. Also, many passengers can watch content that interests them.

(B-2) If the passengers include passengers with a specific attribute, the processing device 40 may exclude the specific content from the plurality of content to be selected. For example, even if there are many female passengers, the processor 40 excludes commercials for women's underwear from content candidates to be displayed on the display device 22 when the ratio of male passengers is greater than or equal to a certain ratio. do it. Conversely, if the percentage of female passengers among the passengers is a certain percentage or higher, the processing device 40 may exclude commercials for men's underwear from the content candidates to be displayed on the display device 22 .

(B-3) The processing device 40 analyzes the image not only when the train departs from the station, but also for each content before the display of the content ends, and the passenger looking at the display device 22 should be determined.

(B-4) The processing device 40 may select content to be displayed based on the attributes of the passenger who is looking at the display device 22 . The passenger who is directing his/her line of sight to the display device 22 may be detected by analyzing the line of sight of the passenger reflected in the image. The processing device 40 extracts the passenger's face from the image captured by the camera 35, and detects the passenger who is looking at the display device 22 from the relationship between the position of the display device 22 and the orientation of the passenger's face. good. Alternatively, the processing device 40 may apply a known line-of-sight detection technique to the image captured by the camera 35 to detect a passenger who is looking at the display device 22 . The position of the display device 22 is preferably registered in the processing device 40 in advance. In this way, for example, it is possible to cause the display device 22 to display content that is likely to be of interest to passengers who are actually looking at the display device 22 . As a result, the appealing effect of the content can be further enhanced.

Information about the number of passengers viewing content is useful information for content providers and content creators to create new content. It can be said that the content that is viewed by a large number of passengers attracts the interest of the passengers and has a high appeal effect. Information on the number of passengers viewing the content may be, for example, the ratio of the number of passengers viewing the content to the total number of passengers. By using a ratio rather than an absolute number as information about the number of passengers viewing the content, the results of comparison between the information obtained when the number of passengers is large and the information obtained when the number of passengers is small become significant.

[C. Content selection function based on passenger behavior]
Next, with reference to FIG. 6, a content selection function based on a passenger's motion will be described as one of the functions of the processing device 40 and the display device 22. FIG.

FIG. 6 is a flowchart illustrating content selection functionality based on passenger actions. The processing device 40 performs the processing shown in FIG. 6 periodically, for example, every 10 seconds with a constant time interval. The processing device 40 detects the motion of each passenger by analyzing the moving image captured by the camera 35 (step SB1). The processing device 40 determines whether or not each passenger's motion corresponds to a predetermined pattern of motion (step SB2). Here, the predetermined pattern of motion indicates a pattern when a predetermined crime such as molesting, pickpocketing, etc. is being committed. If the motion of the passenger matches the motion of the predetermined pattern (step SB2; Y), the processing device 40 issues a command to the display device 22 to select and display predetermined content (step SB3). The content here is crime prevention content, and the directive includes the types of crimes suspected of being committed today. The display device 22 that has received this command displays the content. The display device 22 displays content for crime prevention according to the type of crime. For example, when an action corresponding to molestation is detected, text information such as "Molester is a crime" and "Beware of molestation" or an image for deterring molestation is displayed. In addition, when an action corresponding to pickpocketing is detected, text information "beware of pickpocketing" and an image for deterring pickpocketing are displayed. The anti-crime content displayed on the display device 22 motivates the user to quit criminal activity. In addition, moving images showing criminal acts are effective clues for identifying suspects in criminal investigations.

[D. Variation of content selection function]
(D-1) The camera 35 preferably has a pan/tilt function and a zoom function. When the motion of a predetermined pattern is detected, the processing device 40 preferably pans and tilts the location where the motion is detected, zooms in, and causes the display device 22 to display an image of the location. For example, when the camera 35 detects a criminal act such as molesting, pickpocketing, and pickpocketing, the camera 35 pans, tilts, zooms, and displays an image of the spot where the criminal act is suspected. It may be displayed on the device 22 . In addition, instead of mechanically panning and tilting, it is preferable to display an enlarged image of a portion where a criminal act is suspected on the display device 22 .

(D-2) The processing device 40 preferably selects content based on audio information picked up by a microphone (audio detection means) arranged in the vehicle in addition to the image captured by the camera 35 . For example, based on a keyword during conversation picked up by a microphone, it is preferable to display content associated with the keyword on the display device 22 .

(D-3) The processing device 40 preferably has a function of selecting content to be displayed next, based on the attributes of the passenger who is currently looking at the display device 22 . The processing device 40 may cause the display device 22 to next display, for example, content that is likely to be of interest to passengers who are currently viewing the display device 22 . The attributes of passengers and the types of content that the passengers with those attributes are likely to be interested in are preferably stored in advance in the processing device 40 . Since the content is displayed on the display device 22 by this function, the possibility that the passengers who are currently viewing the content will continue to view the next content is increased, and the appealing effect of the content to the passengers can be enhanced. When a plurality of passengers are viewing the content, the processing device 40 preferably selects the content to be displayed next by majority vote.

[E. Function to acquire information serving as basis for evaluating content and function to evaluate content]
Next, with reference to FIG. 7, a function of acquiring information (hereinafter referred to as “evaluation information”) that serves as a basis for evaluating content displayed on the display device 22 will be described. The content is commercial here, but may be other content.

FIG. 7 is a flow chart showing functions for acquiring evaluation information of content displayed on the display device 22 and evaluating the content. The processing device 40 executes the processing shown in FIG. 7 periodically, for example, at a fixed time interval, for example, every 10 seconds. The processing device 40 detects the line of sight of the passengers by analyzing the image captured by the camera 35, and counts the number of passengers who are directing their line of sight to the display device 22 (step SC1). Step SC1 is an example of processing for acquiring content evaluation information. The processing device 40 associates the type of content displayed on the display device 22 when the original image for image analysis was captured with information about the number of passengers looking at the display device 22, The information is recorded in the storage device 43 or the SD card attached to the reader/writer 42 (step SC2). The information on the number of passengers may be, for example, the ratio of passengers looking at the display device 22 to the total number of passengers.

The processing device 40 evaluates the content based on the type of content and the number of passengers viewing the display device 22 (step SC3). The content evaluation may be, for example, a process of calculating a parameter (hereinafter referred to as “evaluation value”) serving as an indicator of the interest or degree of interest of passengers in the content based on the evaluation information. The evaluation value can be, for example, the audience rating of the content. Note that the term “audience rating” is used here even when video content does not accompany audio information. For example, the evaluation value may be the average value or the maximum value of the audience rating during the period when the content to be evaluated is displayed.

The content evaluation value may be the ratio of the number of passengers who viewed the content for a predetermined time or more among the passengers in the vehicle. The content evaluation value may be the ratio of the number of passengers who have viewed the content for a predetermined time or more, among the passengers appearing in the image that is the basis of the evaluation. Alternatively, the content evaluation value may be the product of the number of passengers viewing the content and the viewing time (hereinafter referred to as "viewing amount"). For example, if two people watch the content for 15 seconds and three people watch the content for 30 seconds, the evaluation value is 2×15+3×30=120 person-seconds. Alternatively, the evaluation value of the content is the amount of viewing when it is assumed that all the passengers appearing in the image that is the basis of the evaluation are watching the content for the entire period that the content to be evaluated is displayed. It is preferable to use the percentage of the actual viewing volume.

As described above, the processing device 40 can be used as a train version audience rating checker. When the number of passengers watching the display device 22 is large, the content displayed at that time can be given a high evaluation. This evaluation result becomes useful information for new content production.

[F. Modified example of the function of acquiring information serving as the basis for evaluating content and the function of evaluating content]
(F-1) The processing device 40 acquires and records information indicating which part of the display device 22 the passengers are looking at as evaluation information instead of or in combination with the number of passengers looking at the display device 22. good. The processing device 40 may have a function of, for example, recording an image captured by the camera 35, information identifying content displayed on the display device 22, and evaluation information in association with each other. In this way, it is possible to evaluate the content in more detail based on the recorded information and utilize it in producing content with a high appealing effect. Information that serves as the basis for content evaluation includes, for example, the number of passengers viewing the content, their attributes, information about which part of the content video they are viewing, and vehicle position information when viewing the content. should be included.

(F-2) The processing device 40 may store the information identifying the content and the evaluation information in the SD card. The content can be evaluated in more detail by an external device such as a personal computer that reads the content recorded on the SD card.

Note that the processing device 40 can detect the line of sight of the passenger and determine the position viewed by the passenger based on the position of the display screen of the display device 22 and the positional relationship between the line of sight. From this evaluation information, information about which part of the video content displayed on the display device 22 is viewed by many passengers can be obtained. This information allows the content to be evaluated in more detail. This evaluation result becomes useful information for producing highly appealing contents. Thus, the evaluation basis may include, for example, the number of passengers viewing the content, the time spent viewing the content, the attributes of the passengers viewing the content, and the like.

(F-3) The processing device 40, in addition to information about the number of passengers looking at the display device 22 and information about which part of the display device 22 they are looking at, is acquired as evaluation information and recorded. From this information, it is possible to obtain information as to what kind of passengers often view what kind of content. This information can be used to produce content with a higher appealing effect.

(F-4) The processing device 40 detects temporal changes in the number of passengers looking at the display device 22, changes in the content displayed on the display device 22, and changes in the position of the vehicle. It is preferable to have a function to display on the display screen even with the change. It is even better if the processing unit 40 has the capability to display, for each position in the video of the content, the change over time in the number of passengers viewing that position. With this information, it is possible to analyze what caused the passenger to stop watching the content. It is possible to know whether the reason why the user has stopped viewing the content is, for example, that the vehicle is approaching the stop and the passengers are preparing to get off, or that the content has changed. A decrease in the number of passengers viewing content in the absence of external factors means a decrease in the number of passengers interested in that content.

(F-5) The processing device 40 preferably has a function of recording the position in the vehicle of the passenger looking at the display device 22 . Based on the recorded information, it is possible to know which position in the vehicle the passengers often view the content. This information is useful information for considering a preferable installation location of the display device 22 that displays the content.

(F-6) The processing device 40 determines which contents (for example, commercials) are frequently viewed by passengers with what attributes in which vehicle in which position (for example, between stations) in which time period the train is traveling. It is preferable to have a function to acquire the information necessary for analyzing the amount. The processing device 40 can optimize the content to be displayed based on this analysis result.

(F-7) The processing device 40 has a function of acquiring information that enables the same analysis to be performed on the passengers watching the advertisements hanging in the train in addition to the content displayed on the display device 22. Good to have.

For example, a processing device (for example, a computer) that displays an advertisement on the display device 22 and a processing device of the photographing device 23 are communicably connected. The processing device of the display device 22 outputs a signal indicating advertisement identification information (hereinafter referred to as "advertisement ID") to the processing device of the photographing device 23 at the start of display of each advertisement, and the processing device of the photographing device 23 is a camera 35 (hereinafter referred to as “camera image” in this modification) data, and recorded so that the display start time and end time of the advertisement with the advertisement ID can be known. For example, it is preferable to record the advertisement ID in association with the camera image assuming that the video content of the advertisement ID is being displayed on the display device 22 from the reception of a certain advertisement ID to the reception of the next advertisement ID. . Also, for example, the image signal of the video content being displayed on the display device 22 may be input to the processing device of the photographing device 23, and this processing device may record the video data of the video content together with the data of the camera image.

As a method of recording the video data of the video content being displayed on the display device 22 together with the camera image, it is preferable to record the camera image and the video content with time information so that they can be reproduced at the same time as the camera image. . Also, as a method of recording the video data of the video content being displayed on the display device 22 together with the camera image, the video content being displayed on the display device 22 is superimposed on the camera image (for example, inserted like a wipe). It is advisable to record it.

The processing device 40 preferably extracts and records only the images of the period when the passenger who was watching the advertisement is recorded later, or records them so that they can be browsed. For example, it is preferable to record information, such as a flag, that identifies the image during the period when the passenger is watching the advertisement. Information to the effect that notification information (also referred to as guidance information) was being displayed instead of the advertisement ID when guidance such as "next XX station" is displayed instead of advertisement, preferably notification information A unique notification information ID may be recorded for each. It is good to record so that it is possible to identify the position between which stations, which car of which train, and which number.

(F-8) In addition to the evaluation information, the processing device 40 may record the video content displayed on the display device 22 at that time as image data. With this information, it is possible to easily grasp what many passengers are watching in the video content.

(F-9) The processing device 40 has a function of detecting the position in the display device 22 to which the passenger is looking, and recording the image of the content displayed on the display device 22 in association with the position. Good to have.

In this way, based on the recorded information, it is possible to know which position in the video content the passenger is looking at. For example, it is possible to acquire information as to whether the viewer is looking at the product in the video of the content or whether he is looking at the entertainer appearing. Based on this information, a more detailed evaluation of the content can be made. For example, this information can be used as useful information for producing content with high product appeal. From the recorded information, it is possible to easily identify specific points of interest within the video content, and what kind of passengers riding in which position in the video content were looking at which position in the video content at what point in time. It is a good idea to record the necessary information so that it can be analyzed later.

A device that reads the recorded information, for example, a personal computer in which a viewer is installed, displays the image of the content, and various information when the image is displayed on the display device 22 in the vehicle, for example, the passenger viewing the content. It is preferable to have a function of simultaneously displaying on the display screen together with information such as the number, time, location where the vehicle is traveling, attributes of passengers viewing the content, and the like. As a result, it is possible to intuitively grasp what kind of content is frequently viewed by what kind of passengers.

(F-10) The device that has read the recorded information should display the passenger who is looking at the video content such as the advertisement in a display mode different from that of the other passengers. For example, it is preferable to detect the position of the face of the passenger who is watching the video content and display the face of the passenger surrounded by a red circle. When multiple people are watching the video content, it is preferable to display the faces of the multiple people by surrounding them with circles of different colors.

The device that has read the recorded information should display the video content to which the line of sight is directed, clearly indicating the position to which the line of sight is directed (for example, by attaching a red circle symbol). To explain the case of using a red symbol as an explicit method, when multiple people are watching, a circle symbol displayed at the position where the line of sight is directed in the video of the content and the passenger who is looking at that position should be the same color as the circle symbol that surrounds the face of By displaying in this way, it is possible to show attention to the content video such as where in the content video the passengers marked with circles were looking, for example, whether they were watching the talent or the product. ) can be easily analyzed where it was directed. If a plurality of circle symbols with different colors are displayed at positions close to the product, it can be determined that the product attracts a lot of attention. If a plurality of circle symbols with different colors are displayed at positions close to the talent, it can be determined that the talent is getting a lot of attention. Also, it is possible to easily analyze the temporal transition of the position of interest in the video of the content. It should be noted that it is preferable to display content targeting passengers who are looking at the image of the content next.

(F-11) The processing device 40 preferably has a function of recording information necessary for analyzing the relationship between the boarding/alighting status of passengers and video content. Based on the information recorded by this function, it is possible to analyze the relationship between the boarding and alighting states of passengers, such as opening and closing of doors, and video content.

(F-12) The processing device 40 may not perform at least one of the process of recording the advertisement ID together with the camera image and the process of detecting the line of sight of the passenger during boarding and alighting. Alternatively, the processing device 40 may execute at least one of these processes and record information for identifying the period during boarding and alighting. For example, based on detection of door opening/closing, detection of station arrival/departure announcements, and detection of display of guidance information informing that the door is open on the display device 22, the present time is the period during boarding and alighting. The processing unit 40 may determine that there is. It is preferable that the processing device 40 records the period during which it is determined that the vehicle is getting on and off, together with the advertisement ID so that the period can be specified.

(F-13) The processing device 40 displays the image of the content and the image of the inside of the vehicle side by side on the display screen so that the passenger of the vehicle and the position in the image of the content viewed by the passenger are associated with each other. It is preferable to have a function to display so that it can be done. For example, a mark of the same color may be displayed at the position of the passenger's face in the vehicle and at the position in the image of the content viewed by the passenger. As a result, it is possible to intuitively grasp which passenger is viewing which part of the video of the content.

When the image of the content is being displayed, the processing device 40 may display the mark at the location where each of the multiple passengers is looking in the image. Since the distribution density of the marks is high in the places where many passengers are watching, it is possible to know which part in the video of the content attracted the interest of the passengers more.

(F-14) When the display device 22 has a plurality of display screens, the processing device 40 preferably has a function of detecting which display screen the passenger is looking at and recording the detection result. Based on the information recorded by this function, it is possible to easily analyze which of the plurality of display screens the passenger is viewing. When a passenger in the range photographed by one camera 35 can see a plurality of display screens, it is preferable to perform the same processing as when one display screen is arranged for each of the plurality of display screens. For example, when two display screens are arranged above one door and one camera 35 is arranged next to it, information indicating which passenger was viewing which display screen with the camera 35. should be recorded.

When one content is displayed across a plurality of display screens, the processing device 40 preferably has a function of detecting which display screen the passenger is looking at. The information obtained by this function is useful information for finding a highly appealing display method when one content is displayed on a plurality of screens.

(F-15) The processing device 40 further includes, as evaluation information, the current time when the content is being displayed, the position of the vehicle, the time when the passenger boarded and the stop information, and the attributes of the passenger viewing the content. You should get at least one of By including these pieces of information in the basis of content evaluation, it becomes possible to perform a more detailed evaluation of the content.

The processor 40 can, for example, obtain information when the passenger begins to look at the display 22 . For example, it is possible to obtain information about how many minutes have passed since the passenger got on the vehicle and how many stations the passenger has passed since the passenger got on the vehicle when the passenger started viewing the content. For example, it is possible to obtain information that the user was operating a smartphone immediately after boarding the train, but started viewing content after passing through two stations. It is possible to obtain information as to what kind of content a passenger with what kind of attribute was viewing. Attributes of the passengers viewing the content may include, for example, sex, age, and facial expressions (for example, whether they are smiling or angry). These pieces of information may be obtained, for example, at fixed time intervals (for example, 1 second). Since these pieces of information do not necessarily need to be obtained in real time, the images captured by the camera 35 are recorded as image data on a recording medium, and the image data recorded on the recording medium are read out to obtain these pieces of information. do it.

In addition, since the processing device 40 has a function of detecting the number of people in the vehicle and the line of sight of the passengers based on the image captured by the camera 35, the direction of the line of sight of the passenger looking at the display device 22, and From the information on the installation location of the display screen of the display device 22, it is possible to obtain information about which part of the screen of the display device 22 the passenger is looking at. Based on the video content displayed on the display device 22 at the time when the image captured by the camera 35 was acquired and the position where the passenger's line of sight was directed in the display screen, which position in the video content is the line of sight? You can know if you are facing For example, it is possible to acquire information as to whether the viewer is viewing a product in the video content or whether the viewer is viewing an actor appearing in the video content. Based on this information, a more detailed evaluation of the content can be made. For example, this information can be used as useful information for producing content with high product appeal.

[G. Function to perform image processing and record]
Next, referring to FIG. 8, the function of performing image processing and recording will be described.
FIG. 8 is a flow chart showing the function of performing image processing and recording. The processing device 40 repeatedly executes the processing shown in FIG. 8 during the period from when the power is turned on until it is turned off. The processing device 40 acquires a moving image captured by the camera 35 (step SD1). After that, the processing device 40 records the moving image obtained by performing the image processing on the designated area in the moving image in the SD card attached to the reader/writer 42 .

The predetermined area to be image-processed may be stored in the storage device 43 in advance. The processing device 40 reads out information specifying an area to be subjected to image processing from the storage device 43, and performs image processing on the moving image (step SD2). When an area including the passenger's face is specified as an area to be subjected to image processing, the processor 40 detects the passenger's face from the moving image and blurs the face. When a specific area within the screen of the moving image is specified as the area to be subjected to image processing, the specified specific area is clipped.

By blurring the faces of passengers in the images and recording them, the risk of being accused of violating privacy is reduced. Also, by clipping the specified specific area, the amount of image data can be reduced. For example, as a clipping area, it is preferable to designate an area such as the ceiling where passengers are not reflected. As a result, even if the amount of data is reduced, it is possible to secure the necessary amount of information about passengers. The predetermined image processing applied to the passenger's face may be an image processing that hinders the visibility or recognition of the passenger's face.

Images captured by the camera 35 inside the vehicle may infringe on the privacy of individuals, so it is desirable to store them strictly so that general people cannot access them. Applying image processing that hinders visibility or recognition of the designated area, and using the function to record it on a recording medium, and applying image processing that makes it impossible to identify an individual, is highly likely to infringe on individual privacy. Information is no longer recorded on the recording medium.

The "specified area" may be, for example, an area in which the passenger's face is shown. For example, clipping, blurring, resolution reduction, or the like may be employed as the image processing that hinders visual recognition or recognition of the designated area. Alternatively, although the passenger in the image cannot be specified, the face should be abstracted and recorded so that the sex and age can be known.

The "specified area" may be an area in which passengers are not included. For example, it is preferable to specify the ceiling portion or wall portion of the vehicle. If processing such as clipping, blurring, and resolution reduction is performed on this area, the amount of image data can be reduced without reducing the amount of information about the passenger.

Cameras are often placed higher than normal passenger line of sight. In this case, if there is a place in the image that makes the passenger in the image extremely embarrassing or makes the passenger in the image feel uneasy, such as underwear or the body that is hidden by normal clothes, It is preferable to specify a location and apply the above image processing to that area.

[H. Function to perform image processing and output image data]
Next, with reference to FIGS. 9A and 9B, the function of performing image processing and outputting image data will be described.

FIG. 9A is a flow chart showing the function of recording a moving image captured by the camera 35. FIG. The processing device 40 constantly executes the processing shown in FIG. 9A during the period from when the power is turned on until it is turned off. The processing device 40 acquires a moving image captured by the camera 35 (step SE1). After that, the acquired moving image is recorded in the SD card attached to the reader/writer 42 .

FIG. 9B is a flow chart showing the function of outputting image data. In step SE2 (FIG. 9A), an information terminal such as a personal computer to which the SD card in which the moving image is recorded executes the processing shown in FIG. 9B. The processing device of the information terminal has a function of accepting an image data output command, a function of accepting an instruction as to whether or not to apply image processing to a moving image to be output, and a function of accepting an instruction specifying an object to be subjected to image processing. . When the operator inputs an image data output command to the information terminal, the processing device of the information terminal executes the process of FIG. 9B. Although illustration of the hardware configuration of the processing device of the information terminal is omitted, the configuration may be the same as that of a general personal computer. That is, the processing device of the information terminal has an arithmetic processing device exemplified by a CPU, a memory, an operation device, an external storage medium interface, a communication module, and an auxiliary storage device. The memory is used as a work area for arithmetic processing. The operating device accepts a user's operation. A keyboard, a pointing device, or the like, for example, is used as the operating device. The external storage medium interface is for loading an external storage medium such as an SD card. The communication module is for communicating (eg, wired or wireless) with an external device. A hard disk device, for example, is used as the auxiliary storage device, and programs, viewers, and other data are stored. The arithmetic processing unit reads a program and other data into a memory and performs various arithmetic processing according to the program.

Based on the input command, the processing device of the information terminal determines whether or not to apply image processing to the image data to be output (step SE5). If image processing is to be performed (step SE5; Y), image data is read from the SD card and image processing is performed (step SE6). The predetermined image processing applied to the passenger's face may be image processing that interferes with visual recognition or recognition of the passenger's face. After that, the image data subjected to the image processing is output (step SE7). If no image processing is to be performed (step SE5; N), the image data read from the SD card is output as is (step SE7). The output of the image data is performed by writing to another SD card, transmission to other equipment via a communication network such as a wired LAN or wireless LAN, or the like.

Image data that has been subjected to image processing with the subject of image processing set to an area in which the passenger's face is reflected is less likely to infringe on privacy. Image data that has not undergone image processing becomes useful information for solving cases such as crimes that have occurred in vehicles and troubles that have occurred among passengers. For example, facial recognition technology can be used to locate wanted criminals and suspects.

[I. Modified example of the function of performing image processing and outputting image data]
(I-1) The processing device 40 has a function of recording an image captured by the camera 35 in a recording device, reads out the image recorded in the recording device, and performs predetermined image processing on the passenger's face. , or a function of selectively outputting image data that has not been subjected to the predetermined image processing.

By recording the images captured by the camera 35 in a recording device, the recorded images can be effectively used by public investigative agencies such as the police to solve incidents such as crimes that have occurred in the vehicle. becomes possible. By outputting image data obtained by subjecting the passenger's face to predetermined image processing, it is possible to provide an image that is less likely to infringe on individual privacy. Image data that has not undergone image processing becomes useful information for solving incidents occurring in the vehicle. For example, it becomes useful information for resolving crimes such as molestation, pickpocketing, and pickpocketing that occur in the vehicle.

The predetermined image processing to be applied to the face of the passenger may be image processing that hinders the visual recognition or recognition of the passenger's face, for example, processing that prevents the individual from being identified from the image of the face. For example, clipping processing, blurring insertion, resolution reduction, and the like may be performed.

As a function to output image data, in addition to outputting image data from the image output terminal, it has functions such as outputting image data via wireless LAN and writing image data to external storage media such as external storage media. Good. When the image data is output from the image output terminal, it is preferable to perform the predetermined image processing. In the case of outputting image data via a wireless LAN, it is preferable to specify whether or not to perform predetermined image processing depending on the attribute of the destination. For example, when the transmission destination is an investigative agency such as the police, which is considered to protect the confidentiality of information, it is preferable not to perform the predetermined image processing. The processing device preferably has a function of registering a list of destinations for transmission without image processing.

(I-2) Regarding (I-1), it is preferable that the processing device 40 has a function of designating an object or range to be subjected to image processing in the image. For example, a passenger's face or the like may be designated as an object for image processing. As the range of image processing, for example, a specific area or the entire area within the screen of the image may be specified.

(I-3) When the processing device 40 records the image data on the external storage medium without image processing, it is preferable to record the image data in a format that requires a password to read the recorded image data. Alternatively, if you record image data on an external storage medium without performing image processing, format the external storage medium in a special format so that the image data on the external storage medium cannot be read by a general reading application. do it. This prevents the image data from being read out by an unspecified person.

When recording image data without a password on an external storage medium formatted in a general format, the processing device 40 may automatically perform predetermined image processing. This makes it possible to protect individual privacy.

As a recording device for recording the image captured by the camera 35, for example, an external storage medium and its reader/writer may be used. It is preferable to provide a viewer that reproduces images recorded in an external storage medium on a terminal such as a personal computer.

[J. Passenger moving route detection function]
Next, the passenger moving route detection function will be described.
The processing device of the information terminal has a function of designating a specific passenger from the passengers appearing in the image recorded on the SD card. When the processing device of the information terminal detects that a specific passenger has been designated, the processing device of the information terminal analyzes the image data read from the SD card and searches for the designated specific passenger. When a particular passenger is detected, the moving image is advanced in time to detect the passenger's movement path within and between vehicles. The detected moving route is displayed as an image on the display screen of the information terminal. Based on the image captured by the camera 35, the processing device detects the moving route in the vehicle from the time of boarding to the time of getting off for each passenger who has boarded the vehicle, and obtains the information of the boarding point and the information of the vehicle. It also has a function to record the detection result of the movement route inside and the information of the drop-off point.

With this function, it is possible to obtain information on which station a particular passenger of the train boarded, how they moved within and between the cars, where they stood or sat, and at which station they got off. can be done. A camera 35 may be arranged in each car of a train including a plurality of cars, and the above information may be recorded for each car. In addition, the processing device may have a function to display the image captured by the camera 35 and designate a specific passenger from the image. Once a particular passenger has been designated, the processor may be capable of detecting and displaying the route of movement within and between vehicles from the time the designated passenger enters the vehicle to the time the designated passenger exits the vehicle. This information can be effectively used for planning the number of vehicles, operation plans of trains, designing station platforms, and the like. Furthermore, when there is a large variation in the congestion rate of each vehicle, it can be used as useful information for devising measures to guide passengers to relatively empty vehicles based on the travel routes of passengers within the vehicle.

[K. Function of displaying an image captured by the camera 35 on the display device 22 in the vehicle]
Next, a function for displaying an image captured by the camera 35 on the display device 22 in the vehicle will be described.
The processing device 40 has a function of causing the display device 22 to display an image captured by the camera 35 or an image obtained by processing the image, instead of or in combination with the process of displaying content on the display device 22 . In addition, the processing device 40 allows the operator to issue a command (for example, a command) as to whether to display the image captured by the camera 35 as it is or to display a processed image, and in the case of processing, what kind of processing is to be performed. It has a function to ask for and input.

When the processing device 40 receives a command to display the image captured by the camera 35 as it is, the processing device 40 displays the image captured by the camera 35 on the display device 22 almost in real time. When receiving a command to process and display an image captured by the camera 35, the processing device 40 processes the image captured by the camera 35 according to the command, and displays the image on a display device almost in real time. 22.

Passengers on the train are worried about how they are being photographed by the camera 35 in the train car. By displaying the actually captured image on the display device 22 in the electric vehicle, the passenger can confirm how he or she is being captured, thereby alleviating anxiety. Displaying an image obtained by processing an actually shot image can provide various additional effects as compared with displaying the image as it is.

The display device 22 for displaying the image captured by the camera 35 may be the display device 22 arranged near the camera 35 . In particular, it is preferable to display the information on the display device 22 at a position where the passenger can see the range captured by the camera 35 .

As image processing, it is preferable to replace the area (background) other than the passenger with another image instead of the image inside the electric vehicle. In particular, it is preferable to display on the screen of the display device 22 a situation that cannot occur in reality. For example, if an image of a pond in which carp are swimming is taken from above as a background, a situation in which passengers are standing on the pond is virtually reproduced. This is expected to reduce the anxiety of passengers that they are being photographed. Furthermore, if there is a child among the passengers, it is preferable to display an image that the child would be interested in and likely to enjoy on the screen of the display device 22 beside the child. For example, an animated image of a popular character may be displayed next to the child on the display screen. This can make the child feel happy.

It is preferable to alternately display the image captured by the camera 35 in the train and the video content prepared in advance, for example, at a constant cycle. Thereby, the image in the electric vehicle and the video content can be displayed on the single display device 22 .

As a modification, a display device 22 corresponding to each vehicle may be installed in the crew cabin so that the crew can check the state of the passengers in the vehicle in real time. The crew can easily grasp the degree of congestion for each vehicle. By grasping the degree of congestion, it is possible to play an announcement to guide passengers to a relatively empty vehicle.

When there is an item left behind on a rack in the vehicle, the crew can easily check the presence or absence of the item by looking at the image. As a result, it is possible to shorten the time for collecting left-behind items at the station.

[L. Baggage theft deterrence function in the electric car]
Next, with reference to FIGS. 10A and 10B, the baggage theft deterrent function in the electric vehicle will be described. The baggage theft deterrence function is a function for setting the lock mechanism to either a locked state or an unlocked state based on the features of the passenger who visited the baggage area in the image captured by the camera 35 .

10A and 10B are perspective views of the lock mechanism provided in the luggage storage area in the electric vehicle in the unlocked state and locked state, respectively. The locking mechanism includes two bars 55,56. In the unlocked state (FIG. 10A), a gap is provided between the two bars 55,56. Therefore, one bar 55 can be passed through the handle 51 of the baggage 50 such as a suitcase. In the locked state (FIG. 10B), the handles 51 of the load 50 cannot be removed from the bars 55, 56 due to the two bars 55, 56 forming a closed loop. The luggage storage area is arranged within the angle of view of the camera 35 inside the vehicle. Therefore, the owner of the luggage 50 is photographed by the camera 35 while the owner of the luggage 50 is operating the lock mechanism.

The owner who intends to put the luggage 50 in the luggage storage place puts the bar 55 through the handle 51 of the luggage 50, and then operates the bars 55 and 56 to make the closed loop state. When the locking mechanism detects that the bars 55, 56 have been placed in the closed loop state, it transitions to the locked state. The processing device 40 has a function of detecting that the lock mechanism has transitioned to the locked state.

When the processor 40 detects that the lock mechanism has been locked, the processor 40 analyzes the image taken by the camera 35 to detect the passenger who put the luggage 50 in the luggage storage area, and identifies the passenger by face recognition technology. , the storage location where the baggage 50 is placed and the information specifying the passenger (owner) who put the baggage are stored in association with each other.

The processing device 40 analyzes the image captured by the camera 35 and performs face recognition of passengers near the luggage storage location. When the processing unit 40 detects that a passenger associated with the storage location is in the vicinity of the storage location, the processing device 40 unlocks the locking mechanism of the storage location. This allows the owner of the luggage to take out his/her luggage from the storage location.

If the owner of package 50 is not detected in the vicinity of the storage location, processor 40 keeps the locking mechanism locked. Therefore, it is possible to deter theft of luggage. Passengers who have put their luggage in the luggage storage do not need to carry the key of the lock mechanism with them, so they do not have to worry about losing the key. In addition, since passengers do not need to perform opening and closing operations with a key, convenience is enhanced.

11A and 11B are a front view and a plan view, respectively, of another lock mechanism provided in the baggage storage space in the electric vehicle. A luggage storage area is partitioned into a plurality of storage locations 60 by partition plates 61. - 特許庁A swing door 62 is provided for each storage location 60 . In the unlocked state, the swing door 62 can be freely opened and closed, and in the locked state, the swing door 62 remains closed and cannot be opened. A lock button 63 is provided for each storage location 60 .

The owner of the cargo 50 opens the swing door 62, stores the cargo 50 in the storage place 60, and presses the lock button 63. - 特許庁The processing device 40 has a function of detecting that the lock button 63 has been pressed. Upon detecting that the lock button 63 has been pressed, the processing device 40 identifies the passenger in front of the storage location 60 by facial recognition technology. The processing device 40 associates and stores the storage location where the luggage 50 is placed and the information specifying the specified passenger (owner). After locking, when the processor 40 detects that the owner of the package is in the vicinity of the storage location, it unlocks the lock mechanism of the storage location. Even if the lock mechanism shown in FIGS. 11A and 11B is used, the same effect as when the lock mechanism shown in FIGS. 10A and 10B is employed can be obtained.

After unlocking the locking mechanism, the processing device 40 may have a function of re-locking if the package is not removed from the storage area within a certain period of time. When the owner of the luggage is detected and unlocked just by passing in front of the storage place, the processor 40 unlocks again, so that the luggage can be safely stored.

This feature makes it less likely that your luggage will be stolen. The luggage storage area may be located anywhere in the electric vehicle, and may be provided in the cabin or on the deck. The baggage area should be located out of sight of passengers when they are seated in the vehicle. Even if luggage is placed out of sight of passengers, theft prevention effect can be obtained, so the effect of the above function is further enhanced. In addition, by providing a luggage storage area away from the seats, the degree of freedom in the layout of seats, luggage storage areas, entrances and exits, etc. in the vehicle is increased.

Passengers who have put their luggage in the luggage storage do not need to carry the key of the lock mechanism with them, so they do not have to worry about losing the key. In addition, since passengers do not need to perform opening and closing operations with a key, convenience is enhanced.

[M. Modified Example of Baggage Theft Deterrence Function in Electric Vehicle]
(M-1) The luggage storage area may be a space inside the vehicle. The luggage storage space may be the space between the rearmost seat of a vehicle such as a Shinkansen and the wall behind it. The processing device 40 preferably performs the above-described processing for a passenger who uses a specific seat among the seats in the vehicle as the owner of the luggage. The processor 40 may determine that the passenger occupying the last seat of the vehicle is the owner of the luggage.

(M-2) The configuration of the lock mechanism is not limited to the above, but it is not necessarily a mechanism such as a locker or a safe that stores luggage in a sealed space so that a third party cannot take out the luggage. It is better to For example, it is preferable to employ a mechanism as the lock mechanism that allows the owner of the baggage or a third party to visually recognize the baggage placed in the baggage storage area, but does not allow the baggage to be easily removed from the baggage storage area. For example, it is preferable to equip the baggage area with a bar that can be passed through a handle of baggage (for example, a suitcase). A locking mechanism may be provided to prevent the handle from being removed from the bar once the bar is passed through the handle of the package and the bar is locked. Alternatively, a swing door may be provided between the aisle and the baggage storage area, and a mechanism that prevents the swing door from opening in the locked state may be employed as the lock mechanism. The upper part of the storage area is open, and it is possible to take out the luggage through the upper part of the swing door, but the effect of deterring theft of the luggage can be expected.

(M-3) When the owner of the parcel places the parcel in the parcel storage area and locks the lock mechanism, the processing device 40 detects that it has been locked. From the image of the passenger standing on the floor, it is preferable to associate the luggage with the owner and store it. Identification of the owner of the parcel may be performed using, for example, face recognition technology. When a person stands in front of the luggage storage area in the locked state, the processing device 40 determines whether the passenger standing in front of the storage area is the owner of the stored luggage based on the person's image. is determined, and if the owner of the stored luggage is the owner, the locking mechanism should be unlocked.

(M-4) The processing device 40 detects passengers standing in front of the storage area who turn their eyes to a specific location, for example, the installation location of the camera 35, and determines whether or not the passenger is the owner of the luggage. It is preferable to have a function to determine whether Alternatively, by analyzing the image captured by the camera 35, the processing device has a function of unlocking the lock mechanism when it is detected that the owner standing in front of the luggage storage area has started to take out the luggage. 40 should have. With this feature, it is possible to avoid accidental unlocking when the owner of the package passes by the storage area for purposes other than retrieving the package.

(M-5) The processing device 40 is provided with a notification device at the storage location, and when the lock mechanism switches from the locked state to the unlocked state and at the time when the unlocked state switches to the locked state, the notification device It would be even better to have a function to inform the owner that the locking mechanism is locked and unlocked. As the notification device, for example, a device that allows the owner of the package to notice the change of state by sight or hearing, for example, a light emitting device such as an LED, a sounding device such as a speaker, or the like may be used. This allows the owner of the luggage to confirm that the locking mechanism has been locked when the luggage is placed in the luggage storage area. In addition, it is possible to confirm that the lock mechanism has been unlocked before taking out the luggage.

(M-6) The processing device 40 preferably has a function of locking the lock mechanism again if the package is not removed from the storage area after a certain period of time has elapsed after the lock mechanism has been unlocked. If the owner of the luggage is detected and unlocked just by passing in front of the storage area, the luggage can be safely stored by unlocking again.

[N. Function to display contents on the display device of the station]
Next, with reference to FIGS. 12A and 12B, the function of displaying content on the station display device will be described.

12A and 12B are schematic diagrams showing a train 70 on a track, a station display device 72 installed on a station platform 71, and a row of passengers 75. FIG. A train 70 includes six coupled cars. The train 70 passes through a plurality of stations in order, and operates such that at each of the plurality of stations, a plurality of vehicles stop at prescribed stop positions on the platform 71 .

A station display device 72 is installed at each stop position of the door of each car on the platform 71 of the station. Passengers lined up at the stop position of the door can see the video content displayed on the station display device 72 . The processing device 73 of the station display device 72 selects content to be displayed on the station display device 72 at each stop position.

Each vehicle of the train 70 is equipped with a photographing device 23 . The processing device of the photographing device 23 has a function of analyzing the image photographed by the camera 35, counting the number of passengers, and calculating the congestion rate of each vehicle. The processing device of the photographing device 23 transmits information on the calculated congestion rate for each vehicle to the processing device 73 installed at the station. For this transmission, a public line including a wireless transmission line, a dedicated line, or the like is used. The congestion rate is classified, for example, into four levels of "empty", "normal", "congested", and "full".

Based on the received information indicating the congestion rate of each vehicle, the station processing device 73 selects, for each stop position, content to be displayed on the station display device 72 arranged corresponding to the stop position from a plurality of contents. It has the function to The processing device 73 displays content that makes passengers want to move from a relatively crowded vehicle stop position to a relatively empty vehicle stop position, that is, content that is likely to attract the interest of passengers.

FIG. 12A shows an example row of passengers 75 before displaying the selected content, and FIG. 12B shows an example row of passengers 75 while displaying the selected content. Passengers 75 move to stops where interesting content is displayed, resulting in longer queues of passengers 75 lining up at relatively empty vehicle stops. As a result, for example, only a specific vehicle near an escalator is congested, and the front and rear vehicles are not busy, and the congestion rate among vehicles can be leveled.

As a modification, the station processing device 73 may cause the station display device 72 at each stop position to display the congestion level of the vehicle in question and the congestion levels of other vehicles.

The imaging device 23 preferably has a function of transferring information representing the degree of congestion of each vehicle to the server. The server preferably has a function that allows passengers to access information representing the degree of congestion in real time using a personal digital assistant such as a smart phone. Furthermore, the server should have a function of providing information representing past congestion levels. Train users can refer to past congestion levels to determine commuting hours and vehicles to use.

By appropriately selecting content to be displayed on the station display device 72, it is possible to guide passengers to a stop position corresponding to a relatively empty vehicle. This makes it possible to level the congestion rate. A train including a plurality of vehicles includes, for example, an electric train, a monorail, a linear motor car, and the like.

For example, the processing device may calculate the congestion rate based on the image captured by the camera 35 arranged in each vehicle each time the vehicle departs from a station (in this case, a station). A processing device mounted on the vehicle obtains the congestion rate, transmits the result to the station display device 72 installed at the next stop station by wireless communication, and the processing device of the station display device 72 receives the congestion rate. It is preferable to display the content according to the rate. For example, the station display device 72 for each stop position may display information representing the congestion rate of vehicles stopping at that position, the level of congestion, etc., in numbers, colors, graphics, and the like.

A position where a relatively unoccupied vehicle stops by displaying content that easily attracts the interest of passengers on a station display device 72 arranged at a position where an unoccupied vehicle such as a train that arrives next stops. Passengers should be guided to For example, if there are many children among the passengers waiting for the next train or the like, it is preferable to use an image of a popular character that is likely to attract the interest of children as the content that is likely to attract the interest of the passengers. A boring commercial image is displayed on the station display device 72 at the position where the crowded car stops, and a popular idol appears on the station display device 72 at the position where the empty car stops. It is preferable that the processing device has a function of displaying commercial images.

The processing device analyzes the number of passengers, their attributes, whether or not they have luggage, etc., based on the image of the passengers lined up on the platform of the station, and displays them on the station display device 72 based on the analysis results. It is preferable to have a function to change the content to be displayed. For example, based on the attributes of the passengers lined up at the position where the crowded vehicle stops, content that is likely to be of interest to the passengers is selected, and displayed on the station display device 72 at the stop position of the crowded vehicle. It is preferable to display a message notifying that the content that the passengers are likely to be interested in is being displayed on the station display device 72 at the stop position of the OOth car. As a result, the effect of guiding the passenger to the stop position of the vacant vehicle can be enhanced. Alternatively, a short image with a story is displayed on the station display device 72 at the stop position of the crowded vehicle, and "The continuation will be displayed on the station display device 72 at the stop position of the XXth car." It is preferable that the processing device has a function of displaying a message such as As a result, passengers can be guided from the stop position of the crowded vehicle to another stop position.

A display device is placed at the bus stop of the route bus, and when a crowded bus stops at the bus stop and the next bus is relatively empty, the passengers are informed that the next bus is empty, and the next bus is The processing device may be capable of causing the display device to display content that motivates the passenger to wait. For example, the processing device has the ability to notify passengers waiting at a bus stop of the estimated time until the next bus arrives, the number of empty seats on the next bus, and the content to be displayed on a display device within the vehicle of the next bus. do it. On the next bus, it would be nice to display content that might be of interest to passengers waiting at the bus stop. For example, if there are many junior high and high school students waiting at the bus stop, it would be better to display a message on the display device of the bus stop saying that the next bus will display the expected questions and answers for the test. .

[O. Another configuration example of the imaging device 23]
(O-1) FIG. 13 is a perspective view of the photographing device 23 (FIGS. 2A and 2B) according to another configuration example with the cover removed. In the following, differences from the photographing device 23 shown in FIGS. 2A and 2B will be mainly described.

An opening 37 is provided in the housing of the imaging device 23 . In this configuration example, an opening 37 is provided on the side surface of the recording unit main body 34 . The opening 37 is a portion through which the external storage medium passes when the external storage medium is attached to the reader/writer 42 and when the external storage medium is removed from the reader/writer 42 . An SD card is inserted through the opening 37 into the reader/writer 42 (FIG. 4) arranged in the recording unit main body 34 . A rotary lid 38 is rotatably attached to the recording unit body 34 . By rotating the rotary lid 38, a state in which the opening 37 is closed and a state in which the opening 37 is opened are realized.

The inserting/removing direction of the SD card is parallel to the circuit board accommodated in the recording section main body 34 . This circuit board is substantially parallel to the wall surface of the train when the imaging device 23 is attached to the wall surface of the train. Therefore, the inserting/removing direction of the SD card is also parallel to the wall surface of the train. A label for identifying the card is attached to the SD card. The reader/writer 42 is arranged so that the label surface faces the front when the SD card is taken out from the recording unit main body 34 .

The rotation axis of the rotary lid 38 is parallel to the opening surface of the opening 37 (for example, perpendicular to the SD card when inserting and removing the SD card), and in a plane parallel to the wall surface of the train. The lid rotates. With the housing attached to the wall surface of the vehicle, the rotation axis of the rotary lid 38 should be parallel to the wall surface. With such a structure, the rotary lid 38 rotates in a plane perpendicular to the wall surface of the vehicle, so it is necessary to secure a space for rotating the rotary lid 38 on the side of the housing. Gone. The rotary lid 38 is fixed with a Torx screw while closing the opening 37 .

An image data output terminal 44 is arranged at the bottom of the recording unit main body 34 . The image data output terminal 44 is attached to the support section 31 in such a posture that the cable can be inserted and removed from the front of the recording section main body 34 .

An interlocking switch 46 is provided for turning on/off the power of the photographing device 23 in conjunction with the opening and closing of the rotary lid 38 . The interlocking switch 46 is turned on when the rotary lid 38 is closed, and the interlocking switch 46 is turned off when the rotary lid 38 is opened.

A power cable 45 is drawn upward from the recording unit main body 34 . The power cable 45 is connected to a power adapter attached to the rear side of the wall surface of the train through an opening provided in the support portion 31 and an opening provided in the wall surface of the train. Power may be supplied to the photographing device 23 from this power adapter. Depending on the train, the voltage of the power cable pre-wired inside the wall and whether it is direct current or alternating current are different. It is preferable to convert the type of power supplied by a pre-wired power cable into the type of power for the photographing device 23 by a power adapter. As a result, an existing power cable can be used as a power source for the photographing device 23, eliminating the need to wire a new power cable.

In order to remove the SD card from the photographing device 23, the cover 32 (FIG. 2A) must be removed from the support 31, and the rotary lid 38 of the recording unit main body 34 must be rotated to open the opening 37. FIG. In this way, the cover 32 and the rotary lid 38 provide double anti-theft measures, so that the SD card can be effectively prevented from being stolen. Since the lid that closes the opening 37 is of a rotary type, it is possible to prevent the lid from falling. The rotary lid 38 is preferably fixed with a special screw, such as a Torx screw, which cannot be removed with a general Phillips screwdriver, flat-blade screwdriver, or the like. In this way, the anti-theft effect can be further enhanced.

By setting the relationship between the reader/writer 42 and the wall surface of the train as described above, the label of the SD card can be easily viewed immediately after the SD card is removed from the reader/writer 42 .

The act of removing the SD card while the SD card is energized may cause the SD card to malfunction. When the rotary lid 38 is opened, the interlocking switch 46 is turned off and the power of the photographing device 23 is turned off, so that there is no danger of the SD card being removed from the reader/writer 42 while the SD card is energized.

(O-2) It is preferable that the rotation axis of the rotary lid 38 is set parallel to the opening surface of the opening 37, and the lid is attached to the case via a hinge so that the rotary lid 38 can be opened and closed. It is also possible to employ a sliding lid instead of the rotary lid 38 .

(O-3) The inserting/removing direction of the SD card should be parallel to the circuit board on which the electronic circuit components for realizing the functions of the processing device 40 are mounted. A label for identifying the SD card should be attached to the SD card. When the SD card is removed from the reader/writer 42 with the housing attached to the wall surface of the vehicle, the label surface should face the front. As a result, the label can be easily viewed immediately after the SD card is removed from the reader/writer 42 .

(O-4) It is preferable that the imaging device 23 and the processing device 40 are equipped with a short-time operation power source such as an electric double layer capacitor. The processing device 40 preferably has a function of receiving power from the power source for short-time operation and performing termination processing on the SD card when detecting that the interlocking switch 46 has been turned off. In this way, it is possible to prevent a situation in which the process of writing data to the SD card ends halfway and new data cannot be written. The termination process for the SD card is completed, for example, in about 2 to 3 seconds. Therefore, the power supply for short-time operation should have a capacity that allows the processing device 40 to operate for such a period of time.

(O-5) A nonflammable or flame-retardant material may be used for the supporting portion 31 and the cover 32 of the housing. For example, metal may be used for the support portion 31 . It is preferable to use a transparent resin for the front portion of the camera lens of the cover 32 and use a metal such as aluminum die-cast for the other portions. When a GPS antenna or a wireless LAN antenna is arranged in the housing, the portion near the antenna should be made of non-metal such as resin. The GPS information may be used for time correction of the real-time clock of the processing device 40 .

(O-6) It is preferable to mount a board on which a backup battery and a power supply for short-time operation are mounted so as to be removable from the main board. As a result, the backup battery and the power supply for short-time operation can be easily replaced by a user such as an installation company of the photographing device 23, for example, a railway company. It is preferable to provide an area in which information regarding the time of replacement, such as the year, month, date, etc., is specified on the substrate on which the backup battery and the power supply for short-time operation are mounted. Such an area may be, for example, an area where a sticker printed with the date of replacement is attached, an area where handwritten characters can be entered, or the like. By writing on the board the time when the board on which the backup battery and the power supply for short-time operation are mounted has been replaced, the next replacement time can be easily known. In addition to the structure in which the backup battery and the power supply for short-time operation are mounted on a common substrate, it is preferable to mount the backup battery and the power supply for short-time operation on separate substrates. With this structure, it becomes possible to easily replace only one of the backup battery and the power supply for short-time operation.

(O-7) It is preferable to adopt a structure in which the lower portion of the cover 32 is opened while the housing is attached to the wall surface of the vehicle. It is preferable to arrange the board on which the backup battery and the power source for short-time operation are mounted so that they can be replaced through the open portion of the cover 32 . Providing an open portion in the cover 32 is also effective from the viewpoint of heat radiation. The backup battery and the power supply for short-time operation are preferably arranged below the main heat-generating components of the processing device 40 . As a result, deterioration due to heat of the backup battery and the power supply for short-time operation can be suppressed.

(O-8) The side surface of the cover 32, which faces upward when the housing is attached to the wall surface of the vehicle, preferably has a shape that slopes downward toward the front. This makes it difficult for passengers of the vehicle to put their hands on the upper side surface of the cover 32 .

(O-9) The cover 32 is preferably fixed to the support portion 31 by screwing. This screw should be provided with a fall prevention structure so that it does not fall off the cover even if it is completely loosened. For example, it is preferable to fit a nylon washer or the like to the screw while passing the screw through the through-hole of the cover so that the cover is sandwiched between the head of the screw and the washer.

[P. Function to play back video images recorded on the SD card]
Next, an image reproducing apparatus for reproducing moving images recorded on an SD card will be described. Although illustration of the hardware configuration of the image reproducing apparatus is omitted, it may be the same as that of a general personal computer. That is, the image reproducing apparatus preferably has an arithmetic processing unit exemplified by a CPU, a memory, an operation device, an interface for an external storage medium, a communication module, and an auxiliary storage device. The memory is used as a work area when executing image reproduction processing. The operating device accepts a user's operation. For example, a keyboard, a pointing device, or the like may be used as the operating device. The communication module communicates (eg, wired or wireless) with an external device. The auxiliary storage device includes, for example, a hard disk device, etc., and stores programs, viewers, and other data. The arithmetic processing unit reads the viewer and other necessary programs into the memory, and performs various arithmetic processing according to the programs.

This image reproducing apparatus has a function of reading moving image data captured by cameras 35 attached to a plurality of train cars and recorded on an SD card and storing the data in a storage device. At this time, the image reproducing device associates the identification information of the camera 35 recorded on the SD card with the moving image data. The image reproducing device has a function of acquiring the train name, vehicle number, positional information of the camera 35 in the vehicle, etc. from the identification information of the camera 35 . The image reproducing device has a function of searching a database containing the identification information of the camera 35 and information about the train on which the camera 35 is mounted, and acquiring this information.

The image reproducing device has a function of displaying on a display screen information about the configuration of a plurality of connected train cars and the mounting positions of the cameras 35 in the cars, and selecting a specific camera 35 from the information displayed on the display screen. have. When one camera 35 is selected by an operator's operation, the image reproducing device has a function of displaying an image captured by the selected camera 35 on the display screen.

With this function, it is possible to easily specify the camera 35 that shot the moving image to be confirmed and reproduce it.

[Q. Interlocking function between detection result of sensor and moving image captured by camera 35]
Next, the function of linking the detection result of the sensor and the moving image captured by the camera 35 will be described.

Various sensors such as a triaxial acceleration sensor, a gyro sensor, a temperature sensor, and a gas sensor are attached to a train car. The processing device of the photographing device 23 has a function of recording the sensor detection information in the SD card in association with the data of the image photographed by the camera 35 .

The image reproducing device has a function of associating the image recorded in the SD card with the sensor detection information and displaying it on the display screen. For example, the sensors installed in the vehicle are triaxial acceleration sensors or gyro sensors, and the image reproducing device synchronizes the detection results of these sensors and moving images and displays them on the display screen at the same time. As a result, it is possible to obtain information as to what kind of behavior the passengers in the vehicle exhibit when what kind of acceleration is applied to the vehicle. In particular, it is preferable to attach three-axis acceleration sensors or gyro sensors to different locations on one vehicle. The behavior of the vehicle can be analyzed from the detection results of these sensors. Abnormalities in track conditions, vehicle conditions, driving conditions, and the like can be grasped from the vehicle behavior. From the image captured by the camera 35, it is possible to obtain information about how the passengers in the vehicle behave when the vehicle is accelerated. In addition, the behavior of the vehicle obtained from the sensor detection results can be reproduced using an operation simulator or the like, so that the driver can experience an impact equivalent to that received by the passengers. The driver can usually only experience the behavior of the driver's seat of the leading vehicle. The driver's experience of how his driving behavior is reflected in the behavior of the vehicle and how the passengers feel is a motivation for the driver to drive in a way that provides a comfortable ride. Attached.

For example, the sensor installed in the vehicle is a temperature sensor, and the image reproducing device synchronizes the detection result of the temperature sensor with the image captured by the camera 35 and simultaneously displays them on the display screen. This makes it possible to know the relationship between temperature fluctuations, opening and closing of doors, raising and lowering of shades, increase and decrease of passengers, and the like. This information is useful in finding ways to maintain a more comfortable temperature inside the vehicle.

For example, the sensors installed in the vehicle may include temperature sensors. Based on the detection result of the temperature sensor and the image captured by the camera 35, it is possible to know the relationship between temperature fluctuations, opening and closing of doors, raising and lowering of shades, increase and decrease of passengers, and the like. This information is useful in finding ways to maintain a more comfortable temperature inside the vehicle.

For example, the detection result of the temperature sensor may be displayed in the crew cabin so that the train crew can immediately see it. Based on the temperature inside the vehicle, the crew can determine whether to make an announcement prompting the opening and closing of the shade, whether to change the set temperature of the air conditioner, and the like. Based on the open/closed state of the door and the temperature change, it is possible to determine whether the cause of the temperature change is due to the opening/closing of the door.

For example, the sensor installed in the vehicle is a thermal camera, and the image reproducing device identifies passengers who have a high fever by comparing the image captured by the camera 35 with the temperature distribution obtained by the thermal camera. have a function. Furthermore, the image reproducing device has a function of searching for, for example, what route a passenger with a high fever has taken in the vehicle, based on the detection result of the thermal camera. This information is an important clue for searching for the movement route of a person infected with a dangerous virus, for example. Based on the detection result of the thermal camera, it is possible to search for, for example, what route a passenger with a high fever traveled in the vehicle. By comparing the image captured by the camera 35 with the temperature distribution obtained by the thermal camera, it is possible to identify the passenger who had a high fever. This information is an important clue for searching for the movement route of a person infected with a dangerous virus, for example.

For example, the sensors installed in the vehicle may include gas sensors. A dangerous gas can be detected based on the detection result of the gas sensor. Upon detection of hazardous gas, the processor should immediately sound an alarm in the crew cabin. When the crew notices this warning, it becomes possible to take appropriate measures before the damage becomes large.

The operator of the image reproducing apparatus can easily select the camera 35 that captured the image he/she wants to see. The function of the image reproducing apparatus may be implemented by an information terminal such as a personal computer and an application such as a viewer installed in the information terminal. Data of an image captured by the camera 35 may be acquired via an external storage medium such as an SD card or a communication network such as a wireless LAN. Information indicating the installation location of the camera 35 in the vehicle, the device ID of the camera 35, and the like may be recorded in the information for recording the image data in the external storage medium.

The viewer may be provided with a function of correlating and storing the device ID of the camera 35 and information for identifying the vehicle in which the camera 35 is installed, for example, "Nozomi No. 100 No. 7 car". It is preferable that the terminal in which the viewer is installed has a function of fetching image data recorded in a plurality of external storage media and allowing the viewer to access arbitrary image data. When the operator of the viewer performs an operation of specifying a vehicle, the viewer may display the installation locations of the cameras 35 installed in the specified vehicle on the display screen. For example, the vehicle may be displayed as a plan view, and a mark representing the camera 35 may be displayed at the installation location of the camera 35 in the plan view.

The viewer preferably has a function of displaying an image taken by the camera 35 on the display screen when the operator of the viewer selects one camera 35 from the displayed plurality of cameras 35 . It is preferable to embed the time information when the image was acquired, the vehicle identification information, and the positional information of the camera 35 in the vehicle in the image and display them in characters or figures. It is even better if the viewer has a function of saving the images being displayed as one moving image file. Since this moving image file can be reproduced using a general moving image reproducing device, it can be used for various purposes such as employee education.

The viewer preferably has a function of analyzing the skeleton of the passenger from the image of the passenger in the vehicle and displaying bones (also referred to as the skeleton). From the bone display, it becomes easier to recognize the attitude of the passengers. For example, it becomes easier to recognize various postures such as whether the user is holding on to a strap, holding on to a bar, or holding on to nothing. This makes it possible to obtain knowledge about the preferred position and height of the strap, the preferred position and orientation of the bar, and the like.

Further, by associating the image photographed by the camera 35 with the sensor detection information, information that cannot be obtained only by the image photographed by the camera 35 or the sensor detection information acquired by the sensor can be obtained. The sensor detection information should be recorded in chronological order. The cameras 35 are preferably arranged in the vicinity of a plurality of doors of the vehicle. In addition, it is preferable to arrange a plurality of cameras 35 in the vicinity of the right door and the vicinity of the left door in a zigzag pattern in plan view.

[R. Communication function with server]
Next, a communication function between the imaging device 23 mounted on the train and an external server will be described.
The photographing device 23 has a parent function, and the server has a child function. That is, communication cannot be started from the imaging device 23 and from the server. The photographing device 23 has a function of recording moving images captured by the camera 35 on an SD card and constantly transmitting moving image data to a server (hereinafter referred to as "always transmitting function").

Furthermore, the photographing device 23 has a function of transmitting moving image data to the server only in an emergency when recording to the SD card becomes impossible or at specific times such as when an instruction to upload moving image data is received from the server. (referred to as "specific time transmission function"). The photographing device 23 has a function of enabling one of the constant transmission function and the specific time transmission function and disabling the other function.

As a modification, the imaging device 23 may have a child function and the tablet terminal may have a parent function. The photographing device 23 constantly records moving images photographed by the camera 35 in the SD card, and maintains a standby state for a connection start request regarding communication. When a connection start request is received from the tablet terminal, communication becomes possible between the imaging device 23 and the tablet terminal. When receiving a transmission request for moving image data from the tablet terminal, the photographing device 23 reads the moving image data from the SD card and transmits it to the tablet terminal. The operator of the tablet terminal can confirm whether the moving image is normally recorded on the SD card without removing the SD card from the imaging device 23 .

[S. Other Modifications]
(S-1) Mobile bodies include vehicles operated with a plurality of unspecified passengers, such as trains and buses, and vehicles operated with an unspecified number of passengers, such as taxis. It includes an elevator that lifts and lowers in a building with a plurality of unspecified passengers, such as a hire car. In particular, it is preferable to arrange a camera on a moving body in which the same passenger is photographed by a camera without changing passengers for a certain period of time, and after a certain period of time, the passengers change and the attributes of the passengers change. For example, it is preferable to arrange a camera on a moving object such as a train or a bus that runs through a plurality of stops such as stations and bus stops in order. When the passengers of the mobile body change at the station or bus stop, it is preferable to perform image-based content selection again. Acquisition of evaluation information may be performed continuously, for example, at a constant time interval, regardless of the change of passengers. Also, the mobile body may be a mobile body on which a specific large number or a specific small number of passengers ride. If the moving object is a train, the stop corresponds to a station; if the moving object is a route bus, the stop corresponds to a stop; if the moving object is an elevator, the stop corresponds to each floor. .

(S-2) In the embodiment, the external storage medium is an SD card, but the external storage medium may be an external storage medium other than the SD card (for example, a USB memory). The external storage medium may be a storage medium implemented by a cloud computing environment or a storage medium provided outside the other processing device.

(S-3) It is preferable that part of the functions of the processing device described in the above embodiments are implemented by the processing device on the camera side, and the remaining functions are implemented by the processing device on the display device side. For example, it is preferable that the processing device on the camera side implements the function of analyzing an image captured by a camera, and the processing device on the display device side implements the function of selecting content based on the analysis result of the image. In this case, it is preferable to transfer the analysis result of the image from the processing device on the camera side to the processing device on the display device side. The analysis results may include information about passenger attributes and the proportion of passengers with those attributes. In this case, the processing device on the display device side may select at least one content item from a plurality of content items based on the attributes of the passenger. Instead of these pieces of information, it is preferable to transfer information about the type of content to be displayed from the processing device on the camera side to the processing device on the display device side. In this case, the processing device on the display device side may select the content according to the information regarding the type of content.

(S-4) Some or all of the functions of the processing device described in the above embodiments may be realized by an external server. In this case, the image captured by the camera may be transmitted to the server via the communication network. The communication network may be a public communication network exemplified by the Internet. The communication network may be wired, wireless, or a combination thereof. The server may obtain information on which to evaluate the content displayed on the display device, for example, based on images captured by the camera.

The scope of the invention is not limited to the configurations or limitations expressly set forth herein, but rather includes within its scope any combination of the various aspects of the invention disclosed herein. Although the patentable configuration of the present invention is specified in the appended claims, any configuration not currently specified in the claims is disclosed herein. It is our intention to claim such configurations in the future.

The present invention is not limited to the configurations described in the above-described embodiments. The constituent elements of the above-described embodiments and modifications may be arbitrarily selected and combined. In addition, arbitrary constituent elements of each embodiment and modifications, arbitrary constituent elements described in Means for Solving the Invention, or constituent elements embodying arbitrary constituent elements described in Means for Solving the Invention and may be configured in any combination. We intend to acquire the rights for these as well in the amendment of the present application or in a divisional application.

In addition, the applicant intends to acquire rights to the entire design or partial design by converting the design registration application. Although the entire device is drawn in solid lines in the drawing, the drawing includes not only the overall design but also the partial design claimed for a part of the device. For example, it is a drawing that includes a part of the device as a partial design regardless of the member, as well as a partial design of a part of the member of the device. The part of the device may be a part of the device or a part of the member. We intend to obtain rights not only for the overall design, but also for the partial design in which any part of the solid line part of the drawing is a broken line part. In addition, the modules, members, parts, etc. inside the housing of the device that are shown in the drawings are all subject to trade independently. It has the intention of making changes and obtaining rights.

20 Vehicle body 21 Door 22 Display device 23 Photographing device 31 Support unit 32 Cover 33 Torx screw 34 Recording unit body 35 Camera 36 Posture adjustment mechanism 36A Intermediate support members 36B, 36C Rotating shaft 37 Opening 38 Rotating lid 40 Processing device 41 CPU
42 Reader/Writer 43 Storage Device 44 Image Data Output Terminal 45 Power Cable 46 Interlocking Switch 50 Baggage 51 Handles 55, 56 Bar 60 Storage Area 61 Partition Plate 62 Swing Door 63 Lock Button 70 Train 71 Platform 72 Station Display Device 73 Station Display Device processor 75 Passenger

Claims (5)

A selection function for selecting content to be displayed on a display device arranged inside the moving body from among a plurality of contents based on an image captured by a camera that captures the inside of the moving body, and based on the image captured by the camera A processing device having at least one function of an evaluation information acquisition function of acquiring information serving as a basis for evaluating content displayed on the display device,
The mobile body is provided with a baggage storage area,
A lock mechanism is provided in the baggage storage area, and a process for setting the lock mechanism to either a locked state or an unlocked state based on the features of a person visiting the baggage storage area in the image captured by the camera. processing equipment. A selection function for selecting content to be displayed on a display device arranged inside the moving body from among a plurality of contents based on an image captured by a camera that captures the inside of the moving body, and based on the image captured by the camera a processing device having at least one function of an evaluation information acquisition function of acquiring information serving as a basis for evaluating content displayed on the display device;
camera and
with
The imaging device is
the camera;
a housing that houses the camera;
an attitude adjustment mechanism that changes and fixes the orientation of the lens of the camera with respect to the housing;
has
The housing is
a support for supporting the camera;
a cover that covers the camera supported by the support,
moreover,
a reader/writer for reading and writing data to and from an external storage medium for recording images captured by the camera;
An opening is provided through which the external storage medium passes when the external storage medium is attached to the reader/writer and the external storage medium is removed from the reader/writer,
A system having a rotary lid that realizes a state in which the opening is closed and a state in which the opening is opened by rotating. A luggage storage area is provided on the mobile body,
A lock mechanism is provided in the luggage storage space, and the lock mechanism is in a locked state or an unlocked state based on the features of a person visiting the luggage storage space in an image captured by a camera that captures the inside of the moving object. A processor that either : camera and
a housing that houses the camera;
an attitude adjustment mechanism that changes and fixes the orientation of the lens of the camera with respect to the housing;
has
The housing is
a support for supporting the camera;
a cover that covers the camera supported by the support;
including
moreover,
a reader/writer for reading and writing data to and from an external storage medium for recording images captured by the camera;
An opening is provided through which the external storage medium passes when the external storage medium is attached to the reader/writer and the external storage medium is removed from the reader/writer,
A photographing device having a rotary lid that realizes a state in which the opening is closed and a state in which the opening is opened by rotating. A program for causing a computer to implement the functions of the processing device according to claim 1 or 3 .

Images