JP6769429B2 - Image processing device and image display system - Google Patents

Description

The present invention relates to an image processing device and an image display system.

The advertisement display management system described in Patent Document 1 includes a user terminal, a general control center, and a plurality of advertisement groups. The advertising user inputs the advertising data to the general control center via the user terminal. In addition, the advertisement user selects an advertisement group via the user terminal and selects a time zone in which the advertisement is displayed.

JP-A-2002-56273

However, the advertisement user must determine the advertisement group to display the advertisement (display image) from the plurality of advertisement groups (display unit), which requires complicated work. It may also be unclear whether the group selected by the advertising user is located in a suitable location to display the advertisement. In this case, the advertising user goes to, for example, the location of the group to see if the group is located in a suitable location. As a result, it takes a complicated work to determine the ad group to display the ad.

The present invention provides an image processing device and an image display system capable of easily determining a display unit for displaying a display image among a plurality of display units.

According to one aspect of the present invention, the image processing device uses an information device including a first display unit to an Nth (N is an integer of 2 or more) display units arranged at different locations. The image processing device includes a reading unit, a calculation unit, a storage unit, a determination unit, and a control unit. The reading unit reads the display image formed on the sheet. The calculation unit calculates the image location information displayed on the displayed image based on the displayed image. The storage unit stores the first correspondence information in which the plurality of location information and the plurality of groups are associated with each other. The determination unit determines a target group indicating at least one of the plurality of the groups based on the first correspondence information and the image location information. The control unit controls each of the first display unit to the Nth display unit. The location information includes information indicating an address and / or information indicating the name of a facility. Each of the plurality of groups includes at least one of the first display unit to the Nth display unit. The control unit causes the display image to be displayed on the target display unit, which is a display unit included in the target group, among the first display unit to the Nth display unit.

According to another aspect of the present invention, the image forming system includes the image processing device and the information device.

According to the present invention, it is possible to easily determine a display unit for displaying a display image among a plurality of display units.

It is a block diagram of the image display system which concerns on embodiment of this invention. It is a figure which shows an example of the display image. It is a figure which shows the 1st correspondence information. It is a 1st flow diagram which shows the 1st operation of a control device. It is a 2nd flow diagram which shows the 1st operation of a control device. It is a flow chart which shows the 2nd operation of a control device. It is a figure which shows the 2nd correspondence information. It is a flow chart which shows the 3rd operation of a control device. It is a flow chart which shows the 4th operation of a control device. It is a figure which shows the 3rd correspondence information. It is a 1st flow diagram which shows the 5th operation of a control device. It is a 2nd flow diagram which shows the 5th operation of a control device. It is a figure which shows the 4th correspondence information. It is a flow chart which shows the sixth operation of a control device. It is a schematic cross-sectional view which shows the image forming apparatus.

An embodiment of the present invention will be described with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference numerals and the description is not repeated.

[First Embodiment]
The image display system X according to the first embodiment of the present invention will be described with reference to FIG. FIG. 1 is a block diagram of the image display system X.

As shown in FIG. 1, the image display system X functions as, for example, digital signage. The image display system X includes an image processing device 100 and an information device 200.

The image processing device 100 is arranged in a commercial facility such as a convenience store. The image processing device 100 includes a reading unit 10, an input unit 20, a storage unit 30, a communication unit 40, and a control device 50.

The reading unit 10 scans the display image G formed on the sheet T and reads the display image G formed on the sheet T. As a result, the reading unit 10 acquires image data indicating the display image G.

The reading unit 10 includes, for example, a light emitting unit such as an LED (Light Emitting Diode) and an imaging unit such as an image sensor. The reading unit 10 scans the display image G formed on the sheet T by using the light emitting unit and the imaging unit.

The input unit 20 receives an instruction to the image processing device 100. The input unit 20 includes a touch panel and a plurality of operation keys.

The storage unit 30 includes a storage device. The storage device includes a main storage device (eg, semiconductor memory) such as a ROM (Read Only Memory) and a RAM (Random Access Memory), and further includes an auxiliary storage device (eg, a hard disk drive, and a non-volatile memory). It may be. The main storage device and / or the auxiliary storage device stores various computer programs executed by the control device 50.

The communication unit 40 transmits / receives information between the control device 50 and the information device 200. The communication unit 40 can communicate with, for example, an electronic device equipped with a communication device that uses the same communication method (protocol). In the first embodiment, the communication unit 40 communicates with the information device 200 via a network network N such as a LAN (Local Area Network). The communication unit 40 is, for example, a communication module (communication device) such as a LAN board.

The control device 50 includes processors such as a CPU (Central Processing Unit) and an MPU (Micro Processing Unit). The control device 50 controls each element of the image processing device 100. Specifically, the processor of the control device 50 controls the reading unit 10, the input unit 20, the storage unit 30, and the communication unit 40 by executing a computer program stored in the storage device. Further, the control device 50 controls the information device 200 via the communication unit 40.

The control device 50 includes a calculation unit 51, a determination unit 52, and a control unit 53. Specifically, the processor of the control device 50 functions as a calculation unit 51, a determination unit 52, and a control unit 53 by executing a computer program stored in the storage device.

The information device 200 includes a plurality of display units α and a plurality of image pickup units β.

Each of the plurality of display units α is, for example, a display such as an LCD (Liquid Crystal Display), an ELD (Electro Luminescence Display), or a video projector.

Each of the plurality of display units α is arranged at a different location from each other. Each of the plurality of display units α is arranged, for example, in a place where a passerby can see. Each of the plurality of display units α is arranged in, for example, a residential area, a downtown area, a station, a commercial facility, and / or a public facility. Each of the plurality of display units α is controlled by the control device 50 via the network network N.

The plurality of display units α include the first display unit α1 to the Nth display unit αN. N is an integer of 2 or more. Each of the plurality of display units α has a displayable area on which an image can be displayed. The first display unit α1 to the Nth display unit αN each have a first displayable area to an Nth displayable area. The nth displayable area indicates a displayable area of the nth display unit αn. n is an integer of 1 or more and N or less.

Each of the plurality of imaging units β has, for example, a lens and an image sensor. The lens collects light incident from the outside of the imaging unit β and forms an image on the imaging surface of the image sensor. The image sensor is composed of a fixed image sensor such as a CCD (Charged Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), for example. The image sensor converts an optical image formed on an imaging surface into an electric signal to generate image data. The image data generated by each of the plurality of imaging units β is transmitted to the control device 50 via the network network N.

The plurality of imaging units β include a first imaging unit β1 to an Nth imaging unit βN. Each of the plurality of imaging units β images the periphery of the plurality of display units α. Specifically, the nth imaging unit βn is arranged in the vicinity of the nth display unit αn. The nth imaging unit βn images the periphery of the nth display unit αn.

The storage unit 30 stores the size information 31 and the first correspondence information 32.

The size information 31 is information indicating each displayable area of the plurality of display units α. The displayable area of the nth display unit αn is referred to as the nth displayable area.

Next, the display image G formed on the sheet S will be described with reference to FIG. FIG. 2 is a diagram showing an example of the display image G.

As shown in FIG. 2, the display image G includes image event information G1, image location information G2, and image date / time information G3.

The image event information G1 includes event information. The event information is information indicating the contents of an event such as "athletic meet", "flea market", and "XX exhibition". The image event information G1 is represented by characters, for example.

The image location information G2 includes the location information L. The place information L is, for example, information indicating an address and / or information indicating the name of a facility such as "○ × elementary school". The image location information G2 is represented by characters, for example.

The image date / time information G3 includes date / time information. The date and time information is information indicating the date and time, for example, "10 am on October 10, 2000". The image date / time information G3 is represented by characters, for example.

Next, the first correspondence information 32 will be described with reference to FIG. FIG. 3 is a diagram showing the first correspondence information 32.

As shown in FIG. 3, the first correspondence information 32 is information in which a plurality of location information L and a plurality of groups M are associated with each other. Each of the plurality of groups M indicates at least one of the plurality of display units α.

The plurality of location information L is composed of the first location information L1 to the R location information LR. R is an integer of 2 or more. The plurality of groups M are composed of the first group M1 to the R group MR. In the first correspondence information 32, the first place information L1 to the R place information LR and the first group M1 to the R group MR are associated with each other.

In the first correspondence information 32, the r-place information Lr and the r-group Mr are associated with each other. r indicates an integer of 1 or more and R or less. In the first embodiment, the first place information L1 is "○ × elementary school". The first group M1 includes the first display unit α1 and the second display unit α2. Therefore, in the first embodiment, “〇 × elementary school” is associated with the first display unit α1 and the second display unit α2.

The display unit α included in the r-th group Mr is arranged at a predetermined position with respect to the r-place which is the place indicated by the r-place information Lr. The predetermined position indicates, for example, a position around the r-place, a position separated from the r-place by a predetermined distance, and / or a position along a path toward the r-place. The position separated by a predetermined distance indicates, for example, a position where the r-place can be reached within a predetermined time when moving toward the place indicated by the r-place by walking or transportation. The predetermined distance is appropriately determined in consideration of, for example, the content of the image event information G1.

Next, the first operation of the control device 50 will be described with reference to FIGS. 4 and 5. FIG. 4 is a first flow chart showing the first operation of the control device 50. FIG. 5 is a second flow chart showing the first operation of the control device 50.

As shown in FIG. 4, in step S10, the input unit 20 receives an input of a job indicating that the digital signage is executed.

In step S20, the reading unit 10 reads the display image G (see FIG. 2) formed on the sheet S.

In step S30, the calculation unit 51 calculates the image location information G2 based on the display image G. For example, the calculation unit 51 uses the OCR function to perform pattern matching matching between an image showing characters formed using a known font and the display image G, and calculate the characters included in the display image G. As a result, in the first embodiment, the calculation unit 51 calculates the image event information G1, the image location information G2, and the image date / time information G3 by the OCR function (see FIG. 2). In the first embodiment, the image location information G2 calculated by the calculation unit 51 is “〇 × elementary school”.

In step S40, the determination unit 52 determines the target group from the plurality of groups M based on the first correspondence information 32 (see FIG. 3) and the image location information G2 calculated by the calculation unit 51. In the first correspondence information 32, the determination unit 52 determines the group M corresponding to the image location information G2 as the target group among the plurality of groups M. In the first embodiment, the image location information G2 is "○ × elementary school". Therefore, the target group of the first embodiment is the first group M1 (see FIG. 3). The display unit α included in the target group is referred to as a target display unit. In the first embodiment, the target display units are the first display unit α1 and the second display unit α2.

In step S50, the input unit 20 receives input of information indicating the target date. The target date indicates a date on which the display image G is displayed on the target group.

In step S60, the input unit 20 receives the input of information indicating the target time. The target time indicates a time or a time zone in which the display image G is displayed on the target display unit.

In step S70, the charge calculation unit 54 calculates the charge required for displaying the display image G on the target display unit. The charge is determined based on, for example, the number of target display units and the length of time that the display image G is displayed on the target display unit. For example, the larger the number of target display units, the higher the charge. Further, the longer the display image G is displayed on the target display unit, the higher the charge. The fee is settled by, for example, a coin vendor, a prepaid card, electronic money, or a credit card.

In step S80, the control unit 53 determines whether or not the fee has been paid. When the control unit 53 determines that the fee has been paid (Yes in step S80), the process proceeds to step S90. When the control unit 53 determines that the fee has not been paid (No in step S80), the process ends.

As shown in FIG. 5, in step S90, the control unit 53 determines whether or not the display image G is in the display period with respect to the target display date. The control unit 53 has a timer function, and determines whether or not the display image G is in the display period by the timer. The display period of the display image G indicates the period determined in step S50 and step S60. When the control unit 53 determines that the display image G is in the display period (Yes in step S90), the process shifts to step S100. When the control unit 53 determines that the display image G is not in the display period (No in step S90), the process proceeds to step S140.

In step S100, the control unit 53 adjusts the size of the display image G according to the size of the displayable area of the target display unit based on the size information 31. Adjusting the size of the display image G means enlarging or reducing the display image G. Matching the size of the display image G to the size of the displayable area means increasing the size of the display image G as much as possible within the range in which the display image G fits within the displayable area.

In step S110, the control unit 53 causes the target display unit to display the display image G. The size of the display image G displayed on the target display unit is adjusted in step S100. Therefore, the display image G having a size suitable for the size of the displayable area of the target display unit can be displayed in the displayable area of the target display unit.

In the first embodiment, the first display unit α1 and the second display unit α2 are the target display units (see step S40). Therefore, in the first embodiment, the control unit 53 displays the display image G having a size matching the size of the first displayable area in the first displayable area of the first display unit α1. Further, the control unit 53 causes the display image G having a size matching the size of the second displayable area to be displayed in the second displayable area of the second display unit α2.

In step S120, the control unit 53 determines whether or not the display period of the display image G has expired. When the control unit 53 determines that the display period of the display image G has expired (Yes in step S120), the process proceeds to step S130. When the control unit 53 determines that the display period of the display image G has not ended (No in step S120), the process shown in step S120 is repeated. As a result, the state in which the display image G is displayed on the target display unit is maintained.

In step S130, the control unit 53 controls the target display unit so as to erase the display of the display image G from the target display unit. Therefore, the display of the display image G is erased from the target display unit. As a result, the process ends. In the first embodiment, the display of the display image G is erased from each of the first display unit α1 and the second display unit α2.

In step S140, the control unit 53 determines whether or not the display period of the display image G has expired. When the control unit 53 determines that the display period of the display image G has expired (Yes in step S140), the process ends. When the control unit 53 determines that the display period of the display image G has not ended (No in step S140), the process proceeds to step S90.

As described above with reference to FIGS. 4 and 5, in step S40, the determination unit 52 determines the target group based on the first correspondence information 32 and the image location information G2. Then, as shown in step S110, the control unit 53 causes the target display unit to display the display image G. Therefore, the user of the image display system X does not need to determine the target group. As a result, the work of determining the target group can be easily performed.

Further, as shown in step S110, the control unit 53 causes the display image G having a size matching the size of the displayable area of the target display unit to be displayed in the displayable area of the target display unit. Therefore, the displayable area can be efficiently used to display the display image G in the displayable area.

Next, the second operation of the control device 50 will be described with reference to FIG. FIG. 6 is a flow chart showing a second operation of the control device 50. While the image processing device 100 and the information device 200 are running, the control device 50 executes the process shown in FIG.

As shown in FIG. 6, in step S200, the control unit 53 acquires the image data captured by each of the plurality of imaging units β from each of the plurality of imaging units β. Then, the control unit 53 executes a person recognition process on the image data acquired from each of the plurality of imaging units β, and acquires an image of a passerby. As a result, the control unit 53 acquires the passerby data for each display unit α. Passerby data indicates, for example, the traffic volume of a person. Further, the control unit 53 performs face recognition processing on the image of the passerby, and further acquires data indicating the gender of the passerby, data indicating the age of the passerby, and specific data for identifying the passerby.

In step 210, the control unit 53 updates the first correspondence information 32 based on the image of the passerby imaged by each of the plurality of imaging units β.

For example, the control unit 53 counts the number of people passing by a predetermined passerby for each display unit α. The predetermined passerby indicates, for example, a passerby heading for "○ × elementary school". Then, the control unit 53 calculates the ranking of the display unit α through which a predetermined passerby passes among the plurality of display units α. Then, the control unit 53 determines the display unit α from the first place in the ranking to the predetermined rank in the first group M1 (see FIG. 3). The control unit 53 keeps counting a predetermined passerby for each display unit α and keeps updating the ranking. Then, every time there is a change in the ranking, the display unit α included in each of the plurality of groups M is changed. When the process shown in step 210 is completed, the process returns to step S200.

The control unit 53 determines, for example, whether or not the passerby passing through the display unit α is a predetermined passerby heading for “〇 × elementary school” according to the procedures shown in (i) to (iii) below. To do. (I) The control unit 53 identifies the passerby by performing face recognition processing on the image of the passerby. (Ii) The control unit 53 confirms the position of the passerby specified in (i) based on the images of the plurality of imaging units β. (Iii) The passerby specified in (i) is imaged by the imaging unit β arranged in "○ × elementary school", so that the control unit 53 controls the passerby specified in (i) to be "○ × elementary school". Determined to be a predetermined passerby heading for. As a result, it becomes possible to count the number of people passing by a predetermined passerby for each display unit α.

As described above with reference to FIG. 6, the control unit 53 updates the first correspondence information 32 based on the image of the passerby imaged by each of the plurality of image pickup units β. Therefore, in step S40, when the determination unit 52 determines the target group, the latest passerby information can be reflected.

The data analysis process for determining the target group in the image display system X may be performed on a server on the cloud.

[Second Embodiment]
The image display system X according to the second embodiment of the present invention will be described with reference to FIGS. 1 and 7 to 9.

The second embodiment is different from the first embodiment in that the calculation unit 51 calculates the target time. Hereinafter, the differences from the first embodiment will be mainly described.

As shown in FIG. 1, the storage unit 30 further stores the second correspondence information 33.

Next, the second correspondence information 33 will be described with reference to FIG. 7. FIG. 7 is a diagram showing the second correspondence information 33.

As shown in FIG. 7, the second correspondence information 33 indicates information in which the first display unit α1 to the Nth display unit αN and the first person information Y1 to the Nth person information YN are associated with each other. The nth number information Yn indicates the relationship between the number of passersby who have passed the nth display unit αn and the time. In the nth number information Yn, the number of passersby who have passed through the nth display unit αn is indicated for each unit time. The unit time indicates the time for each unit time.

According to the second correspondence information 33, in each of the plurality of display units α, it is possible to know the time zone in which the number of passersby passing through the display unit α increases. As a result, when the display image G is displayed on the display unit α, it is possible to calculate a time zone in which the display image G can be exposed to many people.

Next, the third operation of the control device 50 will be described with reference to FIG. FIG. 8 is a flow chart showing a third operation of the control device 50. The control device 50 executes the process shown in step S61 instead of the process shown in step S60 of FIG.

In step S61, the calculation unit 51 calculates the target time, which is the time or time zone for displaying the display image G on the target display unit, based on the second correspondence information 33 (see FIG. 7). For example, in the second correspondence information 33, the calculation unit 51 calculates a time zone in which the number of passersby is larger than the predetermined number Z as the target time.

For example, when the target display unit is the first display unit α1 and the second display unit α2, the calculation unit 51 calculates the target time of each of the first display unit α1 and the second display unit α2. In this case, as shown in FIG. 7, in the first display unit α1, the number of passersby is a predetermined number Z in the first time zone of time t1 to time t2 and the second time zone of time t3 to time t4. More than people. Therefore, the calculation unit 51 calculates the first time zone and the second time zone as the target time of the first display unit α1. Further, in the second display unit α2, the number of passersby is larger than the predetermined number Z in the third time zone of time t5 to time t6 and the fourth time zone of time t7 to time t8. Therefore, the calculation unit 51 calculates the third time zone and the fourth time zone as the target time of the second display unit α2.

The user can change the predetermined number of Z people via the input unit 20.

As described above with reference to FIG. 8, in step S61, the calculation unit 51 calculates the target time based on the second correspondence information 33. Therefore, the user of the image display system X does not need to determine the target time. As a result, the work of determining the target time can be easily performed.

Next, the fourth operation of the control device 50 will be described with reference to FIG. FIG. 9 is a flow chart showing a fourth operation of the control device 50. While the image processing device 100 and the information device 200 are running, the control device 50 executes the process shown in FIG.

As shown in FIG. 9, in step S300, the control unit 53 acquires passerby data for each display unit α. The process shown in step S300 is the same as the process shown in step S200 (see FIG. 6).

In step S310, the control unit 53 updates the second correspondence information 33 (see FIG. 7) based on the image of the passerby imaged by each of the plurality of imaging units β. For example, the control unit 53 counts the passersby passing through the nth display unit αn in association with the time. Then, the control unit 53 performs an additional process of adding the counted number of people to the number of people information Y of the nth display unit αn of the second correspondence information 33 by dividing it for each unit time. Then, the control unit 53 updates the second correspondence information 33 by performing additional processing for each display unit α shown in FIG. When the process shown in step 310 is completed, the process returns to step S300.

In the second embodiment, the process of updating the first correspondence information 32 (see FIG. 6) and the process of updating the second correspondence information 33 (see FIG. 9) are executed in parallel. In the second embodiment, one of the process of updating the first correspondence information 32 and the process of updating the second correspondence information 33 may be executed, and the other may not be executed.

As described above with reference to FIG. 9, the control unit 53 updates the second correspondence information 33 based on the image of the passerby imaged by each of the plurality of image pickup units β. Therefore, in step S61, when the calculation unit 51 calculates the target time, the latest passerby information can be reflected.

[Third Embodiment]
Next, the image display system X according to the third embodiment of the present invention will be described with reference to FIGS. 1, 4, and 10 to 12.

The third embodiment is different from the first embodiment and the second embodiment in that it is determined whether or not to display the display image G on the display unit α according to the attributes of passersby passing through the display unit α. .. Hereinafter, the differences from the first embodiment and the second embodiment will be mainly described.

As shown in FIG. 1, the storage unit 30 further stores the third correspondence information 34.

Next, the third correspondence information 34 will be described with reference to FIG. FIG. 10 is a diagram showing a third correspondence information 34.

As shown in FIG. 10, the third correspondence information 34 indicates information in which the first event information to the P event information and the first event attribute to the P event attribute are associated with each other. P is an integer of 2 or more. The p-event attribute indicates an attribute of a person who matches the p-event information. p is an integer of 1 or more and P or less. Attributes indicate, for example, gender, children, adults, and / or age. In the third embodiment, the first event information "event F" and the first event attribute "adult" are associated with each other. Further, the second event information "event H" and the second event attribute "child" are associated with each other.

Next, the fifth operation of the control device 50 will be described with reference to FIGS. 11 and 12. FIG. 11 is a first flow chart showing a fifth operation of the control device 50. FIG. 12 is a second flow chart showing a fifth operation of the control device 50.

In the third embodiment, the nth display unit αn is a target display unit.

As shown in FIGS. 4 and 11, when the process shown in step S80 is completed, the process proceeds to step S81.

As shown in FIG. 11, in step S81, the calculation unit 51 calculates the image event information G1 based on the display image G. In the third embodiment, the image event information G1 calculated by the calculation unit 51 is "event F".

In step S82, the control unit 53 calculates the first conformity attribute (conformity attribute) based on the image event information G1 and the third correspondence information 34 (see FIG. 10). In the third correspondence information 34, the control unit 53 calculates the event attribute corresponding to the image event information G1 as the first conformity attribute. In other words, the first conforming attribute indicates an attribute of a person who conforms to the image event information G1.

In the third embodiment, the image event information G1 is "event F". Therefore, in the third embodiment, the control unit 53 calculates "adult" as the first conformity attribute.

As shown in FIGS. 11 and 12, when the process shown in step S110 is completed, the process shifts to step S111.

In step S111, the control unit 53 executes a person recognition process on the image data acquired from the nth imaging unit, and determines in real time whether or not the nth imaging unit is imaging a passerby. In the following, a passerby imaged by the nth imaging unit will be referred to as an imaged person.

When the control unit 53 determines that there is an image recipient (Yes in step S111), the process shifts to step S112. The presence of an imaged person means that a passerby is shown in the image captured by the nth display unit. On the other hand, when the control unit 53 determines that there is no person to be imaged (No in step S111), the process proceeds to step S120. The fact that there is no person to be imaged means that no passerby is shown in the image captured by the nth imaging unit βn.

In step S112, when the nth imaging unit βn images a passerby, the control unit 53 calculates the attributes of the imaged person based on the image of the imaged person. The control unit 53 performs face recognition processing on the image of the imaged person, for example, and calculates the attributes of the imaged person. In the third embodiment, the control unit 53 calculates which of the "adult" and "child" attributes the subject has. For example, when the control unit 53 performs face recognition processing on the image of the imaged person and determines that the age of the imaged person is older than a predetermined age, the control unit 53 determines that the attribute of the imaged person is "adult". calculate. Further, the control unit 53 performs face recognition processing on the image of the imaged person, and when it is determined that the age of the imaged person is equal to or less than a predetermined age, it calculates that the attribute of the imaged person is "child". ..

In step S113, the control unit 53 determines whether or not the image subject has the first conformity attribute. Specifically, it is determined whether or not the attribute of the person to be imaged calculated in step S112 is included in the first conformity attribute calculated in step S82 (see FIG. 11). When the control unit 53 determines that the image subject has the first conformity attribute (Yes in step S113), the process proceeds to step S120. When the control unit 53 determines that the image recipient does not have the first conformity attribute (No in step S113), the process proceeds to step S114.

In the third embodiment, the first conforming attribute is "adult". Therefore, when the attribute of the imaged person is "adult", the imaged person has the first conformity attribute. As a result, the process proceeds to step S120. In the third embodiment, when an "adult" is present in front of the nth imaging unit βn, the display of the display image G does not disappear from the nth display unit αn, and the displayed state of the display image G is maintained. ..

On the other hand, when the attribute of the imaged person is "child", the imaged person does not have the first conformity attribute. As a result, the process proceeds to step S114.

In step S114, when the control unit 53 determines that the image subject does not have the first conformity attribute, the control unit 53 controls the nth display unit αn so that the nth display unit αn does not display the display image G. As a result, the display of the display image G disappears from the nth display unit αn. In the third embodiment, if there is a "child" in front of the nth imaging unit βn, the display of the display image G disappears from the nth display unit αn.

In step S115, the control unit 53 determines whether or not there is an image subject who does not have the first conformity attribute. Specifically, the control unit 53 executes a person recognition process on the image data acquired from the nth image pickup unit βn, and determines in real time whether or not there is an imaged person who does not have the first conformity attribute. In the third embodiment, the control unit 53 determines whether or not there is still a "child" in front of the nth imaging unit βn.

When the control unit 53 determines that there is an image subject who does not have the first conformity attribute (Yes in step S115), the process shown in step 115 is repeated. As a result, the state in which the display of the display image G disappears from the nth display unit αn is maintained. In the third embodiment, when the "child" is still in front of the nth image pickup unit βn, the state in which the display of the display image G disappears from the nth display unit αn is maintained.

On the other hand, when the control unit 53 determines that there is no subject having no first conformity attribute (No in step S115), the process proceeds to step S116.

In step S116, the control unit 53 controls the nth display unit αn so that the nth display unit αn displays the display image G. As a result, the display image G is displayed on the nth display unit αn. In the third embodiment, when the "child" disappears from the front of the nth imaging unit βn, the display image G is displayed on the nth display unit αn. When the process shown in step S116 is completed, the process proceeds to step S120.

In step S120, the control unit 53 determines whether or not the display period of the display image G has expired. When the control unit 53 determines that the display period of the display image G has expired (Yes in step S120), the process proceeds to step S130. When the control unit 53 determines that the display period of the display image G has not ended (No in step S120), the process proceeds to step S111.

As described above with reference to FIGS. 11 and 12, in step S113 and step S114, when the image subject does not have the first conformity attribute, the nth display unit αn does not display the display image G. The control unit 53 controls the nth display unit αn. Therefore, during the display period of the display image G, the display image G is displayed on the nth display unit αn and the display image G is displayed on the nth display unit αn according to the attributes of the person to be imaged. It becomes possible to switch between the non-existent state.

[Fourth Embodiment]
The image display system X according to the fourth embodiment of the present invention will be described with reference to FIGS. 1, 13, and 14.

The fourth embodiment is different from the first to third embodiments in that the display image G displayed on the nth display unit αn is changed according to the attributes of the person to be imaged. Hereinafter, the differences from the first to third embodiments will be mainly described.

As shown in FIG. 1, the storage unit 30 further stores the fourth correspondence information 35.

Next, the fourth correspondence information 35 will be described with reference to FIG. FIG. 13 is a diagram showing the fourth correspondence information 35.

As shown in FIG. 13, the fourth correspondence information 35 indicates information in which the first display image J1 to the Q display image JQ and the first image attribute K1 to the Qth image attribute KQ are associated with each other. Q indicates an integer of 2 or more. The qth image attribute Kq indicates an attribute of a person who matches the qth display image Jq. q is an integer greater than or equal to 1 and less than or equal to Q. In the fourth embodiment, the first display image J1 is associated with an "adult" having the first image attribute K1. The second display image J2 is associated with a "child" having the second image attribute K2.

Next, the sixth operation of the control device 50 will be described with reference to FIG. FIG. 14 is a flow chart showing a sixth operation of the control device 50.

As shown in FIG. 14, in step S400, the control unit 53 executes a person recognition process on the image data acquired from the nth image pickup unit βn, and whether or not the nth image pickup unit βn images a passerby. Is determined in real time. When the control unit 53 determines that there is an image recipient (Yes in step S400), the process shifts to step S410. When the control unit 53 determines that there is no person to be imaged (No in step S400), the process shown in step S400 is repeated.

In step S410, when the nth imaging unit βn images a passerby, the control unit 53 calculates the attributes of the imaged person based on the image of the imaged person. In the fourth embodiment, the control unit 53 calculates which of the "adult" and "child" attributes the subject has.

In step S420, the control unit 53 calculates a conforming image based on the fourth correspondence information 35 and the attributes of the person to be imaged. In the fourth correspondence information 35, the control unit 53 calculates the display image G corresponding to the image attribute K including the attribute of the imaged person as a conforming image. In other words, the conforming image indicates a display image G that matches the attributes of the imaged person among the plurality of display images G.

In the fourth embodiment, when the person to be imaged is an "adult", the conforming image is the first display image J1. On the other hand, when the person to be imaged is a "child", the conforming image is the second display image J2.

In step S430, the control unit 53 controls the nth display unit αn so that the nth display unit αn displays the conforming image. As a result, a conforming image is displayed on the nth display unit αn. In the fourth embodiment, when the person to be imaged is an "adult", the first display image J1 is displayed on the nth display unit αn. On the other hand, when the person to be imaged is a "child", the second display image J2 is displayed on the nth display unit αn.

In step S440, the control unit 53 determines whether or not there is an image subject having the second conformity attribute. Specifically, the control unit 53 executes a person recognition process on the image data acquired from the nth image pickup unit βn, and determines in real time whether or not there is an imaged person having the second conformity attribute. The second conforming attribute indicates the attribute of the person corresponding to the conforming image in the fourth correspondence information 35.

When the control unit 53 determines that there is an image subject having the second conformity attribute (Yes in step S440), the process shown in step S440 is repeated. As a result, the state in which the conforming image is displayed on the nth display unit αn is maintained. In the fourth embodiment, when an "adult" is captured in the image captured by the nth imaging unit βn, the first display image J1 continues to be displayed on the nth display unit αn. On the other hand, when a "child" is shown in the image captured by the nth imaging unit βn, the second display image J2 continues to be displayed on the nth display unit αn.

When the control unit 53 determines that there is no subject having the second conformity attribute (No in step S440), the process proceeds to step S450.

In step S450, the control unit 53 controls the nth display unit αn so as to erase the display of the display image G from the target display unit. As a result, the display of the display image G is erased from the nth display unit αn. In the fourth embodiment, when the "adult" passes through the nth display unit αn and is no longer reflected in the nth imaging unit βn, the display of the first display image J1 is erased from the nth display unit αn. On the other hand, when the "child" passes through the nth display unit αn and is no longer reflected in the nth imaging unit βn, the display of the second display image J2 is erased from the nth display unit αn.

When the process shown in step S450 is completed, the process returns to step S400.

As described above with reference to FIG. 14, in step S440, the control unit 53 displays the conforming image while the image subject having the second conforming attribute is present, so that the nth display unit αn displays the conforming image. The display unit αn is controlled. Therefore, it is possible to cause the nth display unit αn to display the display image G that matches the attributes of the imaged person.

[Fifth Embodiment]
The image forming apparatus 300 will be described with reference to FIG. FIG. 15 is a schematic cross-sectional view showing the image forming apparatus 300.

The image forming apparatus 300 includes a conveying unit 1, an input unit 2, a reading unit 3, a cassette 4, a feeding roller 5a, a conveying roller 5b, a discharging roller 5c, an image forming unit 6, and a storage device 7. And a control device 9.

The transport unit 1 transports the sheet having the image to be read toward the reading unit 3. The reading unit 3 scans the sheet to acquire image data. The input unit 2 receives an instruction from the user to the image forming apparatus 300. The display unit 2a functions as a touch panel. In this case, the input unit 2 includes a touch panel.

The cassette 4 houses the sheet T. The feeding roller 5a sends out the sheet T in the cassette 4. The transport roller 5b sends the sheet T transported from the feed roller 5a toward the image forming unit 6.

The image forming unit 6 forms an image on the sheet T. The image specifically shows a toner image. The image forming unit 6 includes a photoconductor drum, a charging unit, an exposure unit, a developing unit, a transfer unit, a cleaning unit, and a static elimination unit. An image is formed on the sheet T by the photoconductor drum, the charging unit, the exposure unit, the developing unit, and the transfer unit. The cleaning unit removes the toner remaining on the surface of the photoconductor drum. The static eliminator removes residual charges on the surface of the photoconductor drum. After forming an image on the sheet T, the image forming unit 6 sends the sheet T toward the fixing unit. The fixing portion heats and pressurizes the image to fix it on the sheet T. The image forming unit 6 may have a nozzle and eject ink from the nozzle to form an image on the sheet T.

The discharge roller 5c discharges the sheet T that has passed through the image forming unit 6 to the outside of the housing of the image forming apparatus 300.

The storage device 7 stores various computer programs executed by the control device 9.

The communication device 8 communicates with the information device 200 via a network network N such as a LAN (Local Area Network).

The control device 9 includes a transport unit 1, an input unit 2, a reader 3, a cassette 4, a feed roller 5a, a transport roller 5b, an image forming unit 6, a discharge roller 5c, and a storage device 7. , Controls the communication device 8.

The image forming apparatus 300 functions as an image processing apparatus 100. Specifically, the reading unit 3 of the image forming apparatus 300 functions as the reading unit 10 of the image processing apparatus 100. The input unit 2 of the image forming apparatus 300 functions as the input unit 20 of the image processing apparatus 100. The storage device 7 of the image forming device 300 functions as a storage unit 30 of the image processing device 100. The communication device 8 of the image forming apparatus 300 functions as a communication unit 40 of the image processing apparatus 100. The control device 9 of the image forming device 300 functions as the control device 50 of the image processing device 100. As a result, the image forming apparatus 300 can be used as the image processing apparatus 100. In addition, the image display system X can be configured by using the image forming apparatus 300 arranged in the store.

The embodiments of the present invention have been described above with reference to the drawings (FIGS. 1 to 15). However, the present invention is not limited to the above-described embodiment, and can be implemented in various embodiments without departing from the gist thereof (for example, (1) to (6)). In addition, various inventions can be formed by appropriately combining a plurality of the constituent elements disclosed in the above-described embodiment. For example, some components may be removed from all the components shown in the embodiments. The drawings are schematically shown mainly for each component for easy understanding, and the number of each component shown may differ from the actual one due to the convenience of drawing. Further, each component shown in the above embodiment is an example, and is not particularly limited, and various modifications can be made without substantially deviating from the effect of the present invention.

(1) In steps S111 to S114 of the third embodiment, when the n-th imaging unit βn images an imaged person who does not have the first conformity attribute, the display of the display image G disappears from the n-th display unit αn. However, when the nth imaging unit βn simultaneously images an imaged person who does not have the first conforming attribute and an imaged person who has the first conforming attribute, the display of the display image G does not disappear from the nth display unit αn. The display of the display image G may be retained. For example, when the first conformity attribute is "adult", the display of the display image G disappears from the nth display unit αn when only the "child" passes through the place where the nth display unit αn is located, but the "child" is displayed. When an "adult" is accompanied, the display of the display image G does not have to disappear from the nth display unit αn.

(2) In the first to fifth embodiments, for example, an image showing the inventory of products sold in a commercial facility such as a convenience store is displayed as event information on the display unit α arranged at the station. May be good. As a result, passers-by who use the station can decide which commercial facility to use on the way from the station.

(3) In the first to third embodiments, the control unit 53 may acquire the weather information for predicting the weather in the area where the plurality of display units α are arranged via the Internet and register it in the database. .. In this case, the control unit 53 predicts the weather in the area where the plurality of display units α are arranged based on the weather information, and determines the time zone for displaying the display image G in the target group according to the predicted weather. You may. For example, the control unit 53 determines a time zone for predicting that it is sunny or cloudy as a time zone for displaying the display image G. As a result, it becomes possible to reflect the weather when determining the time zone for displaying the display image G.

(4) In the first to third embodiments, when the time zones for displaying the display image G on the same display unit α conflict among a plurality of users, for example, they are displayed on the display unit α on a first-come-first-served basis. The user who can display the image G may be determined. Further, the time zone for displaying the display image G may be distributed among a plurality of users. In this case, for example, the user who paid a large amount of money will be distributed for a longer time.

(5) In the first to third embodiments, the amount of the charge required to display the display image G in the target group may be changed according to the attribute of the user who uses the image display system X. .. In this case, the charge calculation unit 54 calculates the attributes of the user of the image display system X based on, for example, the image event information G1 (see FIG. 2), and calculates the charge based on the attributes of the user. For example, the charge calculation unit 54 calculates the charge so that the charge is cheaper for an individual than for a company. As a result, it becomes possible to calculate the charge that reflects the attributes of the user of the image display system X.

(6) The display unit α may be arranged in a vehicle such as an automobile. In this case, for example, when a traffic closure occurs, the reading unit 10 reads a traffic closure image indicating that the traffic closure has occurred. Then, the closed image is transmitted to the display unit α of the vehicle traveling near the place where the closed road is generated via the communication unit 40 of the image processing device 100. Then, the traffic closure image is displayed as event information on the display unit α of the vehicle. As a result, the driver of the vehicle can recognize that the road closure has occurred.

The car navigation system may be used as the display unit α. Further, when the car navigation is used as the display unit α, the display unit α may communicate with the communication unit 40 of the image processing device 100 by using the communication function of the car navigation. When the car navigation system is used as the display unit α, the control unit 53 of the image processing device 100 processes the image to be displayed on the car navigation system into a simple image composed of only character information, and the processed image is processed into a car. It may be displayed in the navigation. That is, in consideration of the fact that the car navigation screen is smaller than the screen of the general display unit α used in digital signage, the display image G to be displayed on the car navigation by the control unit 53 is processed into a simple image. You may. As a result, it becomes possible to form an image that matches the size of the car navigation screen.

The present invention can be used in the fields of image processing devices and image display systems.

10 Reading unit 30 Storage unit 32 First correspondence information 33 Second correspondence information 34 Third correspondence information 51 Calculation unit 52 Decision unit 53 Control unit 100 Image processing device 200 Information device G Display image G1 Image event information G2 Image location information L Location Information M Group S Sheet X Image display system α Display unit αn Nth display unit β Imaging unit

Claims (9)

An image processing device using an information device including a first display unit to an Nth (N is an integer of 2 or more) display units arranged at different locations.
A reading unit that reads the display image formed on the sheet,
A calculation unit that calculates image location information displayed on the displayed image based on the displayed image,
A storage unit that stores first correspondence information in which a plurality of location information and a plurality of groups are associated with each other.
A determination unit that determines a target group from the plurality of groups based on the first correspondence information and the image location information.
A control unit that controls each of the first display unit to the Nth display unit is provided.
Each of the image location information and the plurality of location information includes information indicating an address and / or information indicating the name of a facility.
Each of the plurality of groups includes at least one of the first display unit to the Nth display unit.
The control unit is an image processing device that displays the display image on a target display unit, which is a display unit included in the target group, among the first display unit to the Nth display unit. The storage unit further stores the second correspondence information in which the first display unit to the Nth display unit and the first person information to the Nth person information are associated with each other.
The nth (n is an integer of 1 or more and N or less) number information indicates the relationship between the number of passersby passing through the nth display unit and the time.
Based on the second correspondence information, the calculation unit calculates a target time, which is a time or time zone for displaying the display image on the target display unit.
The image processing apparatus according to claim 1, wherein the control unit causes the target display unit to display the display image at the target time. The information device further includes a first imaging unit to an Nth imaging unit.
The image processing apparatus according to claim 1 or 2, wherein the nth (n is an integer of 1 or more and N or less) imaging unit images the periphery of the nth display unit. The image processing device according to claim 3, wherein the control unit updates the first correspondence information based on an image of a passerby imaged by each of the first imaging unit to the Nth imaging unit. The information device further includes a first imaging unit to an Nth imaging unit.
The nth (n is an integer of 1 or more and N or less) imaging unit images the periphery of the nth display unit.
The image processing device according to claim 2, wherein the control unit updates the second correspondence information based on an image of a passerby imaged by each of the first imaging unit to the Nth imaging unit. The calculation unit calculates the image event information displayed on the display image based on the display image, and calculates the image event information.
The storage unit further stores the third correspondence information in which the first event information to the P (P is an integer of 2 or more) event information and the first event attribute to the P event attribute are associated with each other.
The p-th (p is an integer of 1 or more and P or less) event attribute indicates the attribute of the person who matches the p-event information.
The control unit
Based on the image event information and the third correspondence information, a conformity attribute which is an attribute of a person who conforms to the image event information is calculated.
The attributes of the imaged person are calculated based on the image of the imaged person who is a passerby imaged by the nth imaging unit.
The image according to claim 3, wherein when the imaged person does not have the conforming attribute, the display image is not displayed on the target display unit while the nth display unit is imaging the imaged person. Processing equipment. The target display unit has a displayable area on which an image can be displayed.
The image processing device according to any one of claims 1 to 6, wherein the control unit displays the display image having a size matching the size of the displayable area in the displayable area. The control unit calculates the attributes of the passerby based on the images of the passerby imaged by each of the first imaging unit to the Nth imaging unit.
The storage unit further stores the fourth correspondence information in which the first display image to the Qth (Q is an integer of 2 or more) display image and the first image attribute to the Qth image attribute are associated with each other.
The qth (q is an integer of 1 or more and Q or less) image attribute indicates the attribute of a person who matches the qth display image.
The control unit
When the nth imaging unit images a passerby, the attributes of the imaged person who is the passerby imaged by the nth imaging unit are calculated.
Based on the fourth correspondence information, from the first display image to the Qth display image, a conforming image which is the display image conforming to the attribute of the imaged person is calculated.
The image processing apparatus according to claim 3, wherein the conforming image is displayed on the n-th display unit while the n-th imaging unit is imaging the person to be imaged. The image processing apparatus according to any one of claims 1 to 8.
An image display system including the information device.

Images