JP7310283B2 - Display control system, display control device, display control method, and program - Google Patents

Description

The present invention relates to a display control system, a display control device, a display control method, and a program.

In recent years, due to the improvement in the performance of computer devices, it is widely practiced to import coloring books and handwritten images into computers, set regular or random movements for them, and display them as moving images on displays, signage, etc. (See Patent Document 1).

However, conventionally, the operation of the image displayed on the screen was determined by the identification information provided in advance on the paper, the feature amount of the coloring book or handwritten image by the user, etc. It was not possible to make the operation reflect the

The present invention has been made in view of the above, and includes a display control system, a display control device, a display control method, and a display control system capable of causing an image displayed on a screen to perform an operation that reflects a user's instruction. and to provide programs.

In order to solve the above-described problems and achieve the object, a display control system according to an embodiment of the present invention provides display means for displaying an image and a plurality of wind sensors at a gate through which people pass, and a control means for controlling the image based on the strength of the detected wind when the detection means detects the wind, wherein the control means comprises: and controlling the movement of individual images included in said image based on the strength of the detected wind .

According to the present invention, it is possible to cause an image displayed on the screen to perform an operation reflecting a user's instruction.

FIG. 1 is a diagram showing an example of the configuration of a display control system according to the first embodiment. FIG. 2 is a diagram showing an example of arrangement of wind sensors provided on a projection medium. FIG. 3 is a diagram showing an example of the configuration of a wind sensor module, which is an example of the wind sensor. FIG. 4 is a diagram illustrating an example of a hardware configuration of a PC; FIG. 5 is a diagram showing an example of the configuration of a registration table. FIG. 6 is a diagram showing an example of the configuration of a management table. FIG. 7 is a diagram showing an example of the configuration of functional blocks of a PC. FIG. 8 is a diagram illustrating an example of a detailed functional block configuration of a display control unit. FIG. 9 is a diagram explaining acquisition of a user image and attribute information from a whole image. FIG. 10 is a diagram showing an example of setting motion setting information. FIG. 11 is a diagram for explaining one piece of information indicating movement patterns. FIG. 12 is a diagram showing an example of setting of throwing position information. FIG. 13 is a diagram showing an example of the configuration of a parameter control table. FIG. 14 is a diagram illustrating controlling the motion of a user image in 3D space. 15 is a diagram showing an example of a secondary plane image when the secondary plane projection unit projects the 3D space of FIG. 14. FIG. FIG. 16 is a diagram showing a list of wind strength values of each wind sensor updated by the sensor information analysis unit. FIG. 17 is a diagram showing the correspondence relationship between the value indicated by the wind sensor and the degree of effect. FIG. 18 is a diagram showing a state in which the flowers are stationary for explanation of the effects. FIG. 19 is a diagram showing changes when the user blows on the target area. FIG. 20 is a flowchart showing an example of control processing of the entire display control system by a PC. FIG. 21 is a flowchart showing an example of effect processing when wind is detected. 22 is a diagram illustrating an example of a configuration of a communication device according to modification 1. FIG. FIG. 23 is an explanatory diagram of how to divide the display image area into areas associated with each of the three communication devices. FIG. 24 is a diagram showing a setting example of a table in the case of using the division method shown in FIG. 25 is a diagram illustrating an example of a configuration of a gate according to Modification 2. FIG. FIG. 26 is a diagram showing an example of content prepared in advance. FIG. 27 is a diagram illustrating an example of a configuration of functional blocks;

Exemplary embodiments of a display control system, a display control device, a display control method, and a program will be described in detail below with reference to the accompanying drawings.

(Embodiment)
As an example, an example of application to a display control system for displaying a handwritten image of a picture (including a coloring book) drawn on designated paper by a visitor to an event such as an exhibition will be shown. The picture drawn on the specified paper is not limited to the customer, and may be drawn by the staff. In addition, the drawing is not limited to a drawn picture, and may be a pre-printed picture or the like. These images correspond to "individual images" and are hereinafter collectively referred to as "user images". "Paper" is an example of a medium. In addition, customers, staff, and the like are collectively referred to as "users", but mainly mean customers, and staff is used when it is necessary to specify.

FIG. 1 is a diagram showing an example of the configuration of a display control system according to the first embodiment. In FIG. 1, the display control system 1 includes a computer (PC) 10, a projector (PJ) 11, a database (DB) 12, a sensor 13, and an image acquisition device 20. The operation of the entire display control system 1 is controlled by the PC 10 by executing a control program (including a display control program). In this configuration, the PC 10 and DB 12 correspond to "control means". PJ11 corresponds to the "display means". The sensor 13 corresponds to "detection means". The image acquisition device 20 corresponds to "image acquisition means". A projection medium 14, which will be described later, corresponds to the "display target".

Note that the PC 10 also corresponds to a “display control device”. Also, the PC 10 may be composed of a single housing or a plurality of computers.

The paper 50 includes a hand-drawn area 51 for the user to hand-draw a picture, and an attribute setting area 52 in which the attributes of the picture to be drawn in the hand-drawn area are set.

The image acquisition device 20 has a camera, a scanner, or the like that captures an image of the paper 50 set by the user with an imaging device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The image acquisition device 20 acquires an image of the entire paper 50 by imaging with an imaging element.

The DB 12 is a database provided in the storage of the PC 10, an external storage, or the like. The DB 12 manages images acquired by the image acquisition device 20 and settings for controlling the movement of the images in various information tables.

The PJ 11 projects display information onto the projection medium 14 according to the output from the PC 10 . A projection screen, for example, is used as the projection medium 14 . As the projection screen, a matte screen, a pearl screen, a silver screen, a bead screen, or the like may be appropriately selected according to the usage environment. Alternatively, a transmission screen may be used and the display information may be projected onto the PJ 11 from the rear side of the screen. In any case, a projection medium having a material on which the projected display information is displayed is used.

Sensor 13 is a wind sensor. In this embodiment, the image 100 displayed on the projection medium 14 is provided to detect the wind when the user blows through the display surface. Note that in the present embodiment, an operation of blowing on the image 100 or its display surface by the user will be described as an example of the user's instruction.

FIG. 2 is a diagram showing an example of arrangement of the wind sensors 13a provided on the projection medium 14. As shown in FIG. In FIG. 2, each dot shown inside the dotted line indicates the wind sensor 13a. In this example, 30 wind sensors 13a are used in the X direction and 10 wind sensors 13a are arranged in the Y direction of the projection target medium 14, and are arranged at predetermined intervals. Some of the wind sensors 13a in the X direction are omitted from illustration by dots.

The number of wind sensors 13a and the layout of arrangement are not limited to those shown in FIG. It may be appropriately set according to the size of the projection medium 14, the resolution of the image 100, and the like. As another layout different from the grid-like arrangement of FIG. 2, for example, a layout in which a plurality of concentric circles are provided at predetermined intervals in the radial direction can be considered. Also, the number of wind sensors 13a may be one, only two at both ends, or distributed at three or four locations.

Each wind sensor 13a shown in FIG. 2 is arranged so that it can detect the wind when the user blows on the image 100 displayed on the projection medium 14 through the display surface. For example, it may be arranged on the surface of the projection medium 14, or the surface of the projection medium 14 may be provided with ventilation holes or grooves for air flow, so that the inside (back side) of the projection medium 14, or the It may be arranged in a groove or the like.

When the wind sensor 13a is installed on the projection medium 14 in this way, when the user blows directly on the image 100 projected on the projection medium 14, the generation and strength of the wind are detected. be able to

As the wind sensor 13a, as long as it can detect the wind and output a signal, any sensor that detects the wind based on any principle may be used as appropriate. For example, there is one that uses the principle that the temperature of a resistance wire (hot wire) that is heated by a constant current drops when it hits it. In this case, wind can be detected by detecting a change in the resistance value due to a decrease in the temperature of the hot wire. Some such wind sensors are provided as wind sensor modules. A result obtained by detection by the wind sensor 13a is transmitted to the PC 10. FIG.

FIG. 3 is a diagram showing an example of the configuration of the wind sensor module 130, which is an example of the wind sensor 13a. The wind sensor module 130 has a detection section 131 and a communication section 132 that communicates with the PC 10 . The detection unit 131 is a circuit that monitors the resistance value that varies depending on the temperature of the hot wire, and outputs a signal indicating detection when there is a change in the resistance value that exceeds a predetermined threshold value, or always outputs the resistance value itself. is. The communication unit 132 is a communication circuit that transmits unique identification information (sensor identification information) stored by each wind sensor module 130 and information detected by the detection unit 131 to the PC 10 . Communication with the PC 10 may be performed by wire or wirelessly.

In addition, unlike this, a centralized control device is connected between each wind sensor 13a and the PC 10 to centrally manage each sensor 13a and transmit output data such as the resistance value of each wind sensor 13a to the PC 10. good too. When a centralized control device is provided, the resistance value, etc. output from each wind sensor 13a is directly monitored, and the resistance value, etc., of each wind sensor 13a is output only when even one of them exceeds the threshold value. A configuration in which data is transmitted to the PC 10 is also possible.

FIG. 4 is a diagram showing an example of the hardware configuration of the PC 10. As shown in FIG. As shown in FIG. 4, the PC 10 includes a CPU (Central Processing Unit) 1001, a ROM (Read Only Memory) 1002, a RAM (Random Access Memory) 1003, a display signal generator 1004, a storage 1006, a data I/F 1007, and a communication It has I/F1008. Each unit is connected via a bus 1000 .

CPU 1001 controls the entire PC 10 according to control programs stored in ROM 1002 and storage 1006 . Fixed programs and data are stored in the ROM 1002 . A RAM 1003 is used as a work memory. A display signal generation unit 1004 converts the display information generated by the CPU 1001 into a display signal suitable for various display devices such as the monitor 1005 and the PJ 11, and outputs the display signal. Here, the monitor 1005 is a monitor for the PC 10 administrator.

The storage 1006 is an SSD (Solid State Drive), HDD (Hard Disk Drive), or the like. The storage 1006 stores control programs, data, and the like.

A data I/F 1007 inputs and outputs data to and from an input/output device. For example, the data I/F 1007 receives image data output by the image acquisition device 20, operation data from a mouse and keyboard (KBD), and the like. Moreover, the display information generated by the CPU 1001 may be output from the data I/F 1007 to the projector 11 . Communication with the input/output device is performed by a predetermined interface such as USB (Universal Serial Bus) or Bluetooth (registered trademark).

Communication I/F 1008 is a communication interface that communicates with wind sensor 13a (for example, wind sensor module 130). Note that communication with the wind sensor 13 a may be performed via the data I/F 1007 .

Next, the configuration of various tables in the DB 12 will be described. Note that the table shown here is only an example, and the table may be configured by changing items in the table, deleting the table, or integrating the table as appropriate. The DB 12 has a registration table, a management table, and the like. In addition, it has various settings necessary for controlling the motion of the user image. Various settings necessary for controlling the motion of the user image will be described as appropriate in the description of the functional blocks.

FIG. 5 is a diagram showing an example of the configuration of a registration table. A registration table T1 shown in FIG. 5 shows a correspondence between user images and attribute information. In this example, the attribute information includes information indicating the type of picture of the user image, such as flowers, soap bubbles, and butterflies. In addition, since there are various types of flowers, and the height and shape of leaves also differ, in this example, flowers are classified into a plurality of patterns, one of which is shown as A flower, B flower, and the like. The flags are set to non-display "1", display "2", and display end "3". Undisplayed "1" is a flag indicating a user image that has not yet been used, display "2" is a flag indicating a user image that is in use, and display end "3" is a flag indicating that a user image cannot be used due to time-out or the like. It is a flag indicating the finished user image.

FIG. 6 is a diagram showing an example of the configuration of a management table. A management table T2 shown in FIG. 6 shows a correspondence between user images, attribute information, and start time information. For the user image and the attribute information, the information acquired from the registration table T1, which is to be displayed, is set. In the start time information, the time to start inputting the user image is set.

Next, the configuration of the functional blocks of the PC 10 will be described. Here, using user images of animals and plants as an example, the function of each functional unit will be described with reference to FIGS. 9 to 19 as appropriate.

FIG. 7 is a diagram showing an example of the configuration of functional blocks of the PC 10. As shown in FIG. FIG. 7 shows main functions related to display control processing of display information generated by the PC 10 . As shown in FIG. 7, the PC 10 includes an image analysis unit 101, a registration unit 102, a display control unit 103, and a sensor information analysis unit 104. Each unit is provided as a module or the like, and implemented by the CPU 1001 reading and executing a program from the storage 1006, ROM 1002, or the like. Part or all of the image analysis unit 101, the registration unit 102, the display control unit 103, and the sensor information analysis unit 104 may be configured by dedicated hardware such as ASIC. In this configuration, the sensor information analysis unit 104 corresponds to the "acquisition unit".

The image analysis unit 101 analyzes the overall image of the paper 50 (see FIG. 1) acquired by the image acquisition device 20, and acquires the user image and attribute information from the overall image. The attribute information is attribute information indicating the attribute of the user image, for example, the type of flower in the case of a tulip or a button.

Specifically, the image analysis unit 101 detects a hand-drawn area 41 (see FIG. 9A) from the entire image 40 (see FIG. 9A), and detects a user image 410 from the detected hand-drawn area 41 (see FIG. 9A). a) Extract cf. User image 410 includes a picture 45 of a certain type of flower (A flower). The image analysis unit 101 also detects an attribute setting area 42 (see FIG. 9A) from the entire image 40 and acquires attribute information from the detected attribute setting area 42 . The attribute information is processed according to the encoding form of the attribute information image 420 (see FIG. 9A) set in the attribute setting area 42, for example, decoding of the QR code (registered trademark) in this example. go and get.

In addition to this, if the form of the paper 50 is, for example, as shown in FIG. , character recognition, pattern matching, etc. are used to acquire text information indicating attribute information. In addition, when the form 50 in which check marks are added to check boxes provided for each type of flower is used as the attribute setting area 42, by reading the check boxes with check marks, the read check boxes can be Get the corresponding attribute information. The attribute setting area 42 on the paper 50 may be set in any form.

The registration unit 102 associates the user image and attribute information acquired by the image analysis unit 101 with each other and registers them in the registration table T1 of the DB 12 .

The display control unit 103 acquires the user image from the registration table T1 of the DB 12, and sets predetermined movement information that can change the movement of the user image by a parameter. Then, the motion-set image is placed at a predetermined initial position in a three-dimensional space (3D space) including the background image and moved, and a secondary plane projection image of the three-dimensional space is output as display information. Also, the display control unit 103 changes the motion of the user image according to the result of the sensor information analysis unit 104 . The display information output by the display control unit 103 is output in a format that can be displayed on the PJ 11 (see FIG. 1), and is projected from the PJ 11 onto the projection medium 14 (see FIG. 1) as an image 100 (see FIG. 1). Details of the display control unit 103 will be described with reference to FIG.

The sensor information analysis unit 104 supplies the display control unit 103 with values (values indicating wind strength) corresponding to the respective wind sensors 13a (see FIG. 2). The sensor information analysis unit 104 converts the detection result output from the sensor 13 (each wind sensor 13a) at any time into a value indicating the wind strength, updates the value corresponding to each wind sensor 13a at any time, and controls the display control unit 104. 103.

FIG. 8 is a diagram showing an example of a detailed functional block configuration of the display control unit 103. As shown in FIG. The display control unit 103 shown in FIG. 8 includes an image management unit 201 , an image input unit 202 , an image control unit 203 , an effect instruction unit 204 and a secondary plane projection unit 205 . In this configuration, the image management unit 201, the image input unit 202, the image control unit 203, the secondary plane projection unit 205, and the like correspond to the "generation unit". The image control unit 203, the effect instruction unit 204, and the like correspond to the "control unit".

The image management unit 201 manages user images stored in the DB 12 and outputs displayable user images to the image input unit 202 . For example, the image management unit 201 acquires the undisplayed user image “1” and the attribute information associated with the user image from the registration table T1 (see FIG. 5) of the DB 12, and the image input unit 202 output to In addition, the image management unit 201 manages the elapsed time from the time when each user image is registered in the DB 12 or when the display is started in the management table T2 (see FIG. 6). The image control unit 203 is instructed to remove from the display target.

The image input unit 202 acquires and sets a motion pattern corresponding to each piece of attribute information from the motion patterns set in advance for each attribute information in the motion setting information T3 for user images that can be displayed. . The movement pattern indicates, for example, movement within a secondary plane, and the speed of movement, amplitude of vibration, etc. can be changed by adjusting the set values for the parameters of the target part.

Movement setting performed by the image input unit 202 will be described with reference to FIGS. 10 and 11. FIG. FIG. 10 is a diagram showing an example of setting of the motion setting information T3. As shown in FIG. 10, information indicating a pattern of motion is set in the motion setting information T3 for each piece of attribute information. FIG. 11 is a diagram for explaining one piece of information indicating movement patterns. FIG. 11 shows the movement pattern of A flower.

As shown in FIG. 11 , flower A has a movement pattern in which the stem 450 swings left and right (in the X-axis direction), and the user image 410 of flower A is arranged at the tip of the stem 450 . In the user image 410, the area outside the outline of the flower picture 45 is set to be transparent or the like. In this movement pattern, parameters are used to adjust the cycle of the stem 450 swinging to the left and right and the width of the swing. The period is, for example, the period of a sine wave. In this case, the stem 450 swings from side to side at a speed that varies with the cycle of the sine wave. As the value indicating wind strength increases, the parameter is set to a value that shortens the cycle. As a result, the flowers sway faster and the flowers move as if they were blown by the wind. As shown in FIG. 11, the amplitude is adjusted continuously or in multiple steps from minimum to maximum. By increasing the swing width, it is possible to express a movement in which the swing width is larger than the normal swing width due to the wind.

It should be noted that the movement of the flower may be represented by either the cycle or the swing width. In addition, by adding parameters other than the period and amplitude, the flower will move more naturally in the wind.

In addition, in the case of a soap bubble movement pattern, a movement is set such that a plurality of soap bubble particles are generated, moved, and extinguished after a predetermined period of time. The parameter adjusts the generation cycle of particles. For example, as the value indicating the strength of the wind increases, the particle generation cycle of soap bubbles is shortened.

The image input unit 202 acquires input position information corresponding to the attribute information of the user image from the input position information T4 indicating the initial position set in advance for each attribute information, and controls the input of the user image to that position. The unit 203 is instructed. The input position information is position information within the 3D space.

FIG. 12 is a diagram showing an example of setting of the throw-in position information T4. As shown in FIG. 12, in the input position information T4, the coordinates of the input position are set for each piece of attribute information. The flowers shown as an example do not move from the initial input position, and there is a possibility that a plurality of flowers of the same type may be arranged, so the coordinates of the input position are indicated by areas. The image input unit 202 inputs images of the same kind of flowers in a predetermined arrangement order from the coordinates of the area.

Returning to FIG. 8, the image control unit 203 arranges the user image at the coordinates of the input position in the 3D space indicated by the 3D space information M1, and according to the setting of the parameter control table for each user image, according to the predetermined constraint condition M2. Control the movement of the user image in 3D space. The 3D space is, for example, a 3D space in which a predetermined background image is set on the back. Constraint condition M2 also restricts the mutual movement of user images so that user images do not overlap due to the movement of each user image in 3D space, and the relationship between the same type and different types for each user image. It is a condition to move with . For example, if flowers are arranged in the same area, conditions such as synchronizing them to sway left and right are included.

FIG. 13 is a diagram showing an example of the configuration of a parameter control table. As shown in FIG. 13, in the parameter control table T5, user image identification information is associated with parameter settings for each user image. In FIG. 13, since the user image is a flower, two parameters are set for each. Parameters k1 and k3 are amplitudes, and parameters k2 and k4 are periods. For example, 0 ≤ k1 ≤ 10 can change the amplitude value from 1 (small sway) to 10 (large sway), and 1 ≤ k2 ≤ 10 can change the period from 1 (long period) to 10 (short period). can be changed up to Note that the parameters shown in this example are just an example, and the number of parameters is not limited to this. For example, flower parameters may be increased. Also, parameters may be appropriately set according to the type of user image.

When inputting a user image, the image control unit 203 controls each parameter of the input user image by giving a minimum value (for example, “long period” and “narrow amplitude” for a flower) as an initial value.

FIG. 14 is a diagram illustrating controlling the motion of a user image in 3D space. FIG. 14 schematically shows a 3D space configured by 3D space information. A 3D space 3000 shown in FIG. 14 mainly shows a range corresponding to the display area, and a predetermined background image 3001 is provided on the end face in the depth direction (z direction). A space on the front side of the background image 3001 is a space in which the user image is moved, and each user image with a movement pattern set is arranged according to the input position information T4.

For example, for Flower A, the front left area of the 3D space 3000 is designated as the input position information, so user images 3002 of the same Flower A are arranged in the left area of the front row in the input order. Other types of flowers are also arranged in the 3D space 3000 based on the input position information T4.

The image control unit 203 controls the movement of each flower put into each position so that it sways left and right in a movement pattern corresponding to the type of each flower with a long cycle and a minimum width. In addition, the image control unit 203 controls the user image moving in the 3D space (for example, a butterfly, a soap bubble, etc., although not shown here) to be displayed within the display area and its surroundings, including the constraint conditions. Restrict image movement. Note that the constraint conditions include a constraint condition such that the user images do not overlap each other in the 3D space 3000 .

Returning to FIG. 8, the secondary plane projection unit 205 projects the 3D space in which the image control unit 203 controls the movement of the user image onto one surface of the display area, and outputs a secondary plane image. Specifically, in order to generate a secondary plane image viewed from arrow A in FIG. During projection, the secondary plane projection unit 205 reduces the size of the user image as it is arranged in the depth direction (z direction) in the 3D space 3000 .

FIG. 15 is a diagram showing an example of a secondary plane image when the secondary plane projection unit 205 projects the 3D space of FIG. 14 onto the secondary plane. As shown in FIG. 15, since the user image 3002 of flower A is in the front row, it is displayed in its entirety as it is, and the flower in the back row is reduced in size, and the portion overlapping the flower A in the front row is hidden and cannot be seen.

A secondary plane image generated by projection by the secondary plane projection unit 205 is generated at a predetermined frame rate and sequentially output as display information.

Returning to FIG. 8, the effect instruction unit 204 reads the value indicating the strength of the wind of each wind sensor 13a updated by the sensor information analysis unit 104 at any time or at a predetermined timing, and calculates the wind strength of each wind sensor 13a when it is read. Effect is instructed to the image control unit 203 based on the value indicating the strength of the . Effect means expressing movement caused by wind. The effect instruction unit 204 instructs the image control unit 203 to start a predetermined effect, and instructs the movement of the user image corresponding to the strength of the wind (for example, the speed at which the flower is shaken).

FIG. 16 is a diagram showing a list of values indicating wind strength of each wind sensor 13a updated by the sensor information analysis unit 104. As shown in FIG. The effect instruction unit 204 reads from the sensor information analysis unit 104 the identification information (sensor "number") of each wind sensor 13a shown as list information J1 in FIG. .

The effect instructing unit 204 selects a wind sensor 13a exceeding a predetermined threshold value (such as wind speed 7) from among the values indicating the wind strength of each wind sensor 13a in the list information J1 of FIG. The image control unit 203 is instructed, for example, to apply an effect of a level corresponding to the value of the wind sensor 13a for an image displayed at one or a plurality of wind sensor 13a positions exceeding . The threshold may be changed as appropriate.

FIG. 17 is a diagram showing the correspondence relationship between the value indicated by the wind sensor 13a and the degree of effect (hereinafter referred to as level). Correlation is made such that the effect level increases as the value indicated by the wind sensor 13a increases. The effect level is set so that, for example, the stronger the wind, the faster the movement of the user image.

The effect instruction unit 204 has in advance information indicating the correspondence shown in FIG. 17 and information that associates the sensor identification information with the positional coordinates (X, Y) of each wind sensor 13a on the projection plane. When there is a wind sensor 13a exceeding a predetermined threshold value, the effect instruction unit 204 outputs the coordinates (X, Y) corresponding to the wind sensor 13a and the effect level to the image control unit 203. FIG.

Note that the effect instruction unit 204 may instruct the effect when a predetermined number of values exceeding a predetermined threshold value are included among the values indicating the wind strength of each wind sensor 13a.

When receiving an effect instruction from the effect instruction unit 204, the image control unit 203 controls display contents according to the instruction. For example, when a preset constant effect is instructed, by increasing the value of the parameter of the target user image to a predetermined value, control is performed so that it moves with the constant effect. Further, when an effect of a level corresponding to the value of each wind sensor 13a is instructed, the image control unit 203 displays each user image corresponding to the position of each wind sensor 13a as the wind sensor 13a at that position. Control to move with the effect corresponding to the value.

For example, the effect can be set to the maximum value for a certain period of time ("short period", "wide swing width" for flowers, etc.), or depending on the value, the corresponding increase amount can be added to the parameter value. This is done by setting the value, gradually decreasing it, and returning it to the original value after a certain period of time. It should be noted that the value of the parameter increased to the predetermined value is returned to the original value when the effect is terminated, for example, after a certain period of time has elapsed.

18 and 19 are explanatory diagrams of effects. 18 and 19 show the wind sensor 13a of the projection target medium 14 and the display information shown in FIG. 15 in association with each other. Actually, by adjusting the position where the image 100 (see FIG. 1) is projected, the display information is displayed as the image 100 on the projection medium 14 in the arrangement relationship shown in FIGS. 18 and 19 show an enlarged lower left region for explanation. The coordinates (x, y) indicated on each wind sensor 13a are the position coordinates of each wind sensor 13a in the display information of FIG. In FIGS. 18 and 19, the flower, which is the user image, is indicated by an elliptical dashed line, and its stem is indicated by an inverted triangular dashed line.

FIG. 18 shows a state in which the flower is stationary for explanation of the effect. FIG. 19 shows changes in movement due to effects when the user blows on these areas through the display surface. In FIG. 19, the shading is gradually reduced from the wind sensor 13a that detected a strong wind so that the strength of the wind can be understood. Out of the wind sensors 13a, white ones indicate those to which the wind hardly reaches and the wind could not be detected.

That is, in the example shown in FIG. 19, the wind sensor 13a corresponding to the position of the coordinates (x1, y1) detects the strongest wind, and the strength of the wind detected by the wind sensor 13a decreases as the distance increases. represents the state. At the coordinates (x4, y3), the coordinates (x5, y1), etc., the wind does not sufficiently reach and the wind cannot be detected. Therefore, the flower at the position corresponding to the shaded wind sensor 13a is designated as the object to which the effect is to be applied.

In this example, the effect level is changed according to the strength of the wind detected by the wind sensor 13a. Therefore, the flower at the position of coordinates (x1, y1) where the strongest wind is detected has the largest amplitude. As the distance from the flower increases, the amplitude of the flower gradually decreases. Here, the swing width of the flower has been explained, but the period in which the flower swings from side to side is also changed. At the moment when a strong wind is detected, the period of the flower at that position is made the shortest, and the period of the flower swinging is gradually lengthened as the distance from the flower increases. For this reason, it is possible to realistically reproduce the swaying of flowers when the wind blows through. Once changed, the cycle and amplitude return to their original values after a certain period of time.

Next, a flow of control processing of the entire display control system 1 by the PC 10 will be described. First, the flow of basic control processing will be described. After that, the flow of effect processing when wind is detected will be described.

FIG. 20 is a flowchart showing an example of control processing of the entire display control system 1 by the PC 10. As shown in FIG. First, the image acquisition device 20 (scanner or the like) acquires an image (step S1). For example, when a staff member or the like sets the paper 50 (see FIG. 1) on the mounting table and the execution button is pressed, the image acquisition device 20 captures the paper 50 and captures an image 40 (see FIG. 1) of the entire paper 50 . 9).

Next, the image analysis unit 101 acquires the image 40 output from the image acquisition device 20, analyzes the image 40, and acquires the user image 410 (see FIG. 9) and attribute information (step S2). .

Next, the registration unit 102 associates the user image 410 and the attribute information acquired by the image analysis unit 101 with each other and registers them in the registration table T1 (see FIG. 5) of the DB 12 (step S3).

Next, the image management unit 201 acquires the undisplayed “1” (see FIG. 5) user image 410 and the attribute information associated with the user image 410 from the registration table T1 of the DB 12, and Output to input unit 202 .

Next, for the user image 410 received from the image management unit 201, the image input unit 202 selects a motion pattern corresponding to the attribute information from among the motion patterns in the motion setting information T3 (see FIG. 10). Acquire and set (step S4).

Next, the image input unit 202 acquires the input position information corresponding to the attribute information of the user image from the input position information T4, and instructs the image control unit 203 to input the user image at that position ( step S5).

Next, the image control unit 203 arranges the user image in 3D space and controls the movement of the user image based on the setting of the user image in the parameter control table T5 (see FIG. 13) (step S6). . The appearance of this 3D space is projected by the secondary plane projection unit 205 and output as a secondary plane image (see FIG. 15) and displayed at a predetermined frame rate.

FIG. 21 is a flowchart showing an example of effect processing when wind is detected. First, the effect instruction unit 204 reads the value (see FIG. 16) indicating the strength of the wind of each wind sensor 13a updated by the sensor information analysis unit 104, and the read strength of the wind of each wind sensor 13a becomes the threshold value ( In the example shown in FIG. 16, for example, when the number exceeds "7"), an effect is instructed to the image control unit 203 (step S11). Note that the effect instruction unit 204 may simply instruct the image control unit 203 to start the effect, or may instruct the image control unit 203 about the coordinates to be subjected to the effect and the level of the effect in the display information. .

Next, when receiving an effect instruction from the effect instruction unit 204, the image control unit 203 changes the parameter values of the target user image to perform control so that it operates with the specified effect (step S12). For example, since the position of a flower is fixed, it is possible to determine which flower is the target from the coordinates specified by the effect specifying unit 204 . For things like butterflies that move around, whether or not the butterfly is at the target's coordinates at that time determines whether to perform the effect.

Note that the image control unit 203 performs control such that the changed parameter values are restored to their original values after a certain period of time has elapsed.

As described above, in the display control system according to the present embodiment, when the user blows on the image 100 displayed on the projection medium 14 through the display surface, the wind can be detected. can. In addition, in this display control system, since it is also possible to specify the area where the breath is blown, the user image of the area where the breath is blown in the image projected on the projection medium 14 is displayed by the wind according to the level of the wind. It is possible to implement and display a shaking effect. Therefore, in this display control system, it is possible to cause the image displayed on the display screen to perform an operation that reflects the user's instruction, and as a result, it is possible to provide further amusement.

In the present embodiment, as an example, the configuration in which the wind sensors 13a are arranged at each position on the display surface of the projection medium 14 has been described. It can be implemented even if only the In that case, for example, the entire image displayed on the projection medium 14 when wind is detected by the wind sensor 13a, or the user image of a predetermined partial area may be displayed by similar effect processing. .

(Modification 1)
A configuration of a display control system using a wind detection communication device in which a sensor 13 is incorporated in a portable pen-type or stick-type housing will be described. Since the mode shown in Modification 1 does not directly blow on the image via the display surface, it is also possible to replace the projector 11 of the display control system 1 (see FIG. 1) with a large monitor or the like. . This modified example will be described as having the same configuration as the embodiment. In addition, in this modified example, the description of the parts common to the embodiment will be appropriately omitted, and the different parts will be mainly described.

When a communication device is used, it is possible to apply a wind effect to the entire image or each region by associating the communication device with the display image region in advance. Here, as an example, a form in which a wind effect is applied to each area of a display image is shown.

22 is a diagram illustrating an example of a configuration of a communication device according to modification 1. FIG. A communication device 5000 shown in FIG. 22 is a communication device for detecting wind, in which one wind sensor module 130 is incorporated in a portable pen-shaped or stick-shaped housing 5001 .

In the communication device 5000, when the user blows on the communication device 5000, the detection unit 131 that detects the wind is exposed to the outside through a ventilation hole such as a slit or a through hole provided in the housing 5001, for example. The communication device 5000 has a configuration in which data is transmitted to the PC 10 through the communication section 132 when the detection section 131 detects wind, like the wind sensor module 130 described in the embodiment. Also, the communication unit 132 and the PC communicate by wire or wirelessly.

Note that the communication device 5000 will be described here as having a size that a user can hold and use. In this case, it is also possible to give instructions by gestures such as shaking the communication device 5000 . For example, wind can be generated by shaking the communication device 5000 . Also, the communication device 5000 may be modified to be used by being installed at a predetermined position.

In this example, three communication devices 5000 are configured as an example, and an example is shown in which wind effects are applied to three corresponding regions of a display image by each of them. Note that the number of communication devices 5000 is an example, and is not limited to this. For example, it may be one, two, or four or more. By increasing the number, it becomes possible to apply the wind effect to a finer area. In addition, it is also possible to apply different effects to the same area according to each communication device 5000 by setting in advance.

FIG. 23 is an explanatory diagram of how to divide the display image area into areas associated with each of the three communication devices 5000 . The display image area is an area where the image 100 of the projection medium 14 (see FIG. 1) is displayed. FIG. 23 shows an example of dividing into three regions in the X direction. In FIG. 23, the communication device 5000(1) out of the three communication devices corresponds to the first area, the other communication device 5000(2) out of the three corresponds to the second area, and the third area corresponds to the remaining one of the three communication devices 5000(3).

FIG. 24 is a diagram showing a setting example of a table for the division shown in FIG. FIG. 24(a) shows a table in which communication device identification information and area identification information are associated with each other. FIG. 24B shows a table in which area identification information and information indicating the area range (range information) are associated with each other. In the table structure shown in FIG. 24, the division of the three regions shown in FIG. 23 can be changed as appropriate simply by changing the range information of the table in FIG. 24(b). For example, in FIG. 23, the widths in the X direction of the three regions can be set to different widths. Moreover, it is also possible to change the setting so that the three regions shown in FIG. 23 are divided in the Y direction. In addition, each of the three areas can be set in an arbitrary shape. Also, it is possible to exclude any area of the display area from the range of the effect.

The hardware configuration and functional block configuration of the display control system according to Modification 1 are substantially the same as those of the embodiment. A partial difference in processing in the display control unit 103 will be described below with reference to FIG. 8 .

In the configuration of Modification 1, upon receiving an effect instruction from the effect instruction unit 204, the image control unit 203 refers to each table shown in FIG. 24 and applies a predetermined effect to the user image in the target area. For example, all user images in the target area are moved with given parameter values. Also, a different effect may be applied for each target region. For example, a parameter change value or the like is set in advance for each target region, and when an effect instruction is given by any communication device, for example, the communication device 5000(1), the region corresponding to the communication device 5000(1) is displayed. , to apply the effect to the image in that region. When the effect instruction unit 204 selects and instructs the effect level from multiple levels according to the strength of the wind, the parameter is given a change value corresponding to the selected level to perform the effect.

In this way, in Modification 1, by using the communication device 5000, it is possible to create a wind in the display image from a position away from the projection medium 14. FIG. Further, by providing a plurality of communication devices, the display image area can be divided into a plurality of regions, and by using the communication device corresponding to each region, the image in each region can be individually blown. Also, by using a communication device, it is not necessary to install it on the projection target medium 14, so it can be applied to a large display such as a liquid crystal display.

(Modification 2)
When the wind is detected, instead of changing the movement of the target user image, predetermined content may be displayed. For example, the sensor 13 is provided at a gate large enough for a user to pass through. A sensor 13 provided at the gate detects the wind generated each time the user passes through the gate. In such a configuration, predetermined content is displayed. Although a gate is shown here as an example, wind sensors may be installed on any other object, such as a pillar or wall, that can detect the wind when the user passes through.

25 is a diagram illustrating an example of a configuration of a gate according to Modification 2. FIG. A gate 6000 shown in FIG. 25 is of a size that allows a user (customer) to pass through. FIG. 25 shows an example in which the sensors 13 (a large number of wind sensors 13a) are arranged at a height through which the user passes. This arrangement of the sensors 13 is an example, and may be appropriately arranged so as to facilitate wind detection. For example, they may be arranged on the entire inner surface of the gate 6000 .

FIG. 26 is a diagram showing an example of content prepared in advance. FIG. 26 shows one state when an animation of butterflies dancing in a flower garden is reproduced. The center of the flower garden shows how soap bubbles are generated. In this way, an animation with a predetermined effect may be displayed as content for a predetermined reproduction time. After the animation ends, restore the original display. Note that content is not limited to animation. In addition, pre-produced still images, moving images, and the like may be displayed.

Changing the motion of the user image and displaying the predetermined content may be selectively performed. When selectively changing the movement of the user image and displaying the predetermined content, the selection may be made based on the strength of the wind, or the identification number of the wind sensor that detected the wind. may When selecting based on the identification number of the wind sensor that detected the wind, for example, the wind sensor 13a provided in the projection medium 14 shown in the embodiment, the communication device 5000 shown in the first modification, or the second modification. It is also possible to use it together with the gate 6000 shown in FIG.

FIG. 27 is a diagram illustrating an example of a configuration of functional blocks; FIG. 27 is obtained by adding a switching section 301 to the effect instructing section 204 and further providing a content reproducing section 302 in the configuration of the functional blocks shown in FIG. The switching unit 301 corresponds to "switching means".

When the effect instructing unit 204 instructs an effect, the switching unit 301 confirms the identification number of the wind sensor that detected the wind exceeding the threshold, and if the identification number of the wind sensor is a predetermined identification number, secondary plane projection is performed. The output of the unit 205 is stopped and the content reproduction unit 302 is instructed to reproduce the content. For example, when the identification number is that of the wind sensor installed at the gate 6000, the switching unit 301 switches the display to content reproduction. After that, the switching unit 301 restarts the output of the secondary plane projection unit 205 when the content reproduction unit 302 detects the end of the content reproduction.

The content reproduction unit 302 reproduces predetermined content such as animation, and outputs the reproduced display information to the PJ 11 .

It should be noted that the determination as to whether to give motion to the event image or to reproduce the content may be appropriately changed by setting a determination table to which the switching unit 301 refers. For example, the determination table may include the identification number of the communication device as the identification number for reproducing the content. Moreover, the determination is not limited to the identification number, and the strength of the wind may be set and the determination may be made according to the strength of the wind. For example, motion is given to the event image when wind with strength in the range of the first threshold to the second threshold is detected, and content is played back when wind stronger than the second threshold is detected. , may be modified as appropriate.

Alternatively, a plurality of contents may be prepared, and the corresponding contents may be played back. For example, the wind sensors 13a provided at the gate 6000 are classified by area, and different contents are reproduced depending on the area where the wind is detected. Also, different contents may be reproduced according to the strength of the wind. In any case, in such a case, a plurality of contents are registered as contents to be reproduced by the content reproducing unit 302, and the switching unit 301 selects content numbers according to the strength of the wind and the identification number of the wind sensor from the judgment table. is notified to the content reproduction unit 302 .

Moreover, even when the gate 6000 is used, a configuration that gives movement to the event image, for example, control that gives movement in units of areas may be combined.

In this way, the configuration of Modification 2 makes it possible to reproduce the content, and in combination with the configuration of the embodiment and Modification 1, etc., it is possible to select whether to give motion to the event image or to reproduce the content. be able to. Therefore, it is possible to reflect the user's instructions on the image displayed on the display surface, and as a result, it is possible to provide further amusement.

(Modification 3)
So far, as an example, we have shown a form that causes the displayed flowers to sway by generating wind, but by moving pictures among multiple people, it is possible to play cooperatively or compete against each other. You may do so. As an example, the user image drawn by the first user and the user image drawn by the second user are deformed so that they can compete with each other depending on the strength of the wind. For example, each user image is arranged at both ends of the display area. Each user blows on their own user image in the image projected onto the projection medium to direct it toward the opponent. Victory or defeat is determined by defeating the user image of the opponent according to the strength of blowing. Blowing on the user image may utilize a communication device.

A program for executing the processing according to the embodiment and each modified example is stored in a computer-readable record such as a CD (Compact Disk) or a DVD (Digital Versatile Disk) as a file in an installable format or an executable format. Provided on media. Not limited to this, a program for executing the processing according to the embodiment and each modification may be stored on a computer connected to a communication network such as the Internet, and provided by being downloaded via the communication network. may be configured. Also, the program for executing the processing according to the embodiment and each modification may be provided or distributed via a communication network such as the Internet.

The above-described embodiment and modifications are preferred examples of the present invention, but the present invention is not limited thereto, and various modifications can be made without departing from the scope of the present invention. be.

Each function of the embodiments described above may be implemented by one or more processing circuits. Here, the "processing circuit" in this specification means a processor programmed by software to perform each function, such as a processor implemented by an electronic circuit, or a processor designed to perform each function described above. Devices such as ASIC (Application Specific Integrated Circuit), DSP (Digital Signal Processor), FPGA (Field Programmable Gate Array) and conventional circuit modules are included.

The devices described in the examples are merely representative of one of several computing environments for implementing the embodiments disclosed herein. In some embodiments, DB 12 includes multiple computing devices, such as server clusters. Multiple computing devices are configured to communicate with each other over any type of communication link, including a network, shared memory, etc., to perform the processes disclosed herein. Similarly, PC 10 may include multiple computing devices configured to communicate with each other.

1 display control system 10 computer (PC)
11 Projector (PJ)
12 Database (DB)
REFERENCE SIGNS LIST 13 sensor 14 projection medium 20 image acquisition device 100 image

Japanese Patent No. 6361146

Claims (22)

display means for displaying an image;
A detection means for detecting the wind caused by the passage of a person by providing a plurality of wind sensors at the gate through which the person passes;
a control means for controlling the image based on the strength of the detected wind when the detection means detects the wind;
has
The control means controls movement of individual images included in the image based on the strength of the detected wind .
A display control system characterized by: The control means adjusts the speed at which the individual images move to a speed corresponding to the strength of the wind.
The display control system according to claim 1 , characterized by: switching means for switching control of movement of the individual image according to the identification information of the detection means;
The display control system according to claim 1 , characterized by: The control means controls the movement of the individual image included in a predetermined region of the image, which is associated with a wind sensor that detects wind among the plurality of wind sensors.
3. The display control system according to claim 1 , wherein: The control means adjusts the movement of the individual image in the image region corresponding to the wind sensor from which the wind is detected among the plurality of wind sensors to the movement corresponding to the strength of the wind of the wind sensor.
5. The display control system according to claim 4 , characterized in that: display means for displaying an image;
A detection means for detecting the wind caused by the passage of a person by providing a plurality of wind sensors at the gate through which the person passes ;
a control means for controlling the image based on the strength of the detected wind when the detection means detects the wind;
has
The control means switches the image to display predetermined content based on the strength of the detected wind.
A display control system characterized by: display means for displaying an image;
A detection means for detecting the wind caused by the passage of a person by providing a plurality of wind sensors at the gate through which the person passes ;
a control means for controlling the image based on the strength of the detected wind when the detection means detects the wind;
has
The control means selectively replaces the image with one content from among a plurality of contents in accordance with detection information from the detection means.
A display control system characterized by: The detection means is a wind sensor provided on a display target on which an image is displayed by the display means.
The display control system according to claim 1 , characterized by: a plurality of the wind sensors are arranged in a range in which the image is displayed on the display target;
The control means controls movement of the individual image in an image region corresponding to a wind sensor from which wind is detected among the plurality of wind sensors.
9. The display control system according to claim 8 , characterized by: The detection means is a communication device equipped with a wind sensor,
8. The display control system according to any one of claims 1 to 7, characterized in that: The individual images have different movement patterns depending on image attributes.
3. The display control system according to claim 1 , wherein: the individual images are arranged in 3D space and controlled in motion;
3. The display control system according to claim 1 , wherein: having image acquisition means for acquiring an image of the material drawn on the medium;
The control means controls the movement of the images acquired by the image acquisition means as individual images.
12. The display control system according to any one of claims 1 to 11 , characterized in that: a generator that generates image display information;
an acquisition unit that acquires wind detection information generated by the passage of a person from a plurality of wind sensors provided at a gate through which the person passes;
a control unit that controls the display information of the image based on the strength of the wind included in the detection information;
including
The control unit controls the movement of individual images included in the image based on the strength of the wind included in the detection information .
Display controller. a generator that generates image display information;
Wind detection information generated by the passage of people is collected from multiple wind sensors installed at the gate through which people pass. an acquisition unit for acquiring information;
a control unit that controls the display information of the image based on the strength of the wind included in the detection information;
including
The control unit converts the image to predetermined content based on the strength of the wind included in the detection information. to switch to the view of
Display controller. a generator that generates image display information;
Wind detection information generated by the passage of people is collected from multiple wind sensors installed at the gate through which people pass. an acquisition unit for acquiring information;
a control unit that controls the display information of the image based on the strength of the wind included in the detection information;
including
The control unit selectively selects the image from among a plurality of contents according to the detection information. Replace with one content,
Display controller. The display controller
displaying an image;
A step of providing a plurality of wind sensors at a gate through which a person passes and detecting the wind generated by the passage of the person;
if wind is detected, controlling the image based on the strength of the detected wind;
and run
the step of controlling controls movement of individual images included in the image based on the strength of the detected wind ;
Display control method. The display controller
displaying an image;
Multiple wind sensors are installed at the gate through which people pass to detect the wind generated by the passage of people. and
if wind is detected, controlling the image based on the strength of the detected wind; ,
and run
The step of controlling includes displaying the image to predetermined content based on the strength of the sensed wind. switch to the display of
Display control method. The display controller
displaying an image;
Multiple wind sensors are installed at the gate through which people pass to detect the wind generated by the passage of people. and
if wind is detected, controlling the image based on the strength of the detected wind; ,
and run
The step of controlling includes dividing the image into a plurality of contents according to the strength of the detected wind. Selectively replace with one content from among them,
Display control method. to the computer,
a generator that generates image display information;
an acquisition unit that acquires wind detection information generated by the passage of a person from a plurality of wind sensors provided at a gate through which the person passes;
a control unit that controls the display information of the image based on the strength of the wind included in the detection information;
to make it work ,
The control unit controls movement of individual images included in the image based on the strength of the detected wind.
program for. to the computer,
a generator that generates image display information;
Wind detection information generated by the passage of people is collected from multiple wind sensors installed at the gate through which people pass. an acquisition unit for acquiring information;
a control unit that controls the display information of the image based on the strength of the wind included in the detection information;
to make it work,
The control unit converts the image to predetermined content based on the strength of the wind included in the detection information. to switch to the view of
program for. to the computer,
a generator that generates image display information;
Wind detection information generated by the passage of people is collected from multiple wind sensors installed at the gate through which people pass. an acquisition unit for acquiring information;
a control unit that controls the display information of the image based on the strength of the wind included in the detection information;
to make it work,
The control unit selectively selects the image from among a plurality of contents according to the detection information. Replace with one content,
program for.

Images