JP2012103836A - Shadow image display system, shadow image display method and shadow image display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a shadow image display system, a shadow image display method and a shadow image display program capable of enhancing attraction as an interface while removing an unpleasant feeling from a person to be used as security information.SOLUTION: The shadow image display system includes a camera 10 for imaging a person, a position detection part 34a for detecting a position of the person based on the imaged image of the person, a profile extraction part 34b for extracting a profile of the person based on the imaged image, a shadow creation part 34c for creating a shadow image of the person based on the extracted profile, an image output part 34d for outputting the shadow image created by the shadow creation part 34c and an operation control part 34f for performing control in response to the position of the person detected by the position detection part 34a.

Description

  The present invention relates to a shadow image display system, a shadow image display method, and a shadow image display program for performing various controls using an image of an animal shadow.

  Conventionally, a system has been proposed in which a person is imaged by a camera, and a predetermined device is controlled or a specific area is monitored based on the captured image.

  For example, for controlling a predetermined device, a human motion is detected based on an image captured by a camera, and when a predetermined motion is detected, a predetermined control assigned in advance to the motion is detected. A system has been proposed. According to such a system, human movement can be used as an interface for device control.

  Alternatively, as a system for monitoring a specific area, a system is proposed in which a monitoring target is specified based on a video signal from a camera provided in the site, and the position and locus of the specified monitoring target are displayed on a display device. (For example, refer to Patent Document 1). According to such a system, the position and trajectory of a person can be used as security information.

JP 2006-202062 A

  However, in such a system, the movement or position of the person itself is directly used as an interface or security information, and the physical existence of the person is simply used as it is, so the interface is not interesting. There was a problem of discomforting the person being monitored.

  The present invention has been made in view of the above, and in the case where the movement or position of an animal including a person is used as an interface or security information, the fun of the interface is improved or the security information is used. An object of the present invention is to provide a shadow image display system, a shadow image display method, and a shadow image display program capable of removing discomfort for a person.

  In order to solve the above-described problems and achieve the object, the shadow image display system according to claim 1 is based on an imaging unit that images an animal, and an image of the animal captured by the imaging unit. Based on the position detection means for detecting the position of the animal, the contour extraction means for extracting the contour of the animal based on the image of the animal imaged by the imaging means, and the contour extracted by the contour extraction means A shadow generation unit that generates a shadow image of the animal, an image output unit that outputs a shadow image generated by the shadow generation unit, and a position of the animal detected by the position detection unit. Control means for performing control.

  The shadow image display system according to claim 2 detects the movement of the animal based on the position of the animal detected by the position detection means in the shadow image display system according to claim 1. A motion detection unit is provided, and the control unit performs control according to the motion of the animal detected by the motion detection unit.

  The shadow image display system according to claim 3 is the shadow image display system according to claim 1 or 2, wherein the image output means outputs an operation interface in an output area of the shadow image, The control unit performs control according to a relative positional relationship between the operation interface output in the output area of the shadow image and the position of the animal detected by the position detection unit.

  The shadow image display system according to claim 4 is the shadow image display system according to any one of claims 1 to 3, wherein the superimposed image storage stores a superimposed image to be displayed superimposed on the shadow image. The control means acquires from the superimposed image storage means a superimposed image to be displayed superimposed on the shadow image according to the position of the animal detected by the position detection means, and The display position of the acquired superimposed image is determined, and the acquired superimposed image is displayed superimposed on the shadow image based on the determined position.

  The shadow image display method according to claim 5 includes an imaging step of imaging an animal, a position detection step of detecting the position of the animal based on the image of the animal captured by the imaging step, A contour extraction step for extracting the contour of the animal based on the image of the animal imaged in the imaging step, and a shadow generation for generating a shadow image of the animal based on the contour extracted in the contour extraction step An image output step for outputting the shadow image generated in the shadow generation step; and a control step for performing control in accordance with the position of the animal detected in the position detection step.

  A shadow image display program according to claim 6 causes a computer to execute the method according to claim 5.

  According to the shadow image display system according to claim 1, the shadow image display method according to claim 5, and the shadow image display program according to claim 6, an outline is extracted based on an animal image, and the outline is extracted. The shadow image is generated and output based on the image, and further, the control according to the position of the animal is performed. Therefore, various images are used by using a virtual image called the animal shadow image instead of the physical existence of the animal. Since it is possible to perform control, when a shadow image is used as an interface, a virtual interesting interface can be constructed, or when a shadow image is used as security information, a virtual By performing gentle monitoring with information, the discomfort of the monitored person can be reduced.

  In addition, according to the shadow image display system of the second aspect, since the control according to the movement of the animal is performed, it is possible to perform the intuitive and quick control according to the movement.

  Further, according to the shadow image display system according to claim 3, since the control is performed according to the relative positional relationship between the operation interface and the position of the animal, the operation interfaces of various shapes and positions are used. Diversified control can be performed.

  According to the shadow image display system of claim 4, since the superimposed image is displayed superimposed on the shadow image, the virtuality of the output image is further enhanced, so that the interface and security information are interesting and diverse. Can be improved.

It is a perspective view of the space where the shadow image display system concerning Embodiment 1 of the present invention is applied. It is a block diagram which illustrates functionally the shadow image display system concerning Embodiment 1. It is a figure which shows the structural example of operation content definition information. It is a figure which shows the structural example of outline log | history information. It is a figure which shows the structural example of position history information. It is a flowchart of a shadow image display process. It is a block diagram which illustrates functionally the shadow image display system which concerns on Embodiment 2. FIG. It is a figure which shows the structural example of operation content definition information. It is a figure which shows the structural example of merchandise information. It is a flowchart of a shadow image display process. It is a figure which shows the example of an output of a shadow image. It is a block diagram which illustrates functionally the shadow image display system which concerns on Embodiment 3. FIG. It is a figure which shows the structural example of operation content definition information. It is a figure which shows the structural example of security information. It is a flowchart of a shadow image display process. It is a figure which shows the example of an output of a shadow image.

  Hereinafter, embodiments of a shadow image display system, a shadow image display method, and a shadow image display program according to the present invention will be described in detail with reference to the accompanying drawings. [I] First, the basic concept common to each embodiment was explained, then [II] the specific contents of each embodiment were explained, and [III] Finally, modifications to each embodiment were explained. To do. However, the present invention is not limited to each embodiment.

[I] Basic concept common to the embodiments First, the basic concept common to the embodiments will be described. The shadow image display system, the shadow image display method, and the shadow image display program according to each embodiment perform various controls using an animal shadow image in an arbitrary space including a commercial facility, an office, and an amusement facility. Is for doing.

  An animal is a concept that includes an arbitrary organism such as a dog or a cat in addition to a person. For example, it is possible to detect that an animal such as a dog has performed a predetermined operation using a shadow image of the animal (hereinafter referred to as a shadow image) and perform various controls. In this case, the control can be performed regardless of whether or not the animal itself has an intention to perform the control. Below, the case where a person's shadow image is utilized is demonstrated.

  The shadow means an image of the shape of the animal that is formed on the opposite side of the light when the animal blocks the light. Here, in addition to such an image, a projection described later is used. Contains images of animal shapes artificially projected by means. In addition to a black image that completely reflects the outer shape of an animal that blocks light, an image in which the outer shape and color are artificially corrected is included.

  The specific contents of the various controls are arbitrary, and as long as they can be performed using animal shadow images, all types of control are targeted. In the following, when shadow images are used as an interface for device control ( Embodiment 1 and Embodiment 2) and a case where security control is performed using a shadow image (Embodiment 3) will be described.

  One of the features of the shadow image display system, shadow image display method, and shadow image display program according to each embodiment is to generate and output an animal shadow image based on the animal image captured by the imaging means. However, the control is performed according to the position of the animal. In this way, artificially generated shadow images can be used to improve the fun of the interface compared to simply using the physical presence of people as it is, or to people who are used as security information On the other hand, it is possible to avoid discomfort.

[II] Specific Contents of Each Embodiment Next, specific contents of each embodiment will be described.

[Embodiment 1]
First, the first embodiment will be described. In this form, a shadow image is used as an apparatus control interface.

(Constitution)
FIG. 1 is a perspective view of a space to which a shadow image display system 1 according to Embodiment 1 is applied. As shown in FIG. 1, a floor and a wall are arranged in this space, and a shadow image display system 1 is arranged inside or outside the space. Here, it is assumed that a person stands on the floor and a shadow image of the person is projected on the wall. Therefore, the surface of the wall functions as a projection surface for projecting a shadow image.

  FIG. 2 is a block diagram illustrating the shadow image display system 1 in terms of functional concepts. As shown in FIG. 2, the shadow image display system 1 includes a camera 10, a projector 20, and a shadow image display device 30.

(Configuration-Camera)
The camera 10 is an imaging unit that images a person, and outputs the captured image to the shadow image display device 30. For example, the camera 10 is installed toward an area where a person is supposed to stand on the floor. For example, the camera 10 is configured as an infrared thermography camera, detects infrared rays in the imaging region, and outputs a temperature distribution image of the imaging region based on the wavelength distribution of the infrared rays. By using a thermography camera in this way, it is possible to accurately detect the contour of a person based on a captured image even when the illuminance is insufficient or the background is messy. However, if there is no such need, an optical camera may be used.

(Configuration-Projector)
The projector 20 is an image output unit that outputs a shadow image generated by a shadow generation unit 34c described later. For example, the projector 20 is installed at a position where an image can be projected onto a wall and a region where a person is supposed to stand on the floor and a projection light beam do not interfere with each other. For example, the projector 20 is configured as a known projector having an arbitrary structure such as a liquid crystal projector or a DLP projector.

(Configuration-Shadow image display device)
The shadow image display device 30 is a control device that performs control related to shadow image display, and includes an input unit 31, an output unit 32, a storage unit 33, and a control unit 34. The above-described camera 10 and projector 20 are connected to the shadow image display device 30 by wire or wirelessly.

  The input unit 31 is an input unit that inputs information necessary for various processes executed by the shadow image display device 30 to the shadow image display device 30, and is configured as a keyboard and a mouse here.

  The output unit 32 is an output unit that outputs information from the shadow image display device 30 to an external device. Here, the output unit 32 is configured as a monitor, a speaker, and an interface for controlling the external device. The interface for external device control is an interface for transmitting a control signal to the predetermined external device when an operation control unit 34f described later controls the predetermined external device.

  The storage unit 33 is a storage unit that stores a program and various data necessary for the operation of the shadow image display device 30, and is configured using, for example, a hard disk (not shown) as an external storage device. However, any other recording medium including a magnetic recording medium such as a magnetic disk or an optical recording medium such as a DVD or a Blu-ray disk can be used instead of or together with the hard disk.

  The storage unit 33 includes an operation content definition information database (hereinafter referred to as DB) 33a, contour history information DB 33b, and position history information DB 33c.

  The operation content definition information DB 33a is an operation content definition information storage unit that stores operation content definition information for defining the operation content of a predetermined device. As shown in the configuration example of FIG. 3, the operation content definition information is configured by associating an item “operation” and an item “operation content” with information corresponding to these items. The information corresponding to the item “motion” is information for specifying a person's motion, and here, there are four types of information of “right arm raised”, “right arm lowered”, “left arm raised”, and “left arm lowered”. is there. For example, “right arm raising” indicates an operation in which a person raises the right arm upward from below a predetermined reference position. The information corresponding to the item “operation content” is information for specifying the operation content of the predetermined device. Here, “air conditioner ON”, “air conditioner OFF”, “lighting ON”, “lighting OFF” There are four types of information. That is, here, it is assumed that an air conditioner or lighting (both not shown) is controlled as the predetermined device. For example, “air conditioner ON” means that the air conditioner is turned on. Yes. The operation content definition information DB 33a is arbitrarily set by the administrator of the shadow image display system 1 and stored in the storage unit 33 in advance prior to a shadow image display process described later.

  The contour history information DB 33b of FIG. 2 is contour history information storage means for storing contour history information for specifying a history of a person's contour. As shown in the configuration example of FIG. 4, the contour history information is configured by associating the item “time” and the item “contour” with information corresponding to these items. The information corresponding to the item “time” is information for specifying the time at which the contour of the person is detected. For example, when “13:15:25” is present, the person at 13:15:25 This indicates that the contour of is detected. The item “contour” is information for specifying the recorded contour, and here, the image data extracted by the contour extraction unit 34b is recorded.

  The position history information DB 33c in FIG. 2 is a position history information storage unit that stores position history information for specifying a person's position history. As shown in the configuration example of FIG. 5, the position history information is configured by associating an item “time” and an item “position” with information corresponding to these items. The information corresponding to the item “time” is the same as the information corresponding to the same item name in FIG. The item “position” further includes an item “center”, an item “right arm”, and an item “left arm”. The information corresponding to the item “center” is the position of the center of the person (here, a predetermined reference position). Indicates the distance (coordinates) between the vertical direction (y direction) and the horizontal direction (x direction), and the information corresponding to the item “right arm” is the position of the right arm of the person (here, whether it is above a predetermined reference position) The information corresponding to the item “right arm” indicates the position of the left arm of the person (in this case, whether it is above or below the predetermined reference position). For example, when the information corresponding to the item “right arm” is “upper”, it indicates that the right arm is above a predetermined reference position. This position history information is stored in the storage unit 33 in a shadow image display process described later.

  The control unit 34 in FIG. 2 is a processing unit that performs calculation processing related to the shadow image display device 30. Specifically, the CPU, various programs interpreted on the CPU (basic control programs such as an OS, And an internal memory such as a RAM for storing various programs including a shadow image display program and various data. The program is recorded on an arbitrary recording medium including a magnetic recording medium and an optical recording medium, and is installed in the storage unit 33.

  The control unit 34 includes a position detection unit 34a, a contour extraction unit 34b, a shadow generation unit 34c, an image output unit 34d, an operation detection unit 34e, and an operation control unit 34f in terms of functional concept. The position detection unit 34 a is a position detection unit that detects the position of the person based on the person image captured by the camera 10. The contour extracting unit 34 b is a contour extracting unit that extracts a human contour based on a human image captured by the camera 10. The shadow generation unit 34c is a shadow generation unit that generates a human shadow image based on the contour extracted by the contour extraction unit 34b. The image output unit 34d is an image output unit that outputs the shadow image generated by the shadow generation unit 34c. The motion detection unit 34e is a motion detection unit that detects a human motion based on the position of the person detected by the position detection unit 34a. The operation control unit 34f is a control unit that performs control according to the position of the person detected by the position detection unit 34a. Details of the processes executed by these units will be described later.

(processing)
Next, a shadow image display process executed by the shadow image display system 1 configured as described above will be described. FIG. 6 is a flowchart of the shadow image display process (in the following description of each process, step is abbreviated as “S”).

  This shadow image display process is automatically started after the shadow image display device 30 is turned on, or is started when a start instruction is input to the shadow image display device 30 via the input unit 31. . When the shadow image display process is activated, the contour extraction unit 34b analyzes the image input from the camera 10 to extract a human contour, and acquires image data of the extracted contour by a known method. The contour is stored in the contour history information DB 33b in association with the time when the contour is detected (SA1). This extraction can be performed by a known algorithm. For example, the image is binarized with a predetermined threshold value, and the binarized image is subjected to a labeling process to group the regions. The largest area is identified as a human area, and the outline of the identified area is extracted as a human outline.

  Further, the position detection unit 34a detects the position of the person based on the image of the person captured by the camera 10, and the detected position of the person is obtained at the time of detection of the position acquired by a known method. In association therewith, it is stored in the position history information DB 33c (SA2). Here, the “position” is detected so that at least whether or not a person has performed a predetermined control operation can be recognized. This includes the case of detecting the position of a part (for example, an arm or a leg). Further, not only the position on the absolute coordinate based on the latitude and longitude, but also a position on the relative coordinate with respect to the predetermined reference may be detected.

  Here, it is assumed that the relative position of the person's center and the relative positions of the left and right arms with respect to a predetermined reference set in an area where a person is supposed to stand on the floor are detected. The detection of the position of the person in SA3 can be performed by a known algorithm. For example, the outline of the person is extracted in the same manner as SA1, and the person's top, bottom, left and right centers are extracted from the outline of the person. The contour of the arm can be extracted by extracting the position or extracting a partial contour that matches the characteristic position or shape of the contour of the human arm. In addition, by registering the positional relationship between the camera 10 and the floor in the position detection unit 34a in advance, it is possible to specify the position of the center of the person and the relative position of the arm with respect to a predetermined reference. The detection of the position of the person and the recording in the position history information DB 33c are performed at a predetermined interval (for example, every 5 seconds) or only when it is determined that the position of the person has changed from the position at the previous detection. You may do it.

  Next, the motion detector 34e detects the motion of the person based on the position of the person detected by the position detector 34a (SA3). This operation is detected based on the position history information stored in the position history information DB 33c. That is, the motion detection unit 34e specifies a human trajectory based on the time and position stored in association with each other as the position history information, and specifies the human motion based on the trajectory. For example, “time” = “13:15:25” and “position” = “right arm” = “down” are recorded in association with the position history information, and “time” = “13:15:30”. When “position” = “right arm” = “upper” is recorded in association with each other, the right arm of “13:15:25” to “13:15:30” (in this example, 5 seconds) is recorded. Since it can be identified as the locus that the right arm has moved from the bottom to the top, it is identified that “human motion” = “right arm raised”.

  And the operation control part 34f controls a predetermined apparatus based on the operation | movement of the person detected by the operation | movement detection part 34e (SA4). Specifically, the operation control unit 34f specifies whether or not there is an operation content corresponding to the human motion detected by the motion detection unit 34e by referring to the operation content definition information DB 33a, and the operation content If there is, the predetermined device is controlled based on the operation content. For example, when “human motion” = “right arm raised”, “operation content” = “air conditioner ON” is specified, and a control signal for turning on the air conditioner is sent to the external device control of the output unit 32. Output to the air conditioner wirelessly or via a cable interface. By performing such a process, it is possible to control the predetermined device based on the person's operation, and therefore it becomes possible to use the human operation as an interface for controlling the predetermined device.

  Next, the shadow generation unit 34c generates a human shadow image based on the contour extracted by the contour extraction unit 34b in SA1 (SA5). The shadow image is generated by filling a region surrounded by the contour extracted by the contour extraction unit 34b with black or another predetermined color.

  Here, the shadow generation unit 34c uses a shadow image corresponding to the position of the person at the current time point as the person's shadow image, and the position of the person at one or more predetermined time points (here, two time points). A shadow image corresponding to is generated in different colors, and the shadow image to be finally projected is generated by superimposing the plurality of shadow images. In other words, the shadow generation unit 34c obtains the contour image data corresponding to the latest time from the contour history information recorded in the contour history information DB 33b as the shadow image corresponding to the position of the person at the current time point. The region surrounded by the contour is acquired and filled with a predetermined first color (here, red). Further, the shadow generation unit 34c, as a shadow image corresponding to the position of the person at the past time point, has a contour corresponding to the time immediately before the latest from the contour history information recorded in the contour history information DB 33b. And the image data of the contour corresponding to the time two times before the latest are acquired, and the area surrounded by the contour corresponding to the previous time is filled with a predetermined second color (here, green) In addition, the region surrounded by the contour corresponding to the previous two times is filled with a predetermined third color (here, blue).

  Then, the shadow generation unit 34c generates a plurality of (in this case, three) shadow images generated in this way, and the position of the center of each shadow image is stored in the position history information DB 33c. In this case, the images are superimposed so that the positions correspond to the positions of the center of the person corresponding to the image data used to generate each shadow image. Note that the number of shadow images generated in this way is arbitrary, and at least one shadow image may be used. By using a plurality of shadow images in this way, a shadow image that can visually grasp a human motion trajectory is obtained. Can be generated. Also, the color of the shadow image is arbitrary, and all the shadow images may be the same color, but by using the three primary colors of red, green, and blue light in this way, an area where all the shadow images are superimposed Can enhance visual effects such as whitening.

  Next, the image output unit 34d outputs the shadow image generated by the shadow generation unit 34c via the projector 20 (SA6). That is, by outputting the shadow image data generated by the shadow generator 34c to the projector 20, the shadow image is projected from the projector 20 onto the wall. At this time, the positional relationship between the projector 20 and the wall is registered in the image output unit 34d in advance, thereby calculating the projection magnification when the shadow image is projected onto the wall from the projector 20, and based on this projection magnification. The position and size of the shadow image projected on the wall may be controlled. For example, the shadow image may be projected so that the lower end position thereof matches the lower end position of the wall. Alternatively, the position detection unit 34a may detect a person's position and project a shadow image on the surface of the wall closest to the detected person's position. When performing such control, if necessary, the projector 20 is provided with a zoom mechanism for adjusting the projection magnification and a moving mechanism for adjusting the projection position, and these mechanisms are controlled by a control signal from the image output unit 34d. You may make it control.

  The processes from SA1 to SA6 are repeatedly performed continuously after the shadow image display process is activated. For this reason, when a person is standing on the floor, the shadow image of the person continues to be projected on the wall in almost real time, and each time the person performs an action, the shadow image corresponding to the action is almost real time on the wall. Continue to be projected. Thereafter, when an end instruction is input to the shadow image display device 30 via the input unit 31 (SA7, Yes), the shadow image display process ends.

(Effect of Embodiment 1)
According to the first embodiment, a contour is extracted based on a person's image, a shadow image is generated and output based on the contour, and further, control according to the position of the person is performed. Various controls can be performed using a virtual image called a human shadow image instead of a physical existence, and when a shadow image is used as an interface, a virtual interesting interface is constructed. be able to.

  In addition, since control is performed according to a person's action, it is possible to perform intuitive and quick control according to the action.

[Embodiment 2]
Next, a second embodiment will be described. This form is a form in which a shadow image is used as an interface for device control, and in particular, a form in which another image is superimposed and displayed on the shadow image. However, configurations and methods similar to those of the first embodiment are denoted by the same reference numerals as those used in the first embodiment, and description thereof is omitted, or description is simply omitted.

(Constitution)
FIG. 7 is a block diagram illustrating a functional concept of the shadow image display system 2 according to the second embodiment. As shown in FIG. 7, the shadow image display system 2 includes a camera 10, a projector 20, and a shadow image display device 40.

  The shadow image display device 40 is configured in substantially the same manner as the shadow image display device 30 of the first embodiment, but here, the operation content different from that of the first embodiment is stored in the operation content definition information DB 33a of the storage unit 33. Definition information is stored, and a product information DB 33 d is provided in the storage unit 33.

  As shown in the configuration example of FIG. 8, the operation content definition information in the operation content definition information DB 33a is configured by associating the item “operation” and the item “operation content” with information corresponding to these items. The information corresponding to the item “motion” is information for specifying a person's motion. Here, in addition to the two types of information “raising the right arm” and “raising the left arm”, “touch the operation interface” Is stored. “Touching the operation interface” indicates an operation in which a person touches the operation interface projected on the wall (more precisely, a shadow image projected on the wall based on the outline of the person). The information corresponding to the item “operation content” is information for specifying the operation content of the predetermined device, and here is three types of information of “shirt change”, “cap change”, and “clear”. That is, here, it is assumed that the shadow image display device 40 is controlled as a predetermined device, and specifically, a product (here, clothes) that is superimposed and displayed on the shadow image in the shadow image display device 40. It is assumed that the image data is switched. For example, “change shirt” means to change the shirt superimposed on the shadow image, and “clear” means to clear the clothes superimposed on the shadow image (do not superimpose). Means.

  The product information DB 33d in FIG. 7 is a superimposed image storage unit that stores product information about a product (in this case, a superimposed image displayed by being superimposed on a shadow image). As shown in the configuration example of FIG. 9, the product information is configured by associating an item “type” and an item “image data” with information corresponding to each item. The information corresponding to the item “type” is information for specifying the type of product, and here, “shirt” and “hat”. The information corresponding to the item “image data” is image data of each product, and a plurality of image data corresponding to “shirt” and “hat” are stored.

(processing)
Next, a shadow image display process executed by the thus configured shadow image display system 2 will be described. FIG. 10 is a flowchart of the shadow image display process. However, SB1 and SB2 are the same as SA1 and SA2 in FIG.

  In SB3, the motion detector 34e detects a human motion based on the position of the person detected by the position detector 34a (SB3). The detection of this operation is performed based on the position history information stored in the position history information DB 33c, similarly to SA3 in FIG. Further, the motion detection unit 34e detects whether or not the shadow of the person projected on the wall has touched the operation interface projected on the wall. That is, the motion detection unit 34e is based on the position of the latest shadow image generated by the shadow generation unit 34c and the predetermined projection position of the operation interface set in an area where a person is supposed to stand on the floor. It is determined whether or not the position of the person has passed the predetermined projection position. If the position has passed, it is determined that the person has touched the operation interface projected on the wall.

  And the operation control part 34f controls a predetermined apparatus based on the operation | movement of the person detected by the operation | movement detection part 34e (SB4). Specifically, the operation control unit 34f specifies whether or not there is an operation content corresponding to the human motion detected by the motion detection unit 34e by referring to the operation content definition information DB 33a, and the operation content If there is, the predetermined device is controlled based on the operation content. For example, when “person's action” = “right arm raised”, “operation content” = “change shirt” is specified, and the shirt image to be superimposed on the shadow image in SB5 described later is stored in the product information DB 33d. The image is changed to an image in a predetermined order in the stored shirt image (here, the image of the next shirt with respect to the currently superimposed shirt image). Alternatively, if “human action” = “touch the operation interface”, “operation content” = “clear” is specified, and the shirt and hat images superimposed on the shadow image are cleared in SB5 described later. Yes (eliminates the image to be superimposed). By performing such a process, it is possible to control the predetermined device based on the person's operation, and therefore it becomes possible to use the human operation as an interface for controlling the predetermined device.

  Next, the shadow generation unit 34c generates a human shadow image based on the contour extracted by the contour extraction unit 34b in SB1 (SB5). Here, after generating a shadow image in the same manner as SA5, the image of the clothes specified in SB4 is superimposed on the image data of the contour corresponding to the latest time. Specifically, the image data of the clothes specified in SB4 is acquired with reference to the product information DB 33d. In addition, referring to the position of the person's center in the latest position history information stored in the position history information DB 33c, the overlapping position (in the case of a shirt, the position of the upper body of the person, in the case of a hat) The position of the person's head). Then, the image data is superimposed on the specified position.

  The shadow generation unit 34c adds an operation interface to the shadow image. That is, the image data having a predetermined shape (here, circular) is added to the shadow image so as to be projected onto a predetermined position on the wall. The position and shape of the operation interface are determined so that a person standing on the floor can recognize and touch. Here, the operation interface is added to the shadow image, but only the operation interface may be projected. For this purpose, for example, another projector in addition to the projector 20 may be used. Simultaneously connected to the shadow image display system 2, only the operation interface is projected by the other projector.

  Then, the image output unit 34d outputs the shadow image generated by the shadow generation unit 34c via the projector 20 (SB6). FIG. 11 illustrates an output example of such a shadow image. This output example shows an example in which a shirt is superposed on a human torso. In this output example, the portions other than the left arm of the three shadow images are overlapped, and the shirt image is further overlapped on the overlapped portion.

  The processes from SB1 to SB6 are repeatedly performed continuously after the shadow image display process is activated. For this reason, a shadow image in which different clothes are superimposed according to the motion detected by the SB4 is projected on the wall. Therefore, if you are standing on the floor, the latest image will be displayed according to your motion. Since shirts and hats are switched and displayed in the shadow image, it is possible to give a feeling that various clothes are virtually tried on. Further, since an operation interface is added to the shadow image, by touching the operation interface, the clothes superimposed on the own shadow image can be cleared. Thereafter, when an end instruction is input to the shadow image display device 40 via the input unit 31 (SB7, Yes), the shadow image display process ends.

(Effect of Embodiment 2)
According to the second embodiment, in addition to the same effects as those of the first embodiment, control is performed according to the relative positional relationship between the operation interface and the position of the person. Various controls using the interface can be performed.

  In addition, since the superimposed image is displayed superimposed on the shadow image, it is possible to improve the fun and diversity of the interface and security information by further increasing the virtuality of the output image.

[Embodiment 3]
Next, Embodiment 3 will be described. In this form, a shadow image is used for security. However, configurations and methods similar to those of the first embodiment are denoted by the same reference numerals as those used in the first embodiment, and description thereof is omitted, or description is simply omitted.

(Constitution)
FIG. 12 is a block diagram illustrating a functional concept of the shadow image display system 3 according to the third embodiment. As shown in FIG. 12, the shadow image display system 3 includes a camera 10, a projector 20, a card reader 50, and a shadow image display device 60.

  The card reader 50 is a non-contact card reader that reads a personal ID recorded on an RFID card held by a person passing through the floor in a non-contact manner.

  The shadow image display device 60 is configured in substantially the same manner as the shadow image display device 30 of the first embodiment, but here, the contour history information DB 33b and the position history information DB 33c of the storage unit 33 are omitted and stored. The operation content definition information DB 33a of the unit 33 stores operation content definition information different from that of the first embodiment, and the storage unit 33 is provided with a security information DB 33e. The control unit 34 is provided with an authentication unit 34g.

  As shown in the configuration example of FIG. 13, the operation content definition information in the operation content definition information DB 33a is configured by associating the item “authentication result” and the item “operation content” with information corresponding to these items. The information corresponding to the item “authentication result” is information for specifying the authentication result by the authentication unit 34g described later. Here, “warning level = zero”, “warning level = low”, “warning level = medium” ”And“ warning level = high ”are stored. For example, “warning level = zero” means that there is no need to perform warning of a person who has been authenticated as a result of authentication in the authentication unit 34g, and “warning level = low” As a result of the authentication performed by the authenticating unit 34g, it means that the person who is the subject of authentication needs to be alerted at a minimum level. The information corresponding to the item “operation content” is information for specifying the operation content of the predetermined device. Here, “shadow image = none”, “shadow image = blue”, “shadow image = green”, “ The four types of information are “shadow image = red”. That is, here, it is assumed that the shadow image display device 60 is controlled as a predetermined device. Specifically, the presence / absence and color of the shadow image generated and output by the shadow image display device 60 are switched. Assumed. For example, “shadow image = none” means that no shadow image is output, and “shadow image = blue” means that a blue shadow image is generated and output.

  The security information DB 33e in FIG. 12 is security information storage means for storing security information related to security. As shown in the configuration example of FIG. 14, the security information is configured by associating an item “personal ID” and an item “authentication result” with information corresponding to these items. The information corresponding to the item “personal ID” is a personal ID recorded on an RFID card held by a person passing through the floor. “Personal ID” = “None” means that the person who passes the floor does not hold the RFID card or holds the RFID card for some reason from the RFID card. Means that could not be read. The information corresponding to the item “authentication result” is the same as the information corresponding to the same item name in the operation content definition information of FIG.

  Further, the authentication unit 34g of the control unit 34 in FIG. 12 is an authentication unit that performs human authentication. Details of the processing executed by the authentication unit 34g will be described later.

(processing)
Next, a shadow image display process executed by the shadow image display system 3 configured as described above will be described. FIG. 15 is a flowchart of the shadow image display process. However, SC1 is the same as SA1 in FIG.

  In SC2, the position detection unit 34a detects the position of a person in the same manner as SA2 in FIG. However, information is not stored in the position history information DB 33c here (SC2).

  Next, the authentication unit 34g performs authentication corresponding to the personal ID for the person whose contour is extracted in SA1 (SC3). Specifically, the authentication unit 34g takes in the output from the card reader 50 when the outline of the person is extracted in SA1, acquires the personal ID from the output, and displays the authentication result corresponding to the personal ID as security information. Obtained from the DB 33e.

  And the operation control part 34f controls a predetermined apparatus based on the authentication result of the authentication part 34g (SC4). Specifically, the operation control unit 34f acquires the operation content corresponding to the authentication result of the authentication unit 34g from the operation content definition information DB 33a, and acquires the presence / absence and color of the shadow image generated in SC5 described later. Switch according to the operation.

  Next, the shadow generation unit 34c generates a human shadow image based on the contour extracted by the contour extraction unit 34b in SC1 (SC5). Here, a shadow image is generated based on the operation content acquired in SC4. That is, when the operation content is “shadow image = none”, no shadow image is generated, and when the operation content is “shadow image = blue”, only the blue shadow image is shown in FIG. Generated in the same manner as SA5.

  Then, the image output unit 34d outputs the shadow image generated by the shadow generation unit 34c via the projector 20 (SC6). FIG. 16 shows an output example of such a shadow image. In this output example, the shadow image is not output for the person on the right side in the figure because the alert level is zero, and the person on the left side in the figure is green because the alert level is medium. An example in which a shadow image is output is shown.

  The processes from SC1 to SC6 are continuously repeated after the shadow image display process is started. For this reason, a shadow image is displayed on the wall according to the security level of the person standing on the floor, so that the security level of the person can be easily and gently adjusted to a third party (warning lamp or alarm buzzer). Compared to the case where an alarm or the like is performed, the notification can be made in a form with less stimulation. Thereafter, when an end instruction is input to the shadow image display device 60 via the input unit 31 (SC7, Yes), the shadow image display process ends.

(Effect of Embodiment 3)
According to the third embodiment, in addition to the same effects as those of the first embodiment, a contour is extracted based on a human image, a shadow image is generated and output based on the contour, and the position of the human When a shadow image is used as security information, it is possible to perform various controls using a virtual image called a person's shadow image instead of the physical presence of a person. Therefore, it is possible to reduce the discomfort of the person being monitored by performing gradual monitoring using virtual information.

[III] Modifications to Each Embodiment While each embodiment has been described above, the specific configuration and means of the present invention are within the scope of the technical idea of each invention described in the claims. Modifications and improvements can be made arbitrarily. Hereinafter, such a modification will be described.

(About problems to be solved and effects of the invention)
First, the problems to be solved by the invention and the effects of the invention are not limited to the above contents, and may vary depending on the implementation environment of the invention and the details of the configuration, and only a part of the problems described above. May be solved, or only some of the effects described above may be achieved. Furthermore, according to the present invention, problems not described above may be solved or effects not described above may be achieved.

(About distribution and integration)
Further, each of the electrical components described above is functionally conceptual and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution / integration of each part is not limited to the one shown in the figure, and all or a part thereof may be functionally or physically distributed / integrated in arbitrary units according to various loads and usage conditions. Can be configured. For example, the functions of the shadow image display devices 30, 40, 60 may be distributed to a plurality of servers and personal computers.

(About the mutual relationship of each embodiment)
The configuration and processing of each embodiment can be mixed or interchanged. For example, in the second embodiment, an operation interface is projected onto a wall, and predetermined control is performed when a person touches the operation interface. However, this function may be applied to the first embodiment. Good.

(About control standards)
In the first and second embodiments, the control is performed based on the movement of the person. However, the person's state (for example, a state where the person has stopped at a predetermined position for a predetermined time or longer) and a locus (for example, the tip of the right arm is S-shaped). Control may be performed on the basis of (moved along a curve). In the second embodiment, the predetermined control is performed when a person touches the operation interface. However, the predetermined control is performed when a part of the human body enters the predetermined range with respect to the operation interface. Also, the relationship with the operation interface that becomes the control reference can be changed.

1, 2, 3 Shadow image display system 10 Camera 20 Projector 30, 40, 60 Shadow image display device 31 Input unit 32 Output unit 33 Storage unit 33a Operation content definition information DB
33b Outline history information DB
33c Location history information DB
33d Product information DB
33e Security information DB
34 control unit 34a position detection unit 34b contour extraction unit 34c shadow generation unit 34d image output unit 34e motion detection unit 34f operation control unit 50 card reader

Claims (6)

Imaging means for imaging animals;
Position detecting means for detecting the position of the animal based on the image of the animal imaged by the imaging means;
Contour extracting means for extracting the contour of the animal based on the image of the animal imaged by the imaging means;
Based on the contour extracted by the contour extracting means, a shadow generating means for generating a shadow image of the animal;
Image output means for outputting a shadow image generated by the shadow generation means;
Control means for performing control according to the position of the animal detected by the position detection means;
A shadow image display system comprising: Based on the position of the animal detected by the position detection means, comprising motion detection means for detecting the motion of the animal;
The control means performs control according to the movement of the animal detected by the movement detection means.
The shadow image display system according to claim 1. The image output means outputs an operation interface in an output area of the shadow image,
The control means performs control according to a relative positional relationship between the operation interface output in the output area of the shadow image and the position of the animal detected by the position detection means.
The shadow image display system according to claim 1 or 2. A superimposed image storage means for storing a superimposed image to be displayed superimposed on the shadow image;
The control means acquires from the superimposed image storage means a superimposed image to be displayed superimposed on the shadow image in accordance with the position of the animal detected by the position detection means, and the acquired superimposed image. And displaying the superimposed image obtained by superimposing the acquired superimposed image on the shadow image based on the determined position.
The shadow image display system according to any one of claims 1 to 3. An imaging step for imaging animals;
A position detecting step for detecting the position of the animal based on the image of the animal imaged in the imaging step;
A contour extracting step for extracting a contour of the animal based on the image of the animal imaged in the imaging step;
A shadow generation step of generating a shadow image of the animal based on the contour extracted in the contour extraction step;
An image output step for outputting the shadow image generated in the shadow generation step;
A control step for performing control according to the position of the animal detected in the position detection step;
Shadow image display method including   A shadow image display program for causing a computer to execute the method according to claim 5.

Images