JP2023080156A - Imaging system and print production system - Google Patents

Abstract

To reduce the mounting cost of a physical sensor and to automatically photograph an object at suitable timing.SOLUTION: An imaging system includes a receiving unit 11 that receives a video signal from an imaging device 2, a detection unit 12 that detects a person area from the video signal, a determination unit 13 that determines whether the person area is within a predetermined area set to the angle of view of the imaging device, and a generating unit 14 that generates an image file from the video signal when the person area is within the predetermined area.SELECTED DRAWING: Figure 1

Description

The present invention relates to a photographing system and a print production system.

In theme parks and the like, there is a service in which a customer is photographed, the printed photograph is pasted on an original mount, and the photograph is sold to the customer. In addition, there is a service that installs cameras at attractions and automatically captures the moment during the attraction experience. For example, there is known a ride photo that automatically captures a moment of excitement such as the moment a roller coaster falls.

A conventional automatic photographing system requires the installation of a physical sensor for detecting the approach/passage of a subject, which is costly. Also, after the physical sensor has detected the subject, it may not be possible to take a picture at a suitable timing. For example, when photographing a passenger on an attraction, the moving speed of the attraction may vary depending on the weight (physique) of the passenger. Because the distance to the camera is different, the size of the person in the photographed image may vary.

Japanese Patent No. 3913453

SUMMARY OF THE INVENTION It is an object of the present invention to provide a photographing system and a printed matter manufacturing system capable of automatically photographing a subject at a suitable timing while reducing the cost of attaching a physical sensor.

A photographing system of the present invention includes a receiving unit for receiving a video signal from a photographing device, a detecting unit for detecting a person area from the picture signal, and a person area within a predetermined area set to the angle of view of the photographing device. and a generation unit for generating an image file from the video signal when the person area is within the predetermined area.

The printed matter production system of the present invention comprises the photographing system of the present invention, an acquisition unit that acquires user identification information via a reader, a transmission unit that transmits the image file and the identification information, and a server device for correlating and storing the received image file and the identification information; upon receiving input of the identification information, notifying the input identification information to the server device; and an image printing device that receives the associated image file and prints out the received image file.

According to the present invention, it is possible to reduce the installation cost of the physical sensor and automatically photograph the subject at suitable timing.

1 is a schematic configuration diagram of a print manufacturing system according to an embodiment of the present invention; FIG. 2a to 2c are diagrams showing examples of detection areas and person areas. FIG. 2 is a schematic diagram of a printed matter; It is a block diagram explaining the function of a control device. 5a and 5b are diagrams showing examples of a detection area and a person area. 6a and 6b are diagrams showing examples of detection areas and person areas. FIG. 10 is a diagram showing changes in the pose of a subject; FIG. 10 is a diagram showing changes in the pose of a subject;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a schematic configuration diagram of a print manufacturing system according to an embodiment of the present invention. As shown in FIG. 1, the print manufacturing system includes a control device 1, a photographing device 2, a display device 3, a reader 4, a server device 5, and an image printing device 6, and prints an image photographed by the photographing device 2. Output. The photographing device 2 is, for example, a digital camera.

This printed matter production system is installed in leisure facilities and the like. For example, the photographing device 2 photographs a scene in which a user U (entrance guest) is enjoying an attraction.

The imaging device 2 transmits video signals captured by the imaging sensor to the control device 1 in real time. For example, a video signal of the field angle area A0 of the photographing device 2 as shown in FIG. The control device 1 sets the detection area A1 within the angle-of-view area A0. The control device 1 generates an image file (for example, still image data) when the subject falls within the detection area A1. Although the position and size of the detection area A1 are arbitrary, it is set, for example, in the central portion of the angle-of-view area A0.

As shown in FIG. 2B, when the user on the attraction enters the angle-of-view area A0, the control device 1 detects a person from the video signal and obtains a person area A2.

As shown in FIG. 2c, when the person area A2 falls within the detection area A1, the control device 1 generates an image file from the video signal. For example, an image file is generated when the person area A2 reaches the center of the detection area A1.

The control device 1 displays the generated image file on the display device 3 . As shown in FIG. 1 , after enjoying the attraction, the user U confirms his or her image displayed on the display device 3 and holds the ticket T over the reader 4 . The ticket T is distributed to each user U at the time of entering the park, and is printed with a two-dimensional code indicating identification information unique to the visitor. The reader 4 reads the two-dimensional code and transmits identification information to the control device 1 .

The control device 1 associates the image file with the identification information and transmits them to the server device 5 . The entering customer U causes the image printing device 6 to read the two-dimensional code of the ticket T when leaving the park. The image printing device 6 notifies the server device 5 of the identification information acquired from the two-dimensional code. When the identification information is notified from the image printing device 6 , the server device 5 transmits the image file linked to the identification information to the image printing device 6 . The image printing device 6 prints the image file received from the server device 5 on paper and outputs it. A visitor U can obtain a commemorative print 7 as shown in FIG.

Next, the configuration of the control device 1 will be described. The control device 1 is a computer including a communication unit, a storage unit, a CPU, etc. As the CPU executes a photographing program, as shown in FIG. 13, the functions of the image file generation unit 14, the display processing unit 15, the identification information acquisition unit 16, and the data transmission unit 17 are realized. The storage unit 10 stores a learned model that outputs a detection frame (rectangle circumscribing the person) surrounding the person in the input image.

The video signal receiving unit 11 receives the current video signal in real time from the imaging device 2 via a wired or wireless network. The video signal is a frame (moving image) generated by the imaging device 2 at regular time intervals. The video signal is stored in a buffer (not shown). The buffer removes the oldest signal and stores the newest signal.

The person detection unit 12 detects a person from the video signal. For example, the person detection unit 12 inputs the video signal (each frame) to a trained model that outputs a detection frame surrounding a person in the input image, and based on the output detection frame, detects the person area A2 (FIG. 2b). ) are detected.

The determination unit 13 determines whether the person area A2 detected by the person detection unit 12 is positioned in the center of the preset detection area A1 within the angle-of-view area A0.

When it is determined that the person area A2 is positioned in the center of the detection area A1, the image file generation unit 14 generates an image file using the frame at this time and stores it in the storage unit 10. FIG.

The display processing unit 15 displays the generated image file on the display device 3 . The display device 3 is, for example, a liquid crystal display.

The identification information acquisition unit 16 acquires the identification information of the user indicated by the two-dimensional code printed on the ticket from the reader 4 .

The data transmission unit 17 associates the image file displayed on the display device 3 with the identification information acquired by the identification information acquisition unit 16 and transmits them to the server device 5 .

As described above, in this embodiment, a person is detected from the video signal generated by the imaging device 2, and an image file is generated when the person is positioned near the center of the angle of view. You can shoot automatically with Even in an attraction where the moving speed varies depending on the physique of the passenger, an image of the user captured near the center of the angle of view can be obtained. Moreover, since a physical sensor for detecting passage of an object or the like is not required, the cost of installing the physical sensor can be reduced.

In the above embodiment, an example of generating an image file when the person area A2 is positioned in the center of the detection area A1 has been described, but as shown in FIG. An image file may be generated at the time.

Alternatively, as shown in FIG. 5b, generation of the image file may be started when part of the person area A2 enters the detection area A1. For example, a moving image of a period in which at least part of the person area A2 overlaps with the detection area A1, or a still image (continuous shot image) that continues at regular time intervals is generated.

An image file may be generated based on the size of the person area A2 in the detection area A1. For example, as shown in FIG. 6a, if the size of the person area A2 is less than a predetermined value, no image file is generated. As shown in FIG. 6b, an image file is generated when the size of the person area A2 reaches or exceeds a predetermined value. As a result, an image of the user in a fixed size can be obtained regardless of the physique.

An image file may be generated when the user takes a particular pose (posture). In this case, a trained model that outputs the posture of a person in the input image is stored in the storage unit 10 . For example, when determining that the person area A2 is included in the detection area A1, the determination unit 13 inputs the video signal (frame) to the learned model and acquires the output result of the person's pose. The determination unit 13 determines whether or not the pose of the output result is a predetermined pose. If the predetermined pose is determined, an image file is generated.

FIG. 7 shows an example of photographing when the user raises both hands and takes a banzai pose while jumping on the trampoline. In the frame at time T1, the person area A2 is included in the detection area A1, but the pose is not the banzai pose, so no image file is generated.

In the frames at times T2 and T3, the person area A2 is included in the detection area A1 and the user is taking a banzai pose, so image files are generated.

In the frame at time T4, the banzai pose is taken, but since part of the person area A2 is outside the detection area A1, no image file is generated.

FIG. 8 shows an example in which a file is generated from a video signal of a user's golf swing when a specific pose is reached. Since the axis of the body hardly moves during the swing, it is assumed that the person area A2 is always in the detection area A1.

Generates a moving image from the detection of a pause such as the frame at time T10 to the detection of the finishing pause such as the frame at time T11, and still images (continuous shot images) that are continuous at regular time intervals. may

A golf club may be detected from a video signal, and generation of a moving image or continuous shots may be started at the timing when the golf club reaches a specific angle. For example, like the frame at time T10, at the timing when the golf club becomes parallel to the ground, generation of the moving image or the like is started.

In the above-described embodiment, human detection from video signals can be performed by image processing based on difference comparison with the background. Since it is difficult to detect a person by comparing differences, it is preferable to use machine learning.

In the above embodiment, an example of detecting a person in real time from a video signal received from the photographing device 2 has been described. A person may be detected by analyzing using machine learning technology and an image file may be generated.

A barcode may be printed on the ticket T instead of the two-dimensional code.

Although the present invention has been described in detail using specific embodiments, it will be apparent to those skilled in the art that various modifications can be made without departing from the spirit and scope of the invention.

1 control device 2 imaging device 3 display device 4 reader 5 server device 6 image printing device

Claims (2)

a receiving unit that receives a video signal from the imaging device;
a detection unit that detects a person area from the video signal;
a determination unit that determines whether or not the person area is within a predetermined area set to the angle of view of the photographing device;
a generating unit that generates an image file from the video signal when the person area is within the predetermined area;
with
The determination unit determines whether or not the person detected from the video signal is posing in a predetermined pose,
The imaging system, wherein the generation unit generates an image file when the person area is within the predetermined area and the person is posing in a predetermined pose. The imaging system according to claim 1;
an acquisition unit that acquires user identification information via a reader;
a transmission unit that transmits the image file and the identification information;
a server device that associates and saves the image file and the identification information received from the transmission unit;
An image for receiving an input of identification information, notifying the input identification information to the server device, receiving an image file associated with the notified identification information from the server device, and printing out the received image file. a printing device;
A print production system comprising:

Images