JP2024013956A - Information processing method, information processing device and program - Google Patents

Abstract

[Problem] To record a photographed person who is away from a camera at an appropriate timing.
[Solution]
An information processing method according to an embodiment is an information processing method executed by an information processing apparatus including a display and a camera that photographs the display side, and includes a process of acquiring a moving image photographed by the camera; The method includes a process of estimating a skeleton of the photographed person included in the video, a process of determining whether the estimated skeleton satisfies a start condition, and a process of starting recording when the start condition is satisfied. .
[Selection diagram] Figure 5

Description

The present invention relates to an information processing method, an information processing device, and a program.

In recent years, services that record videos of people exercising and analyze them using AI are becoming more popular. As a technology for realizing such a barbis, Cited Document 1 discloses an image acquisition section that acquires a moving image of the subject, and a predetermined posture recognition method that recognizes the posture of the subject from the moving image. a feature estimation unit that estimates a plurality of body feature points of the examiner; a reference storage unit that stores a reference length that is a length in the real world of a predetermined reference part; and a reference length that is determined from the estimated plurality of body feature points. Based on the ratio of the distance on the image corresponding to the reference part and the reference length, the distance on the image between the plurality of body feature points is used as a value to be used for evaluating the movement of the subject. An operating state evaluation system is disclosed, which includes a motion analysis section that obtains a value indicative of the operating state, and an output section that outputs the value indicative of the operating state.

Patent No. 6703199

Videos used in such services often need to show the whole body of the person being photographed while exercising. In order to take a picture of the whole body with a camera, the person being photographed needs to be a certain distance away from the camera.

On the other hand, it is preferable that videos analyzed by AI do not include unnecessary scenes. Therefore, it is important to start and end recording at appropriate timings.

Since it is difficult to start and stop recording at an appropriate timing from a position away from the camera, it has been difficult for the person being photographed to record an appropriate video by themselves.

The present invention has been made in view of the above-mentioned problems, and an object of the present invention is to record a photographed person who is away from the camera at an appropriate timing.

An information processing method according to an embodiment is an information processing method executed by an information processing apparatus including a display and a camera that photographs the display side, and includes a process of acquiring a moving image photographed by the camera; The method includes a process of estimating a skeleton of the photographed person included in the video, a process of determining whether the estimated skeleton satisfies a start condition, and a process of starting recording when the start condition is satisfied. .

According to one embodiment, a person to be photographed who is away from the camera can be recorded at an appropriate timing.

FIG. 1 is a diagram illustrating an example of a hardware configuration of an information processing device. FIG. 1 is a diagram illustrating an example of a functional configuration of an information processing device. 3 is a flowchart illustrating an example of processing executed by the information processing device. It is a figure showing an example of standby screen Sc1. It is a figure showing an example of standby screen Sc1. It is a figure showing an example of countdown screen Sc2. It is a figure showing an example of recording screen Sc3. It is a figure showing an example of recording screen Sc3. It is a figure showing an example of recording screen Sc3.

Hereinafter, each embodiment of the present invention will be described with reference to the accompanying drawings. Note that in the descriptions of the specifications and drawings related to each embodiment, the same reference numerals are given to the constituent elements having substantially the same functional configuration to omit redundant explanation.

<Overview of photographing device 1>
First, an overview of the photographing device 1 according to the present embodiment will be explained. The photographing device 1 according to this embodiment is an information processing device including a display and a camera. The photographing device 1 is, for example, a PC (Personal Computer), a smartphone, a tablet terminal, or a digital camera, but is not limited thereto. The photographing device 1 automatically photographs a video of a user exercising at an appropriate timing. Exercises here include, but are not limited to, walking, running, swimming, dancing, training, Pilates, yoga, or any form of sports.

By using this photographing device 1, the user can photograph (self-portrait) a video of himself/herself exercising that is suitable for analysis by AI. In this specification, a user corresponds to a person being photographed in a video.

More specifically, the user installs the photographing device 1 with the display facing toward himself, activates the camera that photographs the display side, and moves to a position where his movements are captured on the camera. Then, the photographing device 1 starts and ends recording based on the skeletal information of the user (photographed person) captured by the camera. The photographing device 1 also displays a predetermined screen on the display so that the user can know the start timing and end timing of recording. The user starts and finishes exercise according to the screen displayed on the display. As a result, a video of the user exercising, which does not include unnecessary scenes other than the exercise, is captured.

The video shot in this way can be used as a video to be analyzed in any video analysis service that uses AI to analyze the motion of the person being photographed. For example, by analyzing a video of a person walking using a gait analysis service, it is possible to evaluate one's own walking ability from the video.

<Hardware configuration of information processing device>
Next, the hardware configuration of the information processing device 100 will be explained. FIG. 1 is a diagram illustrating an example of the hardware configuration of the information processing apparatus 100. As shown in FIG. 1, the information processing device 100 includes a processor 101, a memory 102, a storage 103, a communication I/F 104, an input/output I/F 105, and a drive, which are interconnected via a bus B. A device 106 is provided.

The processor 101 controls each configuration of the information processing device 100 and operates the functions of the information processing device 100 by loading various programs including an OS (Operating System) stored in the storage 103 into the memory 102 and executing them. Realize. The processor 101 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), or a combination thereof.

The memory 102 is, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), or a combination thereof. The ROM is, for example, a PROM (Programmable ROM), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), or a combination thereof. The RAM is, for example, DRAM (Dynamic RAM), SRAM (Static RAM), or a combination thereof.

The storage 103 stores various programs and data including an OS. The storage 103 is, for example, a flash memory, an HDD (Hard Disk Drive), an SSD (Solid State Drive), an SCM (Storage Class Memories), or a combination thereof.

The communication I/F 104 is an interface for connecting the information processing device 100 to an external device via a network and controlling communication. The network is, for example, a wired LAN (Local Area Network), a wireless LAN, the Internet, a public network, a mobile data communication network, or a combination thereof. The communication I/F 104 is, for example, an adapter compliant with Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), Ethernet (registered trademark), or optical communication, but is not limited thereto. .

The input/output I/F 105 is an interface for connecting the input device 107 and the output device 108 to the information processing device 100. The input device 107 is, for example, a mouse, keyboard, touch panel, microphone, scanner, camera, various sensors, operation buttons, or a combination thereof. Output device 108 is, for example, a display, a projector, a printer, a speaker, a vibrator, or a combination thereof. The photographing device 1 includes at least a display and a camera for photographing the display side.

The drive device 106 reads and writes data on the disk medium 109. Drive device 106 is, for example, a magnetic disk drive, an optical disk drive, a magneto-optical disk drive, or a combination thereof. The disk media 109 is, for example, a CD (Compact Disc), a DVD (Digital Versatile Disc), an FD (Floppy Disk), an MO (Magneto-Optical disk), a BD (Blu-ray (registered trademark) Disc), or a combination thereof. It is.

Note that in this embodiment, the program may be written into the memory 102 or the storage 103 at the manufacturing stage of the information processing apparatus 100, may be provided to the information processing apparatus 100 via a network, or may be provided to the information processing apparatus 100 via the disk medium 109. The information may be provided to the information processing apparatus 100 via a non-transitory computer-readable recording medium such as.

<Functional configuration of photographing device 1>
Next, the functional configuration of the photographing device 1 will be explained. FIG. 2 is a diagram showing an example of the functional configuration of the photographing device 1. As shown in FIG. As shown in FIG. 2, the photographing device 1 includes a communication section 11, a storage section 12, and a control section 13.

The communication unit 11 is realized by the communication I/F 104. The communication unit 11 transmits and receives information to and from an external device via the network. For example, the communication unit 11 transmits the video file 124 to a video analysis service and receives analysis results from the video analysis service.

The storage unit 12 is realized by a memory 102 and a storage 103. The storage unit 12 stores a captured video 121, skeleton information 122, condition information 123, and a video file 124.

The captured video 121 is a video captured by a camera. The captured video 121 is temporarily stored in the storage unit 12.

The skeletal information 122 is information regarding the skeletal structure of the person photographed in the photographed video 121. The skeleton information 122 includes information indicating the type and coordinates of one or more skeletons designed in advance. Skeletal information is stored for each frame of the captured video 121. Note that the skeleton can be designed arbitrarily.

Condition information 123 is information regarding start conditions and end conditions for recording (generation of video file 124). The start condition and end condition are set based on the skeleton information 122. The start condition and end condition will be described in detail later.

The video file 124 is a file of a video of a person to be photographed (user) exercising, which is generated by the photographing device 1 . A portion of the captured video 121 from the start of recording to the end of recording is saved as one video file 124.

The control unit 13 is realized by the processor 101 reading a program from the memory 102, executing it, and cooperating with other hardware configurations. The control unit 13 controls the entire operation of the photographing device 1. The control unit 13 includes an acquisition unit 131, an estimation unit 132, a determination unit 133, a display control unit 134, a shooting control unit 135, and a video generation unit 136.

The acquisition unit 121 acquires a moving image from the camera that has started shooting. The acquisition unit 121 stores the acquired video in the storage unit 12 as a captured video 121.

The estimation unit 132 estimates the skeleton of the photographed person included in each frame (image) of the photographed video 121 using a skeleton estimation (posture estimation) model. Any existing model such as OpenPose can be used as the skeleton estimation model. The estimation unit 132 may detect the photographed person from the image and estimate the skeleton of the detected photographed person, or may directly estimate the skeleton from the image. The estimation unit 132 stores information regarding the estimated skeleton in the storage unit 12 as skeleton information 122.

The determining unit 133 determines whether the recording start condition and end condition are satisfied based on the skeleton information 122 and the condition information 123. The start condition and end condition will be described in detail later.

The display control unit 134 controls the screen displayed on the display.

The photographing control unit 135 controls photographing by the camera.

The video generation unit 136 generates a video file 124 from the captured video 121.

Note that the functional configuration of the photographing device 1 is not limited to the above example. For example, the photographing device 1 may include a part of the above functional configuration, and the remaining functional configuration may be provided by an external device connected via a network. Further, the photographing device 1 may have functional configurations other than those described above. Further, as described above, each functional configuration of the imaging device 1 may be realized by software, or by hardware such as an IC chip, SoC (System on Chip), LSI (Large Scale Integration), or microcomputer. It's okay.

<Processing executed by photographing device 1>
Next, processing executed by the photographing device 1 according to this embodiment will be described. FIG. 3 is a flowchart illustrating an example of a process executed by the photographing device 1. In the following, an example will be described in which the photographing device 1 is a smartphone and the photographing device 1 photographs a video of a person to be photographed walking a predetermined distance toward the camera.

(Step S101)
First, the user sets the photographing device 1 on a tripod or the like, operates the photographing device 1, and activates a camera that photographs the display side of the photographing device 1. The photographing control unit 135 starts photographing using the camera on the display side in response to the user's operation (step S101). Note that no recording is performed at this point.

(Step S102)
When the camera starts photographing, the display control unit 134 displays a standby screen Sc1 on the display (step S102). The standby screen Sc1 is a screen that is displayed while waiting for the recording start condition to be met. The standby screen Sc1 is a screen that is displayed from the start of shooting until the start of recording.

FIG. 4 is a diagram showing an example of the standby screen Sc1. The standby screen Sc1 in FIG. 4 includes an end button B1, a captured video display area A1, and a standby display area A2.

The end button B1 is a button for ending photographing by the camera and ending the display of the standby screen Sc1. When the user selects the end button B1, the photographing by the camera ends and, for example, the home screen of the application is displayed on the display. In the example of FIG. 4, the end button B1 is arranged at the upper left of the standby display area A2, but the position of the end button B1 is arbitrary.

The photographed video display area A1 is an area for displaying the photographed video 121 in real time. In the example of FIG. 4, the portion of the display excluding the outer periphery is the photographed video display area A1, and the photographed video display area A1 displays a hallway with a door installed at the end.

The standby display area A2 is an area for clearly displaying to a user who is away from the photographing device 1 that the standby screen Sc1 is being displayed, that is, that recording has not yet started. In the example of FIG. 4, a portion surrounding the outer periphery of the captured video display area A1 is a monochrome standby display area A2. The standby display area A2 is, for example, bright green, but is not limited to this. Further, the standby display area A2 does not have to be a single color, or may be displayed in a blinking manner. A user who has moved to a remote position on the display side to capture a walking video can easily understand that recording has not yet started by looking at the standby display area A2 displayed on the display.

(Step S103)
On the other hand, when photography by the camera is started, the acquisition unit 131 acquires a video from the camera in real time, and stores the acquired video in the storage unit 12 as the captured video 121 (step S103). The display control unit 134 displays the captured video 121, which is thus saved from time to time, in the captured video display area A1. The acquisition unit 131 continues to acquire moving images until the camera finishes shooting.

(Step S104)
Next, the estimation unit 132 estimates the skeleton of the user (photographed person) from the latest captured video 121 using the skeleton estimation model (step S104). The estimating unit 132 stores information regarding the skeleton obtained as a result of the estimation in the storage unit 12 as skeleton information 122 in association with the frame targeted for estimation. The estimating unit 132 continues estimating the skeleton until recording ends.

FIG. 5 is a diagram showing an example of the standby screen Sc1. In the example of FIG. 5, the user is moving to the end of a hallway to take a walking video, and a shot video 121 showing the user at the end is displayed in the shot video display area A1. Further, the skeleton of the user (person to be photographed) estimated from the photographed video 121 is displayed superimposed on the photographed video 121.

(Step S105)
Subsequently, the determination unit 133 determines whether the recording start condition is satisfied based on the skeleton information 122 (step S105). The determination unit 133 continues the determination until the recording start condition is satisfied (step S105: NO). If the recording start condition is satisfied (step S105: YES), the process proceeds to step S106.

Here, the starting conditions will be explained in detail. As described above, the start condition is set based on the user's (photographed person's) skeleton. More specifically, the start condition is set based on the size of the user's (photographed person's) skeleton. The size of the skeleton of the user (person being photographed) corresponds to the distance of the user (person being photographed) with respect to the photographing device 1 .

For example, the start condition is that a period in which the ratio of the height h1 (size) of the user's (photographed person's) whole body skeleton to the height H of the display is equal to or less than a threshold continues for a predetermined period of time (predetermined frames). be. The threshold value and the predetermined time can be set arbitrarily. Here, let us consider a case where the starting condition is that the period in which the ratio of the height h1 of the user's (photographed person's) whole body skeleton to the height H of the display is 50% or less continues for 1 second.

In this case, the determination unit 133 first calculates the height h1 of the user's entire body skeleton for each frame based on the skeleton information 122. The height h1 of the whole body skeleton is, for example, the difference between the top coordinate and the bottom coordinate among the coordinates of the whole body skeleton (see FIG. 5).

Next, the determination unit 133 calculates the ratio (h1/H) of the height h1 to the preset height H of the display, and determines whether the ratio is 50% or less. The determining unit 133 determines that the start condition is satisfied if the period in which the ratio is 50% or less continues for 1 second (30 frames if the captured video is 30 fps).

Thereby, as in the example of FIG. 5, recording can be started when the user (person to be photographed) moves away from the photographing device 1 by a predetermined distance. In other words, it is possible to avoid recording the movement period until the user leaves the photographing device 1 by a predetermined distance.

Note that the starting conditions are not limited to the above example. For example, the height h1 may be the height of a part (for example, the upper body) of the user (person to be photographed) instead of the whole body. Further, the height H may be the height of the photographed video display area A1 or the standby display area A2 instead of the height of the display. Furthermore, instead of comparing the proportion of the height h1 and the threshold value, the height h1 and the threshold value may be compared.

Further, the start condition is that the period in which the ratio of the width w (size) of the user's (photographed person's) whole body skeleton to the width W of the display is equal to or less than a threshold value continues for a predetermined period of time (predetermined frames). Good too. The width w may be the width of a part (for example, the upper body) of the user (person being photographed) rather than the whole body. Furthermore, the width W may be the width of the photographed video display area A1 or the standby display area A2 instead of the width of the display. Further, instead of comparing the proportion of the width w and the threshold value, the width w and the threshold value may be compared.

Further, the start condition may be set based on the position of the user (person to be photographed) on the display. For example, as a starting condition, it is possible to set a range of coordinates of a user (person to be photographed) detected by human detection. Thereby, recording can be started when the user (person to be photographed) is at a predetermined position with respect to the display.

Note that the start conditions are not limited to the above example. The start condition may be set based on a combination of two or more of the height h1, the width w, and the user's position, or may be set based on a combination of other conditions.

(Step S106)
If the start condition is satisfied, the display control unit 134 displays the countdown screen Sc2 on the display (step S106). The countdown screen Sc2 is a screen that displays the time until recording starts.

FIG. 6 is a screen showing an example of the countdown screen Sc2. In the example of FIG. 6, a large number "5" is displayed on the countdown screen Sc2. This means that there are 5 seconds left until recording starts. On this countdown screen Sc2, the displayed number decreases by 1, and recording starts at the timing of "0". In this way, by displaying the countdown screen Sc2 after the start condition is satisfied, the user (person to be photographed) can easily grasp the exact timing at which recording will start. Note that the time to be counted down is not limited to 5 seconds, and can be set arbitrarily. Further, the determination unit 133 may continue to determine whether the start condition is satisfied from the start of the countdown until the end of the countdown. In this case, if the start condition is no longer satisfied during the countdown, the process returns to step S105. Thereby, recording can be started in a state where the start conditions are reliably satisfied.

(Step S107)
When the countdown reaches "0", the video generation unit 136 starts recording (step S107). Specifically, the captured video 121 is acquired and the generation of the video file 124 is started.

(Step S108)
On the other hand, the display control unit 134 displays the recording screen Sc3 on the display. The recording screen Sc3 is a screen displayed during recording.

7 to 9 are diagrams showing an example of the recording screen Sc3. The recording screen Sc3 in FIGS. 7 to 9 includes an end button B1, a stop button B2, a captured video display area A1, and a progress bar b.

The end button B1 is a button for ending photographing by the camera and ending the display of the recording screen Sc3. When the user selects the end button B1, the photographing by the camera ends and, for example, the home screen of the application is displayed on the display. In the examples shown in FIGS. 7 to 9, the end button B1 is arranged at the upper left of the standby display area A1, but the end button B1 can be placed at any position.

The stop button B2 is a button for stopping and restarting recording. When the user selects the stop button B2, recording stops, and when the user selects the stop button B2 again, recording resumes. In the examples of FIGS. 7 to 9, the stop button B2 is placed at the center of the lower part of the standby display area A1, but the position of the stop button B2 is arbitrary.

The photographed video display area A1 is an area for displaying the photographed video 121 in real time. In the examples shown in FIGS. 7 to 9, the portion of the display excluding the upper part is the photographed video display area A1, and the photographed video display area A1 displays a hallway with a door installed at the end. Furthermore, a user (person to be photographed) is standing at the end of the hallway.

Progress bar b is a bar for displaying the progress rate of recording. In the examples of FIGS. 7 to 9, the progress bar b is displayed at the top of the captured video display area A1, but the position of the progress bar b is arbitrary. Furthermore, in the examples of FIGS. 7 to 9, the progress bar b is displayed so that it shrinks (closer to 0%) as the progress rate increases, that is, the bar is displayed to represent the remaining progress rate. The bar may be displayed so that it increases as the rate increases (approaches 100%), that is, the bar represents the progress rate itself. Further, the recording progress may be displayed on the display in a format other than a bar.

(Step S109)
The display control unit 134 also calculates the recording progress rate (step S109). The progress rate is calculated based on the skeleton of the user (person being photographed) so that when the recording start conditions are met, the progress rate is 0%, and when the recording end conditions are met, the progress rate is 100%. .

(Step S110)
Next, the determination unit 133 determines whether the recording termination condition is satisfied based on the skeleton information 122 (step S110). The determination unit 133 continues the determination until the recording end condition is satisfied (step S110: NO). If the recording end condition is satisfied (step S110: YES), the process proceeds to step S111.

Here, the termination conditions will be explained in detail. As described above, the termination condition is set based on the user's (photographed person's) skeleton. More specifically, the termination condition is set based on the size of the user's (photographed person's) skeleton. The size of the skeleton of the user (person being photographed) corresponds to the distance of the user (person being photographed) with respect to the photographing device 1 .

For example, the termination condition is that the ratio of the height h2 (size) of the upper body skeleton of the user (photographed person) to the height H of the display continues for a predetermined period of time (predetermined frames). be. The threshold value and the predetermined time can be set arbitrarily. Now, let us consider the case where the termination condition is that the period in which the ratio of the height h2 of the user's (photographed person's) upper body skeleton to the height H of the display is 50% or less continues for 0.1 seconds. .

In this case, the determination unit 133 first calculates the height h2 of the user's upper body skeleton for each frame based on the skeleton information 122. The height h2 of the upper body skeleton is, for example, the difference between the top coordinate and the bottom coordinate among the coordinates of the skeleton set as the upper body skeleton (see FIG. 8).

Next, the determining unit 133 calculates the ratio (h2/H) of the height h2 to the preset height H of the display, and determines whether the ratio is 50% or more. The determination unit 133 determines that the termination condition is satisfied if the period in which the ratio is 50% or more continues for 0.1 seconds (3 frames if the captured video is 30 fps).

As a result, as shown in the example of FIG. 9, when the user (person to be photographed) leaves the photographing device 1 by a predetermined distance (when the user (person to be photographed) approaches the photographing device 1 by a predetermined distance), Recording can be ended. In other words, it is possible to prevent recording after the user approaches the photographing device 1 to a predetermined distance. Furthermore, by determining the termination condition based on the upper body skeleton, recording can be terminated even when the lower body of the user (photographed person) is not visible due to the proximity to the photographing device 1, as in the example of FIG. can.

Note that the termination condition is not limited to the above example. For example, the height h2 may be the height of not the upper body of the user (person to be photographed), but a part of the body other than the upper body, or the height of the whole body. Further, the height H may be the height of the photographed video display area A1 instead of the height of the display. Moreover, instead of comparing the ratio of height h2 and the threshold value, the height h2 and the threshold value may be compared.

Further, the termination condition is that the period in which the ratio of the width w (size) of the user's (photographed person's) whole body skeleton to the width W of the display is equal to or greater than the threshold continues for a predetermined period of time (predetermined frames). Good too. The width w may be the width of a part (for example, the upper body) of the user (person being photographed) rather than the whole body. Furthermore, the width W may be the width of the photographed video display area A1 instead of the width of the display. Further, instead of comparing the proportion of the width w and the threshold value, the width w and the threshold value may be compared.

Further, the termination condition may be set based on the position of the user (person to be photographed) on the display. For example, it is conceivable to set the coordinate range of the user (photographed person) detected by human detection as the termination condition. Thereby, recording can be ended when the user (person to be photographed) is at a predetermined position with respect to the display.

Note that the termination condition is not limited to the above example. The termination condition may be set based on a combination of two or more of the height h2, the width w, and the user's position, or may be set based on a combination of other conditions. Further, when the user moves away from the imaging device 1, the above-mentioned start condition and end condition may be reversed.

(Step S111)
When the termination condition is satisfied, the moving image generation unit 136 terminates recording (step S111). Specifically, the acquisition of the photographed video 121 is finished, and a video file 124 including the photographed video 121 acquired from the start to the end of recording is generated and stored in the storage unit 12.

<Summary>
As explained above, according to the present embodiment, the photographing device 1 determines whether the recording start condition is satisfied based on the skeleton of the user (photographed person) included in the photographed video 121, and determines whether the start condition is satisfied. Start recording if necessary. Thereby, recording can be started at the timing when the user (person to be photographed) comes to a predetermined distance from the photographing device 1 suitable for starting exercise. As a result, it is possible to generate a video file 124 that does not include unnecessary scenes from when the user (photographed person) activates the camera of the photographing device 1 until the user moves to a predetermined distance, and is suitable for motion analysis using AI. .

Further, according to the present embodiment, the photographing device 1 determines whether a recording end condition is satisfied based on the skeleton of the user (photographed person) included in the photographed video 121, and when the end condition is satisfied, the photographing device 1 performs recording. end. Thereby, recording can be ended at the timing when the user (person to be photographed) comes to a predetermined distance from the photographing device 1 suitable for ending the exercise. As a result, it is possible to generate a video file 124 that does not include unnecessary scenes after the user (person to be photographed) finishes exercising and is suitable for analysis of exercise using AI.

<Additional notes>
This embodiment includes the following disclosure.

(Additional note 1)
An information processing method executed by an information processing device including a display and a camera that photographs the display side,
a process of acquiring a video shot by the camera;
a process of estimating the skeleton of the photographed person included in the video;
a process of determining whether the estimated skeleton satisfies a starting condition;
a process of starting recording when the start condition is met;
Information processing methods including.

(Additional note 2)
The information processing method according to supplementary note 1, wherein the start condition is set based on the size of at least a part of the skeleton of the person to be photographed.

(Additional note 3)
The information processing method according to supplementary note 1, wherein the start condition is set based on the height of at least a part of the skeleton of the person to be photographed.

(Additional note 4)
The information processing method according to supplementary note 1, wherein the start condition is set based on a ratio of a height of at least a part of the skeleton of the person to be photographed to a height of the display.

(Appendix 5)
The information processing method according to supplementary note 1, wherein the process of starting recording includes a process of displaying a time until the start of recording on the display.

(Appendix 6)
After the start of recording, a process of determining whether the skeleton satisfies an end condition;
a process of terminating the recording when the termination condition is met;
The information processing method according to Supplementary Note 1, further comprising:

(Appendix 7)
The information processing method according to appendix 6, wherein the termination condition is set based on the size of at least a part of the skeleton of the person to be photographed.

(Appendix 8)
The information processing method according to appendix 6, wherein the termination condition is set based on the height of at least a part of the skeleton of the person to be photographed.

(Appendix 9)
The information processing method according to appendix 6, wherein the termination condition is set based on a ratio of a height of at least a part of the skeleton of the person to be photographed to a height of the display.

(Appendix 10)
The information processing method according to appendix 6, wherein the termination condition is set based on a ratio of the height of the upper body skeleton of the photographed person to the height of the display.

(Appendix 11)
The information processing method according to supplementary note 1, further comprising a process of displaying a progress rate of recording on the display after the start of recording.

(Appendix 12)
The information processing method according to appendix 11, wherein the progress rate is displayed as a bar on the display.

(Appendix 13)
An information processing device including a display and a camera that photographs the display side,
a process of acquiring a video shot by the camera;
a process of estimating the skeleton of the photographed person included in the video;
a process of determining whether the estimated skeleton satisfies a starting condition;
a process of starting recording when the start condition is met;
A program for executing information processing methods including.

(Appendix 14)
display and
a camera that photographs the display side;
an acquisition unit that acquires a video shot by the camera;
an estimation unit that estimates the skeleton of the photographed person included in the video;
a determination unit that determines whether the estimated skeleton satisfies a starting condition;
a camera unit that starts recording when the start condition is met;
Information processing equipment including.

The embodiments disclosed herein are illustrative in all respects and should not be considered restrictive. The scope of the present invention is indicated by the claims rather than the above-mentioned meaning, and is intended to include meanings equivalent to the claims and all changes within the scope. Furthermore, the present invention is not limited to the embodiments described above, and can be modified in various ways within the scope of the claims, and can be obtained by appropriately combining technical means disclosed in different embodiments. The embodiments are also included in the technical scope of the present invention.

1: Imaging device 11: Communication unit 12: Storage unit 13: Control unit 121: Captured video 122: Skeleton information 123: Condition information 124: Video file 131: Acquisition unit 132: Estimation unit 133: Judgment unit 134: Display control unit 135 : Shooting control section 136: Video generation section

Claims (14)

An information processing method executed by an information processing device including a display and a camera that photographs the display side,
a process of acquiring a video shot by the camera;
a process of estimating the skeleton of the photographed person included in the video;
a process of determining whether the estimated skeleton satisfies a starting condition;
a process of starting recording when the start condition is met;
Information processing methods including. The information processing method according to claim 1, wherein the start condition is set based on the size of at least a part of the skeleton of the person to be photographed. The information processing method according to claim 1, wherein the start condition is set based on the height of at least a part of the skeleton of the person to be photographed. The information processing method according to claim 1, wherein the start condition is set based on a ratio of a height of at least a part of the skeleton of the person to be photographed to a height of the display. 2. The information processing method according to claim 1, wherein the process of starting recording includes a process of displaying a time until the start of recording on the display. After the start of recording, a process of determining whether the skeleton satisfies an end condition;
a process of terminating the recording when the termination condition is met;
The information processing method according to claim 1, further comprising: 7. The information processing method according to claim 6, wherein the termination condition is set based on the size of at least a part of the skeleton of the photographed person. 7. The information processing method according to claim 6, wherein the termination condition is set based on the height of at least a part of the skeleton of the photographed person. 7. The information processing method according to claim 6, wherein the termination condition is set based on a ratio of the height of at least a part of the skeleton of the photographed person to the height of the display. 7. The information processing method according to claim 6, wherein the termination condition is set based on a ratio of the height of the upper body skeleton of the photographed person to the height of the display. The information processing method according to claim 1, further comprising a process of displaying a recording progress rate on the display after recording starts. The information processing method according to claim 11, wherein the progress rate is displayed as a bar on the display. An information processing device including a display and a camera that photographs the display side,
a process of acquiring a video shot by the camera;
a process of estimating the skeleton of the photographed person included in the video;
a process of determining whether the estimated skeleton satisfies a starting condition;
a process of starting recording when the start condition is met;
A program for executing information processing methods including. display and
a camera that photographs the display side;
an acquisition unit that acquires a video shot by the camera;
an estimation unit that estimates the skeleton of the photographed person included in the video;
a determination unit that determines whether the estimated skeleton satisfies a starting condition;
a camera unit that starts recording when the start condition is met;
Information processing equipment including.