EP3423899A1

EP3423899A1 - Control of an image-capturing device allowing the comparison of two videos

Info

Publication number: EP3423899A1
Application number: EP17711715.7A
Authority: EP
Inventors: Emmanuel ELARD
Original assignee: Individual
Current assignee: Individual
Priority date: 2016-03-01
Filing date: 2017-03-01
Publication date: 2019-01-09
Also published as: US20200410665A1; FR3048579B1; WO2017149243A1; FR3048579A1

Abstract

The invention relates to a method of video image-capturing by an image-capturing apparatus (2) secured to a support (3), designed to be set into rotation about a zone intended to accommodate a patient by an electric motor slaved by a control unit, this method comprising steps of - transmission (S1) to the control unit of an order to position the support in a first position, and display of a first photographic image captured by the apparatus, - transmission (S3) to the control unit of an order to position the support in a second position; and display of a second photographic image; - transmission (S5) to the control unit of an order to trigger the rotation of the support and recording of a first video; - transmission (S6) to the control unit of an order to position the support in the first position, and display of a first new photographic image as well as, in transparency, an image extracted from the first video corresponding to the first position; - transmission (S8) to the control unit of an order to position the support in the second position; and display of a second new photographic image as well as, in transparency, an image extracted from the first video corresponding to this second position; - transmission (S10) to the control unit of an order to trigger the rotation of the said support and recording of a second video.

Description

CONTROL OF A SHOOTING DEVICE

PERMITTING THE COMPARISON OF TWO VIDEOS

FIELD OF THE INVENTION

The invention relates to the field of video shooting in the context of medicine and cosmetic surgery, orthodontics, beauty or fitness services, and more generally areas requiring an accurate comparison of views before / after an intervention.

It relates more particularly to an electronic and software device for such video shooting.

BACKGROUND OF THE INVENTION

In the field of aesthetic medicine and surgery, practitioners typically take pictures of the face, or part of a patient's body, before and after an operation.

Standards for pre- / post-intervention imaging conditions have been put in place to ensure relevant observations, as noted in "Photography Standards in Plastic Surgery", 2006, Plastic Surgery Education Foundation, USA.

Before / after shots should be taken using the same equipment and procedures. The camera, lighting, magnification, frame, patient position and preparation must be constant.

The material used is most often similar to that of a professional photographer in his photographer's studio, as shown in the chapter "Photography in Facial Plastic Surgery" in the treatise "Advanced Therapy in Facial Plastic & Reconstructive Surgery", J. Regan Thomas, p. 31, 2010, PMPH, USA. This material includes an armchair for the patient placed in front of a uniform background, a camera on a tripod-type stand, lights and reflectors.

Most practitioners perform static shots from a variety of standardized angles. However, panoramic or even stereoscopic views, or pre / post videos, would greatly improve the patient's perception of the benefit of his intervention. It is extremely difficult to manually perform pre / post video sequences so that the before / after video sequences can be superimposed for their frame-by-frame comparison. It therefore appears the need for practitioners to equip themselves with automated video recording systems.

In the prior art there are known automated systems for making such views, for example, the stereoscopic remote viewing system described in European Patent Application EP0218751. In this system, a video camera mounted on a carriage, which moves along a semicircular rail, provides video footage of an object placed in the center of the rail. However, this system for the industry is complex and expensive and is not suitable for use in the field of aesthetic medicine and surgery.

SUMMARY OF THE INVENTION

The object of the present invention is to provide a solution at least partially overcoming the aforementioned drawbacks.

One objective of the invention is to make it possible to simplify video recording systems intended for aesthetic medicine and surgery, in particular by reducing the number of components, which makes it possible to reduce the production costs of such systems. and increase their robustness. For example, the solution proposed by the invention saves connectors and sensors. To this end, the present invention proposes a method of shooting a video by a camera for shooting a support, said support being arranged to be rotated around an area intended to receive a patient by an engine. controlled by a control unit, said method comprising steps of

transmitting to said control unit an order to position said medium in a first position, and displaying a first photographic view captured by said apparatus, on a human-machine interface;

after receiving a command via said human-machine interface, transmitting to said control unit an order to position said medium in a second position; and displaying a second photographic view captured by said apparatus, on said man-machine interface

after receiving a command via said human-machine interface, transmitting to said control unit an order to trigger the rotation of said medium and triggering the recording of a first video;

transmitting to said control unit an order to position said support at said first position, and displaying a first new photographic view and, in transparency, a view taken from said first video corresponding to said first position, on a human interface machine;

after receiving a command via said man-machine interface, transmitting to said control unit an order to position said medium in said second position; and displaying a second new photographic view as well as, in transparency, a view taken from said first video corresponding to said second position, on said man-machine interface; after receiving a command via said human-machine interface, transmitting to said control unit an order to trigger said rotation of said medium and triggering the recording of a second video;

displaying said first and second video on said human-machine interface.

According to preferred embodiments, the invention comprises one or more of the following features which can be used separately or in partial combination with one another or in total combination with one another:

said first and second positions are separated by an angle of at least 90 degrees;

said first and second videos are displayed in two windows of a same screen, facing one another and in time synchronization;

said first and second videos are displayed in a single window and separated by a separator whose position can be dynamically changed by the user;

said rotation of said support comprises at least one stop.

Another subject of the invention relates to a device (1) for video shooting comprising a camera (2) for shooting a carrier (3), said support being arranged to be rotated around a camera. an area intended to accommodate a patient by an electric motor controlled by a control unit and comprising software means provided for

transmitting to said control unit an order to position said medium in a first position, and displaying a first photographic view captured by said apparatus, on a human-machine interface; after receiving a command via said human-machine interface, transmitting to said control unit an order to position said medium in a second position; and displaying a second photographic view captured by said apparatus on said man-machine interface;

after receiving a command via said human-machine interface, transmitting to said control unit an order to trigger the rotation of said medium and trigger the recording of a first video;

transmitting to said control unit an order to position said support at said first position, and displaying a first new photographic view as well as, in transparency, a view taken from said first video corresponding to said first position, on a human-machine interface;

after receiving a command via said human-machine interface, transmitting to said control unit an order to position said medium in a second position; and displaying a second new photographic view as well as, in transparency, a view taken from said first video corresponding to said second position, on said man-machine interface; after receiving a command via said human-machine interface, transmitting to said control unit an order to trigger the rotation of said medium and trigger the recording of a second video;

displaying said first and second video in parallel on said human-machine interface.

According to preferred embodiments, the invention comprises one or more of the following features which can be used separately or in partial combination with one another or in total combination with one another: said software means are provided for transmitting commands to said control unit so that said first and second positions are separated by an angle of 90 degrees;

said man-machine interface belongs to an electronic device having a radio interface for communicating with said control unit;

said electronic apparatus is said camera, said camera further having a touch screen; Other features and advantages of the invention will appear on reading the following description of a preferred embodiment of the invention, given by way of example and with reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an embodiment of a shooting system that can implement the device according to the invention.

Figure 2 schematically illustrates an architecture that can be implemented to implement the principles of the invention.

Figure 3 illustrates the process of the invention very schematically.

Figures 4a and 4b schematically illustrate two display implementations of the first and second videos. DETAILED DESCRIPTION OF THE INVENTION

Figure 1 illustrates an embodiment of a shooting system that can implement the device 1 according to the invention.

A patient P is installed in a sitting position on a stool T, within a zone intended to accommodate the patient. The device comprises a fixed base spreading on the horizontal plane, and a circular rail integral with the base and horizontal also. On this rail can move a horizontal platform 4 driven by an electric motor and having a support 3.

An electric motor allows rotation of the platform, and therefore the support 3 around the central area containing the stool T.

A camera 2 is positioned on the support 3. Various fixing means can be provided so that the apparatus 2 is firmly held during the rotation of the support 3 around the patient P. It must be positioned integrally, so that the position of the objective exactly follows the rotation of the support 3, and that the objective is continuously oriented towards the patient P.

Thus, the camera can rotate around the patient at an angle that can be variable depending on the implementations and configurable. Preferably, this excursion can cover an angle at least equal to 180 ° to allow for example a photographic front view and two photographic profile views of the patient P. It can cover 360 ° to allow complete capture of the patient P.

The camera 2 can be a mobile communication terminal type "smartphone", or a video camera, etc. It can have a human-machine interface on the one hand to display the videos and on the other hand to receive commands from a user.

The apparatus 2 is operatively connected to a control unit 5 for controlling the motor 6 for rotating the support 3. A man-machine interface 7 is also provided to allow at least on the one hand the display of the recorded videos and on the other hand to receive commands from a user of the device 2.

This man-machine interface may be totally or partially implemented by the camera 2, for example in the case where it is a smartphone-type communication terminal or a digital tablet, etc.

The man-machine interface 7 may also be partially (or totally) implemented by one or more other devices 9. It may be a control panel and / or display physically linked to the device 1. It can also be a device not physically linked but functionally for example by means of a radio link, such as a remote control.

The human-machine interface may comprise a touch screen, in particular in the case of the interface portion implemented by the video camera 2.

The commands specific to the invention will be seen later, but it may be mentioned for the sake of clarity at this stage that the man-machine interface can also enable the start and stop of the device 1, the adjustment the speed of the motor 6, its direction of rotation, the angular amplitude of the rotation, a number of stops during the video acquisition, the position and the duration of the stops, etc.

The video recording device also comprises software means 8. These software means may be implemented partially or totally in the camera 2 shooting, especially when it is of the "smartphone" or digital tablet type. They can also be implemented a processing device contained in the device 1, which can be co-located with the control unit 5, or deported to a processing platform different from that implementing the control unit. 5. Figure 3 illustrates the process of the invention very schematically. A first preliminary step, not shown in the figure, is to perform a white balance, in order to calibrate the camera 2 video shooting. To do this, a test pattern or a single blank sheet can be presented in front of the apparatus 2. Then, in a first step S1, the software means transmit to the control unit 5 an order to position the support 3 in a first position , and trigger the display of a first photographic view captured by said apparatus, on the man-machine interface 7.

This first position may for example correspond to a front view of the patient P. The support 3 is therefore positioned in front of him.

The precise positioning can be guided by a screen associated with the camera 2 on which can be displayed a reticle, for example in the form of a cross consisting of a vertical line intended to be positioned on the stop of the patient's nose P, and of a horizontal line intended to be positioned on an imaginary line passing through the center of the eyes of the patient P.

An additional screen may be provided to be patient oriented to enable it to position itself more easily.

Once the patient is positioned, the user can trigger a command via the man-machine interface 7. This command can be triggered by a simple tap on the screen of the device 2, but other control means can obviously be deployed (voice command, button on the screen or on a control panel, etc.) Step S2 indicates the receipt of this command by the software means which can then trigger, in a step S2, the transmission to the control unit of an order to position the support 3 in a second position, and to trigger the display of a second photographic view captured by said apparatus, on the man-machine interface 7.

This second position is distinct from the first position. The angle between the first and second positions must be large enough to allow the recording of significant videos in the following steps, that is to say, showing as completely as possible the patient's face from various angles allowing an assessment or diagnosis. For example, the difference can be greater than or equal to 90 ° to allow to have a photographic front view and a photographic profile of the patient P, the second position then corresponding to this profile view. The angular gap may be larger, for example 180 ° to capture a front view and a view of each patient's profile. It can go up to 360 °.

The second photographic view can be displayed in the same way as the first view in step S1. In particular, the same reticle to be put in place for the precise positioning of the patient P with respect to the objective of the camera 2 of shooting. A profile view is used to adjust the inclination of the patient's head, so that it is not bent too much upward or downward.

Once the patient is positioned, a command can be transmitted via the human-machine interface and received, in a step S4, by the software means.

This command may be similar to the previous command; it may especially consist of a simple tap on the touch screen of the camera 2 shooting.

The reception of this command by the software means triggers the beginning of a second phase consisting of the recording of a first video. In a step referenced S5 in FIG. 3, the software means transmit to the control unit 5 an order to trigger a rotation of the support 8 between the second and the first positions.

This rotation can be continuous or interrupted by breaks. These breaks can allow the patient to make smiles or other muscular movements of the face to enrich the semantic content of the video. Indeed, it may be interesting to have views, from different angles, of the smiling face or performing certain mimicry, to increase the volume of information and better enable the decision-making and diagnosis by the user.

Indications in this sense can be provided to the patient either by the user or by the device 1. In the latter case, the human-machine interface 7 can provide these indications orally, by means of voice synthesis in particular, or visually by a screen oriented towards the patient.

The video allows a dynamic shooting of the patient P, and therefore has a semantic content much richer than a simple set of static shots. Indeed, for a relevant diagnosis, it may be necessary to have not static views, but video views showing the transitions from one mimic to another, or a continuity of angle of view.

The rotation may be in a single direction, for example from the second to the first position, or consist of a round trip or any other course between the first and second positions.

At the end of the course, the support 3 can be stopped by the control means 5 and the recording can be interrupted. We thus obtain a first video.

The treatment of the patient can then take place. The first video is a pre-treatment video. This first video is stored in a memory associated with the device 1. A third phase begins after the treatment to record a second video, constituting a video after treatment.

This third phase begins with the receipt of a command to that effect by the man-machine interface 7.

The software means can then, in a step S6, transmit to the control unit 5 an order to position the support 3 at the first position. They then trigger the display on the man-machine interface 7 of a new photographic view captured by the camera 2 and, in transparency, a view extracted from the first video and corresponding to the same first position.

Thus, it is possible to reposition the patient P in the same way as during the first phase, but instead of doing it on the basis of a reticle, the positioning is guided by an extraction of the first video. It is thus possible to ensure a correspondence of the contours of the patient's face P and / or certain characteristic features (eyes, stop nose, etc.), so that we can be assured that the second video that will be taken will allow a precise and relevant comparison with the first video.

A new white balance adjustment may be made, but it may be proposed to use the calibration determined during the first phase. If the environmental conditions have remained constant, this makes it possible to obtain identical colorimetric characteristics on the two videos obtained and thus to facilitate the comparison.

When the precise positioning is carried out, in the same way as above, a command can be transmitted via the human-machine interface and received, in a step S7, by the software means. This command can be, as described above, of different natures and in particular a simple tap on the touch screen of the apparatus 2.

In a step S8, and following this command, the software means transmit to the control unit 5 an order to position the support 3 at the second position. They then trigger the display on the man-machine interface 7 of a second new photographic view captured by the camera 2 and, in transparency, a view extracted from the first video and corresponding to the same second position.

Thus, it is possible to reposition the patient P as well as previously through an extraction of the first video. It is thus possible to ensure a correspondence of the contours of the patient's face P and / or certain characteristic features (eyes, nose stop, etc.) in the same way as for the first position.

The first and second positions are the same, precisely, as those established in the first phase, so that the videos before and after treatment correspond to the same route of the camera 2 and that the videos are thus quite comparable.

Once the patient is positioned, a command can be transmitted via the human-machine interface and received, in a step S9, by the software means. This command may be similar to the previous command; it may especially consist of a simple tap on the touch screen of the camera 2 shooting.

In the same way as above, a fourth phase can then be triggered by the receipt of this command by the software means.

In a step referenced S 10 in Figure 3, the software means transmit to the control unit 5 an order to trigger a rotation of the support 8 between the second and first positions. This rotation follows preferentially the same course as for the recording of the first video, so that the first and second videos are comparable.

In a SU step, both videos are displayed on the HMI. This step may be concomitant with step S10, that is, say that the second video is displayed at the same time as its recording, in real time or in a slightly delayed time. It can intervene alternately after it, and since the two videos can be stored in a memory of the device 1, they can be displayed several times.

Figures 4a and 4b illustrate two display implementations of the first and second videos.

In the implementation of Figure 4a, two areas of a screen (for example two windows) each have one of two videos vl, v2. The videos are synchronized so that at each moment, images corresponding to identical positions of the support 3 are presented opposite one another allowing easy comparison for the user.

Control means (advance, stop, backward, slow motion, etc.) make it possible to control the two videos simultaneously.

In the implementation of FIG. 4b, the same zone w, or window, makes it possible to display the two videos v1, v2 simultaneously. A separator S separates the display of the two videos. Its position can be dynamically modified by the user, according to the arrows represented, in order to reveal complementary regions of each of the two videos. For example, if the separator is dragged at one end, only one of the two videos will be displayed in the w window.

Of course, the present invention is not limited to the examples and to the embodiment described and shown, but it is capable of numerous variants accessible to those skilled in the art.

Claims

A method of shooting a video by a device (2) for shooting a carrier (3), said support being arranged to be rotated around an area intended to receive a patient by an electric motor controlled by a control unit, said method comprising steps of

transmitting (S1) to said control unit an order to position said medium in a first position, and displaying a first photographic view captured by said apparatus, on a human-machine interface;

after receiving (S2) a command via said human-machine interface, transmitting (S3) to said control unit an order to position said medium in a second position; and displaying a second photographic view captured by said apparatus, on said man-machine interface

after receiving (S4) a command via said human-machine interface, transmitting (S5) to said control unit an order to trigger the rotation of said medium and triggering the recording of a first video;

- transmitting (S6) to said control unit an order to position said medium at said first position, and displaying a first new photographic view and, in transparency, a view taken from said first video corresponding to said first position on said man-machine interface;

after receiving (S7) a command via said man-machine interface, transmitting (S8) to said control unit an order to position said medium in said second position; and displaying a second new photographic view as well as, in transparency, a view taken from said first video corresponding to said second position, on said man-machine interface;

after receiving (S9) a command via said human-machine interface, transmitting (S 10) to said control unit an order to trigger said rotation of said medium and triggering the recording of a second video;

- Display (SU) of said first and second video on said human-machine interface.

Method according to the preceding claim wherein said first and second positions are separated by an angle of at least 90 degrees.

Method according to one of the preceding claims, wherein said first and second videos are displayed in two windows of the same screen, facing one another and in time synchronization.

Method according to one of claims 1 or 2, wherein said first and second videos are displayed in a single window and separated by a separator whose position can be dynamically changed by the user.

Method according to one of the preceding claims, wherein said rotation of said support (3) comprises at least one stop.

Device (1) for video shooting comprising an apparatus (2) for shooting a carrier (3), said support being arranged to be rotated around an area intended to receive a patient by an engine controlled by a control unit and comprising software means provided for

transmit to said control unit an order to position said support in a first position, and display a first photographic view captured by said apparatus, on a man-machine interface;

transmitting to said control unit an order to position said support at said first position, and displaying a first new photographic view as well as, in transparency, a view extracted from said first video corresponding to said first position, on said man-machine interface;

after receiving a command via said human-machine interface, transmitting to said control unit an order to position said medium in a second position; and displaying a second new photographic view as well as, in transparency, a view taken from said first video corresponding to said second position, on said man-machine interface;

after receiving a command via said human-machine interface, transmitting to said control unit an order to trigger the rotation of said medium and trigger the recording of a second video;

displaying said first and second video in parallel on said human-machine interface. Device according to the preceding claim wherein said software means are provided for transmitting commands to said control unit so that said first and second positions are separated by a 90 degree angle.

Device according to one of claims 6 or 7, wherein said man-machine interface belongs to an electronic device having a radio interface for communication with said control unit.

Device according to the preceding claim, wherein said electronic apparatus is said camera, said camera further having a touch screen.