CN108307175B - Dance dynamic image capturing and restoring system based on flexible sensor and control method - Google Patents

Dance dynamic image capturing and restoring system based on flexible sensor and control method Download PDF

Info

Publication number
CN108307175B
CN108307175B CN201810126169.XA CN201810126169A CN108307175B CN 108307175 B CN108307175 B CN 108307175B CN 201810126169 A CN201810126169 A CN 201810126169A CN 108307175 B CN108307175 B CN 108307175B
Authority
CN
China
Prior art keywords
agps
information
performer
flexible sensor
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810126169.XA
Other languages
Chinese (zh)
Other versions
CN108307175A (en
Inventor
钟祎洵
宁洪龙
魏靖林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to CN201810126169.XA priority Critical patent/CN108307175B/en
Publication of CN108307175A publication Critical patent/CN108307175A/en
Priority to PCT/CN2018/110444 priority patent/WO2019153783A1/en
Application granted granted Critical
Publication of CN108307175B publication Critical patent/CN108307175B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/04Synchronising
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01DMEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
    • G01D21/00Measuring or testing not otherwise provided for
    • G01D21/02Measuring two or more variables by means not covered by a single other subclass
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/0009Transmission of position information to remote stations
    • G01S5/0018Transmission from mobile station to base station
    • G01S5/0036Transmission from mobile station to base station of measured values, i.e. measurement on mobile and position calculation on base station
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223Cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Computer Security & Cryptography (AREA)
  • Remote Sensing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The invention discloses a dance dynamic image capturing and restoring system based on a flexible sensor and a control method, wherein the system comprises an image capturing system, an AGPS total system, an AGPS subsystem, a synchronization module, a flexible sensor, a data analysis module and an image restoring and data output system; the synchronization module is connected with the image capturing system, the AGPS total system and the image restoration and output system; the data analysis module is connected with the image restoration and data output system, and the AGPS subsystems are arranged at four corners of a stage space; the flexible sensor is worn on the body by the performer. The invention combines AGPS positioning with a flexible sensor to obtain real-time motion information of a performer, synchronizes captured images with the real-time motion information through a synchronization module, analyzes sign information of the performer through a data analysis module, and finally restores and outputs the images. The system of the invention can make the shooting range wider, the feedback information richer and the reduction effect more vivid.

Description

Dance dynamic image capturing and restoring system based on flexible sensor and control method
Technical Field
The invention relates to the technical field of stereo motion shooting processing of stage art, in particular to a dance dynamic image capturing and restoring system and a dance dynamic image controlling method based on a flexible sensor.
Background
Modern stage art including dance, drama, dance and other performance forms is very important for the stereo motion capture and restoration technology of performers in order to present good visual effects to audiences. The existing camera action capturing generally adopts a single camera, two or three camera positions are required to be added when different visual angles are shot, but the capturing of the three-dimensional action is different, and the three-dimensional effect can only be achieved by at least two lenses for one picture. The reason why the human eyes can generate stereoscopic impression is that the distance between the two eyes causes the different angles of the two eyes seeing the object, so that the pictures received by the brain are different, and after the two pictures are combined through the operation of the brain, the two pictures form an image with stereoscopic impression (as shown in fig. 1).
The conventional stereo dynamic image capturing mainly comprises the steps of carrying out plane or stereo shooting and recording on the motion of a performer through a single or multiple cameras so as to obtain the motion composition of the performer, then carrying out multi-angle restoration on the captured image and the motion, wearing tights with capture points fully covered when the performer shoots, forming a capture stage through a set of 'cooperative working cameras', specially shooting light rays reflected from actors, transmitting the data into a computer so as to form a whole special effect lens, and finally carrying out post-processing so as to integrate and restore the previous image and data. However, the existing technology is difficult to realize multi-angle reconstruction of the actions of performers on the stage or theater, and cannot feed back whether the physical conditions and emotion regulation of actors are in place or not, and particularly cannot consider the action consistency and repeatability of multiple performers. Since the conventional stereo motion capture camera system is a dual lens, if the effect of the capture system is to be improved, an expensive multi-lens array set is required, the motion and distance capture precision of the stereo image and motion capture multi-lens array system for performers depends on the distance measurement of an optical system and the precise positioning relation of different lenses (especially the multi-lens array), but for the reasons of transportation and assembly, the spacing between the lenses is generally compact, and when capturing fine motions in a wide-range and wide-view-angle scene, a large system error is inevitable. In addition, in the conventional dynamic image capturing and restoring system, the quality of capturing and restoring actions is mainly determined by the accuracy of an optical system, but because of the limitation of the shooting angle of the lens, the all-round position information of actors is difficult to obtain, and when the number of actors is large, the restoring accuracy of each actor is reduced due to the limitation of the number of lenses, and the stereoscopic effect is greatly reduced.
Disclosure of Invention
The invention aims to overcome the defects and shortcomings in the prior art, and provides a dance dynamic image capturing and restoring system based on a flexible sensor, which not only improves the visual angle and the restoring precision of each posture of a performer dynamic image capturing, but also can obtain biological data (such as pulse beating rate) of physical signs and the like of the performer on line through a scheme of combining a wearable flexible sensor and a base calibration system, and assists a computer to analyze the physical condition (such as whether the physical ability is sufficient) and the psychological state of an actor, and provides assistance for rationality of analysis and arrangement of the performer and guidance (such as whether the physical ability consumption intensity of the actor in a specific time period is too high) and the infection shown by the actor is in place.
Another objective of the present invention is to provide a control method for dance motion image capturing and restoring system based on flexible sensor.
In order to realize the purpose, the invention adopts the following technical scheme:
a dance dynamic image capturing and restoring system based on a flexible sensor comprises an image capturing system, an AGPS total system, an AGPS subsystem, a synchronization module, the flexible sensor, a data analysis module and an image restoring and data output system; the synchronization module is connected with the image capturing system, the AGPS total system and the image restoration and data output system; the data analysis module is connected with the image restoration and data output system, and the AGPS subsystems are arranged at four corners of a stage space; the flexible sensor is worn on the body by the performer; the flexible sensor is combined with AGPS positioning to obtain real-time motion information of a performer, the captured image and the real-time motion information are synchronized by the synchronization module, meanwhile, the sign information of the performer is analyzed by the data analysis module, and finally, the image is restored and data is output;
the image capturing system is used for capturing the motion of a performer and performing multi-angle restoration on the captured image and motion;
the AGPS subsystem is used for sending radio frequency signals to a flexible sensor worn by a performer from multiple angles; sending the feedback information to an AGPS total system;
the flexible sensor is used for acquiring real-time motion information of a wearing part of the sensor and feeding the information back to the AGPS subsystem; in addition, the flexible sensor is also used for sending the physical sign information of the performer to the data analysis module;
the AGPS total system is used for summarizing feedback information of the AGPS subsystems; the feedback information is real-time motion information of wearing parts of the sensors;
the synchronization module is used for synchronizing the feedback information received by the image capture system and the AGPS total system through a frame synchronization algorithm and sending the synchronization information to the image restoration and output system;
the data analysis module is used for analyzing the received actor sign information sent by the flexible sensor and sending the final data to the image restoration and data output system.
Preferably, the image capturing system is a twin-lens camera.
Preferably, the sensor-worn part includes a neck, a wrist, and a knee.
Preferably, the real-time motion information of the sensor wearing part includes a speed, an angular velocity, and a relative distance to a reference point of the sensor wearing part.
As a preferred technical scheme, the AGPS total system is a TK-911 type TKSTARGPS positioner; the AGPS subsystem is specifically an A6 type multi-base-station positioner and at least comprises 4-8 datum points.
As a preferred technical scheme, the synchronization module comprises a client and a server, wherein the client adopts Finalcut pro video editing software for uploading an operation instruction; the server adopts mac pro high-rate configuration for broadcasting an operation instruction to advance the picture frame.
As a preferred technical scheme, the data analysis module analyzes the physical sign information of actors, and effectively confirms whether the physical performance and emotional expression of performers are in place; the data analysis module comprises an EQ-Radio emotion detector and SPSS software; the sign information of the performer comprises the pulse speed and the breathing rate of the pulse.
As a preferred technical scheme, the image restoration and output system is specifically Apple Macintosh and Photoshop software.
The control method of the dance dynamic image capturing and restoring system based on the flexible sensor comprises the following steps:
s1, capturing images within the lens range of the double-lens camera, sending information of different parts of an actor, including relative positions, speeds and angular speeds, to the AGPS subsystem by the flexible sensor, gathering the information by the AGPS subsystem, and sending the information to the synchronization module;
s2, after the image and the AGPS data captured by the double-lens camera are sent to the synchronization module, the image and the data are synchronized by using a frame synchronization algorithm, and the method specifically comprises the following steps:
(1) synchronizing random number seeds;
(2) the client uploads an operation instruction, wherein the instruction comprises operation on a current picture, a current frame index and real-time data;
(3) the server broadcasts the operation of the client; if no operation, broadcasting null command to drive the frame to advance;
(4) in order to realize the playback of the picture, the client requests to the operation file to execute the server to record all the operations again;
(5) after the operations in the steps (1) to (4) are finished, the processed data are sent to an image restoration and data output system;
s3, in the data analysis module, the EQ-Radio emotion detector analyzes the sign information of the actor sent by the flexible sensor, including whether the physical condition of the performer and the emotion expression of the corresponding plot are in place, and sends the information to the image restoration and data output system; the SPSS software compares and analyzes the physical sign data information of the actor with the information accumulated in the past, and judges the physical ability condition of the performer.
The working principle of the invention is as follows:
first, the camera captures the motion of the performer and performs multi-angle restoration of the captured images and motion. Meanwhile, the AGPS subsystem sends radio-frequency signals to a flexible sensor worn by a performer from multiple angles, the flexible sensor feeds back information such as the distance from a wearing part to the AGPS subsystem, the speed and the angular speed of the wearing part to the subsystem, and the information is collected by the AGPS total system. In addition, the flexible sensor sends the sign information of the performer to the data analysis module to assist actors and compile and analyze sign changes and emotional fluctuations in the performance process; secondly, the synchronization module synchronizes the image capture system and the AGPS information (analyzes and calculates the information of different parts in the same time period, particularly restores the parts in the blind area of the camera, so that the 3D effect is more vivid) through a frame synchronization algorithm, sends the information to the digital image restoration and data output system, and finally displays the shot picture through the image restoration and data output system.
Compared with the prior art, the invention has the following advantages and effects:
(1) the invention adopts a mode of combining the base calibration system, the wearable flexible sensor and the double-lens capturing system to assist the traditional camera to better capture the body position in the dead zone of the camera, realizes multi-angle reconstruction of the action of an actor on a stage or a theater, generates a 3D image with stronger stereoscopic impression, well solves the problem of narrower shooting visual angle of the traditional camera, and ensures wider shooting range, richer feedback information and more vivid restoration effect.
(2) The system obtains biological data (such as pulse beating rate) of physical signs and the like of a performer on line through the flexible sensor, assists the computer to analyze physical conditions (such as whether physical energy is sufficient) and psychological states of the performer, and provides help for rationality of analysis and arrangement (such as whether physical energy consumption intensity of the performer is too high in a specific time period) and whether infectivity shown by the performer is in place.
(3) According to the invention, the base calibration system and the wearable flexible sensor are combined with the traditional photography technology, and the results of the synchronization module and the data analysis module for real-time movement such as distance, speed and angle are assisted, so that the visual angle for capturing dynamic images of performers and the reduction precision of each body position are effectively improved.
Drawings
Fig. 1 is a schematic diagram of a stereoscopic image in the background art.
FIG. 2 is a schematic diagram of the system according to the present embodiment; wherein, the label explains: 1. an image capture system; 2. an AGPS Total System; 3. an AGPS subsystem; 4. a synchronization module; 5. a flexible sensor; 6. a data analysis module; 7. an image restoration and data output system; 8. and (4) indoor.
Fig. 3 is a schematic diagram of a signal control flow of the system according to the embodiment.
FIGS. 4(a) -4 (b) are schematic diagrams showing the image capturing system of the present embodiment before and after improvement; fig. 4(a) is a schematic diagram illustrating the capturing effect of a conventional image capturing system, and fig. 4(b) is a schematic diagram illustrating the capturing effect of an improved image capturing system.
Detailed Description
The invention is described in further detail below with reference to the figures and specific embodiments.
Examples
As shown in FIG. 2, a dance motion picture capturing and restoring system based on a flexible sensor comprises an image capturing system 1, an AGPS total system 2, an AGPS subsystem 3, a synchronization module 4, a flexible sensor 5, a data analysis module 6 and an image restoring and data output system 7; the synchronization module 4 is connected 6 with the image capture system 1, the AGPS total system 2 and the image restoration and data output system; the data analysis module 6 is connected with an image restoration and data output system 7, and the AGPS subsystem 3 is arranged at four corners of a stage space of an indoor 8; the flexible sensor 5 is worn on the body by the performer; the flexible sensor is combined with AGPS positioning to obtain real-time motion information of a performer, the captured image and the real-time motion information are synchronized by the synchronization module, meanwhile, the sign information of the performer is analyzed by the data analysis module, and finally, the image is restored and data is output;
the image capturing system 1 is used for capturing the motion of a performer and performing multi-angle restoration on the captured images and motion;
as shown in fig. 3, the AGPS subsystem 3 is used for sending radio frequency signals from multiple angles to a flexible sensor worn by a performer; sending the feedback information to an AGPS total system;
the flexible sensor 5 is used for acquiring real-time motion information of a wearing part of the sensor and feeding the information back to the AGPS subsystem; in addition, the flexible sensor is also used for sending the sign information of the performer to the data analysis module, assisting the actor and guiding and analyzing the sign change and emotional fluctuation in the actor list process;
the AGPS total system 2 is used for summarizing feedback information of the AGPS subsystems; the feedback information is real-time motion information of wearing parts of the sensors;
the synchronization module 4 is used for synchronizing the feedback information received by the image capture system and the AGPS total system through a frame synchronization algorithm and sending the synchronization information to the image restoration and output system 7;
and the data analysis module 6 is used for analyzing the received actor sign information sent by the flexible sensor and sending the final data to the image restoration and data output system.
In this embodiment, the image capture system is a dual lens camera;
the sensor wearing part comprises a neck, a wrist and a knee;
the real-time motion information of the sensor wearing part comprises the speed, the angular speed and the relative distance from the sensor wearing part to a reference point;
the AGPS total system is a TK-911 type TKSTARGPS positioner; the AGPS subsystem is specifically an A6 type multi-base-station positioner and at least comprises 4-8 datum points;
the synchronization module comprises a client and a server, wherein the client adopts Final cut pro video editing software and is used for uploading an operation instruction; the server adopts mac pro high-configuration and is used for broadcasting an operation instruction to advance a picture frame;
the data analysis module analyzes the physical sign information of the actors and effectively confirms whether the physical performance and emotional expression of the performers are in place or not; the data analysis module comprises an EQ-Radio emotion detector and SPSS software; the sign information of the performer comprises the pulse speed and the breathing rate of the pulse;
the image restoration and output system is specifically Apple Macintosh and Photoshop software.
Fig. 4(a) is a schematic diagram illustrating the capturing effect of a conventional image capturing system, and due to the limitations of the viewing angle (60 ° -75 °) and the position of a conventional camera, it is difficult to capture information of an individual in all directions, and it is more difficult when there are a large number of actors, so that it is difficult to obtain information of a portion in a blind area with a relatively accurate compensation amount. Fig. 4(b) is a schematic diagram showing the capturing effect of the image capturing system after the implementation improvement, in which four (or more) positioning auxiliary systems are added at four corners of the stage space, and a flexible sensor worn by an actor is combined, so that not only can a camera be assisted to better capture motion details in a visual angle, but also details in a blind area of the camera can be captured, and simultaneously biological information such as physical signs of the actor is transmitted to a computer through the flexible sensor to obtain a more vivid 3D effect, and a specific control flow chart is shown in fig. 3.
The control method of the dance dynamic image capturing and restoring system based on the flexible sensor comprises the following steps:
s1, capturing images within the lens range by the double-lens camera, sending information of different parts of the actor, including relative position, speed and angular speed, to the AGPS subsystem by the flexible sensor, gathering the information by the AGPS subsystem, and sending the information to the synchronization module.
S2, sending the image captured by the double-lens camera and the AGPS data to a synchronization module, and synchronizing the image and the data by using a frame synchronization algorithm, wherein the method specifically comprises the following steps:
(1) synchronizing random number seeds;
(2) the client uploads an operation instruction, wherein the instruction comprises operation on a current picture, a current frame index and real-time data;
(3) the server broadcasts the operation of the client; if no operation, broadcasting null command to drive the frame to advance;
(4) in order to realize the playback of the picture, the client requests to the operation file to execute the server to record all the operations again;
(5) after the operations in the steps (1) to (4) are finished, the processed data are sent to an image restoration and data output system;
s3, in the data analysis module, the EQ-Radio emotion detector analyzes the sign information of the actor sent by the flexible sensor, including whether the physical condition of the performer and the emotion expression of the corresponding plot are in place, and sends the information to the image restoration and data output system; the SPSS software compares and analyzes the physical sign data information of the actor with the information accumulated in the past, and judges the physical ability condition of the performer.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the claims.

Claims (7)

1. A dance dynamic image capturing and restoring system based on a flexible sensor is characterized by comprising an image capturing system (1), an AGPS (automatic Generation broadcasting) total system (2), an AGPS subsystem (3), a synchronization module (4), the flexible sensor (5), a data analysis module (6) and an image restoring and data output system (7); the synchronization module (4) is connected with the image capturing system (1), the AGPS total system (2) and the image restoration and data output system (7); the data analysis module (6) is connected with an image restoration and data output system (7), and the AGPS subsystem (3) is arranged at four corners of a stage space; the flexible sensor (5) is worn on the body by a performer, and wearing parts comprise a neck, a wrist and a knee; the flexible sensor is combined with AGPS positioning to obtain real-time motion information of a performer, the captured image and the real-time motion information are synchronized by the synchronization module, meanwhile, the sign information of the performer is analyzed by the data analysis module, and finally, the image is restored and data is output;
the image capturing system (1) is a double-lens camera and is used for capturing the motion of a performer and restoring the captured images and motions at multiple angles;
the AGPS subsystem (3) is used for sending radio frequency signals to a flexible sensor worn by a performer from multiple angles; sending the feedback information to an AGPS total system;
the flexible sensor (5) is used for acquiring real-time motion information of a wearing part of the sensor and feeding the information back to the AGPS subsystem; in addition, the flexible sensor is also used for sending the physical sign information of the performer to the data analysis module;
the AGPS total system (2) is used for summarizing feedback information of the AGPS subsystem; the feedback information is real-time motion information of wearing parts of the sensors;
the synchronization module (4) is used for synchronizing the feedback information received by the image capture system and the AGPS total system through a frame synchronization algorithm and sending the synchronization information to the image restoration and data output system;
the data analysis module (6) is used for analyzing the received physical sign information of the performer sent by the flexible sensor and sending the final data to the image restoration and data output system.
2. A flexible sensor based dance motion image capture and recovery system according to claim 1, wherein said real-time motion information of the sensor wearing portion includes a speed, an angular velocity and a relative distance to a reference point of the sensor wearing portion.
3. A dance motion image capturing and restoring system based on flexible sensor according to claim 1, wherein the AGPS total system is TK-911 type TKSTARGPS positioner; the AGPS subsystem is specifically an A6 type multi-base-station positioner and comprises 4-8 datum points.
4. A dance dynamic image capturing and restoring system based on a flexible sensor according to claim 1, wherein the synchronization module includes a client and a server, the client uses Final cut pro video editing software for uploading operation instructions; the server adopts mac pro high-rate configuration for broadcasting operation instructions to drive the picture frame to advance.
5. A flexible sensor-based dance motion picture capturing and restoring system according to claim 1, wherein said data analysis module analyzes the physical sign information of the performer to effectively confirm whether the performance and emotional expression of the performer are in place; the data analysis module comprises an EQ-Radio emotion detector and SPSS software; the sign information of the performer comprises the pulse speed and the breathing rate of the pulse.
6. A dance motion picture capturing and restoring system based on a flexible sensor according to claim 1, wherein the image restoring and data output system is specifically Apple Macintosh and Photoshop software.
7. The method for controlling a dance motion image capturing and restoring system according to any one of claims 1 to 6, comprising the steps of:
s1, capturing images within the lens range of the double-lens camera, sending information of different parts of the performer, including relative position, speed and angular speed, to the AGPS subsystem by the flexible sensor, gathering the information by the AGPS subsystem, and sending the information to the synchronization module;
s2, after the image and the AGPS data captured by the double-lens camera are sent to the synchronization module, the image and the data are synchronized by using a frame synchronization algorithm, and the method specifically comprises the following steps:
(1) synchronizing random number seeds;
(2) the client uploads an operation instruction, wherein the instruction comprises operation on a current picture, a current frame index and real-time data;
(3) the server broadcasts the operation of the client; if no operation, broadcasting null command to drive the frame to advance;
(4) in order to realize the playback of the picture, the client requests to the operation file to execute the server to record all the operations again;
(5) after the operations in the steps (1) to (4) are finished, the processed data are sent to an image restoration and data output system;
s3, in the data analysis module, the EQ-Radio emotion detector analyzes the sign information of the performer sent by the flexible sensor, including whether the physical performance condition of the performer and the emotion expression of the corresponding plot are in place, and sends the information to the image restoration and data output system; the SPSS software compares and analyzes the physical sign data information of the performer with the information accumulated in the past, and judges the physical ability condition of the performer.
CN201810126169.XA 2018-02-08 2018-02-08 Dance dynamic image capturing and restoring system based on flexible sensor and control method Active CN108307175B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201810126169.XA CN108307175B (en) 2018-02-08 2018-02-08 Dance dynamic image capturing and restoring system based on flexible sensor and control method
PCT/CN2018/110444 WO2019153783A1 (en) 2018-02-08 2018-10-16 Dynamic dance image capture and restoration system based on flexible sensor, and control method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810126169.XA CN108307175B (en) 2018-02-08 2018-02-08 Dance dynamic image capturing and restoring system based on flexible sensor and control method

Publications (2)

Publication Number Publication Date
CN108307175A CN108307175A (en) 2018-07-20
CN108307175B true CN108307175B (en) 2020-01-14

Family

ID=62864479

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810126169.XA Active CN108307175B (en) 2018-02-08 2018-02-08 Dance dynamic image capturing and restoring system based on flexible sensor and control method

Country Status (2)

Country Link
CN (1) CN108307175B (en)
WO (1) WO2019153783A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108307175B (en) * 2018-02-08 2020-01-14 华南理工大学 Dance dynamic image capturing and restoring system based on flexible sensor and control method
CN115297275B (en) * 2022-08-02 2023-04-07 北京国信互通科技有限公司 Restricted space audio and video data acquisition method based on wireless MESH transmission

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104883557A (en) * 2015-05-27 2015-09-02 世优(北京)科技有限公司 Real time holographic projection method, device and system
CN104957940A (en) * 2015-05-29 2015-10-07 王旭昂 Water cup with communication function and water cup communication system
CN205334369U (en) * 2015-09-22 2016-06-22 深圳数虎图像股份有限公司 Stage performance system based on motion capture
CN105999682A (en) * 2016-06-14 2016-10-12 郑州华信学院 Sports training monitoring system
CN106066701A (en) * 2016-07-05 2016-11-02 成都福兰特电子技术股份有限公司 A kind of AR and VR data handling equipment and method
CN106464848A (en) * 2014-04-21 2017-02-22 博拉斯特运动有限公司 Motion event recognition and video synchronization system and method

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1784612A (en) * 2003-03-11 2006-06-07 梅纳谢有限公司 Radio frequency motion tracking system and method
US20070247422A1 (en) * 2006-03-30 2007-10-25 Xuuk, Inc. Interaction techniques for flexible displays
CN101435989B (en) * 2007-11-16 2010-06-16 深圳华强数码电影有限公司 Tracking visual field and method for making three-dimensional film by secondary rendering
KR101644022B1 (en) * 2014-10-13 2016-07-29 주식회사 진스튜디오 Real-time apparatus for analyzing taekwondo motion using kinect sensor and method thereof
CN108307175B (en) * 2018-02-08 2020-01-14 华南理工大学 Dance dynamic image capturing and restoring system based on flexible sensor and control method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106464848A (en) * 2014-04-21 2017-02-22 博拉斯特运动有限公司 Motion event recognition and video synchronization system and method
CN104883557A (en) * 2015-05-27 2015-09-02 世优(北京)科技有限公司 Real time holographic projection method, device and system
CN104957940A (en) * 2015-05-29 2015-10-07 王旭昂 Water cup with communication function and water cup communication system
CN205334369U (en) * 2015-09-22 2016-06-22 深圳数虎图像股份有限公司 Stage performance system based on motion capture
CN105999682A (en) * 2016-06-14 2016-10-12 郑州华信学院 Sports training monitoring system
CN106066701A (en) * 2016-07-05 2016-11-02 成都福兰特电子技术股份有限公司 A kind of AR and VR data handling equipment and method

Also Published As

Publication number Publication date
CN108307175A (en) 2018-07-20
WO2019153783A1 (en) 2019-08-15

Similar Documents

Publication Publication Date Title
US9774896B2 (en) Network synchronized camera settings
US8390729B2 (en) Method and apparatus for providing a video image having multiple focal lengths
WO2020240284A3 (en) Vehicle environment modeling with cameras
CN102221887B (en) Interactive projection system and method
US20120002014A1 (en) 3D Graphic Insertion For Live Action Stereoscopic Video
WO2017173735A1 (en) Video see-through-based smart eyeglasses system and see-through method thereof
US9253470B2 (en) 3D camera
WO2017200847A1 (en) Intelligent interface for interchangeable sensors
US10129503B1 (en) Image-capturing watch
US20150304629A1 (en) System and method for stereophotogrammetry
CN114638918B (en) Real-time performance capturing virtual live broadcast and recording system
US11601572B2 (en) Electronic tracking device for camera and related system for controlling image output of the camera
CN108307175B (en) Dance dynamic image capturing and restoring system based on flexible sensor and control method
US20220137555A1 (en) System and method for lightfield capture
JP2023502552A (en) WEARABLE DEVICE, INTELLIGENT GUIDE METHOD AND APPARATUS, GUIDE SYSTEM, STORAGE MEDIUM
CN116016836A (en) Conference video processing method and system
KR101796539B1 (en) Image photographing apparatus and method thereof
CN109963136B (en) Working method and device of light depth camera with smart phone structure
Rotem et al. Automatic video to stereoscopic video conversion
US11792511B2 (en) Camera system utilizing auxiliary image sensors
CN110770649A (en) Multi-camera system for tracking one or more objects through a scene
US6603503B1 (en) Methods, systems and devices for displaying live 3-D, parallax and panoramic images
US20080252746A1 (en) Method and apparatus for a hybrid wide area tracking system
KR101598921B1 (en) System and Method for Taking Pictures beyond Space Scale with Automatical Camera
CN203086581U (en) Three-dimensional video recording device with GPS positioning function

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant