WO2022162808A1 - Dispositif de traitement de données, programme, et procédé de traitement de données - Google Patents

Dispositif de traitement de données, programme, et procédé de traitement de données Download PDF

Info

Publication number
WO2022162808A1
WO2022162808A1 PCT/JP2021/002926 JP2021002926W WO2022162808A1 WO 2022162808 A1 WO2022162808 A1 WO 2022162808A1 JP 2021002926 W JP2021002926 W JP 2021002926W WO 2022162808 A1 WO2022162808 A1 WO 2022162808A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
music
movement
pitch
animation
Prior art date
Application number
PCT/JP2021/002926
Other languages
English (en)
Japanese (ja)
Inventor
裕子 石若
Original Assignee
ソフトバンク株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソフトバンク株式会社 filed Critical ソフトバンク株式会社
Priority to PCT/JP2021/002926 priority Critical patent/WO2022162808A1/fr
Priority to JP2022577897A priority patent/JPWO2022162808A1/ja
Publication of WO2022162808A1 publication Critical patent/WO2022162808A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation

Definitions

  • the present invention relates to a data processing device, program, and data processing method.
  • Patent Literature 1 describes a technique for estimating a try-on person's posture in real time and simulating the movement of clothes according to the estimated time-series posture.
  • Non-Patent Document 1 and Non-Patent Document 2 describe tools and the like for generating a clothing model.
  • Patent Literature [Patent Literature] [Patent Document 1] JP-A-2006-249618 [Non-Patent Document] [Non-Patent Document 1] UMETANI N., KAUFMAN D. M., IGARASHI T., GRINSPUN E.: Sensitive fashion for interactive garment editing and modeling. ACM Transactions on Graphics (SIGGRAPH 2011) 30, 4 (2011).
  • Non-Patent Document 2 BERTHOUZOZ F., GARG A., KAUFMAN D. M., GRINSPUN E., AGRAWALA M.: Parsing sewing patterns into 3d garments. ACM Trans. Graph. 32, 4 (July 2013), 85:1-85 : 12.
  • a data processing device may include an animation data acquisition unit that acquires animation data in which the object moves.
  • the data processing device may include a music data acquisition unit that acquires music data of music to be reproduced together with the animation data.
  • the data processing device may comprise a data updater that updates the motion of the object in the animation data based on the music data.
  • the music data acquisition unit may acquire BGM data of the animation data as the music data.
  • the data updating section may update the movement of the object by reflecting the magnitude of movement based on the music data on the movement of the object according to the physical laws.
  • the data updating unit reflects the magnitude of the movement based on the music data to the movement of the object according to the physical law according to the reflection ratio of the music data with respect to the physical law, thereby updating the movement of the object. can be updated.
  • the above reflection ratio may be arbitrarily settable and may be changeable.
  • the data updating unit may increase the movement of the object as the pitch of the music corresponding to the portion in which the object moves in the animation data is higher.
  • the data update unit may reduce the movement of the object as the pitch of the music corresponding to the portion in which the object moves in the animation data is higher.
  • the data processing device may include a registration unit that registers the first shape and the second shape of the object for each of the first pitch and the second pitch included in the music data.
  • the data updating unit may update the movement of the object based on the first pitch and the first shape, and the second pitch and the second pitch.
  • the second shape may be a shape with greater movement than the first shape.
  • the second shape may be a shape with less movement than the first hair shape.
  • the registration unit complements shapes of the object corresponding to pitches between the first pitch and the second pitch using the first shape and the second shape. may be generated by 8.
  • the second pitch may be higher than the first pitch, and the registration unit stores a pitch lower than the first pitch and a pitch higher than the second pitch.
  • a corresponding shape of the object may be generated by interpolating with the first shape and the second shape.
  • the data updating unit may update the movement of the object based on the shape of the object registered in association with the pitch of music corresponding to the portion in which the object moves in the animation data.
  • the data updating unit calculates the shape of the object according to the difference between the reference shape, which is the shape of the object generated according to the laws of physics at a certain timing, and the corresponding shape, which is the shape of the object corresponding to the pitch of the music at that timing. can be updated.
  • the data updating unit may increase the movement of the reference shape according to a set reflection ratio.
  • the data updating unit may reduce the movement of the reference shape according to a set reflection ratio.
  • the music may be composed of a plurality of parts, and the data updating unit updates the movement of the first part of the object based on a first part of the plurality of parts, may update the movement of the second portion of the object based on the second part of the.
  • the music may be composed of a plurality of parts, the animation data may include a plurality of the objects, and the data updating unit updates the plurality of objects based on a first part of the plurality of parts.
  • a movement of a first object of the plurality of objects may be updated, and a movement of a second one of the plurality of objects may be updated based on a second one of the plurality of parts.
  • the data update unit may further update at least one of the material element, the effect element, and the environment element of the space in which the object is located in the animation data based on the music data.
  • the data update unit may update the expression of lighting in the animation data based on the music data.
  • the data update unit may provide less lighting for higher pitches and more lighting for lower pitches.
  • the data update section may change the material of the object based on the music data.
  • the data update unit may change the material of the object to a lighter material when the pitch is higher, and change the material of the object to a heavier material when the pitch is lower.
  • the data updating unit changes the material of the object to a more reflective material when the pitch is higher, and changes the material of the object to a less reflective material when the pitch is lower. good.
  • the data updating unit may change the degree of the superimposed object superimposed on the object based on the music data.
  • the data updating unit may increase the degree of dark image superimposed objects such as raindrops when the pitch is lower.
  • the data processing device includes: a music data generation unit for generating music data of music to be reproduced together with the animation data based on the movement of the object in the animation data acquired by the animation data acquisition unit; and a playback control unit that controls to play back the music data.
  • the data processing device may include a registration unit that associates and registers the shape of the object and the pitch.
  • the registration unit registers a first pitch and a second pitch for each of a first shape of the object and a second shape having a larger movement than the first shape. you can
  • the registration unit registers pitches corresponding to shapes other than the first shape and the second shape in the first shape and the first pitch, and the second shape and the second shape. Registration may be based on pitch.
  • the registration unit may assign a pitch between the first pitch and the second pitch to each shape between the first shape and the second shape.
  • the registration unit when the second pitch is higher than the first pitch, the pitch is lower than the first pitch for the shape with smaller movement than the first shape.
  • a pitch higher than the second pitch may be assigned to a shape that moves more than the second shape.
  • the registration unit registers a pitch higher than the first pitch with respect to the shape with a smaller movement than the first shape.
  • a higher pitch may be assigned, and a lower pitch than the second pitch may be assigned to shapes with greater movement than the second shape.
  • the object may be the clothing in animation data in which the clothing moves in accordance with the movement of the wearer wearing the clothing.
  • the object may be the hair in animation data in which the hair moves according to the movement of the person.
  • a data processing device may include an animation data acquisition unit that acquires animation data in which the object moves.
  • the data processing device may include a music data generator that generates music data of music to be played back together with the animation data based on the movement of the object in the animation data.
  • the data processing device may include a reproducing unit that reproduces the music data together with the animation data.
  • a program for causing a computer to function as the data processing device.
  • a computer-implemented data processing method may comprise an animation data acquisition step of acquiring animation data of the object moving.
  • the data processing method may comprise a music data obtaining step of obtaining music data of music played with the animation data.
  • the data processing method may comprise a data update step of updating the movement of objects in the animation data based on the music data.
  • a computer-implemented data processing method may comprise an animation data acquisition step of acquiring animation data of the object moving.
  • the data processing method may comprise a music data generation step of generating music data for music to be played with the animation data based on the movement of the object in the animation data.
  • the data processing method may comprise a playing step of playing the music data together with the animation data.
  • FIG. 4 is an explanatory diagram for explaining music data;
  • FIG. 4 is an explanatory diagram for explaining music data;
  • An example of registration data 152 by the registration unit 132 is schematically shown.
  • 4 schematically shows an example of correspondence between pitches and shapes of objects;
  • 4 schematically shows an example of correspondence between pitches and shapes of objects;
  • An example of registration data 154 by the registration unit 132 is schematically shown.
  • An example of a portion of garment 300 is shown schematically.
  • 1 schematically shows an example of a hardware configuration of a computer 1200 functioning as the data processing device 100.
  • the data processing device 100 acquires, for example, animation data in which an object moves and music data of music played with the animation data, and updates the movement of the object in the animation data based on the music data. By doing so, it is possible to automatically generate animation data in which the object moves in time with the music, which contributes to reducing the number of animation production processes and also enables the generation of unexpected movements.
  • FIG. 1 schematically shows an example of a data processing device 100.
  • the data processing device 100 executes processing for updating the movement of the object in the animation data in which the object moves, based on the music data of the music played together with the animation data.
  • An object can be anything.
  • the object is clothing in animation data in which the clothing moves according to the movement of the wearer wearing the clothing.
  • the object is hair in animation data in which hair moves according to the movement of a person.
  • objects include people, characters, things worn by people and characters (clothes, accessories, etc.), parts of people and characters (parts of the body and hair, etc.), and plants. is not limited to In this embodiment, the case where the object is clothes will be mainly described as an example.
  • the data processing device 100 acquires, for example, animation data (which may be referred to as reference data) in which an object moves, and updates the movement of the object based on music data played together with the animation data.
  • animation data (sometimes referred to as update data) is generated such that the movement of the object increases according to the climax of the music.
  • the data processing device 100 obtains reference data in which clothes move in accordance with the movement of the wearer according to the laws of physics, and updates the movement of the clothes based on the BGM data of the animation data. To generate update data such that the movement of clothes increases according to the excitement.
  • the data processing device 100 acquires reference data including, for example, wearing body data and clothing data.
  • the wearable object data may be animation data in which the wearable object moves.
  • the clothing data may be animation data of clothing that moves according to the movement of the wearer according to the laws of physics.
  • the data processing device 100 may generate update data by generating clothing data in which the movement of clothing is changed based on the BGM data.
  • the data processing device 100 may generate reference data according to the actual movement of a person or the like. For example, the data processing device 100 generates wearing object data representing the three-dimensional shape of a person captured by the camera 150 using polygon meshes, and clothing data representing the three-dimensional shape of clothes worn by the person using polygon meshes. Also, the data processing apparatus 100 may generate reference data such as CG characters regardless of the actual movement of a person.
  • the data processing device 100 for example, outputs the generated update data to a display and a speaker included in the data processing device 100. Further, the data processing device 100 may cause the communication terminal 400 to output the generated update data by transmitting it to the communication terminal 400 via the network 20, for example.
  • the communication terminal 400 may be a PC (Personal Computer), tablet terminal, smartphone, or the like. Data processing apparatus 100 and communication terminal 400 may communicate via network 20 .
  • Network 20 may include the Internet.
  • the network 20 may include a LAN (Local Area Network).
  • Network 20 may include a mobile communication network.
  • the mobile communication network conforms to any of the 3G (3rd Generation) communication method, LTE (Long Term Evolution) communication method, 5G (5th Generation) communication method, and 6G (6th Generation) communication method and later communication methods. good too.
  • the data processing device 100 may receive reference data from the communication terminal 400 .
  • the communication terminal 400 generates, for example, reference data including body-of-wear data of a person captured by the camera 450 and clothing data of clothing worn by the person, and transmits the reference data to the data processing device 100 .
  • Camera 450 may be built in communication terminal 400 or may be externally attached to communication terminal 400 .
  • FIG. 2 schematically shows an example of the functional configuration of the data processing device 100.
  • the data processing device 100 includes a data receiving section 102 , an animation data acquiring section 110 , a music data acquiring section 120 , a registering section 132 , a data updating section 134 , a reproduction controlling section 136 , a registering section 142 and a music data generating section 144 . It should be noted that it is not essential that the data processing apparatus 100 have all of these.
  • the data receiving unit 102 receives various data.
  • the data receiving section 102 may receive various data via the network 20 .
  • the data receiving unit 102 receives various data from the communication terminal 400, for example.
  • the data receiving unit 102 receives, for example, reference data.
  • the data receiving unit 102 receives, for example, wearing body data.
  • the data receiving unit 102 receives, for example, imaging data obtained by imaging a person or the like.
  • the data receiving unit 102 receives, for example, music data of music to be reproduced together with the reference data.
  • the data receiving section 102 may receive music data together with the reference data.
  • the data receiving section 102 may receive the BGM data of the reference data as the music data.
  • the animation data acquisition unit 110 acquires reference data.
  • the animation data acquisition section 110 may acquire the reference data received by the data reception section 102 .
  • the animation data acquisition unit 110 may acquire reference data generated by a user or the like of the data processing device 100 using the data processing device 100 .
  • the animation data acquisition unit 110 may acquire reference data from a portable computer-readable storage medium.
  • the animation data acquisition unit 110 may acquire the reference data by generating the reference data.
  • the animation data acquisition unit 110 has an animation data generation unit 112 .
  • the animation data generation unit 112 analyzes the imaging data received by the data reception unit 102, thereby generating reference data in which the object moves according to the laws of physics. For example, the animation data generation unit 112 analyzes the imaging data to generate reference data in which the clothes move according to the movement of the wearer wearing the clothes according to the laws of physics.
  • the animation data generation unit 112 analyzes the wearable body data received by the data receiving unit 102 to obtain clothing that is worn on the wearable body included in the wearable body data and that moves in accordance with the movement of the wearable body according to the laws of physics. Generating data may generate reference data. The animation data generator 112 may generate the reference data using any known technique.
  • the registration unit 132 registers data used to update the movement of the object in the reference data acquired by the animation data acquisition unit 110 .
  • the registration unit 132 may register data according to instructions from the user of the data processing device 100, the user of the communication terminal 400, or the like.
  • the registration unit 132 for example, generates shapes of objects corresponding to pitches between the first pitch and the second pitch by interpolating them using the first shape and the second shape. do.
  • the registration unit 132 complements the shape of the object corresponding to the pitch lower than the first pitch and the pitch higher than the second pitch using the first shape and the second shape. may be generated by
  • the data update unit 134 increases the movement of the object as the pitch of the music corresponding to the part where the object moves in the reference data is higher. As a result, it is possible to generate update data that increases the movement of the object when the pitch of the music played along with the reference data is high.
  • the data update unit 134 updates the motion of the object by reflecting the magnitude of the motion based on the music data to the motion of the object according to the physical law according to the reflection ratio of the music data to the physical law. good.
  • the reflection ratio may be set arbitrarily and may be changed.
  • the data updating unit 134 sets the reflection ratio according to instructions from the user of the data processing device 100 and the user of the communication terminal 400, for example.
  • the data update unit 134 may update the movement of the object based on the shape of the object registered in association with the pitch of the music corresponding to the part where the object moves in the reference data. For example, the data update unit 134 may update the shape of an object generated according to the laws of physics at a certain timing (sometimes referred to as a reference shape) and the shape of an object corresponding to the pitch of music at that timing (corresponding shape). The shape of the object is updated according to the difference from For example, when the movement of the corresponding shape is greater than that of the reference shape, the data updating unit 134 increases the movement of the reference shape according to the set reflection ratio. Further, for example, when the movement of the corresponding shape is smaller than that of the reference shape, the data updating unit 134 reduces the movement of the reference shape according to the set reflection ratio.
  • the data update unit 134 may update the expression of lighting based on the music data.
  • the lighting representation can be varied, for example, by changing the lighting intensity, the lighting angle, the lighting color, and the like. It should be noted that the degrees, angles, and colors are examples, and the expression of lighting can be changed by changing other elements.
  • the data updater 134 may provide less lighting for higher pitches and more lighting for lower pitches. This may add a hint of darkness at lower pitches by increasing the degree of lighting and enhancing the shadow component.
  • An example of an object material element is an object material element.
  • the data updating section 134 may change the material of the object based on the music data. For example, the data updating unit 134 changes the material of the object to a lighter material when the pitch is higher, and changes the material of the object to a heavier material when the pitch is lower. This makes it possible to create an animation in which the object moves lightly when the pitch is high, and moves heavily when the pitch is low. Also, for example, the data updating unit 134 changes the material of the object to a material with higher reflectivity when the pitch is higher, and changes the material of the object to a material with lower reflectivity when the pitch is lower. Let As a result, when the pitch is high, by changing the material to a highly reflective material, the brightness of the object can be improved and the expression of brightness can be added.
  • the data update unit 134 may change the degree of superimposed objects based on the music data. For example, when the pitch is lower, the data updating unit 134 enhances the degree of dark image superimposed objects such as raindrops. Thereby, when the pitch is lower, the dark image can be added to the object by adding the superimposed object of the dark image to a stronger degree.
  • the reproduction control unit 136 controls to reproduce the animation data updated by the data update unit 134 (that is, the update data).
  • the reproduction control unit 136 causes, for example, a display and a speaker included in the data processing device 100 to output the update data.
  • reproduction control section 136 may control the display and speaker provided in communication terminal 400 to output the update data.
  • the registration unit 142 registers data for generating music data of music to be reproduced together with the reference data based on the movement of the object in the reference data acquired by the animation data acquisition unit 110 .
  • the registration unit 142 may register data in accordance with an instruction from the user of the data processing device 100, the user of the communication terminal 400, or the like.
  • the registration unit 142 associates and registers the shape of the object and the pitch. For example, the registration unit 142 registers the first pitch and the second pitch for each of the first shape of the object and the second shape with a larger movement than the first shape. .
  • the registration unit 142 determines pitches corresponding to shapes other than the first shape and the second shape based on the first shape and the first pitch and the second shape and the second pitch. You may register.
  • the registration unit 142 assigns a pitch between the first pitch and the second pitch to each shape between the first shape and the second shape.
  • the registration unit 142 registers a pitch lower than the first pitch for a shape whose movement is smaller than that of the first shape, for example. , and assigns pitches higher than the second pitch to shapes that move more than the second shape.
  • the registration unit 142 assigns a pitch higher than the first pitch to a shape whose movement is smaller than that of the first shape, for example. assigning, assigning pitches lower than the second pitch to shapes with greater movement than the second shape;
  • the music data generation unit 144 generates music data of music to be reproduced together with the reference data based on the movement of the object in the reference data acquired by the animation data acquisition unit 110 .
  • the music data generation section 144 may generate music data using the data registered by the registration section 142 .
  • the music data generation unit 144 generates music data by, for example, identifying the shape of the object at each timing and identifying the pitch corresponding to the shape of the object.
  • the reproduction control unit 136 may control the music data generated by the music data generation unit 144 to be reproduced.
  • the reproduction control section 136 may perform control so that only music data is reproduced.
  • the reproduction control unit 136 causes, for example, a speaker included in the data processing device 100 to output music data.
  • reproduction control section 136 may control the speaker of communication terminal 400 to output the music data.
  • the reproduction control unit 136 may control to reproduce the music data together with the animation data.
  • the reproduction control unit 136 causes, for example, a display and a speaker provided in the data processing device 100 to output music data and animation data.
  • reproduction control section 136 may control the display and speaker provided in communication terminal 400 to output the music data and the animation data.
  • the movement of objects in animation data can be audibly confirmed. For example, if the music is playing smoothly and the pitch is suddenly out of tune, the movement of the object corresponding to that part may be abnormal. This can be confirmed by listening to the data.
  • FIG. 3 is an explanatory diagram for explaining music data.
  • the music data may be data of the sound itself, or may be data of a musical score representing the sound.
  • the average speed 202 indicates the average speed of the music
  • the time signature 204 indicates the time signature of the music
  • the notes indicate the pitch and duration.
  • the data updating unit 134 can adjust the speed of the object's movement according to the interval between notes, and adjust the magnitude of the object's movement according to the pitch.
  • the data update unit 134 updates the movement of an object based on music data with a large proportion of sixteenth notes, the movement of the object becomes faster, and the movement of the object is updated based on music data with a large proportion of whole notes.
  • Objects may move slower when updated.
  • the data updating unit 134 updates the object movement based on the low pitch, the object movement becomes smaller, and when the object movement is updated based on the high pitch, the object movement becomes smaller. can be large.
  • FIG. 4 is an explanatory diagram for explaining music data.
  • Music data may be MIDI data 210 .
  • the MIDI data 210 includes information on the overall Average Speed and Rhythm, and the pitch (pitch) and duration of each melody and part.
  • FIG. 5 schematically shows an example of registration data 152 by the registration unit 132.
  • the registration data 152 includes shapes with different magnitudes of movement for a given object (skirt in the example shown in FIG. 3). In the example shown in FIG. 3, the movement increases in the order of S1, S2, S3, and S4.
  • FIG. 6 schematically show an example of the correspondence relationship between the pitch and the shape of the object.
  • shape: S1 is associated with “pitch: 44”
  • shape: S2 is associated with “pitch: 49”.
  • correspondence data 170 of FIG. 7 “shape: S1” is associated with “pitch: 44”
  • shape: S4 is associated with "pitch: 49”.
  • Shapes can be registered. Further, when the user of the data processing device 100 and the user of the communication terminal 400 want to increase the degree of exaggeration of the motion of the object, as shown in FIG. can register a shape with a large .
  • FIG. 8 schematically shows an example of registration data 154 by the registration unit 132.
  • the registration data 154 includes an original shape 156 (Original) and a deformed shape 158 (Deformed) for a certain object (a court in the example shown in FIG. 9).
  • the shape 156 may be, for example, the shape with the smallest amount of movement, and the shape 158 may be the shape with the largest amount of movement. Shape 158 may be generated by setting the maximum vertex spacing shift of the mesh in shape 156 .
  • FIG. 9 is an explanatory diagram for explaining the assignment of assigning each of the multiple parts that make up the music to each part of the clothing 300.
  • the data updating unit 134 may update the movement of each part of the object based on the corresponding parts. For example, the data updating unit 134 updates the motion of the first part of the object based on the first part of the plurality of parts, and updates the motion of the object based on the second part of the plurality of parts. Update the movement of the second part.
  • the user of the data processing apparatus 100 and the user of the communication terminal 400 do not want the user to move too much, but want the part 302 to move a little in time with the music. can be assigned.
  • the user of the data processing device 100 and the user of the communication terminal 400 can allocate parts with many pitch changes to the parts 304 and 306 that are desired to move violently in time with the music.
  • the data updating unit 134 may update the movement of each of the plurality of objects based on the corresponding parts. good. For example, the data updating unit 134 updates the movement of the first object out of the plurality of objects based on the first part out of the plurality of parts, and updates the movement of the first object out of the plurality of parts based on the second part out of the plurality of parts. to update the motion of a second object of the plurality of objects. This makes it possible to generate animation data in which a plurality of objects included in the animation data move in accordance with each of the plurality of parts forming the music of the music data.
  • FIG. 10 schematically shows an example of the hardware configuration of a computer 1200 that functions as the data processing device 100.
  • FIG. Programs installed on the computer 1200 cause the computer 1200 to function as one or more "parts" of the apparatus of the present embodiments, or cause the computer 1200 to operate or perform operations associated with the apparatus of the present invention. Multiple "units" can be executed and/or the computer 1200 can be caused to execute the process or steps of the process according to the present invention.
  • Such programs may be executed by CPU 1212 to cause computer 1200 to perform certain operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.
  • a computer 1200 includes a CPU 1212 , a RAM 1214 and a graphics controller 1216 , which are interconnected by a host controller 1210 .
  • Computer 1200 also includes GPU 1250 .
  • Computer 1200 also includes input/output units such as communication interface 1222 , storage device 1224 , DVD drive, and IC card drive, which are connected to host controller 1210 via input/output controller 1220 .
  • the DVD drive may be a DVD-ROM drive, a DVD-RAM drive, and the like.
  • Storage devices 1224 may be hard disk drives, solid state drives, and the like.
  • Computer 1200 also includes legacy input/output units, such as ROM 1230 and keyboard, which are connected to input/output controller 1220 via input/output chip 1240 .
  • the CPU 1212 operates according to programs stored in the ROM 1230 and RAM 1214, thereby controlling each unit.
  • Graphics controller 1216 retrieves image data generated by CPU 1212 into a frame buffer or the like provided in RAM 1214 or itself, and causes the image data to be displayed on display device 1218 .
  • a communication interface 1222 communicates with other electronic devices via a network.
  • Storage device 1224 stores programs and data used by CPU 1212 within computer 1200 .
  • the DVD drive reads programs or data from a DVD-ROM or the like and provides them to the storage device 1224 .
  • the IC card drive reads programs and data from IC cards and/or writes programs and data to IC cards.
  • ROM 1230 stores therein programs such as boot programs that are executed by computer 1200 upon activation and/or programs that depend on the hardware of computer 1200 .
  • Input/output chip 1240 may also connect various input/output units to input/output controller 1220 via USB ports, parallel ports, serial ports, keyboard ports, mouse ports, and the like.
  • the program is provided by a computer-readable storage medium such as a DVD-ROM or an IC card.
  • the program is read from a computer-readable storage medium, installed in storage device 1224 , RAM 1214 , or ROM 1230 , which are also examples of computer-readable storage media, and executed by CPU 1212 .
  • the information processing described within these programs is read by computer 1200 to provide coordination between the programs and the various types of hardware resources described above.
  • An apparatus or method may be configured by implementing information operations or processing according to the use of computer 1200 .
  • the CPU 1212 executes a communication program loaded into the RAM 1214 and sends communication processing to the communication interface 1222 based on the processing described in the communication program. you can command.
  • the communication interface 1222 reads transmission data stored in a transmission buffer area provided in a recording medium such as a RAM 1214, a storage device 1224, a DVD-ROM, or an IC card under the control of the CPU 1212, and transmits the read transmission data. Data is transmitted to the network, or received data received from the network is written in a receive buffer area or the like provided on the recording medium.
  • the CPU 1212 causes the RAM 1214 to read all or necessary portions of files or databases stored in an external recording medium such as a storage device 1224, a DVD drive (DVD-ROM), an IC card, etc. Various types of processing may be performed on the data. CPU 1212 may then write back the processed data to an external recording medium.
  • an external recording medium such as a storage device 1224, a DVD drive (DVD-ROM), an IC card, etc.
  • Various types of processing may be performed on the data.
  • CPU 1212 may then write back the processed data to an external recording medium.
  • CPU 1212 performs various types of operations on data read from RAM 1214, information processing, conditional decisions, conditional branching, unconditional branching, and information retrieval, which are described throughout this disclosure and are specified by instruction sequences of programs. Various types of processing may be performed, including /replace, etc., and the results written back to RAM 1214 . In addition, the CPU 1212 may search for information in a file in a recording medium, a database, or the like.
  • the CPU 1212 selects the first attribute from among the plurality of entries. search for an entry that matches the specified condition of the attribute value of the attribute, read the attribute value of the second attribute stored in the entry, and thereby determine the first attribute that satisfies the predetermined condition An attribute value of the associated second attribute may be obtained.
  • the programs or software modules described above may be stored in a computer-readable storage medium on or near computer 1200 .
  • a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, whereby the program can be transferred to the computer 1200 via the network. offer.
  • the blocks in the flowcharts and block diagrams in this embodiment may represent steps in the process in which the operations are performed or "parts" of the device responsible for performing the operations. Certain steps and “sections” may be provided with dedicated circuitry, programmable circuitry provided with computer readable instructions stored on a computer readable storage medium, and/or computer readable instructions provided with computer readable instructions stored on a computer readable storage medium. It may be implemented by a processor. Dedicated circuitry may include digital and/or analog hardware circuitry, and may include integrated circuits (ICs) and/or discrete circuitry.
  • ICs integrated circuits
  • Programmable circuits such as Field Programmable Gate Arrays (FPGAs), Programmable Logic Arrays (PLAs), etc., perform AND, OR, EXCLUSIVE OR, NOT AND, NOT OR, and other logical operations. , flip-flops, registers, and memory elements.
  • FPGAs Field Programmable Gate Arrays
  • PLAs Programmable Logic Arrays
  • a computer-readable storage medium may comprise any tangible device capable of storing instructions to be executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon may be illustrated in flowchart or block diagram form. It will comprise an article of manufacture containing instructions that can be executed to create means for performing specified operations. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like.
  • Computer readable storage media include floppy disks, diskettes, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory) , electrically erasable programmable read only memory (EEPROM), static random access memory (SRAM), compact disc read only memory (CD-ROM), digital versatile disc (DVD), Blu-ray disc, memory stick , integrated circuit cards, and the like.
  • RAM random access memory
  • ROM read only memory
  • EPROM or flash memory erasable programmable read only memory
  • EEPROM electrically erasable programmable read only memory
  • SRAM static random access memory
  • CD-ROM compact disc read only memory
  • DVD digital versatile disc
  • Blu-ray disc memory stick , integrated circuit cards, and the like.
  • the computer readable instructions may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state configuration data, or instructions such as Smalltalk, JAVA, C++, etc. any source or object code written in any combination of one or more programming languages, including object-oriented programming languages, and conventional procedural programming languages such as the "C" programming language or similar programming languages; may include
  • Computer readable instructions are used to produce means for a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, or programmable circuits to perform the operations specified in the flowchart or block diagrams.
  • a general purpose computer, special purpose computer, or other programmable data processor locally or over a wide area network (WAN) such as the Internet, etc., to execute such computer readable instructions. It may be provided in the processor of the device or in a programmable circuit. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

L'invention concerne un dispositif de traitement de données comprenant : une unité d'acquisition de données d'animation qui acquiert des données d'animation dans lesquelles un objet se déplace ; une unité d'acquisition de données musicales qui acquiert des données musicales pour une musique qui est lue conjointement avec les données d'animation ; et une unité de mise à jour de données qui met à jour le mouvement de l'objet des données d'animation sur la base des données musicales. L'invention concerne également un dispositif de traitement de données comprenant : une unité d'acquisition de données d'animation qui acquiert des données d'animation dans lesquelles un objet se déplace ; une unité de génération de données musicales qui génère, sur la base du mouvement de l'objet dans les données d'animation, des données musicales pour de la musique qui est lue conjointement avec les données d'animation ; et une unité de lecture qui lit les données musicales conjointement avec les données d'animation.
PCT/JP2021/002926 2021-01-27 2021-01-27 Dispositif de traitement de données, programme, et procédé de traitement de données WO2022162808A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2021/002926 WO2022162808A1 (fr) 2021-01-27 2021-01-27 Dispositif de traitement de données, programme, et procédé de traitement de données
JP2022577897A JPWO2022162808A1 (fr) 2021-01-27 2021-01-27

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/002926 WO2022162808A1 (fr) 2021-01-27 2021-01-27 Dispositif de traitement de données, programme, et procédé de traitement de données

Publications (1)

Publication Number Publication Date
WO2022162808A1 true WO2022162808A1 (fr) 2022-08-04

Family

ID=82653112

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/002926 WO2022162808A1 (fr) 2021-01-27 2021-01-27 Dispositif de traitement de données, programme, et procédé de traitement de données

Country Status (2)

Country Link
JP (1) JPWO2022162808A1 (fr)
WO (1) WO2022162808A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117351120A (zh) * 2023-12-06 2024-01-05 青岛蓝飞互娱科技股份有限公司 一种3d游戏动画生成方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0991465A (ja) * 1995-09-28 1997-04-04 Toshiba Corp アニメーション作成装置
JPH10312469A (ja) * 1997-05-13 1998-11-24 Yamaha Corp アニメーション作成システム
JP2019103729A (ja) * 2017-12-14 2019-06-27 株式会社バンダイナムコエンターテインメント プログラム及びゲームシステム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0991465A (ja) * 1995-09-28 1997-04-04 Toshiba Corp アニメーション作成装置
JPH10312469A (ja) * 1997-05-13 1998-11-24 Yamaha Corp アニメーション作成システム
JP2019103729A (ja) * 2017-12-14 2019-06-27 株式会社バンダイナムコエンターテインメント プログラム及びゲームシステム

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117351120A (zh) * 2023-12-06 2024-01-05 青岛蓝飞互娱科技股份有限公司 一种3d游戏动画生成方法
CN117351120B (zh) * 2023-12-06 2024-03-19 青岛蓝飞互娱科技股份有限公司 一种3d游戏动画生成方法

Also Published As

Publication number Publication date
JPWO2022162808A1 (fr) 2022-08-04

Similar Documents

Publication Publication Date Title
US10922882B2 (en) Terrain generation system
US8051024B1 (en) Example-based creation and tuning of motion recognizers for motion-controlled applications
US11938401B2 (en) Audio playing method and apparatus, and storage medium thereof
KR100261749B1 (ko) 비디오 게임 장치 및 비디오 게임 프로그램을 기억한 매체
US20200167984A1 (en) Method and system for determining identifiers for tagging video frames with
US20090091563A1 (en) Character animation framework
US20230177755A1 (en) Predicting facial expressions using character motion states
WO2022162808A1 (fr) Dispositif de traitement de données, programme, et procédé de traitement de données
CN117203675A (zh) 用于捕获面部表情并生成网格数据的人工智能
US10347004B2 (en) Musical sonification of three dimensional data
CN107845135B (zh) 一种三维仿真模型及模型库的构建方法及装置
CN115167940A (zh) 3d文件加载方法及装置
WO2022221716A1 (fr) Création de musique multimédia à l'aide d'une entrée visuelle
CN110992450B (zh) 基于OpenGL的音乐喷泉模拟系统
Freiknecht et al. Game Engines
JP7434134B2 (ja) データ処理装置、プログラム、及びデータ処理方法
Hamilton Perceptually coherent mapping schemata for virtual space and musical method
TWI707301B (zh) 用於服裝設計展示之動態虛擬立體影像之製作方法
Dean Widening unequal tempered microtonal pitch space for metaphoric and cognitive purposes with new prime number scales
WO2024027285A1 (fr) Procédé et appareil de traitement d'expression faciale, dispositif informatique et support de stockage
US20240135616A1 (en) Automated system for generation of facial animation rigs
JP2023110699A (ja) 情報処理システム、情報処理方法、及びプログラム
Farley et al. Augmenting creative realities: The second life performance project
Seymour Hello World: Code and Design
Juganaru A procedural reflection on animation audio

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21922829

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022577897

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21922829

Country of ref document: EP

Kind code of ref document: A1