JP2002044564A - Information processing unit and method, information processing system, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a vibration data generator that can provide an image preferred by a user and to provide a vibration corresponding to the image. SOLUTION: An entry section 41 enters received image data and preferred data by a user. The preferred data are data with respect to vibration preferred by the user. A coefficient generating section 47 stores image data that have been picked up in advance and vibration data generated from the image data. The coefficient generating section 47 reads the image data and the vibration data corresponding to the entered preferred data, calculates a coefficient with respect to the image and the vibration from the data and gives it to a vibration data generating section 42. The vibration data generating section 42 uses the entered image data and the coefficient supplied from the coefficient generating section 47 to generate vibration data. The generated vibration data are fed to a device that provides the vibration via an output section 43.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus, method, and recording medium, and more particularly, to an information processing apparatus, method, and recording medium suitable for use in an apparatus for presenting a user's favorite image and shaking. .

[0002]

2. Description of the Related Art There is a device that, when a spectator is watching an image, shakes a chair on which the spectator sits in accordance with the image, thereby enhancing the sense of realism. The shaking data supplied to such a device for shaking the chair is generated from data obtained by a sensor such as an acceleration sensor that simultaneously detects an angle or the like when the image is captured, or the captured data is captured. The video is generated manually by a person observing the image and predicting the sway.

[0003]

In the above-described apparatus, since the shaking data is generated using the data obtained at the time of image pickup using the sensor, the operation of acquiring the data is complicated. Further, since the data for generating the sway data and the image for acquiring the data need to be synchronized when actually giving the sway to the audience, the image and the sway data corresponding to the image need to be synchronized. It was difficult to get multiple pairs.

[0004] For this reason, there is a problem that the image to be enjoyed and the shaking are limited, and even if the image can be selected, there are few types of the image and it is not possible to cope with the taste of the audience.

The present invention has been made in view of such a situation, and transmits a favorite image prepared by a spectator and information on a user's preference regarding agitation to another device via a network. To generate an agitation data that also takes into account information about user preferences on other devices and present an agitation based on the agitation data so that images and agitation corresponding to the audience's preferences can be presented. With the goal.

[0006]

According to a first aspect of the present invention, there is provided an information processing apparatus, comprising: input means for inputting image data and preference data relating to user's preference regarding shaking via a network; and preference input by the input means. Using the coefficient output means for outputting a coefficient corresponding to the data, and the coefficient output from the coefficient output means, generating motion data for controlling the motion corresponding to the image based on the image data input by the input means. Generating means.

[0007] The coefficient output means includes a storage means for storing image data captured in advance, motion data corresponding to the image data, and image data and motion data stored in the storage means corresponding to the favorite data. It is characterized by including reading means for reading and calculating means for calculating a coefficient from the image data and the shaking data read by the reading means.

[0008] The coefficient output means accumulates image data captured in advance and coefficients calculated from the motion data corresponding to the image data, and among the stored coefficients, the coefficient corresponding to the favorite data. Can be output.

In the information processing method according to the present invention, the input is controlled by an input control step of controlling input of image data and preference data relating to a user's preference regarding movement through a network, and an input control step. A coefficient output step of outputting a coefficient corresponding to the favorite data;
Generating a motion data for controlling the motion corresponding to the image based on the image data whose input has been controlled in the process of the input control step, using the coefficient output in the process of the coefficient output step. It is characterized by.

According to a fifth aspect of the present invention, there is provided a recording medium program, wherein the input is controlled by processing of an input control step for controlling input of image data and preference data relating to user's preference regarding movement via a network, and an input control step. A coefficient output step of outputting a coefficient corresponding to the selected preference data, and a fluctuation corresponding to an image based on the image data whose input is controlled in the input control step using the coefficient output in the coefficient output step. And generating a sway data for controlling the motion.

According to a sixth aspect of the present invention, in the information processing system, the first information processing apparatus includes first supply means for supplying image data and preference data relating to fluctuation of user's preference to the second information processing apparatus. An input unit for inputting the image data and the preference data supplied by the first supply unit; a coefficient output unit for outputting a coefficient corresponding to the preference data input by the input unit; Using the coefficient output by the coefficient output means, generating means for generating sway data for controlling sway corresponding to an image based on the image data input by the input means, and sway data generated by the generating means Second supply means for supplying to the presentation device, wherein the presentation device includes presentation means for presenting a sway based on the sway data supplied by the second supply means. To.

The second supplying means also supplies the first information processing device with the sway data, and the first information processing device connects the first data processing device to the first information processing device based on the sway data supplied by the second supplying device. Control means for controlling a presentation device for presenting the performed shaking, and a shaking means controlled by the controlling means, further comprising a transmitting means for transmitting a determination result as to whether or not the preference data is reflected, If the determination result transmitted by the transmission unit indicates that the preference data is not reflected, the information processing device regenerates the agitation data by the generation unit, and the determination result indicates If the data indicates that the data is reflected, the second supply means can supply the motion data to the presentation device.

According to an eighth aspect of the present invention, in the information processing method of the first information processing apparatus, the supply of the image data and the preference data relating to the fluctuation of the user's preference to the second information processing apparatus is controlled. A first supply control step;
In the information processing method of the information processing apparatus, an input control step of controlling input of image data and preference data whose supply is controlled in the processing of the first supply control step, and an input is controlled in the processing of the input control step Using a coefficient output step of outputting a coefficient corresponding to the favorite data and a coefficient output in the processing of the coefficient output step, controlling a fluctuation corresponding to an image based on the image data whose input is controlled in the processing of the input step. A generating step of generating the shaking data, and a second supplying control step of controlling the supply of the shaking data generated in the processing of the generating step to the presenting device. The present invention is characterized in that the present invention further comprises a presentation step of presenting a sway based on the sway data whose supply has been controlled in the process of the supply control step.

According to a ninth aspect of the present invention, there is provided a program for a recording medium, wherein the program for the first information processing apparatus controls supply of image data and preference data relating to fluctuation of user's preference to the second information processing apparatus. An input control step for controlling input of image data and preference data whose supply has been controlled in the processing of the first supply control step; and an input control step. A coefficient output step of outputting a coefficient corresponding to the preference data whose input is controlled in the processing of the above, and using the coefficient output in the processing of the coefficient output step, based on the image data of which the input is controlled in the processing of the input step A generating step of generating the sway data for controlling the sway corresponding to the image; and supplying the sway data generated in the processing of the generating step to the presentation device. Gosuru and a second supply control step, a program of the presentation device, characterized in that it comprises a presentation step of supplying the processing of the second supply control step presents the upset based on motion data which is controlled.

[0015] The information processing apparatus according to claim 1,
In the information processing method described in the above, and the recording medium described in the claim 5, a coefficient corresponding to the input preference data on the user's preference fluctuation is output, and the input coefficient is input using the output coefficient. Shaking data for controlling shaking corresponding to an image based on the image data is generated.

[0016] In the information processing system according to the sixth aspect, the information processing method according to the eighth aspect, and the recording medium according to the ninth aspect, the first information processing apparatus is configured to store the image data and the user's favorite data. Supplying the preference data relating to the motion to the second information processing apparatus, the second information processing apparatus outputs a coefficient corresponding to the input preference data, and the input image data is input using the output coefficient. Generating sway data for controlling the sway corresponding to the image based on, and supplying the generated sway data to a presentation device,
A motion based on the supplied motion data is presented.

[0017]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing a configuration of an information processing system according to an embodiment of the present invention. Terminals 1-1 to 1-N (hereinafter, when it is not necessary to distinguish terminals 1-1 to 1-N individually,
It is described. Other devices are described similarly), for example,
It is composed of a personal computer installed at home. The terminal 1 is connected to the motion data generating device 3 via the network 2. Network 2 is LA
It is composed of N (Local Area Network) and the Internet.

The motion data generating device 3 generates motion data corresponding to (synchronized with) the image from the image data transmitted from the terminal 1 and transmits the data to the image motion control device 4 via the network 2. The image shaking control device 4 controls the image shaking presenting devices 6-1 to 6-N connected via the network 5 based on the shaking data transmitted from the shaking data generating device 3. The image shaking presentation device 6 includes a display for presenting an image and a chair-type device for presenting shaking, and is installed in a place called a game center, for example.

Next, each device will be described. FIG.
3 is a diagram showing an internal configuration of the terminal 1. FIG. Terminal 1 is a CPU
(Central Processing Unit) 11. CPU1
An input / output interface 15 is connected to 1 via a bus 14. The input / output interface 15 includes an input unit 1 including input devices such as a keyboard and a mouse.
6. Output unit 17 for outputting, for example, audio data as a processing result, storage unit 18 including a hard disk drive for storing programs and various data, network 2
Communication unit 1 such as a modem that communicates data via
And a drive 20 for reading and writing data from and to a program storage medium such as the magnetic disk 31 to the semiconductor memory 34.

A USB (Universal Serial Bus) interface 21 is connected to a digital video camera or the like by a USB cable (not shown). The ROM (Re
ad Only Memory) 12 and RAM (Random Access Memory)
13 is connected.

The user transmits image data stored in the storage unit 18 of the terminal 1 or image data supplied from a digital video camera or the like connected to the USB interface 21 via the network 2 to the shaking data generation device. 3 is configured to be transmitted. Although details will be described later, when the image data is transmitted to the agitation data generating device 3, personal data relating to the user (terminal 1) is also transmitted.

The motion data generating device 3 generates motion data by analyzing the image data transmitted from the terminal 1. FIG. 3 is a diagram showing an internal configuration of the sway data generation device 3. The image data transmitted from the terminal 1 is input to the input unit 41 of the motion data generation device 3. The image data input to the input unit 41 is output from a motion data generation unit 42.
Is output to The motion data generation unit 42 generates motion data for causing the image motion presentation device 6 to present motion corresponding to an image based on the input image data, and outputs the motion data.
Output to 3.

The fee collection unit 44 executes a process for collecting a usage fee for its own device, in other words, a generation fee for shaking data, from the input personal data. As described above, the personal data is data required for collecting a usage fee, such as a credit card number or a bank account number. Further, in order to use the agitation data generation device 3, it is necessary to register in advance as a member, and a payment method such as collecting as a membership fee may be used. Furthermore, it is also possible to use a prepaid system or the like.

When receiving the image data from the terminal 1, the input unit 41 instructs the ID generation unit 45 to generate ID data. According to the instruction, the ID generation unit 45 generates ID data and outputs it to the output unit 43. The output unit 43 associates the image data, the shaking data, and the ID data with each other,
Send to terminal 1.

The motion data generating device 3 uses a fee for the image motion control device 4 and the image motion presenting device 6 (substantially the usage fee for both the image motion control device 4 and the image motion presenting device 6, In the description, the usage fee of the image shaking control device 4 will be collected in advance, so that the image shaking control device 4 assigns the usage fee of its own device to the image data generating device 3 at a later time. The chargeable data generating unit 46 generates data that can be requested by the user and transmits the data to the image fluctuation control device 4 via the output unit 43.

The input section 41 also inputs the preference data transmitted from the terminal 1 together with the image data. The preference data input to the input unit 41 is output to the coefficient generation unit 47. The coefficient generation unit 47 outputs a coefficient (to be described in detail later) to the fluctuation data generation unit 42, and the fluctuation data generation unit 42
Motion data is generated using the coefficient.

FIG. 4 is a diagram showing the internal configuration of the coefficient generation unit 47. As shown in FIG. 4, the coefficient generation unit 47 includes a motion data storage unit 61 for storing motion data, an image data storage unit 62 for storing image data, and a motion data storage unit 61 and an image data storage unit 62. The motion data learning unit 63 receives supply of the stored data and calculates a coefficient relating to the relationship between the image data and the motion data.

The data stored in the shaking data storage unit 61 and the image data storage unit 62 will be described with reference to FIG. Image data storage unit 62
Stores images captured by a video camera attached to a vehicle traveling on a paved road. The sway data for the image is stored in the sway data storage unit 61. The sway data stored in the sway data storage unit 61 is obtained by using a sensor or the like when the corresponding image data stored in the image data storage unit 62 is captured. Alternatively, it is obtained by analyzing corresponding image data (for example, analysis such as detecting a motion vector).

The sway data obtained from an image captured by a video camera mounted on a vehicle traveling on a paved road includes pitch, roll (rotation components) around three axes of X, Y, and Z. roll) and yaw (ya
w) and translational components x, y, z in three axial directions. Here, the sway data will be described. First, before describing the sway data, the configuration of the image sway presenter 6 that presents sway based on the sway data will be described.

FIG. 6 is a diagram showing the configuration of the image shaking presentation device 6. As shown in FIG. As shown in FIG. 6, the image shaking presentation device 6
It comprises a display 71 for presenting an image, a driving device 72 for presenting shaking, and a data acquisition device 73.

The display 71 is connected to the image shaking control device 4.
Presents an image based on the image data from. Similarly, the drive device 72 provides a spectator (user) with a sway based on the sway data from the image sway control data 4. The data acquisition device 73 receives various data from the image fluctuation control device 4 via the network 5 and supplies the data to the display 71 and the driving device 72, and also from a card inserted into the slot 74 (details will be described later). Data is acquired, and the acquired data is transmitted to the image fluctuation control device 4. The display unit 75 is provided to display various information.

FIGS. 7 and 8 show an example of the driving device 72. FIG.
FIG. 7 is a side view of the driving device 72, and FIG. 8 is a diagram of the driving device 72 as viewed from above. The driving device 72 includes pistons 81-1 to 81- as six actuators.
6, and the pedestal 82 is supported by these pistons. A chair 83 is fixed to the pedestal 82, and an audience 84 is seated on the chair 83.

The pistons 81-1 to 81-6 are configured to be able to expand and contract along their respective central axes. As the pistons 81-1 to 81-6 expand and contract, the pedestal 82 moves, and the chair 83 fixed to the pedestal 82 also moves. Pistons 81-1 to 8
Data for controlling 1-6 is stored in the image sway controller 4
Is input through the network 5.

As described above, since the driving device 72 of the image shaking presentation device 6 is configured, for example, the shaking obtained when actually driving in a car cannot be given as it is. That is, the driving device 72 is fixed to a specific place such as a theater, and cannot be rotated or translated without limitation due to the restriction of presenting the shaking. Therefore, in order to present a sway that gives a sensation as if the user is riding in a vehicle, it is necessary to generate two data, the actual sway data and the alternative sway data, as the sway data.

The actual sway data is data for giving the change of the actual angle or position as it is, and the alternative sway data is the pulse change or the step change of the angle according to the change of the rotational angular velocity or the translational acceleration. Is the data that gives

The actual sway data and the alternative sway data when the vehicle is driven along the road surface are configured as shown in FIG. 9, for example. The actual sway data includes a front-rear inclination of the road surface, a left-right inclination of the road surface, a front-rear vibration, a left-right vibration, and a vertical vibration. The inclination of the road surface before and after is represented by a sway component pitch, and the left and right inclination of the road surface is represented by a sway component roll. The vibration in the front-rear direction, the vibration in the left-right direction, or the vibration in the up-down direction are represented by the fluctuation components x, y, and z, respectively.

The alternative sway data includes an inertial force due to acceleration / deceleration, a centrifugal force at a curve, and a yaw at a curve. The inertial force due to acceleration / deceleration is expressed by the double differential value x '' of the sway component x, and the centrifugal force at the time of the curve is the product x 'of the differential value x' of the sway component x and the differential value yaw 'of the sway component yaw.
・ It is expressed by yaw '. The turning of the vehicle at the time of the curve is represented by the differential value yaw 'of the sway component yaw.

The inertial force due to acceleration / deceleration corresponds to the fluctuation component pitch, and the centrifugal force at the time of curve corresponds to the fluctuation component roll,
The swing of the vehicle at the time of the curve corresponds to the yaw component yaw.

Returning to the description of the coefficient generation unit 47 shown in FIG. 4, the coefficient generation unit 47 includes the above-described fluctuation data storage unit 61 for storing the fluctuation data, and the fluctuation data stored in the fluctuation data storage unit 61. An image data storage unit 62 for storing image data from which the image data is generated, and a relation coefficient between the sway data stored in the sway data storage unit 61 and the image data stored in the image data storage unit 62 And an agitation data learning unit 63 that outputs

FIG. 10 is a diagram showing the internal configuration of the fluctuation data learning section 63. The motion vector calculation device 111 scan-converts the image data from the image data storage unit 62 into image data in units of frames, and based on pixel data as representative points given in a grid over the entire screen,
A motion vector is calculated between the current frame and the previous frame one frame before, and is output to the motion center calculation device 112 and the camera motion estimation amount calculation device 113.

The motion center calculation unit 112 calculates the coordinates of the motion center (infinity point in one-point perspective) of the image of the entire screen from the values of the motion vectors of the image from the beginning to the end of the predetermined scene at each representative point. And outputs it to the camera motion estimation amount calculation device 113.

The camera motion estimator calculator 113 calculates the relative coordinates of the representative point with respect to the motion center, the motion vector at the representative point, and the geometric relationship between the three-dimensional space and the two-dimensional image obtained by photographing the three-dimensional space with a video camera. From the camera motion estimator representing the estimator of the change in position and orientation of the video camera per frame period in pixel units from the component (v
_x , v _y , v _z , w _x , w _y , w _z ), and outputs them to the relation coefficient learning device 115.

The camera motion amount calculation device 114 calculates the camera motion estimation amount and the physical amount (distance or angle per unit time).
Are calculated from the motion data supplied from the motion data storage unit 61 so that the camera motion amount representing the amount (m / sec or rad / sec) of the camera actually moved is represented by the components (x ′, y ′,
z ′, roll ′, pitch ′, yaw ′) and outputs it to the relation coefficient learning device 115.

The relation coefficient learning device 115 is composed of several camera motion estimation amounts supplied from the camera motion estimation amount calculation device 113 and one camera supplied from the camera motion amount calculation device 114 corresponding to the time. The image sway data relation coefficient representing the correspondence with the motion amount is learned for each component in the form of a linear linear combination coefficient.

The image sway data relation coefficient thus learned is supplied to the sway data generator 42 (FIG. 3). FIG. 11 is a diagram showing the internal configuration of the motion data generation device 42. The motion vector calculation device 131 detects a motion vector from the input image (the image supplied from the terminal 1 and is different from the image data stored in the image data storage unit 62), and detects the motion center. It outputs to the calculation device 132 and the camera motion estimation amount calculation device 133. The motion center calculation device 132 detects the motion center coordinates of the input image based on the input motion vector, and outputs it to the camera motion estimation amount calculation device 133.

The camera motion estimator 133 calculates a camera motion estimator based on the motion vector input from the motion vector calculator 131 and the motion center coordinates supplied from the motion center calculator 132 to calculate the camera motion estimator. It is output to the quantity calculator 134. The motion vector calculator 131, the motion center calculator 132, and the camera motion estimator calculator 133 include the motion vector calculator 111, the motion center calculator 112,
And has the same configuration and function as the camera motion estimation amount calculation device 113.

The camera motion prediction amount calculation unit 134 calculates the linear first order of the image fluctuation data relation coefficient supplied from the image fluctuation data relation learning unit 1 and the camera motion estimation amount supplied from the camera motion estimation amount calculation unit 133. By calculating the combination, a camera motion prediction amount representing information that the video camera seems to have moved in one frame period is calculated and output to the motion data calculation device 135. The input sway data calculation device 135 calculates the sway data such that the sway data when the driving device 72 is translated or rotated is the same as the physical quantity from the input camera motion prediction amount, and outputs the data.

By generating the sway data in this manner, the sway data that allows the user to experience a realistic sensation corresponding to the image from an existing image resource (the user's favorite image supplied from the terminal 1). Can be generated easily and reliably.

The sway data generated by the sway data generator 42 includes the input image data, the ID data generated by the ID generator 45, and the billing data generator 46.
And transmitted to the image fluctuation control device 4 via the network 2 (FIG. 1).

FIG. 12 is a diagram showing the internal structure of the image fluctuation control device 4. Various data including the above-described motion data transmitted from the motion data generating device 3 via the network 2 are input to the data input unit 151. Among the various data input to the data input unit 151, the charging data is stored in the charging processing unit 152, the image data and the motion data are stored in the data storage unit 153, and the ID data is stored in the data storage unit 153.
Each is output to the ID data storage unit 154.

The accounting section 152 executes a process of collecting a usage fee for the image fluctuation control device 4 based on the input accounting data. The data storage unit 153 stores the input image data and the shaking data, and stores the data related to the address where the data is stored in the ID data storage unit 154.
Output to The ID data storage unit 154 stores the input ID data and the address data in association with each other.

The ID data input unit 155 is connected to the network 5
The ID data transmitted from the image shaking presentation device 6 is input to the ID authentication unit 156 via the. ID authentication unit 156
Checks whether or not the input ID data is stored in the ID data storage unit 154, and when it is determined that the input ID data is stored, reads out the address data associated with the ID data and reads out the address data. The data output unit 153 outputs a data output instruction signal to the data storage unit 153 based on the address data.

The data storage unit 153 outputs the image data and the shaking data to the data output unit 157 according to the instruction from the ID authentication unit 156. The data output unit 157 transmits the input image data and the sway data to the image sway presenter 6 via the network 5.

Next, the operation of the information processing system shown in FIG. 1 will be described with reference to the flowchart of FIG. The terminal 1 transmits the image data to the motion data generating device 3 via the network 2 in step S1. When image data is transmitted, personal data is also transmitted as data used for billing. The personal data is specifically a credit card number. Alternatively, when receiving the service described in the present embodiment, if the service is registered in advance and debited from a designated bank account or the like, data such as a password for uniquely identifying the user is used. There may be. It is also possible to use a prepaid system.

Although any method may be used, in step S1, personal data used for billing is transmitted together with the image data. Along with these data, preference data is also transmitted. The preference data is data used to generate a sway that meets the needs of each user, for example, a larger sway in the vertical direction is better than usual, or a smaller sway is better. When transmitting the image data from the terminal 1 in step S1, the user sets his / her preference (preference data) and transmits it.

Alternatively, the amount of the additional charge may be used as preference data. If you do not pay any additional fees,
Only a minimum amount of fluctuation is presented, and the amount of additional charge increases the amount of fluctuation in a predetermined direction or increases the amount of fluctuation presented by the amount of additional charge. The amount of such an additional charge and the type of agitation presented by the amount are set in advance, and based on the setting, when transmitting the image data in step S1, the user
Select additional charges as preference data.

In step S2, the agitation data generating device 3 which has received the image data, the personal data, and the preference data executes a charging process. The accounting process is performed by the fee collection unit 44 of the shaking data generation device 3 and also by the accounting data generation unit 46.

The fee collecting section 44 collects a fee for generating the shaking data. In other words, a fee to be paid to a person who manages the agitation data generating device 3 is collected. Here, when the user receives the presentation of the image and the shaking corresponding to the image in the image shaking presentation device 6 at a later point in time, a process of newly paying as the usage fee of the image shaking control device 4 is performed. In order to avoid this, the motion data generating device 3 collectively performs the processing in step S2,
Will be collected in advance.

The billing data generation unit 46 determines in step S2
Since the usage fee of the image fluctuation control device 4 has been collected in advance as the charging process in, the image fluctuation control device 4 generates data at a later point in time so that the fee can be collected.

In step S3, the shaking data generating device 3 transmits the ID data to the terminal 1 that has transmitted the image data. Here, the ID transmitted to the terminal 1
The data is data generated by the ID generation unit 45, and the input image data, the sway data generated by the sway data generation unit 42, and the billing data generated by the billing data generation unit 46 are associated with each other. And the other sets of data are assigned so as to be uniquely distinguished from each other.

The ID data transmitted from the shaking data generator 3 is received and stored in the terminal 1 in step S4. The user stores the received ID data on, for example, the magnetic disk 31 set in the drive 20 (FIG. 2). Alternatively, the ID data may be stored in a card-shaped recording medium (not shown), or the user may write the ID data on a paper medium. The medium on which the ID data is recorded depends on what kind of medium the data acquisition device 73 (FIG. 6) of the image shaking presentation device 6 handles (how the data is input).

The shaking data generating device 3
While transmitting the ID data, in step S5, a process of generating the motion data is executed. The sway data is generated in the sway data generator 42 as described above.
When the sway data is generated, first, the preference data is input to the coefficient generation unit 47, and the sway data from the sway data storage unit 61 and the image data corresponding to the sway data are stored in the image data storage unit according to the liking data. 62, and are output to the fluctuation data learning unit 63.

That is, as described above, there are two types of preference data: data for reflecting the user's preference and data for the additional fee. The sway data that emphasizes the user's favorite sway component is read from the sway data storage unit 61. If the sway data is data according to the additional charge, for example, the sway data as shown in FIG. The components (the number of components) to be read differ depending on the amount of the additional charge, for example, the components of only the vibration are read from the storage unit 61, and the components of the vibration and the pitch are read.

In this way, the preference data is reflected on the coefficient generated by the coefficient generating section 47.

The sway data learning section 63 (FIG. 4) calculates an image sway data relation coefficient from the sway data and image data read from the sway data storage section 61 and the image data storage section 62, respectively. The data is output to the camera motion prediction amount calculator 134 (FIG. 11) of the data generator 42 (FIG. 3). Image data input from the terminal 1 via the input unit 41 is input to the motion vector calculation device 131 of the motion data generation unit 42. The sway data generation unit 42 generates sway data using the input image data and the image sway data relation coefficient.

When the generation of the sway data is completed, the sway data generator 3 associates the image data, the sway data, the billing data, and the ID data with the image sway controller 4 in step S6. Send.

The image shaking control device 4 receives various data transmitted from the shaking data generating device 3 via the network 2 in step S7. Then, the image data and the shaking data are stored in the data storage unit 153, and the ID
The data is stored in the ID data storage unit 154. When the ID data is stored in the ID data storage unit 154, data relating to the address where the image data and the shaking data are stored is output from the data storage unit 153, and stored in association with the address data.

In step S8, charging section 152 executes a charging process. This billing process is performed based on the received billing data. That is, as described above, since the motion data generating device 3 previously collects the usage fee of the image motion control device 4 from the user in step S2, the usage data that has already been collected in step S8. This is a process in which a fee is charged to the agitation data generation device 3 and acquired.

In step S 9, ID data is input to the image shaking presentation device 6. For example, when the ID data stored by the terminal 1 in step S4 is to be recorded on a card-shaped recording medium, the card-shaped recording medium is set in the slot 74 of the data acquisition device 73, It is obtained by reading from the set recording medium.

In another embodiment, for example, an image as shown in FIG. 14 is displayed on the display unit 75 of the data acquisition device 73, and the user inputs the image by referring to the displayed screen. You may do it. That is, the display unit 75 is a touch sensor panel, and the user can issue an instruction by touching the screen.

On the screen, for example, an image display unit 171 displaying an image for advertisement or an image provided by the user, ID data read from a recording medium set in the slot 74 (FIG. 6), or , An ID display field 173 in which ID data input by the user using the ten keys 172 is displayed. Below the ID display field 173, a motion presentation instruction field 174 for selecting whether or not to experience the motion is displayed. The cross key 175 is operated to move the position of the cursor.

The ID data may be read from the recording medium as described above, or may be directly input by the user using the ten keys 173.

In step S 9, when the ID data is input to the image shaking presentation device 6, the ID data is transmitted to the image shaking control device 4. Image shaking control device 4
In step S10, when the ID data transmitted from the image shaking presentation device 6 is input through the ID data input 155, the authentication processing is executed by the ID authentication unit 156.

The ID authentication section 156 performs an authentication process by checking whether or not ID data matching the input ID data is stored in the ID data storage section 154. If it is determined that matching ID data is stored in the ID data storage unit 154 as a result of the authentication,
The process proceeds to step S11, but if it is determined that the data is not stored, no further processing is performed.

In step S11, the image data and the shaking data are read out from the data storage unit 153 based on the address data associated with the authenticated ID data, and the image shaking data is output from the data output unit 157 via the network 5. It is transmitted to the presentation device 6. In step S12, the image shaking presentation device 6 presents an image based on the image data transmitted from the image shaking control device 4, and presents a shaking based on the shaking data.

In this way, in the user's favorite image, the fluctuation of the image and the reflection of the taste can be presented to the user. Further, in the above-described embodiment, the user side pays the usage fee collectively when transmitting the image, so that the user does not have to perform the payment process for each device to be used. Can be. Also, on the system side, each device can reliably collect the fee.

FIG. 15 is a diagram showing another configuration of the information processing system. In the information processing system illustrated in FIG. 15, the terminals 1-1 to 1-N include simple type motion presenters 181-1 to 181-N, respectively. The simplified sway presenting device 181 is a device that presents sway to a user under the control of the terminal 1 that receives the sway data generated by the sway data generating device 3 via the network 2. Unlike the image shaking presentation device 6, the simple shaking presentation device 181 is configured to allow the user to feel shaking even at home, but the shaking is simple, and the user simply transmits the shaking. It is provided to confirm whether or not the preference data has been reflected.

Next, referring to the flowchart of FIG.
The operation in the information processing system shown in FIG. 15 will be described. Note that the same device as that of the above-described embodiment can be used for each of the shaking data generating device 3, the image shaking control device 4, and the image shaking presenting device 6.

In step S21, the terminal 1 transmits image data, personal data, and favorite data. These data are received by the shaking data generating device 3 in step S22, and the shaking data generating device 3 executes a charging process. The processing of steps S21 and S22 is the same as the processing of steps S1 and S2 in the flowchart of FIG.

In step S23, sway data is generated. This process is also similar to the process of step S5 in the flowchart of FIG. The generated shaking data is sent to the terminal 1 together with the ID data in step S24.
Sent to. In step S25, the terminal 1 records the received ID data on a predetermined recording medium and also receives image data. Then, the terminal 1 performs step S
At 26, the simplified type of motion display device 181 is controlled according to the received motion data.

Since the shaking data is generated in order to present the shaking in earnest in the image shaking presentation device 6, it cannot be used as it is for controlling the simplified shaking presentation device 181. Therefore, the terminal 1 converts the input sway data into sway data suitable for the simplified sway presenter 181 and controls the simplified sway presenter 181 based on the converted sway data.

The user confirms the shaking presented by the simplified shaking presentation device 181 and determines whether or not the shaking reflects the preference data. The determination result is transmitted from the terminal 1 to the shaking data generation device 3 in step S27. Motion data generator 3
Receives the determination result from the terminal 1 in step S28.

The motion data generating device 3 proceeds to step S29.
, A process based on the received judgment result is executed.
If the received determination result is that the user has determined that the preference data is not reflected, the process returns to step S23, and the subsequent processing is repeated, and the user reflects the preference data. If it is determined that there is, the process proceeds to step S30.

Therefore, the processes in steps S23 to S29 are repeatedly performed until the user determines that the user is in a sway reflecting the preference data. However, if the process of steps S23 to S29 is permitted to be repeated indefinitely, for example, the user enjoys the repetition only with the simple type of motion display device 181 and is satisfied only with the simple motion display device 181 (the image motion display device 6). May not be presented with the swaying). Since such a situation can be regarded as being fraudulently presented with the agitation, in order to prevent such a situation, the number of times the processing of steps S23 to S29 is repeated (the user is required to regenerate the agitation data) The number of times that can be obtained) may be set to, for example, three times.

In step S27, when the user transmits a result of the determination that the user is not upset with the preference data reflected by the terminal 1, the data indicating how the reflection is not reflected is also added together. May be transmitted.

In step S29, if the received determination result is that the user has determined that the preference data is reflected, and the process proceeds to step S30, the image fluctuation control device 4 And various data are output. In step S30, the data output is data in which the agitation data, the image data, the ID data, and the billing data are associated with each other.

The processing after step S30 is the same as the processing after step S7 in the flowchart of FIG. 13, and a description thereof will be omitted.

As described above, by providing the simple type of motion presenting device 181, it is possible to surely present the motion data reflecting the user's preference.

In the above-described embodiment, when the preference data is input, the coefficient generation unit 47 stores the sway data and the image data corresponding to the liking data in the sway data storage unit 61 and the image data storage unit. 62, the image fluctuation relation coefficient is generated and output by the fluctuation data learning unit 63. However, a plurality of image fluctuation data relation coefficients are stored in advance, and the one corresponding to the favorite data is output (new generation). Instead, the stored one may be read out).

The above series of processing can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, it is possible to execute various functions by installing a computer in which the programs constituting the software are embedded in dedicated hardware, or by installing various programs For example, it is installed from a recording medium to a general-purpose personal computer or the like.

As shown in FIG. 2, the recording medium is a magnetic disk 31 (including a floppy disk) on which the program is recorded and an optical disk 32 which are distributed separately from the computer to provide the user with the program.
(CD-ROM (Compact Disk-Read Only Memory), DVD (Dig
ital Versatile Disk), magneto-optical disk 33
(Including MD (Mini-Disk)) or semiconductor memory 3
ROM 12 that stores programs and is provided to the user in a state in which it is not only configured by a package medium such as
And a hard disk including the storage unit 18.

In the present specification, the steps of describing a program provided by a medium are not necessarily performed in chronological order, but may be performed in chronological order according to the described order. Alternatively, it also includes individually executed processing.

In this specification, a system is
It represents the entire device composed of a plurality of devices.

[0094]

As described above, according to the information processing apparatus according to the first aspect, the information processing method according to the fourth aspect, and the recording medium according to the fifth aspect, the fluctuation of the user's favorite input is described. The coefficient corresponding to the preference data is output, and the output coefficient is used to generate the sway data for controlling the sway corresponding to the image based on the input image data. It is possible to generate data for presenting a more reflected sway.

According to the information processing system of the sixth aspect, the information processing method of the eighth aspect, and the recording medium of the ninth aspect, the first information processing apparatus can store the image data and the user's preference. Is supplied to the second information processing apparatus, the second information processing apparatus outputs a coefficient corresponding to the input preference data, and uses the output coefficient to input an image based on the input coefficient. Generate sway data for controlling sway corresponding to an image based on the data, supply the generated sway data to a presentation device, and the presentation device presents the sway based on the supplied sway data. Therefore, it is possible to present a sway that reflects the user's preference.

[Brief description of the drawings]

FIG. 1 is a diagram showing the configuration of an embodiment of an information processing system to which the present invention has been applied.

FIG. 2 is a diagram showing an internal configuration of a terminal 1.

FIG. 3 is a diagram showing an internal configuration of the motion data generating device 3.

FIG. 4 is a diagram showing an internal configuration of a coefficient generation unit 47.

FIG. 5 is a diagram for explaining data stored in a coefficient generation unit 47;

FIG. 6 is a diagram showing a configuration of an image shaking presentation device 6.

7 is a side view of the driving device 72. FIG.

FIG. 8 is a view from above of the driving device 72;

FIG. 9 is a diagram illustrating an actual stimulus and an alternative stimulus.

FIG. 10 is a diagram showing an internal configuration of a fluctuation data learning unit 63.

FIG. 11 is a diagram showing an internal configuration of a motion data generator 42.

FIG. 12 is a diagram showing an internal configuration of the image fluctuation control device 4.

FIG. 13 is a flowchart illustrating the operation of the system.

FIG. 14 is a diagram illustrating a screen displayed on a display unit.

FIG. 15 is a diagram showing another configuration of the embodiment of the information processing system.

16 is a flowchart illustrating an operation of the information processing system illustrated in FIG.

[Explanation of symbols]

1 terminal, 2 network, 3 shaking data generator, 4 image shaking controller, 5 network,
6 Image shaking presentation device, 42 Shaking data generator,
44 Toll collection unit, 45 ID generation unit, 46 Billing data generation unit, 61 Motion data storage unit, 62
Image data storage unit, 63 Motion data learning unit, 71
Display, 72 drive device, 73 data acquisition device, 74 slot, 152 accounting unit, 1
53 data storage unit, 154 ID data storage unit, 15
5 ID data input section, 156 ID authentication section

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Hideo Kasama 6-7-35 Kita Shinagawa, Shinagawa-ku, Tokyo Sony Corporation F-term (reference) 2C001 BC00 BC10 BD00 BD07 CB01 CB08 CC02 5C064 BA07 BB01 BB03 BC10 BC18 BC20 BC23 BD01 BD07 BD08 BD09

Claims (9)

[Claims] 1. An input unit for inputting image data and preference data relating to fluctuation of a user's preference via a network; a coefficient output unit for outputting a coefficient corresponding to the preference data input by the input unit; Using the coefficient output by the coefficient output unit,
An information processing apparatus, comprising: a generating unit configured to generate shaking data for controlling shaking corresponding to an image based on the image data input by the input unit. 2. The image processing apparatus according to claim 1, wherein the coefficient output unit is configured to store image data captured in advance, motion data corresponding to the image data, and the image stored in the storage unit corresponding to the preference data. 2. The information according to claim 1, further comprising: reading means for reading data and the shaking data; and calculating means for calculating the coefficient from the image data and the shaking data read by the reading means. 3. Processing equipment. 3. The coefficient output means accumulates image data captured in advance and coefficients calculated from sway data corresponding to the image data, and calculates the favorite data from the stored coefficients. The information processing apparatus according to claim 1, wherein a coefficient corresponding to is output. 4. An input control step of controlling input of image data and preference data relating to fluctuation of user's preference via a network; and a coefficient corresponding to the preference data whose input is controlled in the processing of the input control step. A coefficient output step of outputting, and using the coefficient output in the processing of the coefficient output step, to control a fluctuation corresponding to an image based on the image data whose input is controlled in the processing of the input control step. A generating step of generating the motion data of the subject. 5. An input control step of controlling input of image data and preference data relating to fluctuation of user's preference via a network, and a coefficient corresponding to the preference data whose input is controlled in the processing of the input control step. A coefficient output step of outputting, and using the coefficient output in the processing of the coefficient output step, to control a fluctuation corresponding to an image based on the image data whose input is controlled in the processing of the input control step. And a generating step of generating the motion data of the computer. 6. A first information processing apparatus for supplying image data, and a second information processing apparatus for generating motion data using the image data.
In an information processing system including: an information processing apparatus according to the present invention, and a presentation apparatus that presents a sway corresponding to the sway data, the first information processing apparatus includes: An input unit for inputting the image data and the preference data supplied by the first supply unit, the first information processing device including a first supply unit that supplies the image data and the preference data to the second information processing device; A coefficient output unit that outputs a coefficient corresponding to the preference data input by the input unit; and using the coefficient output by the coefficient output unit,
Generating means for generating shaking data for controlling shaking corresponding to an image based on the image data input by the input means; and supplying the shaking data generated by the generating means to the presentation device. An information processing system, comprising: a presentation unit that presents a sway based on the sway data supplied by the second supply unit. 7. The second supply unit also supplies the shaking data to the first information processing device, and the first information processing device is supplied by the second supply device. A control unit for controlling a presentation device for presenting a connected sway based on the sway data; and transmitting a determination result as to whether or not the sway controlled by the control unit reflects the preference data. The second information processing apparatus may further include: when the determination result transmitted by the transmission means indicates that the preference data is not reflected, Thereby, the oscillation data is re-generated, and the determination result is
7. The information processing apparatus according to claim 6, wherein, when indicating that the preference data is reflected, the second supply unit supplies the shaking data to the presentation device. . 8. A first information processing apparatus for supplying image data, and a second information processing apparatus for generating sway data using the image data.
An information processing method of an information processing system comprising: an information processing device according to claim 1; and a presentation device that presents a motion corresponding to the motion data, wherein the information processing method of the first information processing device comprises: A first supply control step of controlling supply of preference data relating to the fluctuation of the preference to the second information processing apparatus, wherein the information processing method of the second information processing apparatus includes the first supply control step. An input control step of controlling the input of the image data and the preference data whose supply is controlled in the processing of the above, and a coefficient output step of outputting a coefficient corresponding to the preference data whose input is controlled in the processing of the input control step Using the coefficient output in the coefficient output step based on the image data whose input has been controlled in the input step processing. A generation step of generating sway data for controlling sway corresponding to an image; and a second supply control step of controlling supply of the sway data generated in the processing of the generation step to the presentation device. The information processing method of the presenting apparatus, comprising: a presenting step of presenting a sway based on the sway data whose supply has been controlled in the processing of the second supply control step. 9. A first information processing apparatus for supplying image data, and a second information processing apparatus for generating motion data using the image data.
An information processing system comprising: an information processing device according to claim 1; and a presentation device that presents a motion corresponding to the motion data, wherein the program of the first information processing device includes the image data and a user preference. A first supply control step of controlling supply of preference data relating to rocking to the second information processing apparatus, wherein the program of the second information processing apparatus is supplied in a process of the first supply control step. An input control step of controlling the input of the image data and the preference data, the coefficient output step of outputting a coefficient corresponding to the preference data, the input of which is controlled in the processing of the input control step; An image based on the image data, the input of which is controlled in the processing of the input step, using the coefficient output in the processing of the output step. A generating step of generating sway data for controlling the corresponding sway, and a second supply control step of controlling supply of the sway data generated in the processing of the generating step to the presentation device, The program of the presentation device includes a presentation step of presenting a sway based on the sway data whose supply has been controlled in the processing of the second supply control step. A computer-readable program is recorded. recoding media.