JP4088064B2 - System, information processing apparatus, server apparatus, program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to object change control data for moving or changing a shape of a virtual object in a two-dimensional or three-dimensional virtual space, or an information processing apparatus using the object change control data.
[0002]
[Prior art]
Recently, in the information and communication field, a shift from narrowband to broadband using ADSL, CATV, optical fiber, etc. is progressing. With the arrival of such a broadband era, that is, with the realization of high-speed communication, it is expected that the response speed becomes faster and the download time becomes shorter, and a more comfortable Internet environment and the like can be obtained.
[0003]
In particular, this makes it possible to transmit and receive moving images and audio with higher accuracy and speed, and in the future, the use of three-dimensional (or two-dimensional) moving image objects for user interface screens on the Internet and the like will become more widespread. It is thought to go.
[0004]
[Problems to be solved by the invention]
However, adopting a video object only from the viewpoint of being able to send video and audio with high accuracy and high speed, or constructing a system that uses it, will overturn the idea that has been formed since the narrowband era. Cannot be performed, and there is a possibility that the great possibility in the information exchange by the moving image object is impaired.
[0005]
In other words, in narrowband, for example, WEB content has to be minimal due to restrictions on communication speed, logical explanations (logical expressions) are mainstream, and information given to users is static. (Characters, photos, etc.) are the center, and search is possible at most. In addition, this creates barriers such as a literacy divide or a sensibility divide in the information flow, so that only some people (users) can effectively use information resources, or information can be obtained only from some people (users). There is such a problem as not.
[0006]
Specifically, although data is given to the user for the information provider, that is, the homepage by means of inorganic contents and logical expressions due to restrictions on communication speed, etc., the data is completely regarded as meaningful information for the user. On the other hand, since the operations that the user can perform in the WEB page are limited to the selection operation and the click operation, sufficient user information cannot be extracted only from the selection result and the operation log. Such a point is considered to be a bottleneck particularly in CRM.
[0007]
These problems are not fully recognized that the information is originally for the "people" who use it, handling large-scale data, sophisticated data, improving the efficiency of data transmission, or automating work processes. This is primarily due to the importance of “data volume” and “mechanism efficiency”. And in the limited environment defined by such a way of thinking, even if it is extremely large like artificial intelligence or database, there is no expression for autonomy and information exchange Naturally, there is a limit and it is difficult to think that sufficient information exchange can be realized.
[0008]
In other words, even if moving to broadband and making it possible to fully use video and audio due to higher communication speeds, etc., as long as the system itself is based on the idea described above, the information provider and the information receiver The transmission of information that should be performed between the two is simply a transmission of data, and the possibility of exchanging information using moving images may not be maximized.
[0009]
Therefore, the present invention has been made with the above-mentioned points in mind, and not only how to accurately or precisely represent visuals, but also to convey three-dimensional (or two-dimensional) objects as the main medium. By providing a system that can freely and easily express things freely and with the will and creativity of those who use it, it is possible to communicate information between information providers and information receivers. Its main purpose is to make it truly effective.
[0010]
[Means for Solving the Problems]
That is, the present invention causes a computer to interpret and execute together with space display data for displaying a two-dimensional or three-dimensional virtual space on a display and object display data for displaying an object in the virtual space. For inducing or generating a movement or shape change in the virtual space, and having an object that can be changed, added, or deleted independently from the space display data and the object display data Change control data. In addition, an information processing device that performs image processing based on the object change control data and moves or changes the shape of the object on the display, a server device that transmits and receives the object change control data to and from the information processing device, and the like It is related to the system.
[0011]
If this is the case, the object change control data can be changed, added, or deleted independently from the spatial display data and the object display data. Object change control data can be developed independently from data and object display data, and the developed object change control data is not affected even if the space display data or object display data is changed. Convenience and flexibility in its development will greatly increase. Furthermore, for example, once the object display data is transmitted from the server side to the terminal side, the object can be moved by exchanging only the object change control data with a small capacity. It is possible to easily generate a moving image in real time while communicating without using.
[0012]
In order to make the effects of the present invention more prominent, the object change control data has a hierarchical structure, and element data belonging to an upper hierarchy is associated with one or a plurality of element data belonging to the lower hierarchy. It is desirable to have a structure in which data can be added, changed, or deleted independently of other element data.
[0013]
In this case, for example, the element data belonging to the highest hierarchy indicates the most abstract message of the action or shape change that the corresponding object wants to perform, and more specific actions or shapes as it goes to the lower hierarchy. It is possible to prescribe changes.
[0014]
And this makes it possible for the same message to behave as if the object has autonomy and behaves according to the individual character, simply by making the content of one of the element data appropriate for the object. Can be given. Moreover, since each element data is divided into multiple layers, it is possible to express very delicately by combining them, and each element data can be added, changed or deleted independently, providing information By defining new element data themselves or adding or changing them, the personality and behavior of the objects will leave the hands of the system designer and become infinite variations. It becomes.
[0015]
In other words, the above-described configuration makes it possible to freely express the emotions, actions, processes, etc. of an object in a multidimensional manner, which is truly effective for information transmission between the information provider and the information receiver. Can be done automatically. As a result, a completely new form can be given to character business, games, advertisements, e-commerce, etc., such as distribution of characters having personality.
[0016]
This will be described more specifically. There are various methods for dividing the hierarchy. Preferably, the hierarchy includes at least a scenario hierarchy and a behavior hierarchy set below the scenario hierarchy, and element data relating to the behavior or shape change process of the object is included in the scenario hierarchy. And control data that belong to one or more, and behavior data that is element data relating to the behavior or shape change norm of the object is associated with each control data in the behavior hierarchy. Good. In addition, an action hierarchy is further provided below the behavior hierarchy, and action data that is element data relating to physical movement or shape change of the object is associated with each behavior data in the action hierarchy. If this is done, the degree of freedom of expression is further increased, which is still preferable.
[0017]
Here, the control data, which is the element data belonging to the highest hierarchy, is the most abstract message indicating the action or shape change that the object wants to be made. The content. Of course, depending on the scene, it may be a story like a combination of these, or a more abstract content such as “win the game”.
[0018]
The behavior data indicates a norm such as an action performed by the object based on the control data. For example, “control the right arm” and “enlarge the left arm” for the control data “mighty”. The two are “corresponding”.
[0019]
The action data indicates the contents related to the physical operation corresponding to the behavior data. For example, for the behavior data “Large the right arm”, “Right arm is set at 180 degrees for 2 seconds. "Rotate around the center" corresponds.
[0020]
For example, if there are two different objects, the action data of one object is “rotate the right arm around 150 degrees for 5 seconds” and the other is “the right arm is 180 degrees, 2 Rotate around the base for a second and give a message to both parties that they will be “old”. One side should raise both hands slightly and the other should raise both hands vigorously. It becomes. That is, only by changing the action data, each object behaves as if one has a personality that does not express emotions on the surface and the other has a personality that expresses emotions on the front.
[0021]
In addition, if the object change control data includes event identification information for identifying the type of event, for example, a predetermined operation of the user is regarded as an event, and various objects can be specified in the form of an event drive for each operation type. Can be made interactive so that it can respond to user's actions. As a result, it is possible to provide a user-friendly and suitable operating environment.
[0022]
In order to make it easier and more easily to define the movement or shape change of an object, the object change control data causes the computer to recognize the processing procedure when initiating or generating the movement or shape change of the object. It is preferable that it has procedure identification information.
[0023]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described below.
[0024]
FIG. 1 is a device configuration diagram showing the entire system in this embodiment. In this figure, P1 is an information processing device used by a user, P2 is a server device, and these are connected to each other via a communication network such as the Internet so that bidirectional communication is possible.
[0025]
First, the information processing device P1 and the server device P2 will be described from the device aspect.
[0026]
The information processing apparatus P1 is, for example, a general-purpose personal computer having a WEB browsing function. As shown in FIG. 2, the information processing apparatus P1 includes a CPU 101, an internal memory 102, an external storage device 103 such as an HDD, a modem for connecting to a communication network, and the like. It comprises a communication interface 104, a display 105, input means 106 such as a mouse and a keyboard, and the like. The server device P2 has, for example, a WEB server function, a database function, and the like. As shown in FIG. 3, a CPU 201, an internal memory 202, an external storage device 203 such as an HDD, and a modem for connecting to a communication network A communication interface 204 such as a display 205, an input means 206 such as a mouse and a keyboard, and the like.
[0027]
Next, the information processing device P1 and the server device P2 will be described in terms of functions. First, the information processing device P1 stores spatial display data in a predetermined area of the memory 102 or the external storage device 103 as shown in FIG. 4 by installing a predetermined program in the form of a plug-in in the browser, for example. (Not shown), an object display data storage unit D1, an object change control data storage unit D2, and the like are individually generated, and an operation program is set, and the CPU 101 and peripheral devices operate cooperatively based on the operation program. Thus, it functions as the object change control data changing unit 1, the object control unit 2, the event occurrence detecting unit 3, the object change control data receiving unit 4, and the like.
[0028]
Specifically, the space display data storage unit stores space display data for displaying a three-dimensional virtual space on the display 105, and the object display data storage unit D1 is stored in the virtual space. The object display data for displaying a three-dimensional object is stored, and the object change control data D2 acts on the object display data to cause movement or shape change of the object in the virtual space. Or to be generated.
[0029]
As shown in FIG. 5, one or more of the object display data and the object change control data are associated with an object identifier for identifying each object.
[0030]
The object display data is composed of structure data indicating a structure enabling operation of each three-dimensional object, outline data indicating the outline of each three-dimensional object, or surface data indicating a pattern, a color, etc. as necessary. It can be obtained by using a three-dimensional measuring instrument or CG, CAD or the like that can create a three-dimensional shape. The structure data shows a skeleton structure 30 as shown in FIG. 6, and this skeleton structure 30 is a part 31 which is a skeleton of each part such as a human body's arm, torso, and leg via an indirect point 32. It is a linked structure, and by determining the angle and position of each joint point 32 as the other end point in the three-dimensional local coordinate system with the end point of the upper part as the origin, the posture and position for each part 31 are determined, and the structure The operation of the entire body 30 is defined. On the other hand, the outline data is polygon data indicating a curve or a curved surface set at a required position in the three-dimensional local coordinate system that defines the skeleton structure 30, and the surface data is pasted on the surface by texture mapping or the like. It shows patterns and colors. Note that the configuration of the object display data is not limited to that described above, and various other configurations are possible.
[0031]
The object change control data is in a text format defined using, for example, XML. As shown in FIG. 7, the object change control data has a hierarchical structure, and element data belonging to the lower layer is compared with element data belonging to the upper layer. One or a plurality are associated with each other. In the present embodiment, the hierarchy includes at least three layers of a scenario hierarchy, a behavior hierarchy, and an action hierarchy in order from the upper layer.
[0032]
In the scenario hierarchy, one or more control data, which is element data relating to the operation process of the object, is associated with an object index for identifying each object. The behavior hierarchy is associated with one or a plurality of behavior data, which is element data relating to the behavioral rules of the object, in association with each control data. Further, the action hierarchy is associated with one or a plurality of action data, which are element data relating to the physical operation of the object, in association with the behavior data.
[0033]
More specifically, for example, as shown in FIG. 8, the control data includes an event index indicating the type of event and an index of behavior data to be associated (path specification, URL specification, etc.). Are also described in pairs. In this example, the event index is “mouse click”, and the behavior index is “every year”. Note that a plurality of behavior indexes can be described, and a plurality of pairs of event indexes and behavior indexes can be described.
[0034]
In addition, the behavior data having the “every year” index shows an index of action data to be associated (may include path designation, URL designation, etc.) as shown in FIG. 9, for example. In this example, there are two action indexes, “raise the right arm” and “raise the left arm”, but three or more, or one.
[0035]
The action data indicates one or both of the action content and the shape change content of the object. Here, the movement refers to a change in position and posture of each part of the object or a set thereof, and a change in shape refers to a change in the shape, color, or pattern of each part that does not include the movement. In the present embodiment, the operation content and the shape change content are distinguished from each other, but they may not be distinguished.
[0036]
More specifically, with regard to the motion, for example, as shown in FIG. 10, a target index indicating all or a part of an object to be operated, following an identifier (for example, MOVE) indicating the motion. And a motion index indicating the motion of the object and time data indicating the time for the motion or shape change. There may be a plurality of these. In the target index, a part index indicating each part of the structure may be described, or a joint point connecting the parts may be described. A plurality of parts may be grouped and the group name may be described. In the motion index, the posture change and the position change of the parts and the like are described. The specific description method may be determined appropriately, and it may be possible to specify movement and rotation to a predetermined point, to specify the direction and moving distance, and to specify the direction and rotation angle. May be. In addition, for example, a curve defined by various equations and a movement distance along the curve may be designated, or the above-described designation methods may be combined. Further, the start time and end time may be described in the time data.
[0037]
On the other hand, with regard to the shape change, specifically, a typical example is to change the shape of the face. Here, as shown in FIG. 11, a shape change identifier (for example, EXPRESSION) indicating that the expression is changed. The expression index indicating the expression, the numerical data indicating the degree of the expression, and the time data indicating the time until the expression is described in pairs. There may be a plurality of these.
[0038]
Furthermore, in this embodiment, each element data can include processing procedure identification information for allowing the computer to recognize whether to perform parallel processing or sequential processing. For example, in the above-described FIG. 9, “raise the right arm” and “raise the left arm” are simply written together, or <PARARELLE></PARARELLE> is bundled with a tag and processing is performed at the same time. When specifying sequential processing, <SEQUENCE></SEQUENCE> tags are processed in the order they are written. Note that the processing procedure identification information is not limited to SEQUENCE, and various procedures such as REPEAT, which means repetition, RANDOM, which means random processing, and WAIT, which specifies waiting time, can be used alone or in combination. If yes.
[0039]
On the other hand, the object change control data changing unit 1 performs addition, change, or deletion of the object change control data stored in the object change control data storage unit D2 independently from the object display data. Data can be added, changed, or deleted independently from other element data.
[0040]
In this embodiment, as shown in FIG. 12, it is similar in form to object change control data, but does not include behavior data and the like, and shows an add, change or delete process for each event index and each element data. Data for handling data including a pair of data is transmitted from the server device P2, and is associated with the object identifier and has an event index that matches the detected event. In the case of data manipulation data, the object change control data changing unit 1 performs addition, change, or deletion processing for each element data according to the contents. In this embodiment, ADD is added when element data addition is specified, and DEL is added when deletion is made. In the case of a change, ADD and DEL are combined to cope with it.
[0041]
The object control unit 2 acquires the object display data and the object change control data from the object display data storage unit D1 and the object change control data storage unit D2, interprets the contents, and operates the object from the interpretation result. Alternatively, the shape is changed.
[0042]
Specifically, as shown in FIG. 13, the object control unit 2 interprets the lowermost element data to be processed in parallel and sequentially processed from the processing procedure identification information included in the acquired object change control data. Those that should be classified and processed in parallel serve as reactor interpreters that accumulate in separate instruction queues, and those that should be processed sequentially in the same instruction queue according to their processing order. The instruction queue is temporarily or statically set in a predetermined area such as the internal memory 102 or the external storage device 103.
[0043]
Thereafter, it plays the role of a reactor that takes in the element data stored in the instruction queue via a loader. This reactor takes in the element data stored in the same instruction queue in order from the beginning, generates a movement or shape change based on the time information, and element data stored in different instruction queues are independent of each other. To capture.
[0044]
This reactor performs processing once per unit time such as 0.1 seconds, and based on time information (time data) included in the captured element data, the reactor unit converts the element data in unit time. This is divided into unit change control data for inducing or generating motion or shape change. For example, element data having time information of 2 seconds is divided into 20 unit change control data, and element data having time information of 3 seconds is divided into 30 unit change control data. . Then, based on a target index included in each element data, a target to be operated is specified from the object display data, and the unit change control data is sequentially executed to induce or generate an object motion or shape change. To do. The movement or shape change may be generated by sequentially adding unit amounts to the initial unit change control data, or gradually increasing the movement or shape change amount based on the initial position. You may do it.
[0045]
At this time, if there are unit change control data generated from a plurality of element data stored in different instruction queues, the unit change control data is executed in parallel in the processing for each unit time, and a plurality of operations are performed. Alternatively, the shape change is induced or generated in parallel. For example, as shown in FIG. 14, when a plurality of element data A to D exist in parallel, the difference between processing start times determined from identifiers such as WAIT and the difference in required time of each element data In the part, a plurality of operations or shape change processes are performed in parallel, and in some cases, a single operation or shape change process is performed.
[0046]
The event occurrence detection unit 3 detects the occurrence and type of an event. Here, the event includes, for example, a predetermined operation by the user (mouse click or the like), that a predetermined time has come, or that some data has been transmitted from another computer such as the server device P2.
[0047]
The object change control data receiving unit 4 receives the object change control data transmitted from the server device P2.
[0048]
Next, the server device P2 will be described in terms of functions. For example, the server device P2 is installed with a predetermined program attached to the WEB server program, as shown in FIG. A space display data storage unit (not shown), an object display data storage unit (not shown), an object change control data storage unit D3, and the like are individually generated in a predetermined area, and an operation program is set. Based on this, the CPU 101 and peripheral devices work together to exhibit functions as an object change control data transmission unit 5, a space display data transmission unit (not shown), an object display data transmission unit (not shown), and the like.
[0049]
The space display data storage unit, the object display data storage unit, and the object change control data storage unit D3 store space display data, object display data, and object change control data to be transmitted to the information processing device P1. Since the data is the same as described above, description thereof is omitted.
[0050]
On the other hand, the object change control data transmission unit 5, the space display data transmission unit, and the object display data transmission unit respectively send the object change control data, the space display data, and the object display data independently of the information processing device P1 or other server devices. In particular, the object change control data transmission unit 5 can transmit the element data constituting the object change control data independently.
[0051]
Next, an example of the operation of this system will be described in detail below with reference to FIGS.
[0052]
For example, assume that the information processing device P1 accesses the server device P2. At this time, space display data, object display data, or object change control data is transmitted from each transmission unit of the server device P2, accumulated in each storage unit of the information processing device P1, and added or changed (step S01). . Based on these data, a three-dimensional virtual space and an object are displayed on the WEB page. Regarding the download, the user may be prompted to do so. For example, if the access is for the second time or later, the space display data stored in advance in the information processing apparatus P1 is not downloaded. Alternatively, object display data or object change control data may be used. The download timing is not limited to the time of the first access, and space display data and object display data may be downloaded separately or stored from a recording medium such as a CD-ROM.
[0053]
Thereafter, for example, when an event occurs such that the mouse is clicked, the event occurrence detection unit 3 detects this (step S02).
[0054]
Then, the object control unit 2 acquires object change control data having an event index that matches the detected event (including those satisfying the conditions) from the object change control data storage unit D2 (step S03). Specifically, first, control data having an event index of “mouse click” is specified, and other element data associated therewith is also acquired. If there are two or more pieces of control data having the same event index, a higher priority order may be obtained by assigning an appropriate priority order.
[0055]
At this time, the acquired object change control data is not limited to the data stored in advance in the object change control data storage unit D2. For example, when the data having the event index that matches the detected event is the data operation data, the data operation data is acquired (step S11), and the object change control data change is performed according to the contents. The unit 1 performs processing for adding, changing, or deleting object change control data or each element data (steps S12 to S14). Thus, for example, when the location of the object change control data or element data to be added is set in the object change control data storage unit D4 of the server device P2, the following operation is performed.
[0056]
First, the transmission request unit 6 of the information processing device P1 requests the server device P2 to transmit the corresponding object change control data or element data (step S11).
[0057]
When the transmission request receiving unit 7 receives this request data in the server device P2 (step S21), the requested object change control data or element data is obtained from the object change control data storage unit D3 (step S22), and the object The change control data transmission unit 5 returns it to the information processing device P1.
[0058]
Then, on the information processing device P1 side, the object change control data receiving unit 4 receives the transmitted object change control data or element data (step S13), and the object change control data changing unit 1 receives the object change control data. It adds to the data storage part D2 (step S14).
[0059]
It is assumed that the object change control data specified and acquired by the object control unit 2 is as shown in FIG.
[0060]
After that, the object control unit 2 classifies each action data as the lowermost element data to be processed in parallel and sequentially processed from the processing procedure identification information included in the acquired object change control data as described above. However, items to be processed in parallel are stored in separate instruction queues, and items to be processed sequentially are stored in the same instruction queue according to the processing order. Thereafter, based on the time data included in the action data, the action data is divided into unit change control data (step S05), and these are executed in parallel or sequentially in the processing for each unit time, and both hands are simultaneously applied to the object. After being raised, it is smiled (step S06).
[0061]
Here, the expression change of smiling will be briefly described. In this embodiment, as shown in FIG. 18, when a facial expression instruction is performed using action data, the facial expression shape is specified from the facial expression storage unit based on the facial expression index, and also indicates the degree of facial expression specified in the action data. From the numerical data and the identified facial expression shape, a displacement vector of a predetermined partial region with respect to the entire shape is extracted from the facial expression shape displacement storage unit. Further, the outline data of the face is extracted from the outline data storage unit, and the shape is changed by applying a predetermined calculation based on the displacement vector, specifically, synthesis to the outline data. Even in this case, dividing into unit change control data, that is, dividing the vector into lengths corresponding to unit time and gradually changing the shape is the same as in the case of motion generation. Of course, the method of shape change is not limited to this.
[0062]
By the user operation of clicking in this way, the object smiles after raising both hands at the same time.
[0063]
Therefore, according to the present embodiment, the object change control data can be changed, added, or deleted independently from the space display data and the object display data. Object change control data can be developed independently from display data and object display data, and the developed object change control data is not affected even if the space display data or object display data is changed. Therefore, the convenience and freedom in production will be greatly increased. Furthermore, for example, once the object display data is transmitted from the server side to the terminal side, the object can be moved by exchanging only the small object change control data. It is possible to easily generate a moving image in real time while communicating without using.
[0064]
Furthermore, the object change control data has a hierarchical structure, and element data belonging to the upper hierarchy is associated with one or more element data belonging to the lower hierarchy, and each element data is independent of the other element data. Since it can be added, changed, or deleted, it is just a simple task of making the content of any element data appropriate for each object. Can behave like a behavior.
[0065]
In addition, since each element data can be added, changed, or deleted independently, the information provider can define new element data by themselves, or add, change, etc. The behavior spreads out of the system designer and becomes an infinite variation.
[0066]
In addition, the fact that the object change control data is independent from the object display data means that the object display data has a structure that can be changed, added, or deleted independently from the object change control data. For this reason, for example, it is also possible to change only the shape of the object by making only the operation common. In other words, like the object change control data, the shape of the object leaves the system designer's hand and spreads as an infinite variation.
[0067]
In addition, for example, a user's predetermined operation can be regarded as an event, and the object can be operated in various ways in the form of an event drive for each operation type, so that the object can be interactive in response to the user's actions. . As a result, it is possible to provide a user-friendly and suitable operating environment.
[0068]
In other words, the above-described configuration makes it possible to freely express the emotions, actions, processes, etc. of an object in a multidimensional manner, which is truly effective for information transmission between the information provider and the information receiver. Can be done automatically. Furthermore, coupled with the fact that the object display data is also independent, it is possible to give a completely new aspect to a new character business, such as the distribution of characters with personality and the distribution of cyber talent, games, advertisements or e-commerce. It becomes like this.
[0069]
Next, each application example will be described below.
[0070]
For example, when a predetermined time is reached or the user performs a specific operation, the object change control data related to the advertisement is transmitted from the object change control data transmission unit 5 of the server device P2.
[0071]
In the information processing apparatus P1, the object change control data receiving unit 4 receives the transmitted object change control data, and the object change control data changing unit 1 receives the object change control data received by the object change control data receiving unit 4. The control data is added to or changed in the object change control data storage unit 2 in the information processing apparatus P1.
[0072]
This makes it possible to carry out advertising in a completely different manner from the conventional one. That is, when a certain time comes, object change control data for drinking beer to an object (for example, a character) is sent from the server device as an advertisement for beer, and the object that has been set in advance until the object is virtual You can suddenly drink beer in the space. By using the same technique, for example, an advertisement as an object can suddenly light up, become large, or change its viewpoint.
[0073]
In the above embodiment, the movement of the object, the gazing point, the viewpoint, and the like are utilized by utilizing the techniques described in Japanese Patent Application Laid-Open No. 10-97646 and Japanese Patent Application Laid-Open No. 11-272891 already filed by the present inventor. The change can be intuitively operated by the user's mouse operation or the like, and the decision can be made sensibly. As shown in FIG. 19, such an operation or an operation such as an identifier of a downloaded object is performed. An operation-related data acquisition unit 8 that acquires operation-related data that is data related to the situation at the time and an operation-related data transmission unit 9 that transmits the acquired operation-related data may be further provided.
[0074]
In this case, the server device P2 changes the object based on the operation-related data receiving unit 10 that receives the operation-related data transmitted from the information processing device P1 and the tendency determined from the content of the received operation-related data. An object change control data generation unit 11 that generates control data in association with each user identifier (which may be a terminal identifier) is provided, and the generated object change control data is sent from the object change control data transmission unit 5. The information is individually transmitted to the information processing apparatus P1 identified by each user identifier.
[0075]
In this way, for example, when an e-commerce screen is generated in the information processing apparatus P1 by interposing a virtual character as an object or in a game or the like, the user's operation related data is sucked into the server apparatus P2, and the user's preference is analyzed. In addition, it is possible to display a character having a personality or behavior that seems appropriate for each user. In particular, in the case of this example, not only simple clicks and selection operations as in the conventional case, but also detailed operation information such as movement of an object and change of a gazing point or a viewpoint can be acquired, and sufficient user information can be extracted. Therefore, it is particularly suitable for CRM and the like.
[0076]
In addition, character goods and the like actually sold such as anime dolls and robots can be distributed as objects on the net to promote their sales.
[0077]
Further, on the information processing device P1 side, object display data and object change control data can be created and uploaded to the server device P2 or distributed to other information processing devices P1. May be. This provides more variation in the character and behavior of the object.
[0078]
As another application example, the robot may be divided into an upper body and a lower body, and for example, an object change control data that induces or generates an action of the upper body may be associated with an object indicating the lower body. Then, when the robots are combined in the virtual space by a mouse operation or the like, it can be considered that the entire robot is operated as an event. If you prepare multiple upper and lower body parts with different element data, the way of walking and the like will be completely different depending on how the upper and lower body are combined, giving the user an image that the lower body defines personality and behavior be able to.
[0079]
In addition, some words may be issued in parallel in synchronism with facial expression changes, particularly mouth movements. Furthermore, the number of layers of the object change control data is not limited to three, but may be two or four or more, and it goes without saying that various definitions other than the above-described embodiment are possible. Nor.
[0080]
In addition, the present invention is not limited to the above described examples, and various modifications can be made without departing from the spirit of the present invention.
[0081]
【The invention's effect】
According to the present invention described in detail above, a three-dimensional (or two-dimensional) object can be used as a main medium, freely and easily expressing what you want to convey, and with the will and creativity of human beings using it, It becomes possible to provide an information exchange system that can be developed as much as possible.
[Brief description of the drawings]
FIG. 1 is an overall device configuration diagram according to an embodiment of the present invention.
FIG. 2 is an internal device configuration diagram of the information processing apparatus in the embodiment.
FIG. 3 is an internal device configuration diagram of the server device in the embodiment.
FIG. 4 is a functional block diagram showing an overall functional configuration of the system in the embodiment.
FIG. 5 is a data structure diagram showing data relating to an object in the embodiment.
FIG. 6 is an object diagram showing a human-shaped three-dimensional object in the embodiment.
FIG. 7 is a data structure diagram showing a structure of object change control data in the embodiment.
FIG. 8 is a data content diagram showing a description example of control data in the embodiment.
FIG. 9 is a data content diagram showing a description example of behavior data in the embodiment.
FIG. 10 is a data content diagram showing a description example of action data in the embodiment.
FIG. 11 is a data content diagram showing a description example of action data in the embodiment.
FIG. 12 is a data content diagram showing a description example of data operation data in the embodiment.
FIG. 13 is an explanatory diagram for explaining processing related to generation or generation of an operation or the like in the embodiment.
FIG. 14 is an explanatory diagram for explaining a flow of triggering or generating an operation or the like in the embodiment.
FIG. 15 is an operation flowchart showing the operation of the information processing apparatus according to the embodiment;
FIG. 16 is an operation flowchart showing operations of the information processing apparatus and the server apparatus in the embodiment;
FIG. 17 is a data content diagram showing a description example of object change control data in the embodiment.
FIG. 18 is an explanatory diagram for explaining a process related to generation or generation of a shape change in the embodiment.
FIG. 19 is a functional block diagram showing an overall functional configuration of a system according to another embodiment of the present invention.
[Explanation of symbols]
P1 ... Information processing device (terminal)
P2 ... Server device
D1 Object display data storage unit
D2 ... Object change control data storage unit
D3 ... Object change control data storage (server side)
1 ... Object change control data change unit
2. An information processing apparatus comprising an object control unit.
3 ... Event occurrence detector
4 ... Object change control data receiver
5 ... Object change control data transmitter
8 ... Operation-related data acquisition unit
9 ... Operation-related data transmitter
10 ... Operation-related data receiver
11 ... Object change control data generation unit

Claims (16)

A system comprising an information processing device used by a user and a server device that is communicably connected to the information processing device via a communication network,
The information processing apparatus is
A spatial display data storage unit for storing spatial display data for displaying a two-dimensional or three-dimensional virtual space on a display;
An object display data storage unit for storing object display data for displaying an object in the virtual space;
Behavior data, action index, and action index corresponding to an action index indicating behavior or shape change performed by an object in the behavior index or shape change code indicated by the behavior index or behavior change code indicating the action code or shape change code Action data that correlates the physical contents of the movement or shape change of the object indicated by, and an event index that indicates the type of event and behavior data or action data that should be added when the event indicated by the event index occurs Object that stores data manipulation data that is associated with the index of behavior data and / or the index of action data to be deleted And of control data storage unit,
An event occurrence detector for detecting the occurrence and type of the event,
When adding the behavior data or action data indicated by the index corresponding to the detected event index based on the stored data operation data, the location of the behavior data or action data is the server device A transmission request unit that transmits the transmission request to the server device;
An object change control data receiving unit that receives the behavior data or action data returned from the server device;
Based on the stored data manipulation data, behavior data or action data indicated by an index corresponding to the index of the detected event is added to the object change control data storage unit, and / or An object change control data changing unit for deleting behavior data or action data indicated by an index corresponding to the index from the object change control data storage unit;
Acquires the stored space display data and object display data to display the virtual space and objects on the display, and acquires the action data indicated by the action index of the stored behavior data, based on this An object control unit that induces or generates a movement or shape change in the virtual space of the object,
The server device is
An object change control data storage unit that stores behavior data that associates a behavior index with an action index, and action data that associates an action index with the physical contents of an action or shape change of an object;
A transmission request receiver for receiving a transmission request for the behavior data or action data transmitted from the information processing device;
A system comprising: an object change control data transmission unit that acquires data corresponding to a received transmission request among stored behavior data and action data and returns the acquired data to the information processing apparatus. A system comprising an information processing device used by a user and a server device that is communicably connected to the information processing device via a communication network,
The information processing apparatus is
A spatial display data storage unit for storing spatial display data for displaying a two-dimensional or three-dimensional virtual space on a display;
An object display data storage unit for storing object display data for displaying an object in the virtual space;
Control data that associates an event index that indicates the type of event with the behavior index that indicates the behavior norm that changes the shape of the object when the event indicated by the event index occurs, and the behavior that is indicated by the behavior index and the behavior index Behavior data that associates an action index indicating an action or shape change performed by an object in the norm or shape change norm, an action index and the physical content of the action or shape change of the object indicated by the action index Action data, event index indicating the type of event, and control to be added when the event indicated by the event index occurs Rudeta, and control data, the object change control data storage unit for storing data manipulation data made in association with the index of the behavior data or action data to be indexed and / or deletion of behavior data or action data,
An event occurrence detector for detecting the occurrence and type of the event,
Based on the stored data manipulation data, when adding control data, behavior data or action data indicated by an index corresponding to the detected event index, the location of the control data, behavior data or action data is A transmission request unit that transmits the transmission request to the server device when it is a server device;
An object change control data receiving unit for receiving the control data, behavior data or action data returned from the server device;
Based on the stored data manipulation data, control data, behavior data or action data indicated by an index corresponding to the detected event index is added to the object change control data storage unit and / or detected. An object change control data changing unit for deleting control data, behavior data or action data indicated by an index corresponding to the index of the event, from the object change control data storage unit;
Acquires the stored space display data and object display data, displays the virtual space and object on the display, and based on the stored control data, the behavior indicated by an index corresponding to the index of the detected event An object control unit that acquires data and acquires action data indicated by an action index included in the behavior data, and causes or generates a motion or shape change of the object in the virtual space based on the action data;
The server device is
Control data that associates an event index with a behavior index, behavior data that associates a behavior index with an action index, and an action that associates an action index with the physical contents of an object's motion or shape change An object change control data storage unit for storing data;
A transmission request receiver for receiving a transmission request for the control data, behavior data or action data transmitted from the information processing device;
A system comprising: an object change control data transmitting unit that acquires control data, behavior data, and action data stored therein corresponding to the received transmission request and returns the acquired data to the information processing apparatus. The behavior data or the action data includes processing procedure identification information for causing the information processing apparatus to recognize the execution procedure of the physical contents of the behavior, action, motion, or shape change when inducing or generating the motion or shape change of the object. Can include
The object control unit, based on the processing procedure identification information, behavior, action or The system according to claim 1, wherein the physical contents of the operation or shape change are executed by distinguishing between parallel processing and sequential processing. The control data, behavior data, or action data is a processing procedure for causing an information processing device to recognize the execution procedure of the physical contents of the behavior, action, motion, or shape change when inducing or generating the motion or shape change of the object, respectively. Can contain identification information,
The system according to claim 2, wherein the object control unit distinguishes and executes the physical contents of behavior, action, action, or shape change into parallel processing and sequential processing based on the processing procedure identification information. The object control unit interprets the action data, generates unit change control data for inducing or generating a motion or shape change for a unit time of the motion or shape change, and operates the object based on the generated data. 5. A system according to claim 1, 2, 3 or 4, wherein the shape is changed. It is used for configuring the system according to claim 1,
A spatial display data storage unit for storing spatial display data for displaying a two-dimensional or three-dimensional virtual space on a display;
An object display data storage unit for storing object display data for displaying an object in the virtual space;
Behavior data, action index, and action index corresponding to an action index indicating behavior or shape change performed by an object in the behavior index or shape change code indicated by the behavior index or behavior change code indicating the action code or shape change code Action data that correlates the physical contents of the movement or shape change of the object indicated by, and an event index that indicates the type of event and behavior data or action data that should be added when the event indicated by the event index occurs Object that stores data manipulation data that is associated with the index of behavior data and / or the index of action data to be deleted And of control data storage unit,
An event occurrence detector for detecting the occurrence and type of the event,
When adding the behavior data or action data indicated by the index corresponding to the detected event index based on the stored data operation data, the location of the behavior data or action data is the server device A transmission request unit that transmits the transmission request to the server device;
An object change control data receiving unit that receives the behavior data or action data returned from the server device;
Based on the stored data manipulation data, behavior data or action data indicated by an index corresponding to the index of the detected event is added to the object change control data storage unit, and / or An object change control data changing unit for deleting behavior data or action data indicated by an index corresponding to the index from the object change control data storage unit;
Acquires the stored space display data and object display data to display the virtual space and objects on the display, and acquires the action data indicated by the action index of the stored behavior data, based on this An information processing apparatus comprising: an object control unit that induces or generates an object movement or shape change in a virtual space. It is used for configuring the system according to claim 2,
Stores spatial display data for displaying a 2D or 3D virtual space on the display. A spatial display data storage unit,
An object display data storage unit for storing object display data for displaying an object in the virtual space;
Control data that associates an event index that indicates the type of event with a behavior index that indicates the behavior or shape change criterion that an object performs when the event indicated by the event index occurs, and the behavior that is indicated by the behavior index and the behavior index Behavior data that associates an action index indicating an action or shape change performed by an object in the norm or shape change norm, an action index and the physical content of the action or shape change of the object indicated by the action index Action data, event index indicating the type of event, and control to be added when the event indicated by the event index occurs Rudeta, and control data, the object change control data storage unit for storing data manipulation data made in association with the index of the behavior data or action data to be indexed and / or deletion of behavior data or action data,
An event occurrence detector for detecting the occurrence and type of the event,
Based on the stored data manipulation data, when adding control data, behavior data or action data indicated by an index corresponding to the detected event index, the location of the control data, behavior data or action data is A transmission request unit that transmits the transmission request to the server device when it is a server device;
An object change control data receiving unit for receiving the control data, behavior data or action data returned from the server device;
Based on the stored data manipulation data, control data, behavior data or action data indicated by an index corresponding to the detected event index is added to the object change control data storage unit and / or detected. An object change control data changing unit for deleting control data, behavior data or action data indicated by an index corresponding to the index of the event, from the object change control data storage unit;
Acquires the stored space display data and object display data, displays the virtual space and object on the display, and based on the stored control data, the behavior indicated by an index corresponding to the index of the detected event An object control unit for acquiring data and acquiring action data indicated by an action index included in the behavior data, and inducing or generating a motion or shape change of the object in the virtual space based on the action data Information processing device. The behavior data or the action data includes processing procedure identification information for causing the information processing apparatus to recognize the execution procedure of the physical contents of the behavior, action, motion, or shape change when inducing or generating the motion or shape change of the object. Can include
The information processing apparatus according to claim 6, wherein the object control unit is configured to distinguish the physical contents of behavior, action, action, or shape change into parallel processing and sequential processing based on the processing procedure identification information. The control data, behavior data, or action data is a processing procedure for causing an information processing device to recognize the execution procedure of the physical contents of the behavior, action, motion, or shape change when inducing or generating the motion or shape change of the object Can contain identification information,
The object control unit executes the physical contents of the behavior, action, action, or shape change based on the processing procedure identification information by distinguishing between parallel processing and sequential processing. The information processing apparatus according to claim 7. The object control unit interprets the action data, generates unit change control data for inducing or generating a motion or shape change for a unit time of the motion or shape change, and operates the object based on the generated data. The information processing apparatus according to claim 6, 7, 8, or 9, wherein the shape is changed. It is used for configuring the system according to claim 1,
An object change control data storage unit that stores behavior data that associates a behavior index with an action index, and action data that associates an action index with the physical contents of an action or shape change of an object;
A transmission request receiver for receiving a transmission request for the behavior data or action data transmitted from the information processing device;
A server device comprising: an object change control data transmission unit that obtains data corresponding to a received transmission request among stored behavior data and action data, and returns the data to the information processing device. It is used for configuring the system according to claim 2,
Control data that associates an event index with a behavior index, behavior data that associates a behavior index with an action index, and an action that associates an action index with the physical contents of an object's motion or shape change An object change control data storage unit for storing data;
A transmission request receiver for receiving a transmission request for the control data, behavior data or action data transmitted from the information processing device;
A server apparatus comprising: an object change control data transmission unit that obtains a response corresponding to a received transmission request from among stored control data, behavior data, and action data, and returns the acquired data to the information processing apparatus. What is used for comprising the system of Claim 1, Comprising:
A spatial display data storage unit for storing spatial display data for displaying a two-dimensional or three-dimensional virtual space on a display;
An object display data storage unit for storing object display data for displaying an object in the virtual space;
Behavior data, action index, and action index corresponding to an action index indicating behavior or shape change performed by an object in the behavior index or shape change code indicated by the behavior index or behavior change code indicating the action code or shape change code Action data that correlates the physical contents of the movement or shape change of the object indicated by, and an event index that indicates the type of event and behavior data or action data that should be added when the event indicated by the event index occurs Object that stores data manipulation data that is associated with the index of behavior data and / or the index of action data to be deleted Of control data storage unit,
An event occurrence detector that detects the occurrence and type of an event,
When adding the behavior data or action data indicated by the index corresponding to the detected event index based on the stored data operation data, the location of the behavior data or action data is the server device A transmission request unit for transmitting the transmission request to the server device;
An object change control data receiving unit for receiving the behavior data or action data returned from the server device;
Based on the stored data operation data, it corresponds to the index of the detected event. Behavior data or action data indicated by an index is added to the object change control data storage unit, and / or behavior data or action data indicated by an index corresponding to the index of the detected event is added to the object change control data. An object change control data changing unit to be deleted from the storage unit, and
Acquires the stored space display data and object display data to display the virtual space and objects on the display, and acquires the action data indicated by the action index of the stored behavior data, based on this A program that functions as an object control unit that induces or generates an object movement or shape change in a virtual space. What is used for comprising the system of Claim 2, Comprising:
A spatial display data storage unit for storing spatial display data for displaying a two-dimensional or three-dimensional virtual space on a display;
An object display data storage unit for storing object display data for displaying an object in the virtual space;
Control data that associates an event index that indicates the type of event with the behavior index that indicates the behavior norm that changes the shape of the object when the event indicated by the event index occurs, and the behavior that is indicated by the behavior index and the behavior index Behavior data that associates an action index indicating an action or shape change performed by an object in the norm or shape change norm, an action index and the physical content of the action or shape change of the object indicated by the action index Action data, event index indicating the type of event, and control to be added when the event indicated by the event index occurs Rudeta, index and / or control data to be deleted, the object change control data storage unit for storing data manipulation data made in association with the index of the behavior data or action data behavior data or action data,
An event occurrence detector that detects the occurrence and type of an event,
Based on the stored data manipulation data, when adding control data, behavior data or action data indicated by an index corresponding to the detected event index, the location of the control data, behavior data or action data is A transmission request unit that transmits the transmission request to the server device in the case of the server device;
An object change control data receiving unit for receiving the control data, behavior data or action data returned from the server device;
Based on the stored data manipulation data, control data, behavior data or action data indicated by an index corresponding to the detected event index is added to the object change control data storage unit and / or detected. An object change control data change unit for deleting control data, behavior data or action data indicated by an index corresponding to the index of the event, from the object change control data storage unit, and
Acquires the stored space display data and object display data, displays the virtual space and object on the display, and based on the stored control data, the behavior indicated by an index corresponding to the index of the detected event A program that acquires data and acquires action data indicated by an action index included in behavior data, and causes an action or shape change of the object in the virtual space based on the action data to function or function as an object control unit. What is used for comprising the system of Claim 1, Comprising:
Behavior data that associates the behavior index with the action index, and the physical content of the action index and object movement or shape change An object change control data storage unit for storing action data associated with
A transmission request receiver for receiving a transmission request for the behavior data or action data transmitted from the information processing apparatus; and
A program that functions as an object change control data transmission unit that acquires data corresponding to a received transmission request from stored behavior data and action data and returns the acquired data to the information processing apparatus. What is used for comprising the system of Claim 2, Comprising:
Control data that associates an event index with a behavior index, behavior data that associates a behavior index with an action index, and an action that associates an action index with the physical contents of an object's motion or shape change Object change control data storage unit for storing data,
A transmission request receiver for receiving a transmission request for the control data, behavior data or action data transmitted from the information processing apparatus; and
A program for functioning as an object change control data transmission unit that acquires stored control data, behavior data, and action data corresponding to a received transmission request and returns the acquired data to the information processing apparatus.

Images