JP2014075055A - Information processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processor capable of quickly achieving feedback to a user with low load processing.SOLUTION: A UI function part 201 receives operation information from a communication terminal 100, and selects a service scenario part 202 or a virtual space management part 204 as the notification destination of the received operation information in accordance with the operation information according to a distribution information table. In the case of selecting the virtual space management part 204 as a notification destination, the virtual space management part 204 can rewrite object information of a spatial database 205. On the other hand, in the case of selecting the service scenario 202 as a notification destination, scenario execution processing in the service scenario 202 is performed, the virtual space management part 204 is requested to perform object rewrite processing, and the virtual space management part 204 performs rewrite processing of object information.

Description

  The present invention relates to an information processing apparatus that controls an object in response to an operation request from a communication terminal.

  It is considered to operate an object in a virtual space using a gesture recognition function of a portable terminal, a UI (User Interface) such as a 6-axis sensor, or a touch panel. For example, Patent Literature 1 describes that an operation is performed on an object in a three-dimensional virtual space on a network and a change in the object according to the operation is shared with all users.

JP 2000-99437 A

  As described above, in recent years, it is considered to manage a three-dimensional virtual space in a network server, place an object in the three-dimensional virtual space, and allow a user to operate the object via the network. As described above, when an object in a three-dimensional virtual space on the network is operated, feedback to the user necessary for the operation also requires a three-dimensional process. For example, the operation icon moves or the property of the target object changes. Since such a three-dimensional process imposes a heavy load on the server, there may be a problem that a time lag is likely to occur even when compared with feedback using a simple two-dimensional image, which hinders user operations.

  Therefore, an object of the present invention is to provide an information processing apparatus that can realize feedback to the user quickly and with low load processing.

  Therefore, in order to solve the above-described problems, the information processing apparatus according to the present invention is an information processing apparatus that processes an object to be displayed on the communication terminal in response to a request from the communication terminal. Virtual space storage means for storing object information for displaying an object on an object, and output means for periodically checking object information stored in the virtual space storage means and performing object display processing based on the object information And a distribution information storage means for storing a distribution table in which operation information indicating an operation on the object is associated with a notification destination for executing processing based on the operation information, and receiving operation information from the communication terminal And a notification destination based on a distribution table stored in the distribution information storage unit. A notification means for notifying the operation information received by the means, and upon receiving the operation information from the notification means, a process based on the scenario information defining a process according to the operation information is executed and an object corresponding to the process And a virtual space management unit that rewrites the object information of the virtual space storage unit based on the display instruction when an object display instruction is received from the scenario execution unit. Is configured to notify the virtual space management unit of operation information when the virtual space management unit is determined as a notification destination based on the distribution table stored in the distribution information storage unit, and The space management means receives the operation information from the notification means, and the object of the virtual space storage means is based on the operation information. Rewrite-object information, characterized in that.

  According to the present invention, the operation information is received from the communication terminal, and the received operation information is selected as the notification destination of the scenario execution means or the virtual space management means according to the operation information. When the virtual space management unit is selected as the notification destination, the virtual space management unit can rewrite the object information in the virtual space storage unit. On the other hand, when the scenario execution unit is selected as the notification destination, the scenario execution unit performs the scenario execution process and requests the virtual space management unit to rewrite the object. The virtual space management unit performs the object information rewrite process. Do. By such processing, in the case of simple processing such as feedback to an object, the notification destination for the operation information is made a virtual space management means, so that the processing is simplified when performed via the scenario execution means. can do. Therefore, a quick feedback process can be realized.

  The information processing apparatus according to the present invention is characterized in that the object information that can be rewritten by the virtual space management means is status information indicating the state of the object.

  According to the present invention, the object information to be rewritten by the virtual space management means is the status information indicating the state of the object, so that the feedback process can be easily performed.

  In the information processing apparatus of the present invention, the distribution information storage unit further stores a feedback processing table that defines a drawing process for the object according to the operation information, and the virtual space management unit stores the feedback processing table in the feedback processing table. The object information is rewritten to the contents according to the above.

  According to the present invention, by rewriting the object information with the contents according to the feedback processing table, it is possible to feed back to the object according to the operation information. Therefore, for example, according to the operation information, the state of the object can be changed as a feedback of the object, such as lighting around or blinking the object.

  The present invention can realize quick feedback processing for an object.

1 is a system configuration diagram of a communication system including an information processing apparatus 200 of the present embodiment. 2 is a hardware configuration diagram of an information processing apparatus 200. FIG. It is explanatory drawing which shows a notification destination allocation information table. It is explanatory drawing which shows a feedback process table. It is a spatial information table describing the spatial information where an object is arranged. It is an object information table describing object information. 6 is a sequence diagram illustrating feedback processing of the information processing apparatus 200. FIG. FIG. 11 is a sequence diagram showing processing by a service scenario unit 202 of the information processing apparatus 200. It is an example of the screen of the display process with respect to the object by having recognized the gesture.

  Embodiments of the present invention will be described with reference to the accompanying drawings. Where possible, the same parts are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 1 is a system configuration diagram of a communication system including an information processing apparatus 200 according to the present embodiment. As shown in FIG. 1, this communication system includes a communication terminal 100 and an information processing apparatus 200. The communication terminal 100 and the information processing apparatus 200 are connected via a network. The communication terminal 100 includes input hardware 101 such as a touch panel and a camera and output hardware 102 such as a display and a speaker, and can access the information processing apparatus 200.

  On the other hand, an object is stored in the information processing apparatus 200, and the communication terminal 100 can read and manipulate an object stored therein by accessing the information processing apparatus 200 via a network. it can.

  The information processing apparatus 200 includes a UI function unit 201 (reception unit, notification unit, distribution information storage unit), service scenario unit 202 (scenario execution unit), application 203, virtual space management unit 204 (virtual space management unit), A space database 205 (virtual space storage unit), an output content creation unit 206 (output unit), a content database 207, and an output adjustment unit 208 are configured. The information processing apparatus 200 is realized by hardware such as a CPU.

  FIG. 2 is a hardware configuration diagram of the information processing apparatus 200. As shown in FIG. 2, the information processing apparatus 200 shown in FIG. 2 physically includes a CPU 11, a RAM 12 and a ROM 13 that are main storage devices, an input device 14 such as a keyboard and a mouse that are input devices, a display, and the like. The computer system includes an output device 15, a communication module 16 that is a data transmission / reception device such as a network card, and an auxiliary storage device 17 such as a hard disk and a semiconductor memory. Each function in FIG. 1 operates the input device 14, the output device 15, and the communication module 16 under the control of the CPU 11 by loading predetermined computer software on the hardware such as the CPU 11 and the RAM 12 shown in FIG. 2. In addition, it is realized by reading and writing data in the RAM 12 and the auxiliary storage device 17. Hereinafter, each functional block will be described based on the functional blocks shown in FIG.

  The UI function unit 201 is a part that receives operation information from the communication terminal 100 and performs distribution processing based on the operation information. That is, the UI function unit 201 stores a notification destination distribution information table, and notifies the notification information based on the operation information and the object ID of the object to be operated to the operation information or coordinate information. For example, if the UI function unit 201 does not recognize the object ID of the object to be operated, the UI function unit 201 performs hit determination by notifying the space database 205 of the coordinate information. When the object ID of the object to be operated is recognized, the service scenario unit 202 or the virtual space management unit 204 is set as the notification destination according to the operation information.

  FIG. 3 is an explanatory diagram of a notification destination distribution information table (distribution table). As shown in FIG. 3, in the notification destination distribution information table, distribution information, an input interface, an input UI, and a notification destination are stored in association with each other. For example, in FIG. 3, the notification destination distribution information for service 1 is assigned as the distribution information name, the three-dimensional camera as the input interface, and “lower left and right hands near the object from top to bottom” as the input UI is notified. As a destination, service scenarios for service 1 are stored in association with each other. In the example of FIG. 3, there is no description that the spatial database is a notification destination, but in this notification destination allocation information table, a service scenario unit 202, a virtual space management unit 204, and a spatial database 205 are defined as notification destinations. It is preferable.

  FIG. 4 is an explanatory diagram showing a feedback processing table. As shown in FIG. 4, distribution information, an input interface, an input UI, and feedback actions are stored in association with each other. For example, in FIG. 4, notification destination allocation information for service 1 is allocated as distribution information, a three-dimensional camera is input interface, “rotate right hand” is input UI, and “objects shine” is feedback action. Are stored in association with each other.

  When the user performs a gesture of moving his / her left and right hands down from the top to the bottom in the vicinity of the object displayed on the display unit in front of the three-dimensional camera, the communication terminal 100 displays the operation information and the coordinate information of the gesture. Is transmitted to the UI function unit 201, and the UI function unit 201 outputs operation information to the service scenario for service 1 in the service scenario 202 in accordance with the notification destination distribution information table. This coordinate information may be a three-dimensional coordinate, or may be a two-dimensional coordinate associated with the output system HW102 (such as a display) of the communication terminal 100.

  When the user makes a gesture of rotating the right hand in front of the three-dimensional camera, the communication terminal 100 sends the operation information to the UI function unit 201, and the UI function unit 201 receives the operation information, thereby receiving the spatial database 205. A hit determination process is performed on the data, and a response is received, and feedback action information is output to the virtual space management unit 204 in accordance with the distribution information table and the feedback processing table. The virtual space management unit 204 rewrites the object information in the space database 205 so as to “light around the object” as a feedback action.

  The service scenario unit 202 has a plurality of service scenarios (scenario information), and each executes a scenario according to operation information. For example, the service scenario unit 202 outputs an instruction to that effect to the virtual space management unit 204 in order to start an application or change the display of an object. The service scenario section 202 is a logic section for operating programs such as applications and functional blocks, and is a section for linking each program.

  The application 203 is an application that operates based on an instruction of the service scenario 202, and an application corresponding to each scenario is prepared.

  When receiving the operation information and object ID from the UI function unit 201 or the object ID, operation information, and viewpoint information from the service scenario 202, the virtual space management unit 204 performs a process of rewriting the space database 205. For example, the virtual space management unit 204 performs processing for rewriting the space information and the object information in which the objects stored in the space database 205 are arranged.

  FIG. 5 is a spatial information table describing the spatial information where the object is arranged, and FIG. 6 is an object information table describing the object information.

  As shown in FIG. 5, in this spatial information table, session ID, user ID, display information, 3D background information, 2D background information, viewpoint information, and existence object information are described. The session ID is a session number assigned to the scenario, and the user ID is information for distinguishing users, and is, for example, the telephone number of the communication terminal 100. The display information is information for specifying a destination for displaying the created space, and is, for example, a renderer IP. The viewpoint information is information indicating from which position the user is viewing the space, and is x, y, z coordinate information and its normal vector. The existence object information is information on individual objects existing in the virtual space, and is a list of object information shown in FIG. This spatial information table is created when the communication terminal 100 connects to the information processing apparatus 200 and a session is established, and is deleted when the session disappears.

  FIG. 6 is an object information table, which includes an object identification ID, an object type, a data source indicating the shape of the object, a position in the virtual space indicated by the spatial information of the object, and an object virtual table. Describes status information indicating the orientation in the space, the size of the object in the virtual space, and the state of the object.

  The output content creation unit 206 periodically checks the spatial information table and the object information table in the spatial database 205 and outputs information to be displayed on the communication terminal 100 based on the information about the objects in the spatial information table and the object information table. Is the part to create. The output content creation unit 206 receives application calculation information (processing result) from the application 203 and generates display information to be displayed on the communication terminal 100 based on the application calculation information. For example, when a telephone application is activated, display information such as a menu screen for making a telephone call and an object for the menu screen is created.

  The content database 207 is a part that stores image information (content information) such as objects and background information. The output content creation unit 206 acquires necessary content information from the content database 207 and outputs it to the output adjustment unit 208.

  The output adjustment unit 208 is a part that adjusts the display information output from the output content creation unit 206 so that the display information can be displayed on the communication terminal 100.

  Processing of the information processing apparatus 200 configured as described above will be described. 7 and 8 are sequence diagrams showing processing of the information processing apparatus 200, FIG. 7 is a sequence diagram for feedback, and FIG. 8 is a sequence diagram showing processing via the service scenario 202. . First, a user operation is input from the input system HW 101 of the communication terminal 100 (S101). For example, a user gesture is input from a 3D camera or the like, and is transmitted to the information processing apparatus 200 as operation information.

  In the information processing apparatus 200, the operation information operated by the user by the UI function unit 201 is received (S102). Then, the UI function unit 201 determines the operation information and determines that the object ID is unknown, and performs a distribution process for determining the hit of the object (S103). In the UI function unit 201, the spatial database 205 is determined as a distribution destination, and hit determination processing is performed. For example, it is assumed that “touch an object” is received as operation information in the UI function unit 201. When such operation information is received, first, coordinate information based on the operation information (touch operation) is sent to the space database 205 in order to perform object hit determination processing (S104), corresponding to the coordinate information. The object ID is acquired as a hit determination result (S105). The hit determination in the feedback process may be omitted.

  Then, when the object ID is acquired, the UI function unit 201 detects a user operation based on the previously received operation information (S106), and determines a notification destination according to the feedback processing table. Then, a distribution process according to the notification destination is performed (S107). Here, in the UI function unit 201, for example, the operation information “touch an object” and the object ID are obtained, the virtual space management unit 204 is determined as the distribution destination, and the virtual space management unit 204 is determined as the notification destination. In response, the object ID and the operation information (touching the object) are transmitted (S108).

  When receiving the object ID and the operation information, the virtual space management unit 204 performs an update process on the space database 205 using the object ID and the operation information (S109). Then, the space database 205 rewrites the status information column in the object information corresponding to the object ID (see FIG. 6) with information indicating that “the object is illuminated” (S110).

  On the other hand, the output content creation unit 206 periodically checks the storage contents of the space database 205 and acquires space information and object information as needed (S111). In step S111, since the spatial database 205 has not been updated, the output content creation unit 206 performs no processing. In step S112, the status information is updated in the spatial database 205. Drawing counter-processing is performed. That is, in order to perform feedback processing, drawing processing is performed so as to shine around the object (S113). Then, the output adjustment unit 208 adjusts the drawing process according to the communication terminal 100 and outputs image data such as an object to the communication terminal 100 (output system HW) (S114).

  And in the communication terminal 100, the feedback with respect to operation with respect to the information processing apparatus 200 can be obtained rapidly. For example, when a touch operation is performed on an object, feedback processing is performed such that the area around the object shines, and the object is selected.

  Next, the sequence diagram of FIG. 8 will be described. The user further performs an operation on the fed back object (S115), and the UI function unit 201 receives operation information (S116). When the operation information is received, assuming that the object ID is unknown, the UI function unit 201 performs hit determination processing on the spatial database 205 (S118), and obtains a hit determination result (object ID) (S119). .

  When the hit determination result is acquired, the UI function unit 201 detects a user operation based on the operation information (S120), and performs notification destination distribution processing according to the user operation (S121). Here, for example, when the operation information indicating that “left and right hands are moved down from the top in the vicinity of the object” is received, the object ID, the operation information, and the viewpoint information are output to the service scenario unit 202 ( S122).

  In the service scenario unit 202, scenario execution processing is performed according to the operation information (S123), for example, activation processing is performed on the application 203, and the application is activated (S125), and a screen display instruction accompanying the activation is performed. Is output to the output content creation unit 206, and the output content creation unit 206 performs screen display processing. Further, the object ID, operation information, and viewpoint information are output to the virtual space management unit 204 (S126).

  In the virtual space management unit 204, the space information table (viewpoint information column) is updated based on the viewpoint information based on the object ID (S127), and the object information table (object position, orientation, etc.) depends on the operation information. (S128).

  Then, the output content creation unit 206 checks the update process of the object and performs a drawing reflection process (S129, S130).

  In this manner, the operation information is distributed by the UI function unit 201, so that feedback can be performed quickly.

  FIG. 9 is a screen example of display processing for an object due to recognition of a gesture, and is displayed on the output system HW 102 of the communication terminal 100, that is, a display unit or the like.

  As shown in FIG. 9A, the user performs a gesture such as “rotate the right hand”, and the input system HW 101 of the communication terminal 100, for example, a three-dimensional camera recognizes it. Then, the operation information (gesture) is output to the information processing apparatus 200, and the UI function unit 201 recognizes “rotate the right hand” after the hit determination based on the operation information, and manages the virtual space. Operation information and the like are output to the unit 204.

  Then, the virtual space management unit 204 rewrites the status information column of the object information in the space database 205 to “lights around the object”. The output content creation unit 206 checks the update to create object data so that the area around the object shines. In the communication terminal 100, the area around the object shines as shown in FIG. 9B. Thus, it is possible to notify the user that feedback (an object to be operated is determined). In FIG. 9B, an object is determined by the user's gesture and display processing is performed so that another object is brought to the center.

  The user can perform further operations on the fed back object. For example, when a gesture such as stroking is performed, an operation such as rotating the object can be performed (FIG. 9C).

  Next, operational effects of the information processing apparatus 200 according to the present embodiment will be described. In the information processing apparatus 200 according to the present embodiment, the UI function unit 201 receives operation information from the communication terminal 100, and the received operation information is used as a notification destination according to the operation information. The management unit 204 is selected according to the distribution information table. When the virtual space management unit 204 is selected as a notification destination, the virtual space management unit 204 can rewrite the object information in the space database 205. On the other hand, when the service scenario 202 is selected as a notification destination, the scenario execution process in the service scenario 202 is performed, and the virtual space management unit 204 is requested to rewrite the object. The virtual space management unit 205 rewrites the object information. Process. In the case of simple processing such as feedback for an object by such processing, the processing destination can be simplified by performing the service scenario 22 by setting the notification destination for the operation information to the virtual space management unit 204. It can be. Therefore, a quick feedback process can be realized.

  A general information processing apparatus such as a mobile phone has a plurality of modularized program groups. Conventionally, the operation information received by the UI function unit 201 is first notified to the service scenario unit 202, and the service scenario unit 202 can execute processing according to the operation information. It is not necessary to create a program from scratch because it is modularized, but there are many inconveniences in detail as described above. In the present embodiment, it is possible to provide an information processing apparatus that is devised so that a process that should be fed back to a user can be quickly processed while applying a conventional program.

  Further, according to the information processing apparatus 200, the object information table in the space database 205 to be rewritten by the virtual space management unit 204 is status information indicating the state of the object, so that the feedback process can be easily performed. it can. Rewriting the status information can make the feedback to the object easy to understand. Naturally, as feedback, not only rewriting the status information but also changing the position of the object, changing the orientation, etc. It is done.

  Further, according to the information processing apparatus 200, the space database 205 further stores a feedback processing table that defines a drawing process for an object according to operation information, and the virtual space management unit 204 includes contents according to the feedback processing table. Rewrite the object information.

  According to the present invention, by rewriting the object information with the contents according to the feedback processing table, it is possible to feed back to the object according to the operation information. Therefore, for example, according to the operation information, the state of the object can be changed as a feedback of the object, such as lighting around or blinking the object.

DESCRIPTION OF SYMBOLS 100 ... Communication terminal, 101 ... Input system hardware, 102 ... Output system hardware, 200 ... Information processing apparatus, 201 ... Function part, 202 ... Service scenario part, 203 ... Application, 204 ... Virtual space management part, 205 ... Space Database, 205 ... Virtual space management unit, 206 ... Output content creation unit, 207 ... Content database, 208 ... Output adjustment unit.

Claims (3)

In an information processing apparatus that processes to display an object in the communication terminal in response to a request from the communication terminal,
Virtual space storage means for storing object information for displaying an object on the virtual space;
Output means for periodically checking object information stored in the virtual space storage means and performing object display processing based on the object information;
A distribution information storage unit that stores a distribution table in which operation information indicating an operation on an object is associated with a notification destination that performs processing based on the operation information;
Receiving means for receiving operation information from the communication terminal;
Notifying means for notifying operation information received by the receiving means to a notification destination based on the sorting table stored in the sorting information storage means;
When receiving the operation information from the notification means, the scenario execution means for executing the process based on the scenario information defining the process according to the operation information, and instructing the display of the object according to the process;
When receiving an object display instruction from the scenario execution means, a virtual space management means for rewriting the object information of the virtual space storage means based on the display instruction;
With
The notification unit notifies the virtual space management unit of operation information when the virtual space management unit is determined as a notification destination based on a distribution table stored in the distribution information storage unit. ,
The virtual space management means receives operation information from the notification means, and rewrites the object information of the virtual space storage means based on the operation information.
An information processing apparatus characterized by that.   The information processing apparatus according to claim 1, wherein the object information that can be rewritten by the virtual space management unit is status information indicating a state of the object. The distribution information storage means further stores a feedback processing table that defines a drawing process for an object according to operation information;
The information processing apparatus according to claim 1, wherein the virtual space management unit rewrites the object information with content according to the feedback processing table.