KR101377953B1 - method for controlling an object and apparatus for outputting an object - Google Patents

Abstract

The present invention relates to a scene control method and a scene control apparatus. The present invention shows a BIFS decoder that decodes a command stream including a node capable of controlling a scene, and selects a device sensor, and a scene configuration displayed by the BIFS decoder, receiving and outputting a user event. A compositor for synthesizing the scene such that a scene selected by the user event among the device sensor nodes included in the scene output by the scene graph unit is displayed on the scene, and the compositor synthesizes the scene graph unit; Provided is a scene control apparatus including a renderer for displaying a scene and a display unit for displaying a scene output by the renderer.

Scene, BIFS, Node, Sensor, Device

Description

Scene control method and apparatus for controlling the scene {method for controlling an object and apparatus for outputting an object}

1 illustrates a node type that may be used in an embodiment of the invention.

2 is a view showing an embodiment of a scene control apparatus according to the present invention;

3 illustrates an embodiment of a scene control method according to the present invention.

4 is a flowchart illustrating another embodiment of a scene control method according to the present invention.

5 is a flowchart illustrating another embodiment of a scene control method according to the present invention.

6 illustrates an example using an embodiment of a scene control method according to the present invention.

7 is a diagram illustrating another example of searching for a scene using an embodiment of a scene control method according to the present invention;

<Description of the code of the main part of drawing>

10: BIFS Decryptor

20: scene graph unit

30: compositor

40: renderer

50: display unit

The present invention relates to a scene control method and a scene control apparatus, and more particularly, to a scene control method and a scene control apparatus capable of easily expressing a multimedia object.

There is a method of describing and displaying multimedia content in units of one or more objects. For example, the binary format for scenes (BIFS) adopted by the moving picture experts group (MPEG) is a format for describing multimedia objects included in a scene to be displayed. BIFS can describe how video / audio objects are placed in space and time in a scene. In addition, BIFS can describe the movement of an object and the response of the object when the user adjusts the object, and the response of the object is either by the sensors that can generate the event or by the source and target of the event. It can be expressed in BIFS format by route along.

When a user controls a scene described by MPEG-4 or a scene represented using a virtual reality modeling language (VRML), a mouse is generally used for a two-dimensional scene and a wand for a three-dimensional scene. Use devices such as (wand). That is, in general, when controlling an object in a scene, a pointing device capable of pointing to the object is used.

BIFS may describe a pointing device for object navigation. However, many devices do not have a pointing device, so when searching for an MPEG-4 scene, the user has to search the scene using only a limited device such as a button or a joystick. In addition, even when an object constituting a scene is selected in a device having a plurality of pointing devices, there is a problem in which the pointing device sensor is not displayed to the user.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and an object of the present invention is to provide a scene control method and a scene control apparatus which are easy to control a scene by easily selecting and controlling an object.

According to an aspect of the present invention, there is provided a method of receiving and decoding a stream including a node capable of selecting a device sensor, and according to the device sensor node of the decoded stream, It provides a scene control method comprising the step of displaying the selection area in the scene.

The present invention also provides a method of receiving a user event for selecting a device sensor from a user and selecting a device sensor according to the user event from a node capable of selecting the device sensor, and focusing the selected device sensor. Provides a scene control method comprising the step of displaying the area.

In addition, the present invention is to receive a user event for activating the device sensor from the user and to activate the device sensor according to the user event from the node that can select the device sensor (device sensor), the active area of the activated device sensor It provides a scene control method comprising the step of displaying.

In another aspect, the present invention provides a BIFS decoder for decoding a command stream including a node capable of controlling a scene and selecting a device sensor, wherein the BIFS decoder displays the BIFS decoder. Represents a scene configuration, the scene graph unit for receiving and outputting a user event, and the scene selected so that a sensor selected according to the user event among the device sensor nodes included in the scene output by the scene graph unit is displayed in the scene It provides a scene control device including a compositor to synthesize, a renderer for expressing a scene synthesized by the compositor, and a display unit for displaying the scene output by the renderer.

Hereinafter, with reference to the accompanying drawings, an embodiment of the present invention that can specifically implement the present invention will be described.

A scene described as BIFS includes a node which is a basic element constituting the scene. Among the nodes, a node that a user can interact with an object is called a sensor node. Sensor nodes respond to user actions.

According to an embodiment of the present invention, a new node type may be used to select an object through pointing device sensors. The node type represents a characteristic of each node. For example, the node type may be a box, a group, a sound, a spotlight, or the like.

1 illustrates a node type that may be used in an embodiment of the present invention, wherein the node illustrated is a node that may enable an object to be selected according to a selection action, such as a button. In the following embodiment including FIG. 1, a node responding according to a user's selection action is referred to as a NavigationScheme for convenience.

First, the meaning of each syntax is described to describe the node type illustrated in FIG. 1. First, eventIn represents a logical reception characteristic and is a field indicating event reception.

An event may be transmitted and received from one node to another node by a route. When an event interacts between nodes, a field value of the corresponding node may be changed. eventOut has an attribute that outputs an event from the node that contains the syntax. The exposedField has an attribute that receives an event through eventIn and changes its value, and generates an event through eventOut when the value changes. The SFBool field has a logical value of true or false. The SFString and MFString fields contain strings in the format according to the UTF-8 universal character set. SFString represents a single string and MFString represents zero or more strings.

The node contains set_bind according to the eventIn attribute and isbound along the eventOut attribute. set_bind event raises a given node to the top of the stack or moves it from the top of the stack to another location. If eventIn for set_bind is true, the node goes to the top of the stack; if it's false, the node deviates from the top of the stack.

The isBound event is output when a given node moves 1) to the top of the stack, 2) moves out of the top of the stack, and 3) moves out of the top of the stack by the node that is to be placed on top of the stack. It is an event. That is, the isBound event occurs when a given node becomes an active node or becomes an inactive node by an active node.

The NavigationScheme2D node is a node that contains information describing the navigation characteristics of the selection button via pointing-device sensors. The NavigationScheme2D node can be included in the root group of the scene, and multiple NavigationScheme2D nodes can be included in the scene.

In FIG. 1 the sensors field may define a list of pointing device sensors that operate according to a scheme that can select a selection function, for example pre-next. That is, the pointing devices included in the sensors field may be selected in a cyclical logic process so that the pointing device sensors included in the list may be sequentially and alternatively selected.

The initial field may set the initial pointing device sensor when the object starts to be searched in the scene. If a value of true is set in the set_bind (eventIn) field of the NavigationScheme2D node, the sensor node moves up the top of the stack of NavigationScheme2D nodes. When the NavigationScheme2D node is activated, the browser of the scene control device may control the scene navigation using the fields of the NavigationScheme2D node.

If a false value is set in the set_bind field, the NavigationScheme2D node is removed from the stack. In other words, when a NavigationScheme2D node is at the top of the stack and then leaves, the NavigationScheme2D node sends a false event via isbound. Then, the next node in the stack becomes bound and fires a true event.

2 is an example showing an embodiment of a scene control apparatus according to the present invention. An embodiment of the scene control apparatus according to the present invention includes a BIFS decoder 10, a scene graph unit 20, a compositor 30, a renderer 40, and a display unit 50. .

The BIFS decoder 10 may output a BIFS command stream by decoding the stream transmitted according to the BIFS format. The BIFS command stream may include a node that defines a selection scheme for the scene control device.

The scene graph unit 20 may receive a BIFS command stream and decode information about an object included in a scene and a connection relationship between the objects. The scene graph unit 20 may output information on the scene control device included in the scene from the decoded BIFS stream. The scene graph unit 20 may receive a device selection signal according to a selection scheme from a user and output the device selection signal to the compositor 30. That is, the scene graph unit 20 outputs information for displaying a sensor for an initial device when there is no change event of the device selection of the user, and, when there is a device selection change event of the user, the scene configuration information according to the scene graph unit 20. Output to compositor 30. The user event may be generated by various input devices and may be input to a selection device such as a button.

The compositor 30 may synthesize a scene according to a node included in the scene graph decoded by the scene graph unit 20. When the compositor 30 receives the information about the device sensor according to the user event from the scene graph unit 20, a signal for displaying the active area marker of the device according to the user event around or on the object. Outputs The compositor 30 outputs an object to be focused by a device sensor by a user's selection and an active area that can be focused.

The renderer 40 may display the scene output by the compositor 30 on the screen. Therefore, when there is a device set in the scene output by the compositor 30, and there is an object that the device focuses on, the renderer 40 can display a marker on or around the object. have.

The display unit 50 may display a scene for rendering the renderer 40 to the user.

When a device sensor node (NavigationScheme2D) for selecting a device in the scene is included, the user may output a device selection event to the scene graph unit 20. The scene graph unit 20 may receive a device selection event output by the user, decode it, and output it to the compositor 30. The compositor 30 may select a device according to a device sensor event output by the scene graph unit 20. The compositor 30 instructs the renderer 40 to display an object that can be controlled by the selected device on the display unit 50, and the renderer 40 outputs a device sensor output by the compositor 30. The objects that can be controlled may be displayed through the display unit 50.

The user can change the device defined in the device sensor according to the selection scheme. For example, the user can change the selected device with a pre-next button or the like. When the user outputs the device change event according to the selection scheme, the scene graph unit 20 outputs information on the device sensor changed according to the user event to the compositor 30. For example, the user can change the device selection to control the object from the list for the device sensor defined in the sensor of the NavigationScheme2D node according to the selection button.

The compositor 30 receives the device selection change signal from the scene graph unit 20, and changes the previously selected device to the currently selected device according to the list registration order. Then, the compositor 30 calculates and outputs an active area on the scene that the focused sensor affects, and displays the renderer 40 on the display unit 50.

According to the selection scheme, the user may output an event for activating the selected device to the scene graph unit 20. For example, the user selects a device according to the selection scheme, and outputs an event that activates the selected device by using a designated activation button such as an OK button so that the selected device is activated. The scene graph unit 20 may receive the notification of the activation of the selected scene control device sensor to the compositor 30, and the compositor 30 may allow the object of the scene to be selected by the device selected by the renderer 40.

According to an embodiment of the present invention, receiving and decoding a stream including a node capable of selecting a device sensor, and decoding a stream according to the device sensor node of the decoded stream, And the selection area is displayed in the scene. Specific examples of this embodiment are disclosed in FIG. 3.

3 is a diagram illustrating an embodiment of a scene control method according to the present invention. An embodiment of a scene control method according to the present invention will be described with reference to FIG. 3.

First, a method of expressing a scene when a device selection event does not occur is as follows.

If there is no event generated by the user due to the scene description, the command stream is received and decoded (S10). That is, the command stream including "insert", "delete", "replace", "Update", and the like included in the scene is decoded. The scene is described according to the received command (S20).

Then, the device corresponding to the initial device sensor is marked on the scene (S30). The initial device may be set from the initial device sensor of the node where the compositor performs the device selection scheme. The initial device may be a device according to an initial sensor described in an initial field among fields of a node that performs the device selection scheme described with reference to FIG. 1.

The compositor then locates the initial device on an object in the scene and calculates the area range of the device to determine the area in which the device sensor can act. The compositor may display the determined area on the renderer so as to display it on the screen (S30). Thus, the scene displayed by the renderer may display the active area of the sensor on the object and the scene is updated.

Another embodiment of the present invention is to receive a user event for selecting a device sensor (device sensor) from a user and to select a device sensor according to the user event from a node that can select a device sensor, the focus of the selected device sensor and displaying a (focus) area. Specific examples of this embodiment are disclosed in FIG. 4.

4 is a flowchart illustrating another embodiment of a scene control method according to the present invention. 4 illustrates a process of displaying a scene by a user event. Here, the user may control the device sensor with a button having two or more selections, such as a selection button, for example, a "pre"-"next" button.

First, a user event occurs (S110). The user event refers to an event of selecting a device by selecting a direction using a "pre" or "next" button.

The device sensor selected according to the user's selection is displayed (S120). The sensor display is as follows. The select button finds a pre / next device sensor of the current sensor according to the index information of the device in the currently focused device sensor list, and causes the device sensor to be focused to the current device. The compositor calculates the active area of the device sensor on or around the objects in the scene, and updates the scene by causing the renderer to display the calculated area of the device sensor (S130).

Another embodiment of the present invention is to receive a user event for activating a device sensor from a user and to activate a device sensor according to the user event from a node capable of selecting a device sensor, and the activated device sensor Marking the active area of the substrate. Specific examples of this embodiment are disclosed in FIG. 5.

5 is a flowchart illustrating another embodiment of a scene control method according to the present invention. The example of FIG. 5 describes an example of generating an event for a user to select a sensor.

A user event occurs (S210). The user event is a device sensor activation event according to device sensor selection, for example, pressing an OK button may be an example.

Then, the user updates the scene by activating the sensor selected by the user to display on the screen (S220). Thus, the user can control the object of the scene with a sensor different from the initial one.

6 is a view showing an example using an embodiment of a scene control method according to the present invention. The source code of FIG. 6 includes a NavigationScheme 2D node (a), and the NavigationScheme 2D node is as described in FIG. 1. In the example of FIG. 6, the MPEG 4 scene is defined to be searchable by five sensor nodes. The five sensor nodes are Sensor A, Sensor D, Sensor B, Anchor A and Sensor C, and can be selected by the user in the order listed (b). And, among the sensor nodes, the initially set sensor is Sensor B (initial "SensorB") (c).

After 2000ms, the AnchorA node is deleted along with the children nodes below the AnchorA node along with SensorC and SensorD (d). The device sensor controlling the scene is changed, the AnchorA node is removed from the device sensor list, and the initial selected device sensor is changed to SensorA.

7 discloses another example of searching for a scene using an embodiment of a scene control method according to the present invention. FIG. 7 discloses an example of using a plurality of NavigationScheme 2D nodes to navigate a scene by controlling the stack by a mechanism for the stack and a set_bind event. After 2000ms, the AnchorA node is deleted along with its children, SensorC and SensorD, which are children of the AnchorA node. The example disclosed in FIG. 7 is similar to the example of FIG. 6, but instead of changing each sensor node included in NavigationScheme 1, all of NavigationScheme 1 may be changed to NavigationScheme 2 (d). In the example of FIG. 7, even when controlling a complex scene, the search algorithm is not tangled and the scene can be easily controlled.

When you create and change an MPEG-4 scene, you need to assign which sensor nodes are focused. When you create a scene to make the logical sense of the scene easier, certain device sensors can be assigned to focus. For example, the initial focus of the menu visual may be set as an OK button of the scene control apparatus, and the user may respond. It is possible to indicate the continuation of focus switching for a device with two pre-next buttons. Objects in the scene can be selected on the screen by buttons on a keyboard or remote controller. The scene control apparatus according to the present invention can be applied to a broadcast receiving device, a mobile phone, a DMB smart phone, a broadcast set-top box, an MPEG-4 player, and the like.

It is easy for a person skilled in the same technical field to change or modify the present invention from the present patent specification. Thus, although an embodiment of the present invention has been described above clearly, various modifications thereof should be made without departing from the spirit and the scope of the invention.

The effects of the scene control method and the scene control apparatus according to the present invention described above are as follows. According to the scene control method and the scene control apparatus according to the present invention, an object can be easily selected and controlled.

Claims (17)

Receiving and decoding a stream including a first node capable of selecting a device sensor; Setting a device sensor according to the first node of the decoded stream; Calculating an area range of the device sensor and determining an active area of the device sensor; And And displaying the active area of the determined device sensor in a scene. The method according to claim 1, The first node, And a list of device sensors including at least one device and device sensors that can be activated when the scene is displayed. The method of claim 1, wherein the first node is changed to a second node. Receiving a user event selecting a device sensor from a user; Selecting a device sensor according to the user event from a first node capable of selecting a device sensor; Calculating a focus area of the device sensor; And And displaying the calculated focus area of the device sensor. 5. The method of claim 4, Selection of the device sensor during the displaying step, And at least one device sensor included in the device sensor list of the first node. 5. The method of claim 4, The user event, Scene control method generated by a button according to a selection scheme. 5. The method of claim 4, And the user event is generated by a button for selecting a bidirectional direction. 5. The method of claim 4, wherein the first node is changed to a second node. Receiving a user event activating a device sensor from a user; Activating a device sensor according to the user event from a first node capable of selecting a device sensor; Calculating an active area of the device sensor; And And displaying an active area of the activated device sensor. 10. The method of claim 9, And the user event is performed by a designated activation button. 8. The method of claim 7, The first node includes a list of device sensors including at least one device and a device sensor that can be activated when the scene is displayed from the list. 10. The method of claim 9, wherein the first node is changed to a second node. A BIFS decoder (binary format for scenes decoder) for decoding a command stream including a first node capable of controlling scenes and selecting a device sensor; A scene graph unit configured to display a scene configuration displayed by the BIFS decoder and to receive and output a user event; A compositor configured to synthesize the scene such that a device sensor selected according to the user event among first nodes included in the scene graph unit is displayed on the scene, and calculate an active area of the device sensor; A renderer for expressing a scene synthesized by the compositor; And And a display unit for displaying a scene output by the renderer. 14. The method of claim 13, And the first node includes a list of device sensors including at least one device and a device sensor that can be activated when displaying a scene from the list. 14. The method of claim 13, And the user event is generated by a button for selecting a bidirectional direction. 14. The method of claim 13, And the user event is performed by a designated activation button. 14. The method of claim 13, And the first node is changed to a second node.

Images