KR20100138702A - Method and apparatus for processing virtual world - Google Patents

Abstract

PURPOSE: A method and apparatus for processing a virtual world are provided to implement the interaction between real world and virtual world by transmitting data which is sensed in the real world by a sensor to the virtual world. CONSTITUTION: A method and apparatus for processing a virtual world is comprised of the steps: storing sensor characteristics; and determining a first value which is received from a sensor(100) and transmitting a second value corresponding to the first value. The sensor has a maximum value and minimum value which is variable.

Description

Virtual World Processing Apparatus and Methods {Method and Apparatus for Processing Virtual World}

Embodiments relate to a method and an Apparatus for Processing Virtual World, and more particularly to an apparatus and method for applying the information of the real world to the virtual world.

Recently, interest in immersive games has increased. At the "E3 2009" Press Conference, Microsoft combined its sensor console, Xbox360, with a separate sensor device consisting of a Depth / Color camera and microphone array, providing users' full-body motion capturing, facial recognition, and speech recognition technologies. Introduced "Project Natal", which allows users to interact with virtual worlds without a controller. In addition, Sony applied position / direction sensing technology that combined color camera, marker, and ultrasonic sensor to Play Station3, its game console, so that the user can interact with the virtual world by inputting the motion trajectory of the controller. Wand "was released.

The interaction between the real world and the virtual world has two directions. The first is to reflect the data information obtained from the sensor of the real world to the virtual world, and the second is to reflect the data information obtained from the virtual world to the real world through an actuator. Embodiments provide a control system, a control method, and a command structure for applying data obtained from sensors in the real world to the virtual world to implement the interaction between the real world and the virtual world.

The virtual world processing apparatus according to an embodiment of the present invention determines a first value received from the sensor based on the storage unit and the sensor input device characteristics to store the sensor input device characteristics related to the characteristics of the sensor, And a processor configured to transfer a second value corresponding to the first value to the virtual world.

The virtual world processing method according to an embodiment of the present invention stores the sensor input device characteristics related to the characteristics of the sensor, and determines the first value received from the sensor based on the sensor input device characteristics. Delivering a second value corresponding to the one value to the virtual world.

Embodiments may implement the interaction between the real world and the virtual world by transmitting information measured from the real world to the virtual world using the sensor input device characteristics, which are information on the characteristics of the sensor.

Also, embodiments may generate a third value from a first value that is information measured from the real world using sensor input device characteristics, and a second value that may be applied to the virtual world from the third value using user sensor input preferences. Can be created and delivered to the virtual world to implement the interaction between the real world and the virtual world.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited or limited by the embodiments. Like reference numerals in the drawings denote like elements.

As used herein, an "object" may include an object, an object, an avatar, and the like, which are embodied and represented in a virtual world.

Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating an operation of manipulating an object of a virtual world using a sensor, according to an exemplary embodiment.

Referring to FIG. 1, a user 110 of a real world may manipulate an object 120 of a virtual world using the sensor 100 according to an exemplary embodiment. Can be. The user 110 of the real world may input his or her own motion, state, intention, form, etc. through the sensor 100, and the sensor 100 controls the operation, state, intention, form, etc. of the user 110. Information (control information, CI) may be included in the sensor signal and transmitted to the virtual world processing apparatus.

In some embodiments, the user 110 in the real world may be humans, animals, plants, and inanimate objects (eg, objects), and may also include the user's surroundings.

2 is a diagram illustrating a system for manipulating an object of a virtual world using a sensor, according to an exemplary embodiment.

Referring to FIG. 2, control information regarding a user's motion, state, intention, shape, etc. of a user of the real world 210 input through a sensor which is a device of the real world 210 according to an embodiment ( The sensor signal including control information (CI) 201 may be transmitted to the virtual world processing apparatus. According to an embodiment, the control information 201 regarding the operation, state, intention, shape, etc. of the user of the real world 210 may include sensory input device capabilities (SIDC), user sensory input. preferences (USIP) and sensory input device commands (SIDCmd). Sensor input device characteristics, user sensor input preferences, and sensor input device commands are described in detail later with reference to FIGS. 4 through 13.

The virtual world processing apparatus according to an embodiment may include an adaptation real world to virtual world 220. According to an embodiment, the adaptive RV 220 may be implemented as a real world to virtual world engine (RV engine). The adaptive RV 220 uses the control information (CI) 201 regarding the operation, state, intention, shape, etc. of the user of the real world 210 included in the sensor signal to convert the information of the real world 210 into the virtual world. (virtual world) (240) is converted into information applicable to.

According to an embodiment, adaptive RV 220 may use virtual world information (VWI) 202 using control information 201 about the operation, status, intent, shape, etc. of a user of real world 210. Can be converted.

VWI 202 is information about the virtual world 240. For example, the VWI 202 may include information about an object in the virtual world 240 or a component constituting the object.

The virtual world processing apparatus may transmit the information 203 converted by the adaptive RV 220 to the virtual world 240 through the adaptation real world to virtual world / virtual world to real world (230) 230. Can be.

Table 1 describes the configurations shown in FIG. 2.

TABLE 1

SIDC Sensor input device characteristics
Sensory input device capabilities VWI Virtual world information
(Virtual world information) USIP User sensor input preference
(User sensory input preferences) SODC Sensor output device characteristics
(Sensory output device capabilities) SIDCmd Sensor input device command
(Sensory input device commands) USOP Prefer user sensor output
(User sensory output preferences) VWC Virtual world character
(Virtual world capabilities) SODCmd Sensor output device command
(Sensory output device commands) VWP Prefer virtual world
(Virtual world preferences) SEM Sensor effect metadata
(Sensory effect metadata) VWEM Virtual World Effect Metadata
(Virtual world effect metadata) SI Sensor information
(Sensory information)

3 is a diagram illustrating a configuration of a virtual world processing apparatus according to an exemplary embodiment.

Referring to FIG. 3, the virtual world processing apparatus 300 according to an embodiment includes a storage 310 and a processor 320.

The storage unit 310 stores sensor input device characteristics related to the characteristics of the sensor.

'Sensor' is a device that measures the motion, state, intention or form of the user in the real world. Depending on the embodiment, the sensor may be configured to (1) acoustic, sound, vibration, (2) automotive, transportation, (3) chemical, (4) current, potential, Electric current, electric potential, magnetic, radio (5) environment, weather (6) flow (7) ionizing radiation, subatomic particles (8) Navigation instruments (9) position, angle, displacement, distance, speed, acceleration (10) optical, light, imaging ( 11 pressure, force, density, level (12) thermal, heat, temperature (13) proximity, presence (14) sensor technology Like sensor technology, it can be classified by type.

Table 2 shows embodiments of the sensor according to the sensor type. The sensor shown in the following table is only one embodiment, it should not be construed that the present invention can be implemented only by the sensor shown in the following table.

TABLE 2

Sensor type A list of sensors (1) sound, voice, vibration
(acoustic, sound, vibration)
Geophone
Hydrophone
Race sensor, a guitar pickup
Microphone
Seismometer
Accelerometer
(2) automotive, transportation Crank sensor
Curb feeler
Defect detector
Map sensor
Parking sensors
Parktronic
Radar gun
Speedometer
Speed sensor
Throttle Position Sensor
Variable reluctance sensor
Wheel speed sensor
 (3) chemical Breathalyzer
Carbon dioxide sensor
Carbon monoxide detector
Catalytic bead sensor
Chemical field-effect transistors
Electronic nose
Electrolyte-insulator-semiconductor sensor
Hydrogen sensor
Infrared point sensor
Ion-selective electrode
Nondispersive infrared sensor
Microwave chemistry sensor
Nitrogen oxide sensor
Optode
Oxygen sensor
Pellistor
pH glass electrode
Potentiometric sensor
Redox electrode
Smoke detector
Zinc oxide nanorod sensor
(4) electric current, electric potential, magnetic, radio Ammeter
Current sensor
Galvanometer
Hall effect sensor
Hall probe
Leaf electroscope
Magnetic anomaly detector
Magnetometer
Metal detector
Multimeter
Ohmmeter
Voltmeter
Watt-hour meter
 (5) environment, weather Fish counter
Gas detector
Hygrometer
Pyranometer
Pyrgeometer
Rain gauge
Rain sensor
Seismometers
(6) flow Air flow meter
Flow sensor
Gas meter
Mass flow sensor
Water meter
(7) ionizing radiation, subatomic particles Bubble chamber
Cloud chamber
Gauge counter
Neutron detection
Particle detector
Scintillation counter
Scintillator
Wire chamber
(8) navigation instruments Air speed indicator
Altimeter
Attitude indicator
Fluxgate compass
Gyroscope
Inertial reference unit
Magnetic compass
MHD sensor
Ring laser gyroscope
Turn coordinator
A variometer
Vibrating structure gyroscope
Yaw rate sensor
 (9) position, angle, displacement, distance, speed, acceleration Accelerometer
Inclinometer
Laser rangefinder
Linear encoder
Linear variable differential transformer (LVDT)
Liquid capacitive inclinometers
Odometer
Piezoelectric accelerometer
Position sensor
Rotary encoder
Rotary variable differential transformer
Selsyn
Tachometer
(10) optical, light, imaging Charge-coupled device
Colorimeter
Infrared sensor
LED as light sensor
Nichols radiometer
Fiber optic sensors
Photodiode
Photomultiplier tubes
Phototransistor
Photoelectric sensor
Photoionization detector
Photomultiplier
Photoresistor
Photoswitch
Phototube
Proximity sensor
Scintillometer
Shack-Hartmann
Wavefront sensor
 (11) pressure, force, density, level Anemometer
Bangmeter
Barograph
Barometer
Hydrometer
Level sensor
Load cell
Magnetic level gauge
Oscillating U-tube
Pressure sensor
Piezoelectric sensor
Pressure gauge
Strain gauge
Torque sensor
Viscometer
(12) thermal, heat, temperature Bolometer
Calorimeter
Heat flux sensor
Infrared thermometer
Microbolometer
Microwave radiometer
Net radiometer
Resistance temperature detector
Resistance thermometer
Thermistor
Thermocouple
Thermometer
(13) proximity, presence Alarm sensor
Bedwetting alarm
Motion detector
Occupancy sensor
Passive infrared sensor
Reed switch
Stud finder
Triangulation sensor
Touch switch
Wired glove
 (14) sensor technology Active pixel sensor
Machine vision
Biochip
Biosensor
Capacitance probe
Catadioptric sensor
Carbon paste electrode
Displacement receiver
Electromechanical film
Electro-optical sensor
Image sensor
Inductive sensor
Intelligent sensor
Lab-on-a-chip
Leaf sensor
Radar
Sensor array
Sensor node
Soft sensor
Staring array
Transducer
Ultrasonic Sensor
Video sensor

For example, a microphone of sensor type (1) sound, voice, vibration, and the like may collect the voice of a real world user and the voice around the user. Sensor type (2) Speed sensors in automobiles, vehicles and vehicles can measure the speed of the user in the real world and the speed of objects in the real world (eg vehicles). have. Sensor type (3) Chemical Oxygen sensor can measure the ratio of oxygen in the air around the user in the real world and the ratio of oxygen in the liquid around the user in the real world. Sensor type (4) Metal detectors of electric current, electric potential, magnetic and radio can measure the presence and presence of metal in the real world. Sensor type (5) Rain sensors of environment, weather can measure whether it is raining in the real world. Sensor type (6) Flow A flow sensor can measure the rate of fluid flow in the real world. Sensor type (7) Scintillators of ionizing radiation, subatomic particles can measure radiation rates in the user and around the user in the real world. Sensor type (8) The variometer of the navigation instruments can measure the lifting speeds around the user and the user in the real world. Sensor type (9) Odometer of position, angle, displacement, distance, speed, acceleration is an object in the real world (e.g. vehicle) ) Can measure the mileage. Sensor type (10) Phototransistors of optical, light and imaging can measure light in the real world. Sensor type (11) Barometer of pressure, force, density, level can measure the air pressure in the real world. Sensor type (12) A bolometer of thermal, heat, temperature can measure radiation in the real world. A motion detector of proximity, presence, and sensor type 13 can measure the movement of a user in the real world. Sensor type (14) A biosensor of sensor technology can measure the biological properties of a user in the real world.

Sensory input device capabilities (SIDC) are information about the characteristics of a sensor.

The capability base type is the base type of the sensor. According to an embodiment, the characteristic base type may be a base type of metadata regarding sensor input device characteristics commonly applied to all sensors as part of metadata about sensor input device characteristics. provides a base abstract type for a subset of types defined as part of the sensory input device capability metadata types).

Hereinafter, the sensor input device characteristics and the characteristic basic type will be described in detail with reference to FIGS. 4 to 6.

4 is a diagram illustrating a characteristic basic type according to one embodiment.

Referring to FIG. 4, an attribute base type 400 according to an embodiment may include a sensory input device capabilities base attributes 410 and any attributes 420.

SIDC base attributes 410 are a group of sensor input device characteristics included by default in the characteristic base type 400 (SIDC base attributes describes a group of attributes for the input device capabilities).

The optional attribute 420 is a group of additional sensor input device characteristics that the sensor has. Any attribute 420 may be a unique additional sensor input device characteristic that may be applied to any sensor. The any attribute allows for the inclusion of any attributes defined within a namespace other than the target namespace.

5 is a diagram illustrating syntax of a capability base type according to an embodiment.

Referring to FIG. 5, the syntax 500 of the feature base type according to an embodiment may include a diagram 510, attributes 520, and sources 530.

Diagram 510 may include a diagram of a characteristic base type.

Attribute 520 may include a SIDC basic attribute and any attribute.

The source 530 may include a program indicating a characteristic base type using an XML (eXtensible Markup Language). However, the source 530 shown in FIG. 5 is only one embodiment, and the present invention is not limited thereto.

6 is a diagram illustrating syntax of SIDC base attributes according to an embodiment.

Referring to FIG. 6, the syntax 600 of the SIDC basic attribute according to an embodiment may include a diagram 610, an attribute 620, and a source 630.

Diagram 610 may include a table of SIDC basic attributes.

Attributes 620 include units 601, maxValue 602, minValue 603, offset 604, resolution numOflevels 605, sensitivity 606, signal to noise ratio (SNR) 607, accuracy 608, and position 609.

Unit 601 is a unit of a value measured by a sensor. According to an embodiment, the unit 601 may be degrees Celsius (° C.) and Fahrenheit (° F.) when the sensor is a thermometer, and the unit 601 is hourly (km) when the sensor is a speed sensor. / h) and initial velocity (m / s).

The maxvalue 602 and minValue 603 are the maximum and minimum values that the sensor can measure. According to an embodiment, when the sensor is a thermometer, the maximum value 602 may be 50 ° C and the minimum value 603 may be 0 ° C. Also, even when the sensor is the same thermometer, the maximum value 602 and the minimum value 603 may be different according to the use and performance of the sensor.

Offset 604 is an offset value added to the value measured by the sensor to obtain an absolute value. According to an embodiment, if the user or object in the real world is stationary and the speed is measured with a value other than zero when the sensor is a speed sensor, the sensor determines the offset 604 as a value for adjusting the speed to zero. Can be. For example, if the speed -1km / h is measured for a stationary real-world car, the offset 604 can be 1km / h.

Resolution (numOflevels) 605 is the number of values the sensor can measure. According to an embodiment, if the sensor is a thermometer and the maximum value is 50 ° C. and the minimum value is 0 ° C., if the resolution 605 is 5, then the sensor sets the temperature to 10 ° C., 20 ° C., 30 ° C., 40 ° C., 50 ° C. The dog's temperature can be measured. According to the exemplary embodiment, the temperature may be measured at 20 ° C. by performing a truncation operation as well as when the temperature in the real world is 20 ° C. as well as 27 ° C., or may be measured at 30 ° C. by performing a rounding operation.

Sensitivity 606 is the minimum input value required for the sensor to measure the output value. According to an embodiment, when the sensor is a thermometer and the sensitivity 606 is 1 ° C., the sensor cannot measure temperature changes of 1 ° C. or less, and can only measure temperature changes of 1 ° C. or more. For example, in the real world, if the temperature rises from 15 ° C to 15.5 ° C, the sensor can still measure temperature to 15 ° C.

Signal to noise ratio (SNR) 607 is the relative magnitude of signal-to-noise of the value measured by the sensor. According to an embodiment, when the sensor is a microphone, the SNR 607 of the sensor may be a small value if there is a lot of ambient noise in measuring the voice of a user in the real world.

Accuracy 608 is the error of the sensor. According to an embodiment, when the sensor is a microphone, the measurement error due to the difference in the propagation speed of the voice according to the temperature, humidity, etc. at the time of measurement may be the accuracy 608. Alternatively, the accuracy of the sensor may be determined based on a statistical error degree of values measured by the sensor in the past.

Position 609 is the position of the sensor. According to an embodiment, when the sensor is a thermometer, the position 609 of the sensor may be between the armpits of the user in the real world. Depending on the embodiment, the location 609 may be longitude / latitude, height / direction from the ground, or the like.

In one embodiment, SIDC basic attributes are unit 601, maximum value 602, minimum value 603, offset 604, resolution 605, sensitivity 606, SNR 607, accuracy 608, and The position 609 can be summarized as shown in Table 3.

[Table 3]

name Justice Unit (601) The unit of value. Maximum value (602) The maximum value that the input device (sensor) can provide. The terms will be different according to the individual device type. Minimum value (603) The minimum value that the input device (sensor) can provide. The terms will be different according to the individual device type. Offset (604) The number of value locations added to a base value in order to get to a specific absolute value. Resolution (605) The number of value levels that the device can provide in between maximum and minimum value. Sensitivity (606) The minimum magnitude of input signal required to produce a specified output signal. SNR (607) The ratio of a signal power to the noise power corrupting the signal. Accuracy (608) The degree of closeness of a measured quantity to its actual value. Location (609) the position of the device from the user's perspective according to the x-, y-, and z-axis.

The source 630 may include a program indicating an SIDC basic attribute using XML (eXtensible Markup Language).

Reference numeral 631 denotes the definition of the maximum value 602 in XML. According to reference numeral 631, the maximum value 602 has data of type “float” and may be used optionally.

Reference numeral 632 represents the definition of the minimum value 603 in XML. According to reference numeral 632, the minimum value 603 has data of type “float” and may be used as optional.

Reference numeral 633 represents a definition of the resolution 605 in XML. According to reference numeral 633, the resolution 605 has data of type “nonNegativeInteger” and may be used as optional.

However, the source 630 shown in FIG. 6 is only one embodiment, and the present invention is not limited thereto.

Referring back to FIG. 3, the processor 320 determines a first value received from a sensor based on a sensor input device characteristic, and transmits a second value corresponding to the first value to the virtual world.

According to an embodiment, the processor 320 may determine that the virtual value corresponds to the second value corresponding to the first value when the first value received from the sensor is less than or equal to and greater than or equal to the minimum value that the sensor can measure. Can be delivered as.

According to an embodiment, when the first value received from the sensor is greater than the maximum value that the sensor can measure, the processor 320 recognizes the first value as the maximum value and selects a second value corresponding to the first value. You can pass it to the virtual world. Alternatively, when the first value is smaller than the minimum value, the processor 320 may recognize the first value as the minimum value and transfer the second value corresponding to the first value to the virtual world.

The virtual world processing apparatus 300 according to an embodiment may further include a second storage unit (not shown) that stores a user sensor input preference for manipulating the first value received from the sensor. The processor 320 may generate a third value from the first value based on the sensor input device characteristic, and generate a second value from the third value based on the user sensor input preference.

According to an embodiment, the information about the motion, state, intention, shape, etc. of the user of the real world measured by the sensor may be reflected in the virtual world as it is.

Hereinafter, sensor input device characteristics of a specific embodiment of the sensor will be described. The sensor may be a position sensor, an orientation sensor, an acceleration sensor, an optical sensor, a voice sensor, a temperature sensor, a humidity sensor, a length sensor, a motion sensor, or an intelligent camera sensor, but the present invention is not limited thereto.

[Source 1] shows sensor input device characteristics for a position sensor using XML (eXtensible Markup Language). However, the program source of [Source 1] below is only one embodiment, and the present invention is not limited thereto.

[Source 1]

<!-########################->
<!-SIDCV Position Sensor type->
<!-########################->
<complexType name = “PositionSensorCapabilityType”>
<complexContent>
<extension base = “sidc: CapabilityBaseType” />
</ complexContent>
</ complexType>

The position sensor capability type is a tool for describing sensor input device characteristics for position sensors.

The location sensor characteristic type may include an SIDC basic attribute for the location sensor.

The SIDC basic attribute for the position sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the maximum value that the position sensor can measure in position coordinate units (eg, meters).

The minimum value is the minimum value that the position sensor can measure in position coordinate units (eg, meters).

[Source 2] represents a sensor input device characteristic for an orientation sensor using eXtensible Markup Language (XML). However, the program source of [Source 2] below is only one embodiment, and the present invention is not limited thereto.

[Source 2]

<!-########################->
<!-SIDCV Orientation Sensor type->
<!-########################->
<complexType name = “OrientationSensorCapabilityType”>
<complexContent>
<extension base = “sidc: CapabilityBaseType” />
</ complexContent>
</ complexType>

The orientation sensor capability type is a tool for describing sensor input device characteristics for the orientation sensor.

The orientation sensor characteristic type may include an SIDC basic attribute for the orientation sensor.

SIDC basic attributes for the orientation sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the maximum value azimuth sensor can measure in azimuth coordinate units (eg, radians).

The minimum value is the minimum value that the orientation sensor can measure in azimuth coordinate units (eg, radians).

[Source 3] shows a sensor input device characteristic for an acceleration sensor using XML (eXtensible Markup Language). However, the program source of [Source 3] below is only one embodiment, and the present invention is not limited thereto.

[Source 3]

<!-########################->
<!-SIDCV Acceleration Sensor type->
<!-########################->
<complexType name = “AccelerationSensorCapabilityType”>
<complexContent>
<extension base = “sidc: CapabilityBaseType” />
</ complexContent>
</ complexType>

The acceleration sensor capability type is a tool for describing sensor input device characteristics for the acceleration sensor.

The acceleration sensor characteristic type may include an SIDC basic attribute for the acceleration sensor.

The SIDC basic attribute for the acceleration sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the maximum value the acceleration sensor can measure in acceleration units (eg m / s2).

The minimum value is the minimum value the acceleration sensor can measure in acceleration units (eg m / s2).

[Source 4] represents a sensor input device characteristic for a light sensor using XML (eXtensible Markup Language). However, the program source of [Source 4] below is only one embodiment, and the present invention is not limited thereto.

[Source 4]

<!-########################->
<!-########################->
<!-SIDCV Light Sensor type->
<!-########################->
<complexType name = “LightSensorCapabilityType”>
<complexContent>
<extension base = “sidc: CapabilityBaseType” />
<sequence>
<element name = “color” type = “sidcv: colorType” minOccurs = “0”
maxOccurs = “unbounded”>
</ sequence>
</ extension>
</ complexContent>
</ complexType>

The light sensor capability type is a tool for describing sensor input device characteristics for an optical sensor.

The light sensor characteristic type may include an SIDC basic attribute for the light sensor.

SIDC basic attributes for the light sensor may include a maximum value (maxValue), a minimum value (minValue) and a color value.

The maximum value is the maximum value that the optical sensor can measure in light intensity units (eg, LUX).

The minimum value is the minimum value that the light sensor can measure in light intensity units (eg, LUX).

Color values are information about colors that may enter the light sensor.

[Source 5] shows a sensor input device characteristic for a sound sensor using XML (eXtensible Markup Language). However, the program source of [Source 5] below is only one embodiment, and the present invention is not limited thereto.

[Source 5]

<!-########################->
<!-SIDCV Sound Sensor type->
<!-########################->
<complexType name = “SoundSensorCapabilityType”>
<complexContent>
<extension base = “sidc: CapabilityBaseType” />
</ complexContent>
</ complexType>

The sound sensor capability type is a tool for describing sensor input device characteristics for a voice sensor.

The voice sensor characteristic type may include an SIDC basic attribute for the voice sensor.

The SIDC basic attribute for the voice sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the maximum value that the voice sensor can measure in loudness units (eg, decibels (dB)).

The minimum value is the minimum value that a voice sensor can measure in loudness units (eg, decibels (dB)).

[Source 6] shows a sensor input device characteristic for a temperature sensor using XML (eXtensible Markup Language). However, the program source of [Source 6] below is only one embodiment, and the present invention is not limited thereto.

Source 6

<!-########################->
<!-SIDCV Temperature Sensor type->
<!-########################->
<complexType name = “TempratureSensorCapabilityType”>
<complexContent>
<extension base = “sidc: CapabilityBaseType” />
</ complexContent>
</ complexType>

The temperature sensor capability type is a tool for describing sensor input device characteristics for temperature sensors.

The temperature sensor characteristic type may include an SIDC basic attribute for the temperature sensor.

The SIDC basic attribute for the temperature sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the maximum value that the temperature sensor can measure in temperature units (eg, Celsius (° C.) and Fahrenheit (° F.)).

The minimum value is the minimum value that the temperature sensor can measure in temperature units (eg, Celsius (° C.) and Fahrenheit (° F.)).

[Source 7] shows a sensor input device characteristic for a humidity sensor using XML (eXtensible Markup Language). However, the program source of [Source 7] below is only one embodiment, and the present invention is not limited thereto.

Source 7

<!-########################->
<!-SIDCV Humidity Sensor type->
<!-########################->
<complexType name = “HumiditySensorCapabilityType”>
<complexContent>
<extension base = “sidc: CapabilityBaseType” />
</ complexContent>
</ complexType>

The humidity sensor capability type is a tool for describing sensor input device characteristics for a humidity sensor.

The humidity sensor characteristic type may include an SIDC basic attribute for the humidity sensor.

The SIDC basic attribute for the humidity sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the maximum value the humidity sensor can measure in humidity units (eg%).

The minimum value is the minimum value that the humidity sensor can measure in humidity units (eg,%).

[Source 8] represents a sensor input device characteristic for a length sensor using XML (eXtensible Markup Language). However, the program source of [Source 8] below is only one embodiment, and the present invention is not limited thereto.

[Source 8]

<!-########################->
<!-SIDCV Length Sensor type->
<!-########################->
<complexType name = “LengthSensorCapabilityType”>
<complexContent>
<extension base = “sidc: CapabilityBaseType” />
</ complexContent>
</ complexType>

The length sensor capability type is a tool for describing sensor input device characteristics for the length sensor.

The length sensor characteristic type may include an SIDC basic attribute for the length sensor.

The SIDC basic attribute for the length sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the maximum value the length sensor can measure in length units (eg meters).

The minimum value is the minimum value the length sensor can measure in length units (eg meters).

[Source 9] represents a sensor input device characteristic for a motion sensor using XML (eXtensible Markup Language). However, the program source of [Source 9] below is only one embodiment, and the present invention is not limited thereto.

Source 9

<!-############################################## ##->
<!-SIDCV Motion Sensor CapabilityType->
<!-############################################## ##->
<complexType name = "MotionSensorCapabilityType">
<complexContent>
<extension base = "sidc: SensorCapabilityBaseType">
<sequence>
<element name = "maxAcceleration" type = "float" minOccurs = "0"/>
<element name = "maxVelocity" type = "float" minOccurs = "0"/>
<element name = "maxAngularAcceleration" type = "float" minOccurs = "0"/>
<element name = "maxAngularVelocity" type = "float" minOccurs = "0"/>
<element name = "DOF" type = "cid: DOFType"/>
<element name = "workspace" type = "sidc: workspaceType"/>
</ sequence>
</ extension>
</ complexContent>
</ complexType>

The motion sensor capability type is a tool for describing sensor input device characteristics for a motion sensor.

The motion sensor characteristic type may include an SIDC basic attribute for the motion sensor.

The SIDC basic properties for a motion sensor may include maxAcceleration, maxVelocity, maxAngularAcceleration, maxAngularVelocity, degrees of freedom (DOF), and workspace.

Maximum acceleration is the maximum value that a motion sensor can measure in acceleration units (eg m / s2).

The maximum speed is the maximum value the motion sensor can measure in speed units (eg m / s).

The maximum angular acceleration is the maximum value that the motion sensor can measure in angular acceleration units (eg radian / s2).

The maximum angular velocity is the maximum value that the motion sensor can measure in angular velocity units (eg radian / s).

Degree of freedom is a value that represents a measure of movement.

Workspace is a valid space where each motion sensor can work.

[Source 10] represents a sensor input device characteristic of an intelligent camera sensor using XML (eXtensible Markup Language). However, the program source of [Source 10] below is only one embodiment, and the present invention is not limited thereto.

Source 10

<!-############################################## ##->
<!-SIDCV Intelligent Camera CapabilityType->
<!-############################################## ##->
<complexType name = "IntelligentCameraCapabilityType">
<complexContent>
<extension base = "sidc: SensorCapabilityBaseType">
<sequence>
<element name = "maxBodyFeaturePoint" type = "float" minOccurs = "0"/>
<element name = "maxFaceFeaturePoint" type = "float" minOccurs = "0"/>
<element name = "TrackedFeature" type = "sidc: FeatureType"/>
</ sequence>
</ extension>
</ complexContent>
</ complexType>

The intelligent camera sensor capability type is a tool for describing sensor input device characteristics for intelligent camera sensors.

The intelligent camera sensor characteristic type may include SIDC basic attributes for the intelligent camera motion sensor.

Elements for an intelligent camera motion sensor may include a maximum body feature point (maxBodyFeaturePoint), a maximum face feature point (maxFaceFeaturePoint), and a feature point tracking (TrackedFeature).

The maximum body feature point is the maximum value at which the intelligent camera sensor can track the body feature point.

The maximum facial feature point is the maximum value at which the intelligent camera sensor can track the facial feature point.

Feature point tracking is information on whether the feature points of the body and face can be traced.

User sensory input preferences (USIP) are information for manipulating values received from sensors.

The preference base type is a base type of user's operation information. According to an embodiment, the preference base type may be a base type of metadata regarding user sensor input preferences commonly applied to all sensors as part of metadata about user sensor input preferences. provides a base abstract type for a subset of types defined as part of the sensory device capability metadata types).

Hereinafter, the user sensor input preference and preferred basic type will be described in detail with reference to FIGS. 7 to 9.

7 is a diagram illustrating a preferred basic type according to an embodiment.

Referring to FIG. 7, the preferred base type 700 according to an embodiment may include a USIP base attributes 710 and any attributes 720.

The USIP base attributes 710 are a group of attributes for the user sensory input preferences that are included by default in the preference base type 700.

The optional attribute 720 is a group of additional user sensor input preferences. Any attribute 720 can be a unique additional user sensor input preference that can be applied to any sensor. Any attribute allows for the inclusion of any attributes defined within a namespace other than the target namespace.

8 is a diagram illustrating syntax of a preferred basic type according to an embodiment.

Referring to FIG. 8, the syntax of the preferred basic type 800 according to an embodiment may include a diagram 810, an attribute 820, and a source 830.

Diagram 810 may include a diagram of the preferred base type.

Attributes 820 may include USIP basic attributes and any attributes.

The source 830 may include a program indicating a preferred basic type using eXtensible Markup Language (XML). However, the source 830 shown in FIG. 8 is only one embodiment, and the present invention is not limited thereto.

9 is a diagram illustrating syntax of a USIP basic attribute according to an embodiment.

Referring to FIG. 9, the syntax 900 of the USIP basic attribute may be represented by a diagram 910, an attribute 920, and a source 930.

Diagram 910 may include a table of USIP basic attributes.

Attribute 920 includes adaptation mode 901, activate 902, unit 903, maxValue 904, minValue 905, and resolution (numOflevels) 906.

Adaptation mode 901 is information on how to apply user sensor input preferences to values received from a sensor. According to an embodiment, the adaptation mode 901 may be a user sensor input for an adaptation method for refining and reflecting information on a user's motion, state, intention, shape, etc. of the real world measured by the sensor to the virtual world. Can be.

The active state 902 is information about whether to activate the sensor in the virtual world. Depending on the embodiment, the active state 902 may be a user sensor input preference for determining whether the sensor is operating.

Unit 903 is a unit of values used in the virtual world. For example, the unit 903 may be a pixel. According to an embodiment, the unit 903 may be a unit of a value corresponding to the value received from the sensor.

The maxValue 904 and minValue 905 are the maximum and minimum values of the values used in the virtual world. According to an embodiment, the maxValue 904 and the minValue 905 may be in units of values corresponding to values received from the sensor.

Resolution (numOflevels) 906 is the number of values used in the virtual world. In some embodiments, the value may be a value for dividing the number of steps between the maximum value and the minimum value of the value used in the virtual world.

The USIP basic attributes, the adaptation mode 901, the active state 902, the unit 903, the maximum value 904, the minimum value 905, and the resolution 906 according to an exemplary embodiment, may be summarized as shown in Table 4 below. Can be.

[Table 4]

name Justice Adaptive mode (901) The user's preference on the adaptation method for the virtual world effect. Active state (902) Whether the effect shall be activated. A true value means that the effect is activated, and a pulse value means that the effect is not activated and false means the effect shall be deactivated. Unit (903) The unit of value. Maximum value (904) The maximum desirable value of the effect in percentage according to the max scale defined within the semantics definition of the individual effects. Minimum value (905) The minimum desirable value of the effect in percentage according to the min scale defined within the semantics definition of the individual effects. Resolution (906) The number of value levels that the device can provide in between maximum and minimum value.

The source 930 may include a program indicating a USIP basic attribute using eXtensible Markup Language (XML).

Reference numeral 931 denotes an XML representation of the definition of the active state 902. According to reference numeral 931, active state 902 has data of type “boolean” and may be used as optional.

Reference numeral 932 represents the definition of the maximum value 904 in XML. According to reference numeral 932, the maximum value 904 has data of type “float” and may be used optionally.

Reference numeral 933 denotes the definition of the minimum value 905 in XML. According to reference numeral 933, the minimum value 905 has data of type “float” and may be used as optional.

Reference numeral 934 represents the definition of the resolution 906 in XML. According to reference numeral 934, the resolution 906 has data of type “nonNegativeInteger” and may be used as optional.

However, the source 930 shown in FIG. 9 is only one embodiment, and the present invention is not limited thereto.

Hereinafter, user sensor input preferences for specific embodiments of the sensor will be described.

[Source 11] indicates the user sensor input preference for a position sensor using XML (eXtensible Markup Language). However, the program source of [Source 11] below is only one embodiment, and the present invention is not limited thereto.

Source 11

<!-########################->
<!-USIPV Position Sensor type->
<!-########################->
<complexType name = “PositionSensorType”>
<complexContent>
<extension base = “usip: PreferenceBaseType” />
</ complexContent>
</ complexType>

The position sensor type is a tool for describing the user sensor input preferences for the position sensor.

The location sensor characteristic type may include a USIP basic attribute for the location sensor.

The USIP basic attribute for the position sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the maximum value allowed by the user as the measured value of the position sensor.

The minimum value is the minimum value allowed by the user as the measured value of the position sensor.

Source 12 indicates user sensor input preferences for an orientation sensor using eXtensible Markup Language (XML). However, the program source of [Source 12] below is only one embodiment, and the present invention is not limited thereto.

Source 12

<!-########################->
<!-USIPV Orientation Sensor type->
<!-########################->
<complexType name = “OrientationSensorType”>
<complexContent>
<extension base = “usip: PreferenceBaseType” />
</ complexContent>
</ complexType>

Orientation sensor type is a tool for describing user sensor input preferences for orientation sensors.

The orientation sensor characteristic type may include a USIP basic attribute for the orientation sensor.

The USIP basic attribute for the orientation sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the maximum value allowed by the user as the measured value of the orientation sensor.

The minimum value is the minimum value allowed by the user as the measured value of the orientation sensor.

Source 13 indicates user sensor input preference for an acceleration sensor using eXtensible Markup Language (XML). However, the program source of [Source 13] below is only one embodiment, and the present invention is not limited thereto.

Source 13

<!-########################->
<!-USIPV Acceleration Sensor type->
<!-########################->
<complexType name = “AccelerationSensorType”>
<complexContent>
<extension base = “usip: PreferenceBaseType” />
</ complexContent>
</ complexType>

The acceleration sensor type is a tool for describing the user sensor input preferences for the acceleration sensor.

The acceleration sensor characteristic type may include USIP basic attributes for the acceleration sensor.

The USIP basic attribute for the acceleration sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the maximum value allowed by the user as the measured value of the acceleration sensor.

The minimum value is the minimum value allowed by the user as the measured value of the acceleration sensor.

[Source 14] indicates user sensor input preference for a light sensor using XML (eXtensible Markup Language). However, the program source of [Source 14] below is only one embodiment, and the present invention is not limited thereto.

[Source 14]

<!-########################->
<!-########################->
<!-USIPV Light Sensor type->
<!-########################->
<complexType name = “LightSensorType”>
<complexContent>
<extension base = “usip: PreferenceBaseType” />
<sequence>
<element name = “color” type = “usipv: colorType” minOccurs = “0”
maxOccurs = “unbounded”>
</ sequence>
</ extension>
</ complexContent>
</ complexType>

The light sensor type is a tool for describing user sensor input preferences for light sensors.

The light sensor characteristic type may include USIP basic attributes for the light sensor.

The USIP basic attribute for the light sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the maximum value allowed by the user as the measured value of the light sensor.

The minimum value is the minimum value allowed by the user as the measured value of the light sensor.

The color value represents a color that the user allows among the colors that may enter the light sensor.

Source 15 indicates user sensor input preference for a sound sensor using XML (eXtensible Markup Language). However, the program source of [Source 15] below is only one embodiment, and the present invention is not limited thereto.

Source 15

<!-########################->
<!-USIPV Sound Sensor type->
<!-########################->
<complexType name = “SoundSensorType”>
<complexContent>
<extension base = “usip: PreferenceBaseType” />
</ complexContent>
</ complexType>

The sound sensor type is a tool for describing user sensor input preferences for voice sensors.

The voice sensor characteristic type may include a USIP basic attribute for the voice sensor.

The USIP basic attribute for the voice sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the maximum value allowed by the user as the measured value of the voice sensor.

The minimum value is the minimum value allowed by the user as the measured value of the voice sensor.

[Source 16] shows the user sensor input preference for the temperature sensor using XML (eXtensible Markup Language). However, the program source of [Source 16] below is only one embodiment, and the present invention is not limited thereto.

[Source 16]

<!-########################->
<!-USIPV Temperature Sensor type->
<!-########################->
<complexType name = “TempratureSensorType”>
<complexContent>
<extension base = “usip: PreferenceBaseType” />
</ complexContent>
</ complexType>

The temperature sensor type is a tool for describing user sensor input preferences for temperature sensors.

The temperature sensor characteristic type may include USIP basic attributes for the temperature sensor.

The USIP basic attribute for the temperature sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the maximum value allowed by the user as measured by the temperature sensor.

The minimum value is the measured value of the temperature sensor and the minimum value allowed by the user.

[Source 17] shows user sensor input preference for a humidity sensor using eXtensible Markup Language (XML). However, the program source of [Source 17] below is only one embodiment, and the present invention is not limited thereto.

[Source 17]

<!-########################->
<!-USIPV Humidity Sensor type->
<!-########################->
<complexType name = “HumiditySensorType”>
<complexContent>
<extension base = “usip: PreferenceBaseType” />
</ complexContent>
</ complexType>

The humidity sensor type is a tool for describing the user sensor input preferences for the humidity sensor.

The humidity sensor characteristic type may include USIP basic attributes for the humidity sensor.

The USIP basic attribute for the humidity sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the measured value of the humidity sensor and the maximum value allowed by the user.

The minimum value is the minimum value allowed by the user as measured by the humidity sensor.

[Source 18] shows the user sensor input preference for the length sensor using eXtensible Markup Language (XML). However, the program source of [Source 18] below is only one embodiment, and the present invention is not limited thereto.

[Source 18]

<!-########################->
<!-USIPV Length Sensor type->
<!-########################->
<complexType name = “LengthSensorType”>
<complexContent>
<extension base = “usip: PreferenceBaseType” />
</ complexContent>
</ complexType>

The length sensor type is a tool for describing user sensor input preferences for length sensors.

The length sensor characteristic type may include a USIP basic attribute for the length sensor.

The USIP basic attribute for the length sensor may include a maximum value (maxValue) and a minimum value (minValue).

The maximum value is the maximum value allowed by the user as the measured value of the length sensor.

The minimum value is the measured value of the length sensor and the minimum value allowed by the user.

[Source 19] indicates user sensor input preference for a motion sensor using XML (eXtensible Markup Language). However, the program source of [Source 19] below is only one embodiment, and the present invention is not limited thereto.

Source 19

<!-############################################## ##->
<!-USIP Motion Sensor Command Type->
<!-############################################## ##->
<complexType name = "MotionSensorPreferenceType">
<complexContent>
<extension base = "usip: SensorPreferenceBaseType">
<sequence>
<element name = "maxAcceleration" type = "float" minOccurs = "0"/>
<element name = "maxVelocity" type = "float" minOccurs = "0"/>
<element name = "maxAngularAcceleration" type = "float" minOccurs = "0"/>
<element name = "maxAngularVelocity" type = "float" minOccurs = "0"/>
<element name = "DOF" type = "cid: DOFType"/>
<element name = "workspace" type = "usip: workspaceType"/>
</ sequence>
</ extension>
</ complexContent>
</ complexType></complexType>

The motion sensor capability type is a tool for describing user sensor input preferences for motion sensors.

The motion sensor characteristic type may include a USIP basic attribute for the motion sensor.

USIP basic attributes for motion sensors may include maxAcceleration, maxVelocity, maxAngularAcceleration, maxAngularVelocity, degrees of freedom (DOF), and workspace.

The maximum acceleration is the maximum value allowed by the user in the acceleration unit (eg m / s2) of the motion sensor.

The maximum speed is the maximum value allowed by the user in speed units (eg m / s) of the motion sensor.

The maximum angular acceleration is the maximum value allowed by the user in the angular acceleration unit of the motion sensor (eg radian / s2).

The maximum angular velocity is the maximum value allowed by the user in angular velocity units (eg radian / s) of the motion sensor.

Degree of freedom is a measure of freedom allowed by the user as a measure of movement.

Workspace is the effective space allowed by the user to work with each motion sensor.

[Source 20] indicates user sensor input preference for an intelligent camera sensor using XML (eXtensible Markup Language). However, the program source of [Source 20] below is only one embodiment, and the present invention is not limited thereto.

[Source 20]

<!-############################################## ##->
<!-USIPV Intelligent Camera CapabilityType->
<!-############################################## ##->
<complexType name = "IntelligentCameraCapabilityType">
<complexContent>
<extension base = "usip: SensorCapabilityBaseType">
<sequence>
<element name = "maxBodyFeaturePoint" type = "float" minOccurs = "0"/>
<element name = "maxFaceFeaturePoint" type = "float" minOccurs = "0"/>
<element name = "TrackedFeature" type = "usip: FeatureType"/>
</ sequence>
</ extension>
</ complexContent>
</ complexType>

The intelligent camera sensor capability type is a tool for describing user sensor input preferences for intelligent camera sensors.

The intelligent camera sensor characteristic type may include a USIP basic attribute for the intelligent camera motion sensor.

The USIP basic attributes for the intelligent camera motion sensor may include a maximum body feature point (maxBodyFeaturePoint), a maximum face feature point (maxFaceFeaturePoint), and a feature point tracking (TrackedFeature).

The maximum body feature point is the maximum value that allows the user to track the body feature points of the intelligent camera sensor.

The maximum facial feature point is the maximum value that allows the user to track the facial feature point of the intelligent camera sensor.

Feature point tracking is information on whether the feature points of the body and face can be traced.

According to an embodiment, the virtual world processing apparatus may include sensory input device commands (SIDCmd).

Sensory input device commands (SIDCmd) are commands that control the sensor. According to an embodiment, the sensor input device command may be a command for controlling the sensor in order to reflect the information about the motion, state, intention, shape, etc. of the user of the real world measured by the sensor in the virtual world.

According to an embodiment, the sensor input device command SIDCmd may be the root component of metadata for the sensor input device command (SIDCmd serves as the root element for sensory input device commands metadata).

Hereinafter, the sensor input device command will be described in detail with reference to FIGS. 10 to 13.

10 illustrates a type of sensor input device command according to an embodiment.

Referring to FIG. 10, a type 1000 of sensor input device command according to one embodiment may include a device command 1001, a group of commands 1002, and any attributes ( 1010).

Device command 1001 is a command for controlling a single sensor.

The command group 1002 is a command for controlling a plurality of sensors.

The optional attribute 1010 is a group of additional sensor input device commands. Depending on the embodiment, any attribute 1010 may be a unique additional control instruction that can control any sensor. Any attributes allows for the inclusion of any attributes defined within a namespace other than the target namespace.

11 is a diagram illustrating syntax of a sensor input device command according to an exemplary embodiment.

Referring to FIG. 11, the syntax 1100 of a sensor input device command according to an embodiment may include a diagram 1110, a child layer 1120, an attribute 1130, and a source 1140.

Diagram 1110 may include a diagram for the type of sensor input device command.

The lower layer 1120 may include a device command and a group of commands.

Attribute 1130 may include any attributes.

The source 1140 may include a program representing a sensor input device command using an XML (eXtensible Markup Language).

However, the source 1140 shown in FIG. 11 is only one embodiment, and the present invention is not limited thereto.

12A and 12B illustrate syntax of a device command basic type according to an embodiment.

12A and 12B, syntax of a device command basic type according to an embodiment may be represented by a diagram 1210, an attribute 1220, and a source 1230.

The device command base type is the base type of device command. According to an embodiment, the device command base type may be a base type of metadata about a device command that is commonly applied to all sensors as part of metadata about a sensor input device command for a single sensor ( device command base type provides a base abstract type for a subset of types defined as part of the sensory device commands metadata types).

According to an embodiment, the device command base type may include SIDCmd base attributes and any attributes.

SIDCmd Base Attributes describes a group of attributes for the commands.

An optional attribute is a group of additional device commands. Any attribute can be a unique additional device command that can be applied to any sensor. Any attribute provides an extension mechanism for including attributes from namespaces other than the target namespace.

Diagram 1210 may include a table of device command basic types.

Attribute 1220 may include id 1201, idref (id reference) 1202, activate 1203, value 1204, linked list 1205, time stamp. stamp 1206 and Life Span 1207.

id 1201 is ID information for identifying an individual identity of a sensor.

idref 1202 is additional information about the id for identifying the individual identity of the sensor.

The active state 1203 is information for determining whether the sensor is in operation.

Value 1204 is a sensor measurement. According to an embodiment, the value 1204 may be a value received from a sensor.

The connection list 1205 is link information for grouping several sensors.

The time stamp 1206 is time information when the sensor senses.

The valid period 1207 is information about the valid period of the sensor command. According to an embodiment, the validity period 1207 may be in seconds.

According to an embodiment, an attribute of the device command basic type, id 1201, idref (id reference) 1202, activate 1203, value 1204, and linked list ( 1205, time stamp 1206, and life span 1207 can be summarized as shown in Table 5 below.

TABLE 5

name Justice Id (1201) The id of the SIDCmdBaseType. Idref (1202) Elements that have an instantiated attribute of type ID. Active state (1203) Whether the effect shall be activated. A true value means that the effect is activated, and a pulse value means that the effect is not activated and false means the effect shall be deactivated. Value (1204) The value of the effect in percentage according to the max scale defined within the semantics definition of the individual effects. Linked list (1205) Grouping sensor structure that consists of a group of sensors such that in each record there is a field that contains a reference (id) to the next sensor. Time stamp (1206) Time information when the sensor senses. Validity period (1207) Expiration date information of sensor command (expiration date display in time stamp, in seconds).

The source 1230 may include a program indicating a basic type of a device command using eXtensible Markup Language (XML).

Reference numeral 1231 denotes an XML representation of the definition of the active state 1203. According to reference numeral 1231, the active state 1203 has data of type “boolean” and may be used optionally.

Reference numeral 1232 denotes an XML representation of the definition of the value 1204. According to reference numeral 1232, the value 1204 has data of type “float” and may be used as optional.

However, the source 1230 shown in FIG. 12B is only one embodiment, and the present invention is not limited thereto.

13 is a diagram illustrating syntax of a command group basic type according to an embodiment.

Referring to FIG. 13, the syntax of a command group basic type 1300 according to an embodiment may be represented by a diagram 1310, a child layer 1320, an attribute 1330, and a source 1340.

The group of command base type is the base type of command group. According to an embodiment, the command group primitive type may be a basic type of metadata regarding a command group commonly applied to all sensors as part of metadata about a sensor input device command for a plurality of sensors. .

According to an embodiment, the command group base type may include SIDCmd base attributes and any attributes.

The SIDCmd base attribute is a group of command groups included by default in the command group base type.

An optional attribute is a group of additional command groups. Any attribute may be a unique additional instruction group that can be applied to any sensor. Any attribute may include additional command groups in the namespace.

[Source 21] shows a sensor input device command for a position sensor using XML (eXtensible Markup Language). However, the program source of [Source 21] below is only one embodiment, and the present invention is not limited thereto.

Source 21

<!-SCmd Position Sensor type->
<!-########################->
<complexType name = “PositionSensorType”>
<complexContent>
<extension base = “cid: SCmdBaseType” />
</ complexContent>
</ complexType>

The position sensor command type is a tool for describing sensor input device commands for position sensors.

[Source 22] indicates an sensor input device command for an orientation sensor using eXtensible Markup Language (XML). However, the program source of [Source 22] below is only one embodiment, and the present invention is not limited thereto.

Source 22

<!-########################->
<!-SCmd Orientation Sensor type->
<!-########################->
<complexType name = “OrientationSensorType”>
<complexContent>
<extension base = “cid: SCmdBaseType” />
</ complexContent>
</ complexType>

The orientation sensor command type is a tool for describing sensor input device commands for an orientation sensor.

[Source 23] illustrates an sensor input device command for an acceleration sensor using XML (eXtensible Markup Language). However, the program source of [Source 23] below is only one embodiment, and the present invention is not limited thereto.

[Source 23]

<!-########################->
<!-SCmd Acceleration Sensor type->
<!-########################->
<complexType name = “AccelerationSensorType”>
<complexContent>
<extension base = “cid: SCmdBaseType” />
</ complexContent>
</ complexType>

The acceleration sensor command type is a tool for describing sensor input device commands for an acceleration sensor.

[Source 24] illustrates a sensor input device command for a light sensor using XML (eXtensible Markup Language). However, the program source of [Source 24] below is only one embodiment, and the present invention is not limited thereto.

[Source 24]

<!-########################->
<!-########################->
<!-SCmd Light Sensor type->
<!-########################->
<complexType name = “LightSensorType”>
<complexContent>
<extension base = “cid: SCmdBaseType” />
<sequence>
<element name = “color” type = “SCmd: colorType” minOccurs = “0”
maxOccurs = “unbounded”>
</ sequence>
</ extension>
</ complexContent>
</ complexType>

The light sensor command type is a tool for describing sensor input device commands for light sensors.

Source 25 illustrates a sensor input device command for a sound sensor using XML (eXtensible Markup Language). However, the program source of [Source 25] below is only one embodiment, and the present invention is not limited thereto.

[Source 25]

<!-########################->
<!-SCmd Sound Sensor type->
<!-########################->
<complexType name = “SoundSensorType”>
<complexContent>
<extension base = “cid: SCmdBaseType” />
</ complexContent>
</ complexType>

The sound sensor command type is a tool for describing sensor input device commands for a voice sensor.

[Source 26] illustrates a sensor input device command for a temperature sensor using XML (eXtensible Markup Language). However, the program source of [Source 26] below is only one embodiment, and the present invention is not limited thereto.

Source 26

<!-########################->
<!-SCmd Temperature Sensor type->
<!-########################->
<complexType name = “TempratureSensorType”>
<complexContent>
<extension base = “cid: SCmdBaseType” />
</ complexContent>
</ complexType>

The temperature sensor command type is a tool for describing sensor input device commands for temperature sensors.

Source 27 illustrates a sensor input device command for a humidity sensor using XML (eXtensible Markup Language). However, the program source of [Source 27] below is only one embodiment, and the present invention is not limited thereto.

[Source 27]

<!-########################->
<!-SCmd Humidity Sensor type->
<!-########################->
<complexType name = “HumiditySensorType”>
<complexContent>
<extension base = “cid: SCmdBaseType” />
</ complexContent>
</ complexType>

The humidity sensor command type is a tool for describing sensor input device commands for the humidity sensor.

[Source 28] shows a sensor input device characteristic for a length sensor using eXtensible Markup Language (XML). However, the program source of [Source 28] below is only one embodiment, and the present invention is not limited thereto.

Source 28

<!-########################->
<!-SCmd Length Sensor type->
<!-########################->
<complexType name = “LengthSensorType”>
<complexContent>
<extension base = “cid: SCmdBaseType” />
</ complexContent>
</ complexType>

The length sensor command type is a tool for describing sensor input device commands for length sensors.

Source 29 indicates a sensor input device command to a motion sensor using XML (eXtensible Markup Language). However, the program source of [Source 29] below is only one embodiment, and the present invention is not limited thereto.

Source 29

<!-############################################## ##->
<!-Definition of Motion Sensor Command Type->
<!-############################################## ##->
<complexType name = "MotionSensorType">
<complexContent>
<extension base = "cid: SensorCommandBaseType">
<sequence>
<choice>
<choice>
<element name = "Position" type = "cid: vectorType" minOccurs = "0"/>
<element name = "Velocity" type = "cid: vectorType" minOccurs = "0"/>
<element name = "Acceleration" type = "cid: vectorType" minOccurs = "0"/>
</ choice>
<choice>
<element name = "Orientation" type = "cid: RotationType" minOccurs = "0"/>
<element name = "AngularVelocity" type = "cid: RotationType" minOccurs = "0"/>
<element name = "AngularAcceleration" type = "cid: RotationType" minOccurs = "0"/>
</ choice>
</ choice>
</ sequence>
</ extension>
</ complexContent>
</ complexType>

The motion sensor command type is a tool for describing sensor input device commands for motion sensors.

Source 30 represents a sensor input device command for an intelligent sensor using XML (eXtensible Markup Language). However, the program source of [Source 30] below is only one embodiment, and the present invention is not limited thereto.

[Source 30]

<!-############################################## ##->
<!-Definition of Intelligent Camera Command Type->
<!-############################################## ##->
<complexType name = "IntelligentCameraType">
<complexContent>
<extension base = "cid: SensorCommandBaseType">
<sequence>
<element name = "FaceFeature" type = "cid: vectorType" minOccurs = "0"/>
<element name = "BodyFeature" type = "cid: vectorType" minOccurs = "0"/>
</ sequence>
</ extension>
</ complexContent>
</ complexType>

The intelligent camera sensor command type is a tool for describing sensor input device commands for intelligent camera sensors.

Diagram 1310 may include a table of command group basic types.

The lower layer 1320 may include a device command.

Attribute 1330 includes id 1301, idref (id reference) 1302, activate 1303, value 1304, linked list 1305 time stamp. 1306 and life span 1307.

id 1301 is ID information for identifying an individual identity of a sensor.

The idref 1302 is additional information on the id for identifying the individual identity of the sensor.

The active state 1303 is information for determining whether the sensor is in operation.

Value 1304 is a sensor measurement. In some embodiments, the value may be a value received from a sensor.

The connection list 1305 is link information for grouping several sensors.

The time stamp 1306 is time information when the sensor senses.

The life span 1307 is time information indicating a valid period of a sensor command.

14 is a flowchart of a virtual world processing method, according to an exemplary embodiment.

Referring to FIG. 14, the virtual world processing method according to an embodiment may store sensor input device characteristics related to characteristics of a sensor (S1410).

In operation S1420, the first value received from the sensor may be determined based on the characteristic of the sensor input device, and the second value corresponding to the first value may be transmitted to the virtual world (S1420).

According to an embodiment, the sensor input device characteristic may include a maximum value and a minimum value that the sensor can measure. The virtual world processing method may transfer a second value corresponding to the first value to the virtual world when the first value is less than or equal to the maximum value and greater than or equal to the minimum value.

According to an embodiment, the sensor input device characteristic may include a unit of a first value measured by the sensor. Also, the sensor input device characteristic may include an offset value added to the first value measured by the sensor to obtain an absolute value. In addition, the sensor input device characteristic may include the number of values that the sensor can measure. In addition, the sensor input device characteristic may include a minimum input value required for the sensor to measure the output value. In addition, the sensor input device characteristic may include the SNR of the sensor. In addition, the sensor input device characteristic may include an error of the sensor. In addition, sensor input device characteristics may include the location of the sensor.

The virtual world processing method according to an embodiment may further include storing user sensor input preferences for manipulating the first value received from the sensor (not shown), wherein the delivering step comprises sensor input device characteristics. Generate a third value from the first value based on the second value, and generate a second value from the third value based on the user sensor input preference.

According to an embodiment, the user sensor input preferences may include information about how to apply the user sensor input preferences to the first value. In addition, the user sensor input preference may include information on whether to activate the sensor in the virtual world. In addition, the user sensor input preference may include a unit of a second value used in the virtual world. Also, the user sensor input preference may include a maximum value and a minimum value of the second value used in the virtual world. In addition, the user sensor input preference may include the number of second values used in the virtual world.

15 is a flowchart of a virtual world processing method according to another exemplary embodiment.

Referring to FIG. 15, in the virtual world processing method according to an embodiment, an initial setting may be performed to receive information of a real world from a sensor in operation S1510. According to an embodiment, the step S1510 of initial setting may be an operation of activating a sensor.

In operation S1520, the sensor input device characteristic SIDC, which is information about the characteristic of the sensor, and the user sensor input preference USIP, which is information for manipulating a value received from the sensor, may be stored.

In addition, the sensor may measure information about a user's motion, state, intention, shape, etc. of the real world through the sensor (S1530). If the sensor fails to measure information about a user's motion, status, intention, shape, etc. of the real world, step S1530 may be repeated until the information is measured.

In addition, when measuring information on the motion, state, intention, shape, etc. of the user of the real world through the sensor, it is possible to apply the preprocessing (S1540) for the information (S1540).

In addition, the sensor may be controlled using the sensor input device command SIDCmd, which is a command for controlling the sensor (S1550).

In addition, the adaptive RV may determine the first value received from the sensor based on the sensor input device characteristic SIDC and transmit a second value corresponding to the first value to the virtual world (S1560). According to an embodiment, a third value is generated from the first value based on a sensor input device characteristic (SIDC), a second value is generated from the third value based on a user sensor input preference (USIP), and the second value is generated. You can pass 2 values to the virtual world.

16 is a diagram illustrating an operation of using a virtual world processing apparatus, according to an exemplary embodiment.

Referring to FIG. 16, a user 1610 in the real world may input his or her intention using the sensor 1601 according to an embodiment. According to an embodiment, the sensor 1601 is a motion sensor that measures the motion of the user 1610 in the real world and the direction and position pointed to by the arm and leg tip to be worn at the end of the arm and leg of the user 1610. It may include a remote pointer (measured by the remote pointer).

Control information (CI) 1602 regarding an operation of spreading arms of the user 1610 in the real world input through the sensor 1601, standing position, position of hands and feet, and angle of open hands The sensor signal including the may be transmitted to the virtual world processing apparatus.

According to an embodiment, the control information 1602 may include a sensor input device characteristic (SIDC), a user sensor input preference (USIP), and a sensor input device command (SIDCmd).

According to an embodiment, the control information 1602 may determine positional information about the arm and leg of the user 1610 from X _real , Y _real , and Z _real values, which are values of the x, y, and z axes, and the x, y, and z axes. It can be represented as Θ _Xreal , Θ _Yreal , and Θ _Zreal values.

The virtual world processing apparatus according to an embodiment may include an RV engine 1620. The RV engine 1620 may convert information of the real world into information applicable to the virtual world using the control information 1602 included in the sensor signal.

According to an embodiment, the RV engine 1620 may convert the virtual world information (VWI) 1603 using the control information 1602.

The VWI 1603 is information about the virtual world. For example, the VWI 1603 may include information about an object of a virtual world or elements constituting the object.

According to an embodiment, the VWI 1603 may include virtual world object information 1604 and avatar information 1605.

The virtual world object information 1604 is information about an object of the virtual world. According to an embodiment, the virtual world object information 1604 is an object which is ID information for identifying the identity of the object of the virtual world and an object which is information for controlling the state, size, etc. of the object of the virtual world. It may include object control / scale.

According to an embodiment, the virtual world processing apparatus may control the virtual world object information 1604 and the avatar information 1605 by a control command. The control command may include a command such as create, destroy, copy, and the like. The virtual world processing apparatus may generate a command by selecting which of the virtual world object information 1604 or the avatar information 1605 together with the control command, and specifying an ID of the selected information.

[Source 31] shows a method of constructing a control command using XML (eXtensible Markup Language). However, the program source of [Source 31] below is only one embodiment, and the present invention is not limited thereto.

 Source 31

<!-############################################## ##->
<!-Definition of Control command for Avatar and virtual object->
<!-############################################## ##->
<complexType name = "ControlCommand">
<SimpleContent>
<attribute name = "command" type = "cid: commandType" use = "required"/>
<attribute name = "Object" type = "cid: ObjectType" use = "required"/>
<attribute name = "ObjectID" type = "ID" use = "optional"/>
</ SimpleContent>
</ complexType>

<simpleType name = "commandType">
<restriction base = "string">
<enumeration value = "Create"/>
<enumeration value = "Remove"/>
<enumeration value = "Copy"/>
</ restriction>
</ simpleType>

<simpleType name = "ObjectType">
<restriction base = "string">
<enumeration value = "Avatar"/>
<enumeration value = "VirtualObject"/>
</ restriction>
</ simpleType>

The RV engine 1620 uses the control information 1602 to apply the information about the operation of spreading arms to the VWI 1603, standing position, position of the hands and feet, and the angle of the hands. Can be converted.

The RV engine 1620 may transmit the converted information about the VWI 1606 to the virtual world. According to an embodiment, the transformed VWI information 1606 may include position information about the arms and legs of the avatar of the virtual world, including X _virtual , Y _virtual , Z _virtual values, x, y, It can be represented as Θ _Xvirtual , Θ _Yvirtual , Θ _{Zvirtual which are the} values of the angle with the z axis. In addition, the information about the size of the object of the virtual world may be represented by a scale (w, d, h) _virtual value that is a value of the width, height, and depth of the object.

According to an embodiment, in the virtual world 1630 before receiving the transformed VWI information 1606, the avatar is holding an object, and after receiving the transformed VWI information 1606, the virtual world ( In 1640, the avatar of the virtual world scales up the object by spreading the arms of the user 1610 in the real world, including the open arms, the standing position, the position of the hands and feet, and the angle of the open hands. ) can do.

That is, when the user 1610 in the real world takes a motion to grab and enlarge an object, the motion of the user 1610 in the real world through the sensor 1601, the standing position, the position of the hands and feet, Control information 1602 regarding the angle at which the hand is open may be generated. In addition, the RV engine 1620 may convert the control information 1602 about the user 1610 of the real world, which is data measured in the real world, into information applicable to the virtual world. The converted information is applied to the structure of the information about the avatar and the object in the virtual world, so that the avatar is held and opened, and the object can be enlarged in size.

Embodiments according to the present invention can be implemented in the form of program instructions that can be executed by various computer means can be recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the claims below but also by the equivalents of the claims.

1 is a diagram illustrating an operation of manipulating an object of a virtual world using a sensor according to an embodiment of the present invention.

2 is a diagram illustrating a system for manipulating an object of a virtual world using a sensor according to an embodiment of the present invention.

3 is a diagram illustrating a configuration of a virtual world processing apparatus according to an embodiment of the present invention.

4 illustrates a characteristic basic type according to an embodiment of the present invention.

5 is a diagram illustrating syntax of a capability base type according to an embodiment of the present invention.

6 is a diagram illustrating syntax of SIDC base attributes according to an embodiment of the present invention.

7 is a diagram illustrating a preferred basic type according to an embodiment of the present invention.

8 is a diagram illustrating syntax of a preferred basic type according to an embodiment of the present invention.

9 is a diagram illustrating syntax of a USIP basic attribute according to an embodiment of the present invention.

10 is a diagram illustrating a type of sensor input device command according to an embodiment of the present invention.

11 is a diagram illustrating syntax of a sensor input device command according to an embodiment of the present invention.

12A and 12B illustrate syntax of a device command basic type according to an embodiment of the present invention.

13 is a diagram illustrating syntax of a command group basic type according to an embodiment of the present invention.

14 is a flowchart illustrating a virtual world processing method according to an embodiment of the present invention.

15 is a flowchart illustrating a virtual world processing method according to another embodiment of the present invention.

16 is a view illustrating an operation using a virtual world processing apparatus according to an embodiment of the present invention.

Claims (22)

Storing sensor input device characteristics relating to characteristics of the sensor; And Determining a first value received from the sensor based on the sensor input device characteristic and transferring a second value corresponding to the first value to the virtual world Virtual world processing method comprising a. The method of claim 1, wherein the sensor input device characteristics, And a maximum value and a minimum value that the sensor can measure. The method of claim 2, And if the first value is less than or equal to the maximum value and greater than or equal to the minimum value, transferring the second value corresponding to the first value to the virtual world. The method of claim 1, wherein the sensor input device characteristics, And a unit of the first value measured by the sensor. The method of claim 1, wherein the sensor input device characteristics, And an offset value added to the first value measured by the sensor to obtain an absolute value. The method of claim 1, wherein the sensor input device characteristics, And a number of values that can be measured by the sensor. The method of claim 1, wherein the sensor input device characteristics, And wherein the sensor comprises a minimum input value required for measuring the output value. The method of claim 1, wherein the sensor input device characteristics, And a SNR of the sensor. The method of claim 1, wherein the sensor input device characteristics, Virtual world processing method comprising the error of the sensor. The method of claim 1, wherein the sensor input device characteristics, And a position of the sensor. The method of claim 1, wherein the sensor, And at least one of a position sensor, an orientation sensor, an acceleration sensor, an optical sensor, a voice sensor, a temperature sensor, a humidity sensor, and a length sensor. The method of claim 1, Storing a user sensor input preference for manipulating the first value received from the sensor More, The delivering may generate a third value from the first value based on the sensor input device characteristic, And generating the second value from the third value based on the user sensor input preferences. The method of claim 12, wherein the user sensor input preferences, And information about how to apply the user sensor input preference to the first value. The method of claim 12, wherein the user sensor input preferences, And processing information about whether to activate the sensor in the virtual world. The method of claim 12, wherein the user sensor input preferences, And a unit of said second value used in said virtual world. The method of claim 12, wherein the user sensor input preferences, And a maximum value and a minimum value of the second value used in the virtual world. The method of claim 12, wherein the user sensor input preferences, And a number of the second values used in the virtual world. A computer-readable recording medium having recorded thereon a program for performing the method of any one of claims 1 to 17. A storage unit to store sensor input device characteristics related to the characteristics of the sensor; And A processor configured to determine a first value received from the sensor based on the sensor input device characteristic and to transmit a second value corresponding to the first value to the virtual world Virtual world processing device comprising a. The method of claim 19, wherein the sensor input device characteristics, The maximum and minimum values the sensor can measure; A unit of the first value measured by the sensor; An offset value added to the first value measured by the sensor to obtain an absolute value; The number of values the sensor can measure; A minimum input value the sensor requires for measuring an output value; SNR of the sensor; Error of the sensor; And Position of the sensor A virtual world processing device comprising at least one of the. The method of claim 19, A second storage unit for storing a user sensor input preference for manipulating the first value received from the sensor More, And the processing unit generates a third value from the first value based on the sensor input device characteristic, and generates the second value from the third value based on the user sensor input preference. The method of claim 21, wherein the user sensor input preferences, Information on whether to apply the user sensor input preference to the first value; Information about whether to activate the sensor in the virtual world; A unit of the second value used in the virtual world; Maximum and minimum values of the second value used in the virtual world; And Number of the second value used in the virtual world A virtual world processing device comprising at least one of the.

Images