KR100871840B1 - Ubiquitous home media service apparatus and method based single media multi device, and home media service system and method using it - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

The present invention relates to an SMMD-based ubiquitous home media service apparatus, a method thereof, and a home media service system using the same.

2. The technical problem to be solved by the invention

The present invention creates a new structure of media (ne-media) that can add device control and synchronization information for a sensory service to an existing media consisting of video, audio, and text, and creates an individual on the generated ne-media. By inputting the sensory reproduction information suitable for the user's taste and surrounding device environment, and then transmitting it to the peripheral device, devices with various functions of the surrounding area regardless of the physical location of the user such as home, office, and public places are autonomously through ne-media. The purpose of the present invention is to provide a device and method for SMMD-based ubiquitous home media service that can provide a realistic media service to users, and a home media service system and method using the same.

3. Summary of Solution to Invention

The present invention provides an SMMD-based ubiquitous home media service apparatus, comprising: user interface means for receiving ne-media from an external ne-media providing server; Ne-media processing means for separating the received ne-media into software data for playing sensory information, media, synchronization and control information, and location information; Device control and synchronizing means for collecting device information to generate peripheral device groups to interoperate, generating a synchronization signal between the media and the peripheral device using the separated ne-media synchronization information, and then recording them on the ne-media ; Network management means for transmitting ne-media from the device control and synchronization means to a peripheral device; And ne-media reproduction means for reproducing the media separated by the ne-media processing means in synchronization with the peripheral device receiving the ne-media.

4. Important uses of the invention

The present invention is used for home media services and the like.

SMMD, ubiquitous, ne-media, realistic service, device control and synchronization information, location information

Description

SMB-based ubiquitous home media service apparatus and method, and home media service system using same and method thereof TECHNICAL FIELD AND METHOD BASED SINGLE MEDIA MULTI DEVICE, AND HOME MEDIA SERVICE SYSTEM AND METHOD USING IT}

1 is a structural diagram of an embodiment of a ne-media reference model according to the present invention;

2 is an exemplary view showing a data structure for ne-media according to the present invention;

3 is a block diagram of an embodiment of an SMMD-based ubiquitous home media service device according to the present invention;

4 is a configuration diagram of a database of a SMMD-based ubiquitous home media service apparatus according to the present invention;

5 is a configuration diagram of a user interface of an SMMD-based ubiquitous home media service apparatus according to the present invention;

6 is a diagram illustrating an embodiment of a ne-media processing manager of an SMMD-based ubiquitous home media service apparatus according to the present invention;

7 is a configuration diagram of an ne-media reproduction manager of an SMMD-based ubiquitous home media service apparatus according to the present invention;

8 is a diagram illustrating an embodiment of a device control and synchronization manager of an SMMD-based ubiquitous home media service device according to the present invention;

9 is a configuration diagram of a network manager of an SMMD-based ubiquitous home media service device according to the present invention;

10 is a configuration diagram of a sensor manager of an SMMD-based ubiquitous home media service device according to the present invention;

11 is a configuration diagram of an embodiment of a situation awareness and processing manager of an SMMD-based ubiquitous home media service apparatus according to the present invention;

12 is a configuration diagram of an embodiment of a resource sharing manager of an SMMD-based ubiquitous home media service apparatus according to the present invention;

13 is a configuration diagram of an embodiment of a reproduction assistance apparatus according to the present invention;

14 is a configuration diagram of an embodiment of a reproduction apparatus according to the present invention;

15 is a flowchart illustrating an embodiment of a method for SMMD-based ubiquitous home media service according to the present invention.

* Explanation of symbols for the main parts of the drawings

300: database 310: user interface

320: ne-media processing manager 330: ne-media reproduction manager

340 device control and synchronization manager 350 network manager

360: Sensor Manager

370: Situational Awareness and Processing Manager

380 Resource Sharing Manager

The present invention relates to an SMMD-based ubiquitous home media service apparatus, a method thereof, a home media service system using the same and a method thereof, and more particularly, to control and synchronize a device for a sensory service on an existing media consisting of video, audio, and text. By creating a new structure of media (ne-media) to add information, and inputting the sensory reproduction information according to the personal preferences and surrounding device environment to the generated ne-media, the home, SMMD-based ubiquitous home media service apparatus and method that can provide realistic media services to users by autonomously fusion through ne-media regardless of the physical location of users such as offices and public places. Home media service system and method using the same It is about.

In the present invention, the media service device may be implemented in a set-top box, digital television (DTV), or the like in a home, and may be implemented in a smart phone, a personal digital assistant (PDA), a portable multimedia player (PMP), or the like while moving.

In the era of ubiquitous information technology (IT), realistic technology that satisfies the human senses and intelligent technology based on autonomous collaboration between devices will be applied to the media. In order to implement such a technique, it is difficult to implement the method of reproducing media in one device. In other words, it is possible to operate the device according to the information of the media and the various devices and media to create a sense of reality.

Current media services are mainly based on SMSD (Single Media Single Device) service, in which one media is reproduced on one device. However, in order to maximize the effect of media reproduction in the ubiquitous home, one media is connected to multiple devices. It should be a service based on SMMD (Single Media Multi Devices) reproduced by interworking.

Already, Microsoft is working on "Easy Living" project to develop prototype structure and technology to build intelligent environment, while at Sony and Intel, service and content can be customized. We are developing a technology to implement the provided ubiquitous home.

In Korea, the development of key solutions for ubiquitous computing implementation of "Digital Home" and "LG CNS", the residential environment connected to Samsung's smart home in relation to digital home and ubiquitous IT, and the ubiquitous base of "Daelim I & S" The digital home (apartment) business is being promoted, and KT and SKT are promoting commercial services such as simple home appliance control, home auto, IPTV, and TV portals.

However, such development has only considered the portability of media using information and communication networks such as DMB and Wibro without the effective reproduction of media, and since expensive digital devices developed for the digital home do not provide mobility, Evolution is difficult

Realistic / intelligent ubiquitous home technology requires a variety of advanced technologies such as wired / wireless home network technology, interworking / collaboration technology, device synchronization / control technology, situational awareness technology, device location / identification / authentication technology. Competition between countries will intensify.

In order to realize realistic / intelligent ubiquitous home media service, media must be reproduced with various digital devices, but it cannot be implemented by the existing media reproduction method or digital device operation method.

Media in the ubiquitous era will evolve from media such as video, voice, and text to evolved media such as reality and hologram, and can be reproduced through any device anytime, anywhere.

While pursuing interactive services or customized services using a variety of additional information (metadata) added to the media at the moment, mobile phones, PDAs, PMPs, etc. Killer applications via devices are emerging.

The next required technology will be ubiquitous home media service technology that can maximize media reproduction effect anytime, anywhere and any device of ubiquitous concept.

The present invention has been proposed to meet the above requirements, and creates a new structure of media (ne-media) that can add device control and synchronization information for realistic service to existing media consisting of video, audio and text. By inputting the sensory reproduction information suitable for personal preferences and surrounding device environment into the generated ne-media and transmitting it to the peripheral device, it has various functions of surroundings regardless of the user's physical location such as home, office, public place, etc. An object of the present invention is to provide an apparatus and method for an SMMD-based ubiquitous home media service that can autonomously converge through ne-media to provide a user with a realistic media service, and a home media service system and method using the same.

Other objects and advantages of the present invention can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. Also, it will be readily appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

An apparatus of the present invention for achieving the above object is, SMMD-based ubiquitous home media service apparatus, user interface means for receiving ne-media from an external ne-media providing server; Ne-media processing means for separating the received ne-media into software data for playing sensory information, media, synchronization and control information, and location information; Device control and synchronizing means for collecting device information to generate peripheral device groups to interoperate, generating a synchronization signal between the media and the peripheral device using the separated ne-media synchronization information, and then recording them on the ne-media ; Network management means for transmitting ne-media from the device control and synchronization means to a peripheral device; And ne-media reproduction means for reproducing the media separated by the ne-media processing means in synchronization with the peripheral device receiving the ne-media.

In addition, the method of the present invention, SMMD-based ubiquitous home media service method, the user interface means receiving the ne-media from an external ne-media providing server; ne-media processing means for separating the provided ne-media into software data for playing sensory information, media, synchronization and control information, and location information; The device control and synchronizing means collects peripheral device information to generate a device group to interoperate, and generates a synchronization signal between the media and the peripheral device using the separated ne-media synchronization information and then records the ne-media. step; Transmitting, by the network management means, the ne-media in which the synchronization signal between the devices is recorded to the peripheral device; And ne-media reproducing means playing the media in synchronization with the peripheral device receiving the ne-media.

Meanwhile, the system of the present invention, in the SMMD-based ubiquitous home media service system, analyzes the contents of media consisting of audio, video, and text, and based on the analyzed data, a timing of operation of the device so that a specific device is interworked for a specific time, A ne-media providing server for generating a parameter (set value) and a control value and recording the ne-media together with the device information to generate the ne-media; The ne-media generated by the ne-media providing server is separated into data, media, synchronization and control information, and location information, and a device group to be interlocked by collecting peripheral device information is generated. A home media service apparatus for generating a synchronization signal between the media and the device by using the separated ne-media synchronization information, recording the ne-media, and reproducing the ne-media in synchronization with the corresponding device; And performing authentication according to receiving ne-media while maintaining a session with the home media service device, and securing resources for reproducing ne-media when authentication is normally processed, and collaborating with the home media service device. At least one of said devices for reproducing in order of execution after setting the device to an optimal state for the device.

In addition, the method of the present invention, in the SMMD-based ubiquitous home media service method, the timing of operation of the device to analyze the content of the media consisting of audio, video and text, and to link the specific device for a specific time based on the analyzed data, Generating a parameter (set value) and a control value and recording the ne-media together with the device information to generate the ne-media; The generated ne-media is separated into data, media, synchronization and control information, and location information, peripheral device information is collected to create a device group to be interlocked, and the ne-media separated from the ne-media processing means. Generating a synchronization signal between the media and the device using the synchronization information and then recording the ne-media in synchronization with the corresponding device to reproduce the ne-media; And performing authentication according to receiving ne-media while maintaining a session with the home media service device, and securing resources for reproducing ne-media when authentication is normally processed, and collaborating with the home media service device. And setting the device to an optimal state for reproducing according to the execution order.

Meanwhile, in the present invention, the ne-media includes additional information such as fragrance, smell, touch, temperature / humidity, as well as images, sounds, and texts, which are materials of existing media.

In addition, in the present invention, since the ne-media has location information directly, unlike the existing media format, the ne-media can be reproduced even when the user moves.

In addition, the present invention can be applied to a fixed device that is fixed at a specific place such as a home server and a mobile device such as a mobile phone to reproduce ne-media.

In addition, the present invention is compatible with a variety of communication protocols, such as IP network, IEEE 1934, UWB, ZigBee, and provides a standard interface of the digital device, there is no need for a separate connection work.

In addition, the present invention is characterized in that it has a CPU and memory, such as a smartphone, PDA, etc. can be interlocked with a device that can be controlled by an application by itself and simple household appliances such as TV, audio (Audio).

In addition, the present invention manages the profile of each device in order to manage the frequency and propensity of use of the user, and detects the peripheral devices themselves and authenticates whether the devices can be used, and one device lacks memory ne -In case that it is difficult to reproduce the media, share the resource with other devices with surrounding memory so that the device can be self-organized.

In addition, the present invention is characterized in that by inserting the synchronization and control code of the device inside the ne-media, the peripheral and the reproduction auxiliary devices in the specific portion of the media can be automatically synchronized with the media to produce the effect of self reproduction. .

In addition, the present invention is characterized in that the devices can cooperate with each other to reproduce the ne-media effect when lacking one of the reproduction device and the reproduction auxiliary device in order to maximize the effect of the ne-media.

In addition, the present invention is characterized in that it is possible to add neo-data that provides a specific effect to the already generated ne-media to create a user-specific customized media.

In addition, in the present invention, the ne-media may evolve by adapting profile information of a user, a device, a home environment, and the like.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, whereby those skilled in the art may easily implement the technical idea of the present invention. There will be. In addition, in describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a structural diagram of an embodiment of a ne-media reference model according to the present invention.

As shown in Fig. 1, the ne-media reference model according to the present invention provides a control information in the existing media, whereas the existing media simply includes metadata for accommodating the user's request in the video and audio information. By adding software, synchronization information, and sensational information, the user can more actively respond, select, and experience.

In addition, the conventional media required only one device for playback, but ne-media may exist in a variety of environments in which various devices operate in synchronization with the ne-media. A new type of service can be provided. This ne-media accommodates all existing media.

Hereinafter, the reference model of the ne-media will be described in detail.

First of all, ne-media can be used to define its environment and set up peripheral devices so that its functions can be implemented independently in any environment.Neo-data layer 11, Media layer 12, Control / Sync 'Layer 13,' Location 'layer 14 and' Base 'layer 15.

Here, the 'Neo-data' layer 11 stores not only the existing metadata but also software for reproducing sensory information and software for device control.

In addition, the 'Media' layer 12 records not only all existing media such as audio, video, and text, but also newly appeared media information such as object type media, experiential media, and realistic media.

In addition, in the 'Control / Sync' layer 13, control information and synchronization information of a device for realistically reproducing ne-media are recorded.

In addition, in the 'Location' layer 14, information (ID) of a device (DTV, cellular phone, PDA, etc.) capable of operating by ne-media is recorded.

In addition, the 'base' layer 15 records a protocol for ne-media transmission and environmental information for ne-media reproduction.

By adopting this hierarchical structure, ne-media can include existing media and media service methods, and provide directions for development of media to be created in the future. By doing so, the burden of development can be reduced.

Meanwhile, the transport layer including the 'Location' layer 14 and the 'Base' layer 15 may deliver ne-media using various methods such as transmission through a network, transmission through a broadcasting medium, and transmission using a mobile device. Can be. For example, in the case of a movie service based on the ne-media reference model, the 'base' layer 15 may be configured as a basic structure for playing a digital versatile disc (DVD), and may use a transmission scheme through a network. In this case, the 'base' layer 15 becomes a structure that can be transmitted through a network, and in the case of cable TV and terrestrial broadcasting, the 'base' layer 15 becomes a structure for broadcasting. At this time, the device (TV, mobile phone, PDA, etc.) information for playing ne-media when the service in the digital home is included in the 'Location' layer (14).

In addition, the service layer is used for ne-media playback, wherein the 'Neo-data' layer 11, the 'Media' layer 12 and the 'Control / Sync' layer 13 operate organically with each other. That is, when providing a realistic service in the digital home, when the home server receives ne-media through the transport layer, the peripheral devices registered by analyzing the codes included in the 'Control / Sync' layer 13 are organically Set up your home server in a working state.

Then, the software in the 'Neo-data' layer 11 is executed to play ne-media, and the experiential and immersive types in which the peripheral devices are located in the 'Neo-data' layer 11 according to the control and synchronization signals. Represent data automatically.

Since the information on the device control and sensory effects may vary from device to device, it is preferable to be provided mainly by the device manufacturer, but better sensory data can be collected through the semantic web. In addition, the user suggests the satisfaction of the specific effect on the online scene, so that the high-impact satisfaction effect is selected first, thereby creating a user participatory media that gradually improves the completeness of the media.

2 is an exemplary view showing a data structure for ne-media according to the present invention.

As shown in FIG. 2, in the ne-media data according to the present invention, a header for a media format exists, and existing metadata is included in the Neo-data layer. In the media layer, audio, video, and text information are synchronized with each other, and they are synchronized with device information to be linked. Time, control, and parameter information are input to each device information, and information on 'Location' layer and 'Base' layer is added.

3 is a diagram illustrating an embodiment of an SMMD-based ubiquitous home media service apparatus according to the present invention.

As shown in FIG. 3, the SMMD-based ubiquitous home media service apparatus according to the present invention includes a sensor 300, a device profile, a user profile, a database 300 for storing ne-media, and an external ne-media providing server. The user interface unit 310 for requesting ne-media to receive the corresponding ne-media, and the ne-media received from the user interface 310 as 'neo-data', media consisting of audio / video / text. Ne-media processing manager 320 for separating each device into synchronization / control information and location (ID) information, and ne-media reproduction manager for playing the media separated by the ne-media processing manager 320 ( 330, a device group to collect and collect device information of the surrounding device, and generate media by using ne-media synchronization information separated by the ne-media processing manager 320. Device control and synchronization manager 340 for generating synchronization signals between devices after writing to ne-media, and network manager 350 for transmitting ne-media from the device control and synchronization manager 340 to peripheral devices. ).

Additionally, sensor manager 360 for providing sensor information used by the device control and synchronization manager 340 to collect peripheral device (reproduction device and reproduction aid) information, and the device control and synchronization manager ( The device 340 may further include a situation awareness and process manager 370 for providing inference information used to select a specific device among the devices collected by the device 340 to generate a device group.

In addition, the resource sharing manager 380 for allocating resources when there is insufficient resources for ne-media reproduction of the device.

Here, the function of the ne-media providing server will be described in more detail.

The ne-media providing server includes a ne-media generator for converting existing audio / video / text media into ne-media.

The contents analyzer of the ne-media generator analyzes the contents of the audio / video / text media and analyzes the contents of the media so that a specific device can be linked for a specific time based on the analyzed data. , Control values, etc. are generated and recorded on the ne-media together with the device information.

For example, in a video showing a rose, the moment the rose is pushed out, the device (for example, the fragrance) is operated to give a fragrance for a certain time. At this time, information such as the operation time and duration of the fragrance apparatus, and the fragrance intensity of the apparatus is recorded. Such device information may be generated based on metadata provided by the existing media, and may be generated through content-based media analysis / processing even if not provided in the metadata.

In this way, a specific device is selected at a specific time and device control / synchronization information is generated and input to the ne-media control / synchronization layer. Software agent or device controller information for controlling the device is input to the Neo-data layer of ne-media along with the existing metadata.

In addition, the device 'Location' information around the user to be linked with the media is the ID of the device determined by the main device (home server, set-top box, mobile terminal, etc.) that receives the ne-media. Set to 0 (reserve state).

Hereinafter, each component will be described in detail with reference to FIGS. 4 to 12.

4 is a configuration diagram of a database of an SMMD-based ubiquitous home media service apparatus according to the present invention.

As shown in FIG. 4, the database 300 of the SMMD-based ubiquitous home media service device according to the present invention is configured to store / update / delete / retrieve data generated while the SMMD-based ubiquitous home media service device is in operation. As a storage means for performing a function, a sensor information storage DB (301) for managing sensor information, a device profile DB (302) for managing a profile of the device, a user profile DB (303) for managing a user profile, ne-media storage DB 304 for storing ne-media.

5 is a configuration diagram of a user interface of the SMMD-based ubiquitous home media service apparatus according to the present invention.

As shown in FIG. 5, the user interface 310 of the SMMD-based ubiquitous home media service apparatus according to the present invention may include an access / control management module 311 for managing whether the user can access and control the external device. ne-media service management module 312 for requesting and receiving ne-media to the ne-media providing server and managing the service progress of ne-media, remote control from outside when the home media service device is applied to the home server A remote control module 313 for providing functionality, and a user management module 314 for managing authorized users.

6 is a diagram illustrating an embodiment of a ne-media processing manager of an SMMD-based ubiquitous home media service apparatus according to the present invention.

As shown in FIG. 6, the ne-media processing manager 320 of the SMMD-based ubiquitous home media service apparatus according to the present invention may receive ne- received from an external ne-media providing server through the user interface 310. Reconstructing the ne-media, ne-media parser 321 for separating the media into 'neo-data', media consisting of audio / video / text, synchronization / control information and location (ID) information of each device Ne-media reconstruction module 322, and ne-media storage / retrieval module 323 for storing the ne-media.

In addition, a ne-media conversion module 324 for converting the ne-media provided from the external ne-media providing server to another media format.

7 is a diagram illustrating an embodiment of a ne-media reproduction manager of an SMMD-based ubiquitous home media service apparatus according to the present invention.

As shown in FIG. 7, the ne-media reproduction manager 330 of the SMMD-based ubiquitous home media service apparatus according to the present invention is a service flow scheduler 331 in the form of a stream in order to determine the reproduction order of ne-media. In order to decode the ne-media transmitted, the ne-media decoding module 332 and the ne-media decoded by the ne-media decoding module 332 according to the reproduction order determined by the service flow scheduler 331 (specifically, Includes a ne-media player 333 for playing audio / video / text).

8 is a diagram illustrating an embodiment of a device control and synchronization manager of an SMMD-based ubiquitous home media service apparatus according to the present invention.

As shown in FIG. 8, the device control and synchronization manager 340 of the SMMD-based ubiquitous home media service apparatus according to the present invention may include a device discovery module 341 for collecting peripheral device information, and the device. The device grouping module 342 for generating a device group to interoperate among the devices collected by the collection module 341 and the ne-media using the ne / media synchronization / control information separated from the ne-media processing manager 320 Device signal module 343 for generating synchronization / control signals between media and devices, device callback module 344 for receiving responses from the devices (reproducer and reproduction aid), reproduction device and reproduction aid Device location management module 345 for managing IDs, device group control / collaboration for controlling and managing devices on a group basis Module 346, a device group priority scheduling module 347 for determining ne-media execution priority in the device group, and a device authentication module 348 for determining whether to use the device and maintaining and storing the information. And a ne-media / device time synchronization module 349 for causing the device to run at the correct time according to the control / synchronization signal.

9 is a diagram illustrating an embodiment of a network manager of an SMMD-based ubiquitous home media service device according to the present invention.

As shown in FIG. 9, the network manager 350 of the SMMD-based ubiquitous home media service apparatus according to the present invention may manage connection in various wired and wireless environments such as an IP network, a broadcasting network, ZigBee, and IEEE 1394. As an administrator for the session management module 351 for maintaining / managing sessions between the main device and the reproduction and reproduction assistance device, the routing module 352 for routing ne-media to a device at a specific location, and the load of network transmissions. It includes a load balancing management module 353 for managing the transmission, the transcoding module 354 for transmitting the reduced capacity of the high-capacity ne-media to the device.

10 is a configuration diagram of a sensor manager of an SMMD-based ubiquitous home media service apparatus according to the present invention.

As shown in FIG. 10, the sensor manager 360 of the SMMD-based ubiquitous home media service device according to the present invention may be used to trace back a sensor and a sensor node management module 361 to manage types, locations, and the like of the sensors. A sensor node tracking module 362, a sensor network phase management module 363 for managing the phase of the sensor, and a sensor information transmitting module 364 for transmitting sensor information.

11 is a diagram illustrating an embodiment of a situation awareness and processing manager of an SMMD-based ubiquitous home media service apparatus according to the present invention.

As illustrated in FIG. 11, the context awareness and processing manager 370 of the SMMD-based ubiquitous home media service apparatus according to the present invention may include a history management and pattern extraction module 371 for extracting a history and a pattern of the device. ), A user / device profile analysis module 372 for profile analysis, an autonomous device adaptation module 373 to automatically adapt ne-media to the device, and a profile based reasoning module 374 for inference.

12 is a diagram illustrating an embodiment of a resource sharing manager of an SMMD-based ubiquitous home media service device according to the present invention.

As illustrated in FIG. 12, the resource sharing manager 380 of the SMMD-based ubiquitous home media service apparatus according to the present invention may provide resources to peripheral devices and resources when it is difficult to accommodate digital information for providing a specific effect in one device. Device manager for resource management of each device, a resource allocation release module 382 for revoking allocated resources, and a process management module 383 for managing processes in the device. ), A redundant execution check module 384 to prevent redundant execution due to routing errors.

Meanwhile, a device, that is, a reproduction assistance device and a reproduction device, will be described with reference to FIGS. 13 and 14.

13 is a configuration diagram of an embodiment of a reproduction assistance apparatus according to the present invention.

As shown in Figure 13, the reproduction assistance apparatus according to the present invention is a device that can be controlled by ne-media connected to the network without having a CPU and memory, such as TV, audio system, aroma, vibration sofa, lighting A session management module 131 for maintaining and managing a connection with an SMMD-based ubiquitous home media service device, a profile management module 132 for managing a profile of a device, a player 133 for reproducing ne-media, Device control / synchronization module 134 for device control and synchronization.

14 is a configuration diagram of an embodiment of a reproduction apparatus according to the present invention.

As shown in FIG. 14, the reproducing apparatus according to the present invention independently reproduces ne-media with a CPU and a memory such as a smart phone, a mobile phone, a set-top box, a DTV, and cooperates with a reproducing apparatus nearby. Search for a session management module 141 for maintaining and managing a connection with an SMMD-based ubiquitous home media service device, a player 142 for reproducing ne-media, and a peripheral device for reproducing ne-media. Peripheral device detection module 143, a profile management module 144 for managing the profile of the device, a process scheduler 145 for process scheduling of the device, an authentication module for authenticating a user so that only authorized users can use the device 146, a device control / synchronization module 147 for device control and synchronization, in cooperation with the peripheral device, according to the set state Self Organizer's devices (148) for changing, includes a resource management module 149 for managing the device resources.

15 is a flowchart illustrating an embodiment of a method for SMMD-based ubiquitous home media service according to the present invention.

①, ② The ne-media generator of the ne-media providing server analyzes the contents of the audio / video / text media through the contents analyzer so that a specific device can be linked for a specific time based on the analyzed data. The operating timing, parameters (set values) and control values of the device are generated and recorded together with the device information on the ne-media.

That is, a specific device is selected at a specific time and control / synchronization information of the selected device is generated and input to the ne-media control / synchronization layer.

In addition, the software agent or device controller information for controlling the device is input to the neo-data layer of the ne-media along with the existing metadata.

Also, the device 'Location' information around the user to be linked with the media is set to 0 (reserve state).

③, ④ The user interface 310 requests ne-media to the ne-media providing server to receive the ne-media.

⑤ The user interface unit 310 transmits the received ne-media to the ne-media processing manager 320.

⑥ The ne-media processing manager 320 separates the received ne-media into 'neo-data', media consisting of audio / video / text, synchronization / control information and location (ID) information of each device.

(7) A preparation process for playing the media separated by the ne-media processing manager 320 is performed, and the media is played back later in synchronization with a device controlled by the ne-media.

⑧ The device control and synchronization manager 340 collects the surrounding device information to create a device group to interwork, and uses the ne-media synchronization information separated by the ne-media processing manager 320 to exchange the media between the devices. Generate a synchronization signal and record it on ne-media.

,, ⑩ network manager 350 transmits ne-media from the device control and synchronization manager 340 to peripheral devices, i.e., the reproduction apparatus and the reproduction assistance apparatus.

The session management module of the reproducing apparatus performs authentication based on receiving ne-media while maintaining a session with the SMMD-based ubiquitous home media service apparatus, and provides resources for reproducing ne-media when authentication is normally processed. Secure device, set device to optimal state for collaboration with SMMD based ubiquitous home media service device through device self-organizer, set device execution order using process scheduler and play it in player.

At this time, the reproduction auxiliary device receives ne-media from the SMMD-based ubiquitous home media service device that maintains the session through the session management module, performs authentication, and then plays back normally.

Meanwhile, the reproducing apparatus and the reproducing assist apparatus communicate with each other through a wireless network through a plurality of other reproducing apparatuses and the reproducing assistance apparatus, so that the other reproducing apparatus or the other reproducing assistance apparatus is registered in the SMMD-based ubiquitous home media service apparatus, In this case, the reproducing apparatus and the reproducing assistance apparatus perform a function of routing (routing) ne-media from the SMMD-based ubiquitous home media service apparatus to the corresponding reproducing apparatus or the reproducing assistance apparatus.

As described above, the method of the present invention may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form. Since this process can be easily implemented by those skilled in the art will not be described in more detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

The present invention as described above, generates a new structure of the media (ne-media) that can add the device control and synchronization information for the sensory service to the existing media consisting of video, audio and text, the generated ne -By inputting the realistic reproduction information suitable for individual taste and surrounding device environment into the media, and then transmitting it to the peripheral device, devices with various functions of the surroundings regardless of the physical location of the user such as home, office, public places, etc. Through autonomous convergence, it is possible to provide a realistic media service to users.

In addition, the present invention by maximizing the media effect in the ubiquitous home where mobility is emphasized, such as DMB, smart phone, PDA, etc. It is applied to various fields in which media is used, such as home entertainment, and has the effect of enabling mutual growth by realizing high value-added with related industries by creating services through connection with broadcast, film, contents, and device manufacturers.

In addition, the present invention is a new system development for the ubiquitous era, the system development independent of the existing hardware can have software independence, and the infrastructure construction and new business model that media and devices can work together based on integrated convergence service Development of new profit model of digital home appliance industry, service industry and media industry by creating new service that could not be experienced with existing devices / media such as new concept of media creation, delivery, reproduction and service, interworking with devices You can expect the effect.

Claims (12)

In the SMMD-based ubiquitous home media service device, User interface means for receiving ne-media from an external ne-media providing server; Ne-media processing means for separating the received ne-media into software data for playing sensory information, media, synchronization and control information, and location information; Device control and synchronizing means for collecting device information to generate peripheral device groups to interoperate, generating a synchronization signal between the media and the peripheral device using the separated ne-media synchronization information, and then recording them on the ne-media ; Network management means for transmitting ne-media from the device control and synchronization means to a peripheral device; And Ne-media reproduction means for reproducing media separated by the ne-media processing means in synchronization with the peripheral device receiving the ne-media; SMMD-based ubiquitous home media service device comprising a. The method of claim 1, A database for storing sensor information, device profiles, user profiles, ne-media; Sensor management means for providing sensor information used by said device control and synchronization means to collect peripheral device information; Situation recognition and processing means for providing inference information used to generate a device group by selecting a specific device among the devices collected by the device control and synchronization means; And Resource sharing management means for allocating resources when resources for ne-media reproduction of peripheral devices are insufficient SMMD-based ubiquitous home media service device further comprising. The method according to claim 1 or 2, The ne-media providing server, Analyze the contents of media consisting of audio, video, and text, and generate device operation timings, parameters (setpoints), and control values so that specific devices work together for a specific period of time based on the analyzed data. The apparatus of claim 1, wherein the device 'Location' layer around the user to be linked with the media is set to 0 (reserve state). The method of claim 3, wherein The device, Authenticates upon receiving ne-media while maintaining session with SMMD-based ubiquitous home media service device, and secures resources to reproduce ne-media when authentication is successfully processed, and SMMD through device self-organizer SMMD-based ubiquitous home media service device, characterized in that the device is set to an optimal state for collaboration with the base ubiquitous home media service device, the device execution order is set using the process scheduler, and the device is played back. The method of claim 4, wherein The ne-media, A data layer in which software for reproducing sensory information as well as metadata and software for device control are stored; A media layer in which object media, experiential media, and realistic media are stored, as well as media consisting of audio, video, and text; a synchronization and control layer on which control information and synchronization information of a device for realistically reproducing ne-media are recorded; a location layer in which device information (ID) capable of operating by ne-media is recorded; And Base layer where protocol for ne-media transmission and environmental information for ne-media reproduction are recorded SMMD-based ubiquitous home media service device comprising a. In the SMMD-based ubiquitous home media service method, Receiving, by the user interface means, ne-media from an external ne-media providing server; ne-media processing means for separating the provided ne-media into software data for playing sensory information, media, synchronization and control information, and location information; The device control and synchronizing means collects peripheral device information to generate a device group to interoperate, and generates a synchronization signal between the media and the peripheral device using the separated ne-media synchronization information and then records the ne-media. step; Transmitting, by the network management means, the ne-media in which the synchronization signal between the devices is recorded to the peripheral device; And Playing the media by the ne-media reproducing means in synchronization with the peripheral device receiving the ne-media; SMMD-based ubiquitous home media service method comprising a. The method of claim 6, Sharing resources by a resource sharing management means when there is insufficient resources for ne-media reproduction received by the device; SMMD-based ubiquitous home media service method further comprising. The method according to claim 6 or 7, The ne-media, A data layer in which software for reproducing sensory information as well as metadata and software for device control are stored; A media layer in which object media, experiential media, and realistic media are stored, as well as media consisting of audio, video, and text; a synchronization and control layer on which control information and synchronization information of a device for realistically reproducing ne-media are recorded; a location layer in which device information (ID) capable of operating by ne-media is recorded; And Base layer where protocol for ne-media transmission and environmental information for ne-media reproduction are recorded SMMD-based ubiquitous home media service method that includes. In the SMMD-based ubiquitous home media service system, Analyze the contents of media consisting of audio, video, and text, and generate device operation timings, parameters (setpoints), and control values so that specific devices work together for a specific period of time based on the analyzed data. A ne-media providing server for generating ne-media by writing to the file; The ne-media generated by the ne-media providing server is separated into software data for playing sensory information, media, synchronization and control information, and location information, and a device group to be interlocked by collecting peripheral device information is generated. A home media service apparatus for generating a synchronization signal between the media and the device by using the synchronized information of the ne-media, recording the ne-media, and reproducing the ne-media in synchronization with the corresponding device; And When ne-media is delivered while maintaining a session with the home media service device, authentication is performed, and when authentication is normally processed, resources for reproducing ne-media are secured, and collaboration with the home media service device is performed. At least one of said devices for playback in order of execution after setting the device to an optimal state for the SMMD-based ubiquitous home media service system comprising a. The method of claim 9, The ne-media, A data layer in which software for reproducing sensory information as well as metadata and software for device control are stored; A media layer in which object media, experiential media, and realistic media are stored, as well as media consisting of audio, video, and text; a synchronization and control layer on which control information and synchronization information of a device for realistically reproducing ne-media are recorded; a location layer in which device information (ID) capable of operating by ne-media is recorded; And Base layer where protocol for ne-media transmission and environmental information for ne-media reproduction are recorded SMMD-based ubiquitous home media service system comprising a. In the SMMD-based ubiquitous home media service method, The ne-media provision server analyzes the contents of the media consisting of audio, video, and text, and generates device operation timings, parameters (settings), and control values so that a specific device can be linked for a specific time based on the analyzed data. Generating ne-media by recording on ne-media together with information; The home media service apparatus separates the generated ne-media into software data for playing sensory information, media, synchronization and control information, and location information, collects peripheral device information, creates a device group to interoperate, and separates the separated ne-media. generating a synchronization signal between the media and the device by using the synchronization information of the ne-media, recording the ne-media, and reproducing the ne-media in synchronization with the corresponding device; And At least one device performs authentication according to receiving ne-media while maintaining a session with the home media service apparatus, and secures a resource for reproducing ne-media when authentication is normally processed, and the home media Setting the device to the optimal state for collaboration with the service device and playing back in the order of execution SMMD-based ubiquitous home media service method comprising a. The method of claim 11, The ne-media, A data layer in which software for reproducing sensory information as well as metadata and software for device control are stored; A media layer in which object media, experiential media, and realistic media are stored, as well as media consisting of audio, video, and text; a synchronization and control layer on which control information and synchronization information of a device for realistically reproducing ne-media are recorded; a location layer in which device information (ID) capable of operating by ne-media is recorded; And Base layer where protocol for ne-media transmission and environmental information for ne-media reproduction are recorded SMMD-based ubiquitous home media service method comprising a.

Images