KR20180129605A - Method for providing content service and system thereof - Google Patents

Abstract

A content providing method using a content obtaining device, a server, and a content executing device comprises the following steps: generating video data by using a camera of the content obtaining device, generating motion data by measuring an angular velocity and acceleration of the content obtaining device by using sensors of the content obtaining device, and generating content by synchronizing the video data and the motion data; reading a first setting signal from a memory by the server; and receiving the content transmitted from the content obtaining device by the server when the first setting signal instructs VOD streaming, storing the content in a database, receiving the content transmitted from the content obtaining device by the server when the first setting signal instructs live streaming, and streaming the content on live by the content executing device.

Description

[0001] METHOD FOR PROVIDING CONTENT SERVICE AND SYSTEM THEREOF [0002]

An embodiment according to the concept of the present invention relates to a content providing service method, and more particularly, to a content providing service method, in which content generated by a content obtaining apparatus is stored in a database for video-on-demand (VOD) streaming, And to a system and method for enabling live streaming to a content execution device.

Currently, content in virtual space is conveyed by human visual and auditory information. Current IT-based portable devices support various contents through development of 3D graphic technology and virtual reality technology.

Registered Patent Bulletin (B1) 10-0479365 (Announced on Mar. 28, 2005)

SUMMARY OF THE INVENTION A technical problem to be solved by the present invention is to provide a method and system capable of storing contents created by a content acquisition apparatus in a database for VOD streaming or live streaming to a content execution apparatus according to a user's setting .

The technical problem to be solved by the present invention is to provide a method and system in which at least one of the components included in the content obtaining apparatus can be controlled (or adjusted) by a user of the content obtaining apparatus and / .

A content providing service method using a content obtaining apparatus, a server, and a content executing apparatus according to the present invention includes the steps of: generating video data using a camera of the content obtaining apparatus; Generating motion data by measuring angular velocity and acceleration of the device, and generating a content by synchronizing the video data and the motion data; The server reading a first setting signal from a memory; When the first setting signal indicates VOD streaming, the server receives the content transmitted from the content obtaining apparatus and stores the received content in a database, and when the first setting signal instructs live streaming, Receiving the content transmitted from the device and live streaming the content to the content executing device; And a motion simulator for separating the video data and the motion data from the content in which the content execution apparatus is live streamed, transmitting the video data to an HMD (head mounted device) To the motion simulator.

According to an embodiment of the present invention, a content providing service method using a content obtaining apparatus, a server, and a content executing apparatus includes: setting a content transfer mode using the content obtaining apparatus; Generating motion data by measuring angular velocity and acceleration of the content acquisition apparatus using sensors of the content acquisition apparatus, generating mode data including the content transfer mode, , Generating the video data, and the content including the motion data; The server receiving the content transmitted from the content acquiring device; Determining the mode information by the server; When the mode information indicates VOD streaming, the server receives the content and stores the content in a database. When the mode information indicates live streaming, the server bypasses the content and performs live streaming to the content execution device step; And a motion simulator for separating the video data and the motion data from the content in which the content execution apparatus is live streamed, transmitting the video data to an HMD (head mounted device) To the motion simulator.

The method according to the embodiment of the present invention is effective in that the content generated by the content obtaining apparatus can be stored in the database for VOD streaming or can be live streamed to the content executing apparatus according to the setting of the user. Therefore, the user of the content executing apparatus can enjoy realistic contents.

The method according to the embodiment of the present invention has the effect that at least one of the components included in the content obtaining apparatus can be controlled (or adjusted) by the user of the content obtaining apparatus and / or the user of the content executing apparatus .

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In order to more fully understand the drawings recited in the detailed description of the present invention, a detailed description of each drawing is provided.
1 is a block diagram of a data providing service system according to an embodiment of the present invention.
Fig. 2 is an embodiment of a method for setting whether content is to be publicized, a content transmission mode, and an allowed user.
3 is a data flow for explaining the operation of the data providing service system shown in Fig.
4 is a data flow for explaining the operation of the data providing service system shown in FIG.
5 is a data flow for explaining the operation of the data providing service system shown in FIG.

1 is a block diagram of a data providing service system according to an embodiment of the present invention. 1, a data (2D content or 3D content) providing service system 100 includes a content acquiring device 200, a server 400, a database 500, and a plurality of content executing devices 700 and 800. [ . In accordance with embodiments, the data serving system 100 may further include the device 900. [ Apparatus 900 may refer to a device (e.g., a smartphone) that includes a display and / or a speaker.

The data providing service system 100 may be implemented as a virtual reality service system, an experience service providing system, or a remote control system capable of providing a virtual reality (VR) service, but the technical idea of the present invention is limited thereto It is not.

The content acquisition apparatus 200 collectively refers to a device capable of acquiring various data (or various contents), and includes a smart phone, a wearable computer, an Internet of Things (IoT) device, a drone, a camcoder, an action camera or an action-cam, a sports action camcorder, or an automobile. Herein, the contents may include a video signal, an audio signal, and / or a motion signal (e.g., including acceleration and angular velocity). The signal may refer to an analog signal or a digital signal.

The content acquisition apparatus 200 includes a camera 210, a microphone 220, an acceleration sensor 230, an angular velocity sensor 240, a memory 245, a processor 250, an actuator 255, and a wireless transceiver 260. [ . ≪ / RTI >

The camera 210 may generate a video signal VS, such as a still image or a moving image, and output the video signal VS to the processor 250. The camera 210 may be implemented as a CMOS image sensor. The camera 210 may be implemented with a CMOS image sensor capable of generating color information and depth information. The camera 210 may be implemented with at least one camera capable of generating a video signal VS, such as a three-dimensional image or a stereoscopic image.

For example, the operation of the camera 210 (e.g., recording or photographing direction) may be controlled by a control signal generated by the content acquisition apparatus 200 by the user's operation of the content acquisition apparatus 200 or by a control signal generated by the content execution apparatus 700 or 800 And may be controlled by the processor 250 that processes the control signal generated by the content execution device 700 or 800 by the user's operation.

The microphone 220 may also be referred to as a microphone and may generate an audio signal AS and output the audio signal AS to the processor 250. [ In accordance with embodiments, the microphone 220 may or may not be placed (or installed) in the content acquisition device 200.

For example, the operation of the microphone 220 (e.g., on or off) may be controlled by a control signal generated by the content acquisition apparatus 200 by the user's operation of the content acquisition apparatus 200 or by a user of the content execution apparatus 700 or 800 By the processor 250 that processes the control signal generated by the content execution device 700 or 800 by the operation of the content execution device 700 or 800. [

The acceleration sensor 230 measures the acceleration ACS of the moving content acquisition apparatus 200. When the acceleration ACS is integrated once with respect to time, the speed (or speed information) is obtained, The displacement (or displacement information) is obtained. A three-axis acceleration sensor may be used as the acceleration sensor 230, but the present invention is not limited thereto.

For example, the operation of the acceleration sensor 230 (e.g., on or off) may be controlled by a control signal generated by the content acquisition apparatus 200 or by the operation of the content execution apparatus 700 or 800 And may be controlled by the processor 250 that processes the control signal generated by the content execution device 700 or 800 by the user's operation.

The angular velocity sensor 240 is an apparatus for measuring the angular velocity AGS of the moving content acquisition apparatus 200. An angle (or angle information) is obtained when the angular velocity is integrated once with respect to time, When differentiating, the angular acceleration is obtained, and torque (or torque) is obtained in combination with the moment of inertia. The angular velocity sensor 240 may be implemented as a gyro sensor, but is not limited thereto. Motion signals (or motion data) are signals (or data) associated with acceleration (ACS) and angular velocity (AGS).

For example, the operation of the angular velocity sensor 240 (e.g., on or off) may be controlled by a control signal generated by the content acquisition apparatus 200 or by an operation of the content execution apparatus 700 or 800 And may be controlled by the processor 250 that processes the control signal generated by the content execution device 700 or 800 by the user's operation.

Although the acceleration sensor 230 and the angular velocity sensor 240 are illustrated as separate sensors in FIG. 1, the acceleration sensor 230 and the angular velocity sensor 240 may be implemented as one hardware chip (or module) Can be implemented.

The memory 245 may store data and / or firmware (or application programs) required for operation of the content acquisition apparatus 200. The memory 245 collectively refers to a volatile memory such as a DRAM and a nonvolatile memory such as a flash memory.

2, the user of the content acquisition apparatus 200 can use the firmware (or an application program) stored in the memory 245 to determine whether the content is 'open', 'content transfer mode' You can set the 'Allowed users'. According to the embodiment, the 'content disclosure', the 'content transmission mode', and the 'permitted user' may be set using a smart phone capable of wireless communication with the content acquisition apparatus 200.

The memory 245 stores control signals generated by the content acquisition apparatus 200 in accordance with a control policy, for example, an operation of a user of the content acquisition apparatus 200, (Or data) about which control signal to process first among the control signals generated in the control unit 700 or 800 may be stored.

The processor 250 may control the operation of each component 210, 220, 230, 240, 245, 255 and 260 and may include an operating system (OS) . The processor 250 may be a central processing unit (CPU), a micro control unit (MCU), a graphics processing unit (GPU), a general-purpose computing graphics processing unit (GPGPU), or an application processor can do.

Processor 250 may generate synchronized signals by synchronizing the video signal VS with the motion signal. The processor 250 may also generate synchronized signals by synchronizing the video signal VS, the audio signal AS, and the motion signal.

For example, the processor 250 generates a synchronized packet by synchronizing the video signal VS with the motion signal (or the video signal VS, the audio signal AS, and the motion signal) on a frame- And may transmit the synchronized packet to the server 400 via the first communication network 300. [ Processor 250 may generate a synchronized packet that includes synchronization information.

The synchronized packet may include video data VD associated with the video signal VS and motion data MD associated with the motion signal. The synchronized packet may also include video data VD associated with the video signal VS, audio data AD associated with the audio signal AS, and motion data MD associated with the motion signal. A synchronized packet can mean content (CNT).

As another example, the processor 250 may insert a timestamp into a layer capable of inserting metadata of a video signal VS to generate a video signal VS and a motion signal (Or packet) including a video signal (VS), an audio signal (AS), and a motion signal).

That is, the content acquisition apparatus 200 can acquire the content CNT including the video data VD and the motion data MD synchronized with each other or the video data VD, the audio data AD, (CNT) including the synchronization information, and transmits the content (CNT) including the synchronization information to the server 400 via the first communication network 300. [

The actuator 255 collectively refers to a device that gives a motion to an object included in the content acquisition apparatus 200 under the control of the processor 250. For example, the actuator 255 may be implemented as an electric actuator such as a DC motor (or an AC motor), a hydraulic actuator such as a hydraulic cylinder or a hydraulic motor, and / or a pneumatic actuator such as a pneumatic cylinder or an air motor.

The object to be moved by the actuator 255 may be various. For example, when the content acquisition apparatus 200 is a drone, the object controlled by the actuator 255 may be a propeller, a rotor, or a gimbal that holds the camera so as not to shake. When the content acquisition apparatus 200 is an automobile, the object controlled by the actuator 255 may be a handle or a transmission.

The processor 250 refers to the control policy stored in the memory 245 and controls the operation of the actuator 255 in accordance with the control signal generated in the content acquisition apparatus 200 or the control signal generated in the content execution apparatus 700 or 800. [ The operation can be controlled.

The wireless transceiver 260 may output the content CNT output from the processor 250 or the content CNT generated under the control of the processor 250 to the first communication network 300. [ That is, since the content acquisition apparatus 200 does not include hardware or software for an additional pre-process, the content acquisition apparatus 200 can transmit the content CNT to the server 400 as soon as the content CNT is generated.

The video data VD collectively refers to signals generated by processing (e.g., encoding or modulating) a signal corresponding to the video signal VS or a video signal VS, and the motion data MD includes acceleration ACS and angular velocity (For example, encoding or modulating) a signal or an acceleration ACS and an angular speed AGS corresponding to the AGS of the audio signal AS and the audio data AD is a signal corresponding to the audio signal AS, And generically refers to signals generated by processing (e.g., encoding or modulating) the audio signal AS.

According to an embodiment, the motion data MD may be generated by processing signals (e.g., encoding or modulating) signals corresponding to acceleration ACS and angular velocity AGS and / or acceleration ACS and angular velocity AGS In addition, it may include signals generated by differentiating or integrating acceleration (ACS) and angular velocity (AGS), respectively. Content (CNT) may be transmitted in packet form.

The content acquisition apparatus 200 may communicate with the server 400 through the first communication network 300 (e.g., wirelessly). Each communication network 300 and 600 may support Bluetooth, Wi-Fi, a cellular system, wireless LAN, or satellite communication. Cellular systems are not ^{W-CDMA, LTE TM (long} term evolution), or LTE-A (LTE-advanced) can be, but is not limited thereto.

The server 400 receives the content CNT transmitted from the content acquisition apparatus 200 according to the first setting signal and stores it in the database 500 for VOD (Video On Demand) streaming or performs live streaming To at least one of the plurality of content execution devices 700 and 800. [

Unlike VOD streaming, live streaming refers to a technique of reproducing multimedia digital information including video and audio while real-time encoding without downloading. VOD streaming means that contents stored in the database 500 are transmitted through the second communication network 600 according to a request of a user of the content execution device 700 or 800.

The server 400 capable of performing the functions of the VOD streaming server and the live streaming server includes a processor 410, a memory 420, a first transceiver 430, a selector 440, and a second transceiver 450 can do.

Processor 410 may be configured to perform operations such as, for example, content disclosure, content delivery mode (e.g., VOD streaming mode for VOD streaming, live streaming mode for live streaming, and VOD streaming mode and live streaming (Or set) a mixed mode, mixed mode, and allowed user, etc. The processor 410 may control the operation of each of the components 420, 430, 440, and 450. The processor 410 may be implemented as a CPU, an MCU, a GPU, a GPGPU, or an AP, but is not limited thereto.

The memory 420 is an embodiment of a recording medium capable of storing data necessary for operation of the server 400 and firmware (or program) executed by the server 400. [ The volatile memory generally includes a cache memory, a random access memory (RAM), a dynamic RAM (DRAM), and / or a static RAM (SRAM), and the nonvolatile The memory includes a flash memory.

The first transceiver 430 receives the content CNT including the video data VD and the motion data MD received through the first communication network 300 and transmits the content CNT to the selector 440 do. The first transceiver 430 may transmit the signals output from the processor 410 to the first communication network 300.

The selector 440 transmits the content CNT including the video data VD and the motion data MD to either the database 500 or the second communication network 600 under the control of the processor 410 . Although the selector 440 is shown outside of the processor 410 in FIG. 1, the selector 440 may be implemented within the processor 410, according to embodiments. In addition, the selector 440 may be implemented in hardware or in firmware or software executable in the processor 410. [

The processor 410 may control the operation of the selector 440 based on the first setting signal. The database 500 may receive and store contents (CNT = CNT1) for VOD streaming.

Also, under the control of the processor 410 of the server 400, the database 500 may store the data (or information) exemplarily shown in FIG. 1 in the form of a table or a look-up table.

For example, the database 500 stores information about a user (USER), a device ID (DEVICE) of the content acquisition apparatus 200, a content disclosure status, a content transmission mode, and a user (ALL or FUSER1) Can be stored. According to the embodiments, the server 400 may include a user (USER), a device ID (DEVICE) of the content acquisition device 200, a content disclosure status, a content transmission mode, and a user (ALL or FUSER1) May be stored in the memory 420.

The second transceiver 450 transmits the content (CNT = CNT1) for VOD streaming or the content (CNT = CNT2) for live streaming to the corresponding content To the execution devices 700 and / or 800.

The first content execution apparatus 700 includes a PC 710, a head mounted display (HDM) 720, a motion simulator 730, and a speaker 740. The second content execution device 800 includes a PC 810, a head-mounted display 820, a motion simulator 830, and a speaker 840.

Each of the moving simulators 730 and 830 may be a device for a robot, a virtual reality experience device, or an exergame. The virtual reality experience device can be implemented as a three-dimensional (3D), 4D, 5D, 6D, 7D, 8D, 9D, or XD virtual reality experience device. The corresponding PC 710 or 810 can execute contents for 3D, 4D, 5D, 6D, 7D, 8D, 9D, or XD.

The PC 710 or 810 separates the video data VD and the motion data MD from the contents (CNT = CNT1 or CNT2) including the video data VD and the motion data MD Transmits the video data VD to the corresponding HMD 720 or 820 and transmits the motion data MD to the corresponding motion simulator 730 or 830. The separated video data VD and separated motion data MD are synchronous (or temporally synchronized) data. The PC 710 or 810 generically refers to a controller that can be called by various names to control the content execution device 700 or 800. [

According to the embodiment, the PC 710 or 810 converts video data VD, audio data AD, and motion data MD from content (CNT = CNT1 or CNT2) containing video data VD, (For example, separates at the time of decoding) the video data VD and the motion data MD and transmits the video data VD to the corresponding HMD 720 or 820 and outputs the motion data MD to the corresponding motion simulator 730 Or 830, and transmits the audio data AD to the corresponding speaker 740 or 840. [ The separated video data VD, separated audio data AD, and separated motion data MD are data synchronized with each other (or synchronized in time).

The HMD 720 or 820 can display an image (e.g., a virtual reality) based on the video data VD. The motion simulator 730 or 830 can directly reproduce the motion (e.g., roll, pitch, and yaw) of the content acquisition apparatus 200 based on the motion data MD . The speakers 740 and 40 can output the audio based on the audio data AD.

The motion simulator 730 or 830 may calculate an acceleration value ACS generated by the content acquisition device 200 and an integral value related to at least one of an angular velocity AGS, an acceleration ACS and an angular velocity AGS, and / (E.g., roll, pitch, and yaw) of the content acquisition apparatus 200 can be reproduced using the derivative values related to at least one of the ACS and the angular speed AGS have.

An image (for example, a 2D image or a 3D image) corresponding to an image (for example, a 2D image or a 3D image) photographed by the camera 210 of the content acquisition apparatus 200 is displayed on the HMD 720 or 820, The acceleration ACS and the angular speed AGS measured from the sensors 230 and 240 of the content acquisition apparatus 200 are reflected in the corresponding motion simulator 730 or 830 and the audio acquired by the microphone 220 Can be output through the speakers 740 and 840.

The content execution device 700 or 800 has the effect of reflecting the video, audio, and motion acquired by the content acquisition device 200 as it is.

Fig. 2 is an embodiment of a method for setting whether content is to be publicized, a content transmission mode, and an allowed user. The firmware (or application program) executed by the processor 250 of the content acquisition apparatus 200 may be provided to the user (or the content acquisition apparatus 200) via the graphical user interface (GUI) To a smart phone capable of communicating with a mobile phone.

The GUI 251 includes buttons 253-1 and 253-2 for inputting whether or not to display "content disclosure (content security)", buttons 255-1 to 255-3 for inputting "content transmission mode" And input windows 257-1 and 257-2 that allow the user to enter at least one "permitted user" that can execute the content via VOD streaming (or VOD streaming service) or live streaming (or live streaming service) . The identification information for the permitted user may be identification information (e.g., the user's smartphone phone number or e-mail address, etc.) that can uniquely identify the user using the content execution apparatus 700 or 800.

Although the GUI 251 is shown in FIG. 2, the method of generating the first setting signal for determining the content transmission mode and the second setting signal for determining whether the content is open or closed can be variously changed. Each set signal may refer to data comprising a plurality of bits.

Thus, a smartphone capable of communicating with content acquisition device 200 or content acquisition device 200 according to the inventive concept may include hardware or software capable of generating a first set signal and a second set signal have.

3 is a data flow for explaining the operation of the data providing service system shown in Fig. 1 to 3, the user of the content acquisition apparatus 200 may be a display device of the content acquisition apparatus 200 or buttons (e.g., buttons) displayed on the display device of the smartphone capable of communicating with the content acquisition apparatus 200 253-1 and 253-2) to select whether or not the content is disclosed (S110).

The button 253-1 is a button for selecting an open (or non-secure) button. When the button 253-1 is selected, the content can be streamed (for example, VOD streaming or live streaming) without limitation to a desired user. When the button 253-2 is selected, the content is permitted to be streamed only to a user registered in the server 400 as an authorized user (for example, VOD streaming or VOD streaming) Live streaming).

As the button 253-1 or 253-2 is selected, the processor 250 generates a second setting signal indicating whether the content is to be released, 430 to the processor 410 in step S112 and the processor 410 stores the second setting signal in the memory 420 and / or the database 500 in step S114. The device ID of the content acquisition apparatus 200 is transferred to the processor 410 and the processor 410 stores the device ID in the memory 420 and /

The user of the content acquisition apparatus 200 selects a content transmission mode using one of the buttons 255-1, 255-2, and 255-3 (S120).

The button 255-1 is a button for selecting the VOD streaming (or the VOD service). When the button 255-1 is selected, the content is stored in the database 500 for VOD streaming by the server 400 . The button 255-2 is a button for selecting live streaming (or live service). When the button 255-2 is selected, the content is transmitted to the corresponding content executing device 700 and / or 800 by the server 400. [ Lt; / RTI > That is, the server 400 bypasses the corresponding content. The content for VOD streaming can be called offline content, and the content for live streaming can be called online content. Bypass means that the content is transmitted to the corresponding content execution device 700 and / or 800 in real time without being stored in the database 500.

Button 255-3 is a button for selecting VOD streaming (or VOD service) at the same time as live streaming (or live service). When the button 255-3 is selected, the corresponding content is displayed on the corresponding content execution device 700 and / Or 800) and simultaneously (or in parallel) are stored in the database 500 by the server 400.

As the buttons 255-1, 255-2, or 255-3 are selected, the processor 250 generates a first setting signal indicating a content transfer mode, The processor 410 transmits the first setting signal to the memory 420 and / or the database 500 (S124).

The user of the content acquisition apparatus 200 inputs an allowable user to each of the input windows 257-1 and 257-2 (S126). When at least one permissive user is input, the processor 250 transmits the entered authorized user (FUSER) to the processor 410 via the components 260, 300, and 430 (S127) (FUSER) to the memory 420 and / or the database 500 (S128).

The content acquisition apparatus 200 generates video data VD using the video signal AS photographed by the camera 210 at step S130 and the content acquisition apparatus 200 transmits the video data VD to the sensors 230 and 240 The motion data MD is generated using the values (ACS and AGS) measured by the motion estimation unit 120 (S140). According to the embodiment, the content obtaining apparatus 200 may further generate audio data AD using not only the motion data MD but also the audio signal AS obtained from the microphone 220 (S140).

The processor 250 of the content acquisition apparatus 200 may generate the content CNT (S142). The content CNT includes the video data VD and the motion data MD synchronized with each other or includes the video data VD synchronized in time with each other, the audio data AD, and the motion data MD (S142).

The processor 410 of the server 400 searches the memory 420 or the database 500 to determine whether or not the content CNT is received from the server 400, 1 setting signal and determines whether the content transmission mode is a VOD streaming mode (VOD streaming mode), a live streaming mode (live streaming mode), or a mixed mode (S150).

When the user of the content acquisition apparatus 200 is the first user (USER = USER1), the device ID (DEVICE) of the content acquisition apparatus 200 is DEVICE1, and the content transmission mode corresponding to the first setting signal is the VOD streaming mode VOD STREAMING), and the content acquisition apparatus 200 generates the content (CNT = CNT1), and the content disclosure status corresponding to the second setting signal is "open to all users ".

In this case, the processor 410 of the server 400 generates the selection signal SEL based on the first setting signal indicating the VOD streaming, and outputs the selection signal SEL to the selector 440. [ The selector 440 receives the content (CNT = CNT1) transmitted from the content obtaining apparatus 200 in response to the selection signal SEL and stores it in the database 500 (S160).

If the user of the content acquisition apparatus 200 is the second user (USER = USER2), the device ID (DEVICE) of the content acquisition apparatus 200 is DEVICE2, and the content transmission mode corresponding to the first setting signal is the live streaming mode LIVE STREAMING), the allowable user is the user (FUSER1) using the content executing apparatus 700, the content obtaining apparatus 200 generates the content (CNT = CNT2) Is "private" to all users except FUSER1.

In this case, the processor 410 of the server 400 generates the selection signal SEL based on the first setting signal for instructing the live streaming, and outputs the selection signal SEL to the selector 440. The selector 440 is responsive to the selection signal SEL to select a second transceiver (not shown) for transmitting (or bypassing) the content CNT = CNT2 transmitted from the content acquiring device 200 to the content executing device 700 450 in step S170.

Only the content executing apparatus 700 corresponding to the permitted user FUSER1 can receive and execute the content CNT transmitted from the server 700. [ For example, the PC 710 of the content executing apparatus 700 compares the information on the permitted user FUSER1 included in the content CNT with the user information of the content executing apparatus 700, .

However, the content execution apparatus 800 of the user not corresponding to the permitted user FUSER1 can receive the content CNT transmitted from the server 700, but the content execution apparatus 800 can execute the content CNT There is no. For example, the PC 810 of the content executing apparatus 800 compares the information on the permitted user FUSER1 included in the content CNT with the user information of the content executing apparatus 800. Since they do not coincide with each other, ) Can not be executed.

For example, the server 400 may transmit content (CNT) to which the digital rights management (DRM) is applied to the second communication network 600. Therefore, only the content executing apparatus 700 corresponding to the permitted user FUSER1 can execute the content (CNT) using the DRM.

The PC 710 of the content executing apparatus 700 corresponding to the permitted user FUSER1 processes (e.g., demodulates or decodes) the content CNT = CNT2 including the video data VD and the motion data MD The video data VD and the motion data MD can be separated from the content (CNT = CNT2) (S180).

The PC 710 transmits the video data VD to the HMD 720 in step S185 and transmits the motion data MD to the motion simulator 730 in step S190. The video data VD transmitted to the HMD 720 and the motion data MD transmitted to the motion simulator 730 are data synchronized with each other according to the time information included in the content CNT = CNT2.

The PC 710 of the content execution device 700 includes the video data VD, the audio data AD, and the motion data MD when the content CNT = CNT2 further includes audio data AD. The audio data AD, and the motion data MD from the contents CNT = CNT2 by processing (for example, demodulating or decoding) the contents (CNT = CNT2)

The PC 710 transmits the video data VD to the HMD 720, transmits the motion data MD to the motion simulator 730, and transmits the audio data AD to the speaker 740. The video data VD transmitted to the HMD 720, the motion data MD transmitted to the motion simulator 730 and the audio data AD transmitted to the speaker 740 are included in the content CNT = CNT2 Data synchronized with each other according to time information.

The user of the content execution apparatus 700 corresponding to the permitted user FUSER1 operates the PC 710 or the simulator 730 so that the PC 710 or the simulator 730 can control the configuration of the content acquisition apparatus 200 The control signals CTRL1-1 are transmitted to the second communication network 600 via the second communication network 600. The control signals CTRL1-1 and CTRL2-2 are transmitted to the second communication network 600 via the second communication network 600, (S192), and the control signal CTRL1-1 is transmitted to the content acquisition apparatus 200 through the first communication network 300 (S194).

The processor 250 of the content acquisition apparatus 200 may control at least one of the components 210, 220, 230, 240, and 255 according to the control signals CTRL1-1 (S196).

For example, the camera 210 may change the photographing direction under the control of the processor 250 operating in accordance with the control signals CTRL1-1 (S196). When the content acquisition device 200 is a drone, the actuator 255 is controlled by the processor 250 operating in accordance with the control signals CTRL1-1 to control the direction and speed of the drones, The rotor can be controlled (S196).

4 is a data flow for explaining the operation of the data providing service system shown in FIG. 1 to 4, a first user of the first content executing apparatus 700 is a user (FUSER1) registered as an authorized user in the server 400, and a second user of the second content executing apparatus 800 Is a user who is not registered as an authorized user in the server 400.

The first user transmits the first user information to the PC 710 of the first content executing apparatus 700 while the first content executing apparatus 700 and the server 400 are connected to each other via the second communication network 600 , The PC 710 transmits the first user information to the server 400 (S171). The processor 410 of the server 400 searches the memory 420 or the database 500 based on the first user information and determines whether the first user is the registered user FUSER1 at step S173. When the first user is a registered user (FUSER1), the processor 410 of the server 400 executes the first content execution in real time to live stream the content (CNT = CNT2) transmitted from the content acquisition apparatus 200 To the device 700 (S170).

In other words, the server 400 judges with reference to the content 420 whether the content (CNT = CNT2) is to be live streamed to the content executing apparatus with reference to whether or not the content is to be released, the content transmission mode, And transmits the content (CNT = CNT2) to the determined content execution apparatus in real time according to the determination result (S170).

The second user transmits the second user information to the PC 810 of the second content execution apparatus 800 while the second content execution apparatus 800 and the server 400 are connected to each other via the second communication network 600. [ , The PC 810 transmits the second user information to the server 400. [

When the second user is authenticated as a user who can receive VOD streaming by the server 400, the second user retrieves the content from the database 500 accessible by the server 400 using the PC 810, The content (CNT = CNT1) to be VOD streamed is selected (S210). The processor 410 of the server 400 retrieves the content CNT = CNT1 from the database 500 and streams the content CNT1 CNT1 at step S230.

The PC 810 of the content execution apparatus 800 processes (e.g., demodulates or decodes) a content (CNT = CNT1) including the video data VD and the motion data MD, The data VD and the motion data MD can be separated from each other (S240).

The PC 810 transmits the video data VD to the HMD 820 (S250), and transmits the motion data MD to the motion simulator 830 (S260). The video data VD transmitted to the HMD 820 and the motion data MD transmitted to the motion simulator 830 are data synchronized with each other according to the time information included in the content CNT = CNT1.

The PC 810 of the content execution apparatus 800 includes the video data VD, the audio data AD, and the motion data MD when the content CNT = CNT1 further includes audio data AD. The audio data AD, and the motion data MD from the contents CNT1 CNT1 by processing (e.g., demodulating or decoding) the contents CNT1 CNT1 that are the contents CNT1 CNT1.

The PC 810 transmits the video data VD to the HMD 820 and transmits the motion data MD to the motion simulator 830 and the audio data AD to the speaker 840. [ The video data VD sent to the HMD 820, the motion data MD sent to the motion simulator 830 and the audio data AD sent to the speaker 840 are stored in the content CNT = CNT1 Data synchronized with each other according to time information.

The user of the content execution apparatus 700 corresponding to the permitted user FUSER1 operates the PC 710 or the simulator 730 so that the PC 710 or the simulator 730 can control the configuration of the content acquisition apparatus 200 The control signals CTRL1-2 may be transmitted to the second communication network 600 via the second communication network 600 by generating control signals CTRL1-2 for controlling at least one of the elements 210, 220, 230, 240, The control signal CTRL1-2 is transmitted to the content acquisition apparatus 200 through the first communication network 300 (S264).

The processor 250 of the content acquisition apparatus 200 may control at least one of the components 210, 220, 230, 240, and 255 according to the control signals CTRL1-2 (S266).

For example, the camera 210 may change the photographing direction under the control of the processor 250 operating in accordance with the control signals CTRL1-2 (S266). When the content acquisition device 200 is a drone, the actuator 255 is controlled by the processor 250, which operates in accordance with the control signals CTRL1-2, to control the direction and speed of the drones, The rotor can be controlled (S266).

3 and 4, a control signal generated by the content acquisition apparatus 200 and a control signal CTRL1-1 or CTRL1 (CTRL1-1) transmitted from the content execution apparatus 700 are generated in accordance with an operation of the user of the content acquisition apparatus 200, (Or rotation) of the content acquisition apparatus 200 to the right when the content acquisition apparatus 200 conflicts with the content acquisition apparatus 200 (e.g., the intention of the user of the content acquisition apparatus 200 to move the content acquisition apparatus 200 to the left The processor 250 may determine which control signal to process first by referring to the control policy stored in the memory 245. In this case,

For example, when the control policy assigns a priority to the control signal according to the intention of the user of the content acquisition apparatus 200, the processor 250 generates a control signal according to the control signal according to the intention of the user of the content acquisition apparatus 200 At least one of the elements 210, 220, 230, 240, and 255 may be controlled.

However, when the control policy assigns priority to the control signals CTRL1-1 or CTRL1-2 transmitted from the content execution apparatus 700, the processor 250 sets the control signals CTRL1-1 or CTRL1-2 to And may control at least one of the components 210, 220, 230, 240, and 255.

A device 900 that does not include a simulator such as a smart phone can receive video data VD and / or audio data AD via a second communication network 600 that can communicate with the server 400, It is possible to reproduce the data VD and / or the audio data AD.

5 is a data flow for explaining the operation of the data providing service system shown in FIG.

1, 2, and 5, the user of the content acquisition apparatus 200 sets a content transmission mode (S310). The set content transmission mode is any one of a VOD streaming mode, a live streaming mode, and a mixed mode.

The content acquisition apparatus 200 generates video data VD using the video signal AS photographed by the camera 210 at S320 and the content acquisition apparatus 200 transmits the video data VD to the sensors 230 and 240 The motion data MD is generated using the values (ACS and AGS) measured by the motion estimation unit 350 (S330). According to the embodiment, the content obtaining apparatus 200 may further generate the audio data AD using the audio signal AS obtained from the microphone 220 as well as the motion data MD (S340).

The processor 250 of the content acquisition apparatus 200 can generate the content CNT including the mode information CTM for the content transmission mode set by the user and transmit the content CNT to the server 400 (S350).

The content CNT includes the video data VD and the motion data MD synchronized with each other or includes the video data VD synchronized in time with each other, the audio data AD, and the motion data MD do.

When the content CNT is received by the server 400, the processor 410 of the server 400 interprets the mode information CTM (S355). When the mode information CTM indicates VOD streaming (YES in S357), the server 400 receives the content CNT transmitted from the content obtaining apparatus 200 and stores it in the database 500 (S360).

When the mode information CTM indicates live streaming (NO in S357), the server 400 bypasses the content CNT transmitted from the content acquisition apparatus 200 (i.e., does not store it in the database 500) To the second communication network 600 (S365). That is, the server 400 performs live streaming of the content (CNT) transmitted from the content obtaining apparatus 200 to the corresponding content executing apparatus 700 (S365).

When the mode information CTM indicates a mixed mode including live streaming and VOD streaming (NO in S357), the server 400 stores the content CNT transmitted from the content obtaining apparatus 200 in the database 500 (CNT) to the second communication network 600 in parallel.

When the content CNT further includes the audio data AD, the PC 710 of the content executing apparatus 700 transmits the content data including the video data VD, the audio data AD, and the motion data MD (E.g., demodulate or decode) CNTs (CNT = CNT2) and separate the video data VD, audio data AD, and motion data MD from the content CNT (S370).

The PC 710 transmits the video data VD to the HMD 720 in S375 and transmits the audio data AD to the speaker 740 in S380 and outputs the motion data MD to the motion simulator 730. [ (S385). The video data VD transmitted to the HMD 720, the motion data MD transmitted to the motion simulator 730 and the audio data AD transmitted to the speaker 740 are supplied to the time information As shown in Fig.

The device 900 may be implemented as a smart phone, a tablet PC, or a mobile Internet device. When a user of the device 900 is a person associated with the first user of the first content execution device 700 (such as a protector, a friend, or an acquaintance) (CNT = CNT2) to the device 900 while live streaming the content (CNT = CNT2) to the first content execution device 700 by registering the content (VD) and / or audio data (AD) contained in the video data (VD). Therefore, a user of the apparatus 900 that can not use the motion simulator 730 can select video data VD and / or audio data (CNT = CNT1) among contents (CNT = CNT2) experienced by the first user of the first content execution apparatus 700 AD) can be experienced.

Further, when the user of the device 900 is a person (such as a guardian, friend, or acquaintance) who is associated with the second user of the second content execution device 800, (CNT = CNT1) to the second content execution apparatus 800 while registering the content CNT1 (e.g., a telephone number or an IP address) in the server 400, = CNT1) and / or the audio data (AD). Therefore, the user of the apparatus 900 that can not use the motion simulator 830 can select the video data VD and / or audio data (CNT = CNT1) among the contents (CNT = CNT1) experienced by the second user of the second content execution apparatus 800 AD) can be experienced.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

100: Data (or contents) providing service system
200: Content acquisition device
300: first communication network
40: Server
500: Database
600: second communication network
700: first content execution device
710, 810: PC
720, 820: Head-mounted display
730, 830: Motion simulator
740, 840: Speaker
800: second content execution device

Claims (10)

A service method for providing a content using a content acquisition device, a server, and a content execution device,
Generating video data by using the camera of the content acquiring device, generating motion data by measuring the angular velocity and acceleration of the content acquiring device using sensors of the content acquiring device, synchronizing the video data and the motion data with each other Generating content based on the content;
The server reading a first setting signal from a memory;
When the first setting signal indicates VOD streaming, the server receives the content transmitted from the content obtaining apparatus and stores the received content in a database, and when the first setting signal instructs live streaming, Receiving the content transmitted from the device and live streaming the content to the content executing device; And
Wherein the content execution apparatus separates the video data and the motion data from the content to be streamed live, transmits the video data to a head mounted device (HMD), and transmits the motion data to the motion And transmitting the content to a simulator. The method according to claim 1,
The content acquisition apparatus generating the first setting signal and transmitting the first setting signal to the server; And
And the server storing the first setting signal in the memory. The method according to claim 1,
Generating audio data using a microphone of the content acquisition device, generating the content by synchronizing the video data, the audio data, and the motion data; And
The content execution apparatus separates the video data, the audio data, and the motion data from the content that is live streamed from the server, transmits the video data to the HMD, transmits the audio data to the speaker, And transmitting the motion data to the motion simulator. The method of claim 3,
The server receiving the content including the video data, the audio data, and the motion data from the content acquiring device; And
Further comprising the step of the server receiving the content transmitted from the content acquiring device and live streaming to the content executing device and transmitting the video data and the audio data included in the content to the smartphone Service method. The method according to claim 1,
The server receiving a control signal from the content executing apparatus and transmitting the control signal to the content obtaining apparatus; And
And the content acquisition device controls an actuator included in the content acquisition device based on the control signal. 6. The method of claim 5,
The content acquisition apparatus further includes a step of determining, in accordance with a control policy, which control signal is to be executed first from the control signal generated in accordance with the input of the user of the content acquisition apparatus and the control signal transmitted from the content execution apparatus Service content. A service method for providing a content using a content acquisition device, a server, and a content execution device,
Setting a content transmission mode using the content acquisition device;
Generating motion data by measuring angular velocity and acceleration of the content acquisition apparatus using sensors of the content acquisition apparatus, generating mode data including the content transfer mode, , Generating the video data, and the content including the motion data;
The server receiving the content transmitted from the content acquiring device;
Determining the mode information by the server;
When the mode information indicates VOD streaming, the server receives the content and stores the content in a database. When the mode information indicates live streaming, the server bypasses the content and performs live streaming to the content execution device step; And
Wherein the content execution apparatus separates the video data and the motion data from the content to be streamed live, transmits the video data to a head mounted device (HMD), and transmits the motion data to the motion And transmitting the content to a simulator. 8. The method of claim 7,
The server receiving a control signal from the content executing apparatus and transmitting the control signal to the content obtaining apparatus; And
And the content acquisition device controls an actuator included in the content acquisition device based on the control signal. 9. The method of claim 8,
The content acquisition apparatus further includes a step of determining, in accordance with a control policy, which control signal is to be executed first from the control signal generated in accordance with the input of the user of the content acquisition apparatus and the control signal transmitted from the content execution apparatus Service content. A content acquiring device including a camera, sensors, and an actuator;
A content execution device including an HMD (head mounted device) and a motion simulator; And
And a server for exchanging data with the content acquiring device via a first communication network and exchanging data with the content executing device through a second communication network,
Wherein the content acquisition apparatus generates video data using the camera, generates motion data by measuring the angular velocity and acceleration of the content acquisition apparatus using the sensors, synchronizes the video data and the motion data, And transmit the content to the server via the first communication network,
The server reads a setting signal from the memory, receives the content transmitted from the content acquiring device when the read first setting signal indicates VOD streaming, stores the received content in a database, and the first setting signal performs live streaming Receiving the content transmitted from the content acquiring device when instructed and live streaming the content to the content executing device,
Wherein the content execution device separates the video data and the motion data from the live streamed content and transmits the video data to the HMD and transmits the motion data to the motion simulator to control the motion of the motion simulator Service system.

Images