KR20180107437A - Method and apparatus for controling streaming quality through determination of interest - Google Patents

Abstract

The present invention relates to a method for controlling streaming quality. More specifically, the present invention relates to a method for controlling streaming quality through interest image determination and a device therefor, which determine whether an interest image is captured by using sensing information for a movement state at the time of capturing and adjust streaming quality to provide a streaming service, when providing the streaming service to a streaming image receiving device such as a content provider, a broadcasting provider or a terminal by streaming the captured image in real time. Therefore, the present invention can efficiently provide the streaming service in a limited network situation and can improve image quality interested in a user.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a streaming quality control method,

The present invention relates to a streaming quality control method, and more particularly, to a streaming quality control method in which, when a streaming service is provided to a streaming video receiving apparatus such as a content provider, a broadcasting company, And more particularly, to a streaming quality control method for determining a video of interest by using sensing information on a motion state and determining streaming quality by controlling a streaming quality according to the streaming quality.

The contents described in this section merely provide background information on the present embodiment and do not constitute the prior art.

Streaming refers to the transmission of content such as video or audio from a server to a client over a network, such as the Internet. The transmitted data is called streaming if it is treated as though water is flowing. The streaming server separates the contents into streaming data packets so that the contents can be transmitted to the network. The terminal recovers the received streaming data packets, restores them to their original form, and reproduces them. At this time, playback and packet reception occur simultaneously, and a series of related packets is called a stream.

In such a streaming service, demand for high-quality live broadcasting is gradually increasing. In particular, demand for real-time live streaming service is explosively increasing due to the spread of smartphones and the activation of one-person broadcasting.

Accordingly, a real-time live streaming service has been attracting attention, in which streams of images shot through a portable device connected to a camera are streamed in real time and transmitted to a streaming video receiving apparatus such as a user terminal such as a smart phone, a broadcasting company server, or a server of a content provider.

In the conventional video streaming apparatus for live streaming service, as shown in FIG. 1, a captured video is input (1000), and an encoding and a streaming data packet are generated for an input video (1002) And transmitted to the receiving apparatus (1003). In this case, the streaming quality of the input image is determined in consideration of the network state (1001), and streaming is performed without loss and delay by ensuring proper streaming quality according to a variable network state. By determining the network bandwidth and packet transmission delay time by transmitting the packets at regular intervals, we determined streaming quality appropriate to the network condition in real time. For reference, the streaming quality means the quality of a streaming data packet to be transmitted. Since the streaming data packet is the captured image data, it can be understood as the quality of the transmitted image. This streaming quality can be defined as the frame rate of the video data to be transmitted or the number of packets transmitted per frame.

However, if 5G technology is applied in the future, the network quality is improved due to the development of communication technology such that the delay and broadband data communication becomes possible. Accordingly, there is a need for a technology for providing a streaming service by increasing the streaming quality in the case of a video of interest, taking into account the state of the network and the presence or absence of a video of interest of the photographer. However, it is difficult to judge an image of interest based on the complexity of image processing.

Korean Patent Publication No. 10-2005-0047920, published on May 23, 2005 (name: adaptive streaming apparatus and method)

The present invention has been proposed in order to solve the conventional problems, and it is an object of the present invention to provide a method and apparatus for controlling streaming quality in consideration of not only the network state but also the interest image of the photographer.

Particularly, in the present invention, in determining whether the image is of interest, the user intends to use the sensing information of the motion of the user to photograph the image.

However, the object of the present invention is not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood from the following description.

According to another aspect of the present invention, there is provided a streaming quality control method including: receiving an image captured by an image capturing apparatus; Sensing information on a motion of a user who takes an image while the captured image is being input; Determining whether the image is of interest using sensing information of the motion; Determining a streaming quality for an input image according to the determination result of the interest image; Performing encoding on the input image according to the determined quality and generating a streaming data packet; And transmitting the streaming data packet to a streaming video receiving apparatus.

The step of determining whether or not the image of interest includes a step of calculating a change amount of the sensing information; Determining that the image is of interest if the amount of change of the sensing information is smaller than the threshold value and determining that the image is of no interest if the amount of change of the sensing information is larger than the threshold value.

In addition, the step of determining the streaming quality may improve the streaming quality in case of a video of interest and adjust the streaming quality by reducing a streaming quality in case of an uninteresting video.

Storing the streaming data packet in a streaming image buffer before the transmitting step; And varying the threshold value in consideration of an amount of packets stored in the streaming image buffer.

In addition, the sensing information may be at least one of acceleration, gyro, magnetic field, and air pressure.

Further, the present invention can provide a computer-readable recording medium on which a program for executing the above-described method is recorded.

Further, the present invention can provide a computer program stored in a computer-readable recording medium which is implemented to carry out the method as described above.

According to an aspect of the present invention, there is provided an image transmission apparatus including: an image input unit receiving an image; A sensor unit for sensing information on a motion of a user photographing the input image; Determining whether the video is of interest based on the sensing information of the motion, determining a streaming quality of the input video according to the determination result, encoding the input video according to the determined quality, and generating a streaming data packet ; And a transmitting unit for transmitting the streaming data packet to a streaming video receiving apparatus.

The control unit may calculate a change amount of the sensing information to improve the streaming quality by judging the change amount of the sensing information to be an image of interest if the variation amount of the sensing information is less than the threshold value, It can be judged as an image and the streaming quality can be reduced to control the streaming quality.

The apparatus may further include a streaming image buffer for storing the streaming data packet before transmission, and the controller may variably control the threshold value in consideration of the amount of packets stored in the streaming image buffer.

According to the streaming quality control method and apparatus for performing the image determination of interest of the present invention, streaming quality can be determined by reflecting not only the network state but also the interest image of the user who shoots the image, so that streaming quality can be efficiently streamed Service can be provided, and the quality of the image of interest can be improved by the user.

Particularly, the present invention determines whether a video of interest is based on sensing information about a motion of a user who shoots an image without complicated image processing, thereby transmitting an image of interest to a photographer in a real-time live broadcast with high quality, The missing video can be transmitted with lower quality.

In addition, according to the present invention, by adjusting a threshold value for discriminating a video of interest according to the amount of a streaming data packet stored in the streaming video buffer for streaming transmission, the amount of transmission can be appropriately adjusted considering the network state, It is possible to control the streaming quality according to the video of interest, while using a certain level of network bandwidth.

In addition, various effects other than the above-described effects can be directly or implicitly disclosed in the detailed description according to the embodiment of the present invention to be described later.

1 is a block diagram illustrating a conventional streaming service process considering only a network state.
2 is a diagram illustrating a streaming service system according to an embodiment of the present invention.
3 is a block diagram of a video transmission apparatus for streaming quality control according to an embodiment of the present invention.
4 is an exemplary view illustrating an example in which an image transmission apparatus according to an embodiment of the present invention is installed.
5 and 6 are diagrams illustrating an example of a process of calculating a change amount of sensing information according to an embodiment of the present invention.
7 is a block diagram illustrating a streaming service process through streaming quality control according to an embodiment of the present invention.
FIG. 8 is a flowchart illustrating a streaming quality determination process using sensing information according to an embodiment of the present invention.
9 is a flowchart illustrating a threshold value control process according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS For a more complete understanding of the nature and advantages of the present invention, reference should be made to the following detailed description taken in conjunction with the accompanying drawings, in which:

In the following description and the accompanying drawings, detailed description of well-known functions or constructions that may obscure the subject matter of the present invention will be omitted. It should be noted that the same constituent elements are denoted by the same reference numerals as possible throughout the drawings.

The terms and words used in the following description and drawings are not to be construed in an ordinary sense or a dictionary, and the inventor can properly define his or her invention as a concept of a term to be described in the best way It should be construed as meaning and concept consistent with the technical idea of the present invention. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention, and not all of the technical ideas of the present invention are described. Therefore, It is to be understood that equivalents and modifications are possible.

Also, terms including ordinal numbers such as first, second, etc. are used to describe various elements, and are used only for the purpose of distinguishing one element from another, Not used. For example, without departing from the scope of the present invention, the second component may be referred to as a first component, and similarly, the first component may also be referred to as a second component.

In addition, when referring to an element as being "connected" or "connected" to another element, it means that it can be connected or connected logically or physically. In other words, it is to be understood that although an element may be directly connected or connected to another element, there may be other elements in between, or indirectly connected or connected.

Also, the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. It is also to be understood that the terms such as " comprising "or" having ", as used herein, are intended to specify the presence of stated features, integers, It should be understood that the foregoing does not preclude the presence or addition of other features, numbers, steps, operations, elements, parts, or combinations thereof.

In addition, embodiments within the scope of the present invention include computer-readable media having computer-executable instructions or data structures stored on computer-readable media. Such computer-readable media can be any available media that is accessible by a general purpose or special purpose computer system. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or in the form of computer- But is not limited to, a physical storage medium such as any other medium that can be used to store or communicate certain program code means of the general purpose or special purpose computer system, .

In the following description and claims, "network" or "communication network" is defined as one or more data links that allow electronic data to be transmitted between computer systems and / or modules. When the information is transmitted or provided to a computer system via a network or other (wired, wireless, or a combination of wired or wireless) communication connection, the connection may be understood as a computer-readable medium. Computer readable instructions include, for example, instructions and data that cause a general purpose computer system or special purpose computer system to perform a particular function or group of functions. The computer executable instructions may be binary, intermediate format instructions, such as, for example, assembly language, or even source code.

The invention may also be practiced in distributed systems environments where both local and remote computer systems linked by a combination of wired data links, wireless data links, or wired and wireless data links over a network perform tasks. In a distributed system environment, program modules may be located in local and remote memory storage devices.

In addition, the streaming service described in this specification means providing various types of contents such as audio or moving pictures in a streaming manner. Particularly, a streaming quality is determined using a portable device connected to a photographing device, and a streaming service is provided. The portable device is described herein as an image transmission device.

Hereinafter, a main configuration of a streaming service system through streaming quality control according to an embodiment of the present invention will be described first.

2 is a diagram illustrating a streaming service system according to an embodiment of the present invention.

2, a streaming service system according to an embodiment of the present invention may include an image transmission apparatus 100 connected through a communication network 300 and a plurality of streaming image receiving apparatuses 200, The apparatus 100 is connected to the photographing apparatus 400.

The photographing apparatus 400 may be connected to the outside of the image transmitting apparatus 100 via a cable such as HDMI or may be connected to the inside of the image transmitting apparatus 100 As shown in FIG.

The image transmission apparatus 100 refers to a portable apparatus that receives an image captured by the image capturing apparatus 400, forms a streaming data packet after encoding the input image, and transmits the streaming data packet to the streaming image receiving apparatus 200. A detailed description thereof will be described later.

The streaming video receiving apparatus 200 receives a streaming data packet transmitted from the video transmitting apparatus 100. The streaming video receiving apparatus 200 holds content such as a content provider server or a broadcast provider server, Or a user terminal device such as a smart phone or a PC.

That is, the streaming video receiving apparatus 200 may be a third server that holds and manages contents, and may be implemented as a web server or a web application server (WAS) , A device that holds broadcast data transmitted from a broadcast station head end device (not shown) such as a professional baseball relay broadcast, a world cup relay broadcast, or the like to a terminal. Alternatively, the streaming video receiving apparatus 200 may be a terminal device of a user, such as a smart phone or a PC, that receives and streams an image captured by a photographer in real time without performing secondary processing.

A processor mounted on each device according to an embodiment of the present invention may process program instructions for executing the method according to the present invention. In one implementation, the processor may be a single-threaded processor, and in other embodiments, the processor may be a multithreaded processor. Further, the processor is capable of processing instructions stored on a memory or storage device.

In addition, the communication network 300 according to the embodiment of the present invention refers to a communication network for transmitting and receiving information between the video transmission apparatus 100 and the streaming video reception apparatus 200. In particular, A communication network implemented using various types of wired / wireless communication technologies such as an intranet network, a mobile communication network, and a satellite communication network may be mixed.

Here, the communication network 300 may include an external network such as an Internet network (not shown) connected to a mobile network including a plurality of wired / wireless access networks (not shown) and a core network (not shown). The wired / wireless access network (not shown) constituting the mobile network includes a plurality of base stations such as a base station (BS), a base transceiver station (BTS), a NodeB, and an eNodeB, a base station controller (BSC) Radio Network Controller).

Alternatively, the digital signal processing unit and the radio signal processing unit integrally implemented in the base station may be divided into a digital unit (hereinafter referred to as DU) and a radio unit (hereinafter referred to as RU) A plurality of RUs (not shown) may be provided in each of the regions, and a plurality of RUs (not shown) may be connected to a centralized DU (not shown).

In addition, a core network (not shown) constituting a mobile network together with a wired / wireless access network (not shown) performs a role of connecting a wired / wireless access network (not shown) and an external network such as an Internet network (not shown).

As described above, the core network (not shown) is a network system that performs main functions for mobile communication services such as mobility control and switching between wired / wireless access networks (not shown). The core network includes circuit switching or packet switching packet switching, and manages and controls packet flow within the mobile network. The core network (not shown) manages inter-frequency mobility and plays a role for interworking with traffic in an access network (not shown) and a core network (not shown) and other networks such as the Internet It is possible. The core network (not shown) may further include a Mobile Switching Center (MSC), a Home Location Register (HLR), a Mobile Mobility Entity (MME), and a Home Subscriber Server (HSS).

The internet network (not shown) refers to a public network, that is, a public network, in which information is exchanged according to the TCP / IP protocol. The internet network is connected to the image transmission apparatus 100, And provides the streaming data to the streaming video receiving apparatus 200 via a core network (not shown) and a wire / wireless access network (not shown).

The communication network 300 may be a closed type network such as a LAN (Local Area Network) or a WAN (Wide Area Network), an open network such as the Internet, a Code Division Multiple Access (CDMA) Multiple Access, GSM (Global System for Mobile Communications), LTE (Long Term Evolution), and EPC (Evolved Packet Core).

Hereinafter, the main configuration and operation of the image transmission apparatus 100 according to the embodiment of the present invention will be described with reference to FIG. 3 to FIG.

FIG. 3 is a diagram illustrating a configuration of an image transmission apparatus 100 for streaming quality control according to an embodiment of the present invention, and FIG. 4 illustrates an example in which an image transmission apparatus 100 according to an embodiment of the present invention is installed Fig.

3, an image transmission apparatus 100 according to an exemplary embodiment of the present invention includes a control unit 110, an image input unit 120, a storage unit 130, a sensor unit 140, and a transmission unit 150 And the storage unit 130 may include an input image buffer 131 and a streaming image buffer 132.

The image input unit 120 receives the image data captured by the image capturing apparatus 400. The external image capturing apparatus 100 is provided separately from the image transmission apparatus 100, Output interface through a video input / output interface such as HDMI from the image capturing apparatus 400 or can receive image data from the image capturing apparatus 400 incorporated in the image transmitting apparatus 100. [ The images input in real time from the photographing apparatus 400 are sequentially stored in the input image buffer 131. [

The sensor unit 140 senses information on the motion of the user who performs image capturing, and senses at least one of acceleration, gyro, terrestrial system, and air pressure to detect movement of the user at the time of shooting . The sensing information is transmitted to the control unit 110, and the control unit 110 calculates the amount of change in the sensing information.

The control unit 110 receives the sensing information, calculates a change amount, and compares a change amount of the sensing information with a threshold value to determine a target image.

The degree of motion of the user can be determined by calculating the amount of change in the sensing information. The threshold value is a reference point for determining a target image in consideration of the degree of motion of a user who shoots the image. The threshold value may be initially set by the user or the video transmission apparatus 100 itself, and may then be variably controlled in consideration of other factors such as network bandwidth.

For example, if the user has a small amount of motion at the time of shooting, it can be considered that the user is shooting intensively when shooting the image. Therefore, if the user is walking while taking a picture while moving, A threshold value which is a reference point for the movement of the user is set in advance. If the amount of change in the sensing information is less than the threshold value, it is determined that the image is of interest. Otherwise, it is determined that the image is of no interest.

4 to 6, the image transmitting apparatus 100 may be installed in various directions at various positions according to the purpose of the user, as shown in FIG. 4. Referring to FIG. Do.

The image transmission apparatus 100 may be installed in a vertical direction as shown in FIGS. 4A and 4B and may be installed in a horizontal direction as shown in FIG. 4C. The calibration is performed as shown in FIG.

5 (a) shows a case of being installed in a horizontal direction (case 1) and a case of being installed in a vertical direction (case 2).

Heading information is calculated by a combination of acceleration, magnetic field and gyro sensor to obtain horizontal / vertical direction information irrespective of the installation direction of the image transmitting apparatus 100, and correction is performed based on the gravity direction at the time of the initial operation.

For example, if case 2 is corrected based on the x, y, and z axes of case 1, it can be expressed as shown in the table of FIG. 5 (b).

After the correction is performed based on a specific direction so as not to be influenced by the installation direction of the image transmitting apparatus 100, the amount of change in the sensing information is calculated to grasp the degree of movement of the user.

For example, when the acceleration is sensed, the change of the acceleration according to the photographing time can be graphically displayed as shown in FIG. 6. When the user moves at a constant speed, the acceleration value in the direction opposite to the moving direction as in the section A In the case of moving at a constant speed, there is no acceleration change. Therefore, as in the case of the section B, the acceleration value may appear in a direction moving as in the section C when the camera is stopped while moving. D is a case in which the acceleration value is random and therefore continues to move at a constant speed. The variation amount of the acceleration can be calculated by various methods such as the inclination of the graph showing the magnitude of the sensing value of the acceleration or the change of the acceleration or the area with respect to the time.

In the case where the user is taking a picture while stopped at a specific place, or continuously capturing while moving at a constant speed like a section B, the amount of change in the sensing information can be considered to be almost zero.

In addition, when the photographer rotates in a stationary state while photographing a peripheral image, if the gyro sensor is used together with the acceleration sensor, the acceleration sensing value will not change and the gyro sensing value will have a constant value. In this case, the change amount of the sensing information may be '0'.

Also, if you move by walking or running, the amount of change in sensing information will be relatively large.

Further, when the user operates the photographing apparatus 400, if the air pressure sensor is used together, the photographing height is relatively low and the movement is frequent, so that the change amount of the sensing information will be large.

The variation amount of the sensing information calculated by the various methods can be compared with the threshold value to determine the presence or absence of the image of interest.

If the user is relatively moving or moving at a constant speed, the change amount of the sensing information will be relatively small. If the change amount is smaller than the threshold value, it can be determined that the streaming quality is improved by determining it as a video of interest.

On the other hand, if the motion of the user at the time of shooting is large, the amount of change in the sensing information will be large. If the amount of change is larger than the threshold value, the streaming quality can be controlled to be determined as the non-interest image.

The streaming quality can be adjusted in various ways, such as adjusting the number of frames encoded per unit time, adjusting the resolution of the frame itself to be encoded, adjusting the amount of streaming data packets generated per unit time, adjusting the bandwidth of the encoder have.

In addition, the controller 110 performs encoding according to the streaming quality determined according to the determination of the interested video as described above, and generates a streaming data packet.

The storage unit 130 may store and manage various types of information necessary for the operation of the image transmission apparatus 100 according to an embodiment of the present invention.

The storage unit 130 may include a program area and a data area. The program area stores related information for driving the image transmission apparatus 100 such as an operating system (OS) for booting the image transmission apparatus 100. [ The data area is an area in which data generated according to use of the image transmission apparatus 100 is stored, and various commands for processing streaming data can be stored.

In particular, the storage unit 130 according to an exemplary embodiment of the present invention may include an input image buffer 131 and a streaming image buffer 132.

The input image buffer 131 is a storage space for temporarily storing the captured image input through the image input unit 120. The streaming image buffer 132 compresses the streaming data packet in which the encoded image is packetized into a streaming image receiving apparatus 200).

The sending unit 150 transmits the streaming data packet stored in the streaming image buffer 132 to the streaming image receiving apparatus 200 through a communication network.

The control unit 110 according to the embodiment of the present invention may control the streaming quality by considering the network state such as the network bandwidth by checking the remaining capacity of the streaming image buffer 132. [

When the transmission rate is low due to a bad network condition, streaming data packets are not transmitted to the streaming image buffer 132 and accumulated. When the transmission rate is high due to a good network condition, the streaming data packets are stably transmitted, The amount of streaming data packets accumulated in the streaming data stream 132 is reduced.

Accordingly, the present invention sets the capacity reference value of the streaming image buffer 132 in advance, and if the streaming data packet amount stored in the streaming image buffer 132 is smaller than the predetermined capacity reference value, the control unit 110 has a good network status , It is determined that the streaming quality can be further increased and the threshold value can be adjusted upward. If the streaming data packet amount is larger than the predetermined capacity reference value, the network state is not good. Therefore, the streaming quality is lowered, The value can be adjusted downward. The capacity reference value can be set in advance as a ratio of the available capacity such as 70% of the available capacity of the streaming image buffer 132 and the like.

The first threshold value and the capacity reference value for threshold image control may be set by the user or may be stored in the storage unit 130 in advance in the image transmission apparatus 100 itself have.

As described above, the video transmission apparatus 100 checks the remaining capacity of the streaming video buffer 132, which is encoded by the streaming video receiving apparatus 200 and temporarily stores the packetized streaming data packet before transmission, By variably controlling the streaming quality, it is possible to prevent the streaming quality from being continuously increased irrespective of the network state, and to use a certain level of network bandwidth.

Although the present specification and drawings describe exemplary device configurations, the functional operations and subject matter implementations described herein may be embodied in other types of digital electronic circuitry, or alternatively, of the structures disclosed herein and their structural equivalents May be embodied in computer software, firmware, or hardware, including, or in combination with, one or more of the foregoing. Implementations of the subject matter described herein may be embodied in one or more computer program products, i. E. One for computer program instructions encoded on a program storage medium of the type for < RTI ID = 0.0 & And can be implemented as a module as described above. The computer-readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter that affects the machine readable propagation type signal, or a combination of one or more of the foregoing.

7 is a block diagram illustrating a streaming service process through streaming quality control according to an embodiment of the present invention.

First, the image transmission apparatus 100 receives the photographed image (700), and stores the input image in the input image buffer 131. The input image is encoded according to the streaming quality to generate a streaming data packet 702. The streaming data packet is temporarily stored 704 in the streaming image buffer 132, (Step 706). However, according to the embodiment of the present invention, it is possible to determine whether a video of interest is based on sensing information of a motion of a user at the time of shooting, The quality is determined (708). That is, the control unit 110 of the image transmission apparatus 100 calculates the amount of change in the sensing information, compares it with a predetermined threshold value to determine whether the image is of interest, and encodes it per unit time The streaming quality is adjusted upward or downward by adjusting the number of frames to be played.

On the other hand, if the amount of change in the sensing information of the input image is small, the streaming quality becomes too high, which may cause a problem that the network bandwidth of the network 300 does not match the network state. Accordingly, by checking the remaining capacity of the streaming image buffer 132 in step 710, the amount of streaming data packets to be transmitted to the streaming video receiving apparatus 200 can be checked. Accordingly, the threshold value is adjusted 712, From increasing continuously. For example, if the number of frames to be encoded per unit time is high due to high streaming quality, the amount of streaming data packets generated thereby increases, and the amount of streaming data packets waiting to be transmitted to the streaming image buffer 132 is equal to or greater than a predetermined capacity reference value By lowering the threshold value, even if the amount of change in the sensing information is relatively small, it can be judged that the image is not interested, exceeding the threshold value. In this case, the streaming quality is automatically adjusted downwardly. The network state can be considered.

FIG. 8 is a flowchart illustrating a streaming quality determination process using sensing information according to an embodiment of the present invention, and is a more detailed process related to the process 708 of FIG.

Referring to FIG. 8, a motion of the user of the photographing apparatus 400 at the time of photographing is sensed through the sensor unit 140 of the image transmitting apparatus 100 (S800). The movement of the user may be achieved by using any one of acceleration, gyro, magnetic field and air pressure sensor, or a combination of two or more.

The image transmitting apparatus 100 calculates a change amount of the sensing information in order to grasp the degree of movement of the user (S802). In order to calculate the change amount of the sensing information, first, calibration is performed so that the image transmission apparatus 100 has a constant reference direction regardless of whether the image transmission apparatus 100 is installed in the horizontal direction or the vertical direction, and the size of the sensing value itself, The amount of change of the sensing information is calculated.

If the calculated variation is smaller than the threshold value, the variation is relatively small. Thus, the variation can be regarded as a video captured with almost no motion, (S806).

On the other hand, if the amount of change is not smaller than the threshold value, the amount of change is relatively large, and it can be considered that the motion at the time of shooting is frequent, so that it can be determined as an unattractive image and the streaming quality can be reduced (S808).

The adjustment of the streaming quality such as improvement or reduction of the streaming quality may be any one of a method of adjusting the number of frames to be encoded per unit time, a method of adjusting the number of streaming data packets generated per unit time, or a method of adjusting the bandwidth of the encoder, The present invention is not limited to the above-described examples, and various methods can be used.

FIG. 9 is a flowchart illustrating a threshold value control process according to an exemplary embodiment of the present invention, and illustrates a process related to steps 710 and 712 of FIG. 7 in more detail.

9, the streaming data packet is temporarily stored in the streaming image buffer 132 before being transmitted to the streaming image receiving apparatus 200, so that the streaming image buffer 132 can use a predetermined level of network bandwidth, (S900). To this end, the streaming data packet amount stored in the streaming image buffer 132 is compared with a preset capacity reference value (S902).

If the stored packet amount is smaller than the capacity reference value, there is a room for improving the streaming quality, so the threshold value is adjusted upward (S904). Accordingly, even if the amount of change in the sensing information becomes a little larger, the quality of the streaming can be improved by judging it as a video of interest.

On the other hand, if the stored packet amount is larger than the capacity reference value, the threshold value is adjusted down to reduce the streaming quality to use a certain level of network bandwidth (S906).

The streaming quality control method based on the determination of the image of interest according to the embodiment of the present invention has been described above.

The streaming quality control method of the present invention may be provided in the form of computer readable media suitable for storing computer program instructions and data.

In order to allow a computer to read a program recorded on a recording medium and to execute functions implemented by the program, the above-mentioned program may be stored in a computer-readable medium such as C, C ++, JAVA, machine language, and the like.

The code may include a function code related to a function or the like that defines the functions described above and may include an execution procedure related control code necessary for the processor of the computer to execute the functions described above according to a predetermined procedure. In addition, such code may further include memory reference related code as to what additional information or media needed to cause the processor of the computer to execute the aforementioned functions should be referenced at any location (address) of the internal or external memory of the computer . In addition, when a processor of a computer needs to communicate with any other computer or server that is remote to execute the above-described functions, the code may be stored in a memory of the computer using a communication module of the computer, It may further include a communication-related code such as how to communicate with another computer or a server, and what information or media should be transmitted or received during communication.

Such computer-readable media suitable for storing computer program instructions and data include, for example, magnetic media such as hard disks, floppy disks and magnetic tape, compact disk read only memory (CD-ROM) Optical media such as a DVD (Digital Video Disk), a magneto-optical medium such as a floppy disk, and a ROM (Read Only Memory), a RAM , Random Access Memory), flash memory, EPROM (Erasable Programmable ROM), and EEPROM (Electrically Erasable Programmable ROM). The processor and memory may be supplemented by, or incorporated in, special purpose logic circuits.

The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. The functional program for implementing the present invention and the related code and code segment may be implemented by programmers in the technical field of the present invention in consideration of the system environment of the computer that reads the recording medium and executes the program, Or may be easily modified or modified by the user.

While the specification contains a number of specific implementation details, it should be understood that they are not to be construed as limitations on the scope of any invention or claim, but rather on the description of features that may be specific to a particular embodiment of a particular invention Should be understood. Certain features described herein in the context of separate embodiments may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented in multiple embodiments, either individually or in any suitable subcombination. Further, although the features may operate in a particular combination and may be initially described as so claimed, one or more features from the claimed combination may in some cases be excluded from the combination, Or a variant of a subcombination.

Likewise, although the operations are depicted in the drawings in a particular order, it should be understood that such operations must be performed in that particular order or sequential order shown to achieve the desired result, or that all illustrated operations should be performed. In certain cases, multitasking and parallel processing may be advantageous. Also, the separation of the various system components of the above-described embodiments should not be understood as requiring such separation in all embodiments, and the described program components and systems will generally be integrated together into a single software product or packaged into multiple software products It should be understood.

The present invention relates to a streaming quality control method, and more particularly, to a streaming quality control method, a streaming quality control method, a streaming quality control method, And an apparatus therefor.

INDUSTRIAL APPLICABILITY The present invention can contribute to the development of the streaming service industry and is industrially applicable because it is not only a possibility of being commercially available or operating, but also can be practically and practically carried out.

100: Video transmission device
110:
120:
130:
131: input image buffer
132: Streaming image buffer
140:
150:
200: Streaming video receiving device
300: Network
400: photographing apparatus

Claims (10)

A video transmission apparatus,
Receiving a photographed image from a photographing apparatus;
Sensing information on a motion of a user who takes an image while the captured image is being input;
Determining whether the image is of interest using sensing information of the motion;
Determining a streaming quality for an input image according to the determination result of the interest image;
Performing encoding on the input image according to the determined quality and generating a streaming data packet; And
Transmitting the streaming data packet to a streaming video receiving apparatus;
The streaming quality control method comprising: The method according to claim 1,
The method of claim 1,
Calculating a change amount of the sensing information;
Determining that the image is of interest if the amount of change of the sensing information is less than a threshold value and determining that the image is of no interest if the amount of change of the sensing information is greater than a threshold value;
The streaming quality control method comprising: 3. The method of claim 2,
Wherein determining the streaming quality comprises:
Wherein the streaming quality is improved in case of a video of interest and the streaming quality is decreased in case of an uninteresting video. 3. The method of claim 2,
Before the transmitting step,
Storing the streaming data packet in a streaming image buffer; And
Varying the threshold value in consideration of an amount of packets stored in the streaming image buffer;
Lt; RTI ID = 0.0 > streaming quality control < / RTI > The method according to claim 1,
Wherein the sensing information is at least one of acceleration, gyro, magnetic field, and air pressure, or a combination of two or more. A computer-readable recording medium storing a program for executing the method according to any one of claims 1 to 5. A computer program embodied in computer readable recording medium which is embodied to execute the method recited in any one of claims 1 to 5. A video input unit for receiving a photographed image;
A sensor unit for sensing information on a motion of a user photographing the input image;
Determining whether the video is of interest based on the sensing information of the motion, determining a streaming quality of the input video according to the determination result, encoding the input video according to the determined quality, and generating a streaming data packet ; And
A transmitting unit for transmitting the streaming data packet to a streaming video receiving apparatus;
And an image processing unit for processing the image data. 9. The apparatus according to claim 8,
If the amount of change of the sensing information is less than the threshold value, it is determined that the image is of interest and the streaming quality is improved. If the amount of change of the sensing information is less than the threshold value, To adjust the streaming quality. 10. The method of claim 9,
A streaming image buffer for storing the streaming data packet before transmission;
Further comprising:
Wherein,
Wherein the control unit variably controls the threshold value in consideration of the amount of packets stored in the streaming image buffer.

Images