WO2019065296A1 - Appareil de contrôle de communication, procédé de contrôle de communication, programme, terminal de communication mpi (motion picture imaging), et terminal de communication mpr (motion picture reproducing) - Google Patents

Appareil de contrôle de communication, procédé de contrôle de communication, programme, terminal de communication mpi (motion picture imaging), et terminal de communication mpr (motion picture reproducing) Download PDF

Info

Publication number
WO2019065296A1
WO2019065296A1 PCT/JP2018/034128 JP2018034128W WO2019065296A1 WO 2019065296 A1 WO2019065296 A1 WO 2019065296A1 JP 2018034128 W JP2018034128 W JP 2018034128W WO 2019065296 A1 WO2019065296 A1 WO 2019065296A1
Authority
WO
WIPO (PCT)
Prior art keywords
communication
moving image
image data
power
sir
Prior art date
Application number
PCT/JP2018/034128
Other languages
English (en)
Japanese (ja)
Inventor
小川　一哉
Original Assignee
ソニー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニー株式会社 filed Critical ソニー株式会社
Publication of WO2019065296A1 publication Critical patent/WO2019065296A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W28/00—Network traffic management; Network resource management
    • H04W28/02—Traffic management, e.g. flow control or congestion control
    • H04W28/06—Optimizing the usage of the radio link, e.g. header compression, information sizing, discarding information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W28/00—Network traffic management; Network resource management
    • H04W28/16—Central resource management; Negotiation of resources or communication parameters, e.g. negotiating bandwidth or QoS [Quality of Service]
    • H04W28/18—Negotiating wireless communication parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/06—Selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS]; Services to user groups; One-way selective calling services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W52/00—Power management, e.g. TPC [Transmission Power Control], power saving or power classes
    • H04W52/04—TPC
    • H04W52/18—TPC being performed according to specific parameters

Definitions

  • the present disclosure relates to a communication control device, a communication control method, a program, a moving image imaging communication terminal, and a moving image reproduction communication terminal, and in particular, a communication control device and a communication control method which can suppress communication power.
  • the present invention relates to a program, a video imaging communication terminal, and a video reproduction communication terminal.
  • an imaging system having a wireless communication function of transferring data obtained by compressing captured moving images via a wireless communication system has been developed.
  • many playback systems have wireless communication functions, such as smartphones, that receive data distributed from a streaming server on a network via a wireless communication system and play moving images. It is being developed.
  • the consumption of communication power may increase due to the signal to interference ratio (SIR) of the communication path.
  • SIR signal to interference ratio
  • the modulation method is selected to maintain the communication band from a plurality of modulation methods
  • the transmission power is increased to maintain the communication band when the SIR is poor
  • power consumption may increase.
  • Patent Document 2 when transmitting digital data using a transmission line such as a wireless LAN (Local Area Network), switching control of the data supply path is performed to reduce power consumption.
  • a transmission line such as a wireless LAN (Local Area Network)
  • switching control of the data supply path is performed to reduce power consumption.
  • the present disclosure has been made in view of such a situation, and enables to reduce communication power.
  • a communication control apparatus acquires a parameter having a correlation with at least one of a communication state and communication power from a wireless transmission apparatus that transmits and receives moving image data by performing wireless communication. And a restricting unit for restricting the quality of the moving image data before the communicable band decreases with the deterioration of the radio wave condition of the communication path according to the parameter.
  • a communication control method or program acquires a parameter correlated with at least one of communication state and communication power from a wireless transmission device that transmits and receives moving image data by performing wireless communication. And limiting the quality of the moving image data before the communicable band decreases with the deterioration of the radio wave condition of the communication path according to the parameters.
  • a parameter correlated with at least one of communication state and communication power is acquired from a wireless transmission device that transmits and receives moving image data by performing wireless communication, and communication is performed according to the parameter
  • the quality of the moving image data is limited before the communicable band decreases with the deterioration of the radio wave condition on the road.
  • a moving picture imaging communication terminal includes: an imaging apparatus for acquiring moving picture data by capturing a moving picture; and a wireless transmission apparatus for transmitting moving picture data by performing transmission by wireless communication; A parameter having a correlation with at least one of the communication state and the communication power is acquired from the wireless transmission device, and the moving image data is acquired before the communicable band decreases according to the parameter according to the deterioration of the radio wave condition of the communication path. And a control unit for limiting the quality.
  • moving image data is acquired by capturing a moving image, transmission by wireless communication is performed, and moving image data is transmitted, which has a correlation with at least one of communication state and communication power.
  • a parameter is acquired, and according to the parameter, the quality of moving image data is limited before the communicable band decreases with the deterioration of the radio wave condition of the communication path.
  • a moving image reproduction communication terminal includes a display device that reproduces and displays a moving image, a wireless transmission device that performs transmission by wireless communication and receives moving image data, and the wireless transmission device.
  • a control that acquires a parameter correlated with at least one of the communication state and the communication power, and limits the quality of the moving image data before the communicable band decreases according to the parameter according to the deterioration of the radio wave condition of the communication path.
  • a moving image is reproduced and displayed, transmission by wireless communication is performed, moving image data is received, and a parameter correlated with at least one of the communication state and the communication power is acquired, According to the parameters, the quality of moving image data is limited before the communicable band decreases with the deterioration of the radio wave condition of the communication path. Then, when transmitting a request command to the moving image distribution server that distributes moving image data in order to reproduce and display the moving image, the quality of moving image data for which distribution is requested is limited.
  • communication power can be suppressed.
  • FIG. 1 is a block diagram showing a configuration example of an embodiment of a video imaging communication terminal to which the present technology is applied. It is a figure which shows the relationship between a communication zone
  • FIG. 1 is a block diagram showing a configuration example of an embodiment of a moving image reproduction communication terminal to which the present technology is applied. It is a block diagram which shows the structural example of a moving image delivery system. It is a flowchart explaining the example of processing which controls consumption of communication power based on SIR. It is a flowchart explaining the example of processing which controls consumption of communication electric power based on communication electric power information.
  • Fig. 21 is a block diagram illustrating a configuration example of an embodiment of a computer to which the present technology is applied.
  • FIG. 1 is a block diagram showing a configuration example of an embodiment of a moving picture imaging communication terminal to which the present technology is applied.
  • the moving picture imaging communication terminal 11 shown in FIG. 1 has a function of capturing moving pictures and transmitting moving picture data obtained by compressing the moving pictures by wireless communication, and the imaging device 21, the image processing device 22, and the image compression A device 23, a wireless transmission device 24, a wireless antenna 25, and a control device 26 are provided.
  • the imaging device 21 includes, for example, an imaging device such as a complementary metal oxide semiconductor (CMOS) image sensor, and supplies to the image processing device 22 moving image data obtained by capturing a moving image by the imaging device. .
  • CMOS complementary metal oxide semiconductor
  • the imaging device 21 can start and stop the imaging in accordance with the imaging control information supplied from the control device 26, and a moving image of a predetermined frame rate and a predetermined image size set in the moving image pickup communication terminal 11. An image can be taken.
  • CMOS complementary metal oxide semiconductor
  • the image processing device 22 subjects the moving image data supplied from the imaging device 21 to various image processing such as development processing, correction processing, enlargement / compression processing and the like, and moving image data subjected to those image processing. Are supplied to the image compression device 23.
  • the image processing device 22 performs image processing to reduce the frame rate of moving image data, image processing to reduce the image size of moving image data, and the like according to the image processing control information supplied from the control device 26 It can be performed.
  • the image compression device 23 is an image such as JPEG (Joint Photographic Experts Group), MPEG 2 (Moving Picture Experts Group 2), H.264, H.265, etc. for moving image data subjected to image processing by the image processing device 22.
  • the amount of data is compressed by encoding according to the encoding algorithm.
  • the image compression device 23 supplies the encoded moving image data to the wireless transmission device 24.
  • the image compression device 23 can adjust the encoding bit rate (compression rate) at the time of encoding a moving image, and the encoding bit rate according to the compression rate control information supplied from the control device 26
  • the moving image data is encoded and the amount of data is compressed.
  • the image compression device 23 can also encode moving image data of a frame rate and an image size in accordance with the compression rate control information supplied from the control device 26.
  • the wireless transmission device 24 can perform wireless communication with various wireless communication systems (specifically, WiFi / 3G / LTE, etc.) with, for example, a wireless communication base station (not shown), and the wireless communication can be performed by the wireless communication
  • the moving image data supplied from the image compression device 23 is transmitted.
  • the wireless transmission device 24 when performing wireless communication with the wireless communication base station, performs communication band information indicating the communication band currently being used, and the communication state (channel state) and communication in wireless communication on the current communication path. It is possible to acquire at least one of the power and the communication parameter having correlation (association), and supply the acquired communication band information and communication parameter to the control device 26.
  • SIR indicating the ratio of interference power to signal power in the current communication channel
  • MCS Modulation and Coding Set
  • current Communication power information indicating communication power consumed to perform wireless communication in the communication path is used.
  • the wireless antenna 25 emits a stream signal of moving image data transmitted by the wireless transmission device 24 into space as an electromagnetic wave, and transmits moving image data to, for example, a wireless base station (not shown).
  • the control device 26 can control the entire moving image imaging communication terminal 11 by using the imaging control information, the image processing control information, and the compression rate control information as described above. For example, the control device 26 acquires communication parameters (SIR, MCS, or communication power information) from the wireless transmission device 24, and before the communicable band is lowered due to deterioration of the radio wave condition of the communication path, moving image data Control to limit the quality of the image (compression rate, frame rate, image size, etc.). Thereby, the control device 26 can suppress the communication power.
  • communication parameters SIR, MCS, or communication power information
  • FIG. 2 shows a general relationship between a communication band (bit rate) and communication power when the radio wave condition of the communication path is sufficiently good.
  • the communication power consumed by the wireless communication is proportional to the communication band, and when the radio wave condition of the communication path is sufficiently good, the communication power increases or decreases according to the amount of data to be transmitted per unit time. It will be.
  • the communication power consumed by the wireless communication may increase without being proportional to the communication band.
  • FIG. 3 shows the relationship between SIR and communication band (bit rate) and the relationship between SIR and communication power.
  • the moving picture imaging communication terminal 11 can perform wireless communication in a sufficiently good radio wave condition near the wireless communication base station. For example, as shown in FIG. 3, in the SIR value ST where the SIR is sufficiently large, wireless communication is performed in the designated band b0, which is the designated communication band, with the minimum power p0 having the smallest communication power. In addition, the moving image imaging communication terminal 11 changes the vicinity of the minimum power p0 from the SIR value ST to a predetermined SIR value s0 which can perform wireless communication in the designated band b0 without increasing the communication power. Wireless communication can be performed.
  • the moving picture imaging communication terminal 11 gets worse in the radio wave condition of the communication path as it leaves the wireless communication base station and the SIR becomes smaller than the SIR value s 0, the communication power is increased from the minimum power p 0 Communication control is performed to maintain the communication band of the designated band b0.
  • the moving picture imaging communication terminal 11 performs communication control such as changing the modulation scheme or increasing the transmission power, so that the radio wave condition of the communication path is such that the SIR becomes smaller than the SIR value s0. Even in this case, the communication band of the designated band b0 can be maintained.
  • the moving picture imaging communication terminal 11 has a predetermined SIR which is the upper limit of the communication power necessary to perform the maximum communication control such as changing the modulation scheme or increasing the transmission power.
  • the communication power can be increased according to the SIR up to the value s1.
  • the moving picture imaging communication terminal 11 performs maximum communication control such as changing the modulation scheme or increasing the transmission power. Even if it does, it becomes difficult to maintain the communication band of the designated band b0. Therefore, in this case, as shown in FIG. 3, the communication bandwidth decreases as the SIR value s0 decreases.
  • the communication power is increased or decreased.
  • the communication band of the designated band b0 is maintained.
  • the control device 26 monitors the SIR of the transmission path via the radio transmission device 24. For example, before the communication band falls from the designated band b0, that is, even if the SIR is larger than the SIR value s1, Control is performed to limit the compression rate by the image compression device 23. By reducing the amount of coded bits in this way, it is possible to avoid an increase in communication power before the communication bandwidth decreases, and as a result, it is possible to suppress communication power. Therefore, the consumption of communication power can be optimized as a whole of the video imaging communication terminal 11.
  • control device 26 sets, as a threshold value, an SIR determination reference value which is equal to or greater than the SIR value s0 and less than the SIR value s1, and when the SIR becomes smaller than the SIR determination reference value Control is performed to reduce the coding bit rate of data.
  • the SIR determination reference value is set in the vicinity (including s0) of the SIR value s0 between the SIR value s0 and the SIR value s1. Further, the SIR judgment reference value is set in the vicinity (larger than s0) of the SIR value s1 between the SIR value s0 and the SIR value s1 in the mode in which priority is given to transmission of a higher quality moving image. Ru.
  • the SIR determination reference value may be set to the moving image imaging communication terminal 11 from the outside using a network or the like.
  • FIG. 4 shows the relationship between SIR and communication band (bit rate) and the relationship between SIR and communication power. Further, in the example shown in FIG. 4, the above-described SIR determination reference value is set to the SIR value s0.
  • the moving picture imaging communication terminal 11 operates with the designated band b0 (or the maximum bit rate within the communicable band) and the minimum power p0. ing.
  • the SIR of the communication channel changes with the movement of the moving picture imaging communication terminal 11, and the SIR becomes smaller than the SIR value s0 set as the SIR judgment reference value.
  • the control device 26 performs moving image to perform communication in the limited band b0 'limited to the communication band smaller than the designated band b0. Control is performed on the image compression device 23 to reduce the data encoding bit rate.
  • the control device 26 controls so as not to limit the compression ratio of the moving image. Do. Therefore, the control device 26 can control the image compression device 23 so as to restore the coding bit rate of the moving image data, and can return to communication in the designated band b0.
  • control device 26 supplies imaging control information for instructing the imaging device 21 to start capturing a moving image, and processing is performed periodically when moving image data is output from the imaging device 21.
  • the control device 26 obtains the SIR from the communication parameters supplied from the wireless transmission device 24.
  • step S12 the control device 26 determines whether the SIR according to the current radio wave condition of the communication path is larger than the SIR determination reference value.
  • the SIR determination reference value the SIR value s0 described with reference to FIG. 4 may be used, or an SIR value (SIR value s1) set from the outside in advance for the moving picture imaging communication terminal 11 Larger values and SIR values less than or equal to s 0) may be used.
  • step S12 If it is determined in step S12 that the current SIR is larger than the SIR determination reference value, the process proceeds to step S13. That is, in this case, it is determined that the radio wave condition of the communication path is good and there is no possibility that the communication power may increase. Therefore, the control device 26 limits the encoding bit rate when encoding moving image data. It is decided to use the designated band b0 (see FIG. 4) without performing it.
  • step S12 determines whether the current SIR is larger than (is equal to or less than) the SIR determination reference value. If it is determined in step S12 that the current SIR is not larger than (is equal to or less than) the SIR determination reference value, the process proceeds to step S14. That is, in this case, it is determined that the communication power may be increased as the radio wave condition of the communication channel is deteriorated. Therefore, the control device 26 is configured to encode the moving image data. , And decide to use the limited band b0 '(see FIG. 4).
  • step S15 the control device 26 sets, as the compression rate control information, a target encoding bit rate when encoding moving image data. For example, when the process of step S13 is performed, the control device 26 sets the designated band b0 to the compression rate control information, and when the process of step S14 is performed, the limited band b0 'is compressed. Set in control information.
  • step S16 the control device 26 supplies, to the image compression device 23, the compression rate control information in which the target encoding bit rate is set in step S15.
  • the control device 26 can control the image compression device 23 to encode moving image data at a target encoding bit rate, and then the process is ended.
  • control device 26 can reduce the amount of coding bits by reducing the coding bit rate of moving image data, and therefore avoids an increase in communication power before the communication bandwidth decreases. As a result, communication power can be reduced.
  • steps S21 and S22 the same processes as steps S11 and S12 in FIG. 5 are performed.
  • step S22 If it is determined in step S22 that the current SIR is larger than the SIR determination reference value, the process proceeds to step S23.
  • the control device 26 does not limit the frame rate of moving image data to be transmitted from the moving image imaging communication terminal 11, and a predetermined frame rate (for example, Decide to use 120 fps).
  • step S22 when it is determined in step S22 that the current SIR is not larger than (is less than) the SIR determination reference value, the process proceeds to step S24.
  • the control device 26 places a limit on the frame rate of moving image data to be transmitted from the moving image imaging communication terminal 11, and reduces the frame rate lower than the frame rate originally set in the moving image imaging communication terminal 11 (for example, To use 60 fps).
  • step S25 a desired frame rate is set in the image processing control information and the compression rate control information.
  • the control device 26 sets a predetermined frame rate in the image processing control information and the compression rate control information when the process of step S23 is performed, and reduces the process when the process of step S24 is performed.
  • the set frame rate is set in the image processing control information and the compression rate control information.
  • step S26 the control device 26 supplies the image processing control information and the compression rate control information for which the frame rate is set in step S25 to the image processing device 22 and the image compression device 23, respectively.
  • the control device 26 can control the image processing device 22 so as to perform the image processing with the predetermined frame rate or to perform the image processing to reduce the frame rate.
  • the control device 26 can control the image compression device 23 so as to encode the image data of the frame rate subjected to the image processing in the image processing device 22, and then the process is ended. .
  • control device 26 can reduce the encoding bit amount by reducing the frame rate of moving image data, it is possible to avoid an increase in communication power before the communication band decreases. As a result, communication power can be reduced.
  • steps S31 and S32 processing similar to that of steps S11 and S12 in FIG. 5 is performed.
  • step S32 determines whether the current SIR is larger than the SIR determination reference value. If it is determined in step S32 that the current SIR is larger than the SIR determination reference value, the process proceeds to step S33.
  • the control device 26 does not change the image size of the moving image data to be transmitted from the moving image imaging communication terminal 11, and the original image size (for example, It is decided to use the pixel number 3840 ⁇ 2160).
  • step S32 when it is determined in step S32 that the current SIR is not larger than (is equal to or less than) the SIR determination reference value, the process proceeds to step S34.
  • the control device 26 changes the image size of the moving image data transmitted from the moving image imaging communication terminal 11, and reduces the image size reduced from the original image size set from the beginning to the moving image imaging communication terminal 11 For example, it is decided to use the number of pixels 1920 ⁇ 1080).
  • step S35 a desired image size is set in the image processing control information and the compression rate control information.
  • the control device 26 sets the original image size in the image processing control information and the compression rate control information when the process of step S33 is performed, and reduces the size when the process of step S34 is performed.
  • the set image size is set in the image processing control information and the compression rate control information.
  • step S36 the control device 26 supplies the image processing control information and the compression rate control information for which the image size is set in step S35 to the image processing device 22 and the image compression device 23, respectively.
  • the control device 26 may control the image processing device 22 to perform image processing with the original image size as it is or to perform image processing to reduce the image size from the original. it can.
  • the control device 26 can control the image compression device 23 so as to encode the image data of the image size subjected to the image processing in the image processing device 22, and then the process is ended. .
  • control device 26 can reduce the encoding bit amount by reducing the image size of the moving image data, so that the increase in communication power can be avoided before the communication bandwidth decreases. As a result, communication power can be reduced.
  • FIG. 8 shows the relationship between SIR and throughput
  • FIG. 9 shows multiple levels of MCS.
  • control device 26 can use MCS as well as SIR as a parameter for determining the status of the wireless communication channel.
  • the moving picture imaging communication terminal 11 can perform communication while changing the modulation method in accordance with the condition of the communication channel.
  • the modulation scheme is expressed by a parameter called MCS.
  • MCS MCS with a large multilevel
  • MCS with a small multilevel is set.
  • the throughput is small in the modulation method with small multilevels, and the throughput is large in the method with large multilevels as shown in the upper side of FIG. Therefore, as the power for transferring the same amount of data, the smaller the multi-value level, the more power is required.
  • control device 26 supplies imaging control information for instructing the imaging device 21 to start capturing a moving image, and processing is performed periodically when moving image data is output from the imaging device 21.
  • the control device 26 obtains the MCS used in the current communication from the communication parameters supplied from the wireless transmission device 24.
  • step S42 the control device 26 determines whether the multilevel level of the MCS used in the current communication is "large".
  • step S42 If it is determined in step S42 that the current multi-level MCS is "high”, the process proceeds to step S43. That is, in this case, it is determined that the radio wave condition of the communication path is good and there is no possibility that the communication power may increase. Therefore, the control device 26 limits the encoding bit rate when encoding moving image data. It is decided to use the designated band b0 (see FIG. 4) without performing it.
  • step S42 determines that the current MCS multilevel is not "high”. If it is determined in step S42 that the current MCS multilevel is not "high”, the process proceeds to step S44, and control device 26 determines that the MCS multilevel used in the current communication is It is determined whether it is "medium”.
  • step S44 If it is determined in step S44 that the current multi-level MCS is "medium”, the process proceeds to step S45. That is, in this case, it is determined that the radio wave condition of the communication path is not good but the possibility that the communication power is increased is low. Therefore, the control device 26 sets the coding bit rate at the time of coding moving image data. With a degree of restriction, it is decided to use a medium limit band (for example, a band intermediate between the designated band b0 and the limit band b0 'in FIG. 4).
  • a medium limit band for example, a band intermediate between the designated band b0 and the limit band b0 'in FIG. 4).
  • step S44 when it is determined in step S44 that the current multilevel MCS is not "medium”, the process proceeds to step S46. That is, in this case, it is determined that the current multi-level MCS is "small” and that the communication power may be increased as the radio wave condition of the communication path is deteriorated. There is a large restriction on the coding bit rate when coding moving image data, and it is decided to use the limited band b0 '(see FIG. 4).
  • step S43 After the process of step S43, S45, or S46, the process proceeds to step S47, and the control device 26 sets a target encoding bit rate when encoding moving image data in the compression rate control information. For example, when the process of step S43 is performed, the control device 26 sets the designated band b0 to the compression rate control information, and when the process of step S45 is performed, the middle restricted band is compressed. The rate control information is set, and when the process of step S14 is performed, the limited bandwidth b0 'is set as the compression rate control information.
  • step S48 the control device 26 supplies, to the image compression device 23, the compression rate control information in which the target encoding bit rate is set in step S47.
  • the control device 26 can control the image compression device 23 to encode moving image data at a target encoding bit rate, and then the process is ended.
  • control device 26 can reduce the amount of coding bits by reducing the coding bit rate of moving image data, and therefore avoids an increase in communication power before the communication bandwidth decreases. As a result, communication power can be reduced.
  • control device 26 reduces the frame rate as described with reference to the flowchart of FIG. 6 based on MCS, or reduces the image size as described with reference to the flowchart of FIG. Thus, the consumption of communication power may be suppressed.
  • control device 26 supplies imaging control information for instructing the imaging device 21 to start capturing a moving image, and processing is performed periodically when moving image data is output from the imaging device 21.
  • the control device 26 acquires communication power from the communication power information supplied from the wireless transmission device 24.
  • step S52 the control device 26 determines that the communication power consumed to perform communication in the current radio wave condition of the communication path is a predetermined communication power determination reference value (for example, larger than the minimum power p0) set in advance. It is determined whether or not the power in the vicinity of the minimum power p0).
  • a predetermined communication power determination reference value for example, larger than the minimum power p0
  • step S52 If it is determined in step S52 that the current communication power is larger than the communication power determination reference value, the process proceeds to step S53. That is, in this case, it is determined that the communication power may be increased as the radio wave condition of the communication channel is deteriorated. Therefore, the control device 26 is configured to encode the moving image data. , And decide to use the limited band b0 '(see FIG. 4).
  • step S52 determines whether the current communication power is not (greater than or less than) the communication power determination reference value. If it is determined in step S52 that the current communication power is not (greater than or less than) the communication power determination reference value, the process proceeds to step S54. That is, in this case, it is determined that the radio wave condition of the communication path is good and there is no possibility that the communication power may increase. Therefore, the control device 26 limits the encoding bit rate when encoding moving image data. It is decided to use the designated band b0 (see FIG. 4) without performing it.
  • step S55 the control device 26 sets the target encoding bit rate when encoding moving image data in the compression rate control information. For example, when the process of step S53 is performed, the control device 26 sets the limited band b0 'to the compression rate control information, and when the process of step S54 is performed, the control rate of the designated band b0 is compressed. Set in control information.
  • step S56 the control device 26 supplies, to the image compression device 23, the compression rate control information in which the target encoding bit rate is set in step S55.
  • the control device 26 can control the image compression device 23 to encode moving image data at a target encoding bit rate, and then the process is ended.
  • control device 26 can avoid an increase in communication power before the communication bandwidth decreases, and as a result, can suppress the communication power based on the communication power information.
  • FIG. 12 is a block diagram showing a configuration example of an embodiment of a moving image reproduction communication terminal to which the present technology is applied.
  • the moving image reproduction communication terminal 31 shown in FIG. 1 has a function of receiving moving image data by wireless communication and reproducing the moving image, and the wireless antenna 41, the wireless transmission device 42, the image decoding device 43, and the image processing A device 44, a display device 45, and a control device 46 are provided.
  • the moving image reproduction communication terminal 31 is a so-called smartphone or a tablet terminal.
  • the wireless antenna 41 receives a signal emitted to the space as an electromagnetic wave from a wireless base station (not shown), for example, a stream signal of moving image data.
  • the wireless transmission device 42 demodulates a stream signal of moving image data received via the wireless antenna 41, and supplies a bit stream of moving image data obtained thereby to the image decoding device 43. Further, the wireless transmission device 42 can acquire communication band information and communication parameters as in the case of the wireless transmission device 24 of FIG. 1 and supplies the communication band information and communication parameters to the control device 46. Furthermore, the wireless transmission device 42 can request the moving image distribution server to limit the quality (such as bit rate) of the moving image data requested to be distributed, under the control of the control device 46 as described later.
  • the image decoding device 43 decodes the bit stream of moving image data supplied from the wireless transmission device 42 in accordance with the decoding control signal supplied from the control device 46, and supplies the decoded moving image data to the image processing device 44.
  • the image processing device 44 subjects the moving image data supplied from the image decoding device 43 to various image processing in accordance with the image processing control signal supplied from the control device 46 and supplies the processed image data to the display device 45.
  • the image processing apparatus 44 can perform image processing for converting a frame rate, image processing for enlarging or reducing a screen size, color correction, and the like.
  • the display device 45 is configured of a display device such as a liquid crystal display (LCD) panel or an organic electro luminescence (EL) panel, and is supplied from the image processing device 44 in accordance with display control information supplied from the control device 46. Display a moving image according to the moving image data.
  • a display device such as a liquid crystal display (LCD) panel or an organic electro luminescence (EL) panel
  • the control device 46 acquires communication parameters (SIR, MCS, or communication power information) from the radio transmission device 24 in the same manner as the control device 26 of FIG. Limit the quality of video data that requires delivery before it degrades. Thereby, the control device 46 can suppress the communication power.
  • SIR communication parameters
  • MCS communication power information
  • the control device 46 can optimize the consumption of communication power as a whole by performing the same communication control as the control device 26 of FIG.
  • FIG. 13 is a block diagram showing an example of the configuration of a moving image distribution system.
  • a plurality of moving image reproduction communication terminals 31 are connected to the moving image distribution system 51 shown in FIG.
  • the moving image distribution system 51 is configured such that the wireless communication base station 61 performing wireless communication with the moving image reproduction communication terminal 31 is connected to the moving image distribution server 62 via the network 63 including the Internet network and the like. Be done.
  • the wireless communication base station 61 can wirelessly communicate with the moving image reproduction communication terminal 31 and transmits moving image data distributed from the moving image distribution server 62 to the moving image reproduction communication terminal 31 via the network 63. .
  • the moving image distribution server 62 prepares a plurality of different bit rate files for the same content.
  • a file 63-1 of 2.4 Mbps, a file 63-2 of 1.2 Mbps, a file 63-3 of 500 kbps, a file 63-4 of 300 kbps, and a file 63-5 of 128 kbps are prepared.
  • the moving image distribution server 62 transfers the requested bit rate file via the network 63 and via the wireless communication base station 61.
  • control device 46 requests a moving image via the wireless transmission device 42 and distribution of moving image data from the moving image distribution server 62 is started, processing is performed periodically.
  • step S61 the control device 26 acquires the SIR from the communication parameters supplied from the wireless transmission device 42.
  • step S62 the control device 46 determines whether the SIR according to the current radio wave condition of the communication path is larger than the SIR determination reference value.
  • the SIR determination reference value the SIR value s0 described with reference to FIG. 4 may be used, or an SIR value (SIR value s1) set from the outside in advance for the video reproduction communication terminal 31. Larger values and SIR values less than or equal to s 0) may be used.
  • step S62 If it is determined in step S62 that the current SIR is larger than the SIR determination reference value, the process proceeds to step S63. That is, in this case, it is determined that the radio wave condition of the communication path is good and there is no possibility that the communication power is increased. Therefore, the control device 46 sets the bit rate of moving image data requested to the moving image distribution server 62 to the maximum bit rate within the communicable band (or is set as a default to the moving image reproduction communication terminal 31) choose to use the
  • step S62 when it is determined in step S62 that the current SIR is not larger than (is equal to or less than) the SIR determination reference value, the process proceeds to step S64. That is, in this case, it is determined that the communication power may be increased as the radio wave condition of the communication path is deteriorated. Therefore, the control device 46 sets the bit rate of the moving image data requested to the moving image distribution server 62 to a larger bit rate (ie, at the current time) from bit rates smaller than the current bit rate. Choose to use the next higher bit rate).
  • step S63 or S64 the process proceeds to step S65, and the control device 46 selects the bit rate selected in each step as the bit rate of the moving picture data requested to the moving picture distribution server 62
  • the request command to be sent to the distribution server 62 is set.
  • step S66 the control device 46 supplies the request command for which the bit rate has been set in step S65 to the wireless transmission device 42, and causes the wireless communication base station 61 to transmit the request command by wireless communication.
  • the moving image distribution server 62 can distribute moving image data of the bit rate set in the request command, and then the process is terminated.
  • the moving image reproduction communication terminal 31 can avoid an increase in communication power by requesting moving image data with a lower bit rate before the communication bandwidth decreases, and as a result, the communication power can be reduced. It can control.
  • control device 46 requests a moving image via the wireless transmission device 42 and distribution of moving image data from the moving image distribution server 62 is started, processing is performed periodically.
  • step S71 the control device 26 obtains communication power from the communication power information supplied from the wireless transmission device 24.
  • control device 46 determines whether or not the communication power consumed to perform communication in the current radio wave condition of the communication path is larger than a predetermined communication power determination reference value set in advance. .
  • step S72 If it is determined in step S72 that the current communication power is larger than the communication power determination reference value, the process proceeds to step S73. That is, in this case, it is determined that the communication power may be increased as the radio wave condition of the communication path is deteriorated. Therefore, the control device 46 sets the bit rate of the moving image data requested to the moving image distribution server 62 to a larger bit rate (ie, at the current time) from bit rates smaller than the current bit rate. Choose to use the next higher bit rate).
  • step S72 when it is determined in step S72 that the current communication power is not larger than (is less than) the communication power determination reference value, the process proceeds to step S74. That is, in this case, it is determined that the radio wave condition of the communication path is good and there is no possibility that the communication power is increased. Therefore, the control device 46 sets the bit rate of moving image data requested to the moving image distribution server 62 to the maximum bit rate within the communicable band (or is set as a default to the moving image reproduction communication terminal 31) choose to use the
  • step S73 or S74 the process proceeds to step S75, and the control device 46 selects the bit rate selected in each step as the bit rate of the moving picture data requested to the moving picture distribution server 62
  • the request command to be sent to the distribution server 62 is set.
  • step S76 the control device 46 supplies the request command for which the bit rate has been set in step S75 to the wireless transmission device 42, and causes the wireless communication base station 61 to transmit the request command by wireless communication.
  • the moving image distribution server 62 can distribute moving image data of the bit rate set in the request command, and then the process is terminated.
  • the moving image reproduction communication terminal 31 can avoid an increase in communication power by requesting moving image data with a lower bit rate before the communication bandwidth decreases, and as a result, the communication power can be reduced. It can control.
  • the series of processes (the communication control method) described above can be performed by hardware or software.
  • the various functions are executed by installing a computer in which a program constituting the software is incorporated in dedicated hardware or various programs.
  • the program can be installed, for example, on a general-purpose personal computer from a program recording medium on which the program is recorded.
  • FIG. 16 is a block diagram showing an example of a hardware configuration of a computer that executes the series of processes described above according to a program.
  • a central processing unit (CPU) 101 a read only memory (ROM) 102, a random access memory (RAM) 103, and an electronically erasable and programmable read only memory (EEPROM) 104 are mutually connected by a bus 105.
  • a bus 105 a bus 105.
  • an input / output interface 106 is connected to the bus 105, and the input / output interface 106 is connected to the outside.
  • the CPU 101 loads a program stored in, for example, the ROM 102 and the EEPROM 104 into the RAM 103 via the bus 105 and executes the program, whereby the series of processes described above are performed. Further, the program executed by the computer (CPU 101) can be previously installed in the ROM 102, or can be externally installed or updated in the EEPROM 104 through the input / output interface 106.
  • a parameter acquisition unit for acquiring a parameter correlated with at least one of a communication state and communication power from a wireless transmission apparatus that transmits and receives moving image data by performing wireless communication;
  • a communication control apparatus comprising: a restriction unit that restricts the quality of the moving image data before the communicable band is reduced according to the parameters and the radio wave condition of the communication path is deteriorated.
  • the parameter is a signal to interference ratio (SIR) indicating a ratio of interference power to signal power in a channel used in the wireless communication,
  • SIR signal to interference ratio
  • the parameter is a modulation and coding set (MCS) indicating a modulation scheme in a channel used in the wireless communication
  • MCS modulation and coding set
  • the communication control apparatus according to (1) or (2), wherein the restriction unit imposes a restriction so as to lower the quality of the moving image data in response to a decrease in the multilevel level of the MCS.
  • the parameter is communication power information indicating communication power consumed by the wireless transmission device to perform wireless communication, The restriction unit provides restriction so as to reduce the quality of the moving image data when the current communication power becomes larger than a predetermined communication power judgment reference value.
  • the image processing apparatus further includes an image compression unit that compresses the moving image data acquired by capturing a moving image by the imaging device and supplies the compressed data to the wireless transmission device.
  • the communication control apparatus according to any one of (1) to (4), wherein the restriction unit restricts the compression rate of the moving image data by the image compression unit.
  • the image processing apparatus further includes an image processing unit that performs image processing on the moving image data and supplies the processed image data to the image compression unit.
  • the restriction unit reduces the frame rate of the moving image data by image processing by the image processing unit.
  • the communication control apparatus wherein the restriction unit reduces the image size of the moving image data by image processing by the image processing unit.
  • the restriction unit transmits a request command to a moving image distribution server that distributes the moving image data to reproduce and display the moving image via the wireless transmission device, the moving image requesting the distribution
  • the communication control device according to any one of (1) to (8) above, which limits the quality of data.
  • the parameter is a signal to interference ratio (SIR) indicating a ratio of interference power to signal power in a channel used in the wireless communication
  • SIR signal to interference ratio
  • the parameter is communication power information indicating communication power consumed by the wireless transmission device to perform wireless communication
  • Control device (12) A communication control device that controls wireless communication Obtaining a parameter correlated with at least one of communication state and communication power from a wireless transmission device that transmits and receives moving image data by performing wireless communication; And limiting the quality of the moving image data before the communicable band decreases with the deterioration of the radio wave condition of the communication path according to the parameter.
  • a computer of a communication control unit that controls wireless communication Obtaining a parameter correlated with at least one of communication state and communication power from a wireless transmission device that transmits and receives moving image data by performing wireless communication;
  • a program for executing processing including: limiting the quality of the moving image data before the communicable band decreases according to the deterioration of the radio wave condition of the communication path according to the parameter.
  • An imaging device for acquiring moving image data by capturing a moving image;
  • a wireless transmission device that performs transmission by wireless communication and transmits the moving image data;
  • a parameter having a correlation with at least one of the communication state and the communication power is acquired from the wireless transmission device, and the moving image data is acquired before the communicable band decreases according to the parameter according to the deterioration of the radio wave condition of the communication path.
  • a control unit that limits quality.
  • a display device for reproducing and displaying a moving image A wireless transmission device that performs transmission by wireless communication and receives moving image data; A parameter having a correlation with at least one of the communication state and the communication power is acquired from the wireless transmission device, and the moving image data is acquired before the communicable band decreases according to the parameter according to the deterioration of the radio wave condition of the communication path.
  • Control unit to limit the quality The control unit, when transmitting a request command to a moving image distribution server for distributing the moving image data to reproduce and display a moving image, via the wireless transmission device, the control unit requests the distribution A video communication terminal that limits the quality of data.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • Databases & Information Systems (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Studio Devices (AREA)

Abstract

La présente invention concerne un appareil de contrôle de communication, un procédé de contrôle de communication, un programme, un terminal de communication mpi (motion picture imaging), et un terminal de communication mpr (motion picture reproducing), tous aptes à permettre une suppression de la consommation de puissance durant une communication. L'appareil de contrôle de communication acquiert, d'un dispositif de transmission sans fil qui transmet/reçoit des données filmographiques via l'exécution d'une transmission au moyen d'une communication sans fil, un paramètre corrélé à un état de communication et/ou une puissance de communication, et limite, d'après ledit paramètre, la qualité des données filmographiques avant qu'une bande de communication disponible ne diminue suite à la détérioration d'une condition d'onde radio dans un trajet de communication. L'appareil de contrôle de communication impose également une limite sur le taux de compression des données filmographiques acquises par imagerie d'un film par un dispositif d'imagerie ou, lors de la transmission d'une instruction de demande à un serveur de distribution de film, limite la qualité des données filmographiques devant être distribuées. La présente technologie peut être appliquée par exemple à un terminal de reproduction ou à un terminal d'imagerie ou un terminal ayant la fonction de transmettre ou de recevoir des données filmographiques au moyen d'une communication sans fil.
PCT/JP2018/034128 2017-09-29 2018-09-14 Appareil de contrôle de communication, procédé de contrôle de communication, programme, terminal de communication mpi (motion picture imaging), et terminal de communication mpr (motion picture reproducing) WO2019065296A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017-189779 2017-09-29
JP2017189779 2017-09-29

Publications (1)

Publication Number Publication Date
WO2019065296A1 true WO2019065296A1 (fr) 2019-04-04

Family

ID=65902115

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/034128 WO2019065296A1 (fr) 2017-09-29 2018-09-14 Appareil de contrôle de communication, procédé de contrôle de communication, programme, terminal de communication mpi (motion picture imaging), et terminal de communication mpr (motion picture reproducing)

Country Status (1)

Country Link
WO (1) WO2019065296A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116669153A (zh) * 2022-12-09 2023-08-29 荣耀终端有限公司 发射功率回退方法、终端设备和计算机可读存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004158983A (ja) * 2002-11-05 2004-06-03 Victor Co Of Japan Ltd 画像信号送信装置、画像信号受信装置、及び画像信号送受信装置
JP2004312569A (ja) * 2003-04-10 2004-11-04 Hitachi Ltd 配信サーバ及び端末装置
JP2006157889A (ja) * 2004-10-29 2006-06-15 Sharp Corp 通信装置、通信方法、通信プログラム、通信プログラムを記録した記録媒体、および通信システム
JP2012249005A (ja) * 2011-05-26 2012-12-13 Nippon Hoso Kyokai <Nhk> 映像伝送装置
WO2013145194A1 (fr) * 2012-03-28 2013-10-03 富士通株式会社 Dispositif d'évaluation de qualité, procédé d'évaluation de qualité, système de communication et dispositif de station de base sans fil

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004158983A (ja) * 2002-11-05 2004-06-03 Victor Co Of Japan Ltd 画像信号送信装置、画像信号受信装置、及び画像信号送受信装置
JP2004312569A (ja) * 2003-04-10 2004-11-04 Hitachi Ltd 配信サーバ及び端末装置
JP2006157889A (ja) * 2004-10-29 2006-06-15 Sharp Corp 通信装置、通信方法、通信プログラム、通信プログラムを記録した記録媒体、および通信システム
JP2012249005A (ja) * 2011-05-26 2012-12-13 Nippon Hoso Kyokai <Nhk> 映像伝送装置
WO2013145194A1 (fr) * 2012-03-28 2013-10-03 富士通株式会社 Dispositif d'évaluation de qualité, procédé d'évaluation de qualité, système de communication et dispositif de station de base sans fil

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116669153A (zh) * 2022-12-09 2023-08-29 荣耀终端有限公司 发射功率回退方法、终端设备和计算机可读存储介质
CN116669153B (zh) * 2022-12-09 2023-10-20 荣耀终端有限公司 发射功率回退方法、终端设备和计算机可读存储介质

Similar Documents

Publication Publication Date Title
US10091528B2 (en) Method and system for scalable video compression and transmission
KR100893863B1 (ko) 무선 통신 시스템에서의 링크 적응적 데이터 전송 방법
WO2021244341A1 (fr) Procédé et appareil de codage d&#39;image, dispositif électronique et support de stockage lisible par ordinateur
KR101640508B1 (ko) 무선 시스템에서의 비압축 영상 통신을 위한 점진적 레이트 조정 방법 및 시스템
US9014277B2 (en) Adaptation of encoding and transmission parameters in pictures that follow scene changes
KR102525577B1 (ko) 데이터 스트리밍 방법 및 장치
US20110026591A1 (en) System and method of compressing video content
JP6463041B2 (ja) 画像処理装置、画像処理方法、及びプログラム
US20090234919A1 (en) Method of Transmitting Data in a Communication System
US20080304574A1 (en) Information processing device and method, and information processing system
US8842159B2 (en) Encoding processing for conferencing systems
US10498655B1 (en) Dynamically adjusting load on an over-the-top (OTT) delivery network
EP2272237B1 (fr) Procédé de transmission de données dans un système de communication
US20240040136A1 (en) Method to optimize the quality of video delivered over a network
CN111263192A (zh) 视频处理方法及相关设备
WO2019065296A1 (fr) Appareil de contrôle de communication, procédé de contrôle de communication, programme, terminal de communication mpi (motion picture imaging), et terminal de communication mpr (motion picture reproducing)
JP2009124518A (ja) 画像送信装置
CN107135403B (zh) 信息处理设备
JP2011066577A (ja) 画像処理プログラム、表示システム、画像処理装置および画像処理方法
JP2004193990A (ja) 情報処理システム、情報処理装置および方法、記録媒体、並びにプログラム
CN116962613A (zh) 数据传输方法及装置、计算机设备、存储介质
Reznik User-adaptive mobile video streaming using MPEG-DASH
US11778264B2 (en) Device and method for processing and transmitting image data in wireless AV system
JP6045051B1 (ja) 動画像伝送装置及び動画像伝送方法
JP4103070B2 (ja) 信号処理システムおよび方法、信号処理装置および方法、記録媒体、並びにプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18861070

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18861070

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP