WO2022097303A1 - 情報処理装置及び通信方法 - Google Patents
情報処理装置及び通信方法 Download PDFInfo
- Publication number
- WO2022097303A1 WO2022097303A1 PCT/JP2020/041758 JP2020041758W WO2022097303A1 WO 2022097303 A1 WO2022097303 A1 WO 2022097303A1 JP 2020041758 W JP2020041758 W JP 2020041758W WO 2022097303 A1 WO2022097303 A1 WO 2022097303A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- communication
- unit
- information
- information processing
- characteristic information
- Prior art date
Links
- 230000006854 communication Effects 0.000 title claims abstract description 324
- 238000004891 communication Methods 0.000 title claims abstract description 315
- 230000010365 information processing Effects 0.000 title claims abstract description 159
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000008569 process Effects 0.000 claims abstract description 25
- 238000012545 processing Methods 0.000 claims description 148
- 239000000872 buffer Substances 0.000 claims description 116
- 230000006870 function Effects 0.000 claims description 36
- 230000005540 biological transmission Effects 0.000 description 46
- 238000009877 rendering Methods 0.000 description 30
- 238000007906 compression Methods 0.000 description 25
- 230000006835 compression Effects 0.000 description 15
- 230000015654 memory Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000003111 delayed effect Effects 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 239000013589 supplement Substances 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 238000013479 data entry Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 239000012464 large buffer Substances 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 230000004043 responsiveness Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/33—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections
- A63F13/332—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using wireless networks, e.g. cellular phone networks
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/35—Details of game servers
- A63F13/358—Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/35—Details of game servers
- A63F13/355—Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/50—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
- A63F2300/53—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of basic data processing
- A63F2300/534—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of basic data processing for network load management, e.g. bandwidth optimization, latency reduction
Definitions
- This disclosure relates to an information processing device and a communication method.
- this disclosure proposes a technology that contributes to the realization of the provision of services of more stable quality.
- an information processing device provides application functions to the client device.
- the information processing device includes an acquisition unit and a communication unit.
- the acquisition unit acquires characteristic information related to the application function.
- the communication unit communicates with the client device.
- the communication unit changes the processing related to the communication according to the characteristic information.
- Each of one or more embodiments (including examples and modifications) described below can be implemented independently. On the other hand, at least a part of the plurality of embodiments described below may be carried out in combination with at least a part of other embodiments as appropriate. These plurality of embodiments may contain novel features that differ from each other. Therefore, these plurality of embodiments may contribute to solving different purposes or problems, and may have different effects.
- FIG. 1 is a diagram for explaining an outline of the proposed technique of the present disclosure.
- the proposed technique according to the present disclosure is implemented in the information processing system shown in FIG.
- the information processing system includes an information processing device 10, a terminal device 20, and a base station device 30.
- the information processing device 10 is, for example, a game server, and provides services such as games to the terminal device 20 via the base station device 30.
- the information processing device 10 transmits, for example, a moving image such as a game image to the terminal device 20.
- the terminal device 20 may be, for example, a smartphone, a PC, or a game device.
- the terminal device 20 displays the moving image acquired from the information processing device 10 on the display unit of the own device or the display device connected to the own device.
- the base station device 30 is a wireless communication device that wirelessly communicates with the terminal device 20.
- the base station device 30 is, for example, a device corresponding to a wireless base station (Node B, eNB, gNB, etc.), and provides a cellular communication service such as NR (New Radio) to the terminal device 20.
- the base station device 30 may be a wireless relay station.
- the base station device 30 may be a road base station device such as an RSU (Road Side Unit). Further, the base station device 30 may be an optical overhanging device called RRH (Remote Radio Head).
- RRH Remote Radio Head
- the base station device 30 connects to the information processing device 10 via a network, for example, and transmits information about services provided by the information processing device 10, such as a moving image of a game, to the terminal device 20. Further, the base station device 30 provides the information processing device 10 with game operation information and the like by the terminal device 20 via a network.
- the information processing device 10 and the terminal device 20 transmit and receive information via the base station device 30, so that the terminal device 20 receives a service such as a cloud game from the information processing device 10. can.
- FIG. 1 shows an example in which the terminal device 20 and the information processing device 10 are connected by wireless communication via the base station device 30, but the terminal device 20 and the information processing device 10 are connected to each other. For example, it may be connected by wire via a network.
- 5G whose service has been partially started, has three features: large capacity, low latency, and multiple access.
- large capacity a capacity of a network
- low latency a feature that provides a high-power service.
- multiple access a feature that provides a high-power service.
- a certain game is expected to satisfy the low delay characteristic of 5G.
- another game is expected to satisfy the large capacity (high quality) that is a feature of 5G.
- it is considered difficult to maintain all the characteristics required for each game at the same time. For example, in all games, it may be difficult to simultaneously meet the low delay and large capacity required for each game.
- the communication device controls the communication according to the characteristic information of the game (for example, low delay or large capacity).
- the game server communicates without considering the characteristics required for the game, and communication control is not performed according to the nature of the game.
- the communication device controls communication according to the characteristic information of the game, so that the communication device satisfies the characteristics required for the game (for example, low delay, large capacity, etc.). Communication is possible. As a result, the communication device can provide a game service of more stable quality, and can further improve the operability and usability of the game.
- FIG. 2 is a diagram showing an example of the configuration of the information processing system according to the embodiment of the present disclosure.
- the information processing system includes an information processing device 10 and a terminal device 20.
- the information processing system may have the base station apparatus 30 as shown in FIG.
- the information processing device 10 is a MEC (Mobile Edge Computing)
- the information processing device 10 may be arranged as a server in the base station device 30.
- the information processing apparatus 10 is a client server that provides an application function to a client device.
- the information processing device 10 is, for example, a game server (Game Server) that provides a game service as an application function, and displays moving image data as a game screen on the terminal device 20. Further, the information processing device 10 receives information (scene information) about the scene displayed as a game screen from the terminal device 20.
- the scene information is information indicating a game scene, such as whether the game screen is a menu screen or a play screen.
- the information processing device 10 includes an application unit 110, a rendering processing unit 120, a coding unit 130, a communication unit 140, a storage unit 150, and a control unit 160.
- the application unit 110 is one or more applications that provide services to the terminal device 20 based on the information acquired by the control unit 160.
- the application unit 110 is realized by operating a program on, for example, a CPU (Central Processing Unit), and provides a game service to a user who uses the terminal device 20 by displaying a moving image on the terminal device 20.
- a CPU Central Processing Unit
- the application unit 110 controls the operation of the game. For example, the application unit 110 outputs the moving image data to the rendering processing unit 120 based on the acquisition from the terminal device 20.
- the service provided by the application unit 110 is not limited to the game service, and various services such as a video viewing service may be provided.
- the rendering processing unit 120 is a drawing unit that performs rendering processing of a moving image to be displayed on the terminal device 20.
- the rendering processing unit 120 performs a process of generating image data to be displayed as a game screen.
- the rendering processing unit 120 renders the scene image of the game at a predetermined rendering resolution and frame rate according to the instructions of the application unit 110 and the control unit 160.
- the rendering processing unit 120 is configured by a processor such as a GPU (Graphics Processing Unit), and the moving image information can be generated by operating the processor according to a predetermined program.
- a processor such as a GPU (Graphics Processing Unit)
- the rendering processing unit 120 appropriately divides the information related to image generation and performs image processing in parallel by these plurality of GPUs.
- the coding unit 130 compresses the image data generated by the rendering processing unit 120 by encoding it, and outputs the compressed bit stream (hereinafter, also referred to as compressed data) to the communication unit 140.
- the coding unit 130 generates compressed data according to the instructions of the control unit 160.
- the coding unit 130 shown in FIG. 2 has a buffer 131.
- the coding unit 130 temporarily stores the compressed data and the like in the buffer 131, and performs the coding process.
- the communication unit 140 is a communication interface (I / F) that communicates with an external device.
- the communication unit 140 is realized by, for example, a NIC (Network Interface Card) or the like.
- the communication unit 140 communicates with the core network to which the base station device 30 (see FIG. 1) is connected.
- the communication unit 140 converts the scene image encoded by the coding unit 130 into a transmission signal and transmits it to the terminal device 20. Further, the communication unit 140 receives scene information and service information related to the game service from the terminal device 20, and notifies the control unit 160 of the reception result. Further, the communication unit 140 transmits the characteristic information generated based on the scene information and the service information to the terminal device 20.
- the communication unit 140 shown in FIG. 2 has a buffer 141.
- the communication unit 140 temporarily stores communication data and the like in the buffer 141 and performs communication processing.
- the storage unit 150 is a data-readable / writable storage device such as a DRAM, an SRAM, a flash memory, and a hard disk.
- the storage unit 150 functions as a storage means for the information processing device 10.
- the storage unit 150 stores control information and the like used for communication control and buffer control by the control unit 160, which will be described later.
- FIG. 2 shows a configuration in which the coding unit 130 and the communication unit 140 have buffer memories as buffers 131 and 141, respectively, but the present invention is not limited to this.
- the coding unit 130 and the communication unit 140 may process a part of the storage unit 150 as buffers 131 and 141.
- the control unit 160 controls each unit of the information processing apparatus 10.
- the control unit 160 is realized by, for example, executing a program stored in the information processing apparatus 10 by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like with a RAM (Random Access Memory) or the like as a work area. Will be done.
- the control unit 160 is realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
- the control unit 160 includes an acquisition unit 161, a buffer control unit 162, and a communication control unit 163, and realizes or executes the functions and operations of information processing described below.
- the internal configuration of the control unit 160 is not limited to the configuration shown in FIG. 2, and may be any other configuration as long as it is configured to perform information processing described later.
- the connection relationship of each processing unit included in the control unit 160 is not limited to the connection relationship shown in FIG. 2, and may be another connection relationship.
- the acquisition unit 161 acquires information (characteristic information) regarding the characteristics of the game.
- the acquisition unit 161 acquires information on the game service and information on the scene of the game service from the terminal device 20, and acquires characteristic information from the storage unit 150 based on the acquired information.
- the characteristic information is, for example, information related to the characteristics required when providing a game service.
- the characteristic information includes, for example, information indicating the required characteristics among low latency, large capacity, and multiple access.
- the characteristic information is set for each service provided by the application unit 110, for example. Further, the characteristic information may be set for each service scene. Details of the characteristic information will be described later.
- the buffer control unit 162 controls the buffers 131 and 141 of each unit based on the characteristic information acquired by the acquisition unit 161.
- the buffer control unit 162 controls the buffer amount of the buffers 131 and 141 based on the characteristic information.
- the communication control unit 163 controls the communication processing performed by the communication unit 140 based on the characteristic information acquired by the acquisition unit 161. Further, the communication control unit 163 controls the processing performed by the coding unit 130 such as the frame rate and the coding rate.
- the terminal device 20 is a client device (information processing device) that receives application functions from the information processing device 10 that is a client server.
- the terminal device 20 receives, for example, a game service as an application function.
- the terminal device 20 receives the moving image data related to the game transmitted from the information processing device 10, and displays the received moving image data.
- the terminal device 20 determines the game scene according to the operation of the game by the user, and transmits the scene information regarding the determined scene to the information processing device 10.
- the terminal device 20 has a communication unit 210, a decoding unit 220, a rendering processing unit 230, an input / output unit 240, a storage unit 250, and a control unit 260.
- the communication unit 210 is a communication interface (I / F) that communicates with an external device.
- the communication unit 210 is realized by, for example, a NIC (Network Interface Card) or the like.
- the communication unit 210 connects to the core network by performing wireless communication with the base station device 30 (see FIG. 1).
- the communication unit 210 receives the video image data of the game from the information processing device 10.
- the communication unit 210 transmits scene information and service information related to the game service to the information processing device 10.
- the communication unit 210 receives the characteristic information from the information processing device 10.
- the communication unit 210 has a buffer 211, temporarily stores the data received from the information processing device 10 in the buffer, and performs reception processing.
- the communication unit 210 temporarily stores the data to be transmitted to the information processing apparatus 10 in a buffer and performs the transmission process.
- the decoding unit 220 decodes the moving image data received by the communication unit 210.
- the decoding unit 220 has a buffer 221 and temporarily stores moving image data to perform decoding processing.
- the rendering processing unit 230 renders the moving image data decoded by the decoding unit 220 and displays it on the display (not shown) of the input / output unit 240.
- the input / output unit 240 has, for example, a display device (not shown) such as a display and an input device (not shown) such as an operator (controller).
- the input / output unit 240 displays the moving image data rendered by the rendering processing unit 230 on the display.
- the input / output unit 240 detects an operation on the game by the user via the input device.
- the storage unit 250 is a data-readable / writable storage device such as a DRAM, an SRAM, a flash memory, and a hard disk.
- the storage unit 250 functions as a storage means for the terminal device 20.
- the storage unit 250 stores control information and the like used for communication control and buffer control by the control unit 260 described later.
- FIG. 2 shows a configuration in which the communication unit 210 and the decoding unit 120 each have, for example, a buffer memory as buffers 211 and 221, but the present invention is not limited to this.
- the communication unit 210 and the decoding unit 120 may process a part of the storage unit 250 as buffers 211 and 221.
- the control unit 260 controls each unit of the terminal device 20.
- the control unit 260 is realized by, for example, executing a program stored in the terminal device 20 by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like with a RAM (Random Access Memory) or the like as a work area.
- the control unit 260 is realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
- the control unit 260 includes an acquisition unit 261, a buffer control unit 262, and a communication control unit 263, and realizes or executes the functions and operations of information processing described below.
- the internal configuration of the control unit 260 is not limited to the configuration shown in FIG. 2, and may be any other configuration as long as it is configured to perform information processing described later.
- the connection relationship of each processing unit of the control unit 260 is not limited to the connection relationship shown in FIG. 2, and may be another connection relationship.
- the acquisition unit 261 acquires information (characteristic information) related to the application function (characteristics of the game).
- the acquisition unit 261 acquires service information related to the game service and scene information related to the scene of the game service from the input / output unit 240 and the storage unit 250. By notifying the information processing apparatus 10 of these acquired information, the acquisition unit 261 acquires characteristic information from the information processing apparatus 10.
- the buffer control unit 262 controls the buffers 211 and 221 of each unit based on the characteristic information acquired by the acquisition unit 261.
- the buffer control unit 262 controls the buffer amount of the buffers 211 and 221 based on the characteristic information.
- the communication control unit 263 controls the communication processing performed by the communication unit 210 based on the characteristic information acquired by the acquisition unit 261. Further, the communication control unit 263 controls the processing performed by the decoding unit 220 such as the frame rate and the decoding rate.
- FIG. 3 is a diagram showing an example of the configuration of the information processing apparatus 10 according to the embodiment of the present disclosure.
- the application unit 110 of the information processing device 10 is, for example, an application that provides a game service.
- FIG. 4 is a chart for explaining an example of the types of services according to the embodiment of the present disclosure.
- the type of the game service can be specified by a genre and a sub-genre, for example, as shown in FIG.
- the genre corresponds to a major classification that divides services such as “shooting” and “action”. Services whose genre is “shooting” are classified into sub-genres such as “bullet shooter” and “FPS (First Person shooter)”.
- the storage unit 150 stores the game service provided by the application unit 110 in association with the characteristic information.
- FIG. 5 is a chart for explaining an example of characteristic information stored in the storage unit 150 according to the embodiment of the present disclosure.
- the storage unit 150 stores the sub-genre of the game service and the priority of the characteristic information in association with each other.
- the characteristic information includes, for example, information on communication quality (low delay or large capacity) characteristics required for the service, and information on (multiple access) characteristics according to the number of terminals to which the service is provided.
- the storage unit 150 stores the low delay characteristic and the large capacity characteristic as the characteristic information in association with the sub-genre of the game.
- the priority of the low delay characteristic is high (High)
- the priority of the large capacity characteristic is medium (Mid).
- the priority of the low delay characteristic is low (Low)
- the priority of the large capacity characteristic is high (High).
- the storage unit 150 may store the service scene and the characteristic information in association with each other.
- FIG. 6 is a chart for explaining another example of the characteristic information stored in the storage unit 150 according to the embodiment of the present disclosure. As shown in FIG. 6, the storage unit 150 stores the scene and the priority of the characteristic information in association with each other for each sub-genre of the game service.
- the storage unit 150 stores characteristic information for each menu scene and play scene as a scene.
- the "menu" scene of the sub-genre "fighting game” has a low priority for low delay characteristics (Low) and a high capacity characteristic (High). Even in the same sub-genre "fighting game", when the scene is "play", the priority of the low delay characteristic is high (High), and the priority of the large capacity characteristic is medium (Mid).
- the storage unit 150 may store the characteristic information most required for the game service.
- the storage unit 150 stores, for example, the sub-genre "FPS" and “low delay” in association with each other, and stores the "strategy game” and “large capacity” in association with each other.
- the storage unit 150 stores the control information used for the control in the control unit 160.
- the control information includes communication control information used for communication control and buffer control information used for buffer control.
- the storage unit 150 stores characteristic information and control information in association with each other.
- FIG. 7 is a diagram for explaining an example of communication control information stored in the storage unit 150 according to the embodiment of the present disclosure.
- FIG. 7 shows a case where the storage unit 150 stores information about the network slice as communication control information.
- the storage unit 150 stores "Slice 5" as the corresponding network slice.
- the storage unit 150 stores, for example, the frame rate, the coding rate, the coding method, the type of the communication protocol, and the characteristic information in association with each other as the communication control information. Further, the storage unit 150 stores the buffer amount and the characteristic information in association with each other as the buffer control information.
- the storage unit 150 may store the game service, characteristic information, and control information in association with each other.
- FIG. 8 is a chart for explaining another example of the characteristic information stored in the storage unit 150 according to the embodiment of the present disclosure.
- the storage unit 150 stores the sub-genre of the game service, the priority of the characteristic information, the communication control information, and the buffer control information in association with each other.
- FIG. 8 shows a case where the storage unit 150 stores information about the network slice as communication control information and stores information about the buffer amount as buffer control information.
- the sub-genre “FPS” has a high low delay characteristic (High), a medium large capacity characteristic (Mid), a network slice of “Slice 2”, and a buffer amount of “Small”. ". Further, the sub-genre "strategy game” has a low low delay characteristic (Low) and a high large capacity characteristic (High). The network slice used in the sub-genre "strategy game” is "Slice 6", and the buffer amount is "large”.
- the storage unit 150 stores the characteristic information corresponding to the service provided to the terminal device 20. Further, the storage unit 150 stores control information corresponding to the characteristic information. As a result, the information processing apparatus 10 can perform communication control and buffer control according to the characteristic information required for the service.
- the storage unit 150 stores the low delay characteristic and the large capacity (high image quality) characteristic as the characteristic information, but the present invention is not limited to this.
- the storage unit 150 may store the multiple access characteristics as characteristic information. For example, a game in which a large number of players participate at the same time has a high priority of the multiple access characteristic.
- FIG. 9 is a chart for explaining another example of the characteristic information stored in the storage unit 150 according to the embodiment of the present disclosure.
- the storage unit 150 stores the priority of the characteristic information and the information about the network slice as the communication control information in association with each other. For example, when the low delay characteristic is low (Low), the large capacity characteristic is low (Low), and the multiple access characteristic is high (High), "Slice 10" is used as the network slice.
- the acquisition unit 161 of the control unit 160 includes a service information acquisition unit 161a, a scene information acquisition unit 161b, and a characteristic information acquisition unit 161c.
- the service information acquisition unit 161a acquires service information related to the service provided by the application unit 110 from the terminal device 20. For example, when the application unit 110 provides a game service, the service information acquisition unit 161a acquires information about a game subgenre from the terminal device 20 via the communication unit 140.
- the scene information acquisition unit 161b acquires scene information from the terminal device 20 via the communication unit 140.
- the scene information acquisition unit 161b acquires, for example, information indicating whether the scene image displayed on the screen of the terminal device 20 is a menu scene which is a menu image or a play scene which is a play image.
- the characteristic information acquisition unit 161c acquires characteristic information based on the service information and the scene information. For example, when the service information is a "fighting game” and the scene information is "play", the characteristic information acquisition unit 161c refers to the storage unit 150, has a high low delay characteristic (High), and has a large capacity characteristic. The information that is low (Low) is acquired (see FIG. 6).
- the buffer control unit 162 shown in FIG. 3 controls the buffer amount of the buffers 131 and 141 based on the characteristic information acquired by the characteristic information acquisition unit 161c.
- the buffer control unit 162 refers to, for example, the storage unit 150, and determines the buffer amount corresponding to the priority of the characteristic information.
- the buffers 131 and 141 temporarily store data for coding processing and communication processing. Therefore, the longer the data is accumulated, the longer the data transmission is delayed, which leads to the transmission delay. Therefore, in order to reduce the data transmission delay, the buffer amounts of the buffers 131 and 141 may be reduced.
- the information processing apparatus 10 needs to convert the data into various formats and adjust the timing of sending or receiving the data, so that the buffer amount is to some extent. Buffers 131 and 141 are required.
- the buffer control unit 162 controls the buffers 131 and 141 to be the first buffer amount B1 having a small buffer amount.
- the buffer amount B1 having a small buffer amount.
- the buffer control unit 162 controls the buffers 131 and 141 to be the second buffer amount B2 (B1 ⁇ B2) having a large buffer amount.
- B1 ⁇ B2 the second buffer amount
- the buffer control unit 162 increases the buffer amount when the priority of the large capacity characteristic is high as compared with the case where the priority of the low delay characteristic is high. As a result, the information processing apparatus 10 can transmit high-quality image data.
- the priority of the multiple access characteristic is high, since a large number of players (terminal device 20) play the game, the data to be transmitted is often small, and the buffer amount for data processing may be small. However, it is important to control the communication timing for communicating with a large number of terminal devices 20. Therefore, there is a possibility that a waiting time for adjusting the communication timing may occur, and a certain amount of buffer is required to cope with this waiting time.
- the buffer control unit 162 controls the buffers 131 and 141 so that the buffer amount is a medium third buffer amount B3 (B1 ⁇ B3 ⁇ B2).
- the information processing apparatus 10 can transmit small data while controlling the communication timing.
- the communication units 140 have first to third communication processing units 140a to 140c, and each of the first to third communication processing units 140a to 140c has buffers 141a to 141c, respectively.
- the buffer control unit 162 controls the buffer amount for each of the buffers 141a to 141c.
- the communication control unit 163 controls the processing related to the communication performed by the communication unit 140 based on the characteristic information acquired by the characteristic information acquisition unit 161c.
- the communication control unit 163 refers to the storage unit 150 and selects a network slice to be used for communication according to the characteristic information.
- the communication control unit 163 selects the bandwidth used for communication. For example, when the priority of the low delay characteristic is high, the communication control unit 163 narrows the bandwidth used for communication so as to be the first bandwidth W1. As a result, the information processing apparatus 10 can easily secure a band and can easily stabilize communication.
- the communication control unit 163 widens the bandwidth used for communication to be the second bandwidth W2 (W1 ⁇ W2). As a result, the information processing apparatus 10 can increase the amount of data that can be transmitted at one time.
- the communication control unit 163 narrows the bandwidth used for communication to be the third bandwidth W3 (W1 ⁇ W3). As a result, the information processing apparatus 10 can easily secure a band and can easily stabilize communication.
- the communication control unit 163 selects the protocol used by the communication unit 140 based on the characteristic information. An example of the protocol used in the communication unit 140 will be described later.
- the communication control unit 163 can control the coding processing in the coding unit 130 and the rendering processing in the rendering processing unit 120.
- the coding process takes time and the transmission delay becomes large.
- the communication control unit 163 reduces the compression rate of the compression process performed by the coding unit 130 to the first compression rate C1. Further, the communication control unit 163 reduces the resolution after the compression process performed by the coding unit 130 to the first resolution R1 (lower resolution). As a result, the information processing apparatus 10 can shorten the time of the compression process performed by the coding unit 130, and can reduce the transmission delay.
- the communication control unit 163 increases the compression rate of the compression process performed by the coding unit 130 to the second compression rate C2 (C1 ⁇ C2). Further, the communication control unit 163 increases the resolution after the compression process performed by the coding unit 130 to the second resolution R2 (R1 ⁇ R2) (higher resolution). As a result, the information processing apparatus 10 can transmit high-quality image data.
- the communication control unit 163 sets, for example, the compression rate of the compression process performed by the coding unit 130 to a small or medium third compression rate C3 (C1 ⁇ C3 ⁇ C2). .. Further, the communication control unit 163 sets the resolution after the compression process performed by the coding unit 130 to, for example, a small or medium third resolution R3 (R1 ⁇ R3 ⁇ R2). As a result, the information processing apparatus 10 can transmit image data having a small or medium size, and the transmission delay can be reduced.
- the communication control unit 163 can control, for example, a frame rate or a bit rate according to the characteristic information.
- the time interval for each frame becomes shorter and the transmission delay becomes smaller.
- the bit rate also increases, and it takes time for coding processing and communication processing.
- the communication control unit 163 increases, for example, the frame rate after the compression process performed by the coding unit 130 to the first frame rate FR1. Further, the communication control unit 163 reduces, for example, the bit rate to the first bit rate BR1. For example, the communication control unit 163 reduces the bit rate by reducing the resolution of the image data.
- the communication control unit 163 reduces, for example, the frame rate after the compression process performed by the coding unit 130 to the second frame rate FR2 (FR1> FR2). Further, the communication control unit 163 increases, for example, the bit rate to the second bit rate BR2 (BR1 ⁇ BR2). For example, the communication control unit 163 increases the bit rate by increasing the resolution of the image data.
- the communication control unit 163 sets the frame rate after the compression process performed by the coding unit 130 to a medium or large third frame rate FR3 (FR1 ⁇ FR3> FR2), for example. do. Further, the communication control unit 163 sets the bit rate to, for example, a small or medium third bit rate BR3 (BR1 ⁇ BR3 ⁇ BR2). For example, the communication control unit 163 adjusts the bit rate by adjusting the resolution of the image data.
- the rendering processing unit 120 generates image data according to the instruction from the control unit 160.
- the rendering processing unit 120 outputs the generated image data to the coding unit 130.
- the coding unit 130 is, for example, a video encoder that performs compression processing on the image data generated by the rendering processing unit 120.
- the coding unit 130 compresses the image data at the compression rate, the frame rate, and the bit rate according to the characteristic information according to the instruction from the control unit 160, and generates the compressed data.
- the coding unit 130 outputs the generated compressed data to the communication unit 140.
- the communication unit 140 processes the compressed data according to an appropriate communication protocol for transmitting the compressed data, and generates transmission data.
- the communication unit 140 has first to third communication processing units 140a to 140c.
- the first and second communication processing units 140a and 140b perform communication processing for video transmission
- the third communication processing unit 140c performs communication processing according to the transmission path.
- the first communication processing unit 140a generates a video transmission stream according to, for example, RTP (Real time Transport Protocol).
- RTP is a protocol often used for Audio / Video transmission.
- RTP is often used in combination with other protocols such as RTCP (RTP Control Protocol) that controls communication quality, etc., but here, RTP is used to simplify the explanation. The case will be described.
- RTP is a protocol that basically organizes video data (compressed data) into a fixed format and converts it into a format that is easy to send.
- a time stamp indicating the time when the video data was sampled and a sequence number indicating the order of the RTP packets are also included in the format.
- the time stamp and the sequence number are used, for example, for the receiving side to determine the data loss during transmission and the timing of video reproduction.
- the first communication processing unit 140a temporarily stores video data and the like using the buffer 141a whose buffer amount has been adjusted by the control unit 160, and generates a video transmission stream (RTP packet).
- the first communication processing unit 140a outputs the generated first communication data (for example, a video transmission stream) to the second communication processing unit 140b.
- the second communication processing unit 140b generates transmission data (second communication data) according to the communication protocol.
- the image data is transmitted to the terminal device 20 via the IP network.
- the IP network is the so-called Internet.
- the RTP packet is usually transmitted to the terminal device 20 using IP (Internet Protocol) after using TCP (Transmission Control Protocol) or UDP (User Datagram Protocol).
- TCP and UDP are designed to reliably transmit data from the sender to the receiver via the Internet, using information such as the source address and recipient address required for Internet communication depending on the IP. It is a protocol. Of TCP and UDP, TCP enables more reliable data transmission. UDP can transmit data with lower delay than TCP. Since UDP is generally used when RTP is used, a case where the second communication processing unit 140b uses UDP to generate transmission data will be described below.
- FIG. 10 is a diagram for explaining transmission data generated by the communication unit 140 according to the embodiment of the present disclosure.
- the first communication processing unit 140a performs RTP processing on the compressed data string generated by the coding unit 130, attaches an RTP header to the compressed data string, and generates an RTP packet.
- the RTP packet is output to the second communication processing unit 140b.
- the second communication processing unit 140b adds a UDP header to the RTP packet to generate a UDP packet.
- the UDP header contains information about, for example, a port for internet transmission.
- the port is a data entry / exit number inside the device (information processing device 10).
- the second communication processing unit 140b adds an IP header to the UDP packet to generate an IP packet.
- the IP header includes, for example, a source address and a destination address for Internet transmission.
- the second communication processing unit 140b temporarily stores each packet or the like using the buffer 141b whose buffer amount has been adjusted by the control unit 160, and generates an IP packet.
- the second communication processing unit 140b outputs the generated IP packet to the third communication processing unit 140c.
- the second communication processing unit 140b uses UDP to generate a UDP packet, but the present invention is not limited to this.
- the second communication processing unit 140b may use TCP to generate a TCP packet.
- the first communication processing unit 140a may generate the first communication data by using a protocol other than RTP.
- the second communication processing unit 140b may change the protocol based on the characteristic information. For example, the second communication processing unit 140b may select UDP when the priority of the low delay characteristic is high, and select TCP when the priority of the large capacity characteristic is high. In this case, the first communication processing unit 140a may change the protocol to be used according to the protocol selected by the second communication processing unit 140b.
- the third communication processing unit 140c performs processing according to the transmission physical medium on the IP packet to generate a transmission signal.
- the third communication processing unit 140c transmits the generated transmission signal to the terminal device 20.
- the transmission physical medium is a network to which the information processing device 10 and the terminal device 20 are connected, and examples thereof include Ethernet, 5G, and 4G.
- the third communication processing unit 140c performs signal processing on the IP packet according to the type of network to generate and transmit a transmission signal. For example, in a 5G network, communication satisfying low delay characteristics and large capacity characteristics is performed by using the network slice technique described above.
- the third communication processing unit 140c transmits a transmission signal using, for example, a network slice selected by the control unit 160.
- the third communication processing unit 140c temporarily stores each packet or the like using the buffer 141c whose buffer amount has been adjusted by the control unit 160, and generates a transmission signal.
- the third communication processing unit 140c transmits the generated transmission signal to the terminal device 20.
- the information processing device 10 acquires the characteristic information of the service provided from the terminal device 20, and decides to change the processing related to communication based on the acquired characteristic information.
- the information processing apparatus 10 can perform communication processing according to the characteristic information, and can perform efficient communication control. Therefore, the information processing device 10 can provide a service of stable quality to the terminal device 20.
- the information processing device 10 also controls the coding processing in the coding unit 130, the buffer amount, and the like based on the characteristic information. For example, even if the information processing apparatus 10 only controls the communication of the communication related to the network, the characteristics caused by the transmission line (network) are improved, but the characteristics caused by, for example, the coding process are not improved. Specifically, even if the information processing apparatus 10 selects a network slice and reduces the delay on the network, if the coding process takes a long time, the delay of the data transmission itself can be reduced. Can not.
- the information processing apparatus 10 controls the buffer amount, the coding process, and the like in addition to the communication process by the communication unit 140 as the communication control process based on the characteristic information.
- the information processing apparatus 10 can perform communication satisfying the characteristics required for the service, and can provide the terminal apparatus 20 with a service of stable quality.
- FIG. 11 is a diagram showing an example of the configuration of the terminal device 20 according to the embodiment of the present disclosure.
- the storage unit 250 stores the game service provided by the application unit 110.
- the acquisition unit 261 of the control unit 260 includes a service information acquisition unit 261a, a scene information acquisition unit 261b, and a characteristic information acquisition unit 261c.
- the service information acquisition unit 261a acquires service information related to the service provided from the application unit 110 from, for example, the storage unit 250. For example, when the application unit 110 provides a game service, the service information acquisition unit 261a acquires information regarding a sub-genre of the game. The service information acquisition unit 261a notifies the information processing apparatus 10 of the acquired service information.
- the scene information acquisition unit 261b acquires scene information.
- the scene information acquisition unit 261b acquires scene information from, for example, the input / output unit 240.
- the scene information acquisition unit 261b notifies the information processing apparatus 10 of the acquired scene information.
- the characteristic information acquisition unit 261c acquires characteristic information from the information processing apparatus 10.
- the buffer control unit 262 controls the buffer amount of the buffers 211 and 221 based on the characteristic information acquired by the characteristic information acquisition unit 261c.
- the buffer control unit 262 refers to, for example, the storage unit 250, and determines the buffer amount corresponding to the priority of the characteristic information. Since the specific buffer control is the same as the control performed by the buffer control unit 162 of the information processing apparatus 10, the description thereof will be omitted.
- the communication unit 210 has first to third communication processing units 210a to 210c, and each of the first to third communication processing units 210a to 210c has buffers 211a to 211c, respectively.
- the buffer control unit 262 controls the buffer amount for each of the buffers 211a to 211c.
- the communication control unit 263 controls the processing related to the communication performed by the communication unit 210 based on the characteristic information acquired by the characteristic information acquisition unit 261c.
- the communication control unit 263 selects the protocol used by the communication unit 210 based on the characteristic information.
- the communication control unit 263 selects the protocol used in the information processing apparatus 10.
- the communication control unit 263 can control the coding processing in the decoding unit 220 and the rendering processing in the rendering processing unit 230.
- the communication control unit 263 selects the compression rate to be used by the decoding unit 220 based on the characteristic information.
- the communication control unit 263 selects the compression ratio used in the coding process of the information processing apparatus 10.
- the communication control unit 263 selects the frame rate and the bit rate used in the coding process of the information processing apparatus 10 based on the characteristic information.
- the communication unit 210 processes the received signal received from the information processing device 10 according to an appropriate communication protocol to generate compressed data.
- the communication unit 210 has first to third communication processing units 210a to 210c.
- the first communication processing unit 210a performs communication processing according to the transmission path
- the second and third communication processing units 210b and 210c perform communication processing for video transmission.
- the first communication processing unit 210a processes the received received signal according to the transmission physical medium to generate an IP packet.
- the first communication processing unit 210a outputs the generated IP packet to the second communication processing unit 210b.
- the first communication processing unit 210a temporarily stores received signals and the like using the buffer 211a whose buffer amount has been adjusted by the control unit 260, and generates an IP packet.
- the second communication processing unit 210b generates the first communication data (video stream) from the IP packet according to the communication protocol. As described above, when the information processing apparatus 10 uses IP and UDP to generate an IP packet, the second communication processing unit 210b also generates the first communication data from the IP packet based on the IP and UDP.
- the second communication processing unit 210b generates a UDP packet based on, for example, an IP header added to the IP packet.
- the second communication processing unit 210b generates an RTP packet based on the UDP header added to the UDP packet.
- the second communication processing unit 210b temporarily stores each packet or the like using the buffer 211b whose buffer amount has been adjusted by the control unit 260, and generates an RTP packet.
- the second communication processing unit 210b outputs the generated RTP packet to the third communication processing unit 210c.
- the third communication processing unit 210c generates compressed data according to, for example, RTP.
- the third communication processing unit 210c temporarily stores RTP packets and the like using the buffer 211c whose buffer amount has been adjusted by the control unit 260, and generates compressed data.
- the decoding unit 220 is a video decoder that generates image data by performing decompression processing for decompressing compressed data generated by, for example, the communication unit 210.
- the decoding unit 220 decompresses the compressed data at a compression rate, a frame rate, and a bit rate according to the characteristic information according to the instruction from the control unit 160, and generates image data.
- the decoding unit 220 outputs the generated image data to the rendering processing unit 230.
- the rendering processing unit 230 performs rendering processing on the image data according to the instruction from the control unit 260, and outputs the image data to the input / output unit 240.
- the terminal device 20 acquires the characteristic information of the service to be provided, and changes the processing related to communication based on the acquired characteristic information. As a result, the terminal device 20 can perform communication processing according to the characteristic information, and can perform efficient communication control. Therefore, the terminal device 20 can enjoy a service of stable quality.
- the terminal device 20 controls the buffer amount, the decoding process, and the like in addition to the communication process by the communication unit 210 based on the characteristic information. As a result, the terminal device 20 can perform communication satisfying the characteristics required for the service, and can enjoy the service of stable quality.
- FIG. 12 is a flowchart showing a flow of communication processing executed by the information processing apparatus 10 according to the embodiment of the present disclosure. While the information processing apparatus 10 is providing the service to the terminal apparatus 20, the information processing apparatus 10 repeatedly executes the communication process shown in FIG. 12 at a predetermined cycle. Alternatively, the information processing apparatus 10 may execute the communication process shown in FIG. 12 at the timing when the scene is switched.
- the information processing apparatus 10 acquires scene information (step S101).
- the information processing device 10 acquires scene information regarding a game scene from, for example, the terminal device 20.
- the information processing device 10 may acquire service information indicating the type of the game from the terminal device 20.
- the information processing apparatus 10 acquires characteristic information required for service provision based on scene information and service information (step S102).
- the characteristic information includes, for example, low delay characteristics, large capacity characteristics, and multiple connection characteristics.
- the characteristic information may be information indicating the priority of these characteristics.
- the information processing apparatus 10 changes the buffer amount of the buffers 131 and 141 used for data transmission based on the characteristic information (step S103).
- the information processing apparatus 10 changes the communication process for data transmission (step S104).
- the information processing apparatus 10 changes parameters used for communication, such as network slices and bandwidth. Further, the information processing apparatus 10 changes parameters related to communication data generation such as compression rate and data rate.
- the information processing apparatus 10 generates transmission data using the changed buffer, parameters, and the like (step S105), and transmits the generated transmission data (step S106).
- FIG. 13 is a flowchart showing the flow of communication processing executed by the terminal device 20 according to the embodiment of the present disclosure.
- the terminal device 20 repeatedly executes the communication process shown in FIG. 13 at a predetermined cycle while receiving the service from the information processing device 10.
- the terminal device 209 may execute the communication process shown in FIG. 13 at the timing when the scene is switched.
- the terminal device 20 acquires scene information (step S201).
- the terminal device 20 acquires scene information regarding a game scene from, for example, the input / output unit 240.
- the terminal device 20 may acquire service information indicating the type of the game from the storage unit 250.
- the terminal device 20 acquires characteristic information from the information processing device 10 (step S102).
- the characteristic information includes, for example, low delay characteristics, large capacity characteristics, and multiple connection characteristics. Alternatively, the characteristic information may be information indicating the priority of these characteristics.
- the terminal device 20 acquires characteristic information by notifying the information processing apparatus 10 of the scene information and service information acquired in step S201.
- the terminal device 20 changes the buffer amount of the buffers 131 and 141 used for data reception based on the characteristic information (step S203).
- the terminal device 20 changes the communication process for receiving data (step S204). Further, the terminal device 20 changes parameters related to data decoding such as compression rate and data rate.
- the terminal device 20 receives the received data using the changed buffer, parameters, and the like (step S205), and decodes the received received data (step S206).
- the menu and the play are described as an example of the game scene, but the game scene is not limited to this.
- the scene of the game may include an "explanatory video" scene for explaining the operation method of the game, the story, and the like.
- the terminal device 20 transmits the scene information related to the scene to the information processing device 10, but at this time, the terminal device 20 may transmit the scene information using TCP. good.
- the scene information is also information indicating the progress of the game, and although the amount of data is small, it is information that should be transmitted more reliably. Therefore, the terminal device 20 transmits the scene information using TCP, unlike the moving image transmission using UDP.
- TCP is a protocol for transmitting data more reliably than UDP. Therefore, the terminal device 20 can more reliably transmit the scene information to the information processing device 10 by IP-transmitting the scene information using TCP.
- control units 160 and 260 control the buffer amount of each processing unit based on the scene information, but the present invention is not limited to this.
- Each processing unit may acquire scene information and control the buffer amount.
- the coding unit 140 and the communication unit 140 may acquire scene information and control the buffer amounts of the buffers 131 and 141, respectively.
- the terminal device 20 determines the scene based on the image data presented to the user, the operation information performed by the user, and the like, and generates and transmits the scene information.
- the terminal device 20 may transmit the operation information performed by the user to the information processing device 10.
- the application unit 110 of the information processing apparatus 10 determines the scene based on the operation information and generates the scene information.
- the control unit 160 of the information processing device 10 and the control unit 260 of the terminal device 20 acquire scene information from the application unit 110.
- the information processing device 10 is a game server, and the game service is provided to the user as an application function, but the present invention is not limited to this.
- the information processing device 10 may be an application server that provides application functions other than games.
- the information processing device 10 may be a mobile body such as a robot or a drone.
- the information processing device 10 transmits the image data captured by the moving body to the terminal device 20 that controls the moving body.
- the user steers the moving body while checking the image displayed on the terminal device 20.
- the information processing apparatus 10 controls communication separately when the moving body is moving at a predetermined speed or higher (moving scene) and when the moving body is stopped at zero speed or slowly moving at a speed lower than the predetermined speed (stop scene). May be done.
- the information processing apparatus 10 transmits image data with a high priority of low delay characteristics in a moving scene, and transmits image data with a high priority of a large capacity (high image quality) characteristic in a stopped scene. , Perform communication control.
- the information processing device 10 generates characteristic information from service information, scene information, and the like acquired from the terminal device 20, but the present invention is not limited to this.
- the information processing device 10 may acquire information about a service provided to the terminal device 20 such as service information and scene information from the application unit 110.
- the terminal device 20 may acquire characteristic information from service information, scene information, and the like.
- the storage unit 250 of the terminal device 20 stores the same characteristic information and the like (see FIGS. 5, 6 and the like) as the storage unit 150 of the information processing device 10.
- the terminal device 20 refers to the storage unit 250 based on the acquired service information and scene information, and acquires characteristic information.
- the storage unit 250 may store the correspondence between the service information and the characteristic information in advance, or may acquire and store the service information and the characteristic information from the information processing apparatus 10 via the control unit 260.
- the control device for controlling the information processing device 10 or the terminal device 20 of the present embodiment may be realized by a dedicated computer system or a general-purpose computer system.
- a program for executing the above operation is stored and distributed in a computer-readable recording medium such as an optical disk, a semiconductor memory, a magnetic tape, or a flexible disk.
- the control device is configured by installing the program in a computer and executing the above-mentioned processing.
- the control device may be an external device (for example, a personal computer) of the information processing device 10 or the terminal device 20.
- the control device may be an internal device (for example, control unit 160 or control unit 260) of the information processing device 10 or the terminal device 20.
- the above communication program may be stored in a disk device provided in a server device on a network such as the Internet so that it can be downloaded to a computer or the like.
- the above-mentioned functions may be realized by cooperation between the OS (Operating System) and the application software.
- the part other than the OS may be stored in a medium and distributed, or the part other than the OS may be stored in the server device so that it can be downloaded to a computer or the like.
- each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of them may be functionally or physically distributed / physically in arbitrary units according to various loads and usage conditions. Can be integrated and configured.
- the present embodiment includes a device or any configuration constituting the system, for example, a processor as a system LSI (Large Scale Integration), a module using a plurality of processors, a unit using a plurality of modules, and a unit. It can also be implemented as a set or the like with other functions added (that is, a configuration of a part of the device).
- a processor as a system LSI (Large Scale Integration)
- a module using a plurality of processors a unit using a plurality of modules
- a unit that is, a configuration of a part of the device.
- the system means a set of a plurality of components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a device in which a plurality of modules are housed in one housing are both systems. ..
- the present embodiment can have a cloud computing configuration in which one function is shared by a plurality of devices via a network and jointly processed.
- the present technology can also have the following configurations.
- An information processing device that provides application functions to client devices.
- An acquisition unit that acquires characteristic information related to the application function
- a communication unit that communicates with the client device, Equipped with The communication unit changes the processing related to the communication according to the characteristic information.
- Information processing equipment (2) The communication unit The information processing apparatus according to (1), wherein the processing related to the communication is changed based on the characteristic information according to the scene of the application function.
- the communication unit The information processing apparatus according to (2), wherein the processing related to the communication is changed according to the characteristics of the communication quality required for each scene.
- the communication unit The information processing apparatus according to (2), wherein the processing related to the communication is changed according to the number of the client devices provided with the application function.
- the acquisition unit Acquiring the characteristic information from the storage unit, The information processing apparatus according to any one of (1) to (4).
- the communication unit Based on the characteristic information, when low delay is required, the bandwidth used for the communication is narrowed, and when a large capacity is required, the bandwidth is widened.
- the communication unit At least one of the frame rate and the bit rate of the data transmitted to the client device is changed according to the characteristic information.
- the communication unit The buffer amount of the buffer used for the processing related to the communication is changed according to the characteristic information.
- the communication unit Based on the characteristic information, when low delay is required, the buffer amount is reduced, and when a large capacity is required, the buffer amount is increased.
- the information processing apparatus according to (8).
- An information processing device that receives application functions from a client server.
- An acquisition unit that acquires characteristic information related to the application function
- a communication unit that communicates with the client server, Equipped with The communication unit changes the processing related to the communication according to the characteristic information.
- Information processing equipment (11) It is a communication method for communicating in an information processing device that provides an application function to a client device. Acquiring characteristic information about the application function and Communicating with the client device Including In the communication with the client device, the process related to the communication is changed according to the characteristic information. Communication method.
- Information processing equipment 20 Terminal equipment 30 Base station equipment 110 Application unit 120, 230 Rendering processing unit 130 Coding unit 140, 210 Communication unit 150, 250 Storage unit 160, 260 Control unit 161, 261 Acquisition unit 162, 262 Buffer control unit 163, 263 Communication control unit 220 Decoding unit 240 Input / output unit
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Information Transfer Between Computers (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
1.はじめに
1.1.提案技術の概要
2.情報処理システムの構成例
2.1.情報処理システム
2.2.情報処理装置
2.3.端末装置
3.通信処理
3.1.情報処理装置による通信処理
3.2.端末装置による通信処理
4.その他の実施形態
5.補足
<1.1.提案技術の概要>
まず、本開示に係る提案技術の概要について説明する。図1は、本開示の提案技術の概要を説明するための図である。本開示に係る提案技術は、図1に示す情報処理システムで実施される。図1に示すように、情報処理システムは、情報処理装置10と、端末装置20と、基地局装置30と、を有する。
<2.1.情報処理システム>
図2は、本開示の実施形態に係る情報処理システムの構成の一例を示す図である。上述したように、情報処理システムは、情報処理装置10と、端末装置20と、を有する。なお、図2では図示を省略しているが、図1に示すように、情報処理システムが基地局装置30を有していてもよい。あるいは、情報処理装置10がMEC(Mobile Edge Computing)である場合、情報処理装置10が、基地局装置30内のサーバとして配置されてもよい。
図2に示すように、情報処理装置10は、クライアントデバイスにアプリケーション機能を提供するクライアントサーバである。情報処理装置10は、例えば、アプリケーション機能としてゲームサービスを提供するゲームサーバ(Game Server)であり、端末装置20に対してゲーム画面として表示する動画像データを。また、情報処理装置10は、ゲーム画面として表示しているシーンに関する情報(シーン情報)を端末装置20から受信する。シーン情報は、例えば、ゲーム画面がメニュー画面であるか、プレイ画面であるか等、ゲームのシーンを示す情報である。
アプリケーション部110は、制御部160が取得した情報に基づき、端末装置20にサービスを提供する1または2以上のアプリケーションである。アプリケーション部110は、例えばCPU(Central Processing Unit)上でプログラムが動作することで実現され、端末装置20に動画像を表示させることで、端末装置20を使用するユーザにゲームサービスを提供する。
レンダリング処理部120は、端末装置20に表示させる動画像のレンダリング処理を行う描画部である。レンダリング処理部120は、ゲーム画面として表示する画像データを生成する処理を行う。レンダリング処理部120は、アプリケーション部110及び制御部160の指示に従い、所定のレンダリング解像度及びフレームレートでゲームのシーン画像のレンダリングを行う。
符号化部130は、レンダリング処理部120が生成した画像データを符号化することで圧縮し、圧縮したビットストリーム(以下、圧縮データとも記載する)を通信部140に出力する。符号化部130は、制御部160の指示に従い、圧縮データを生成する。
通信部140は、外部装置との通信を行う通信インタフェース(I/F)である。通信部140は、例えば、NIC(Network Interface Card)等によって実現される。例えば、通信部140は、基地局装置30(図1参照)が接続するコアネットワークと通信を行う。通信部140は、符号化部130が符号化したシーン画像を送信信号に変換して端末装置20に送信する。また、通信部140は、端末装置20からシーン情報やゲームサービスに関するサービス情報を受信し、受信結果を制御部160に通知する。また、通信部140は、シーン情報やサービス情報に基づいて生成された特性情報を端末装置20に送信する。
記憶部150は、DRAM、SRAM、フラッシュメモリ、ハードディスク等のデータ読み書き可能な記憶装置である。記憶部150は、情報処理装置10の記憶手段として機能する。記憶部150は、後述する制御部160による通信制御やバッファ制御に使用する制御情報等を記憶する。
制御部160は、情報処理装置10の各部を制御する。制御部160は、例えば、CPU(Central Processing Unit)やMPU(Micro Processing Unit)等によって情報処理装置10内部に記憶されたプログラムがRAM(Random Access Memory)等を作業領域として実行されることにより実現される。また、制御部160は、例えば、ASIC(Application Specific Integrated Circuit)やFPGA(Field Programmable Gate Array)等の集積回路により実現される。
取得部161は、ゲームの特性に関する情報(特性情報)を取得する。取得部161は、端末装置20からゲームサービスに関する情報やゲームサービスのシーンに関する情報を取得し、取得したこれらの情報に基づいて記憶部150から特性情報を取得する。
バッファ制御部162は、取得部161が取得した特性情報に基づき、各部のバッファ131、141を制御する。バッファ制御部162は、特性情報に基づき、バッファ131、141のバッファ量を制御する。
通信制御部163は、取得部161が取得した特性情報に基づき、通信部140が行う通信処理を制御する。また、通信制御部163は、フレームレートや符号化率等、符号化部130が行う処理を制御する。
端末装置20は、クライアントサーバである情報処理装置10からアプリケーション機能の提供を受けるクライアントデバイス(情報処理装置)である。端末装置20は、例えばアプリケーション機能としてゲームサービスの提供を受ける。
通信部210は、外部装置との通信を行う通信インタフェース(I/F)である。通信部210は、例えば、NIC(Network Interface Card)等によって実現される。例えば、通信部210は、基地局装置30(図1参照)と無線通信を行うことでコアネットワークに接続する。通信部210は、情報処理装置10からゲームの動画像データを受信する。通信部210は、情報処理装置10にシーン情報やゲームサービスに関するサービス情報を送信する。通信部210は、特性情報を情報処理装置10から受信する。
復号部220は、通信部210が受信した動画像データを復号する。復号部220は、バッファ221を有し、動画像データを一時的に保存して復号処理を行う。
レンダリング処理部230は、復号部220が復号した動画像データをレンダリングして入出力部240のディスプレイ(図示省略)に表示させる。
入出力部240は、例えばディスプレイ等の表示装置(図示省略)や、操作器(コントローラ)等の入力装置(図示省略)を有する。入出力部240は、レンダリング処理部230がレンダリングした動画像データをディスプレイに表示する。入出力部240は、入力装置を介してユーザによるゲームに対する操作を検出する。
記憶部250は、DRAM、SRAM、フラッシュメモリ、ハードディスク等のデータ読み書き可能な記憶装置である。記憶部250は、端末装置20の記憶手段として機能する。記憶部250は、後述する制御部260による通信制御やバッファ制御に使用する制御情報等を記憶する。
制御部260は、端末装置20の各部を制御する。制御部260は、例えば、CPU(Central Processing Unit)やMPU(Micro Processing Unit)等によって端末装置20内部に記憶されたプログラムがRAM(Random Access Memory)等を作業領域として実行されることにより実現される。また、制御部260は、例えば、ASIC(Application Specific Integrated Circuit)やFPGA(Field Programmable Gate Array)等の集積回路により実現される。
取得部261は、アプリケーション機能(ゲームの特性)に関する情報(特性情報)を取得する。取得部261は、ゲームサービスに関するサービス情報やゲームサービスのシーンに関するシーン情報を、入出力部240や記憶部250から取得する。取得したこれらの情報を情報処理装置10に通知することで、取得部261は、情報処理装置10から特性情報を取得する。
バッファ制御部262は、取得部261が取得した特性情報に基づき、各部のバッファ211、221を制御する。バッファ制御部262は、特性情報に基づき、バッファ211、221のバッファ量を制御する。
通信制御部263は、取得部261が取得した特性情報に基づき、通信部210が行う通信処理を制御する。また、通信制御部263は、フレームレートや復号率等、復号部220が行う処理を制御する。
次に、情報処理装置10の詳細について説明する。図3は、本開示の実施形態に係る情報処理装置10の構成の一例を示す図である。
情報処理装置10のアプリケーション部110は、例えばゲームサービスを提供するアプリケーションである。
図3に戻る。記憶部150は、アプリケーション部110が提供するゲームサービスと特性情報とを対応付けて記憶する。
図3に戻る。制御部160の取得部161は、サービス情報取得部161aと、シーン情報取得部161bと、特性情報取得部161cと、を備える。
レンダリング処理部120は、制御部160からの指示に従い、画像データを生成する。レンダリング処理部120は、生成した画像データを符号化部130に出力する。
符号化部130は、例えばレンダリング処理部120が生成した画像データに対して圧縮処理を行うビデオエンコーダである。符号化部130は、制御部160からの指示に従い、特性情報に応じた圧縮率、フレームレート及びビットレートで画像データを圧縮し、圧縮データを生成する。符号化部130は、生成した圧縮データを通信部140に出力する。
通信部140は、圧縮データを伝送するために適切な通信プロトコルに従って圧縮データを加工し、送信データを生成する。通信部140は、第1~第3通信処理部140a~140cを有する。例えば、第1、第2通信処理部140a、140bは、ビデオ伝送のための通信処理を行い、第3通信処理部140cは、伝送路に応じた通信処理を行う。
図11は、本開示の実施形態に係る端末装置20の構成の一例を示す図である。
記憶部250は、アプリケーション部110から提供を受けるゲームサービスを記憶する。
制御部260の取得部261は、サービス情報取得部261aと、シーン情報取得部261bと、特性情報取得部261cと、を備える。
通信部210は、情報処理装置10から受信した受信信号を適切な通信プロトコルに従って加工し、圧縮データを生成する。通信部210は、第1~第3通信処理部210a~210cを有する。例えば、第1通信処理部210aは、伝送路に応じた通信処理を行い、第2、第3通信処理部210b、210cは、ビデオ伝送のための通信処理を行う。
復号部220は、例えば通信部210が生成した圧縮データを伸張する伸張処理を行い、画像データを生成するビデオデコーダである。復号部220は、制御部160からの指示に従い、特性情報に応じた圧縮率、フレームレート及びビットレートで圧縮データを伸張し、画像データを生成する。復号部220は、生成した画像データをレンダリング処理部230に出力する。
レンダリング処理部230は、制御部260からの指示に従い、画像データに対してレンダリング処理を施し、入出力部240に出力する。
<3.1.情報処理装置による通信処理>
図12は、本開示の実施形態に係る情報処理装置10が実行する通信処理の流れを示すフローチャートである。情報処理装置10は、端末装置20にサービスを提供している間、所定の周期で図12に示す通信処理を繰り返し実行する。あるいは、情報処理装置10は、シーンが切り替わったタイミングで図12に示す通信処理を実行するようにしてもよい。
図13は、本開示の実施形態に係る端末装置20が実行する通信処理の流れを示すうフローチャートである。端末装置20は、情報処理装置10からサービスの提供を受けている間、所定の周期で図13に示す通信処理を繰り返し実行する。あるいは、端末装置209は、シーンが切り替わったタイミングで図13に示す通信処理を実行するようにしてもよい。
上述の実施形態は一例を示したものであり、種々の変更及び応用が可能である。
以上、添付図面を参照しながら本開示の好適な実施形態について詳細に説明したが、本開示の技術的範囲はかかる例に限定されない。本開示の技術分野における通常の知識を有する者であれば、請求の範囲に記載された技術的思想の範疇内において、各種の変更例または修正例に想到し得ることは明らかであり、これらについても、当然に本開示の技術的範囲に属するものと了解される。
(1)
クライアントデバイスにアプリケーション機能を提供する情報処理装置であって、
前記アプリケーション機能に関する特性情報を取得する取得部と、
前記クライアントデバイスと通信を行う通信部と、
を備え、
前記通信部は、前記特性情報に応じて前記通信に関する処理を変更する、
情報処理装置。
(2)
前記通信部は、
前記アプリケーション機能のシーンに応じた前記特性情報に基づき、前記通信に関する処理を変更する、(1)に記載の情報処理装置。
(3)
前記通信部は、
前記シーンごとに要求される通信品質の特性に応じて前記通信に関する処理を変更する、(2)に記載の情報処理装置。
(4)
前記通信部は、
前記アプリケーション機能の提供を受ける前記クライアントデバイスの数に応じて前記通信に関する処理を変更する、(2)に記載の情報処理装置。
(5)
前記特性情報を記憶する記憶部をさらに備え、
前記取得部は、
前記記憶部から前記特性情報を取得する、
(1)~(4)のいずれか1つに記載の情報処理装置。
(6)
前記通信部は、
前記特性情報に基づき、低遅延が要求される場合、前記通信に使用する帯域幅を狭くし、大容量が要求される場合、前記帯域幅を広くする、
(1)~(5)のいずれか1つに記載の情報処理装置。
(7)
前記通信部は、
前記特性情報に応じて、前記クライアントデバイスに送信するデータのフレームレート及びビットレートの少なくとも一方を変更する、
(1)~(6)のいずれか1つに記載の情報処理装置。
(8)
前記通信部は、
前記特性情報に応じて、前記通信に関する処理に使用するバッファのバッファ量を変更する、
(1)~(7)のいずれか1つに記載の情報処理装置。
(9)
前記通信部は、
前記特性情報に基づき、低遅延が要求される場合、前記バッファ量を小さくし、大容量が要求される場合、前記バッファ量を大きくする、
(8)に記載の情報処理装置。
(10)
クライアントサーバからアプリケーション機能の提供を受ける情報処理装置であって、
前記アプリケーション機能に関する特性情報を取得する取得部と、
前記クライアントサーバと通信を行う通信部と、
を備え、
前記通信部は、前記特性情報に応じて前記通信に関する処理を変更する、
情報処理装置。
(11)
クライアントデバイスにアプリケーション機能を提供する情報処理装置において通信を行うための通信方法であって、
前記アプリケーション機能に関する特性情報を取得することと、
前記クライアントデバイスと通信を行うことと、
を含み、
前記クライアントデバイスとの前記通信において、前記特性情報に応じて前記通信に関する処理を変更する、
通信方法。
(12)
クライアントサーバからアプリケーション機能の提供を受ける情報処理装置において通信を行うための通信方法であって、
前記アプリケーション機能に関する特性情報を取得することと、
前記クライアントサーバと通信を行うことと、
を含み、
前記クライアントサーバとの前記通信において、前記特性情報に応じて前記通信に関する処理を変更する、
通信方法。
20 端末装置
30 基地局装置
110 アプリケーション部
120、230 レンダリング処理部
130 符号化部
140、210 通信部
150、250 記憶部
160、260 制御部
161、261 取得部
162、262 バッファ制御部
163、263 通信制御部
220 復号部
240 入出力部
Claims (12)
- クライアントデバイスにアプリケーション機能を提供する情報処理装置であって、
前記アプリケーション機能に関する特性情報を取得する取得部と、
前記クライアントデバイスと通信を行う通信部と、
を備え、
前記通信部は、前記特性情報に応じて前記通信に関する処理を変更する、
情報処理装置。 - 前記通信部は、
前記アプリケーション機能のシーンに応じた前記特性情報に基づき、前記通信に関する処理を変更する、請求項1に記載の情報処理装置。 - 前記通信部は、
前記シーンごとに要求される通信品質の特性に応じて前記通信に関する処理を変更する、請求項2に記載の情報処理装置。 - 前記通信部は、
前記アプリケーション機能の提供を受ける前記クライアントデバイスの数に応じて前記通信に関する処理を変更する、請求項2に記載の情報処理装置。 - 前記特性情報を記憶する記憶部をさらに備え、
前記取得部は、
前記記憶部から前記特性情報を取得する、
請求項1に記載の情報処理装置。 - 前記通信部は、
前記特性情報に基づき、低遅延が要求される場合、前記通信に使用する帯域幅を狭くし、大容量が要求される場合、前記帯域幅を広くする、
請求項1に記載の情報処理装置。 - 前記通信部は、
前記特性情報に応じて、前記クライアントデバイスに送信するデータのフレームレート及びビットレートの少なくとも一方を変更する、
請求項1に記載の情報処理装置。 - 前記通信部は、
前記特性情報に応じて、前記通信に関する処理に使用するバッファのバッファ量を変更する、
請求項1に記載の情報処理装置。 - 前記通信部は、
前記特性情報に基づき、低遅延が要求される場合、前記バッファ量を小さくし、大容量が要求される場合、前記バッファ量を大きくする、
請求項8に記載の情報処理装置。 - クライアントサーバからアプリケーション機能の提供を受ける情報処理装置であって、
前記アプリケーション機能に関する特性情報を取得する取得部と、
前記クライアントサーバと通信を行う通信部と、
を備え、
前記通信部は、前記特性情報に応じて前記通信に関する処理を変更する、
情報処理装置。 - クライアントデバイスにアプリケーション機能を提供する情報処理装置において通信を行うための通信方法であって、
前記アプリケーション機能に関する特性情報を取得することと、
前記クライアントデバイスと通信を行うことと、
を含み、
前記クライアントデバイスとの前記通信において、前記特性情報に応じて前記通信に関する処理を変更する、
通信方法。 - クライアントサーバからアプリケーション機能の提供を受ける情報処理装置において通信を行うための通信方法であって、
前記アプリケーション機能に関する特性情報を取得することと、
前記クライアントサーバと通信を行うことと、
を含み、
前記クライアントサーバとの前記通信において、前記特性情報に応じて前記通信に関する処理を変更する、
通信方法。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2022560626A JPWO2022097303A1 (ja) | 2020-11-09 | 2020-11-09 | |
CN202080106839.7A CN116457767A (zh) | 2020-11-09 | 2020-11-09 | 信息处理设备和通信方法 |
PCT/JP2020/041758 WO2022097303A1 (ja) | 2020-11-09 | 2020-11-09 | 情報処理装置及び通信方法 |
US18/251,401 US20230405457A1 (en) | 2020-11-09 | 2020-11-09 | Information processing device and communication method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2020/041758 WO2022097303A1 (ja) | 2020-11-09 | 2020-11-09 | 情報処理装置及び通信方法 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022097303A1 true WO2022097303A1 (ja) | 2022-05-12 |
Family
ID=81457706
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2020/041758 WO2022097303A1 (ja) | 2020-11-09 | 2020-11-09 | 情報処理装置及び通信方法 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20230405457A1 (ja) |
JP (1) | JPWO2022097303A1 (ja) |
CN (1) | CN116457767A (ja) |
WO (1) | WO2022097303A1 (ja) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2004093406A1 (ja) * | 2003-04-16 | 2004-10-28 | Sony Computer Entertainment Inc. | データ伝送装置、データ伝送方法、ゲーム機およびゲームシステム |
JP2004329300A (ja) * | 2003-04-30 | 2004-11-25 | Sony Computer Entertainment Inc | 通信方法およびゲーム機 |
JP2008016974A (ja) * | 2006-07-03 | 2008-01-24 | Sony Computer Entertainment Inc | 通信装置、通信中継装置およびゲーム装置 |
JP2016537914A (ja) * | 2013-09-04 | 2016-12-01 | クゥアルコム・インコーポレイテッドQualcomm Incorporated | オーディオ/ビデオストリーミングのためのレイテンシバッファリングの動的および自動制御 |
CN111135569A (zh) * | 2019-12-20 | 2020-05-12 | RealMe重庆移动通信有限公司 | 云游戏处理方法、装置、存储介质与电子设备 |
-
2020
- 2020-11-09 CN CN202080106839.7A patent/CN116457767A/zh active Pending
- 2020-11-09 US US18/251,401 patent/US20230405457A1/en active Pending
- 2020-11-09 JP JP2022560626A patent/JPWO2022097303A1/ja active Pending
- 2020-11-09 WO PCT/JP2020/041758 patent/WO2022097303A1/ja active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2004093406A1 (ja) * | 2003-04-16 | 2004-10-28 | Sony Computer Entertainment Inc. | データ伝送装置、データ伝送方法、ゲーム機およびゲームシステム |
JP2004329300A (ja) * | 2003-04-30 | 2004-11-25 | Sony Computer Entertainment Inc | 通信方法およびゲーム機 |
JP2008016974A (ja) * | 2006-07-03 | 2008-01-24 | Sony Computer Entertainment Inc | 通信装置、通信中継装置およびゲーム装置 |
JP2016537914A (ja) * | 2013-09-04 | 2016-12-01 | クゥアルコム・インコーポレイテッドQualcomm Incorporated | オーディオ/ビデオストリーミングのためのレイテンシバッファリングの動的および自動制御 |
CN111135569A (zh) * | 2019-12-20 | 2020-05-12 | RealMe重庆移动通信有限公司 | 云游戏处理方法、装置、存储介质与电子设备 |
Also Published As
Publication number | Publication date |
---|---|
CN116457767A (zh) | 2023-07-18 |
JPWO2022097303A1 (ja) | 2022-05-12 |
US20230405457A1 (en) | 2023-12-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Shi et al. | Mobile VR on edge cloud: A latency-driven design | |
KR101523133B1 (ko) | 비디오 디스플레이 시스템을 위한 스트리밍 기술 | |
CN108370580B (zh) | 匹配用户装备和网络调度周期 | |
US20240171492A1 (en) | Screen projection data transmission method and apparatus, electronic device, and storage medium | |
US20140187331A1 (en) | Latency reduction by sub-frame encoding and transmission | |
WO2021209034A1 (zh) | 一种数据传输的方法及通信装置 | |
CN104618195A (zh) | 带宽估测方法和装置 | |
CN114667727A (zh) | 用于远程会议的方法和装置 | |
US20140112354A1 (en) | Method, apparatus, and system for processing streaming media data | |
CN104837043A (zh) | 多媒体信息处理方法及电子设备 | |
Nyamtiga et al. | Edge-computing-assisted virtual reality computation offloading: An empirical study | |
WO2022097303A1 (ja) | 情報処理装置及び通信方法 | |
CN109963106A (zh) | 一种视频图像处理方法、装置、存储介质及终端 | |
KR101710011B1 (ko) | 영상 데이터 전송 및 수신 방법 및 장치 | |
US20140280692A1 (en) | System and method for encoding control commands | |
EP4391639A1 (en) | Communication method and apparatus | |
US20220182713A1 (en) | Device and system for streaming media interaction | |
US9729867B2 (en) | Wireless communication terminal and communication control method | |
CN115982084A (zh) | 数据传输方法及装置、通信设备、及存储介质 | |
WO2022206016A1 (zh) | 一种数据分层传输方法、装置及系统 | |
KR101670767B1 (ko) | 영상 안정화 서비스를 위한 이중화 전송 스트리밍 방법, 이를 수행하기 위한 기록 매체, 장치 및 시스템 | |
US9300979B2 (en) | Methods for transmitting and receiving data contents, corresponding source and destination nodes and storage means | |
KR102279730B1 (ko) | 실시간 IoT 기반 메타정보를 갖는 영상의 다중 전송 스트리밍 방법, 이를 수행하기 위한 기록 매체, 장치 및 시스템 | |
WO2022193182A1 (zh) | 一种传输参数调整方法及通信装置 | |
WO2021002135A1 (ja) | データ送信装置、データ送信システム、及び、データ送信方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20960855 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2022560626 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202080106839.7 Country of ref document: CN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20960855 Country of ref document: EP Kind code of ref document: A1 |