CN107018537B - Voice communication method and device - Google Patents
Voice communication method and device Download PDFInfo
- Publication number
- CN107018537B CN107018537B CN201710202147.2A CN201710202147A CN107018537B CN 107018537 B CN107018537 B CN 107018537B CN 201710202147 A CN201710202147 A CN 201710202147A CN 107018537 B CN107018537 B CN 107018537B
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- voice
- core network
- coding
- decoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W28/00—Network traffic management; Network resource management
- H04W28/16—Central resource management; Negotiation of resources or communication parameters, e.g. negotiating bandwidth or QoS [Quality of Service]
- H04W28/18—Negotiating wireless communication parameters
Landscapes
- Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephone Function (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention discloses a voice communication method and a voice communication device. The method is executed at a first mobile terminal and comprises the following steps: before establishing a call with a second mobile terminal, performing voice coding and decoding negotiation with a core network to enable the core network to judge that a voice packet is transmitted between the first mobile terminal and the second mobile terminal; after establishing a call with a second mobile terminal, a first voice coding and decoding mode is adopted to code a voice packet and the voice packet is transmitted to the second mobile terminal through a core network. The invention leads the core network equipment to transmit the voice packet between the first mobile terminal and the second mobile terminal through the negotiation of the voice coding and decoding with the core network equipment, avoids the restriction of the operator network on the new voice coding and decoding technology, then the first mobile terminal and the second mobile terminal can adopt the new voice coding and decoding mode to carry out coding and decoding, does not depend on the support of the operator network on the new voice coding and decoding mode, and does not need the support of the operator network or can identify the new voice coding and decoding mode.
Description
Technical Field
The present invention relates to the field of mobile terminal technologies, and in particular, to a voice communication method and apparatus.
Background
The quality of the voice coding and decoding technology directly determines the quality of voice in voice communication, so the voice coding and decoding technology is an important embodiment of differentiation of the mobile terminal.
Currently, many companies are working on developing their own voice codec technology and operating it in a mobile phone terminal to gain business opportunities. However, the newly developed voice codec technology depends on the voice support degree of the operator network for the new voice codec technology, and the voice support degree of the operator network for the new voice codec technology also restricts the new voice codec technology to some extent.
Firstly, a new voice encoding and decoding technology needs to be updated and modified depending on the synchronization of an operator network, because a voice transcoder is arranged in a core network of the operator, if the voice transcoder of the operator does not support or recognize a newly developed voice encoding and decoding technology, a voice packet which is sent by a mobile terminal and encoded by the new voice encoding and decoding technology cannot pass through the core network, or even though the voice packet passes through the core network, the voice packet is modified to be completely invisible, so that the voice packet cannot be correctly decoded.
Secondly, the voice coding and decoding mode adopted by the mobile terminal during the call is negotiated with the operator network, the negotiation mechanism is mature and fixed at present, if the operator network does not support or agree to adopt the newly developed voice coding and decoding technology, the operator network does not allow the mobile terminal to use the new voice coding and decoding technology in the negotiation process, and can negotiate with the mobile terminal to obtain other voice coding and decoding technologies supported by both the mobile terminal and the operator network, and the other voice coding and decoding technologies are the former voice coding and decoding technologies.
In summary, in the existing voice communication process, if the operator intends to support the voice codec technology on the operator network, or the operator network cannot technically support the voice codec technology, the mobile terminal cannot use the new voice codec technology.
Disclosure of Invention
The invention mainly aims to provide a voice communication method and a voice communication device, and aims to solve the technical problem that in the existing voice communication process, if an operator does not aim to support the voice coding and decoding technology on an operator network or the operator network cannot support the voice coding and decoding technology technically, a mobile terminal cannot use a new voice coding and decoding technology.
Aiming at the technical problems, the invention solves the technical problems by the following technical scheme:
the invention provides a voice communication method, which is executed at a first mobile terminal and comprises the following steps: before establishing a call with a second mobile terminal, performing voice coding and decoding negotiation with a core network to enable the core network to judge that a voice packet is transparently transmitted between the first mobile terminal and the second mobile terminal; after establishing a call with a second mobile terminal, a first voice coding and decoding mode is adopted to code a voice packet and the voice packet is transmitted to the second mobile terminal through the core network.
Optionally, the negotiating about voice encoding and decoding with a core network to make the core network determine that a voice packet is transparently transmitted between the first mobile terminal and the second mobile terminal includes: reporting a second voice coding and decoding mode to the core network in the process of carrying out voice coding and decoding negotiation with the core network; and the second voice coding and decoding mode is the same as or compatible with a third voice coding and decoding mode reported by the second mobile terminal, so that the core network judges that a voice packet is transparently transmitted between the first mobile terminal and the second mobile terminal.
Optionally, after reporting the second speech codec mode to the core network, before establishing a call with the second mobile terminal, the method further includes: and sending information corresponding to the first voice coding and decoding mode to the second mobile terminal through the core network, and informing the second mobile terminal to code a voice packet by adopting the first voice coding and decoding mode.
Optionally, the sending, by the core network, information corresponding to the first speech codec mode to the second mobile terminal includes: and when sending the setup signaling to the second mobile terminal through the core network, carrying information corresponding to the first voice coding and decoding mode in a user-user field of the setup signaling.
Optionally, after reporting the second speech codec mode to the core network, before establishing a call with the second mobile terminal, the method further includes: receiving information corresponding to the first voice coding and decoding mode sent by the second mobile terminal through the core network; after establishing a call with a second mobile terminal, encoding a voice packet by adopting a first voice encoding and decoding mode and transmitting the voice packet to the second mobile terminal through the core network, wherein the method comprises the following steps: and according to the received information corresponding to the first voice coding and decoding mode, after a call is established with a second mobile terminal, coding a voice packet by adopting the first voice coding and decoding mode and transmitting the voice packet to the second mobile terminal through the core network.
The invention also provides a voice communication device, which is arranged at the first mobile terminal and comprises: the negotiation module is used for carrying out voice coding and decoding negotiation with a core network before establishing a call with a second mobile terminal, so that the core network judges that a voice packet is transparently transmitted between the first mobile terminal and the second mobile terminal; and the communication module is used for coding a voice packet by adopting a first voice coding and decoding mode and transmitting the voice packet to the second mobile terminal through the core network after establishing a call with the second mobile terminal.
Optionally, the negotiation module is configured to report a second speech codec mode to the core network in a speech codec negotiation process with the core network; and the second voice coding and decoding mode is the same as or compatible with a third voice coding and decoding mode reported by the second mobile terminal, so that the core network judges that a voice packet is transparently transmitted between the first mobile terminal and the second mobile terminal.
Optionally, the negotiation module is further configured to: after reporting the second voice coding and decoding mode to the core network and before establishing a call with the second mobile terminal, sending information corresponding to the first voice coding and decoding mode to the second mobile terminal through the core network, and informing the second mobile terminal to code a voice packet by adopting the first voice coding and decoding mode.
Optionally, the negotiation module is configured to, when sending the setup signaling to the second mobile terminal through the core network, carry information corresponding to the first speech codec mode in a user-user field of the setup signaling.
Optionally, the negotiation module is further configured to receive, through the core network, information corresponding to the first voice codec mode sent by the second mobile terminal after reporting the second voice codec mode to the core network and before establishing a call with the second mobile terminal; and the communication module is used for coding a voice packet by adopting the first voice coding and decoding mode and transmitting the voice packet to the second mobile terminal through the core network after establishing a call with the second mobile terminal according to the received information corresponding to the first voice coding and decoding mode.
The voice communication method and the voice communication device have the following technical effects:
the invention makes the core network device transmit the voice packet between the first mobile terminal and the second mobile terminal by negotiating the voice coding and decoding with the core network device, thereby avoiding the restriction of the operator network on the new voice coding and decoding technology.
Drawings
Fig. 1 is a schematic diagram of a hardware structure of an optional mobile terminal for implementing various embodiments of the present invention;
FIG. 2 is a diagram of a wireless communication system for the mobile terminal shown in FIG. 1;
fig. 3 is a flowchart of a voice communication method according to a first embodiment of the present invention;
fig. 4 is a network architecture diagram of a voice communication system according to a first embodiment of the present invention;
FIG. 5 is a detailed flowchart of a voice communication method according to a second embodiment of the present invention;
FIG. 6 is a detailed flowchart of a voice communication method according to a third embodiment of the present invention;
fig. 7 is a structural diagram of a voice communication apparatus according to a fourth embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.
The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.
Fig. 1 is a schematic hardware structure of an optional mobile terminal for implementing various embodiments of the present invention.
The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, an output unit 140, a memory 150, an interface unit 160, a controller 170, and a power supply unit 180, and the like. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.
The wireless communication unit 110 typically includes one or more components that allow radio communication between the mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.
The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Also, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may be stored in various formsIn this case, for example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB), an Electronic Service Guide (ESG) of digital video broadcasting-handheld (DVB-H), and the like. The broadcast receiving module 111 may receive a signal broadcast by using various types of broadcasting systems. In particular, the broadcast receiving module 111 may receive a broadcast signal by using a signal such as multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), digital video broadcasting-handheld (DVB-H), forward link media (MediaFLO)@) A digital broadcasting system of a terrestrial digital broadcasting integrated service (ISDB-T), etc. receives digital broadcasting. The broadcast receiving module 111 may be constructed to be suitable for various broadcasting systems that provide broadcast signals as well as the above-mentioned digital broadcasting systems. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 150 (or other type of storage medium).
The mobile communication module 112 transmits and/or receives radio signals to and/or from at least one of a base station (e.g., access point, node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received according to text and/or multimedia messages.
The wireless internet module 113 supports wireless internet access of the mobile terminal. The module may be internally or externally coupled to the terminal. The wireless internet access technology to which the module relates may include WLAN (wireless LAN) (Wi-Fi), Wibro (wireless broadband), Wimax (worldwide interoperability for microwave access), HSDPA (high speed downlink packet access), and the like.
The short-range communication module 114 is a module for supporting short-range communication. Some examples of short-range communication technologies include bluetoothTMRadio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), zigbeeTMAnd so on.
The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of the location information module is a GPS (global positioning system). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information, thereby accurately calculating three-dimensional current location information according to longitude, latitude, and altitude. Currently, a method for calculating position and time information uses three satellites and corrects an error of the calculated position and time information by using another satellite. In addition, the GPS module 115 can calculate speed information by continuously calculating current position information in real time.
The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a microphone 121. The microphone 121 can receive sounds (audio data) via the microphone in a phone call mode, a recording mode, a voice recognition mode, or the like, and can process such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the mobile communication module 112 in case of a phone call mode. The microphone 121 may implement various types of noise canceling (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting an audio signal.
The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display unit 141 in the form of a layer, a touch screen may be formed.
The interface unit 160 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The identification module may store various information for authenticating a user using the mobile terminal 100 and may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), a Universal Subscriber Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter, referred to as an "identification device") may take the form of a smart card, and thus, the identification device may be connected with the mobile terminal 100 via a port or other connection means. The interface unit 160 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal and the external device.
In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 160 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the cradle may be used as signals for recognizing whether the mobile terminal is accurately mounted on the cradle. The output unit 140 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner. The output unit 140 may include a display unit 141, an audio output module 142, an alarm unit 143, and the like.
The display unit 141 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 141 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 141 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.
Meanwhile, when the display unit 141 and the touch pad are stacked on each other in the form of layers to form a touch screen, the display unit 141 may function as an input device and an output device. The display unit 141 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. Depending on the particular desired implementation, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure as well as a touch input position and a touch input area.
The audio output module 142 may convert audio data received by the wireless communication unit 110 or stored in the memory 150 into an audio signal and output as sound when the mobile terminal is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output module 142 may provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output module 142 may include a speaker, a buzzer, and the like.
The alarm unit 143 may provide an output to notify the mobile terminal 100 of the occurrence of the event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, alarm unit 143 may provide output in different ways to notify the occurrence of an event. For example, the alarm unit 143 may provide an output in the form of vibration, and when a call, a message, or some other incoming communication (communicating communication) is received, the alarm unit 143 may provide a tactile output (i.e., vibration) to inform the user thereof. By providing such a tactile output, the user can recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 143 may also provide an output notifying the occurrence of an event via the display unit 141 or the audio output module 142.
The memory 150 may store software programs and the like for processing and controlling operations performed by the controller 170, or may temporarily store data (e.g., a phonebook, messages, still images, videos, and the like) that has been or is to be output. Also, the memory 150 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.
The memory 150 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 150 through a network connection.
The controller 170 generally controls the overall operation of the mobile terminal. For example, the controller 170 performs control and processing related to voice calls, data communications, video calls, and the like. In addition, the controller 170 may include a multimedia module 171 for reproducing (or playing back) multimedia data, and the multimedia module 171 may be constructed within the controller 170 or may be constructed separately from the controller 170. The controller 170 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
The power supply unit 180 receives external power or internal power and provides appropriate power required to operate the respective elements and components under the control of the controller 170.
The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 170. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in memory 150 and executed by controller 170.
Up to this point, mobile terminals have been described in terms of their functionality. Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.
The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication systems such as wired and wireless communication systems and satellite-based communication systems that transmit data via frames or packets.
A communication system in which a mobile terminal according to the present invention is operable will now be described with reference to fig. 2.
Such communication systems may use different air interfaces and/or physical layers. For example, the air interface used by the communication system includes, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)), global system for mobile communications (GSM), and the like. By way of non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.
Referring to fig. 2, the CDMA wireless communication system may include a plurality of mobile terminals 100, a plurality of Base Stations (BSs) 270, Base Station Controllers (BSCs) 275, and a Mobile Switching Center (MSC) 280. The MSC280 is configured to interface with a Public Switched Telephone Network (PSTN) 290. The MSC280 is also configured to interface with a BSC275, which may be coupled to the base station 270 via a backhaul. The backhaul may be constructed according to any of several known interfaces including, for example, E1/T1, ATM, IP, PPP, frame Relay, HDSL, ADSL, or xDSL. It will be understood that a system as shown in fig. 2 may include multiple BSCs 275.
Each BS270 may serve one or more sectors (or regions), each sector covered by a multi-directional antenna or an antenna pointing in a particular direction being radially distant from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS270 may be configured to support multiple frequency allocations, with each frequency allocation having a particular frequency spectrum (e.g., 1.25MHz, 5MHz, etc.).
The intersection of partitions with frequency allocations may be referred to as a CDMA channel. The BS270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" may be used to generically refer to a single BSC275 and at least one BS 270. The base stations may also be referred to as "cells". Alternatively, each sector of a particular BS270 may be referred to as a plurality of cell sites.
As shown in fig. 2, a Broadcast Transmitter (BT)295 transmits a broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in fig. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In fig. 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 assists in locating at least one of the plurality of mobile terminals 100.
In fig. 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information may be obtained with any number of satellites. The GPS module 115 as shown in fig. 1 is generally configured to cooperate with satellites 300 to obtain desired positioning information. Other techniques that can track the location of the mobile terminal may be used instead of or in addition to GPS tracking techniques. In addition, at least one GPS satellite 300 may selectively or additionally process satellite DMB transmission.
As a typical operation of the wireless communication system, the BS270 receives reverse link signals from various mobile terminals 100. The mobile terminal 100 is generally engaged in conversations, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within the particular BS 270. The obtained data is forwarded to the associated BSC 275. The BSC provides call resource allocation and mobility management functions including coordination of soft handoff procedures between BSs 270. The BSCs 275 also route the received data to the MSC280, which provides additional routing services for interfacing with the PSTN 290. Similarly, the PSTN290 interfaces with the MSC280, the MSC interfaces with the BSCs 275, and the BSCs 275 accordingly control the BS270 to transmit forward link signals to the mobile terminal 100.
Based on the above mobile terminal hardware structure and communication system, the present invention provides various embodiments of the method.
Example one
The embodiment of the invention provides a voice communication method. Fig. 3 is a flowchart of a voice communication method according to a first embodiment of the present invention. In this embodiment, the execution subject is a first mobile terminal. The steps performed at the second mobile terminal side may refer to the description of the present embodiment.
Step S310, before establishing a call with a second mobile terminal, the core network determines to transparently transmit a voice packet between the first mobile terminal and the second mobile terminal by performing voice coding and decoding negotiation with the core network.
In this embodiment, the first Mobile terminal and the second Mobile terminal are an MS (Mobile Station) or a UE (User Equipment). For example: the first mobile terminal and the second mobile terminal are smart phones or tablet computers.
Specifically, the first mobile terminal is equivalent to a calling party, and the second mobile terminal is equivalent to a called party; a first mobile terminal calls a second mobile terminal, and the first mobile terminal and the second mobile terminal respectively interact with core network equipment at a core network side according to a voice coding and decoding negotiation mechanism so as to carry out voice coding and decoding negotiation; the core network device is, for example: a PLMN (Public Land Mobile Network) device.
In the process of carrying out voice coding and decoding negotiation, a first mobile terminal reports a voice coding and decoding mode supported by the first mobile terminal to a first core network device (PLMN A); the second mobile terminal reports the voice coding and decoding modes supported by the second mobile terminal to second core network equipment (PLMN B); according to the voice coding and decoding mode supported by the first mobile terminal and the voice coding and decoding mode supported by the second mobile terminal, the first core network equipment and the second core network equipment determine the voice coding and decoding mode which should be adopted by the current call of the first mobile terminal and the second mobile terminal and whether a voice packet generated in the current call needs transcoding or not, and inform the first mobile terminal and the second mobile terminal of the determined voice coding and decoding mode.
In the 3GPP (3rd Generation Partnership Project) TS28.062 protocol, if the core network knows that the two parties (the first mobile terminal and the second mobile terminal) in the call report the same voice coding and decoding mode or a compatible voice coding and decoding mode in the voice coding and decoding negotiation process, the voice transcoder arranged in the core network device will decide not to activate the Transcoding Function (Transcoding Function), and the voice packet can be transparently transmitted in the voice transcoder, thereby implementing the transparent transmission of the voice packet in the core network.
In this embodiment, a voice encoding and decoding mode reported by the first mobile terminal to the first core network device and a voice encoding and decoding mode reported by the second mobile terminal to the second core network device are preset to be the same or compatible, so that the first core network device and the second core network device can realize that a voice packet does not need to be transcoded after a call is established between the first mobile terminal and the second mobile terminal, and the voice packet transmitted between the first mobile terminal and the second mobile terminal can be transmitted through the voice packet.
Step S320, after establishing a call with a second mobile terminal, sending a voice packet encoded in a first voice encoding and decoding manner to the core network, so that the core network transparently transmits the voice packet to the second mobile terminal.
The first speech codec mode may be a speech codec mode supported by an operator network (core network), or a speech codec mode that is not supported or recognized by the operator network. For example: the first speech codec is a newly developed speech codec.
In this embodiment, after establishing a call with the second mobile terminal, the first mobile terminal and the second mobile terminal may not encode and decode the voice packet in the voice encoding and decoding manner determined by negotiation, that is, the voice encoding and decoding manner determined by negotiation may not be the first voice encoding and decoding manner.
Specifically, the first mobile terminal and the second mobile terminal may be configured in advance to encode the voice packet by using the first voice encoding and decoding manner, or the first mobile terminal and the second mobile terminal may determine to encode the voice packet by using the first voice encoding and decoding manner in the interaction process.
After the core network determines that the voice packet is transparently transmitted between the first mobile terminal and the second mobile terminal, the first mobile terminal and the second mobile terminal may encode the voice packet by using a newly developed voice encoding and decoding method instead of the voice encoding and decoding method determined by negotiation, that is, the first voice encoding and decoding method.
For example: fig. 4 is a diagram showing a network architecture of a voice communication system according to a first embodiment of the present invention. Calling a called party by a calling party; before a call between a calling party and a called party is established, a PLMN A collects a voice coding and decoding technology supported by the calling party in a voice coding and decoding negotiation stage, and a PLMN B collects a voice coding and decoding technology supported by the called party in a voice coding and decoding negotiation stage; the calling party and the called party respectively report the same voice coding and decoding mode or report the voice coding and decoding modes which are mutually compatible, and the voice coding and decoding modes reported by the calling party and the called party can be the existing voice coding and decoding modes which can be supported by a core network; the PLMN A and the PLMN B interact the voice coding and decoding modes reported by the calling party and the called party, and can determine that the voice coding and decoding modes reported by the calling party and the called party are the same or compatible, so that voice transcoders in the PLMN A and the PLMN B can make decisions and transparently transmit voice packets transmitted between the calling party and the called party without transcoding; because the voice transcoders in the PLMN A and the PLMN B already determine to transparently transmit the voice packet between the calling party and the called party, the calling party and the called party can adopt other voice coding and decoding modes to code the voice packet after the call is established, so that the limitation and restriction of a core network on the voice coding and decoding technology are avoided, the support of an operator network (core network) on the new voice coding and decoding mode is not required, and the support of the operator network or the identification of the new voice coding and decoding mode is not required.
Example two
In order to make the present invention clearer, the present embodiment provides a more specific voice communication method to further describe the present invention. In this embodiment, the execution subject is the first mobile terminal, and reference may be made to the description of this embodiment for the execution situation of the second mobile terminal.
Fig. 5 is a detailed flowchart of a voice communication method according to a second embodiment of the present invention.
Step S510, before the first mobile station establishes a call with the second mobile station, the first mobile station performs a voice codec negotiation with the core network.
Step S520, the first mobile terminal reports a second speech codec mode to the core network during the speech codec negotiation with the core network, where the second speech codec mode is the same as or compatible with a third speech codec mode reported by the second mobile terminal.
The second voice coding and decoding mode reported by the first mobile terminal is the same as or compatible with the third voice coding and decoding mode reported by the second mobile terminal, so that the core network can transmit the voice packet transmitted between the first mobile terminal and the second mobile terminal. Further, when the core network device determines that the second speech coding/decoding mode reported by the first mobile terminal is the same as or compatible with the third speech coding/decoding mode reported by the second mobile terminal, the speech transcoder in the core network device transparently transmits the speech packet transmitted between the first mobile terminal and the second mobile terminal, without transcoding.
In this embodiment, in the negotiation process of the voice codec, the voice codec mode reported by the first mobile terminal and the second mobile terminal is not the voice codec mode actually used in the voice communication between the first mobile terminal and the second mobile terminal.
Step S530, the first mobile terminal sends information corresponding to the first speech codec mode to the second mobile terminal through the core network, and notifies the second mobile terminal to encode a speech packet using the first speech codec mode.
The information corresponding to the first speech encoding/decoding method is, for example: the first speech codec mode corresponds to a unique code or a name of the first speech codec mode.
In this embodiment, when sending the setup signaling to the second mobile terminal through the core network, the user-user field of the setup signaling carries information corresponding to the first speech codec mode.
Specifically, during the negotiation process of the speech coding and decoding with the core network, a setup signaling is used, which is specified in the 3GPP TS24.008 protocol, and the setup signaling includes a user-user field, and information carried in the user-user field can be directly transmitted from the speech calling-out terminal (the first mobile terminal) to the speech calling-in terminal (the second mobile terminal) by the core network, without the core network intervening and modifying the information carried in the user-user field. In this embodiment, the first mobile terminal may add and fill specific content in the user-user field when sending the setup signaling, and the two parties of the call (the first mobile terminal and the second mobile terminal) may agree in advance, and when finding out the specific content added in the user-user field, the first voice codec mode is enabled to perform voice codec, in other words, the first voice codec technology is adopted in the first mobile terminal and the second mobile terminal to implement end-to-end voice codec, and the network only carries the voice packet without transcoding the voice packet, so as to implement end-to-end transparent transmission, and thus, voice communication based on a new voice codec technology is implemented, thereby obtaining better voice quality and user experience.
In this embodiment, the characteristic of the user-user field in the setup signaling is used to carry the information of the first speech codec mode actually adopted by the first mobile terminal and the second mobile terminal in the current call.
And step S540, after the first mobile terminal establishes a call with the second mobile terminal, the first mobile terminal transparently transmits the voice packet encoded by the first voice encoding and decoding manner to the second mobile terminal through the core network.
After the call between the first mobile terminal and the second mobile terminal is established, the first mobile terminal transmits the voice packet coded by the first voice coding and decoding mode to the second mobile terminal through the core network, and receives the voice packet coded by the first voice coding and decoding mode and transmitted from the second mobile terminal.
In this embodiment, on one hand, when the first mobile terminal and the core network perform the negotiation of speech coding and decoding, the restriction of the core network on the speech coding and decoding manner is avoided, and a new speech coding and decoding manner required by the user is developed according to the requirement; on the other hand, the second mobile terminal is informed to adopt the first voice coding and decoding mode to code and decode the voice packet through the user-user field in the setup signaling, and the new voice coding and decoding mode does not need to be supported or can be identified by the operator network, so that the voice communication process is more flexible.
EXAMPLE III
In order to make the present invention clearer, the present embodiment provides another specific voice communication method to further describe the present invention. In this embodiment, the execution subject is the first mobile terminal, and reference may be made to the description of this embodiment for the execution situation of the second mobile terminal.
Fig. 6 is a detailed flowchart of a voice communication method according to a third embodiment of the present invention.
Step S610, before the call between the first mobile station and the second mobile station is established, the first mobile station performs a voice codec negotiation with the core network.
Step S620, the first mobile terminal reports a second voice coding and decoding mode to the core network in the process of voice coding and decoding negotiation with the core network; and the second voice coding and decoding mode is the same as or compatible with a third voice coding and decoding mode reported by the second mobile terminal.
In this embodiment, in the speech codec negotiation process, the second speech codec mode reported by the first mobile station and the third speech codec mode reported by the second mobile station are not the speech codec mode actually used in the speech communication between the first mobile station and the second mobile station.
Step S630, the first mobile terminal receives, through the core network, the information corresponding to the first speech codec mode sent by the second mobile terminal.
In this embodiment, the first speech codec mode sent by the second mobile terminal is a speech codec mode actually used in speech communication between the first mobile terminal and the second mobile terminal.
And the first mobile terminal receives a CONNECT signaling sent by the second mobile terminal through the core network, and extracts information corresponding to the first voice coding and decoding mode from a user-user field in the CONNECT signaling.
In the 3GPP TS24.008 protocol, it is specified that a user-user field is included in the CONNECT signaling, and the core network does not interfere with and modify information carried in the user-user field. In this embodiment, the second mobile terminal may fill the actually used speech coding mode with a user-user field in the CONNECT signaling, and notify the first mobile terminal, and the first mobile terminal may obtain the information in the user-user field in the received CONNECT signaling, thereby completing the determination of the speech coding mode.
And step 640, after the first mobile terminal establishes a call with a second mobile terminal according to the received information corresponding to the first voice coding and decoding mode, the first mobile terminal codes a voice packet by using the first voice coding and decoding mode and transmits the voice packet to the second mobile terminal through the core network.
And the first mobile terminal transmits the voice packet coded by the first voice coding and decoding mode to the second mobile terminal through the core network after the call with the second mobile terminal is established according to the received information corresponding to the first voice coding and decoding mode, and receives the voice packet coded by the first voice coding and decoding mode and transmitted from the second mobile terminal.
In this embodiment, on one hand, when the first mobile terminal and the core network perform the negotiation of speech coding and decoding, the restriction of the core network on the speech coding and decoding manner is avoided, and a new speech coding and decoding manner required by the user is developed according to the requirement; on the other hand, the second mobile terminal is informed to adopt the first voice coding and decoding mode to code and decode the voice packet through the user-user field in the CONNECT signaling, and the new voice coding and decoding mode does not need to be supported or can be identified by an operator network, so that the voice communication process is more flexible.
Example four
The embodiment provides a voice communication device. The voice communication apparatus may be provided in a mobile terminal. The voice communication devices are respectively arranged in the first mobile terminal and the second mobile terminal. In this embodiment, the structure and function of the voice communication apparatus provided in the first mobile terminal are explained, and the structure and function of the voice communication apparatus provided in the second mobile terminal can refer to this embodiment.
Fig. 7 is a block diagram of a voice communication apparatus according to a fourth embodiment of the present invention.
In this embodiment, the voice communication apparatus includes:
the negotiation module 710 is configured to perform voice coding and decoding negotiation with a core network before establishing a call with a second mobile terminal, so that the core network determines that a voice packet is transparently transmitted between the first mobile terminal and the second mobile terminal.
And the communication module 720 is configured to encode a voice packet in a first voice encoding and decoding manner and transmit the voice packet to the second mobile terminal through the core network after a call is established with the second mobile terminal.
In an embodiment, the negotiation module 710 is configured to report a second speech codec mode to the core network during a speech codec negotiation with the core network; and the second voice coding and decoding mode is the same as or compatible with a third voice coding and decoding mode reported by the second mobile terminal, so that the core network judges that a voice packet is transparently transmitted between the first mobile terminal and the second mobile terminal.
In another embodiment, the negotiation module 710 is further configured to send, after reporting the second speech coding/decoding scheme to the core network and before establishing a call with the second mobile terminal, information corresponding to the first speech coding/decoding scheme to the second mobile terminal through the core network, and notify the second mobile terminal to encode a speech packet using the first speech coding/decoding scheme.
In another embodiment, the negotiation module 710 is configured to, when sending the setup signaling to the second mobile terminal through the core network, carry information corresponding to the first speech codec mode in a user-user field of the setup signaling.
In another embodiment, the negotiation module 710 is further configured to, after reporting the second speech codec mode to the core network and before establishing a call with the second mobile terminal, receive, through the core network, information corresponding to the first speech codec mode sent by the second mobile terminal; the communication module 720 is configured to encode a voice packet in the first voice coding and decoding manner and transmit the encoded voice packet to the second mobile terminal through the core network after establishing a call with the second mobile terminal according to the received information corresponding to the first voice coding and decoding manner.
The functions of the apparatus in this embodiment have already been described in the method embodiments shown in fig. 1 to 6, so that reference may be made to the related descriptions in the foregoing embodiments for details in the description of this embodiment, which are not repeated herein.
In this embodiment, the core network device transparently transmits the voice packet between the first mobile terminal and the second mobile terminal by performing voice codec negotiation with the core network device, thereby bypassing the restriction of the operator network on a new voice codec technology.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (8)
1. A voice communication method, performed at a first mobile terminal, comprising:
before establishing a call with a second mobile terminal, performing voice coding and decoding negotiation with a core network to enable the core network to judge that a voice packet is transparently transmitted between the first mobile terminal and the second mobile terminal;
sending information corresponding to a first voice coding and decoding mode to the second mobile terminal through the core network, and informing the second mobile terminal to code a voice packet by adopting the first voice coding and decoding mode;
after establishing a call with a second mobile terminal, coding a voice packet by adopting the first voice coding and decoding mode and transmitting the voice packet to the second mobile terminal through the core network, wherein the first voice coding mode is a non-negotiation determined voice coding mode.
2. The method according to claim 1, wherein the causing the core network to determine to pass through voice packets between the first mobile terminal and the second mobile terminal by performing voice codec negotiation with the core network comprises:
reporting a second voice coding and decoding mode to the core network in the process of carrying out voice coding and decoding negotiation with the core network; and the second voice coding and decoding mode is the same as or compatible with a third voice coding and decoding mode reported by the second mobile terminal, so that the core network judges that a voice packet is transparently transmitted between the first mobile terminal and the second mobile terminal.
3. The method of claim 1, wherein the sending information corresponding to the first speech codec to the second mobile terminal via the core network comprises:
and when sending the setup signaling to the second mobile terminal through the core network, carrying information corresponding to the first voice coding and decoding mode in a user-user field of the setup signaling.
4. The method of claim 2,
after reporting the second speech encoding and decoding mode to the core network and before establishing a call with the second mobile terminal, the method further comprises:
receiving information corresponding to the first voice coding and decoding mode sent by the second mobile terminal through the core network;
after establishing a call with a second mobile terminal, encoding a voice packet by adopting a first voice encoding and decoding mode and transmitting the voice packet to the second mobile terminal through the core network, wherein the method comprises the following steps:
and according to the received information corresponding to the first voice coding and decoding mode, after a call is established with a second mobile terminal, coding a voice packet by adopting the first voice coding and decoding mode and transmitting the voice packet to the second mobile terminal through the core network.
5. A voice communication apparatus, provided in a first mobile terminal, comprising:
the negotiation module is used for carrying out voice coding and decoding negotiation with a core network before establishing a call with a second mobile terminal, so that the core network judges that a voice packet is transparently transmitted between the first mobile terminal and the second mobile terminal; sending information corresponding to a first voice coding and decoding mode to the second mobile terminal through the core network, and informing the second mobile terminal to code a voice packet by adopting the first voice coding and decoding mode;
and the communication module is used for coding a voice packet by adopting the first voice coding and decoding mode and transmitting the voice packet to the second mobile terminal through the core network after establishing a call with the second mobile terminal, wherein the first voice coding mode is a non-negotiation determined voice coding mode.
6. The apparatus of claim 5, wherein the negotiation module is configured to report a second speech codec mode to the core network during a speech codec negotiation with the core network; and the second voice coding and decoding mode is the same as or compatible with a third voice coding and decoding mode reported by the second mobile terminal, so that the core network judges that a voice packet is transparently transmitted between the first mobile terminal and the second mobile terminal.
7. The apparatus of claim 5, wherein the negotiation module is configured to, when sending a setup signaling to the second mobile terminal through the core network, carry information corresponding to the first speech codec mode in a user-user field of the setup signaling.
8. The apparatus of claim 6,
the negotiation module is further configured to receive, through the core network, information corresponding to the first voice codec mode sent by the second mobile terminal after reporting the second voice codec mode to the core network and before establishing a call with the second mobile terminal;
and the communication module is used for coding a voice packet by adopting the first voice coding and decoding mode and transmitting the voice packet to the second mobile terminal through the core network after establishing a call with the second mobile terminal according to the received information corresponding to the first voice coding and decoding mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710202147.2A CN107018537B (en) | 2017-03-30 | 2017-03-30 | Voice communication method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710202147.2A CN107018537B (en) | 2017-03-30 | 2017-03-30 | Voice communication method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107018537A CN107018537A (en) | 2017-08-04 |
| CN107018537B true CN107018537B (en) | 2020-03-17 |
Family
ID=59445672
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710202147.2A Active CN107018537B (en) | 2017-03-30 | 2017-03-30 | Voice communication method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107018537B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009002912A2 (en) * | 2007-06-26 | 2008-12-31 | Texas Instruments Incorporated | Endpoint-to-endpoint transcoding free connection |
| CN101562910A (en) * | 2008-04-18 | 2009-10-21 | 中国移动通信集团公司 | Voice data transmission method as well as system and media gateway |
| CN102726096A (en) * | 2011-12-27 | 2012-10-10 | 华为技术有限公司 | Method and device for codec negotiation |
| CN102739605A (en) * | 2011-03-31 | 2012-10-17 | 华为技术有限公司 | Method and device for improving speech communication |
| CN103167561A (en) * | 2011-12-08 | 2013-06-19 | 中兴通讯股份有限公司 | Tandem free operation (TFO) processing method and device |
| CN104994054A (en) * | 2015-03-19 | 2015-10-21 | 数据通信科学技术研究所 | Method of transmitting grouped data based on TD-SCDMA transparent transmission voice channel, and mobile terminal |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8369267B2 (en) * | 2007-01-18 | 2013-02-05 | Telefonaktiebolaget Lm Ericsson (Publ) | Technique for controlling establishment of a tandem-free transcoder operation |
-
2017
- 2017-03-30 CN CN201710202147.2A patent/CN107018537B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009002912A2 (en) * | 2007-06-26 | 2008-12-31 | Texas Instruments Incorporated | Endpoint-to-endpoint transcoding free connection |
| CN101562910A (en) * | 2008-04-18 | 2009-10-21 | 中国移动通信集团公司 | Voice data transmission method as well as system and media gateway |
| CN102739605A (en) * | 2011-03-31 | 2012-10-17 | 华为技术有限公司 | Method and device for improving speech communication |
| CN103167561A (en) * | 2011-12-08 | 2013-06-19 | 中兴通讯股份有限公司 | Tandem free operation (TFO) processing method and device |
| CN102726096A (en) * | 2011-12-27 | 2012-10-10 | 华为技术有限公司 | Method and device for codec negotiation |
| CN104994054A (en) * | 2015-03-19 | 2015-10-21 | 数据通信科学技术研究所 | Method of transmitting grouped data based on TD-SCDMA transparent transmission voice channel, and mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107018537A (en) | 2017-08-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105681567B (en) | Mobile terminal and communication method based on dual channels | |
| CN105188098B (en) | Network switching device and network switching method of mobile terminal | |
| CN106413128B (en) | Projection method and mobile terminal | |
| CN106302651B (en) | Social picture sharing method and terminal with social picture sharing system | |
| CN105515619B (en) | Bluetooth communication method and system | |
| CN105554869B (en) | Mobile terminal communication method, equipment and communication system | |
| CN106912034B (en) | Short message processing method, system and terminal | |
| CN105227892A (en) | Video call system, apparatus and method | |
| CN106547439B (en) | Method and device for processing message | |
| CN104796964A (en) | Method and device for improving call completion ratio of emergency call of mobile terminal | |
| CN106453863B (en) | Method and system for controlling terminal and earphone | |
| CN106455009B (en) | Network searching device and method | |
| CN106547565B (en) | Browser exception reporting method and system | |
| CN106686672B (en) | Network connection method and terminal | |
| CN105722246B (en) | Network speed superposition device and method | |
| CN105682007B (en) | Mobile terminal and WIFI control method | |
| CN106791567B (en) | Switching method and terminal | |
| CN105959301B (en) | Multimedia call optimization method and optimization system thereof | |
| CN104639428B (en) | Self-adaptive method for session scene in instant messaging and mobile terminal | |
| CN106856617B (en) | Terminal and cell reselection method | |
| CN106790126B (en) | Account authorization method and device of application program and terminal | |
| CN108289241B (en) | Wireless projection device, system and method | |
| CN106412877B (en) | Activation method and activation device for mobile terminal SIM card | |
| CN106257943B (en) | Method and device for controlling terminal function through access point and access point | |
| CN105094733B (en) | Split screen display method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |