CN115396626A - Video conference method, device, equipment and storage medium - Google Patents

Video conference method, device, equipment and storage medium Download PDF

Info

Publication number
CN115396626A
CN115396626A CN202211008915.8A CN202211008915A CN115396626A CN 115396626 A CN115396626 A CN 115396626A CN 202211008915 A CN202211008915 A CN 202211008915A CN 115396626 A CN115396626 A CN 115396626A
Authority
CN
China
Prior art keywords
conference
video
participants
image
projection equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211008915.8A
Other languages
Chinese (zh)
Inventor
黄贤柱
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Rongxun Technology Co ltd
Original Assignee
Beijing Rongxun Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Rongxun Technology Co ltd filed Critical Beijing Rongxun Technology Co ltd
Priority to CN202211008915.8A priority Critical patent/CN115396626A/en
Publication of CN115396626A publication Critical patent/CN115396626A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/04Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/155Conference systems involving storage of or access to video conference sessions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179Video signal processing therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a video conference method, which comprises the following steps: determining conference projection equipment corresponding to each video conference according to the conference participation condition of each video conference and the identity of the candidate participants, and determining conference participants of each video conference from the candidate participants; sending a conference invitation to conference participants and acquiring video data fed back by the conference participants; analyzing the video data to obtain video images of the conference participants and identification marks of the conference participants; encrypting the video image according to the equipment identifier of the conference projection equipment to obtain an encrypted image, sending the encrypted image to the conference projection equipment according to the identity identifier of the conference participant, and controlling the conference projection equipment to decrypt the encrypted image to generate a conference image; and acquiring the conference image fed back by the conference projection equipment, and sending the conference image to the conference participants according to the identity marks of the conference participants. The safety of the video conference is improved.

Description

Video conference method, device, equipment and storage medium
Technical Field
The embodiment of the invention relates to the field of computers, in particular to a video conference method, a video conference device, video conference equipment and a storage medium.
Background
In a video conference system, a multi-point control unit generally controls a plurality of terminal devices participating in a video conference to participate in the video conference, and the terminal devices participating in the video conference may be fixed terminals in a conference room or mobile terminals. When participating in the video conference through fixed terminal, audio and video quality is higher, but if will insert the video conference with fixed terminal, the cable that needs to build for fixed terminal is more complicated, causes the problem that the cable knoed and signal interference easily, and complicated cable structure can make the maintenance work to the cable comparatively difficult. Therefore, how to carry out the video conference through the fixed terminal on the premise of no cable connection and ensure the information security of the video conference is a problem to be solved.
Disclosure of Invention
The invention provides a video conference method, a video conference device, video conference equipment and a storage medium, which can realize video conference through a fixed terminal on the premise of no cable connection and improve the safety of video information transmission in the video conference.
According to an aspect of the present invention, there is provided a video conference method, including:
determining conference projection equipment corresponding to each video conference according to the conference participation condition of each video conference and the identity of the candidate participants, and determining conference participants of each video conference from the candidate participants;
sending a conference invitation to the conference participants and acquiring video data fed back by the conference participants;
analyzing the video data to obtain the video images of the conference participants and the identity marks of the conference participants;
encrypting the video image according to the equipment identifier of the conference projection equipment to obtain an encrypted image, sending the encrypted image to the conference projection equipment according to the identity identifier of the conference participant, and controlling the conference projection equipment to decrypt the encrypted image to generate a conference image;
and acquiring the conference image fed back by the conference projection equipment, and sending the conference image to the conference participants according to the identity marks of the conference participants.
According to another aspect of the present invention, there is provided a video conference apparatus, comprising:
the conference participant determining module is used for determining conference projection equipment corresponding to each video conference according to the conference participation condition of each video conference and the identity of the candidate participants and determining the conference participants of each video conference from the candidate participants;
the video data acquisition module is used for sending a conference invitation to the conference participants and acquiring video data fed back by the conference participants;
the video data analysis module is used for analyzing the video data to obtain the video images of the conference participants and the identity marks of the conference participants;
the conference image determining module is used for encrypting the video image according to the equipment identifier of the conference projection equipment to obtain an encrypted image, sending the encrypted image to the conference projection equipment according to the identity identifier of the conference participant, and controlling the conference projection equipment to decrypt the encrypted image to generate a conference image;
and the conference image feedback module is used for acquiring the conference image fed back by the conference projection equipment and sending the conference image to the conference participants according to the identification marks of the conference participants.
According to another aspect of the present invention, there is provided an electronic apparatus including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the video conferencing method of any of the embodiments of the present invention.
According to another aspect of the present invention, there is provided a computer-readable storage medium storing computer instructions for causing a processor to implement a video conferencing method according to any of the embodiments of the present invention when the computer instructions are executed.
According to the technical scheme of the embodiment of the invention, conference projection equipment corresponding to each video conference is determined according to the conference participation condition of each video conference and the identity of the candidate participants, and the conference participants of each video conference are determined from the candidate participants; sending a conference invitation to conference participants and acquiring video data fed back by the conference participants; analyzing the video data to obtain video images of the conference participants and identification marks of the conference participants; encrypting the video image according to the equipment identifier of the conference projection equipment to obtain an encrypted image, sending the encrypted image to the conference projection equipment according to the identity identifier of the conference participant, and controlling the conference projection equipment to decrypt the encrypted image to generate a conference image; and acquiring the conference image fed back by the conference projection equipment, and sending the conference image to conference participants according to the identity marks of the conference participants. According to the scheme, the conference projection equipment and the conference participants of each video conference are determined according to the conference participation conditions of each video conference and the identification marks of the candidate participants, the video data fed back by the conference participants are encrypted and then sent to the conference projection equipment corresponding to the video conference in which the video participants participate, so that the conference projection equipment corresponding to each video conference decrypts the video data, then the video images corresponding to each video conference are obtained respectively, and the video images corresponding to the video conferences are fed back to the conference participants. Realized under the prerequisite of wireless cable connection, when having the demand of a plurality of video conferences, receive the video data of each video conference through fixed terminal, in order to realize carrying out overall planning to a plurality of video conferences simultaneously, the accurate video data with each video conference sends the meeting projection equipment that each video conference corresponds, and the video image of receiving meeting projection equipment feedback, the accurate gives the meeting participant with video image feedback, the meeting planning efficiency of video conference has been improved. Meanwhile, the video image is encrypted and then sent to the conference projection equipment, so that the content in the video image can be prevented from being stolen, and the safety of the video conference is improved.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present invention, nor do they necessarily limit the scope of the invention. Other features of the present invention will become apparent from the following description.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart of a video conference method according to an embodiment of the present invention;
fig. 2 is a flowchart of a video conference method according to a second embodiment of the present invention;
fig. 3 is a flowchart of a video conference method according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of a video conference apparatus according to a fourth embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It is to be understood that the terms "first" and "second," and the like in the description and claims of the present invention and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in other sequences than those illustrated or described herein. Moreover, the terms "comprises," "comprising," and any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example one
Fig. 1 is a flowchart of a video conference method according to an embodiment of the present invention, which is applicable to a video conference through a fixed terminal. The video conference system is particularly suitable for the situation that video conferences are carried out through fixed terminals under the condition of wireless cable connection. The method may be performed by a video conferencing device, which may be implemented in hardware and/or software, which may be configured in an electronic device. As shown in fig. 1, the method includes:
s110, according to the conference participation condition of each video conference and the identification of the candidate participants, determining the conference participants of each video conference from the candidate participants, and determining the conference projection equipment corresponding to each video conference.
It should be noted that, in the present application, the terminal device used for performing the video conference is a fixed terminal, and when the video conference is performed through the fixed terminal, the conference image corresponding to the video conference needs to be projected onto the conference projection device installed in the conference room. A wireless receiving device arranged in the fixed terminal can be adopted to receive the relevant data of the video conference; and sending the relevant data of the video conference by adopting a wireless sending device arranged in the fixed terminal.
The conference participation condition refers to a condition that a conference participant of the video conference needs to have. For example, the conference participation condition may be at least one of an age condition, a job position condition, a working age condition, and a name condition that the participants of the video conference need to possess. The name condition that the participants of the video conference need to have can be the name of the personnel who need to participate in the video conference, which is input in advance by the conference organizer according to the conference requirement.
Candidate participants refer to people who may choose to participate in the video conference as online participants. For example, when a business needs to conduct a video conference, the candidate participants may be all employees within the business. The identity of the candidate participant refers to data that can characterize the identity information of the candidate participant. The identification of the candidate participant may include: the candidate participant's name, age, job title, and working year. The conference projection equipment is projection equipment which is installed in a conference room and is used for playing video images of conference participants of a video conference, and each conference room is provided with one conference projection equipment. Conference participants refer to participants of a video conference, determined from the candidate participants.
Specifically, when at least two video conferences need to be performed simultaneously through the fixed terminal, the conference participation conditions of the video conferences can be input into the fixed terminal. And determining conference participants of the video conferences meeting the conference participation conditions of the video conferences from the candidate participants according to the identification marks of the candidate participants. For example, if the conference participation condition of one video conference is that the working life of the people is more than two years, the candidate participants with the working life of more than two years are screened out from the candidate participants as the conference participants of the video conference according to the identification of the candidate participants.
For example, the conference projection device of each video conference may be determined according to the conference attribute of each video conference; and selecting the conference participants of the video conferences from the candidate participants according to the conference participation conditions of the video conferences and the identification marks of the candidate participants. Specifically, the method can be realized by the following substeps:
s1101, determining the conference attribute of each video conference according to the conference participation condition of each video conference.
The conference attribute refers to a conference size of the video conference corresponding to the number of participants of the video conference. For example, meeting attributes may include: the conference system comprises a large conference, a medium conference and a small conference, wherein the number of participants of the video conference corresponding to different conference attributes is different. For example, the conference attribute of the video conference with the number of participants greater than or equal to 50 can be set as a large conference; the conference attribute of the video conference with the number of the participants more than 20 and less than 50 is a medium conference; the conference attribute of a videoconference with a number of participants less than or equal to 20 is mini-conferences. The number of conference participants corresponding to the conference attribute is only an example, and can be adjusted according to actual needs.
Specifically, the number of participants of each video conference is determined according to the conference participation condition of each video conference, and the conference attribute of each video conference is determined according to the number of participants of each video conference. For example, if the conference participation condition of the video conference is: and if the number of the employees in the enterprise with the age less than thirty years old is taken as the number of the participants of the video conference, and the conference attribute of the video conference is determined according to the number of the participants of the video conference.
And S1102, determining conference projection equipment corresponding to each video conference according to the conference attribute of each video conference.
Specifically, the number of participants of the video conference that can be accommodated by different conference projection devices is different. The conference projection equipment and the conference attributes can be stored in the terminal equipment in advance according to the number of participants of the video conference which can be accommodated by the conference projection equipment, and after the conference attributes of each video conference are determined, the conference projection equipment corresponding to each video conference is determined according to the corresponding relation between the conference projection equipment and the conference attributes.
S1103, selecting conference participants of the video conferences from the candidate participants according to the identity marks of the candidate participants and the conference participation conditions of the video conferences.
Specifically, the conference participation condition of each video conference is matched with the identity of the candidate participant, the candidate participants meeting the conference participation condition of each video conference are respectively determined according to the matching result to serve as the conference participants of each video conference, and the identity of each conference participant is associated with the video conference to be participated in.
According to the scheme, the conference attributes of the video conferences can be automatically determined according to the conference participation conditions of the video conferences, conference projection equipment and conference participants corresponding to the video conferences are automatically determined based on the conference attributes and the conference participation conditions of the video conferences, the effect of overall planning of the video conferences according to conference subjects is achieved, and the overall planning efficiency of the video conferences is improved.
And S120, sending a conference invitation to the conference participants, and acquiring video data fed back by the conference participants.
The conference invitation comprises conference starting time, conference ending time, conference subject and device identification of the conference projection device corresponding to the conference participant. The device identification of the conference projection device may be a number, an image, or a string of characters; for example, the device identification may be a room number of a conference room in which the conference projection device is located. Meeting topics refer to summary information that can characterize the meeting content of a video conference. The video data fed back by the conference participants comprise the identification marks of the conference participants and the image data of the conference participants acquired by the camera equipment.
Specifically, a conference invitation is sent to conference participants, so that the conference participants determine conference start time, conference end time, conference subject and device identifiers of conference projection devices corresponding to the conference participants of a video conference to be participated in according to the conference invitation. And acquiring video data fed back by the conference participants in real time in a time period between the conference starting time and the conference ending time.
S130, analyzing the video data to obtain the video images of the conference participants and the identification marks of the conference participants.
Specifically, the video data is analyzed, and the identity of the conference participant and the video image of the conference participant, which can be displayed at the fixed terminal, are obtained according to the analysis result of the video data.
S140, according to the equipment identification of the conference projection equipment, the video image is encrypted to obtain an encrypted image, the encrypted image is sent to the conference projection equipment according to the identification of the conference participant, and the conference projection equipment is controlled to decrypt the encrypted image to generate the conference image.
Specifically, the video conference in which the conference participant needs to participate is determined according to the identity of the conference participant, and the device identity of the conference projection device corresponding to the video conference in which the conference participant needs to participate is obtained. And taking the equipment identification of the conference projection equipment as the encrypted data of the video image, and encrypting the video image according to the encrypted data to obtain the encrypted image. And sending the encrypted images corresponding to the conference participants to conference projection equipment corresponding to the video conference in which the conference participants participate according to the identification of the conference participants. The conference projection device can decrypt the encrypted image based on a predetermined decryption protocol to obtain the video image of the conference participant. And the conference projection equipment of each video conference integrates the video images of the acquired conference participants, and the integrated video images of the conference participants are used as the conference images of each video conference.
Illustratively, the encrypted transmission of the video image can be realized by the following sub-steps:
and S1401, generating a temporary key according to the equipment identifier of the conference projection equipment and the abstract information of the video image.
The summary information of the video image may be partial data of the video image, for example, header data of the video image or feature data of the video image extracted by a feature extraction algorithm.
Specifically, abstract information of the video images is extracted from the video images, and a temporary key corresponding to each video conference is generated by using a key server according to the equipment identifier of each conference projection equipment and the abstract information of each video image. The ephemeral key includes an ephemeral private key and an ephemeral public key. And the key server distributes the temporary private keys in the temporary keys to the terminal equipment, and distributes the temporary private keys in each temporary key to the conference projection equipment corresponding to the temporary keys respectively.
S1402, the video image is encrypted by the aid of the temporary private key in the temporary secret key, and an encrypted image is obtained.
Specifically, the temporary private key in the temporary key corresponding to each video conference is used for encrypting each video image, so as to obtain the encrypted image of each video image.
And S1403, sending the encrypted image to the conference projection equipment according to the identity of the conference participant, and controlling the conference projection equipment to decrypt the encrypted image through a temporary private key in the temporary private key to generate the conference image.
Specifically, according to the identification of the conference participant, the encrypted image corresponding to the conference participant is sent to the conference projection device corresponding to the video conference in which the conference participant is to participate. And the conference projection equipment decrypts the encrypted image according to the temporary private key in the temporary secret key to obtain the video image of the conference participant. And the conference projection equipment of each video conference integrates the video images of the acquired conference participants respectively, and the integrated video images of the conference participants are used as the conference images of each video conference.
It can be understood that the temporary key is generated according to the device identifier of the conference projection device and the digest information of the video image, so as to encrypt the video image into an encrypted image through the temporary key, and control the conference projection device to decrypt the encrypted image through the temporary key, thereby obtaining the conference image. The problem that the conference projection equipment projects wrong video images due to wrong video image sending when the video images corresponding to different video conferences are sent to different conference projection equipment at the same time can be solved. The safety of the video conference and the accuracy of the conference image played by the conference projection equipment are ensured.
S150, obtaining the conference image fed back by the conference projection equipment, and sending the conference image to conference participants according to the identification marks of the conference participants.
Specifically, conference images of the video conferences fed back by the conference projection equipment are obtained, identification marks of conference participants corresponding to the video conferences are determined, and the conference images of the video conferences are correspondingly sent to the conference participants of the video conferences according to the identification marks of the conference participants.
According to the scheme, the problem that when a video conference is carried out through the fixed terminal, in order to enable the fixed terminal to have the function of the video conference, complex cable connection needs to be carried out in advance, the phenomenon of cable knotting is easy to generate, and the cable is difficult to maintain is solved; meanwhile, the problem that in the video conference process, video images are easy to steal, and therefore information leakage is caused is solved.
According to the technical scheme provided by the embodiment, conference projection equipment corresponding to each video conference is determined according to the conference participation condition of each video conference and the identity of the candidate participants, and the conference participants of each video conference are determined from the candidate participants; sending a conference invitation to conference participants and acquiring video data fed back by the conference participants; analyzing the video data to obtain video images of the conference participants and identification marks of the conference participants; encrypting the video image according to the equipment identification of the conference projection equipment to obtain an encrypted image, sending the encrypted image to the conference projection equipment according to the identification of the conference participant, and controlling the conference projection equipment to decrypt the encrypted image to generate a conference image; and acquiring the conference image fed back by the conference projection equipment, and sending the conference image to the conference participants according to the identity marks of the conference participants. According to the scheme, the conference projection equipment and the conference participants of each video conference are determined according to the conference participation conditions of each video conference and the identification marks of the candidate participants, the video data fed back by the conference participants are encrypted and then sent to the conference projection equipment corresponding to the video conference in which the video participants participate, so that the conference projection equipment corresponding to each video conference decrypts the video data, then the video images corresponding to each video conference are obtained respectively, and the video images corresponding to the video conferences are fed back to the conference participants. Realized under the prerequisite of wireless cable connection, when having the demand of a plurality of video conferences, receive the video data of each video conference through fixed terminal, in order to realize carrying out overall planning to a plurality of video conferences simultaneously, the accurate video data with each video conference sends the meeting projection equipment that each video conference corresponds, and the video image of receiving meeting projection equipment feedback, the accurate gives the meeting participant with video image feedback, the meeting planning efficiency of video conference has been improved. Meanwhile, the video images are encrypted and then sent to the conference projection equipment, so that the content in the video images can be prevented from being stolen, and the safety of the video conference is improved.
Example two
Fig. 2 is a flowchart of a video conference method according to a second embodiment of the present invention, which is optimized based on the second embodiment, and this embodiment provides a preferred embodiment that obtains video data fed back by conference participants, sends an encrypted image to a conference projection device according to the identifiers of the conference participants, and controls the conference projection device to decrypt the encrypted image to generate a conference image. Specifically, as shown in fig. 2, the method includes:
s210, determining conference projection equipment corresponding to each video conference according to the conference participation condition of each video conference and the identity of the candidate participants, and determining conference participants of each video conference from the candidate participants.
S220, sending a conference invitation to the conference participants, calling a data conversion interface of the intermediate server, and performing data conversion on feedback data according to a first data conversion protocol to obtain video data fed back by the conference participants.
It should be noted that, because there are differences in the types of the camera devices used by different conference participants, the terminal device may not be able to directly analyze the feedback data of the conference participants to obtain video images of the conference participants. An intermediate server for data conversion is thus provided.
The first data conversion protocol is a protocol for converting the data format of the feedback data of the conference participant into a data format that can be analyzed by the fixed terminal.
Specifically, the conference invitation is sent to the conference participants, after the feedback data of the conference participants are obtained, a data conversion interface of the intermediate server is called, data conversion is carried out on the feedback data according to a first data conversion protocol, and the converted feedback data is used as video data fed back by the conference participants.
And S230, analyzing the video data to obtain the video images of the conference participants and the identification marks of the conference participants.
S240, according to the equipment identification of the conference projection equipment, the video image is encrypted to obtain an encrypted image, the encrypted image is sent to the conference projection equipment according to the identification of the conference participant, and the conference projection equipment is controlled to decrypt the encrypted image to obtain decrypted data.
And S250, controlling the conference projection equipment to call a data conversion interface of the intermediate server, performing data conversion on the decrypted data according to a second data conversion protocol, and acquiring a conference image according to a data conversion result.
Due to differences in the models of the conference projection devices installed in the conference rooms, it may be impossible for some of the conference projection devices to obtain video images of conference participants according to the decrypted data. An intermediate server is required to perform data conversion on the decrypted data.
The second data conversion protocol is a protocol for converting the data format of the decrypted data into a data format that can be analyzed by the conference projection device.
Specifically, the conference projection equipment is controlled to call a data conversion interface of the intermediate server, data conversion is carried out on the decrypted data according to a second data conversion protocol, and the converted decrypted data is analyzed to obtain video images of conference participants. And integrating the acquired video images of the conference participants by the conference projection equipment to generate a conference image.
And S260, acquiring the conference image fed back by the conference projection equipment, and sending the conference image to conference participants according to the identity marks of the conference participants.
According to the technical scheme of the embodiment, after the feedback data of the conference participants are obtained, a data conversion interface of an intermediate server is called to perform data conversion on the feedback data, the feedback data are converted into video data which can be identified by a fixed terminal, and video images of the conference participants are obtained according to the video data; and then encrypting the video image and sending the video image to the conference projection equipment, decrypting the encrypted image by the conference projection equipment to obtain decrypted data, calling a data conversion interface of the intermediate server, and performing data conversion on the decrypted data to obtain the conference image which can be displayed on the conference projection equipment. By means of the scheme, the situation that the fixed terminal cannot identify the feedback data of the conference participants due to the fact that the camera devices used by the conference participants are different is avoided, and meanwhile the problem that the conference projection devices possibly cannot play video images sent by the fixed terminal due to the fact that the formats of videos which can be played by the conference projection devices of different models are different is avoided. The data conversion is carried out on the transmission data in the video conference by setting the intermediate server, so that the data format of the feedback data of conference participants and the equipment model of the conference projection equipment do not need to be considered when the video conference is carried out through the fixed terminal, and the compatibility of the video conference on the conference projection equipment and the image acquisition equipment is improved.
EXAMPLE III
Fig. 3 is a flowchart of a video conference method according to a third embodiment of the present invention, which is optimized based on the third embodiment, and this embodiment provides a preferred embodiment that when there is a conference adjustment requirement, a target conference to be adjusted is determined, a target participant of the target conference is determined, an adjustment image is generated according to a target projection device corresponding to the target conference and a video image of the target participant, and the adjustment image is sent to the target participant. Specifically, as shown in fig. 3, the method includes:
s310, determining conference projection equipment corresponding to each video conference according to the conference participation condition of each video conference and the identity of the candidate participants, and determining conference participants of each video conference from the candidate participants.
And S320, sending a conference invitation to the conference participants, and acquiring video data fed back by the conference participants.
S330, analyzing the video data to obtain the video images of the conference participants and the identification marks of the conference participants.
S340, according to the equipment identification of the conference projection equipment, the video image is encrypted to obtain an encrypted image, the encrypted image is sent to the conference projection equipment according to the identification of the conference participant, and the conference projection equipment is controlled to decrypt the encrypted image to generate a conference image.
And S350, acquiring the conference image fed back by the conference projection equipment, and sending the conference image to conference participants according to the identity marks of the conference participants.
And S360, when meeting adjustment requirements exist, determining a target meeting to be adjusted and target participants of the target meeting from all the video meetings according to meeting adjustment rules.
The conference adjustment requirement refers to an adjustment requirement for conference participants of a video conference in the process of the video conference. The meeting adjustment rules may include: the conference adjusting time, the equipment identifier of the conference projection equipment corresponding to the target conference to be adjusted, and the target participant of the adjusted target conference. The target conference refers to a video conference requiring adjustment of conference participants. The target participant refers to a conference participant required by the adjusted target conference.
Specifically, the conference organizer may set the conference adjustment rule in advance. When the meeting adjustment time specified in the meeting adjustment rule is reached, there is a meeting adjustment requirement. And according to the conference adjustment rule, determining the equipment identifier of the conference projection equipment corresponding to the target conference to be adjusted and the identity identifier of the target participant of the target conference from all the video conferences.
And S370, if the target participants have the absent participants which do not participate in the target conference, acquiring the identity of the absent participants, and acquiring the video images of the absent participants according to the identity of the absent participants.
Specifically, the identity of the current participant of the target conference is determined, and the current participant is a conference participant participating in the target conference at the current time. And determining whether the target participants have absent participants which do not participate in the target conference or not according to the identity marks of the current participants and the identity marks of the target participants. If the target participants have the absent participants which do not participate in the target conference, the identity of the absent participants is determined according to the comparison result of the identity of the current participants and the identity of the target participants, and the video images of the absent participants are obtained according to the identity of the absent participants.
And S380, transferring the video image of the absent participant to a target projection device corresponding to the target conference, and generating an adjustment image according to the target projection device.
The target projection device is a conference projection device for executing a target conference, and the adjusted image is a conference image of the adjusted target conference.
Specifically, an equipment identifier of a target projection equipment corresponding to the target conference is determined, and the video image of the absent participant is transferred to the target projection equipment corresponding to the target conference according to the equipment identifier of the target projection equipment, so that the target projection equipment generates an adjustment image according to the video image of the target participant.
And S390, obtaining the adjustment image fed back by the target projection equipment, and sending the adjustment image to the target participant according to the identity of the target participant.
According to the technical scheme of the embodiment, in the process of each video conference, if a video conference with conference adjustment requirements exists, according to a conference adjustment rule, the video conference to be adjusted is used as a target conference, a target participant needing to participate in the target conference is determined, an absent participant which does not participate in the target conference is determined, a video image of the absent participant is transferred to a target projection device corresponding to the target conference, an adjusted image of the adjusted target conference is obtained, and the adjusted image is sent to the target participant. The video conference adjusting method and device have the advantages that the video conference can be automatically adjusted according to the conference adjusting rule in the video conference process, the adjusting efficiency of the target conference is improved, and meanwhile the convenience of conference adjustment is improved.
Example four
Fig. 4 is a schematic structural diagram of a video conference apparatus according to a fourth embodiment of the present invention. The present embodiment can be applied to a case where a video conference is performed through a fixed terminal. As shown in fig. 4, the video conference apparatus includes: a conference participant determination module 410, a video data acquisition module 420, a video data parsing module 430, a conference image determination module 440, and a conference image feedback module 450.
The conference participant determining module 410 is configured to determine, according to the conference participation condition of each video conference and the identity of the candidate participant, a conference projection device corresponding to each video conference, and determine, from the candidate participants, a conference participant of each video conference;
the video data acquisition module 420 is configured to send a conference invitation to a conference participant and acquire video data fed back by the conference participant;
the video data analysis module 430 is configured to analyze the video data to obtain a video image of a conference participant and an identity of the conference participant;
the conference image determining module 440 is configured to encrypt the video image according to the device identifier of the conference projection device to obtain an encrypted image, send the encrypted image to the conference projection device according to the identity identifier of the conference participant, and control the conference projection device to decrypt the encrypted image to generate a conference image;
the conference image feedback module 450 is configured to obtain a conference image fed back by the conference projection device, and send the conference image to a conference participant according to an identity of the conference participant.
According to the technical scheme provided by the embodiment, conference projection equipment corresponding to each video conference is determined according to the conference participation condition of each video conference and the identity of the candidate participants, and conference participants of each video conference are determined from the candidate participants; sending a conference invitation to conference participants and acquiring video data fed back by the conference participants; analyzing the video data to obtain video images of the conference participants and identification marks of the conference participants; encrypting the video image according to the equipment identifier of the conference projection equipment to obtain an encrypted image, sending the encrypted image to the conference projection equipment according to the identity identifier of the conference participant, and controlling the conference projection equipment to decrypt the encrypted image to generate a conference image; and acquiring the conference image fed back by the conference projection equipment, and sending the conference image to the conference participants according to the identity marks of the conference participants. According to the scheme, the conference projection equipment and the conference participants of each video conference are determined according to the conference participation condition of each video conference and the identification marks of the candidate participants, the video data fed back by the conference participants are encrypted and then sent to the conference projection equipment corresponding to the video conference in which the video participants participate, so that the video images corresponding to the video conferences are obtained after the video data are decrypted by the conference projection equipment corresponding to the video conferences, and the video images corresponding to the video conferences are fed back to the conference participants. The video conference system has the advantages that on the premise of connection of a wireless cable, when the video conference system has the requirements of multiple video conferences, the video data of the video conferences are received through the fixed terminal, so that the video conferences are comprehensively planned at the same time, the video data of the video conferences are accurately sent to the conference projection equipment corresponding to the video conferences, the video images fed back by the conference projection equipment are received, the video images are accurately fed back to conference participants, and the conference planning efficiency of the video conferences is improved. Meanwhile, the video image is encrypted and then sent to the conference projection equipment, so that the content in the video image can be prevented from being stolen, and the safety of the video conference is improved.
Illustratively, the conference participant determination module 410 includes:
the conference attribute determining unit is used for determining the conference attribute of each video conference according to the conference participation condition of each video conference;
the conference projection equipment determining unit is used for determining the conference projection equipment corresponding to each video conference according to the conference attribute of each video conference;
and the conference participant selection unit is used for selecting the conference participants of the video conferences from the candidate participants according to the identification marks of the candidate participants and the conference participation conditions of the video conferences.
Illustratively, the video data obtaining module 420 is specifically configured to:
and calling a data conversion interface of the intermediate server, and performing data conversion on the feedback data according to a first data conversion protocol to obtain video data fed back by the conference participants.
Illustratively, the conference image determination module 440 is specifically configured to:
generating a temporary key according to the equipment identifier of the conference projection equipment and the abstract information of the video image;
encrypting the video image by adopting a temporary private key in the temporary secret key to obtain an encrypted image;
and sending the encrypted image to the conference projection equipment according to the identity of the conference participant, and controlling the conference projection equipment to decrypt the encrypted image through a temporary private key in the temporary secret key to generate the conference image.
Illustratively, the conference image determination module 440 is further specifically configured to:
sending the encrypted image to conference projection equipment according to the identity of the conference participant, and controlling the conference projection equipment to decrypt the encrypted image to obtain decrypted data;
and controlling the conference projection equipment to call a data conversion interface of the intermediate server, performing data conversion on the decrypted data according to a second data conversion protocol, and acquiring a conference image according to a data conversion result.
Illustratively, the video conference apparatus further includes:
the target conference determining module is used for determining a target conference to be adjusted and target participants of the target conference from all the video conferences according to a conference adjusting rule when meeting adjusting requirements exist;
the absence participant determining module is used for acquiring the identity of an absence participant if the absence participant which does not participate in the target conference exists in the target participants and acquiring the video image of the absence participant according to the identity of the absence participant;
the adjustment image determining module is used for transferring the video image of the absent participant to target projection equipment corresponding to the target conference and generating an adjustment image according to the target projection equipment;
and the adjustment image sending module is used for acquiring the adjustment image fed back by the target projection equipment and sending the adjustment image to the target participant according to the identity of the target participant.
The video conference device provided by the embodiment can be applied to the video conference method provided by any embodiment, and has corresponding functions and beneficial effects.
EXAMPLE five
FIG. 5 illustrates a block diagram of an electronic device 10 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 5, the electronic device 10 includes at least one processor 11, and a memory communicatively connected to the at least one processor 11, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, and the like, wherein the memory stores a computer program executable by the at least one processor, and the processor 11 can perform various suitable actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from a storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data necessary for the operation of the electronic apparatus 10 may also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.
A number of components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, or the like; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, or the like. Processor 11 performs the various methods and processes described above, such as the video conferencing method.
In some embodiments, the video conferencing method may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the video conferencing method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the video conferencing method by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Computer programs for implementing the methods of the present invention can be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be performed. A computer program can execute entirely on a machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. A computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service are overcome.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present invention may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired result of the technical solution of the present invention can be achieved.
The above-described embodiments should not be construed as limiting the scope of the invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. A video conferencing method, comprising:
determining conference projection equipment corresponding to each video conference according to the conference participation condition of each video conference and the identity of the candidate participants, and determining conference participants of each video conference from the candidate participants;
sending a conference invitation to the conference participant, and acquiring video data fed back by the conference participant;
analyzing the video data to obtain the video images of the conference participants and the identity marks of the conference participants;
encrypting the video image according to the equipment identifier of the conference projection equipment to obtain an encrypted image, sending the encrypted image to the conference projection equipment according to the identity identifier of the conference participant, and controlling the conference projection equipment to decrypt the encrypted image to generate a conference image;
and acquiring the conference image fed back by the conference projection equipment, and sending the conference image to the conference participants according to the identity marks of the conference participants.
2. The method of claim 1, wherein determining conference projection equipment corresponding to each video conference according to the conference participation condition of each video conference and the identification of the candidate participants, and determining conference participants of each video conference from the candidate participants comprises:
determining the conference attribute of each video conference according to the conference participation condition of each video conference;
determining conference projection equipment corresponding to each video conference according to the conference attribute of each video conference;
and selecting conference participants of each video conference from the candidate participants according to the identification of the candidate participants and the conference participation conditions of each video conference.
3. The method of claim 1, wherein the obtaining the video data fed back by the conference participants comprises:
and calling a data conversion interface of the intermediate server, and performing data conversion on the feedback data according to a first data conversion protocol to obtain video data fed back by the conference participants.
4. The method according to claim 1, wherein the encrypting the video image according to the device identifier of the conference projection device to obtain an encrypted image, and sending the encrypted image to the conference projection device according to the identity identifier of the conference participant to control the conference projection device to decrypt the encrypted image to generate the conference image comprises:
generating a temporary key according to the equipment identifier of the conference projection equipment and the abstract information of the video image;
encrypting the video image by adopting a temporary private key in the temporary secret key to obtain an encrypted image;
and sending the encrypted image to conference projection equipment according to the identity of the conference participant, and controlling the conference projection equipment to decrypt the encrypted image through a temporary private key in the temporary secret key to generate the conference image.
5. The method according to claim 1, wherein the sending the encrypted image to a conference projection device according to the identification of the conference participant, and controlling the conference projection device to decrypt the encrypted image to generate a conference image comprises:
sending the encrypted image to conference projection equipment according to the identity of the conference participant, and controlling the conference projection equipment to decrypt the encrypted image to obtain decrypted data;
and controlling the conference projection equipment to call a data conversion interface of the intermediate server, performing data conversion on the decrypted data according to a second data conversion protocol, and acquiring a conference image according to a data conversion result.
6. The method of claim 1, further comprising:
when meeting adjustment requirements exist, determining a target meeting to be adjusted and target participants of the target meeting from all video meetings according to meeting adjustment rules;
if the target participants have the absent participants which do not participate in the target conference, acquiring the identity of the absent participants, and acquiring the video images of the absent participants according to the identity of the absent participants;
transferring the video image of the absent participant to a target projection device corresponding to the target conference, and generating an adjusting image according to the target projection device;
and acquiring an adjustment image fed back by the target projection equipment, and sending the adjustment image to the target participant according to the identity of the target participant.
7. A video conferencing apparatus, comprising:
the conference participant determining module is used for determining conference projection equipment corresponding to each video conference according to the conference participation condition of each video conference and the identity of the candidate participants and determining the conference participants of each video conference from the candidate participants;
the video data acquisition module is used for sending a conference invitation to the conference participants and acquiring video data fed back by the conference participants;
the video data analysis module is used for analyzing the video data to obtain the video images of the conference participants and the identity marks of the conference participants;
the conference image determining module is used for encrypting the video image according to the equipment identifier of the conference projection equipment to obtain an encrypted image, sending the encrypted image to the conference projection equipment according to the identity identifier of the conference participant, and controlling the conference projection equipment to decrypt the encrypted image to generate a conference image;
and the conference image feedback module is used for acquiring the conference image fed back by the conference projection equipment and sending the conference image to the conference participants according to the identification marks of the conference participants.
8. The apparatus of claim 7, wherein the conference participant determination module comprises:
the conference attribute determining unit is used for determining the conference attribute of each video conference according to the conference participation condition of each video conference;
the conference projection equipment determining unit is used for determining the conference projection equipment corresponding to each video conference according to the conference attribute of each video conference;
and the conference participant selection unit is used for selecting the conference participants of the video conferences from the candidate participants according to the identification marks of the candidate participants and the conference participation conditions of the video conferences.
9. An electronic device, characterized in that the electronic device comprises:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein, the first and the second end of the pipe are connected with each other,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the video conferencing method of any of claims 1-6.
10. A computer-readable storage medium having stored thereon computer instructions for causing a processor, when executed, to implement the video conferencing method of any of claims 1-6.
CN202211008915.8A 2022-08-22 2022-08-22 Video conference method, device, equipment and storage medium Pending CN115396626A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211008915.8A CN115396626A (en) 2022-08-22 2022-08-22 Video conference method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211008915.8A CN115396626A (en) 2022-08-22 2022-08-22 Video conference method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN115396626A true CN115396626A (en) 2022-11-25

Family

ID=84121563

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211008915.8A Pending CN115396626A (en) 2022-08-22 2022-08-22 Video conference method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN115396626A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116112296A (en) * 2023-04-13 2023-05-12 中保网盾(天津)科技有限公司 Intelligent video conference data protection management method, system and storage medium thereof

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116112296A (en) * 2023-04-13 2023-05-12 中保网盾(天津)科技有限公司 Intelligent video conference data protection management method, system and storage medium thereof

Similar Documents

Publication Publication Date Title
US20160134428A1 (en) User Device Evaluation for Online Meetings
US10148712B2 (en) Automated social network introductions for e-meetings
EP3131257B1 (en) Program, information processing apparatus, and information processing system for use in an electronic conference system
US9992142B2 (en) Messages from absent participants in online conferencing
CN107292441B (en) Operation and maintenance cooperation system
CN110708358B (en) Session message processing method, electronic device and computer-readable storage medium
JP2014179806A (en) Communication system, communication management device and program
JP7453576B2 (en) Information processing system, its control method and program.
US9516175B2 (en) Transmission system, participation fee management method, computer program product, and maintenance system
EP3217596B1 (en) Communication terminal, communication system, and data transmission method
CN111711528A (en) Network conference control method and device, computer readable storage medium and equipment
US20150150105A1 (en) Communication management apparatus, program, communication management method, and communication management system
US20150278718A1 (en) Systems and methods for communication sharing in a relationship management system
CN115396626A (en) Video conference method, device, equipment and storage medium
EP3151481B1 (en) Communication terminal, communication system, and output method
US11838338B2 (en) Method and device for conference control and conference participation, server, terminal, and storage medium
CN102016816A (en) Messaging between events
CN113992882A (en) Packet processing method and device for multi-person conversation, electronic device and storage medium
CN113420133A (en) Session processing method, device, equipment and storage medium
JP2022047727A (en) Information processing system, information processing method, and program
CN106992971B (en) Interactive terminal switching method and device and interactive recording and broadcasting system
KR20210026215A (en) Apparatus and method for managing online conference
CN113037517B (en) Method, system and readable storage medium for multi-device merging and sharing
CN115150128B (en) Remote off-site bid evaluation method and system, electronic device and storage medium
US11888634B2 (en) Dynamic sharing of meeting assets within a messaging platform

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination