CN114494937A - Early warning method for abnormal behaviors of bid evaluation experts in remote bid evaluation video conference process - Google Patents

Early warning method for abnormal behaviors of bid evaluation experts in remote bid evaluation video conference process Download PDF

Info

Publication number
CN114494937A
CN114494937A CN202111590589.1A CN202111590589A CN114494937A CN 114494937 A CN114494937 A CN 114494937A CN 202111590589 A CN202111590589 A CN 202111590589A CN 114494937 A CN114494937 A CN 114494937A
Authority
CN
China
Prior art keywords
face
bid evaluation
expert
human body
bid
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111590589.1A
Other languages
Chinese (zh)
Inventor
张又新
马学军
田森
于斌
高宏伟
李再池
包立贞
王端贵
郭永荣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Guoxin Innovation Technology Co ltd
Huaneng Tendering Co ltd
Original Assignee
Beijing Guoxin Innovation Technology Co ltd
Huaneng Tendering Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Guoxin Innovation Technology Co ltd, Huaneng Tendering Co ltd filed Critical Beijing Guoxin Innovation Technology Co ltd
Priority to CN202111590589.1A priority Critical patent/CN114494937A/en
Publication of CN114494937A publication Critical patent/CN114494937A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The application provides an early warning method for abnormal behaviors of bid evaluation experts in a remote bid evaluation video conference process, which relates to the technical field of bid invitation evaluation and comprises the following steps: the method comprises the steps that in the process that an evaluation expert remotely evaluates a preset project through a video conference evaluation tool, a face video picture of the evaluation expert is obtained; carrying out face detection on the face video picture to obtain a face detection result; carrying out human body detection on the face video picture to obtain a human body detection result, wherein the human body detection result comprises whether the face video picture contains a human body part with a corresponding display proportion exceeding a preset proportion; judging whether abnormal behaviors exist in the bid evaluation process of the bid evaluation expert based on the face detection result and the human body detection result; and when abnormal behaviors exist in the bid evaluation process of the bid evaluation expert, outputting early warning information. Therefore, the abnormal behaviors of the bid evaluation experts are automatically identified in the remote bid evaluation process, and the labor cost of manual monitoring is reduced.

Description

Early warning method for abnormal behaviors of bid evaluation experts in remote bid evaluation video conference process
Technical Field
The application relates to the technical field of bid inviting and bid evaluation, in particular to an early warning method for abnormal behaviors of bid evaluation experts in a remote bid evaluation video conference process.
Background
The bid inviting and evaluation is a comprehensive economic responsibility form for promoting competition in the field of basic construction, a plurality of construction units generally participate in project bidding, and the bid inviting units (such as the construction units) select the optimal choice, so that the construction unit has short construction period, low construction cost, high quality and good credit, the bid inviting units can wrap project tasks to the construction units, and the bid inviting process evaluation is particularly important.
Currently, the bid evaluation can be performed in a remote bid evaluation manner, and during the remote bid evaluation, abnormal behaviors may occur, such as the bid evaluation expert entrusting other people to evaluate the bid, the bid evaluation expert not evaluating the bid on the bid evaluation machine, or other people breaking into the bid evaluation room where the bid evaluation expert is located. In the related art, in the process of remotely evaluating the bid remotely, a project manager usually monitors the bid evaluation process of the bid evaluation expert through a video conference display interface to determine whether the abnormal behavior exists in the bid evaluation process, and in this way, the bid evaluation expert needs to continuously watch the video conference display interface, so that the labor cost is high.
Disclosure of Invention
The application provides an early warning method for abnormal behaviors of bid evaluation experts in a remote bid evaluation video conference process, which is used for solving the technical problem of high labor cost of an abnormal behavior identification method in a remote bid evaluation process in the related technology.
The embodiment of the first aspect of the application provides an early warning method for abnormal behaviors of a bid evaluation expert in a remote bid evaluation video conference process, which comprises the following steps: the method comprises the steps that in the process that an evaluation expert remotely evaluates a preset project through a video conference evaluation tool, a facial video picture of the evaluation expert is obtained; performing face detection on the face video picture to obtain a face detection result, wherein the face detection result comprises whether the face video picture contains a face or not; performing human body detection on the face video picture to obtain a human body detection result, wherein the human body detection result comprises whether a human body part with a corresponding display proportion exceeding a preset proportion is contained in the face video picture, and the display proportion is the proportion of an area where the human body part is located in the face video picture; judging whether the bid evaluation expert has abnormal behaviors in the bid evaluation process based on the face detection result and the human body detection result; and outputting early warning information when the bid evaluation expert has abnormal behaviors in the bid evaluation process.
The embodiment of the second aspect of the application provides an early warning device for abnormal behaviors of bid evaluation experts in a remote bid evaluation video conference process, and the device comprises: the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a facial video picture of an evaluation expert in the process of remotely evaluating a preset project by the evaluation expert through a video conference evaluation tool; the identification module is used for carrying out face detection on the face video picture to obtain a face detection result, wherein the face detection result comprises whether the face video picture contains a face or not; the detection module is used for carrying out human body detection on the face video picture to obtain a human body detection result, wherein the human body detection result comprises whether a human body part with a corresponding display proportion exceeding a preset proportion is contained in the face video picture, and the display proportion is the proportion of an area where the human body part is located in the face video picture; the judging module is used for judging whether the bid evaluation expert has abnormal behaviors in the bid evaluation process based on the face detection result and the human body detection result; and the output module is used for outputting early warning information when the bid evaluation expert has abnormal behaviors in the bid evaluation process.
An embodiment of a third aspect of the present application provides an electronic device, including: the system comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein when the processor executes the program, the early warning method for the abnormal behavior of the bid evaluation expert in the process of the remote bid evaluation video conference is executed.
An embodiment of a fourth aspect of the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method for early warning of abnormal behavior of a bid evaluation expert in a remote bid evaluation video conference process as set forth in the foregoing embodiment of the first aspect of the present application.
In an embodiment of a fifth aspect of the present application, a computer program product is provided, where the computer program product includes a computer program, and when the computer program is executed by a processor, the computer program implements the method for early warning of abnormal behavior of the bid evaluation expert in the remote bid evaluation video conference process, which is provided in the embodiment of the first aspect of the present application.
The technical scheme that this application provided has following beneficial effect:
the method comprises the steps that in the process that an evaluation expert carries out remote evaluation on a preset item through a video conference evaluation tool, a face video picture of the evaluation expert is obtained, face detection is carried out on the face video picture to obtain a face detection result, wherein the face detection result comprises whether a face is contained in the face video picture or not, human body detection is carried out on the face video picture to obtain a human body detection result, the human body detection result comprises whether a human body part with a corresponding display proportion exceeding a preset proportion is contained in the face video picture or not, the display proportion is the proportion of an area where the human body part is located in the face video picture, whether abnormal behaviors exist in the evaluation process of the evaluation expert is judged based on the face detection result and the human body detection result, when the abnormal behaviors exist in the evaluation process of the evaluation expert, early warning information is output, and the abnormal behaviors of the evaluation expert are automatically determined in the remote evaluation process, and the labor cost of manual monitoring is reduced.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The above and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic structural diagram of an intelligent remote bid evaluation monitoring system according to an embodiment of the present application;
fig. 2 is another schematic structural diagram of an intelligent remote bid evaluation monitoring system according to an embodiment of the present application;
FIG. 3 is a schematic diagram illustrating interaction among a project manager, a bid evaluation expert, a monitoring platform, and a bid monitoring person according to an embodiment of the present disclosure;
fig. 4 is a schematic flowchart of an early warning method for abnormal behavior of a bid evaluation expert in a remote bid evaluation video conference process according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an early warning device for abnormal behavior of a bid evaluation expert in a remote bid evaluation video conference process according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.
The early warning method for the abnormal behavior of the bid evaluation expert in the process of the remote bid evaluation video conference in the embodiment of the application can be applied to an intelligent remote bid evaluation supervision platform of an intelligent remote bid evaluation supervision system, and the intelligent remote bid evaluation supervision system in the embodiment of the application is explained with reference to the attached drawings.
Fig. 1 is a schematic structural diagram of an intelligent remote bid evaluation monitoring system according to an embodiment of the present application.
As shown in fig. 1, the intelligent remote bid evaluation monitoring system may include an intelligent bid evaluation platform 110 and an intelligent remote bid evaluation monitoring platform 120, which are communicatively connected, where the intelligent bid evaluation platform 110 includes a video conference bid evaluation tool 111.
The intelligent bidding platform 110 is used for processing bidding purchasing business; the video conference bid evaluation tool 111 is used for enabling bid evaluation experts to enter a virtual conference room through the video conference bid evaluation tool 111 and remotely evaluating bid on preset items in the virtual conference room; the intelligent remote bid evaluation supervision platform 120, hereinafter referred to as the supervision platform 120, is used for intelligently supervising the bid evaluation process of the bid evaluation experts on the preset project. The preset item refers to the item which is being evaluated by the evaluation expert and can be set randomly according to the requirement. The bid evaluation expert may be any bid evaluation expert participating in bid evaluation work of a preset project.
Specifically, the supervision platform 120 may be deployed on an enterprise cloud, integrate cloud desktop resource devices of the enterprise, develop a computer-based visual analysis technology, a remote video conference technology, and a remote video monitoring technology, serve as a software and hardware support platform of an evaluation visualization supervision center, and have functions of querying real-time videos, historical videos, intelligent early warning, and the like.
The monitoring platform 120 may include a base service layer, a platform service layer, and an application service layer from bottom to top. The basic service layer may include modules such as an enterprise cloud, a cloud desktop, and a video monitor, and is used to provide basic services required by the operation of the monitoring platform 120. The platform service layer can comprise an audio-video communication service module, a message queue service module, an embedded security service module, a search engine service module, a distributed storage service module, a distributed computing service module, a virtualization service module, a centralized computing service module, a signaling service module and a media service module and is used for providing corresponding services. The application service layer can comprise a video monitoring management module for providing video monitoring management service, a video fusion module for providing video recording and fusion service, a video conference service module for providing video conference service, an intelligent analysis and early warning module for providing intelligent analysis and early warning of video data and the like.
In addition, the administration platform 120 may also provide a display interface for a large screen of visualization, a virtual meeting room, and the like.
The intelligent bidding platform 110 is used for processing the bidding purchase service, that is, all the bidding purchase services are performed on the intelligent bidding platform 110.
The videoconference bidding tool 111 can be understood to be a sub-application in the intelligent bidding platform 110. The evaluation expert and the relevant personnel of the evaluation work such as the project manager can log in the video conference evaluation tool 111 through the intelligent enrollment platform 110, the intelligent enrollment platform 110 performs identity verification during logging in, and after logging in the video conference evaluation tool 111, the video conference evaluation tool 111 can run independently.
Taking the bid evaluation expert as an example, when the bid evaluation expert logs in the video conference bid evaluation tool 111, the intelligent bidding platform 110 can implement the identity verification of the bid evaluation expert through a face recognition technology. After the identity verification is passed, the bid evaluation expert can perform related bid evaluation operation through the video conference bid evaluation tool 111; when the authentication fails, the video conference comment tool 111 may prompt the expert that the authentication fails, and the login is not allowed. If the current bid evaluation expert does not acquire the face image, the video conference bid evaluation tool 111 may prompt the bid evaluation expert to acquire the face image first.
After the bid evaluation expert logs in the video conference bid evaluation tool 111, the bid evaluation expert can enter a virtual conference room and remotely evaluate bids in the virtual conference room, and in the process of evaluating bids of preset items by the bid evaluation expert, the supervision platform 120 can intelligently supervise the bid evaluation process.
The intelligent remote bid evaluation supervision system is described in detail below.
Specifically, the video conference bid evaluation tool 111 is deeply integrated with the video conference tool and the bid evaluation tool. The bid evaluation tool is used for processing bid inviting purchase services, and the video conference tool is deeply integrated with the bid evaluation tool on the basis of meeting basic functions of audio and video communication, text message communication, screen desktop sharing, file sharing, application program sharing and the like of a video conference, so that the video conference tool is organically integrated with the bid inviting purchase services, and service requirements for different user roles (such as bid evaluation experts and project managers) in a remote bid evaluation process are met.
When the preset project needs to be evaluated, a project manager can firstly create a virtual meeting room for the video conference for evaluating the targets. Specifically, the project manager may log in the video conference bid evaluation tool 111, and click an entry button having a function of entering a display interface of the preset project on the display interface of the video conference bid evaluation tool 111 after successful login, so that the video conference bid evaluation tool 111 may display the display interface of the project manager of the preset project. It should be noted that, after the entry button is clicked by different user roles, the video conference bid evaluation tool 111 displays different display interfaces of the preset project for different user roles, for example, for a project manager, a project manager display interface of the preset project is displayed, through the interface, the project manager can create a virtual meeting room corresponding to the preset project, for a bid evaluation expert, the video conference bid evaluation tool 111 displays a bid evaluation expert display interface of the preset project, and through the interface, the bid evaluation expert can enter the created virtual meeting room corresponding to the preset project to evaluate the preset project.
When the video conference bid evaluation tool 111 displays a project manager display interface of a preset project, a project manager may click a conference creation button with a conference creation function on the interface to trigger a video conference creation request, and accordingly, the video conference bid evaluation tool 111 may send the video conference creation request to the monitoring platform 120, where the video conference creation request includes conference information of the preset project. The meeting information may include item information of the preset item, such as an item name, an item identifier, a bid evaluation time, a bid evaluation location, and any information related to the preset item. Alternatively, the meeting information may include project information of a preset project and expert information, where the expert information includes, for example, name, identification, age, identification number, mobile phone number, and any information related to each bid evaluation expert, such as name, identification, age, identification number, and mobile phone number, of each bid evaluation expert who needs to participate in bid evaluation work of the preset project.
After receiving the video conference creation request, the monitoring platform 120 may create a virtual conference room according to the conference information of the preset project, generate a video conference number corresponding to the virtual conference room, and further send the video conference number to the video conference bid evaluation tool 111, so as to notify the video conference bid evaluation tool 111 that the virtual conference room is created. After receiving the video conference number, the video conference comment tool 111 may display a prompt message that the video conference has been created to prompt the project manager that the video conference has been created. The creation of the virtual meeting room and the generation of the corresponding video conference number may be executed by a module in the application service layer of the monitoring platform 120, which provides a video conference creation service.
Accordingly, the videoconference bidding tool 111 is further configured to: sending a video conference creation request to the intelligent remote bid evaluation monitoring platform 120, wherein the video conference creation request comprises conference information of a preset project;
the intelligent remote bid evaluation supervision platform 120 is further configured to: after receiving the video conference creation request, according to the conference information of the preset project, creating a virtual conference room and generating a video conference number corresponding to the virtual conference room, and sending the video conference number to the video conference evaluation tool 111.
The video conference number is used to uniquely identify the corresponding virtual conference room, and the video conference number is automatically generated by the monitoring platform 120, and the generation rule may refer to related technologies, which are not described herein again.
Since the project manager only needs to click the meeting creation button, the video meeting bidding tool 111 can interact with the monitoring platform 120, and the virtual meeting room is automatically created through the monitoring platform 120, so that the project manager can automatically create the virtual meeting room for bidding evaluation of the preset project by one key.
It should be noted that, the above process is described by taking one virtual meeting room as an example, in an actual application, a plurality of virtual meeting rooms may be created through the above process as needed, and the present application is not limited to this.
After a virtual meeting room for evaluating the bid of the preset project is created, any bid evaluation expert participating in the bid evaluation work of the preset project can enter the virtual meeting room through the video conference bid evaluation tool 111 to evaluate the bid of the preset project. Specifically, for example, one of the bid evaluation experts is taken as an example, after the video conference bid evaluation tool 111 used by the bid evaluation expert receives the video conference number sent by the monitoring platform 120, the video conference number may be associated with a preset project and stored under the preset project, and after the bid evaluation expert participating in the bid evaluation work of the preset project enters a bid evaluation expert display interface of the preset project, a join video conference button is displayed, and the bid evaluation expert may click the join video conference button, so that the video conference bid evaluation tool 111 may respond to the detection of the touch operation on the join video conference button, acquire the video conference number associated with the preset project, start the video conference tool, and send the video conference number to the video conference tool, so as to enter a virtual conference room corresponding to the video conference number through the video conference tool. After entering the virtual meeting room corresponding to the video meeting number, the bid evaluation expert can begin to evaluate the bid of the preset project.
Accordingly, the videoconference bidding tool 111 is further configured to: receiving a video conference number sent by the intelligent remote bid evaluation monitoring platform 120; and entering a virtual meeting room according to the video meeting number.
Therefore, the bid evaluation expert can join the created virtual meeting room through one-key joining of the video meeting button. It should be noted that, in the above embodiment, the comment expert enters the created virtual meeting room as an example, in practical application, all the related personnel of the preset project, such as a project manager, a supervisor, and a comment expert, can enter the display interface of the preset project through the video conference comment tool 111, and join the virtual meeting room of the preset project through adding the video conference button by one key to perform a video conference. The created virtual meeting room can be added by adding the video conference button only after the video conference bid evaluation tool 111 is logged in and the display interface of the preset project is entered, and the virtual meeting room cannot be entered by other ways for bid evaluation, so that the bid evaluation process is safer and more confidential. In addition, before the related personnel of the preset project enter the virtual meeting room, the identity of the entering personnel can be verified, so that the safety and the confidentiality of the bid evaluation process are further improved. In addition, before the related preset project personnel enter the virtual meeting room, the video conference comment tool 111 can also remind the attention points when the video conference is participated in, and then enter the virtual meeting room to participate in the video conference after the related preset project personnel agree.
The virtual meeting room is established through project managers based on a video conference bid evaluation tool key, and the bid evaluation experts join the virtual meeting room based on the video conference bid evaluation tool key, so that a video conference does not need to be established in advance through manual work, a video conference account password does not need to be managed independently, the remote bid evaluation can be performed on the preset project through simple operation, the remote bid evaluation efficiency is improved, and the bid evaluation process is high in safety and confidentiality.
In the embodiment of the application, the bid evaluation experts participating in bid evaluation work of the preset project can be obtained by extracting an expert database in advance. Accordingly, referring to fig. 2, the intelligent remote bid evaluation supervising system may further include an expert extraction platform 130 communicatively connected to the intelligent bidding platform 110 for extracting bid evaluation experts participating in bid evaluation work of a preset project from among a plurality of candidate bid evaluation experts included in the expert database. The expert database may be independent of the expert extraction platform 130, or may be configured in the expert extraction platform 130, and the expert extraction platform 130 may update expert information of a plurality of candidate bid evaluation experts in the expert database. The expert information of the candidate bid evaluation expert may include any information related to the bid evaluation expert, such as the specialty, age, province or city, job, academic calendar, and job of the candidate bid evaluation expert.
Specifically, the intelligent enrollment platform 110 may include an extraction button having an expert extraction function, and when an assessment expert participating in the assessment work of the preset project needs to be extracted, a person having an extraction authority may first input the project information and the extraction requirement of the preset project, and click the extraction button in the intelligent enrollment platform 110 to trigger an expert extraction request. Accordingly, the intelligent enrollment platform 110 may send an expert extraction request to the expert extraction platform 130, wherein the expert extraction request may include the item information and the extraction requirement of the preset item. The project information can comprise project identification, bid evaluation time, bid evaluation place and any information related to a preset project; the extraction requirements may include requirements on the expertise, age, province or city of the bidding experts to be extracted, whether the bidding experts are in the work, academic calendar, post, etc., and requirements for avoiding the abnormal bidding behavior in the extraction process.
After receiving the expert extraction request, the expert extraction platform 130 may extract the bid evaluation experts corresponding to the preset item and meeting the extraction requirement from the expert database according to the item information and the extraction requirement of the preset item, and send the extracted expert information of the bid evaluation experts to the intelligent enrollment platform 110. The expert information of the bid evaluation expert may include any information related to the bid evaluation expert, such as the specialty of the bid evaluation expert, the age, the province or city where the bid evaluation expert is located, the job, the academic calendar, and the job.
It should be noted that in the embodiment of the present application, the bid evaluation expert who enters the created virtual meeting room corresponding to the preset item to evaluate the bid is the bid evaluation expert extracted by the expert extraction platform 130 according to the item information and the extraction requirement of the preset item. After the intelligent bidding platform 110 receives the expert information of the bid evaluation expert extracted by the expert extraction platform 130, the video conference bid evaluation tool 111 can determine which bid evaluation experts to evaluate the preset project according to the extracted expert information of the bid evaluation expert corresponding to the preset project, and then display the display interface of the bid evaluation expert of the preset project after the bid evaluation experts log in the video conference bid evaluation tool 111, so that the bid evaluation experts can add the bid evaluation in the virtual conference room corresponding to the preset project by clicking the add video conference button displayed on the display interface of the bid evaluation expert of the preset project.
Furthermore, after the expert extraction, the extracted bid evaluation expert can be notified in the modes of short message, telephone, instant communication and the like. In order to enable the supervision platform 120 to supervise the bid evaluation process of the bid evaluation expert extracted by the expert extraction platform 130, the intelligent enrollment platform 110 may further synchronize the expert information of the bid evaluation expert extracted by the expert extraction platform 130 to the supervision platform 120. That is, the intelligent bidding platform 110 is also used to synchronize expert information and project information of the bid evaluation expert to the intelligent remote bid evaluation monitoring platform 120.
In the embodiment of the present application, the bid evaluation institution, the bid evaluation center, the bid evaluation room, and the bid evaluation machine position may be deployed in a manner that one bid evaluation institution includes at least one bid evaluation center, one bid evaluation center includes at least one bid evaluation room, and one bid evaluation room includes at least one bid evaluation machine position, and the monitoring platform 120 may manage the bid evaluation institution, the bid evaluation center, the bid evaluation room, and the bid evaluation machine position in advance, for example, an identifier of at least one bid evaluation center included in at least one bid evaluation institution, an identifier of at least one bid evaluation room included in each bid evaluation center, and an identifier of at least one bid evaluation machine position included in each bid evaluation room may be stored in advance. And when the video conference bid evaluation tool 111 is installed in the terminal device of the corresponding bid evaluation station, the video conference bid evaluation tool 111 may automatically generate a station code, and bind the station code with the identifier of the bid evaluation station stored in the monitoring platform 120. The terminal device may be any device capable of operating the video conference bid evaluation tool 111, such as a computer.
For each bid evaluation expert who enters the virtual meeting room through the video conference bid evaluation tool 111 to remotely evaluate the bid of the preset project, the video conference bid evaluation tool 111 can determine the bid evaluation machine position where the bid evaluation expert is located, so that a first camera in the terminal equipment of the bid evaluation machine position where the bid evaluation expert is located or a second camera connected with the terminal equipment can acquire the face video picture of the bid evaluation expert in real time, and the video conference bid evaluation tool 111 can acquire the display interface of the terminal equipment in real time to acquire the screen operation picture, so that the video conference bid evaluation tool 111 can acquire the face video picture and the screen operation picture of the bid evaluation expert in the bid evaluation process of evaluating the preset project in real time, and further send the face video picture and the screen operation picture to the monitoring platform 120. The video conference bid evaluation tool 111 may send the face video picture and the screen operation picture of the bid evaluation expert in the bid evaluation process of evaluating the bid for the preset project to the video conference service module in the monitoring platform 120 in real time.
In addition, for each bid evaluation expert who successfully logs in the video conference bid evaluation tool 111, the monitoring platform 120 may determine the bid evaluation machine position and the bid evaluation room where the bid evaluation expert is located, further call a monitoring picture of the bid evaluation room where the bid evaluation expert is located, which is collected by a third camera installed in the bid evaluation room where the bid evaluation expert is located (i.e., the bid evaluation room where the bid evaluation machine position where the video conference bid evaluation tool 111 is located), and obtain the monitoring picture of the bid evaluation room where the bid evaluation expert is located in real time in a bid evaluation process where the bid evaluation expert enters a virtual conference room to evaluate a preset item. The video monitoring management module in the monitoring platform 120 may obtain the monitoring picture of the bid evaluation room where the bid evaluation expert is located in real time.
The supervision platform 120 may further evaluate the bid evaluation process of each bid evaluation expert on the preset item according to the facial video picture, the screen operation picture and the monitoring picture of the bid evaluation room in which each bid evaluation expert is located. The intelligent analysis and early warning module in the supervision platform 120 may evaluate the bid evaluation process of each bid evaluation expert on the preset project.
In the embodiment of the present application, the evaluating process of each bid evaluation expert may include identifying whether each bid evaluation expert has at least one of the following abnormal behaviors in the evaluating process: the bid evaluation expert watches other display interfaces irrelevant to the bid evaluation item through the terminal equipment, the bid evaluation expert uses the communication equipment, the bid evaluation expert is not the expert, the bid evaluation expert leaves the post or other people break into the bid evaluation room where the bid evaluation expert is located, and when the at least one abnormal behavior of the bid evaluation expert is identified, the early warning information can be output. The early warning information may include project information of a current preset project, expert information of an evaluation expert with an abnormal behavior, early warning content (for example, the expert is not the expert, leaves the post or has another person break in), early warning time, shooting of early warning evidence (screenshot of a face video picture, a screen operation picture or a monitoring picture), and the like.
Specifically, for each bid evaluation expert, in the bid evaluation process of the bid evaluation expert on the preset project, the monitoring platform 120 may identify whether at least one of the following abnormal behaviors exists in the bid evaluation process of the bid evaluation expert according to a facial video picture of the bid evaluation expert, or the facial video picture is combined with a monitoring picture of a bid evaluation room where the bid evaluation expert is located: the bid evaluation expert is not the expert himself, the bid evaluation expert leaves the post or other people break into the bid evaluation room where the bid evaluation expert is located; identifying whether the bid evaluation expert watches other display interfaces unrelated to the bid evaluation project through the terminal equipment according to the screen operation picture of the terminal equipment where the video conference bid evaluation tool 111 is located; and detecting whether the bid evaluation expert uses communication equipment such as a mobile phone or not by adopting a communication equipment detection technology according to the facial video picture of the bid evaluation expert or combining the facial video picture with a monitoring picture of a bid evaluation room where the bid evaluation expert is located. When the bid evaluation expert leaves the post, the bid evaluation expert can be instructed not to evaluate the bid on the bid evaluation machine position.
That is, in the embodiment of the present application, the administration platform 120 is specifically configured to: acquiring a facial video picture of a bid evaluation expert, a screen operation picture of terminal equipment where a video conference bid evaluation tool is located and a monitoring picture of a bid evaluation room where the bid evaluation expert is located; the system comprises a face video picture, a screen operation picture and a monitoring picture, wherein the face video picture, the screen operation picture and the monitoring picture are collected in real time in the bid evaluation process of a bid evaluation expert on a preset project; and evaluating the bid evaluation process of the bid evaluation expert on the preset project according to the face video picture, the screen operation picture and the monitoring picture. In this embodiment of the present application, the administration platform 120 is specifically configured to: in the bid evaluation process of the bid evaluation expert on the preset item, according to the facial video picture, identifying abnormal behaviors of the bid evaluation expert in the bid evaluation process, wherein the abnormal behaviors comprise at least one of the following behaviors: the bid evaluation expert is not the expert, the bid evaluation expert leaves the post or other people break into the bid evaluation room where the bid evaluation expert is.
Further, after the supervision platform 120 obtains the facial video pictures of each bid evaluation expert, the screen operation pictures of the terminal device where the video conference bid evaluation tool 111 is located, and the monitoring pictures of the bid evaluation room where each bid evaluation expert is located, the three pictures can be recorded in real time respectively to obtain facial video data, screen operation video data, and monitoring video data. In addition, in the process of evaluating the bid of the preset item by each bid evaluation expert, the supervision platform 120 may determine which bid evaluation expert is evaluating the bid of which item in which bid evaluation room, so that the facial video data, the screen operation video data and the monitoring video data may be associated and stored with the bid evaluation expert and the preset item currently being evaluated, so as to meet the requirements of filing and monitoring the bid evaluation process data. Furthermore, when the face video data, the screen operation video data and the monitoring video data of a certain bid evaluation expert need to be displayed or viewed, the face video data, the screen operation video data and the monitoring video data associated with the bid evaluation expert can be fused to obtain fused target audio and video data, and the fused target audio and video data is displayed or viewed through a display interface (namely, the face video data, the screen operation video data and the monitoring video data of a bid evaluation expert are displayed on one display interface at the same time). When the face video data, the screen operation video data and the monitoring video data of each bid evaluation expert who evaluates a preset project need to be displayed or viewed, the face video data, the screen operation video data and the monitoring video data of each bid evaluation expert which are associated with the preset project can be fused to obtain fused further target audio and video data, and the fused further target audio and video data is displayed or viewed through a display interface (namely, the face video data, the screen operation video data and the monitoring video data of each bid evaluation expert are displayed on one display interface at the same time). Therefore, the method and the device can realize the independent recording of the three paths of video data of each bid evaluation expert, the fusion display or viewing of the three paths of video data of each bid evaluation expert, and the fusion display or viewing of the multi-path video data of each bid evaluation expert of a preset item.
The video conference service module of the monitoring platform 120 can record the facial video images and the screen operation images, the video monitoring management module of the monitoring platform 120 records the monitoring images, the video fusion module of the monitoring platform 120 acquires the facial video data and the screen operation video data from the video conference service module, and acquires the monitoring video data from the video monitoring management module, so that the fusion of the facial video data, the screen operation video data and the monitoring video data is realized.
The target audio and video data can be displayed in real time in the bid evaluation process, or can be displayed as historical video data after the bid evaluation is finished, and the display is not limited in the application.
In the bid evaluation process, for example, when monitoring pictures of scattered different bid evaluation rooms need to be displayed, the monitoring pictures of the bid evaluation rooms can be accessed into a video conference in an interface configuration mode so as to meet the scene monitoring needs of the bid evaluation rooms.
Therefore, in the process of remotely evaluating the preset project by the evaluation expert, the supervision platform 120 can realize the comprehensive integrated monitoring of the facial video picture of the evaluation expert, the screen operation picture of the terminal equipment where the video conference evaluation tool 111 is located and the monitoring picture of the evaluation room where the evaluation expert is located, can perform real-time intelligent analysis on the pictures, and can perform intelligent early warning reminding when the evaluation expert is found to have abnormal behaviors, thereby intelligently supervising the evaluation process, timely finding and early stopping the abnormal behaviors, and in addition, can simultaneously monitor and look up the video according to the dimensionality of the evaluation expert or the dimensionality of the project, thereby realizing the controllability, the traceability and the legal and compliance of the evaluation process.
In the embodiment of the present application, the monitoring platform 120 not only has the functions of querying real-time video data, historical video data and intelligent early warning, but also can provide a display interface of a visual large-screen display and a virtual meeting room, so as to facilitate monitoring and viewing of the bid evaluation process of the bid evaluation expert by related personnel.
Additionally, referring to FIG. 2, the administration platform 120 may also interface integrally with a third party administration platform 140. The third party monitoring platform refers to a platform for monitoring third party services, for example, the third party monitoring platform may be a purchase monitoring platform for monitoring purchase transactions. The monitoring platform 120 may receive the third-party early warning information sent by the third-party monitoring platform 140 to perform centralized display and management on the third-party early warning information. The third-party early warning information sent by the purchasing supervision platform can include early warning information of abnormal conditions of third-party services, such as unpaid bidding security, incidence relation, abnormal operation, illegal distrust condition, proper punishment condition, proper bribery criminal behavior, overhigh similarity of bidding documents and the like.
In this embodiment, the monitoring platform 120 implements access to devices such as cameras of different manufacturers, NVRs (Network Video recorders), DVRs (Digital Video recorders), and the like through a unified customized system abstraction interface, and implements functions such as obtaining Real-Time streams and videos of monitoring devices, and performing parameter setting and remote control on the devices through Network Protocol modes such as SDK (Software Development Kit), RTMP (Real Time Messaging Protocol), ONVIF (open Network Video interface forum), GB28181 (national standard Protocol), RTSP (Real Time Streaming Protocol), and the like.
Referring to fig. 3, a bid evaluation method based on the intelligent remote bidding system is described by taking an interaction process among a project manager, a bid evaluation expert, a supervision platform and a bid monitoring person as an example. Fig. 3 is an interaction diagram of a project manager, a bid evaluation expert, a monitoring platform, and a bid monitoring person according to an embodiment of the present disclosure. The bidding supervising personnel may be, for example, a project manager, a discipline inspection department, a conference staff, or the like, who supervises the bid evaluation process.
Referring to fig. 3, after logging in the videoconference bidding tool 111 (step 301) and entering the project manager display interface of the preset project, the project manager can create a virtual meeting room by one key (step 302). When the current bid evaluation expert logs in the video conference bid evaluation tool 111 (step 303), the video conference bid evaluation tool 111 may first determine whether the face image of the current bid evaluation expert is collected in advance (step 304), and if the face image of the current bid evaluation expert is not collected, may prompt the current bid evaluation expert to collect the face image of the person who carries the current bid evaluation expert first, and collect the face image of the current bid evaluation expert (step 305). If the face image of the current bid evaluation expert is collected, face recognition can be performed on the current bid evaluation expert (step 306), and whether the current bid evaluation expert is the expert himself or herself is further judged (step 307). Specifically, the current face image of the current bid evaluation expert can be collected, the current face image is compared with the face image of the current bid evaluation expert collected in advance, if the current face image is not consistent with the face image of the current bid evaluation expert, the current bid evaluation expert is determined not to be the expert, and the current expert is not allowed to log in the video conference bid evaluation tool. If the current face image is consistent with the face image of the current bid evaluation expert collected in advance, the current bid evaluation expert can be determined to be the expert himself, so that the current bid evaluation expert is allowed to log in the video conference bid evaluation tool 111, that is, the current bid evaluation expert can successfully log in the video conference bid evaluation tool 111 (step 308). After the current bid evaluation expert successfully logs in the video conference bid evaluation tool 111 and enters the bid evaluation expert display interface of the preset project, the current bid evaluation expert can enter the virtual meeting room created by the project manager by one key (step 309), and can evaluate the bid of the preset project (step 310), and after the bid evaluation is finished, the video conference bid evaluation tool can be quitted (step 311).
After the current bid evaluation expert logs in the video conference bid evaluation tool 111, the monitoring platform 120 may determine the bid evaluation station and the bid evaluation room where the current bid evaluation expert is located, and call a monitoring picture of the bid evaluation room collected by a third camera installed in the bid evaluation room where the current bid evaluation expert is located. In addition, after the current bid evaluation expert enters the virtual meeting room, the video conference bid evaluation tool 111 may send the face video picture of the current bid evaluation expert, which is collected in real time by the first camera in the terminal device of the bid evaluation machine position where the bid evaluation expert is located or the second camera connected to the terminal device, and the screen operation picture, which is obtained by the video conference bid evaluation tool 111 collecting the display interface of the terminal device in real time, to the monitoring platform 120. Therefore, the supervision platform 120 can acquire the monitoring picture of the bidding evaluation room where the current bid evaluation expert is located (step 312), acquire the facial video picture and the screen operation picture of the current bid evaluation expert (step 313), and further record and fuse the three pictures respectively (step 314), so as to obtain target audio and video data.
In addition, in the process of evaluating the bid of the preset item by the current bid evaluation expert, the supervision platform 120 may perform intelligent analysis on the face video picture of the current bid evaluation expert (step 315), further determine whether the current bid evaluation expert is abnormal behaviors such as non-expert, off duty, intrusion of others into the current bid evaluation room (step 316), if not, continue to perform intelligent analysis on the face video picture of the current bid evaluation expert, and if the current bid evaluation expert is abnormal, may push early warning information to early warn the bid monitoring personnel through the supervision platform.
After receiving the early warning from the monitoring platform 120, the monitoring personnel can process the early warning in time (step 317), and when processing the early warning, the monitoring personnel can check the target audio/video data recorded and fused by the monitoring platform (step 318) to find the evidence that the current evaluation expert has abnormal behavior.
To sum up, the intelligent remote bid evaluation supervision system of the embodiment of the application can conveniently and safely enter the virtual meeting room through the video conference bid evaluation tool, remotely evaluate the preset project in the virtual meeting room, and intelligently supervise the bid evaluation process of the bid evaluation expert on the preset project by utilizing the supervision platform. The comprehensive integrated monitoring of the facial video pictures of the bid evaluation experts, the screen operation pictures of the terminal equipment where the video conference bid evaluation tool is located and the monitoring pictures of the bid evaluation room where the bid evaluation experts are located can be realized through the monitoring platform in the intelligent remote bid evaluation monitoring system, the pictures can be intelligently analyzed in real time, when abnormal behaviors of the bid evaluation experts are found, intelligent monitoring of the bid evaluation process is realized, the abnormal behaviors can be timely found and stopped early, in addition, three paths of video data of each bid evaluation expert can be simultaneously monitored and recorded according to the dimensionality or the dimensionality of a project, and therefore the whole bid evaluation process can be controlled, checked and traceable, and the legal bid evaluation and compliance are guaranteed.
Based on the intelligent remote bid evaluation monitoring system, the application provides an early warning method and device for abnormal behaviors of a bid evaluation expert in a remote bid evaluation video conference process, electronic equipment and a storage medium. The following describes an early warning method, an early warning device, electronic equipment and a storage medium for abnormal behaviors of a bid evaluation expert in a remote bid evaluation video conference process according to an embodiment of the present application with reference to the accompanying drawings.
Fig. 4 is a schematic flow chart of an early warning method for abnormal behavior of a bid evaluation expert in a remote bid evaluation video conference process according to an embodiment of the present application.
It should be noted that the method for early warning of abnormal behavior of bid evaluation experts in the process of remote bid evaluation video conference provided by the embodiment of the present application can be executed by an early warning device of abnormal behavior of bid evaluation experts in the process of remote bid evaluation video conference, hereinafter referred to as an abnormal behavior identification device, and the abnormal behavior identification device can be configured in an intelligent remote bid evaluation supervision platform, so as to automatically identify the abnormal behavior of bid evaluation experts in the process of remote bid evaluation and reduce the labor cost of manual monitoring.
As shown in fig. 4, the method for warning the abnormal behavior of the bid evaluation expert in the remote bid evaluation video conference process may include the following steps:
step 401, in the process that the bid evaluation expert remotely evaluates the bid of the preset project through the video conference bid evaluation tool, a facial video picture of the bid evaluation expert is obtained.
The preset items refer to items currently being evaluated by the evaluation expert.
The face video picture is acquired in real time in the bid evaluation process by a first camera installed in the terminal equipment or a second camera connected with the terminal equipment.
In the embodiment of the application, during the process that the bid evaluation expert remotely evaluates the bid of the preset project through the video conference bid evaluation tool, the video conference bid evaluation tool can determine the bid evaluation machine position where the bid evaluation expert is located, so that the first camera in the terminal equipment of the bid evaluation machine position where the bid evaluation expert is located or the second camera connected with the terminal equipment can acquire the face video picture of the bid evaluation expert in real time. After the video conference evaluation tool acquires the facial video pictures of the evaluation experts collected by the first camera or the second camera, the facial video pictures can be sent to the abnormal behavior identification device in real time, and correspondingly, in the process that the evaluation experts remotely evaluate the preset items through the video conference evaluation tool, the abnormal behavior identification device can acquire the facial video pictures of the evaluation experts in real time.
Step 402, performing face detection on the face video image to obtain a face detection result, wherein the face detection result includes whether the face video image contains a face.
In the embodiment of the application, after the abnormal behavior recognizing device acquires the face video picture, the face video picture can be input into a face detection model in the technical field of artificial intelligence, so that the face detection model is adopted to perform face detection on the face video picture. The face detection model can perform face and position coordinate regression of the face detection frame to obtain face classification scores and position coordinates of the face detection frame. The face two-classification score may be used to determine whether the face video frame includes a face, for example, when the face two-classification score is greater than a preset score threshold, it is determined that the face video frame includes a face, and when the face two-classification score is less than or equal to the preset score threshold, it is determined that the face video frame does not include a face. And the position coordinates of the face detection frame are used for representing the position of the face detection frame in the face video picture.
The face detection model can be any neural network model capable of realizing face detection, and the type of the face detection model is not limited in the application.
In the embodiment of the application, the abnormal behavior recognizing device can acquire the two face classification scores output by the face detection model, and compare the two face classification scores with the preset score threshold value to obtain the face detection result. When the face classification score is larger than a preset score threshold value, a face detection result containing a face in a face video picture can be obtained; and when the face two classification score is less than or equal to the preset score threshold value, determining that the face detection result of the face is not contained in the face video picture.
The preset score threshold may be arbitrarily set as required, for example, set to 0.8, 0.85, and the like, which is not limited in this application.
Step 403, performing human body detection on the face video picture to obtain a human body detection result, where the human body detection result includes whether the face video picture includes a human body part whose corresponding display ratio exceeds a preset ratio, and the display ratio is the ratio of the area where the human body part is located to the face video picture.
The human body part may include any body part of the human body, such as at least one of a head, a left hand, a right hand, a left leg, a right leg, a left foot, a right foot, an upper half of the body, a whole body, and the like. The upper body may be an upper body including a head or an upper body not including a head, and the present application is not limited thereto. The whole body may be a whole body including the head or a whole body not including the head, and the present application does not limit this.
The display scale is a scale in which the sum of the areas of the regions where all the human body parts included in the face video image are located occupies the area of the face video image.
In this embodiment of the application, the human body detection model may be trained in advance, the input of the human body detection model is an image, the position information of the detection frame to which each human body part belongs included in the image is output, and then after the face video picture of the bid evaluation expert is obtained, the face video picture may be input into the trained human body detection model, so as to perform human body detection on the face video picture by using the trained human body detection model, and obtain the position information of the detection frame to which each human body part belongs included in the face video picture. The position information of the detection frame to which the human body part belongs may include position coordinates of 4 corner points of the detection frame to which the human body part belongs. Further, the abnormal behavior recognizing device may specify the size of the detection frame to which each human body part belongs based on the position information of the detection frame to which each human body part belongs included in the face video picture output by the human body detection model, and may set the size of the detection frame to which each human body part belongs as the size of the region in which each human body part is located.
The abnormal behavior recognizing device may determine the sum of the areas of all the human body parts included in the face video picture according to the size of the region where each human body part is located after determining the size of the region where each human body part is located, and then determine the ratio of the sum of the areas to the area of the face video picture as the display ratio of all the human body parts.
Further, the abnormal behavior identification device can compare the display proportion of all human body parts with a preset proportion, when the display proportion of all human body parts is larger than the preset proportion, the human body parts with the corresponding display proportion exceeding the preset proportion in the face video picture can be determined, when the display proportion of all human body parts is not larger than the preset proportion, the human body parts with the corresponding display proportion exceeding the preset proportion in the face video picture can be determined, and therefore a human body detection result can be obtained.
The human body detection model can be any neural network model capable of realizing human body detection, and the type of the human body detection model is not limited in the application.
The human body detection model can be obtained by training an initial human body detection model in a deep learning mode by adopting preset training data, and the training process can refer to the related technology, which is not repeated in the application. Deep learning performs better on large data sets than other machine learning methods. The preset training data may include a plurality of sample images, and each sample image is labeled by using sample position information of a detection frame to which each human body part included in the sample image belongs. The sample position information may include position coordinates of 4 corner points of the detection frame to which each human body part included in the sample image belongs.
And step 404, judging whether the bid evaluation expert has abnormal behaviors in the bid evaluation process based on the face detection result and the human body detection result.
The judging whether the bid evaluation expert has abnormal behaviors in the bid evaluation process may include judging whether the bid evaluation expert has at least one of the following abnormal behaviors: the bid evaluation expert is not the expert, the bid evaluation expert leaves the post, and other people break into the bid evaluation room in which the bid evaluation expert is located, and when at least one of the abnormal behaviors exists in the bid evaluation expert, the abnormal behavior of the bid evaluation expert in the bid evaluation process can be determined.
The following describes a process of determining whether there is an abnormal behavior in which the evaluation expert is not an expert.
In this embodiment of the application, when the human detection result includes that the face video picture contains a face, the abnormal behavior determination device may further perform feature extraction on the face video picture to obtain a face feature in the face video picture, match the face feature with a known face feature of the bid evaluation expert to obtain a matching degree between the face feature and the known face feature, and determine whether the matching degree is greater than a preset threshold, when the matching degree is greater than the preset threshold, the bid evaluation expert may be determined as the expert, and when the matching degree is not greater than the preset threshold, the bid evaluation expert may be determined as not the expert.
The preset threshold may be set arbitrarily as required, for example, set to 80%, 90%, and the like, which is not limited in this application. The known face features of the bid evaluation experts are face features extracted from face images of the bid evaluation experts collected in advance.
In this embodiment, when the human body detection result includes that the face video picture does not include the human face, the abnormal behavior recognition device may determine whether the bidding evaluation expert is the expert himself or not by combining the human body detection result, when the human body detection result includes that the face video picture includes a human body part corresponding to a display ratio exceeding a preset ratio, it may be determined that the bidding evaluation expert is not the expert himself or not, and when the human body detection result includes that the face video picture does not include a human body part corresponding to a display ratio exceeding a preset ratio, it is not necessary to perform the determination whether the bidding evaluation expert is the expert himself or not.
The following describes a process of determining whether there is an abnormal behavior of the bid evaluation expert leaving the post.
In the embodiment of the application, the abnormal behavior recognizing device can judge whether the bid evaluation expert leaves the post or not by combining the human face detection result and the human body detection result. Specifically, when the face detection result includes that the face video picture does not contain the face and the human body detection result includes that the face video picture does not contain the human body part with the corresponding display ratio exceeding the preset ratio, the bid evaluation expert can be determined to be off duty, and in other cases, the bid evaluation expert can be determined to be on duty.
The following explains a process of judging whether there is an abnormal behavior of others intruding into the evaluation room where the evaluation expert is located.
In this embodiment of the application, when the face detection result includes that the face video picture contains a face, or the face detection result includes that the face video picture does not contain a face, if the human detection result includes that the face video picture contains a human body part corresponding to a display ratio exceeding a preset ratio, the abnormal behavior recognizing device may further determine whether each human body part belongs to the same human body according to position information of a detection frame to which each human body part belongs, the position information being output by the human body detection model. When the body parts belong to the same body, the condition that no other person enters the evaluation room where the evaluation expert is located can be determined; when the body parts of the people do not belong to the same body, the situation that other people enter the evaluation room where the evaluation expert is located can be determined. When the face detection result comprises that the face video picture contains the face, or the face detection result comprises that the face video picture does not contain the face, if the human body detection result comprises that the face video picture does not contain the human body part with the corresponding display proportion exceeding the preset proportion, the fact that no other person enters the evaluation room where the evaluation expert is located can be determined.
The abnormal behavior recognizing device may determine whether each of the body parts belongs to the same human body according to the position information of each of the body parts and the number of the position information of the same body part output by the human body detection model. Specifically, the number of the same type of human body parts included in the face video picture can be determined according to the number of the position information of the same human body parts included in the face video picture, and then whether the number of the same type of human body parts is larger than the number of the same type of human body parts included in a normal single human body or not is judged, and if yes, it can be determined that each human body part in the face video picture does not belong to the same human body. If not, the abnormal behavior affirming device can determine whether the areas of the human body parts are adjacent to each other according to the position information of the human body parts output by the human body recognition model. If the areas of the human body parts are not adjacent to each other, the human body parts are determined not to belong to the same human body. If the areas of the human body parts are adjacent in pairs, the human body parts can be determined to belong to the same human body.
That is, step 404 may specifically include:
when the face detection result comprises that a face is contained in a face video picture, and the matching degree between the face features corresponding to the face and the known face features of the bid evaluation expert is not greater than a preset threshold value, determining that the bid evaluation expert is not the expert;
when the human face detection result comprises that the face video picture does not contain the human face, and the human body detection result comprises that the human body part with the corresponding display proportion exceeding the preset proportion is contained in the face video picture, determining that the evaluation expert is not the expert;
when the face detection result comprises that the face video picture does not contain the face and the human body detection result comprises that the face video picture does not contain the human body part with the corresponding display proportion exceeding the preset proportion, determining that the bid evaluation expert leaves the post;
and when the human body detection result comprises that the human body part with the corresponding display proportion exceeding the preset proportion is contained in the face video picture and the human body part does not belong to the same human body, determining that other people enter the evaluation room where the evaluation expert is located.
And 405, outputting early warning information when abnormal behaviors exist in the bid evaluation process of the bid evaluation expert.
The early warning information comprises at least one of project information of preset projects, expert information of standard evaluation experts with abnormal behaviors, early warning content, early warning time and early warning evidence photographing. The early warning content may be, for example, that the bid evaluation expert is not the expert, that the bid evaluation expert leaves the post, that another person enters the bid evaluation room where the bid evaluation expert is located, or the like. The early warning evidence is photographed, for example, a screenshot of a facial video picture.
In addition, after the early warning information is output, the early warning information can be displayed through a visual large screen provided by the intelligent remote bid evaluation supervision platform.
To sum up, the method for early warning of abnormal behavior of a bid evaluation expert in a remote bid evaluation video conference process according to the embodiment of the present application obtains a face video picture of the bid evaluation expert and performs face detection on the face video picture to obtain a face detection result during the process of the bid evaluation expert performing remote bid evaluation on a preset item through a video conference bid evaluation tool, wherein the face detection result includes whether the face video picture contains a face or not, performs body detection on the face video picture to obtain a body detection result, wherein the body detection result includes whether the face video picture contains a body part with a display ratio exceeding a preset ratio or not, the display ratio is a ratio of the body part to the face video picture, and judges whether the bid evaluation expert has abnormal behavior in the bid evaluation process based on the face detection result and the body detection result, when the abnormal behavior exists in the bid evaluation process of the bid evaluation expert, the early warning information is output, the abnormal behavior of the bid evaluation expert is automatically determined in the remote bid evaluation process, and the labor cost of manual monitoring is reduced.
The embodiment of the method for warning the abnormal behavior of the bid evaluation expert in the remote bid evaluation video conference process provided in the embodiment of the present application is also applicable to the method for warning the abnormal behavior of the bid evaluation expert in the remote bid evaluation video conference process provided in the embodiment of the present application, and is not described in detail in the embodiment of the present application.
Fig. 5 is a schematic structural diagram of an early warning device for abnormal behavior of a bid evaluation expert in a remote bid evaluation video conference process according to an embodiment of the present application.
As shown in fig. 5, the apparatus 500 for warning an abnormal behavior of a bid evaluation expert during a remote bid evaluation video conference may include: an acquisition module 510, an identification module 520, a detection module 530, a determination module 540, and an output module 550.
The obtaining module 510 is configured to obtain a facial video picture of a bid evaluation expert during a process that the bid evaluation expert remotely evaluates a preset project through a video conference bid evaluation tool;
the recognition module 520 is configured to perform face detection on the face video image to obtain a face detection result, where the face detection result includes whether a face is included in the face video image;
a detecting module 530, configured to perform human body detection on the face video picture to obtain a human body detection result, where the human body detection result includes whether a human body part corresponding to a display ratio exceeding a preset ratio is included in the face video picture, and the display ratio is a ratio of an area where the human body part is located to the face video picture;
the judging module 540 is configured to judge whether an abnormal behavior exists in the bid evaluation process of the bid evaluation expert based on the face detection result and the human body detection result;
and the output module 550 is configured to output the early warning information when the bid evaluation expert has an abnormal behavior in the bid evaluation process.
As a possible implementation manner of the embodiment of the present application, the determining module is specifically configured to:
when the face detection result comprises that a face is contained in a face video picture, and the matching degree between the face features corresponding to the face and the known face features of the evaluation expert is not greater than a preset threshold value, determining that the evaluation expert is not an expert;
when the human face detection result comprises that the face video picture does not contain the human face, and the human body detection result comprises that the human body part with the corresponding display proportion exceeding the preset proportion is contained in the face video picture, determining that the evaluation expert is not the expert;
when the face detection result comprises that the face video picture does not contain the face and the human body detection result comprises that the face video picture does not contain the human body part with the corresponding display proportion exceeding the preset proportion, determining that the bid evaluation expert leaves the post;
and when the human body detection result comprises that the human body part with the corresponding display proportion exceeding the preset proportion is contained in the face video picture and the human body part does not belong to the same human body, determining that other people enter the evaluation room where the evaluation expert is located.
As a possible implementation manner of the embodiment of the application, the early warning information includes at least one of item information of a preset item, expert information of a bid evaluation expert with an abnormal behavior, early warning content, early warning time, and early warning evidence photographing.
As a possible implementation manner of the embodiment of the present application, the early warning device 500 for abnormal behavior of the bid evaluation expert in the process of remote bid evaluation video conference further includes:
and the display module is used for displaying the early warning information through the large visual screen.
The early warning device for the abnormal behavior of the bid evaluation expert in the remote bid evaluation video conference process of the embodiment of the application obtains the face video picture of the bid evaluation expert and detects the face of the face video picture to obtain the face detection result in the process that the bid evaluation expert remotely evaluates the preset project through the video conference bid evaluation tool, wherein the face detection result comprises whether the face video picture contains the face or not, and detects the face video picture to obtain the human body detection result, wherein the human body detection result comprises whether the face video picture contains the human body part with the corresponding display proportion exceeding the preset proportion, the display proportion is the proportion of the human body part in the face video picture, based on the face detection result and the human body detection result, whether the bid evaluation expert has the abnormal behavior in the bid evaluation process is judged, and when the bid evaluation expert has the abnormal behavior in the bid evaluation process, the early warning information is output, the abnormal behaviors of the bid evaluation experts are automatically identified in the remote bid evaluation process, and the labor cost of manual monitoring is reduced.
In order to implement the foregoing embodiments, the present application also provides an electronic device, which may include: the system comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein when the processor executes the program, the early warning method for the abnormal behavior of the bid evaluation expert in the process of the remote bid evaluation video conference is implemented as provided in the first aspect of the embodiments of the present application.
It should be noted that the explanation of the above embodiment of the warning method for the abnormal behavior of the bid evaluation expert in the remote bid evaluation video conference process, which is provided in the embodiment of the first aspect, is also applicable to the electronic device of this embodiment, and is not described herein again.
The electronic equipment of the embodiment of the application acquires a face video picture of a bid evaluation expert and performs face detection on the face video picture to obtain a face detection result in the process that the bid evaluation expert remotely evaluates preset items through a video conference bid evaluation tool, wherein the face detection result comprises whether the face video picture contains a face or not, the face video picture performs body detection on the face video picture to obtain a body detection result, the body detection result comprises whether the face video picture contains a body part with a corresponding display proportion exceeding a preset proportion or not, the display proportion is the proportion of an area where the body part is located in the face video picture, whether abnormal behaviors exist in the bid evaluation process of the bid evaluation expert is judged based on the face detection result and the body detection result, and when the abnormal behaviors exist in the bid evaluation process of the bid evaluation expert, early warning information is output, the automatic identification of the abnormal behaviors of the bid evaluation experts in the remote bid evaluation process is realized, and the labor cost of manual monitoring is reduced.
In order to achieve the above embodiments, the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the method for early warning of abnormal behavior of a bid evaluation expert in a remote bid evaluation video conference process as set forth in the foregoing first aspect of the present application.
In order to implement the foregoing embodiments, the present application further provides a computer program product, where the computer program product includes a computer program, and when the computer program is executed by a processor, the computer program implements the method for early warning of abnormal behavior of the bid evaluation expert in the remote bid evaluation video conference process proposed in the foregoing first aspect of the present application.
Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
As shown in fig. 6, the electronic device may include:
a memory 601, a processor 602, and a computer program stored on the memory 601 and executable on the processor 602.
When the processor 602 executes the program, the method for warning the abnormal behavior of the bid evaluation expert in the process of the remote bid evaluation video conference, which is provided in the embodiment shown in fig. 4, is implemented.
Further, the electronic device may further include:
a communication interface 603 for communication between the memory 601 and the processor 602.
The memory 601 is used for storing computer programs that can be run on the processor 602.
Memory 601 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.
The processor 602 is configured to implement the method for warning the abnormal behavior of the bid evaluation expert in the remote bid evaluation video conference process according to the embodiment shown in fig. 4 when executing the program.
If the memory 601, the processor 602 and the communication interface 603 are implemented independently, the communication interface 603, the memory 601 and the processor 602 may be connected to each other through a bus and perform communication with each other. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 6, but this is not intended to represent only one bus or type of bus.
Optionally, in a specific implementation, if the memory 601, the processor 602, and the communication interface 603 are integrated on a chip, the memory 601, the processor 602, and the communication interface 603 may complete mutual communication through an internal interface.
Processor 602 may be a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement embodiments of the present invention.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
The logic and/or steps represented in the flowcharts or otherwise described herein, such as an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Claims (10)

1. A method for early warning of abnormal behaviors of bid evaluation experts in a remote bid evaluation video conference process is characterized by comprising the following steps:
the method comprises the steps that in the process that an evaluation expert remotely evaluates a preset project through a video conference evaluation tool, a facial video picture of the evaluation expert is obtained;
performing face detection on the face video picture to obtain a face detection result, wherein the face detection result comprises whether the face video picture contains a face or not;
performing human body detection on the face video picture to obtain a human body detection result, wherein the human body detection result comprises whether a human body part with a corresponding display proportion exceeding a preset proportion is contained in the face video picture, and the display proportion is the proportion of an area where the human body part is located in the face video picture;
judging whether the bid evaluation expert has abnormal behaviors in the bid evaluation process based on the face detection result and the human body detection result;
and outputting early warning information when the bid evaluation expert has abnormal behaviors in the bid evaluation process.
2. The method according to claim 1, wherein the determining whether the bid evaluation expert has abnormal behavior in the bid evaluation process based on the human face detection result and the human body detection result comprises:
when the face detection result comprises that the face is contained in the face video picture, and the matching degree between the face features corresponding to the face and the known face features of the bid evaluation expert is not greater than a preset threshold value, determining that the bid evaluation expert is not an expert himself;
when the human face detection result comprises that the human face is not contained in the face video picture and the human body detection result comprises that the human body part with the corresponding display proportion exceeding the preset proportion is contained in the face video picture, determining that the evaluation expert is not an expert;
when the face detection result comprises that the face is not contained in the face video picture and the human body detection result comprises that the human body part with the corresponding display proportion exceeding the preset proportion is not contained in the face video picture, determining that the evaluation expert leaves the post;
and when the human body detection result comprises that the face video picture contains a human body part with a corresponding display proportion exceeding a preset proportion, and the human body part does not belong to the same human body, determining that other people enter a bidding evaluation room where the bidding evaluation expert is located.
3. The method according to claim 1 or 2, wherein the early warning information includes at least one of item information of the preset item, expert information of a bidding evaluation expert with abnormal behavior, early warning content, early warning time, and shooting of early warning evidence.
4. The method of claim 1 or 2, further comprising, after the outputting the warning information:
and displaying the early warning information through a visual large screen.
5. The utility model provides an early warning device of beaconing expert's unusual action in long-range beaconing video conference process which characterized in that includes:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring a facial video picture of an evaluation expert in the process of remotely evaluating a preset project by the evaluation expert through a video conference evaluation tool;
the identification module is used for carrying out face detection on the face video picture to obtain a face detection result, wherein the face detection result comprises whether the face video picture contains a face or not;
the detection module is used for carrying out human body detection on the face video picture to obtain a human body detection result, wherein the human body detection result comprises whether a human body part with a corresponding display proportion exceeding a preset proportion is contained in the face video picture, and the display proportion is the proportion of an area where the human body part is located in the face video picture;
the judging module is used for judging whether the bid evaluation expert has abnormal behaviors in the bid evaluation process based on the face detection result and the human body detection result;
and the output module is used for outputting early warning information when the bid evaluation expert has abnormal behaviors in the bid evaluation process.
6. The apparatus of claim 5, wherein the determining module is specifically configured to:
when the face detection result comprises that the face is contained in the face video picture, and the matching degree between the face features corresponding to the face and the known face features of the bid evaluation expert is not greater than a preset threshold value, determining that the bid evaluation expert is not an expert himself;
when the human face detection result comprises that the human face is not contained in the face video picture and the human body detection result comprises that the human body part with the corresponding display proportion exceeding the preset proportion is contained in the face video picture, determining that the evaluation expert is not an expert;
when the face detection result comprises that the face is not contained in the face video picture and the human body detection result comprises that the human body part with the corresponding display proportion exceeding the preset proportion is not contained in the face video picture, determining that the evaluation expert leaves the post;
and when the human body detection result comprises that the face video picture contains a human body part with a corresponding display proportion exceeding a preset proportion, and the human body part does not belong to the same human body, determining that other people enter a bidding evaluation room where the bidding evaluation expert is located.
7. The apparatus according to claim 5 or 6, wherein the warning information includes at least one of item information of the preset item, expert information of a bidding evaluation expert with abnormal behavior, warning content, warning time, and warning evidence photographing.
8. The apparatus of claim 5 or 6, further comprising:
and the display module is used for displaying the early warning information through a visual large screen.
9. An electronic device, characterized in that the electronic device comprises: a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor executes the program to perform the method for warning the abnormal behavior of the bid evaluation expert in the process of the remote bid evaluation video conference according to any one of claims 1 to 4.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements a method for warning an abnormal behavior of a bid evaluation expert during a remote bid evaluation video conference according to any one of claims 1 to 4.
CN202111590589.1A 2021-12-23 2021-12-23 Early warning method for abnormal behaviors of bid evaluation experts in remote bid evaluation video conference process Pending CN114494937A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111590589.1A CN114494937A (en) 2021-12-23 2021-12-23 Early warning method for abnormal behaviors of bid evaluation experts in remote bid evaluation video conference process

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111590589.1A CN114494937A (en) 2021-12-23 2021-12-23 Early warning method for abnormal behaviors of bid evaluation experts in remote bid evaluation video conference process

Publications (1)

Publication Number Publication Date
CN114494937A true CN114494937A (en) 2022-05-13

Family

ID=81494184

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111590589.1A Pending CN114494937A (en) 2021-12-23 2021-12-23 Early warning method for abnormal behaviors of bid evaluation experts in remote bid evaluation video conference process

Country Status (1)

Country Link
CN (1) CN114494937A (en)

Similar Documents

Publication Publication Date Title
CN109911732B (en) Monitoring method and system for elevator maintenance
CN108846922A (en) Cloud monitoring method, Cloud Server and computer readable storage medium
CN105957172A (en) Photograph attendance application system of intelligent photograph electrical screen
WO2024124970A1 (en) Monitoring apparatus and method for performing behavior recognition in complex environment
CN112507314A (en) Client identity verification method, device, electronic equipment and storage medium
CN112087603A (en) Intelligent examination room supervision method
CN114071060B (en) Intelligent remote comment supervision system
CN114429642A (en) Abnormal behavior identification method for bid evaluation expert in remote bid evaluation video conference process
WO2019134548A1 (en) Identity recognition method, apparatus and system
US20140012792A1 (en) Systems and methods for building a virtual social network
JP2015073191A (en) Image processing system and control method therefor
CN112989993A (en) Recording method, recording system, and computer-readable storage medium
CN114494937A (en) Early warning method for abnormal behaviors of bid evaluation experts in remote bid evaluation video conference process
CN114071062B (en) Video recording method and device in remote comment video conference process
CN114422744B (en) Video picture display method and device for remote comment video conference process
CN114071061B (en) Evaluation method and device for evaluation expert behavior in remote evaluation video conference process
CN114419666A (en) Abnormal behavior identification method for bid evaluation expert in remote bid evaluation video conference process
CN114095689B (en) Method and device for joining remote comment video conference
CN114071052B (en) Video streaming transmission method and supervision system in remote comment video conference process
CN114419696A (en) Abnormal behavior identification method for bid evaluation expert in remote bid evaluation video conference process
CN114419538A (en) Abnormal behavior identification method for bid evaluation expert in remote bid evaluation video conference process
TW202303399A (en) Equipment linkage method, equipment and computer-readable storage medium
CN115761614A (en) Abnormal behavior target detection system based on multi-view deep learning algorithm
CN113454643A (en) Object information association method, device, equipment and storage medium
Jayagopi Computational modeling of face-to-face social interaction using nonverbal behavioral cues

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination