CN112752051A - Intelligent recording device, control method and device thereof, and storage medium - Google Patents
Intelligent recording device, control method and device thereof, and storage medium Download PDFInfo
- Publication number
- CN112752051A CN112752051A CN202011632163.3A CN202011632163A CN112752051A CN 112752051 A CN112752051 A CN 112752051A CN 202011632163 A CN202011632163 A CN 202011632163A CN 112752051 A CN112752051 A CN 112752051A
- Authority
- CN
- China
- Prior art keywords
- display screen
- information
- display
- host module
- interview
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 238000012545 processing Methods 0.000 claims abstract description 34
- 230000014509 gene expression Effects 0.000 claims abstract description 21
- 238000012795 verification Methods 0.000 claims description 4
- 239000000463 material Substances 0.000 claims description 3
- 230000004044 response Effects 0.000 claims description 3
- 238000004590 computer program Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000001960 triggered effect Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 2
- 239000002131 composite material Substances 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/0008—General problems related to the reading of electronic memory record carriers, independent of its reading method, e.g. power transfer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/40—Spoof detection, e.g. liveness detection
- G06V40/45—Detection of the body part being alive
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/91—Television signal processing therefor
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an intelligent recording device and a control method, a device and a storage medium thereof, wherein the intelligent recording device comprises a first display screen, a second display screen, a plurality of acquisition instruments and a host module, wherein the host module acquires interview information acquired by each acquisition instrument, acquires a processing result of each interview information, controls the first display screen and the second display screen to synchronously display the same display content of a part, and controls the first display screen to display the processing result of each interview information. The invention can analyze the detailed information of the expression of the talked, the first display screen displays the processing result of each interview information, and the first display screen can remind the talker of keeping track of the detailed information of the expression of the talked and assist the talker to read the expression of the talked on site and in real time. The intelligent recording equipment has simple and compact structure, is convenient for a talker to carry, and the talker can use the recording equipment to carry out talking work in an outdoor environment. The invention is widely applied to the technical field of recording equipment.
Description
Technical Field
The invention relates to the technical field of recording equipment, in particular to intelligent recording equipment, a control method and a control device thereof and a storage medium.
Background
During interviews, conversations, etc., the talker presents information to the talked person, directs the talked person to speak or confirm the relevant information, and records the speech or other meaning of the talked person. In the prior art, communication between a talker and a talked person is performed through a spoken language or a body language, in order to achieve the talking purpose, the talker needs to interpret the spoken language or the body language of the talked person by subjective recognition, and because information which can be expressed by the spoken language or the body language is limited and misunderstanding easily occurs, the talker often needs to spend a large amount of work to perform interpretation work after the talking is finished, and manual interpretation and real-time interpretation in a non-talking site are easy to ignore detailed expressions of the talked person, so that the talking purpose is difficult to be achieved well.
Disclosure of Invention
In view of at least one of the above technical problems, an object of the present invention is to provide an intelligent recording device, a control method, an apparatus, and a storage medium thereof.
In one aspect, an embodiment of the present invention includes an intelligent recording device, including:
a first display screen; when the display screen is in a working state, the first display screen displays towards a first direction;
a second display screen; when the display screen is in a working state, the second display screen displays towards a second direction;
a plurality of collection instruments; the collecting instrument is used for collecting interview information to the viewers of the second display screen, and the forms of the interview information collected by at least part of the collecting instrument are different from each other;
a host module; the host module is connected with the first display screen through a first connecting structure, the host module is connected with the second display screen through a second connecting structure, and the host module is in signal connection with each acquisition instrument;
the host module is used for acquiring the interview information acquired by each acquisition instrument, acquiring a processing result of each interview information, controlling the first display screen and the second display screen to synchronously display the same display content of the parts, and controlling the first display screen to display the processing result of each interview information.
Further, the obtaining of the processing result of each piece of interview information includes:
respectively identifying the interview information in each form, and acquiring identification results corresponding to the interview information in each form;
according to each identification result, determining consistent information points and/or inconsistent information points; the consistent information points and/or the inconsistent information points are processing results of the interview information.
Further, the determining consistent information points and/or inconsistent information points according to each of the identification results includes:
determining that the interview information corresponding to each recognition result is acquired from the same time or time period, and performing semantic analysis on each recognition result respectively;
and when the difference degree between every two semantic analysis results of each identification result does not exceed a preset threshold value, determining the semantic analysis result of each identification result as the consistent information point, and otherwise, determining the semantic analysis result of each identification result as the inconsistent information point.
Further, the plurality of acquisition instruments comprises:
a camera; the camera is installed on the second display screen and used for acquiring head portrait information of a viewer of the second display screen;
a microphone; the microphone is arranged on the second display screen and used for acquiring voice information of a viewer of the second display screen;
a high shooting instrument; the high-speed shooting instrument is arranged on the host module and is used for acquiring image information of written materials;
the head portrait information, the voice information and the image information are the interview information.
Further, the obtaining of the processing result of each piece of interview information includes:
performing expression recognition on the head portrait information to obtain a first recognition result;
performing voice recognition on the voice information to obtain a second recognition result;
performing character recognition on the image information to obtain a third recognition result;
determining consistent information points and/or inconsistent information points according to the first recognition result, the second recognition result and the third recognition result; the consistent information points and/or the inconsistent information points are processing results of the interview information.
Further, the intelligent recording device further comprises:
a living body sensor; the living body sensor is arranged on the second display screen, is in signal connection with the host module and is used for acquiring living body information of a viewer of the second display screen and sending the living body information to the host module;
an infrared sensor; the infrared sensor is arranged on the second display screen, is in signal connection with the host module and is used for acquiring infrared identification information of a viewer of the second display screen and sending the infrared identification information to the host module;
an identity card reader; the identity card reader is arranged on the host module, is in signal connection with the host module and is used for acquiring identity card information of a viewer of the second display screen and sending the identity card information to the host module;
the host module is further used for verifying the identity of the viewer of the second display screen according to the living body information, the infrared identification information or the identity card information, triggering the control of the second display screen when the identity verification of the viewer of the second display screen passes, and not triggering or stopping the control of the second display screen when the identity verification of the viewer of the second display screen does not pass.
Further, the controlling the first display screen and the second display screen to synchronously display the same display content of the part and the first display screen to display the processing result of each piece of interview information includes:
controlling the first display screen to display basic display content and processing results of each interview information;
controlling the second display screen to display the basic display content;
the host module is further configured to obtain, through the first display screen, an editing operation of a viewer of the first display screen, and update the basic display content displayed on the first display screen and the basic display content displayed on the second display screen in response to the editing operation.
On the other hand, the embodiment of the present invention further includes a method for controlling an intelligent recording device, including:
when the first display screen is detected to face the first direction, controlling the first display screen to display;
when the second display screen is detected to face the second direction, controlling the second display screen to display; the first display screen and the second display screen synchronously display the same display content of the part;
collecting the interview information by at least one of the collection instruments;
and acquiring a processing result of each piece of interview information, and controlling the first display screen to display the processing result of each piece of interview information.
In another aspect, an embodiment of the present invention further includes a computer apparatus, including a memory and a processor, where the memory is used to store at least one program, and the processor is used to load the at least one program to execute the control method in the embodiment.
In another aspect, the present invention further includes a storage medium in which a program executable by a processor is stored, the program executable by the processor being configured to perform the control method in the embodiments when executed by the processor.
The invention has the beneficial effects that: according to the intelligent recording device in the embodiment, the plurality of collecting instruments are arranged to collect the interview information of the viewers on the second display screen, the host module obtains the processing result of each interview information to analyze the detailed information of the expression of the talked person, and the host module controls the first display screen to display the processing result of each interview information, so that the talker can be reminded of keeping track of the detailed information of the expression of the talked person, and the talker can be assisted to read the expression of the talked person on site in real time. The intelligent recording equipment in the embodiment has a simple and compact structure, is convenient for a talker to carry, and the talker can use the recording equipment in the embodiment to carry out talking work in an outdoor environment.
Drawings
Fig. 1, fig. 2, fig. 3, and fig. 4 are schematic structural diagrams of an intelligent recording device in an embodiment.
Detailed Description
In this embodiment, the structure of the intelligent recording device is as shown in fig. 1, fig. 2, fig. 3, and fig. 4, where fig. 1 is a schematic diagram of a recording device with a second display screen 200 viewed from the side, fig. 2 is a schematic diagram of a recording device with a first display screen 100 viewed from the side, fig. 3 is a schematic diagram of a recording device with one side viewed from the side, and fig. 4 is a schematic diagram of a recording device with the other side viewed from the side.
In this embodiment, referring to fig. 1, 2, 3, and 4, the recording apparatus includes a first display screen 100, a second display screen 200, a host module 300, a living body sensor 400, an infrared sensor 500, and an identification card reader 600. The host module 300 is a personal computer enclosed by a housing, the first display screen 100 is connected to one edge of the housing of the host module 300 by a first connection structure, and the second display screen 200 is connected to the other edge of the housing of the host module 300 by a second connection structure. In this embodiment, the first connection structure and the second connection structure are both hinges, so that the first display screen 100 and the second display screen 200 can be opened and closed on one side of the host module 300.
In the present embodiment, the living body sensor 400 is mounted on the second display screen 200, and the living body sensor 400 is in signal connection with the host module 300, specifically, the living body sensor 400 is connected with the data terminal of the CPU in the host module 300.
In this embodiment, the infrared sensor 500 is installed on the second display screen 200, the infrared sensor 500 is in signal connection with the host module 300, and specifically, the infrared sensor 500 is connected with the data terminal of the CPU in the host module 300.
In this embodiment, the identification card reader 600 is installed on the host module 300, the identification card reader 600 is in signal connection with the host module 300, and specifically, the identification card reader 600 is connected with a data terminal of a CPU in the host module 300.
In this embodiment, the intelligent recording device may be applied to interview, conversation, and other occasions, which all involve a talker and a talked person. For example, in interviews, a talker may be a reporter and a talked person may be an object being interviewed. In the intra-unit conversation, the talker may be a superior leader and the talked person may be an employee to be negotiated.
In this embodiment, when the recording device is used, the first display screen 100 is opened to form a certain angle with the surface of the housing of the host module 300, so that the first display screen 100 faces the first direction, the first display screen 100 enters the working state, the second display screen 200 is opened to form a certain angle with the surface of the housing of the host module 300, the second display screen 200 faces the second direction, and the second display screen 200 enters the working state. In the present embodiment, the first direction and the second direction are opposite directions.
In the present embodiment, when the recording apparatus is used, the first display screen 100 is directed to the talker and the second display screen 200 is directed to the talked, and the talker becomes the viewer of the first display screen 100 and the talked becomes the viewer of the second display screen 200.
In this embodiment, the host module 300 has a graphics processing capability, and is capable of generating graphics and controlling the first display screen 100 and the second display screen 200 to display the graphics. The first display screen 100 and the second display screen 200 are both display screens having a touch control function, a person can perform touch control on the first display screen 100 or the second display screen 200 by using a finger, the first display screen 100 or the second display screen 200 sends an acquired control instruction to the host module 300, and the host module 300 makes a corresponding response.
In this embodiment, when the first display screen 100 is opened to the position where the angle formed by the first display screen 100 and the surface of the housing of the host module 300 reaches the preset threshold, the host module 300 determines that the first display screen 100 enters the working state, and when the second display screen 200 is opened to the position where the angle formed by the second display screen 200 and the surface of the housing of the host module 300 reaches the preset threshold, the host module 300 determines that the second display screen 200 enters the working state. The host module 300 acquires the living body information of the viewer, i.e., the talked person, of the second display screen 200 through the living body sensor 400, acquires the infrared recognition information of the viewer, i.e., the talked person, of the second display screen 200 through the infrared sensor 500, and acquires the identification card information of the viewer, i.e., the talked person, of the second display screen 200 through the identification card reader 600. The host module 300 performs single or composite authentication on the person who is the person to be talked who is the viewer of the second display screen 200 according to the living body information, the infrared recognition information, and the identification card information, where the single authentication means authenticating the identity of the person to be talked according to one of the living body information, the infrared recognition information, and the identification card information, and the composite authentication means authenticating the identity of the person to be talked according to two or three of the living body information, the infrared recognition information, and the identification card information, and authentication performed on each information is considered to pass the authentication on the person to be talked.
For example, in the interviewing process, a reporter writes the identity information of the interviewed object into the host module 300 in advance, and only when the viewer of the second display screen 200 passes the identity authentication, the host module 300 is triggered to control the second display screen 200, so that the host module 300 controls the second display screen 200 to display the related content for the viewer of the second display screen 200 to view, otherwise the host module 300 is not triggered to control the second display screen 200 or stops the host module 300 from controlling the second display screen 200, and the second display screen 200 does not display the related content for the viewer of the second display screen 200 to view.
For example, during the internal conversation, the leader writes the identity information of the employee to be negotiated into the host module 300 in advance, and only when the viewer of the second display screen 200 passes the authentication, the control of the second display screen 200 by the host module 300 is triggered, so that the host module 300 controls the second display screen 200 to display the related content for the viewer of the second display screen 200 to view, otherwise the control of the second display screen 200 by the host module 300 is not triggered or the control of the second display screen 200 by the host module 300 is stopped, and the related content is not displayed by the second display screen 200 for the viewer of the second display screen 200 to view.
In this embodiment, the host module 300 can control the first display screen 100 and the second display screen 200 to display the same content. For example, a talker may edit a PPT file in advance, the PPT file includes a plurality of questions to be asked to the talker, the PPT file is played during the use of the recording device, the host module 300 controls the first display 100 and the second display 200 to display the playing content of the PPT file, the first display 100 and the second display 200 both display the playing content of the PPT file, the display contents of the two displays are different only in size or resolution, so that the talker can know the question asked by viewing the display content of the second display 200, and the talker can remember which question is asked by viewing the display content of the first display 100 to the talker.
In this embodiment, the host module 300 can control the first display screen 100 and the second display screen 200 to display different contents. Specifically, the host module 300 controls the first display screen 100 to display content including basic display content and first display content, and the host module 300 controls the second display screen 200 to display content including basic display content and second display content, that is, the first display screen 100 and the first display screen 100 both display basic display content, and the different content displayed by the first display screen 100 and the first display screen 100 is the first display content and the second display content. For example, the talker may edit a PPT file in advance, the PPT file includes a plurality of questions to be asked to the talked, the PPT file is played during the use of the recording device, the host module 300 synchronously displays the played content of the PPT file as the basic display content on the first display screen 100 and the second display screen 200, so that the talked can know the questions asked by viewing the basic display content displayed on the second display screen 200, and the talker can remember which question to the talked by viewing the basic display content displayed on the first display screen 100. The first display content that the host module 300 controls the first display screen 100 to display may be a question asking skill of a question in the current basic display content, thereby prompting the talker how to ask the question to the talked person. The second display content that the host module 300 controls the second display screen 200 to display may be the necessity or importance of a question in the current basic display content, thereby prompting the talker how to prepare to answer the question to the talker.
In this embodiment, the host module 300 may further obtain an editing operation of a talker through the first display screen 100, the talker may edit the basic display content on the first display screen 100 in a touch manner, the host module 300 updates the basic display content displayed on the first display screen 100 and the basic display content displayed on the second display screen 200 synchronously, and if the talker edits the first display content on the first display screen 100, the host module 300 updates only the first display content displayed on the first display screen 100 and does not update the second display content displayed on the second display screen 200 synchronously.
In this embodiment, the intelligent recording device includes a plurality of collecting instruments for collecting interview information to the viewer of the second display screen 200, and the forms of the interview information collected by each of the collecting instruments are different from each other. In this embodiment, referring to fig. 1, fig. 2, and fig. 3, the smart recording device includes three acquisition instruments, namely a camera 700, a microphone 800, and a high-speed shooting instrument 900, where the camera 700 is installed on the second display screen 200, the microphone 800 is installed on the second display screen 200, and the high-speed shooting instrument 900 is installed on the host module 300.
In this embodiment, the camera 700 acquires the head portrait information of the viewer on the second display screen 200, that is, the form of the interview information acquired by the camera 700 is the head portrait information. The microphone 800 acquires voice information of the viewer of the second display screen 200, that is, the microphone 800 acquires interview information in the form of voice information. The high-speed camera 900 acquires image information of written materials, that is, the interview information acquired by the high-speed camera 900 is in the form of image information.
When the intelligent recording device is used, the talker operates the intelligent recording device to display the question to be answered by the talker to the talked through the second display 200. The talked person may answer by speaking or writing, wherein the speech of the talked person is collected into voice information by the microphone 800, the answer of the talked person by writing on the paper is collected into image information by the high-speed camera 900, and the expression of the emotion of the talked person in the process of answering is collected into head image information by the camera 700.
In this embodiment, the host module 300 obtains interview information collected by the collecting instrument, and obtains a processing result of each interview information. Specifically, the host module 300 acquires interview information such as voice information, image information, and head portrait information acquired by the acquisition devices such as the camera 700, the microphone 800, and the high-speed shooting device 900, and acquires a processing result of the interview information. The host module 300 also controls the first display screen 100 to display the processing result of these interview information on the basis of controlling the first display screen 100 and the second display screen 200 to simultaneously display partially the same display contents, that is, the questions posed to the talker in the present embodiment.
In this embodiment, the process of the host module 300 obtaining the processing result of each interview information includes: the host module 300 performs voice recognition on voice information, performs character recognition on image information, and performs expression recognition on avatar information, and obtains a first recognition result, i.e., a recognition result on the voice information, a second recognition result, i.e., a recognition result on the image information, and a third recognition result, i.e., a recognition result on the avatar information. The recognition result of the voice information is characters converted according to contents expressed by the voice information, the recognition result of the image information is characters converted according to contents expressed by the image information, and the recognition result of the head portrait information is expression types converted according to expressions shown by the head portrait information.
In the present embodiment, in the case where the voice information, the image information, and the avatar information are collected from the same time or the same time period, it is indicated that the talked makes the above-mentioned speech, writing, and expression expressions at the same time or the same time period, and since the talked is thinking about the same problem at this time, there is an intrinsic relation between the speech, writing, and expression. In this embodiment, the host module 300 performs semantic analysis on the recognition result of the voice information, the recognition result of the image information, and the recognition result of the avatar information, respectively, that is, analyzes the semantics expressed by the voice information, the semantics expressed by the image information, and the semantics expressed by the avatar information, then determines the difference between any two of the semantics expressed by the voice information, the semantics expressed by the image information, and the semantics expressed by the avatar information, that is, the difference between the semantics expressed by the voice information and the semantics expressed by the image information, the difference between the semantics expressed by the voice information and the semantics expressed by the avatar information, and the difference between the semantics expressed by the image information and the semantics expressed by the avatar information, where the three differences do not exceed the preset threshold, it indicates that the semantics expressed by the talked person through the language, the body, and the expression are relatively consistent, the host module 300 determines the semantic analysis results thereof as consistent information points; in the case where one or more of the three degrees of dissimilarity exceeds a preset threshold, which indicates that the semantics expressed by the speech, the limbs and the expressions of the talked person are inconsistent, the host module 300 determines the semantic analysis result thereof as inconsistent information points.
In this embodiment, the host module 300 controls the first display screen 100 to display the consistent information points or the inconsistent information points. Since the host module 300 collects the voice information, the image information, and the avatar information in a plurality of time periods, each time period has a corresponding consistent information point or inconsistent information point, and the host module 300 can control the first display screen 100 to display the consistent information points or the inconsistent information points in a time sequence. When displaying inconsistent information points, the host module 300 may control the first display screen 100 to specifically display each semantic analysis result and the semantic analysis result farthest from other semantic analysis results.
In the intelligent recording device in this embodiment, a plurality of collecting instruments are arranged to collect interview information of the viewers on the second display screen, the host module obtains processing results of the interview information to analyze detailed information of the expression of the talked person, and the host module controls the first display screen to display the processing results of the interview information, so that the talker can be reminded of keeping track of the detailed information of the expression of the talked person, and the talker can be assisted to read the expression of the talked person on site in real time. The intelligent recording equipment in the embodiment has a simple and compact structure, is convenient for a talker to carry, and the talker can use the recording equipment in the embodiment to carry out talking work in an outdoor environment.
For the intelligent recording device in this embodiment, the following steps may be performed to perform control:
s1, when the first display screen is detected to face a first direction, controlling the first display screen to display;
s2, when the second display screen is detected to face a second direction, controlling the second display screen to display; the first display screen and the second display screen synchronously display the same display content of the part;
s3, collecting interview information through at least one collecting instrument;
and S4, acquiring the processing result of each interview information, and controlling a first display screen to display the processing result of each interview information.
The principle and effect of steps S1-S4 can refer to the relevant description part of the intelligent recording device in this embodiment. The intelligent recording apparatus in this embodiment may be implemented by writing a computer program that executes steps S1-S4, and writing the computer program into an embedded controller, which may serve as a core of a host module. The computer program may also be written in a storage medium, which may serve as a program memory of the host module, for the general-purpose processor to read out the computer program from the storage medium for execution, thereby implementing the intelligent recording device in the present embodiment.
It should be noted that, unless otherwise specified, when a feature is referred to as being "fixed" or "connected" to another feature, it may be directly fixed or connected to the other feature or indirectly fixed or connected to the other feature. Furthermore, the descriptions of upper, lower, left, right, etc. used in the present disclosure are only relative to the mutual positional relationship of the constituent parts of the present disclosure in the drawings. As used in this disclosure, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. In addition, unless defined otherwise, all technical and scientific terms used in this example have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in the description of the embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this embodiment, the term "and/or" includes any combination of one or more of the associated listed items.
It will be understood that, although the terms first, second, third, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element of the same type from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of the present disclosure. The use of any and all examples, or exemplary language ("e.g.," such as "or the like") provided with this embodiment is intended merely to better illuminate embodiments of the invention and does not pose a limitation on the scope of the invention unless otherwise claimed.
It should be recognized that embodiments of the present invention can be realized and implemented by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer readable memory. The methods may be implemented in a computer program using standard programming techniques, including a non-transitory computer-readable storage medium configured with the computer program, where the storage medium so configured causes a computer to operate in a specific and predefined manner, according to the methods and figures described in the detailed description. Each program may be implemented in a high level procedural or object oriented programming language to communicate with a computer system. However, the program(s) can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language. Furthermore, the program can be run on a programmed application specific integrated circuit for this purpose.
Further, operations of processes described in this embodiment can be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. The processes described in this embodiment (or variations and/or combinations thereof) may be performed under the control of one or more computer systems configured with executable instructions, and may be implemented as code (e.g., executable instructions, one or more computer programs, or one or more applications) collectively executed on one or more processors, by hardware, or combinations thereof. The computer program includes a plurality of instructions executable by one or more processors.
Further, the method may be implemented in any type of computing platform operatively connected to a suitable interface, including but not limited to a personal computer, mini computer, mainframe, workstation, networked or distributed computing environment, separate or integrated computer platform, or in communication with a charged particle tool or other imaging device, and the like. Aspects of the invention may be embodied in machine-readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, optically read and/or write storage medium, RAM, ROM, or the like, such that it may be read by a programmable computer, which when read by the storage medium or device, is operative to configure and operate the computer to perform the procedures described herein. Further, the machine-readable code, or portions thereof, may be transmitted over a wired or wireless network. The invention described in this embodiment includes these and other different types of non-transitory computer-readable storage media when such media include instructions or programs that implement the steps described above in conjunction with a microprocessor or other data processor. The invention also includes the computer itself when programmed according to the methods and techniques described herein.
A computer program can be applied to input data to perform the functions described in the present embodiment to convert the input data to generate output data that is stored to a non-volatile memory. The output information may also be applied to one or more output devices, such as a display. In a preferred embodiment of the invention, the transformed data represents physical and tangible objects, including particular visual depictions of physical and tangible objects produced on a display.
The above description is only a preferred embodiment of the present invention, and the present invention is not limited to the above embodiment, and any modifications, equivalent substitutions, improvements, etc. within the spirit and principle of the present invention should be included in the protection scope of the present invention as long as the technical effects of the present invention are achieved by the same means. The invention is capable of other modifications and variations in its technical solution and/or its implementation, within the scope of protection of the invention.
Claims (10)
1. An intelligent recording device, comprising:
a first display screen; when the display screen is in a working state, the first display screen displays towards a first direction;
a second display screen; when the display screen is in a working state, the second display screen displays towards a second direction;
a plurality of collection instruments; the collecting instrument is used for collecting interview information to the viewers of the second display screen, and the forms of the interview information collected by at least part of the collecting instrument are different from each other;
a host module; the host module is connected with the first display screen through a first connecting structure, the host module is connected with the second display screen through a second connecting structure, and the host module is in signal connection with each acquisition instrument;
the host module is used for acquiring the interview information acquired by each acquisition instrument, acquiring a processing result of each interview information, controlling the first display screen and the second display screen to synchronously display the same display content of the parts, and controlling the first display screen to display the processing result of each interview information.
2. The intelligent recording device according to claim 1, wherein the acquiring of the processing result of each piece of interview information includes:
respectively identifying the interview information in each form, and acquiring identification results corresponding to the interview information in each form;
according to each identification result, determining consistent information points and/or inconsistent information points; the consistent information points and/or the inconsistent information points are processing results of the interview information.
3. The intelligent recording device according to claim 2, wherein the determining consistent information points and/or inconsistent information points according to each of the recognition results comprises:
determining that the interview information corresponding to each recognition result is acquired from the same time or time period, and performing semantic analysis on each recognition result respectively;
and when the difference degree between every two semantic analysis results of each identification result does not exceed a preset threshold value, determining the semantic analysis result of each identification result as the consistent information point, and otherwise, determining the semantic analysis result of each identification result as the inconsistent information point.
4. The smart recording device of claim 2 or 3, wherein the plurality of collection instruments comprises:
a camera; the camera is installed on the second display screen and used for acquiring head portrait information of a viewer of the second display screen;
a microphone; the microphone is arranged on the second display screen and used for acquiring voice information of a viewer of the second display screen;
a high shooting instrument; the high-speed shooting instrument is arranged on the host module and is used for acquiring image information of written materials; the head portrait information, the voice information and the image information are the interview information.
5. The intelligent recording device according to claim 4, wherein the obtaining of the processing result of each piece of interview information includes:
performing expression recognition on the head portrait information to obtain a first recognition result;
performing voice recognition on the voice information to obtain a second recognition result;
performing character recognition on the image information to obtain a third recognition result;
determining consistent information points and/or inconsistent information points according to the first recognition result, the second recognition result and the third recognition result; the consistent information points and/or the inconsistent information points are processing results of the interview information.
6. The intelligent recording device according to any one of claims 1-3, further comprising:
a living body sensor; the living body sensor is arranged on the second display screen, is in signal connection with the host module and is used for acquiring living body information of a viewer of the second display screen and sending the living body information to the host module;
an infrared sensor; the infrared sensor is arranged on the second display screen, is in signal connection with the host module and is used for acquiring infrared identification information of a viewer of the second display screen and sending the infrared identification information to the host module;
an identity card reader; the identity card reader is arranged on the host module, is in signal connection with the host module and is used for acquiring identity card information of a viewer of the second display screen and sending the identity card information to the host module;
the host module is further used for verifying the identity of the viewer of the second display screen according to the living body information, the infrared identification information or the identity card information, triggering the control of the second display screen when the identity verification of the viewer of the second display screen passes, and not triggering or stopping the control of the second display screen when the identity verification of the viewer of the second display screen does not pass.
7. The intelligent recording device according to claim 1, wherein the controlling the first display screen and the second display screen to synchronously display the same display content, and the controlling the first display screen to display the processing result of each piece of interview information comprises:
controlling the first display screen to display basic display content and processing results of each interview information;
controlling the second display screen to display the basic display content;
the host module is further configured to obtain, through the first display screen, an editing operation of a viewer of the first display screen, and update the basic display content displayed on the first display screen and the basic display content displayed on the second display screen in response to the editing operation.
8. The method for controlling an intelligent recording apparatus according to any one of claims 1 to 7, comprising:
when the first display screen is detected to face the first direction, controlling the first display screen to display;
when the second display screen is detected to face the second direction, controlling the second display screen to display; the first display screen and the second display screen synchronously display the same display content of the part;
collecting the interview information by at least one of the collection instruments;
and acquiring a processing result of each piece of interview information, and controlling the first display screen to display the processing result of each piece of interview information.
9. A computer apparatus comprising a memory for storing at least one program and a processor for loading the at least one program to perform the control method of claim 8.
10. A storage medium in which a program executable by a processor is stored, wherein the program executable by the processor is used to perform the control method according to claim 8 when executed by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011632163.3A CN112752051A (en) | 2020-12-31 | 2020-12-31 | Intelligent recording device, control method and device thereof, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011632163.3A CN112752051A (en) | 2020-12-31 | 2020-12-31 | Intelligent recording device, control method and device thereof, and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112752051A true CN112752051A (en) | 2021-05-04 |
Family
ID=75650929
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011632163.3A Pending CN112752051A (en) | 2020-12-31 | 2020-12-31 | Intelligent recording device, control method and device thereof, and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112752051A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107222705A (en) * | 2017-05-27 | 2017-09-29 | 山东中磁视讯股份有限公司 | A kind of memcon system |
| CN110900624A (en) * | 2019-11-25 | 2020-03-24 | 广西秀牛科技有限公司 | Robot for assisting interview |
| CN111553189A (en) * | 2020-03-30 | 2020-08-18 | 深圳壹账通智能科技有限公司 | Data verification method and device based on video information and storage medium |
| CN111694937A (en) * | 2020-04-26 | 2020-09-22 | 平安科技（深圳）有限公司 | Interviewing method and device based on artificial intelligence, computer equipment and storage medium |
| CN112087309A (en) * | 2020-09-30 | 2020-12-15 | 公安部第一研究所 | Management and education conversation integrated terminal equipment |
-
2020
- 2020-12-31 CN CN202011632163.3A patent/CN112752051A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107222705A (en) * | 2017-05-27 | 2017-09-29 | 山东中磁视讯股份有限公司 | A kind of memcon system |
| CN110900624A (en) * | 2019-11-25 | 2020-03-24 | 广西秀牛科技有限公司 | Robot for assisting interview |
| CN111553189A (en) * | 2020-03-30 | 2020-08-18 | 深圳壹账通智能科技有限公司 | Data verification method and device based on video information and storage medium |
| CN111694937A (en) * | 2020-04-26 | 2020-09-22 | 平安科技（深圳）有限公司 | Interviewing method and device based on artificial intelligence, computer equipment and storage medium |
| CN112087309A (en) * | 2020-09-30 | 2020-12-15 | 公安部第一研究所 | Management and education conversation integrated terminal equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20190188903A1 (en) | Method and apparatus for providing virtual companion to a user | |
| CN112162628A (en) | Multi-mode interaction method, device and system based on virtual role, storage medium and terminal | |
| CN109634552A (en) | It is a kind of to enter for control method and terminal device applied to dictation | |
| EP2942698A1 (en) | Non-contact gesture control method, and electronic terminal device | |
| WO2016132729A1 (en) | Robot control device, robot, robot control method and program recording medium | |
| DE112014000441T5 (en) | Dynamic User Interactions for Display Control and Custom Gesture Interpretation | |
| CN111027486A (en) | Auxiliary analysis and evaluation system and method for big data of teaching effect of primary and secondary school classroom | |
| US20100271456A1 (en) | Conference details recording system | |
| CN103902029A (en) | Mobile terminal and unlocking method thereof | |
| JP2018032164A (en) | Interview system | |
| CN104965589A (en) | Human living body detection method and device based on human brain intelligence and man-machine interaction | |
| US20210271864A1 (en) | Applying multi-channel communication metrics and semantic analysis to human interaction data extraction | |
| CN115988164A (en) | Conference room multimedia control method, system and computer equipment | |
| CN112752051A (en) | Intelligent recording device, control method and device thereof, and storage medium | |
| CN111427456B (en) | Real-time interaction method, device and equipment based on holographic imaging and storage medium | |
| CN111261187B (en) | Method, system, device and storage medium for converting voice into lip shape | |
| JP6855737B2 (en) | Information processing equipment, evaluation systems and programs | |
| CN110673499A (en) | Audio-visual interaction system for intelligent robot and interaction control method thereof | |
| CN112732185B (en) | Recording apparatus, recording method, device and medium for executing multiple storage strategies | |
| KR20180074124A (en) | Method of controlling electronic device with face recognition and electronic device using the same | |
| Prange et al. | A categorisation and implementation of digital pen features for behaviour characterisation | |
| CN112748895A (en) | Dual-screen recording apparatus, control method and apparatus thereof, and storage medium | |
| CN113317629A (en) | Intelligent AI voice interactive desk | |
| CN111580653A (en) | Intelligent interaction method and intelligent interactive desk | |
| CN109710131A (en) | A kind of information control method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |