CN109343761B - Data processing method based on intelligent interaction equipment and related equipment - Google Patents

Data processing method based on intelligent interaction equipment and related equipment Download PDF

Info

Publication number
CN109343761B
CN109343761B CN201811442939.8A CN201811442939A CN109343761B CN 109343761 B CN109343761 B CN 109343761B CN 201811442939 A CN201811442939 A CN 201811442939A CN 109343761 B CN109343761 B CN 109343761B
Authority
CN
China
Prior art keywords
page
recording
data
uploading
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811442939.8A
Other languages
Chinese (zh)
Other versions
CN109343761A (en
Inventor
丁琛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shirui Electronics Co Ltd
Original Assignee
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shirui Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Shiyuan Electronics Thecnology Co Ltd, Guangzhou Shirui Electronics Co Ltd filed Critical Guangzhou Shiyuan Electronics Thecnology Co Ltd
Priority to CN201811442939.8A priority Critical patent/CN109343761B/en
Publication of CN109343761A publication Critical patent/CN109343761A/en
Application granted granted Critical
Publication of CN109343761B publication Critical patent/CN109343761B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]

Abstract

The invention discloses a data processing method based on intelligent interaction equipment and related equipment, and relates to the field of interactive intelligent panels, wherein the method comprises the following steps: receiving page turning operation; when the intelligent interaction equipment is in a recording state, detecting whether the page identification of the operation page is the same as the preset recording page identification; when the page identification of the operation page is different from the recorded page identification, recording according to the page identification of the operation page to obtain page recorded data corresponding to page turning operation; and uploading the page record data to a server, wherein the server is used for generating recording fragment data corresponding to the operation page according to the page record data. According to the invention, the recording fragment data corresponding to the operation page is generated by the server, so that the problem of large screen recording files caused by complete screen recording of the operation performed on the interactive intelligent panel in the prior art is avoided, the data transmission quantity uploaded each time can be reduced, and the network sharing efficiency is improved.

Description

Data processing method based on intelligent interaction equipment and related equipment
Technical Field
The invention relates to the field of interactive intelligent panels, in particular to a data processing method based on intelligent interactive equipment and related equipment.
Background
With the rapid development of computer network technology, intelligent interaction devices such as smart phones, tablet computers and interactive smart tablets are increasingly popularized, and great convenience is brought to life, study and work of people.
The intelligent interaction equipment is widely applied to the fields of education and teaching, enterprise meetings, commercial exhibition and the like, and can effectively improve the communication environment and improve the group communication efficiency. For example, the interactive intelligent tablet can form a complete set of solution with equipment such as a center console, a camera and a terminal computer, and a new intelligent teaching era is built together, so that a teacher can give lessons through the interactive intelligent tablet, and the classroom interactivity is enhanced. In the course of giving lessons to teachers, the operation of the teachers on the interactive intelligent tablet can be completely recorded through software installed in the interactive intelligent tablet, and screen recording files are obtained, so that the teaching contents of the teachers can be managed, reviewed, shared and the like based on the screen recording files in the following process. At present, a screen recording file is usually shared in a network sharing manner, that is, the screen recording file is uploaded to a network server for storage as needed, so that a user can obtain recording content information contained in the screen recording file from the network server. However, the efficiency of uploading the screen recording file is limited by the network bandwidth, and if the file size of the screen recording file is large and the network bandwidth is small, the problem of uploading failure of the screen recording file may occur, which affects the sharing efficiency.
Disclosure of Invention
In view of this, embodiments of the present invention provide a data processing method, an apparatus, a device, a data processing platform and a storage medium based on an intelligent interactive device, so as to improve sharing efficiency.
In a first aspect, an embodiment of the present invention provides a data processing method based on an intelligent interactive device, including: receiving page turning operation, wherein the page turning operation is submitted aiming at an operation page displayed by the intelligent interaction equipment; when the intelligent interaction equipment is in a recording state, detecting whether a page identifier of the operation page is the same as a preset recording page identifier or not, wherein the recording page identifier is a page identifier recorded last time; when the page identification of the operation page is different from the recording page identification, recording according to the page identification of the operation page to obtain page recording data corresponding to the page turning operation; and uploading the page record data to a server, wherein the server is used for generating record fragment data corresponding to the operation page according to the page record data.
Optionally, the method further comprises: receiving a sound recording triggering operation of a target application program, wherein the target application program is an application program used for displaying the operation page in the intelligent interaction equipment; triggering the intelligent interaction equipment to enter a recording state according to the recording triggering operation; recording audio data in the recording state; processing the audio data according to preset recording configuration data to obtain recording data; generating a recording file corresponding to the recording data according to the recording data and the recording fragment identification corresponding to the recording data; and uploading the sound recording file to the server, wherein the sound recording file is used for triggering the server to generate the recording fragment data.
Optionally, before generating the recording file corresponding to the recording data according to the recording data and the recording segment identifier corresponding to the recording data, the method further includes: when the intelligent interaction equipment stores the recording segment identification, directly acquiring the recording segment identification; when the intelligent interaction equipment does not store the recording segment identification, sending a recording segment creating request to the server, and receiving the recording segment identification sent by the server, wherein the recording segment identification is determined by the server according to the recording segment creating request.
Optionally, before uploading the sound recording file to the server, the method further includes: sending an upload application request to the server; and receiving an application success message. Wherein, the uploading the sound recording file to the server includes: and uploading the sound recording file based on the application success message.
Optionally, before uploading the sound recording file, the method further includes: and determining a recording and uploading mode. Wherein, the uploading the sound recording file comprises: and uploading the recording file according to the recording uploading mode.
Optionally, the determining a recording uploading manner includes: monitoring user uploading operation; when the user uploading operation cannot be monitored, determining the recording uploading mode as a silent uploading mode; and when the user uploading operation is monitored, determining the recording uploading mode as the user uploading mode.
Optionally, the method further includes: acquiring audio recording configuration data from the server; detecting whether the audio recording configuration data meet preset effective conditions or not; if the audio recording configuration data meet the preset effective conditions, determining the audio recording configuration data as the recording configuration data; and if the audio recording configuration data do not accord with the preset effective condition, acquiring local recording configuration data, and determining the local recording configuration data as the recording configuration data.
Optionally, the method further includes: if the uploading of the recording file fails, generating recording uploading failure prompt information; if the recording file is uploaded successfully, the step of uploading the page record data to a server corresponding to the intelligent interaction equipment is executed; and generating uploading failure prompt information when the uploading of the page record data fails.
Optionally, before the recording according to the page identifier of the operation page, the method further includes: determining display residence time corresponding to the operation page, wherein the operation page comprises a courseware page; if the display residence time exceeds a preset time threshold, executing the step of recording according to the page identifier of the operation page, wherein the page identifier comprises: courseware page numbers.
In a second aspect, an embodiment of the present invention further provides a data processing method based on an intelligent interaction device, including:
acquiring recording fragment data corresponding to a display page, wherein the recording fragment data is generated by a server according to page recording data uploaded by intelligent interaction equipment, and the page recording data is obtained by recording according to a page identifier of an operation page after the intelligent interaction equipment receives page turning operation;
carrying out audio playing according to the recording segment data, and detecting whether the recording segment data contains target page recording data corresponding to the display page;
and if the recording fragment data comprises the target page recording data, executing page turning operation according to the target time point corresponding to the target page recording data, and displaying the page after page turning.
Optionally, the method further comprises: receiving comment triggering operation; acquiring user input information according to the comment triggering operation; and displaying the recorded comment information corresponding to the page according to the user input information.
Optionally, after receiving the comment triggering operation, the method further includes: pausing audio playing aiming at the comment triggering operation; acquiring a page playing time point corresponding to the display page, wherein the display page comprises a courseware page; establishing an association relation between the recording comment information and the recording segment data based on the page playing time point; and storing the recorded comment information based on the incidence relation.
In a third aspect, an embodiment of the present invention further provides a data processing apparatus based on an intelligent interactive device, including:
the page turning operation receiving module is used for receiving page turning operation, and the page turning operation is submitted aiming at an operation page displayed by the intelligent interaction equipment;
the page detection module is used for detecting whether the page identifier of the operation page is the same as a preset recording page identifier when the intelligent interaction equipment is in a recording state, wherein the recording page identifier is a page identifier recorded last time;
the page recording module is used for recording according to the page identifier of the operation page when the page identifier of the operation page is different from the recorded page identifier to obtain page recording data corresponding to the page turning operation;
and the page record data uploading module is used for uploading the page record data to a server, wherein the server is used for generating the record fragment data corresponding to the operation page according to the page record data.
In a fourth aspect, an embodiment of the present invention further provides a data processing apparatus based on an intelligent interactive device, including:
the data acquisition module is used for acquiring recording fragment data corresponding to a display page, wherein the recording fragment data is generated by a server according to page recording data uploaded by intelligent interaction equipment, and the page recording data is obtained by recording according to a page identifier of an operation page after the intelligent interaction equipment receives page turning operation;
the audio playing module is used for playing audio according to the recording fragment data;
the page recorded data detection module is used for detecting whether the recorded fragment data contains target page recorded data corresponding to the display page or not;
and the page turning display module is used for executing page turning operation according to a target time point corresponding to the target page record data when the record fragment data contains the target page record data, and displaying a page after page turning.
In a fifth aspect, an embodiment of the present invention further provides an intelligent interaction device, including: the touch screen comprises a memory, a display screen with a touch function and one or more processors; the memory for storing one or more programs; when executed by the one or more processors, cause the one or more processors to perform operations comprising: receiving page turning operation; based on the page turning operation, the page turning operation is submitted aiming at an operation page displayed by the intelligent interaction equipment; when the intelligent interaction equipment is in a recording state, detecting whether a page identifier of the operation page is the same as a preset recording page identifier or not, wherein the recording page identifier is a page identifier recorded last time; when the page identification of the operation page is different from the recording page identification, recording according to the page identification of the operation page to obtain page recording data corresponding to the page turning operation; and uploading the page record data to a server, wherein the server is used for generating record fragment data corresponding to the operation page according to the page record data.
In a sixth aspect, an embodiment of the present invention further provides a data processing platform, including: a processor and a display; wherein the display is coupled to the processor;
the processor acquires recording segment data corresponding to a display page, performs audio playing according to the recording segment data, and detects whether the recording segment data contains target page recording data corresponding to the display page; if the recording fragment data comprises the target page recording data, executing page turning operation according to a target time point corresponding to the target page recording data, and triggering the display to display a page after page turning;
the recording fragment data is generated by a server according to page recording data uploaded by intelligent interaction equipment, and the page recording data is obtained by recording according to a page identifier of an operation page after the intelligent interaction equipment receives page turning operation.
In a seventh aspect, an embodiment of the present invention further provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the data processing method based on an intelligent interactive device according to the first aspect.
When the page turning operation is received and the intelligent interactive device is in the recording state, whether the recording is needed according to the page identification of the operation page can be determined by detecting whether the page identification of the operation page is the same as the page identification recorded last time, so that the problem that the recorded page recorded data carries redundant data when the page identification of the operation page is the same as the page identification recorded last time is solved, the page recorded data corresponding to the page turning operation is obtained by recording when the page identification of the operation page is different from the page identification recorded last time, and then the page recorded data can be uploaded to a server so as to generate the recorded fragment data corresponding to the operation page through the server, thereby avoiding the problem that the recorded screen file is large because the operation on the interactive intelligent panel is completely recorded in the prior art, the data transmission quantity of each uploading is reduced, namely the transmission time of each uploading can be shortened, so that the problem that the uploading of the recorded content fails due to the fact that the uploading time of the recorded content exceeds the preset network transmission time threshold can be solved, and the network sharing efficiency is improved.
In addition, after the recording segment data corresponding to the display page is acquired, the audio playing can be performed according to the recording segment data, so that a user can review the recording recorded on the display page; and when the recorded fragment data comprises target page recorded data corresponding to the display page, page turning operation is performed on the display page according to the target time point corresponding to the target page recorded data, so that a user can look up the page after page turning, network sharing is realized, the data volume required to be transmitted by network sharing is reduced, and network sharing efficiency is improved.
Drawings
FIG. 1 is a flowchart illustrating steps of a data processing method based on an intelligent interactive device according to an embodiment of the present invention;
FIG. 2 is a schematic illustration of uploading a sound recording file in a silent upload mode in an alternative example of the present invention;
FIG. 3 is a schematic illustration of an upload based on a user upload operation in another alternative example of the present invention;
FIG. 4 is a flow chart of steps of another data processing method based on an intelligent interactive device in the embodiment of the present invention;
FIG. 5 is a block diagram of a data processing apparatus based on an intelligent interactive device in an embodiment of the present invention;
FIG. 6 is a schematic structural diagram of an intelligent interaction device in an embodiment of the present invention;
FIG. 7 is a block diagram of another data processing apparatus based on an intelligent interactive device according to an embodiment of the present invention;
fig. 8 is a schematic diagram of a hardware structure of a data processing platform according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
The data processing method based on the intelligent interaction equipment provided by the embodiment of the invention can be executed by the intelligent interaction equipment and can also be executed by software installed in the intelligent interaction equipment. The intelligent interaction device can be an integrated device which controls the content displayed on the display panel through a touch technology and realizes man-machine interaction operation, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound box, a television, a video conference terminal and the like.
In the embodiment, the intelligent interaction device can be integrated with a plurality of technologies such as man-machine interaction, flat panel display, multimedia information processing and network transmission, and can realize functions such as writing, annotation, multimedia entertainment, network conference and the like through corresponding software cooperation. Optionally, the hardware part of the intelligent interaction device may be composed of three major parts, namely a touch positioning recognition system, a display system, an intelligent processing system, and the like, and may also be supported by a dedicated software system. When a user touches the screen with a finger or a passive pen, the touch system positions the coordinates of the point, so that the control of the intelligent processing system is realized, and then different functional applications are realized through software built in the intelligent processing system. For example, in the course of giving lessons by using the intelligent interaction device, a teacher records the lessons by using the recording device connected with the intelligent interaction device, and can trigger the intelligent interaction device to execute a page turning operation by inputting the page turning operation to the intelligent interaction device, so as to realize page turning of courseware, and further give lessons continuously based on the page displayed after the page turning of the intelligent interaction device.
Referring to fig. 1, a flowchart illustrating steps of a data processing method based on an intelligent interaction device in the embodiment of the present invention is shown, which may specifically include the following steps:
step 110, receiving a page turning operation, wherein the page turning operation is submitted aiming at an operation page displayed by the intelligent interaction device.
In an embodiment of the present invention, the page turning operation may include a user operation for triggering the intelligent interactive device to turn a page. For example, when a user needs to turn pages, the user may input a page turning operation to the intelligent interaction device to trigger the intelligent interaction device to execute the page turning operation, so that the intelligent interaction device displays the page after page turning. The page turning operation may be a touch operation submitted by a user on the intelligent interaction device based on a page turning operation requirement, or a mouse operation, a touchpad operation, a click operation, and the like input by the user on the intelligent interaction device based on the page turning operation requirement, which is not particularly limited in the embodiment of the present invention.
In a specific implementation, after the intelligent interaction device receives the page turning operation, the embodiment of the invention can determine whether the intelligent interaction device needs to record the page turning operation received by the intelligent interaction device by detecting whether the intelligent interaction device is in a recording state. If the intelligent interaction device is detected to be in the non-recording state, if the intelligent interaction device is in the recording pause state, it can be determined that the page turning operation received by the intelligent interaction device does not need to be recorded. If it is detected that the intelligent interactive device is in the recording state, it may be determined that the intelligent interactive device is recording, and then step 120 is performed.
And step 120, when the intelligent interaction device is in a recording state, detecting whether the page identifier of the operation page is the same as a preset recording page identifier, wherein the recording page identifier is a page identifier recorded last time.
Specifically, when detecting that the intelligent interactive device is in the recording state, the embodiment of the present invention may acquire the page identifier of the currently displayed operation page with respect to the currently received page turning operation, and then may compare the page identifier of the operation page with the page identifier recorded last time to determine whether the page identifier of the operation page is the same as the preset recording page identifier. If the page identifier of the operation page is the same as the preset recording page identifier, that is, when the page identifier of the operation page is the same as the page identifier recorded last time, it may be determined that recording is not required according to the page identifier of the operation page, so as to avoid recording redundant data, thereby saving network resources occupied by uploading the redundant data. If the page identifier of the operation page is different from the preset recorded page identifier, that is, if the page identifier of the operation page is different from the last recorded page identifier, step 130 may be executed to generate page record data corresponding to the page turning operation according to the page identifier of the operation page.
As an example of the present invention, after the intelligent interaction device displays an operation page of a courseware on a display screen, the intelligent interaction device may receive a page turning operation submitted by a user on the operation page, and may determine whether the current operation page is in a recording state for the currently received page turning operation, so as to determine whether a page identifier of the currently displayed operation page is the same as a page identifier recorded last time in the recording state, for example, in the recording state, a page identifier of the currently displayed operation page and a recorded page identifier (i.e., a page identifier recorded last time) are obtained for the currently received page turning operation, and then the page identifier of the operation page may be compared with the obtained recorded page identifier to determine whether the currently displayed operation page is the same as the operation page recorded last time. If the currently displayed operation page is the same as the last recorded operation page, it may be determined that the currently received page turning operation does not need to be recorded, for example, the currently received page turning operation may be determined as an incorrect operation, or the page turning operation may be ignored, and the page turning operation may not be recorded. If the currently displayed operation page is not the same as the last recorded operation page, step 130 may be executed to record the received page turning operation based on the page identifier of the operation page displayed by the intelligent interactive device. The last recorded page identifier may refer to a last recorded page identifier of the operation page.
Step 130, when the page identifier of the operation page is different from the record page identifier, recording according to the page identifier of the operation page to obtain page record data corresponding to the page turning operation.
Specifically, the page turning operation can be recorded based on the page identifier of the operation page displayed on the intelligent interaction device, so as to generate page record data corresponding to the page turning operation. The page record data may include various data related to the operation page, such as dotting time data, page dotting data, thumbnail data corresponding to the operation page, and the like, recorded for page turning operation; the dotting time data can determine the time for recording the operation page, such as the time point for recording by adopting a dotting mode, the display time of the operation page and the like; the page dotting data can be used for determining operation pages related to the record, such as operation pages displayed before page turning of the intelligent interactive device, operation pages displayed after page turning of the intelligent interactive device and the like; the thumbnail data may be used to represent thumbnails of the operation page, such as when the operation page is a courseware page, the thumbnail data may be used to characterize thumbnails of courseware pages, and so on.
Step 140, uploading the page record data to a server, wherein the server is configured to generate the record fragment data corresponding to the operation page according to the page record data.
After the page record data is obtained, the page record data can be uploaded to a server corresponding to the intelligent interaction device, so that the server can generate recording segment data corresponding to the operation page according to the page record data uploaded by the intelligent interaction device, and audio playing and page displaying can be performed according to the recording segment data. Wherein the recording section data may include: recording segment identification, page recording data, data contained in a recording file uploaded by the intelligent interaction equipment, and the like. Note that, recording segment Identification (ID) may be used to identify recording segment data, for example, in a case where generated recording segment data is stored in a time capsule, a time capsule ID may be used as the recording segment ID to identify recording segment data stored in the same time capsule using the time capsule ID.
To sum up, after receiving a page turning operation submitted by an operation page displayed by an intelligent interaction device, and the intelligent interaction device is in a recording state, whether the received page turning operation needs to be recorded according to the page identifier of the operation page can be determined by detecting whether the page identifier of the operation page is the same as the page identifier recorded last time, so that recording can be performed when the page identifier of the operation page is different from the page identifier recorded last time, page recorded data corresponding to the page turning operation is obtained, and the problem that the recorded page recorded data carries redundant data due to the fact that recording is performed when the page identifier of the operation page is the same as the page identifier recorded last time is solved; the page recorded data can be uploaded to a server, so that recorded fragment data corresponding to the operation page can be generated through the server, the problem that in the prior art, a screen recording file is large due to the fact that the screen is completely recorded in the operation of the interactive intelligent tablet is solved, the data transmission quantity of each uploading is reduced, the transmission time of each uploading can be shortened, and the problem that the uploading time of the recorded content exceeds the preset network transmission time threshold value to cause the uploading failure of the recorded content can be solved. Therefore, the embodiment of the invention generates the recording segment data corresponding to the operation page through the server, avoids the problem that the uploading of the screen recording file fails due to the fact that the screen recording file generated by the intelligent interaction device is too large in the prior art, namely, network sharing corresponding to the page operation data recorded by the intelligent interaction device in the recording state is realized based on the recording segment data, the data transmission quantity of the network sharing is reduced, and the network sharing efficiency is improved.
It should be noted that the intelligent interaction device in the embodiment of the present invention may be connected to a server through a network, so that data transmission may be performed with the server based on the network connection, such as uploading a recording file, page record data, and the like. In addition, the intelligent interactive apparatus may establish a data connection with at least one external device. The external devices may include, but are not limited to: recording devices, mobile phones, notebook computers, Universal Serial Bus (USB) flash drives, tablet computers, desktop computers, and the like. The embodiment of the communication mode of the data connection between the external device and the intelligent interaction device is not limited, for example, the communication mode may be a USB connection, an internet, a local area network, a bluetooth, a Wi-Fi protocol (Wi-Fi), a ZigBee protocol (ZigBee), or the like.
In the use process of the intelligent interaction equipment, if a user needs to record, the intelligent interaction equipment can be triggered to enter a recording state by clicking an entry of the recording. After the intelligent interaction device enters the recording state, audio recording, namely recording audio data, can be performed through the built-in recording device and/or the recording device connected in the intelligent interaction device.
In an optional embodiment of the present invention, the data processing method based on the intelligent interactive device may further include: receiving a sound recording triggering operation of a target application program, wherein the target application program is an application program used for displaying the operation page in the intelligent interaction equipment; and triggering the intelligent interaction equipment to enter a recording state according to the recording triggering operation so as to record audio data in the recording state. The recording triggering operation may refer to an operation of triggering a recording function of the intelligent interactive device, for example, a recording operation submitted by a user on the intelligent interactive device, or an operation of clicking a software recording entry displayed on the intelligent interactive device by the user, and the like.
For example, after a user starts whiteboard software installed in the intelligent interactive device, it may be determined whether the user logs in an account registered in the whiteboard software; if the user logs in the account registered in the whiteboard software, whether the user starts the recording function can be detected based on account information corresponding to the logged-in account, so that whether the user opens the synchronized courseware or not is determined on the premise that the user starts the recording function. In other words, on the premise that the user logs in the account of the whiteboard software, the information whether the current user starts the recording function may be acquired from a management platform corresponding to the whiteboard software in a HyperText Transfer Protocol (HTTP) request manner. The management platform may be a data processing platform based on an intelligent interactive device, and may include a data management and course review module, where the data management and course review module may be used to manage courseware uploaded by a user and/or recorded courses, and the like.
After the recording function is started by the user, whether the courseware currently used by the user is synchronized to the management platform or not can be judged, and whether the courseware currently used by the user is stored in a server of the management platform or not can be judged, so that whether microphone equipment exists in intelligent interaction equipment such as an interactive intelligent panel where whiteboard software is located or not can be detected after the courseware currently used by the user is judged to be synchronized to the management platform. If the microphone equipment exists in the intelligent interaction equipment, the recording inlet can be displayed, so that a user can trigger the whiteboard software to start a recording process by clicking the recording inlet, namely, the user can submit a recording triggering operation to the whiteboard software through the recording inlet, and the whiteboard software and the intelligent interaction equipment for starting the whiteboard software enter a recording state. When it is detected that the user does not log in the account of the whiteboard software, or the user does not start the recording function, or the user does not open the synchronized courseware, or the intelligent interaction device where the whiteboard software is located does not have a microphone device, the recording entry may not be displayed on the interface of the whiteboard software, which is not particularly limited in the embodiment of the present invention.
In the recording process, the intelligent interaction equipment running the whiteboard software can record the operation of the user on the courseware, for example, the operation can be recorded in a dotting mode to obtain page recording data; the voice of the user giving lessons can be recorded to generate a recording file; and uploading the page record data and the record file according to a predetermined record uploading mode to trigger the server to generate record fragment data corresponding to the courseware according to the uploaded record file and the page record data, so as to record the course. The recording section data generated by the server may include an uploaded recording file, page recording data, and the like.
Optionally, in the audio recording process according to the embodiment of the present invention, the audio data obtained by recording may be processed according to preset recording configuration data to obtain recording data, a recording file may be generated according to the recording data and the recording segment identifier corresponding to the recording data, and the generated recording file is uploaded to the server, so as to trigger the server to generate corresponding recording segment data according to the recording file. Therefore, the data processing method based on the intelligent interaction device provided by the embodiment of the present invention may further include: recording audio data in a recording state; processing the audio data according to preset recording configuration data to obtain recording data; generating a recording file corresponding to the recording data according to the recording data and the recording fragment identification corresponding to the recording data; and uploading the sound recording file to the server, wherein the sound recording file is used for triggering the server to generate the recording fragment data.
As an example of the present invention, after a user logs in an account of whiteboard software using an intelligent interactive device, the user may submit an operation of clicking a recording entry on a software interface of the whiteboard software to trigger the intelligent interactive device to start a recording process. Specifically, after detecting the recording entry operation submitted by the user, the intelligent interaction device may detect whether the user uses the whiteboard software for the first time; if the fact that the user uses the whiteboard software for the first time is detected, the use guide information corresponding to the whiteboard software can be displayed to prompt the user to use the functions provided by the whiteboard software, and user experience is improved. Then, whether the recording equipment used for recording needs to be selected or not can be determined by detecting whether the intelligent interaction equipment has a plurality of recording equipment or not; if the fact that the user does not use the whiteboard software for the first time is detected, whether one or more recording devices exist in the intelligent interaction device can be detected, and whether the recording device used for recording needs to be selected or not is determined. If the intelligent interaction device has a recording device, a recording process can be started based on the recording device, namely, the intelligent interaction device enters a recording state. If the intelligent interaction device has two or more than two recording devices, one or more recording devices of the intelligent interaction device can be displayed so that the user can select the recording device required to be used for the current recording, and then the recording process can be started based on the recording device selected by the user. Of course, the intelligent interaction device may also automatically select the recording device to be used for the recording based on the preset recording default setting information, which is not limited in this example.
After the recording process is started by the intelligent interaction device, the audio data can be recorded by the recording device, and the preset recording configuration data can be acquired to process the recorded audio data so as to generate one or more segments of recording data. After the recording data is obtained, whether the intelligent interaction device has obtained the recording segment identifier can be judged; if the intelligent interaction device acquires the recording segment ID, determining the acquired recording segment ID as a recording segment ID corresponding to the recorded audio data, so as to generate a recording file corresponding to the recorded audio data according to the recording segment ID; if the intelligent interaction device does not acquire the recording segment ID, a recording segment creating request can be sent to the server so as to download one recording segment ID from the server, and then a recording file corresponding to the recording data can be generated according to the downloaded recording segment ID. The recording segment creating request may include request parameters that the intelligent interactive device needs to send, and for example, the recording segment creating request may include: capsule name, file identification, file name, total number of pages of file, file version number, etc. The capsule name may be used to identify the time capsule storing the recording segment data; the file identifier may be used to identify a file that the intelligent interactive device needs to operate currently, for example, a courseware identifier, and the courseware identifier may be used to identify a courseware opened by whiteboard software installed in the intelligent interactive device; the file name may refer to a file name of a file which the intelligent interactive device needs to operate currently, such as a courseware name; the total number of pages of the file may be a total number of pages corresponding to an operation page included in a file which needs to be operated currently by the intelligent interactive device, such as a courseware name courseware total number of pages; the file version number may be used to determine the version of the file that the mutual intelligence tablet needs to operate currently, such as a courseware version number. If the courseware version number does not exist, the courseware version number carried by the recording segment creating request can be an empty character string and the like.
In the audio recording process, if the size of the recorded audio exceeds the limitation of being divided, the audio can be stored in segments, for example, according to preset recording configuration data, the recorded audio data is divided into at least two segments of recording data, and each segment of recording data can be stored as a recording file. On the basis of the foregoing embodiment, optionally, the data processing method based on the intelligent interactive device may further include: acquiring audio recording configuration data from the server; detecting whether the audio recording configuration data meet preset effective conditions or not; if the audio recording configuration data meet the preset effective conditions, determining the audio recording configuration data as the recording configuration data; and if the audio recording configuration data do not accord with the preset effective condition, acquiring local recording configuration data, and determining the local recording configuration data as the recording configuration data.
Specifically, in the embodiment of the present invention, after the intelligent interactive device enters the recording state, a recording configuration data acquisition request may be sent to a server connected to the intelligent interactive device, so as to request to acquire audio recording configuration data from the server. After receiving the recording configuration data acquisition request, the server may acquire pre-stored audio recording configuration data for the recording configuration data request, or may automatically generate audio recording configuration data, and then may return the audio recording configuration data to the intelligent interaction device, so that the intelligent interaction device may receive the audio recording configuration data, that is, the intelligent interaction device may acquire the audio recording configuration data from the server. After the audio recording configuration data is acquired from the server, whether the audio recording configuration data meets a preset effective condition or not can be detected, so that whether the audio recording configuration data acquired from the server is effective data or not can be determined. If the audio recording configuration data meets the preset effective condition, that is, when the audio recording configuration data acquired from the server is effective data, the audio recording configuration data can be determined as the recording configuration data corresponding to the recording, so that the audio recording configuration data acquired from the server is used for processing the recorded audio data. If the audio recording configuration data does not meet the preset effective condition, that is, when the audio recording configuration data acquired from the server is invalid data, the audio recording configuration data acquired from the server can be ignored, and locally stored local recording configuration data is acquired as recording configuration data corresponding to the current recording, so that the recorded audio data is processed by using the local recording configuration data.
Optionally, after sending a recording configuration data acquisition request to a server connected to the intelligent interactive device, the embodiment of the present invention detects whether the intelligent interactive device can successfully acquire audio recording configuration data from the server; if the intelligent interaction device fails to acquire the audio recording configuration data from the server, the locally stored local recording configuration data can be directly acquired from the intelligent interaction device and used as the recording configuration data of the current recording process, so that the audio data obtained by recording can be processed according to the recording configuration data in the following process, the data volume contained in each generated section of recording data is limited, the file size of each uploaded recording file can be limited, the problem that the uploading of the recording file fails due to the fact that the uploading duration of the recording file exceeds a preset network transmission duration threshold is solved, the uploading efficiency of the recording file is improved, and the sharing efficiency can be improved. The recording configuration data is used to limit the data size included in a segment of recording data, for example, the recording configuration data may include a maximum recording duration corresponding to the recording data, a maximum data size of each segment of recording data, audio quality data corresponding to the recording data, and a recording sampling frequency
After the recording file is generated, the recording file can be stored in the audio queue to be uploaded to wait for uploading to the server. For example, the intelligent interaction device may determine the condition of the audio queue to be uploaded at regular time, such as determining whether the audio queue to be uploaded stores an audio file that is not uploaded, or determining whether the audio file to be uploaded is an empty queue, so as to determine whether the audio file needs to be uploaded. If the audio queue to be uploaded stores the record files which are not uploaded, namely when the audio files to be uploaded are not empty queues, one or more record files stored in the audio queue to be uploaded can be uploaded to the server according to the sequence of storing the record files in the audio queue to be uploaded, so that the server is triggered to generate the record fragment data corresponding to the record fragment identification carried by the record file according to the record files. The recording segment ID may have a one-to-one correspondence relationship with the recording segment data, and may specifically be used to identify the recording segment data.
In an optional embodiment of the present invention, before generating the sound recording file corresponding to the sound recording data according to the sound recording data and the recording segment identifier corresponding to the sound recording data, the method may further include: when the intelligent interaction equipment stores the recording segment identification, directly acquiring the recording segment identification; when the intelligent interaction equipment does not store the recording segment identification, sending a recording segment creating request to the server, and receiving the recording segment identification sent by the server, wherein the recording segment identification is determined by the server according to the recording segment creating request. Specifically, after newly recorded audio data is obtained, whether the intelligent interaction device stores the recording segment ID or not can be detected; if the intelligent interaction equipment is detected to store the recording segment ID, the recording segment ID can be directly obtained from the intelligent interaction equipment and is used as the recording segment ID corresponding to the recording data obtained after processing, so that a recording file corresponding to each piece of recording data is generated according to the recording segment ID; if the intelligent interaction equipment does not store the recording segment ID, a recording segment creating request can be sent to the server to trigger the server to send a recording segment ID, so that the recording segment ID sent by the server can be received, the received recording segment ID can be used as the recording segment ID corresponding to the recording data, and the recording file corresponding to each piece of recording data can be generated according to the received recording segment ID.
The embodiment of the invention can send the file uploading application to the server before uploading the file, so as to upload the file when the file uploading application is successful. Optionally, before uploading the audio record file to the server, the method may further include: sending an upload application request to the server; and receiving an application success message.
Specifically, after it is determined that the audio queue to be uploaded stores the audio files that are not uploaded, the embodiment of the present invention may send an upload application request to the server to apply for the upload files from the server. The upload application request may carry various request parameters required for applying for uploading a file, such as capsule ID, media name, media type, media size, unit byte, check value of media file MD5, media file sequence, data, and the like. After receiving the upload application request, the server can determine whether to allow the upload application request by detecting the network connection status of the intelligent interactive device and/or detecting whether the upload application request is a legal request. And if the application request is allowed to be uploaded, generating an application success message corresponding to the application request, and feeding back the application success message to the intelligent interaction equipment, so that the intelligent interaction equipment can upload the record file in the audio queue to be uploaded based on the application success message. If the application request is allowed to be uploaded, an application success message corresponding to the uploading application request is generated, and the application success message is fed back to the intelligent interaction equipment, so that the intelligent interaction equipment can upload the record file in the audio queue to be uploaded based on the application success message. Wherein, the uploading the sound recording file to the server includes: and uploading the sound recording file based on the application success message. If the upload application request is not allowed, the upload application request may be ignored, or an application failure message corresponding to the upload application request may be generated, which is not limited in the embodiment of the present invention.
Further, in the audio recording process, the embodiment of the invention can store the generated recording file into the audio queue to be uploaded, and can store the generated page record data into the page record data queue to be uploaded. After receiving an application success message sent by a server, namely after acquiring an uploading file application success message, uploading a recording file in an audio queue to be uploaded and page record data in a page record data queue to be uploaded, namely uploading the recording file and the page record data to the server through a network, so as to trigger the server to generate and store recording fragment data according to the uploaded recording file and page record data, and further realize audio playing and page operation display according to the recording fragment data stored in the server.
The embodiment of the invention can determine the current recording uploading mode of the intelligent interaction equipment in the audio recording process so as to upload the generated recording file and page recording data according to the determined recording uploading mode. Optionally, before uploading the sound recording file, the method may further include: and determining a recording and uploading mode. Wherein, the uploading the sound recording file comprises: and uploading the recording file according to the recording uploading mode. After the recording file is uploaded, uploading the page record data which is not uploaded in the page record data queue to be uploaded according to the determined recording and uploading mode.
In a specific implementation, the intelligent interaction device may upload according to a user upload mode designated by a user, or upload according to a preset silent upload mode, which is not limited in this embodiment of the present invention. Optionally, the recording upload mode may include a user upload mode and a silent upload mode.
In order to reduce the time for waiting for uploading by the user, the embodiment of the invention can upload the recording file and the page record data in a silent uploading mode in the uploading process. For example, as shown in fig. 2, in the recording process, it may be determined whether a new sound recording file is generated; if a new recording file is generated, the generated recording file can be stored in an audio queue to be uploaded; if no new sound recording file is generated, returning to the step of judging whether a new sound recording file is generated or not to wait for the generation of the new sound recording file. Meanwhile, whether the audio queue to be uploaded has the record file which is not uploaded can be judged at regular time based on a silent uploading mode; if the audio queue to be uploaded has the recording file which is not uploaded, the recording file in the uploaded audio queue can be uploaded according to a silent uploading mode, whether the recording file is uploaded successfully can be judged, and the recording file is removed from the audio queue to be uploaded after being uploaded, namely the recording file which is uploaded successfully is removed from the audio queue to be uploaded. If the uploading of the recording file fails, the recording file can be left in an audio queue to be uploaded so as to be uploaded again at the next time.
Optionally, when receiving the user uploading operation, the embodiment of the present invention may close the silent uploading mode, so as to upload the generated sound recording file and the page recording data preferentially according to the user uploading mode corresponding to the user uploading operation. The determining of the recording uploading mode may specifically include: monitoring user uploading operation; when the user uploading operation cannot be monitored, determining the recording uploading mode as a silent uploading mode; and when the user uploading operation is monitored, determining the recording uploading mode as the user uploading mode. And then uploading the generated sound recording file and page record data according to a user uploading mode.
For example, after the recording is finished, the user may submit the user uploading operation to the whiteboard software through the intelligent interaction device, so that the whiteboard software may monitor the user uploading operation submitted by the user. In the case of storing recording segment data using a time capsule, the time capsule identification may be used as a recording segment identification; and the time capsule creation request can be sent to the server as a request for creating the recording segment so as to trigger the server to issue the time capsule identification. Specifically, as shown in fig. 3, after the whiteboard software monitors the user uploading operation, it may detect whether the time capsule identifier is acquired. If the time capsule identifier is not obtained, a new time capsule creating request can be sent to the server, that is, the time capsule creating request is sent to the server so as to be downloaded from the server to the time capsule identifier, that is, the time capsule identifier returned by the server for the time capsule creating request is received, and then the user uploading mode can be determined to be the recording uploading mode corresponding to the recording file based on the time capsule identifier. If the time capsule identification has been acquired, the silent upload mode can be directly closed. Subsequently, whether the audio queue to be uploaded has the record file which is not uploaded can be judged based on the uploading mode of the user, so that the uploading is applied when the audio queue to be uploaded has the record file which is not uploaded, and an uploading application request is sent to the server. When an application success message returned by the server for the application request is received, namely when the application is successful, the recording file in the audio queue to be uploaded can be uploaded, whether the recording file is uploaded successfully can be detected, and under the condition that the recording file is uploaded successfully, page record data which are not uploaded are obtained from the page record data queue to be uploaded and uploaded. Furthermore, after the page record data is uploaded successfully, the effective time data of the recording segments set by the user or set in advance can be uploaded to the server, so that the server can set the effective time of the recording segment data corresponding to the page record data according to the uploaded effective time data of the recording segments. After the effective time of recording the data of the segments is successfully set, the server can return an uploading success prompt message to prompt the user to successfully upload the recording file and the page recording data.
On the basis of the foregoing embodiment, optionally, the data processing method based on the intelligent interaction device may further include: if the uploading of the recording file fails, generating recording uploading failure prompt information; if the recording file is uploaded successfully, the step of uploading the page record data to a server corresponding to the intelligent interaction equipment is executed; and generating uploading failure prompt information when the uploading of the page record data fails.
For example, with reference to the above example, as shown in fig. 3, when the audio file fails to be uploaded, an audio file upload failure prompt message corresponding to the audio file may be generated to prompt the user that the audio file fails to be uploaded; similarly, when the uploading of the page record data fails, the uploading failure prompt information corresponding to the page record data is generated to prompt the user that the uploading of the page record data fails, so that the user can be prompted to try to upload manually again, and the user experience is improved.
In an optional embodiment of the present invention, before the recording according to the page identifier of the operation page, the method may further include: determining display residence time corresponding to the operation page, wherein the operation page comprises a courseware page; if the display residence time exceeds a preset time threshold, executing the step of recording according to the page identifier of the operation page, wherein the page identifier comprises: a page number. Specifically, when it is detected that the page number of the currently displayed courseware page is different from the page number recorded last time, that is, when it is detected that the currently displayed operation page is different from the operation page recorded last time, the current time may be obtained, so as to determine, based on the current time, the display residence time corresponding to the currently displayed operation page of the intelligent interaction device, and it may be detected whether the display residence time corresponding to the operation page exceeds a preset time threshold value, so as to determine whether the currently received page turning operation is a continuous page turning operation. If the display residence time exceeds the preset time threshold, for example, if the display residence time of the operation page exceeds the preset time threshold for 3 seconds, it can be determined that the currently received page turning operation needs to be recorded, then, the step of recording according to the page identifier of the operation page is executed, for example, dotting recording is carried out according to the page identifier of the currently displayed operation page to obtain page dotting data, thumbnail data corresponding to the currently displayed operation page can be obtained, generating corresponding page record data by using the thumbnail data and the page dotting data, then storing the generated page record data into a page record data queue to be uploaded, uploading the generated page record data according to the sequence of storing the page record data into a page record data queue to be uploaded, so that the server can generate the recording segment data corresponding to the operation page according to the page recording data.
By applying the data processing method provided by the embodiment of the invention, the recording segment data corresponding to the operation page can be generated by the server, so that a user can download the recording segment data from the server to play the recording according to the recording segment data, and can realize the page turning operation corresponding to the operation page according to the page recording data contained in the recording segment data to display the operation page after page turning, namely, the network sharing corresponding to the page operation data recorded by the intelligent interaction equipment in the recording state can be realized based on the recording segment data, the problem that the operation performed on an interactive intelligent panel in the prior art causes large screen recording files is solved, the data transmission quantity uploaded each time is reduced, the transmission time length uploaded each time can be shortened, and the problem that the uploading time length of the recorded content exceeds the preset network transmission time length threshold value to cause the uploading failure of the recorded content can be avoided, and the network sharing efficiency is improved.
On the basis of the foregoing embodiment, another data processing method based on an intelligent interactive device is further provided in an embodiment of the present invention, so as to perform audio playing and page displaying according to the acquired recording segment data, to implement audio playing corresponding to a recording file included in the recording segment data and page turning operation corresponding to page recording data included in the recording segment data, and improve network sharing efficiency while achieving a network sharing purpose.
It should be noted that another data processing method based on an intelligent interactive device provided by the embodiment of the present invention may be applied to a data processing platform based on an intelligent interactive device, such as a management platform of whiteboard software. The user can manage and review the recorded content of the intelligent interaction device through the data processing platform. The recorded content may include the recorded audio file, the recorded page record data, and the media file where the operation page is located.
In the process of managing and reviewing the recorded content, for example, when the recorded content is played, the operation page corresponding to the recorded content may be displayed on the display interface of the data processing platform, that is, the operation page mentioned in the above embodiment may be displayed on the display interface of the data processing platform. Therefore, in the process of managing and reviewing the recorded content, the operation page mentioned in the recording process can be called as a display page.
Referring to fig. 4, a flowchart illustrating steps of another data processing method based on an intelligent interactive device in the embodiment of the present invention is shown, which may specifically include the following steps:
step 410, acquiring recording segment data corresponding to the display page.
The recording fragment data is generated by a server according to page recording data uploaded by intelligent interaction equipment, and the page recording data is obtained by recording according to a page identifier of an operation page after the intelligent interaction equipment receives page turning operation.
Step 420, performing audio playing according to the recording segment data, and detecting whether the recording segment data includes target page recording data corresponding to the display page.
Specifically, when the recording content corresponding to the display page currently displayed by the data processing platform needs to be reviewed and managed, the embodiment of the present invention may acquire the recording segment data corresponding to the display page from the server, that is, the recording segment data corresponding to the display page currently displayed in the server. Then, audio playing can be performed according to the recording file contained in the acquired recording segment data, so that a user can acquire the audio recorded in advance for the display page; meanwhile, whether the recording section data contains page recording data or not can be detected; if the recording section data includes page recording data, the page recording data included in the recording section data may be determined as target page recording data corresponding to the display page, so as to perform a page turning operation according to the target page recording data. Specifically, when it is detected that the recording section data includes target page recording data corresponding to the display page, step 430 may be performed; when it is detected that the recording segment data does not include target page recording data corresponding to the display page, it may be determined that a page turning operation is not required to be performed on the display page, and after the audio corresponding to the recording file included in the recording segment data is played, audio playing and detection may continue according to the next acquired recording segment data.
Step 430, if the recording fragment data includes the target page record data, performing a page turning operation according to a target time point corresponding to the target page record data, and displaying a page after page turning.
In the embodiment of the present invention, after it is determined that the recording segment data includes the target page recording data, the target page recording data may be extracted from the recording segment data, so as to perform a page turning operation based on the current display page according to a target time point corresponding to the target page recording data. For example, the intelligent interaction device may analyze the target page record data to obtain a target time point corresponding to the target page record data and a page turning operation corresponding to the target page record data, then may execute the page turning operation on the display page according to the target time point, and display the page after the page turning operation is executed. And the page after page turning is a display page which needs to be displayed after the page turning operation is executed.
Therefore, after the recording segment data corresponding to the display page is acquired, the embodiment of the invention can play the audio according to the recording segment data, so that the user can review the recording recorded on the display page; and when the recorded fragment data comprises target page recorded data corresponding to the recorded page turning operation, the page turning operation is executed on the display page according to the target time point corresponding to the target page recorded data, so that a user can look up the page after page turning, and network sharing is realized.
Furthermore, when receiving a comment triggering operation submitted by a user for the recorded content, the embodiment of the invention can display the corresponding input interface, so that the user can input the comment information to be submitted on the input interface, and the user can conveniently comment the recorded content. The recording content may refer to information recorded for a display page, and specifically may include: recording files recorded for display pages, page recording data recorded for display pages, and the like.
Optionally, another data processing method based on an intelligent interaction device provided in the embodiment of the present invention may further include: receiving comment triggering operation; acquiring user input information according to the comment triggering operation; and displaying the recorded comment information corresponding to the page according to the user input information. The user triggering operation can be an operation submitted by a user in a recorded content playing process and/or a page display process, and can be specifically used for triggering the data processing platform to acquire user input information so as to generate recorded comment information corresponding to a display page based on the user input information, so that the user can conveniently comment on the recorded content, the user can interact with the recorded content recorded based on the intelligent interaction equipment, and the interactivity is improved; the user input information may refer to information input by a user, such as comment information, and the like submitted by the user on currently played recording content and/or a currently displayed display page, which is not limited in this embodiment of the present invention.
Specifically, after receiving a comment triggering operation submitted by a user, the embodiment of the invention can display an input interface corresponding to the currently played and recorded content on the interface of the data processing platform aiming at the comment triggering operation, so that the user can input the information required to be input on the input interface, and the data processing platform can receive the input information of the user. After receiving the user input information, the data processing platform can determine the user input information as the recorded comment information corresponding to the currently displayed display interface, and if the validity and the legality of the user input information are detected, the data processing platform associates the user input information with the currently displayed display page so as to determine the user input information as the recorded comment information corresponding to the display page, so that a user can conveniently comment, and further the user can conveniently review and manage the recorded content.
In an optional embodiment of the present invention, after the receiving a comment triggering operation, the method may further include: pausing audio playing aiming at the comment triggering operation; acquiring a page playing time point corresponding to the display page, wherein the display page comprises a courseware page; establishing an association relation between the recording comment information and the recording segment data based on the page playing time point; and storing the recorded comment information based on the incidence relation.
Specifically, in the process of playing the recorded content, that is, in the process of displaying the page and playing the recording file, if a comment triggering operation submitted by the user is received, the data processing platform in the embodiment of the present invention may pause the audio playing with respect to the currently received comment triggering operation, so that the user may review and comment on the played recorded content, and the user may manage the recorded content conveniently. After the audio playing is paused, a page playing time point corresponding to the currently displayed display page may be acquired, so as to establish an association relationship between the recording comment information and the recording segment data based on the page playing time point, for example, the recording comment information may be associated with the recording file and/or the page recording data in the recording segment data based on the acquired page playing time point, so as to implement a function of commenting the recorded content.
For example, after the server generates corresponding recording segment data of the recorded course based on the uploaded recording file and the uploaded page recording data, a user who wants to review the recorded course content can access the server of the management platform through a web page, so that the management platform plays the course content that the user needs to review on the web page, that is, plays courseware in the recorded course content. In the course playing process, the management platform can play audio according to the recording file contained in the acquired recording fragment data, so that a user can hear the audio recorded by a teacher in the course recording process, and can execute page turning operation according to target page recording data contained in the recording fragment data, so that the user can watch the page turning operation of the teacher on the course in the course recording process and watch the page turned over after the course. When a user submits comment triggering operation to the management platform in the watching process, the management platform can display an input interface on a webpage, so that the user can input information on the input interface to generate corresponding recorded comment information, namely, the user is supported to operate the course watched by the user, the user can conveniently conduct teaching and research analysis and teaching reflection, the user can conduct on-line teaching evaluation, and accordingly, normalized teaching feedback in the true sense can be provided for a teacher, and the professional teaching ability development of the teacher is promoted.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention.
Referring to fig. 5, a block diagram of a data processing apparatus based on an intelligent interactive device in an embodiment of the present invention is shown. The data processing device based on the intelligent interaction equipment specifically comprises the following modules:
a page turning operation receiving module 510, configured to receive a page turning operation, where the page turning operation is submitted for an operation page displayed by an intelligent interactive device;
a page detection module 520, configured to detect whether a page identifier of the operation page is the same as a preset record page identifier when the intelligent interactive device is in a recording state, where the record page identifier is a last recorded page identifier;
the page recording module 530 is configured to record according to the page identifier of the operation page when the page identifier of the operation page is different from the recorded page identifier, and obtain page recording data corresponding to the page turning operation;
the page record data uploading module 540 is configured to upload page record data to a server, where the server is configured to generate recording segment data corresponding to the operation page according to the page record data.
In an optional embodiment of the present invention, the data processing apparatus based on an intelligent interactive device may further include the following modules:
the recording triggering operation receiving module is used for receiving a recording triggering operation of a target application program, wherein the target application program is an application program used for displaying the operation page in the intelligent interaction equipment;
the recording state triggering module is used for triggering the intelligent interaction equipment to enter a recording state according to the recording triggering operation;
the audio recording module is used for recording audio data in the recording state;
the audio processing module is used for processing the audio data according to preset recording configuration data to obtain recording data;
the recording file generating module is used for generating a recording file corresponding to the recording data according to the recording data and the recording segment identification corresponding to the recording data;
and the recording file uploading module is used for uploading the recording file to the server, wherein the recording file is used for triggering the server to generate the recording fragment data.
Optionally, the data processing apparatus based on the intelligent interaction device may further include: and a recording segment identifier acquisition module. The recording segment identification obtaining module is used for directly obtaining the recording segment identification when the intelligent interaction equipment stores the recording segment identification; when the intelligent interaction equipment does not store the recording segment identification, sending a recording segment creating request to the server, and receiving the recording segment identification sent by the server, wherein the recording segment identification is determined by the server according to the recording segment creating request.
Optionally, the data processing apparatus based on the intelligent interaction device may further include the following modules:
an application request sending module, configured to send an upload application request to the server;
and the message receiving module is used for receiving the application success message.
The recording file uploading module may be specifically configured to upload the recording file based on the application success message received by the message receiving module.
Optionally, the data processing apparatus based on the intelligent interaction device may further include: and an uploading mode determining module. The uploading mode determining module can be used for determining a recording uploading mode. The recording file uploading module can be specifically used for uploading the recording file according to the recording uploading mode.
In the embodiment of the present invention, optionally, the upload mode determining module may include the following sub-modules:
the monitoring submodule is used for monitoring the uploading operation of the user;
the silence mode determining submodule is used for determining the recording uploading mode as a silence uploading mode when the user uploading operation cannot be monitored;
and when the user uploading operation is monitored, determining the recording uploading mode as the user uploading mode.
In an optional embodiment of the present invention, the data processing apparatus based on an intelligent interactive device may further include the following modules:
the recording configuration data acquisition module is used for acquiring audio recording configuration data from the server;
the recording configuration data detection module is used for detecting whether the audio recording configuration data meet preset effective conditions or not;
the first configuration data determining module is used for determining the audio recording configuration data as the recording configuration data if the audio recording configuration data meets the preset effective condition;
and the second configuration data determining module is used for acquiring local recording configuration data if the audio recording configuration data does not accord with the preset effective condition, and determining the local recording configuration data as the recording configuration data.
Optionally, the data processing apparatus based on the intelligent interaction device may further include the following modules:
the recording uploading failure module is used for generating recording uploading failure prompt information when the recording file is unsuccessfully uploaded;
the page recorded data uploading module is used for uploading the page recorded data to a server corresponding to the intelligent interaction equipment when the recording file is uploaded successfully;
and the dotting uploading failure module is used for generating uploading failure prompt information when the uploading of the page record data fails.
Optionally, the data processing apparatus based on the intelligent interactive device may further include: a display residence time determination module. The display residence time determining module is used for determining the display residence time corresponding to the operation page, wherein the operation page comprises a courseware page; if the display residence time exceeds a preset time threshold, triggering the page recording module 530 to perform a recording step according to the page identifier of the operation page. Wherein the page identification comprises: a page number.
In a specific implementation, the data processing apparatus based on the intelligent interactive device provided by the embodiment of the present invention may be integrated in the intelligent interactive device. The intelligent interaction device may be composed of two or more physical entities, or may be composed of one physical entity, for example, the device may be a digital television, a computer, a mobile phone, a tablet, a projector, or an interactive smart tablet.
Referring to fig. 6, a schematic structural diagram of an intelligent interaction device in the embodiment of the present invention is shown. As shown in fig. 6, the intelligent interaction device includes: a processor 60, a memory 61, a display 62 with touch functionality, an input device 63, an output device 64 and a communication device 65. The number of the processors 60 in the intelligent interaction device can be one or more, and one processor 60 is taken as an example in fig. 6. The number of the memories 61 in the device may be one or more, and one memory 61 is taken as an example in fig. 6. The processor 60, the memory 61, the display 62, the input device 63, the output device 64 and the communication device 65 of the intelligent interactive device can be connected through a bus or other means, and the connection through the bus is taken as an example in fig. 6. In an embodiment, the smart interactive device may be a computer, a mobile phone, a tablet, a projector, or an interactive smart tablet. In the embodiment, an intelligent interactive device is taken as an example of an interactive intelligent tablet to describe.
The memory 61 is a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the data processing method based on the intelligent interactive device according to any embodiment of the present invention (for example, the page turning operation receiving module 510, the page detecting module 520, the page recording module 530, the page recorded data uploading module 540, and the like in the data processing apparatus based on the intelligent interactive device). The memory 61 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the device, and the like. Further, the memory 61 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory 61 may further include memory located remotely from the processor 60, which may be connected to the intelligent interaction device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The display screen 62 is a display screen 62 with a touch function, which may be a capacitive screen, an electromagnetic screen, or an infrared screen. In general, the display screen 62 is used for displaying data according to instructions from the processor 60, and is also used for receiving touch operations applied to the display screen 62 and sending corresponding signals to the processor 60 or other devices. Optionally, when the display screen 62 is an infrared screen, the display screen further includes an infrared touch frame, and the infrared touch frame is disposed around the display screen 62, and may also be configured to receive an infrared signal and send the infrared signal to the processor 60 or other devices.
The communication device 65 is used for establishing a communication connection with other devices, and may be a wired communication device and/or a wireless communication device.
The input means 63 may be used for receiving input numeric or character information and generating key signal inputs related to user settings and function control of the apparatus, and may be a camera for acquiring images and a sound pickup apparatus for acquiring audio data. The output device 64 may include an audio device such as a speaker. It should be noted that the specific composition of the input device 63 and the output device 64 can be set according to actual conditions.
The processor 60 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory 61, that is, implements the above-mentioned data processing method based on the intelligent interactive device.
Specifically, in the embodiment, when the processor 60 executes one or more programs stored in the memory 61, the following operations are specifically implemented: receiving page turning operation, wherein the page turning operation is submitted aiming at an operation page displayed by the intelligent interaction equipment; when the intelligent interaction equipment is in a recording state, detecting whether a page identifier of the operation page is the same as a preset recording page identifier or not, wherein the recording page identifier is a page identifier recorded last time; when the page identification of the operation page is different from the recording page identification, recording according to the page identification of the operation page to obtain page recording data corresponding to the page turning operation; and uploading the page record data to a server, wherein the server is used for generating record fragment data corresponding to the operation page according to the page record data.
On the basis of the above embodiment, the one or more processors 60 further implement the following operations: receiving a sound recording triggering operation of a target application program, wherein the target application program is an application program used for displaying the operation page in the intelligent interaction equipment; triggering the intelligent interaction equipment to enter a recording state according to the recording triggering operation; recording audio data in the recording state; processing the audio data according to preset recording configuration data to obtain recording data; generating a recording file corresponding to the recording data according to the recording data and the recording fragment identification corresponding to the recording data; and uploading the sound recording file to the server, wherein the sound recording file is used for triggering the server to generate the recording fragment data.
On the basis of the foregoing embodiment, before the one or more processors 60 generate the sound recording file corresponding to the sound recording data according to the sound recording data and the recording segment identifier corresponding to the sound recording data, the following operations are further implemented: when the intelligent interaction equipment stores the recording segment identification, directly acquiring the recording segment identification; when the intelligent interaction equipment does not store the recording segment identification, sending a recording segment creating request to the server, and receiving the recording segment identification sent by the server, wherein the recording segment identification is determined by the server according to the recording segment creating request.
On the basis of the above embodiment, the one or more processors 60 further implement the following operations before implementing uploading of the sound recording file to the server: sending an upload application request to the server; and receiving an application success message. When the processor 60 uploads the audio file to the server, the method may specifically include: and uploading the sound recording file based on the application success message.
On the basis of the above embodiment, the one or more processors 60 further implement the following operations before implementing uploading of the sound recording file: and determining a recording and uploading mode. When the processor 60 uploads the audio record file, the uploading may specifically include: and uploading the recording file according to the recording uploading mode.
On the basis of the foregoing embodiment, when the processor 60 determines the recording uploading mode, the method may specifically include: monitoring user uploading operation; when the user uploading operation cannot be monitored, determining the recording uploading mode as a silent uploading mode; and when the user uploading operation is monitored, determining the recording uploading mode as the user uploading mode.
On the basis of the above embodiment, the one or more processors 60 further implement the following operations: acquiring audio recording configuration data from the server; detecting whether the audio recording configuration data meet preset effective conditions or not; if the audio recording configuration data meet the preset effective conditions, determining the audio recording configuration data as the recording configuration data; and if the audio recording configuration data do not accord with the preset effective condition, acquiring local recording configuration data, and determining the local recording configuration data as the recording configuration data.
On the basis of the above embodiment, the one or more processors 60 further implement the following operations: if the uploading of the recording file fails, generating recording uploading failure prompt information; if the recording file is uploaded successfully, the step of uploading the page record data to a server is executed; and generating uploading failure prompt information when the uploading of the page record data fails.
On the basis of the above embodiment, before implementing the recording according to the page identifier of the operation page, the one or more processors 60 further implement the following operations: determining display residence time corresponding to the operation page, wherein the operation page comprises a courseware page; and if the display residence time exceeds a preset time threshold, executing the step of recording according to the page identification of the operation page.
The device can execute the data processing method based on the intelligent interaction device provided by any embodiment of the invention, and has corresponding functions and beneficial effects.
Embodiments of the present invention also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a data processing method based on an intelligent interactive device, including: receiving page turning operation; detecting whether the intelligent interaction equipment is in a recording state or not based on the page turning operation; if the intelligent interaction equipment is in a recording state, detecting whether an operation page displayed by the intelligent interaction equipment is the same as a preset operation page recorded last time; if the operation page is different from the last recorded operation page, recording according to the page identification of the operation page to obtain page recorded data; and uploading the page record data to a server corresponding to the intelligent interaction equipment, wherein the server is used for generating recording fragment data corresponding to the operation page according to the page record data.
Of course, the storage medium containing the computer-executable instructions provided by the embodiments of the present invention is not limited to the operations of the data processing method based on the intelligent interactive device described above, and may also perform related operations in the data processing method based on the intelligent interactive device provided by any embodiments of the present invention, and has corresponding functions and advantages.
An embodiment of the present invention may also provide another data processing apparatus based on an intelligent interactive device, as shown in fig. 7, the data processing apparatus may include the following modules:
the data obtaining module 710 is configured to obtain recording segment data corresponding to a display page, where the recording segment data is generated by a server according to page record data uploaded by an intelligent interaction device, and the page record data is obtained by recording, by the intelligent interaction device, after receiving a page turning operation according to a page identifier of an operation page;
an audio playing module 720, configured to play audio according to the recording segment data;
a page record data detection module 730, configured to detect whether the recording segment data includes target page record data corresponding to the display page;
and a page turning display module 740, configured to execute, when the recording segment data includes the target page record data, a page turning operation according to a target time point corresponding to the target page record data, and display a page after page turning.
In an optional implementation of the present invention, the another data processing apparatus based on an intelligent interactive device may further include the following modules:
the operation receiving module is used for receiving comment triggering operation;
the input information acquisition module is used for acquiring user input information according to the comment triggering operation;
and the comment information generating module is used for generating the recorded comment information corresponding to the display page according to the user input information.
In an embodiment of the present invention, optionally, the another data processing apparatus based on an intelligent interactive device may further include the following modules:
the audio playing pause module is used for pausing the audio playing aiming at the comment triggering operation;
the playing time point acquisition module is used for acquiring a page playing time point corresponding to the display page, wherein the display page comprises a courseware page;
the incidence relation establishing module is used for establishing incidence relation between the recording comment information and the recording segment data based on the page playing time point;
and the comment information storage module is used for storing the recorded comment information based on the incidence relation.
In a specific implementation, another data processing apparatus based on an intelligent interactive device provided in the embodiment of the present invention may be integrated in a data processing platform, and may be specifically configured to execute another data processing method based on an intelligent interactive device mentioned in the foregoing embodiment, which has corresponding functions and beneficial effects. The data processing platform may be formed by two or more physical entities, or may be formed by one physical entity, for example, the data processing platform may be a management platform corresponding to whiteboard software installed in the intelligent interactive device.
Referring to fig. 8, a hardware structure diagram of a data processing platform according to an embodiment of the present invention is shown. The data processing platform comprises: a processor 81 and a memory 82; the processor 81 executes the computer program code stored in the memory 82 to implement another data processing method based on the intelligent interactive device described in the above embodiments.
The memory 82 is configured to store various types of data to support operations at the data processing platform. Examples of such data include instructions for any application or method operating on the data processing platform, such as messages, pictures, audio, and the like. The memory 82 may include a Random Access Memory (RAM) and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.
Optionally, the processor 81 is provided in the processing assembly 80. The data processing platform may further comprise: a communication component 83, a power component 84, a multimedia component 85, an audio component 86, an input/output interface 87 and/or a sensor component 88. The specific components included in the data processing platform are set according to actual requirements, which is not limited in this embodiment.
The processing component 80 generally controls the overall operation of the data processing platform. The processing components 80 may include one or more processors 81 to execute instructions to perform all or a portion of the steps of the method of fig. 4 described above. Further, the processing component 80 may include one or more modules that facilitate interaction between the processing component 80 and other components. For example, the processing component 80 may include a multimedia module to facilitate interaction between the multimedia component 85 and the processing component 80.
The power supply component 84 provides power to the various components of the data processing platform. The power components 84 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the data processing platform.
The multimedia component 85 includes a display screen that provides an output interface between the data processing platform and the user. In some embodiments, the display screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the display screen includes a touch panel, the display screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.
The audio component 86 is configured to output and/or input audio signals. For example, audio component 86 may include a Microphone (MIC) configured to receive external audio signals when the data processing platform is in an operational mode, such as a speech recognition mode. The received audio signal may further be stored in the memory 82 or transmitted via the communication component 83. In some embodiments, audio assembly 86 also includes a speaker for outputting audio signals.
The input/output interface 87 provides an interface between the processing component 80 and peripheral interface modules, which may be click wheels, buttons, etc. These buttons may include, but are not limited to: a volume button, a start button, and a lock button.
The sensor assembly 88 includes one or more sensors for providing various aspects of status assessment for the data processing platform. For example, the sensor assembly 88 may detect the open/closed status of the data processing platform, the relative positioning of the components, the presence or absence of user contact with the data processing platform. The sensor assembly 88 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact, including detecting the distance between the user and the data processing platform. In some embodiments, the sensor assembly 88 may also include a camera or the like.
The communication component 83 is configured to facilitate wired or wireless communication between the data processing platform and other devices. The data processing platform may have access to a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In one embodiment, the data processing platform may include a SIM card slot therein for insertion of a SIM card, such that the data processing platform may log onto a GPRS network to establish communication with a server via the internet.
From the above, the communication component 83, the audio component 86, the input/output interface 87 and the sensor component 88 referred to in the embodiment of fig. 8 can be implemented as input devices.
In a data processing platform of this embodiment, the data processing platform includes: a processor and a display; wherein the display is coupled to the processor. The processor acquires recording segment data corresponding to a display page, performs audio playing according to the recording segment data, and detects whether the recording segment data contains target page recording data corresponding to the display page; and if the recording fragment data comprises the target page recording data, executing page turning operation based on the display page according to a target time point corresponding to the target page recording data, and triggering the display to display the page after page turning. The recording fragment data is generated by a server according to page recording data uploaded by intelligent interaction equipment, and the page recording data is obtained by recording and recording according to a page identifier of an operation page after the intelligent interaction equipment receives page turning operation.
It should be noted that, as for the embodiments of the apparatus, the device, the storage medium, and the data processing platform, since they are basically similar to the embodiments of the method, the description is simple, and the relevant points can be referred to the partial description of the embodiments of the method.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions to enable a computer device (which may be a robot, a personal computer, a server, or a network device) to execute the data processing method based on the intelligent interactive device according to any embodiment of the present invention.
It should be noted that, in the data processing apparatus based on the intelligent interactive device, each unit and each module included in the data processing apparatus are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (17)

1. A data processing method based on intelligent interaction equipment is characterized by comprising the following steps:
receiving page turning operation, wherein the page turning operation is submitted aiming at an operation page displayed by the intelligent interaction equipment;
when the intelligent interaction equipment is in a recording state, detecting whether a page identifier of the operation page is the same as a preset recording page identifier or not, wherein the recording page identifier is a page identifier recorded last time;
when the page identification of the operation page is different from the recording page identification, recording according to the page identification of the operation page to obtain page recording data corresponding to the page turning operation;
and uploading the page record data to a server, wherein the server is used for generating record fragment data corresponding to the operation page according to the page record data.
2. The method of claim 1, further comprising:
receiving a sound recording triggering operation of a target application program, wherein the target application program is an application program used for displaying the operation page in the intelligent interaction equipment;
triggering the intelligent interaction equipment to enter a recording state according to the recording triggering operation;
recording audio data in the recording state;
processing the audio data according to preset recording configuration data to obtain recording data;
generating a recording file corresponding to the recording data according to the recording data and the recording fragment identification corresponding to the recording data;
and uploading the sound recording file to the server, wherein the sound recording file is used for triggering the server to generate the recording fragment data.
3. The method according to claim 2, wherein before generating the recording file corresponding to the recording data according to the recording data and the recording segment identifier corresponding to the recording data, the method further comprises:
when the intelligent interaction equipment stores the recording segment identification, directly acquiring the recording segment identification;
when the intelligent interaction equipment does not store the recording segment identification, sending a recording segment creating request to the server, and receiving the recording segment identification sent by the server, wherein the recording segment identification is determined by the server according to the recording segment creating request.
4. The method of claim 2, wherein prior to uploading the audio recording file to the server, further comprising:
sending an upload application request to the server;
receiving a successful application message;
wherein, the uploading the sound recording file to the server includes: and uploading the sound recording file based on the application success message.
5. The method of claim 4, further comprising, prior to uploading the sound recording file:
determining a recording uploading mode;
wherein, the uploading the sound recording file comprises: and uploading the recording file according to the recording uploading mode.
6. The method of claim 5, wherein determining the recorded upload mode comprises:
monitoring user uploading operation;
when the user uploading operation cannot be monitored, determining the recording uploading mode as a silent uploading mode;
and when the user uploading operation is monitored, determining the recording uploading mode as the user uploading mode.
7. The method of claim 2, further comprising:
acquiring audio recording configuration data from the server;
detecting whether the audio recording configuration data meet preset effective conditions or not;
if the audio recording configuration data meet the preset effective conditions, determining the audio recording configuration data as the recording configuration data;
and if the audio recording configuration data do not accord with the preset effective condition, acquiring local recording configuration data, and determining the local recording configuration data as the recording configuration data.
8. The method of any of claims 2 to 6, further comprising:
if the uploading of the recording file fails, generating recording uploading failure prompt information;
if the recording file is uploaded successfully, the step of uploading the page record data to a server is executed;
and when the uploading of the page record data fails, generating uploading failure prompt information.
9. The method according to any one of claims 1 to 7, wherein before the recording according to the page identifier of the operation page, the method further comprises:
determining display residence time corresponding to the operation page, wherein the operation page comprises a courseware page;
if the display residence time exceeds a preset time threshold, executing the step of recording according to the page identifier of the operation page, wherein the page identifier comprises: a page number.
10. A data processing method based on intelligent interaction equipment is characterized by comprising the following steps:
acquiring recording segment data corresponding to a display page, wherein the recording segment data at least comprises: recording segment identification, page recording data and a recording file uploaded by intelligent interaction equipment, wherein the recording segment data are generated by a server according to the page recording data uploaded by the intelligent interaction equipment, and the page recording data are obtained by recording according to the page identification of an operation page after the intelligent interaction equipment receives page turning operation;
carrying out audio playing according to the recording segment data, and detecting whether the recording segment data contains target page recording data corresponding to the display page;
and if the recording fragment data comprises the target page recording data, executing page turning operation according to the target time point corresponding to the target page recording data, and displaying the page after page turning.
11. The method of claim 10, further comprising:
receiving comment triggering operation;
acquiring user input information according to the comment triggering operation;
and generating recording comment information corresponding to the display page according to the user input information.
12. The method of claim 11, wherein after receiving the comment triggering operation, further comprising:
pausing audio playing aiming at the comment triggering operation;
acquiring a page playing time point corresponding to the display page, wherein the display page comprises a courseware page;
establishing an association relation between the recording comment information and the recording segment data based on the page playing time point;
and storing the recorded comment information based on the incidence relation.
13. A data processing device based on intelligent interaction equipment is characterized by comprising:
the page turning operation receiving module is used for receiving page turning operation, and the page turning operation is submitted aiming at an operation page displayed by the intelligent interaction equipment;
the page detection module is used for detecting whether the page identifier of the operation page is the same as a preset recording page identifier when the intelligent interaction equipment is in a recording state, wherein the recording page identifier is a page identifier recorded last time;
the page recording module is used for recording according to the page identifier of the operation page when the page identifier of the operation page is different from the recorded page identifier to obtain page recording data corresponding to the page turning operation;
and the page record data uploading module is used for uploading the page record data to a server, wherein the server is used for generating the record fragment data corresponding to the operation page according to the page record data.
14. A data processing device based on intelligent interaction equipment is characterized by comprising:
a data obtaining module, configured to obtain recording segment data corresponding to a display page, where the recording segment data at least includes: recording segment identification, page recording data and a recording file uploaded by intelligent interaction equipment, wherein the recording segment data are generated by a server according to the page recording data uploaded by the intelligent interaction equipment, and the page recording data are obtained by recording the page recording data according to the page identification of an operation page after the intelligent interaction equipment receives page turning operation;
the audio playing module is used for playing audio according to the recording fragment data;
the page recorded data detection module is used for detecting whether the recorded fragment data contains target page recorded data corresponding to the display page or not;
and the page turning display module is used for executing page turning operation according to a target time point corresponding to the target page record data when the record fragment data contains the target page record data, and displaying a page after page turning.
15. An intelligent interaction device, comprising: the touch screen comprises a memory, a display screen with a touch function and one or more processors;
the memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving page turning operation, wherein the page turning operation is submitted aiming at an operation page displayed by the intelligent interaction equipment;
when the intelligent interaction equipment is in a recording state, detecting whether a page identifier of the operation page is the same as a preset recording page identifier or not, wherein the recording page identifier is a page identifier recorded last time;
when the page identification of the operation page is different from the recording page identification, recording according to the page identification of the operation page to obtain page recording data corresponding to the page turning operation;
and uploading the page record data to a server, wherein the server is used for generating record fragment data corresponding to the operation page according to the page record data.
16. A data processing platform, comprising: a processor and a display;
wherein the display is coupled to the processor;
the processor acquires recording segment data corresponding to a display page, performs audio playing according to the recording segment data, and detects whether the recording segment data contains target page recording data corresponding to the display page; if the recording fragment data comprises the target page recording data, executing page turning operation according to a target time point corresponding to the target page recording data, and triggering the display to display a page after page turning;
the recording section data includes at least: recording segment identification, page recording data and a recording file uploaded by the intelligent interaction device, wherein the recording segment data are generated by the server according to the page recording data uploaded by the intelligent interaction device, and the page recording data are obtained by recording according to the page identification of the operation page after the intelligent interaction device receives page turning operation.
17. A storage medium containing computer-executable instructions for performing the intelligent interactive device-based data processing method of any one of claims 1-9 when executed by a computer processor.
CN201811442939.8A 2018-11-29 2018-11-29 Data processing method based on intelligent interaction equipment and related equipment Active CN109343761B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811442939.8A CN109343761B (en) 2018-11-29 2018-11-29 Data processing method based on intelligent interaction equipment and related equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811442939.8A CN109343761B (en) 2018-11-29 2018-11-29 Data processing method based on intelligent interaction equipment and related equipment

Publications (2)

Publication Number Publication Date
CN109343761A CN109343761A (en) 2019-02-15
CN109343761B true CN109343761B (en) 2021-02-19

Family

ID=65319220

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811442939.8A Active CN109343761B (en) 2018-11-29 2018-11-29 Data processing method based on intelligent interaction equipment and related equipment

Country Status (1)

Country Link
CN (1) CN109343761B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114070576B (en) * 2020-08-07 2024-03-08 腾讯科技（深圳）有限公司 A content display method a content generation method a device(s) apparatus and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102638444A (en) * 2011-06-10 2012-08-15 吴东辉 Network terminal type construction method and network terminal type construction system for application software
CN106056996A (en) * 2016-08-23 2016-10-26 深圳市时尚德源文化传播有限公司 Multimedia interaction teaching system and method

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI413106B (en) * 2010-08-04 2013-10-21 Hon Hai Prec Ind Co Ltd Electronic recording apparatus and method thereof
US20130332421A1 (en) * 2012-06-06 2013-12-12 International Business Machines Corporation Defining Content Retention Rules Using a Domain-Specific Language
CN105763925A (en) * 2014-12-17 2016-07-13 珠海金山办公软件有限公司 Video recording method and device for presentation files
CN106412470A (en) * 2015-08-03 2017-02-15 北京鸿合智能系统股份有限公司 Method of recording desktop PPT information dotting and apparatus thereof
CN105306861B (en) * 2015-10-15 2017-03-01 深圳市鹰硕技术有限公司 A kind of Web-based instruction recorded broadcast method and system
CN105450944A (en) * 2015-11-13 2016-03-30 北京自由坊科技有限责任公司 Method and device for synchronously recording and reproducing slides and live presentation speech
CN107920280A (en) * 2017-03-23 2018-04-17 广州思涵信息科技有限公司 The accurate matched method and system of video, teaching materials PPT and voice content
CN108460120A (en) * 2018-02-13 2018-08-28 广州视源电子科技股份有限公司 Data save method, device, terminal device and storage medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102638444A (en) * 2011-06-10 2012-08-15 吴东辉 Network terminal type construction method and network terminal type construction system for application software
CN106056996A (en) * 2016-08-23 2016-10-26 深圳市时尚德源文化传播有限公司 Multimedia interaction teaching system and method

Also Published As

Publication number Publication date
CN109343761A (en) 2019-02-15

Similar Documents

Publication Publication Date Title
WO2020108403A1 (en) Courseware making and reviewing method, apparatus and system, device, and storage medium
US20150120816A1 (en) Tracking use of content of an online library
CN110647303A (en) Multimedia playing method, device, storage medium and electronic equipment
CN104050266B (en) User behavior recording method, device and web browser
CN110166842B (en) Video file operation method and device and storage medium
US10275341B2 (en) Mobile application usability testing
US20180047429A1 (en) Streaming digital media bookmark creation and management
CN103916829A (en) Desktop message notifying method and device
WO2017156983A1 (en) List callup method and device
CN112188267B (en) Video playing method, device and equipment and computer storage medium
MX2014003452A (en) Display apparatus for providing recommendation information and method thereof.
WO2019052053A1 (en) Whiteboard information reading method and device, readable storage medium and electronic whiteboard
US10091452B2 (en) Electronic device and method for recording and displaying script
CN111901695B (en) Video content interception method, device and equipment and computer storage medium
WO2015074568A1 (en) Method and device for collaborative document review
CN107239351A (en) Method of attaching and device
WO2016112791A1 (en) Method and device for displaying interface of application program on mobile terminal
CN104536787A (en) Resource preloading method and device
CN109788223A (en) Data processing method and relevant device based on intelligent interaction device
CN104951184A (en) Application program downloading method and device
CN104035764A (en) Object control method and relevant device
CN109343761B (en) Data processing method based on intelligent interaction equipment and related equipment
WO2023241360A1 (en) Online class voice interaction methods and apparatus, device and storage medium
CN112286617A (en) Operation guidance method and device and electronic equipment
EP2960795B1 (en) A computer implemented non-intrusive remote monitoring and capturing system and a method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant