CN112954248A - Multi-screen recording method and device, multi-screen equipment and computer readable storage medium - Google Patents

Multi-screen recording method and device, multi-screen equipment and computer readable storage medium Download PDF

Info

Publication number
CN112954248A
CN112954248A CN202110194738.6A CN202110194738A CN112954248A CN 112954248 A CN112954248 A CN 112954248A CN 202110194738 A CN202110194738 A CN 202110194738A CN 112954248 A CN112954248 A CN 112954248A
Authority
CN
China
Prior art keywords
screen
trigger signal
coordinate
recording area
screen trigger
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110194738.6A
Other languages
Chinese (zh)
Other versions
CN112954248B (en
Inventor
赵起超
杨苒
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kingfar International Inc
Original Assignee
Kingfar International Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kingfar International Inc filed Critical Kingfar International Inc
Priority to CN202110194738.6A priority Critical patent/CN112954248B/en
Publication of CN112954248A publication Critical patent/CN112954248A/en
Application granted granted Critical
Publication of CN112954248B publication Critical patent/CN112954248B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334Recording operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally

Abstract

The application relates to a multi-screen recording method, a multi-screen recording device, multi-screen equipment and a computer readable storage medium, wherein the method comprises the following steps: establishing a coordinate system based on a main screen of a plurality of screens; receiving recording area outline information input by a user; receiving at least two screen trigger signals based on the contour information of the recording area, and acquiring coordinates of coordinate points of the recording area; and calling an interface method of a video capture module, inputting the coordinates of the coordinate points of the recording area, and waiting for acquiring screen frame image data. The problem of can not carry out the screen to a plurality of screens simultaneously and record is solved, this application has the effect of carrying out the screen to a plurality of screens simultaneously and recording.

Description

Multi-screen recording method and device, multi-screen equipment and computer readable storage medium
Technical Field
The present application relates to the field of human-computer interaction and user experience technologies, and in particular, to a multi-screen recording method and apparatus, a multi-screen device, and a computer-readable storage medium.
Background
With the development of information processing technologies such as communications and computers, attention is paid to a human-computer interaction system. In the development process, the user experience of the human-computer interaction system needs to be measured, so that the cost of the user in the process of interacting with the interface is reduced, and the requirement of the user on interaction is stimulated. In a user experience experiment for a human-computer interaction system, varying experimental stimuli are usually presented to a human subject through a window, and the experimental stimuli include pictures, sounds, videos and the like. Moreover, a screen recording mode is required to record the stimulation picture seen by the testee at each moment, data information such as physiology, expression and motion capture of the testee is collected, a screen recording video in the experimental process corresponds to the moment of change of the physiology, expression and motion of the testee, and the influence degree of the product presented in the screen recording mode on the physiology, expression and motion of the human body is researched.
In order to better provide experimental stimulation to the subject, it is sometimes necessary to display different contents through a plurality of display screens. However, when the screen needs to be recorded, the main screen is generally recorded by default, and the screen recording cannot be performed on a plurality of screens at the same time.
Disclosure of Invention
In order to record a plurality of screens simultaneously, the application provides a multi-screen recording method, a multi-screen recording device, multi-screen equipment and a computer readable storage medium.
In a first aspect, the present application provides a multi-screen recording method, which adopts the following technical scheme:
a multi-screen recording method comprises the following steps:
establishing a coordinate system based on a main screen of a plurality of screens;
receiving recording area outline information input by a user;
receiving at least two screen trigger signals based on the contour information of the recording area, and acquiring coordinates of coordinate points of the recording area;
and calling an interface method of a video capture module, inputting the coordinates of the coordinate points of the recording area, and waiting for acquiring screen frame image data.
Preferably, the recording area profile information includes a rectangle, a circle, or a regular triangle, and the receiving at least two screen trigger signals based on the recording area profile information and acquiring coordinates of coordinate points of the recording area includes:
receiving a first screen trigger signal and acquiring a coordinate of a first trigger point;
receiving a second screen trigger signal and acquiring a coordinate of a second trigger point;
judging whether the distance between the second trigger point and the first trigger point exceeds a first preset pixel or not;
if so, acquiring coordinates of the coordinate point of the recording area according to the first trigger point and the second trigger point;
if not, the screen trigger signal is waited to be received again.
Preferably, the first screen trigger signal is a signal generated by a user finger touching a screen or clicking a mouse; the second screen trigger signal is a signal generated by the user finger leaving the screen or releasing the mouse.
Preferably, the recording area profile information includes an irregular polygon, and the receiving at least two screen trigger signals based on the recording area profile information and acquiring coordinates of coordinate points of the recording area includes:
receiving a current screen trigger signal, and acquiring the coordinates of a trigger point corresponding to the current screen trigger signal;
judging whether the current screen trigger signal is a first screen trigger signal or not;
if the current screen trigger signal is the first screen trigger signal, waiting for receiving the next screen trigger signal, taking the next screen trigger signal as the current screen trigger signal, continuing to receive the current screen trigger signal, and acquiring the coordinates of a trigger point corresponding to the current screen trigger signal;
if the current screen trigger signal is not the first screen trigger signal, judging whether the distance between the trigger points corresponding to the current screen trigger signal and the previous screen trigger signal exceeds a second preset pixel or not;
if the current screen trigger signal does not exceed the second preset pixel, deleting the first screen trigger signal, waiting for receiving the next screen trigger signal, taking the next screen trigger signal as the current screen trigger signal, continuing to receive the current screen trigger signal, and acquiring the coordinate of a trigger point corresponding to the current screen trigger signal;
if the current screen trigger signal exceeds the second preset pixel, judging whether the distance between the current screen trigger signal and the trigger point corresponding to the first screen trigger signal exceeds a third preset pixel;
if the current screen trigger signal exceeds the third preset pixel, waiting for receiving a next screen trigger signal, taking the next screen trigger signal as a current screen trigger signal, continuing to receive the current screen trigger signal, and acquiring the coordinates of a trigger point corresponding to the current screen trigger signal;
and if the coordinate of the coordinate point of the recording area is not beyond the third preset pixel, acquiring the coordinate of the coordinate point of the recording area according to the trigger points corresponding to all the screen trigger signals.
Preferably, the establishing a coordinate system based on the home screen of the plurality of screens includes:
identifying a primary screen of the plurality of screens;
and establishing the coordinate system by taking any corner point of the main screen as a coordinate origin.
Preferably, the method further comprises the following steps:
after receiving the screen trigger signal, acquiring a first coordinate of a trigger point corresponding to the screen trigger signal;
acquiring a second coordinate of an angular point which is the same as the position of the origin of coordinates in a screen receiving the screen trigger signal;
subtracting the x coordinate of the second coordinate from the first coordinate to obtain a new x coordinate;
subtracting the y coordinate of the second coordinate from the first coordinate to obtain a new y coordinate;
and displaying the new coordinates of the trigger point corresponding to the screen trigger signal.
In a second aspect, the present application provides a multi-screen recording apparatus, which adopts the following technical solution:
a multi-screen recording device comprises
A coordinate system establishing module for establishing a coordinate system based on a main screen among the plurality of screens;
the contour receiving module is used for receiving the recording area contour information input by a user;
the coordinate acquisition module is used for receiving at least two screen trigger signals based on the recording area contour information and acquiring coordinates of coordinate points of a recording area;
and the calling module is used for calling an interface method of the video capturing module, inputting the coordinates of the coordinate points of the recording area and waiting for acquiring the screen frame image data.
In a third aspect, the present application provides a multi-screen device, which adopts the following technical scheme:
a multi-screen apparatus includes a memory, a processor, a communication bus, a communication interface, an input device, and a plurality of screens;
the memory, the processor and the communication interface are connected through the communication bus;
the plurality of screens are connected with the communication interface and used for displaying experimental stimulation;
the input device is connected with the communication interface and is used for a user to input a screen to record corresponding actions;
the memory has stored thereon a computer program that can be loaded by the processor and that performs the method of any of the first aspects.
In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solutions:
a computer readable storage medium storing a computer program that can be loaded by a processor and executed to perform the method of any of the first aspects.
By adopting the technical scheme, the coordinate systems of the multiple screens are established by taking the main screen as a reference, then the outline of the area to be recorded and the multiple screen trigger signals input by a user are combined to obtain the outline coordinate information of the recording area, and finally the interface method of the video capture module is called to record the video of the recording area, so that the recording of a single screen can be realized, and the recording of the multiple screens can be realized simultaneously.
Drawings
Fig. 1 is a flowchart illustrating a multi-screen recording method according to an embodiment of the present application.
Fig. 2 is a schematic diagram of selecting a recording area on seamlessly spliced screens a and B according to an embodiment of the present application.
Fig. 3 is a schematic flowchart of step S300 in this embodiment of the present application.
Fig. 4 is another schematic flow chart of step S300 in the embodiment of the present application.
Fig. 5 is a block diagram of a multi-screen recording apparatus 500 according to an embodiment of the present application.
Fig. 6 is a block diagram of a multi-screen device 600 according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
Fig. 1 is a flowchart illustrating a multi-screen recording method according to this embodiment. As shown in fig. 1, the main flow of the method is described as follows (steps S100 to S400):
step S100, establishing a coordinate system based on a main screen in a plurality of screens;
in this embodiment, the plurality of screens are connected to the electronic device host through the peripheral device interface, and may display the same experimental stimulus content or different experimental stimulus contents. The sizes of the screens can be the same or different, but seamless splicing of the screens is required to be ensured.
It is generally necessary to set a main screen defined by a multi-display setting and a sub-screen, and it is possible to recognize that screen as the main screen by reading the program variable.
After the main screen is identified, a coordinate system is established by taking any one corner point of the main screen as a coordinate origin.
Fig. 2 shows two seamlessly spliced screens a and B, where screen B is the primary screen and screen a is the secondary screen. As shown in fig. 2, a coordinate system of the whole spliced screen is established with an upper left corner point of the screen B as a coordinate origin o, an upper frame along the screen B as a positive x-axis direction, and a left frame along the screen B as a positive y-axis direction.
The screen image is composed of a plurality of pixel points, if the image resolution is 1920 × 1080, the number of pixels possessed by the screen image in the length and width directions is 1920 and 1080 in sequence, and therefore, the coordinates (x, y) of the established coordinate system represent the number of pixels in the length and width directions of the screen corresponding to the coordinate points.
Of course, other three corner points of the screen B may also be used as the origin of coordinates to establish a coordinate system, which is not described herein again.
Step S200, receiving recording area contour information input by a user;
in this embodiment, before the user triggers the screen, the profile information of the recording area needs to be input. The recording area outline information represents the outline shape which the user wants to record the video to finally present, such as rectangle, circle, regular triangle, irregular polygon, etc.
The user can input the profile information of the recording area by means of keyboard input, touch screen input, voice input and the like.
Step S300, receiving at least two screen trigger signals based on the contour information of the recording area, and acquiring the coordinates of the coordinate points of the recording area;
in this embodiment, the coordinates of the coordinate points in the recording area are coordinates of a plurality of points on the contour finally presented by the recorded video, so that a corresponding interface method is called in the following process to record the video.
The way of obtaining the coordinate point of the final recording area is different for the contour shapes of different recording areas.
When the recording area profile information includes a rectangle, a circle, or a regular triangle, as shown in fig. 3, step S300 includes:
step S3011, receiving a first screen trigger signal and acquiring a coordinate of a first trigger point;
step S3012, receiving a second screen trigger signal and acquiring a coordinate of a second trigger point;
in this embodiment, the first screen trigger signal is a signal generated by clicking a mouse when a finger of a user touches a first trigger point of the screen or moves a cursor to the first trigger point; the second screen trigger signal is a signal generated by releasing the mouse when the finger of the user leaves a second trigger point of the screen or moves the cursor to the second trigger point.
That is, with the first trigger point as a starting point, the finger slides on the screen according to a certain sliding track, and with the second trigger point as a stopping point; or pressing down the mouse by taking the first trigger point as a starting point, dragging the mouse according to a certain sliding track, and releasing the mouse by taking the second trigger point as a stopping point.
The first trigger point and the second trigger point may be located on the same screen or may be located on different screens, depending on the extent size of the recording area.
Step S3013, determining whether the distance between the second trigger point and the first trigger point exceeds a first preset pixel, if yes, going to step S3014, and if no, going to step S3015;
step S3014, obtaining coordinates of a coordinate point of the recording area according to the first trigger point and the second trigger point;
step S3015, waits for receiving the first screen trigger again.
In this embodiment, if the second trigger point coincides with the first trigger point, the recording area cannot be selected, an error is prompted, and the first screen trigger signal needs to be received again. Of course, when determining whether the second trigger point coincides with the first trigger point, an error is allowed, that is, whether the distance between the second trigger point and the first trigger point exceeds the first preset pixel is determined, if so, it is determined that the second trigger point and the first trigger point do not coincide, otherwise, it is determined that the second trigger point and the first trigger point coincide.
Wherein the distance d1 between the second trigger point (x2, y2) and the first trigger point (x1, y1), i.e. the distance d1, can be calculated by the pythagorean theorem
Figure BDA0002946157730000051
And if the second trigger point is not overlapped with the first trigger point, the recording area is successfully selected, and the coordinates of each point on the contour of the recording area can be obtained through the coordinates of the first trigger point and the second trigger point.
Specifically, if the contour shape of the recording area is a rectangle, the default first trigger point and the default second trigger point are a pair of diagonal points of the rectangle, and then the coordinates of each point on the contour of the recording area can be obtained.
If the contour shape of the recording area is circular, the default first trigger point is the circle center of the circle, and the distance between the second trigger point and the first trigger point represents the radius of the circle, so that the coordinates of each point on the contour of the recording area can be obtained.
If the contour shape of the recording area is a regular triangle, the default first trigger point is the center of the regular triangle, the default second trigger point is the corner point of the regular triangle, and the coordinates of each point on the contour of the recording area can be obtained.
When the recording area profile information includes an irregular polygon, as shown in fig. 4, step S300 includes:
step S3021, receiving a current screen trigger signal, and acquiring coordinates of a trigger point corresponding to the current screen trigger signal;
step S3022, judging whether the current screen trigger signal is the first screen trigger signal, if so, turning to step S3023, and if not, turning to step S3024;
step S3023, waiting for receiving a next screen trigger signal, taking the next screen trigger signal as a current screen trigger signal, and proceeding to step S3021;
step S3024, determining whether the distance between the trigger points corresponding to the current screen trigger signal and the previous screen trigger signal exceeds a second preset pixel, if not, turning to step S3025, and if so, turning to step S3026;
step S3025, deleting the first screen trigger signal, and turning to step S3023;
step S3026, determining whether the distance between the current screen trigger signal and the trigger point corresponding to the first screen trigger signal exceeds a third preset pixel, if yes, turning to step S3023, and if not, turning to step S3027;
step S3027, obtaining coordinates of coordinate points of the recording area according to the trigger points corresponding to all the screen trigger signals.
In this embodiment, the first screen trigger signal is a screen trigger signal received for the first time after receiving the recording area profile information input by the user. And after determining that the current screen trigger signal is a first screen trigger signal, recording the first screen trigger signal.
Only when the current screen trigger signal is not the first screen trigger signal, whether the trigger points corresponding to the current screen trigger signal and the previous screen trigger signal are overlapped, namely whether the distance between the current screen trigger signal and the previous screen trigger signal exceeds a second preset pixel can be judged.
And if the current screen trigger signal is superposed with the trigger point corresponding to the previous screen trigger signal, deleting the recorded first screen trigger signal, waiting for the user to input a new screen trigger signal again, and recording the new screen trigger signal as the first screen trigger signal.
Only when the trigger point corresponding to the current screen trigger signal and the previous screen trigger signal is not overlapped, whether the current screen trigger signal is overlapped with the first screen trigger signal or not, namely whether the distance between the current screen trigger signal and the first screen trigger signal exceeds a third preset pixel or not can be judged.
If the current screen trigger signal is overlapped with the trigger point corresponding to the first screen trigger signal, judging that the outline of the recording area is closed, and connecting two adjacent trigger points by using a straight line or a curve for meeting the recording area of the condition, thereby obtaining a coordinate point on the straight line or the curve, and forming the coordinate point of the recording area together with the trigger points corresponding to all the effective screen trigger signals.
In this embodiment, the calculation formula of the distance d2 between the trigger points corresponding to the current screen trigger signal and the previous screen trigger signal and the distance d3 between the trigger points corresponding to the current screen trigger signal and the first screen trigger signal is the same as the distance d1 between the second trigger point and the first trigger point, and details thereof are not repeated here.
The values of the first preset pixel, the second preset pixel and the third preset pixel can be the same or different. When the values are taken to be the same, it may be set to 10.
It should be noted that, when the recording area is an irregular polygon, each screen trigger signal is a signal generated by a user clicking a screen once with a finger or a mouse once with a mouse.
Step S400, calling an interface method of the video capture module, inputting the coordinates of the coordinate points of the recording area, and waiting for acquiring the screen frame image data.
In this embodiment, an interface method of an associated.video.directshow.dll file of the existing video capture module may be invoked, and after the coordinates of the coordinate point of the recording area acquired in step S300 are input, a screen recording triggering operation of the user is waited. And when receiving a screen recording triggering operation of a user, starting to acquire screen frame image data in the recording area.
Further, each time a screen trigger signal is received, the coordinates of the trigger point corresponding to the screen trigger signal need to be displayed on the current screen where the screen trigger signal is received.
However, since the coordinate system is established based on the main screen, there may occur a case where the coordinates of the point on the sub-screen are negative (as shown in fig. 2), and thus, in order to display the positive coordinates, the coordinates need to be converted.
Specifically, after receiving a screen trigger signal, acquiring a first coordinate of a trigger point corresponding to the screen trigger signal; acquiring a second coordinate of an angular point which is the same as the position of the origin of coordinates in a screen for receiving the screen trigger signal; subtracting the x coordinate of the second coordinate from the first coordinate to obtain a new x coordinate; subtracting the y coordinate of the second coordinate from the first coordinate to obtain a new y coordinate; and displaying the new coordinates of the trigger point corresponding to the screen trigger signal.
As shown in fig. 2, the recording area is rectangular, and the actual coordinates (xa, ya) of the start point a and the actual coordinates (xb, yb) of the stop point b. In order to obtain the display coordinates of the starting point a, the coordinates (xo ', yo ') of the point o ' corresponding to the position of the origin o of the coordinates on the screen a are also obtained, and after the coordinates are converted, the display coordinates of the starting point a are (xa-xo ', ya-yo '). Similarly, the display coordinates of the stopping point b are (xb-xo ', yb-yo').
Fig. 5 is a block diagram of a multi-screen recording apparatus 500 according to an embodiment of the present disclosure. As shown in fig. 5, the multi-screen recording apparatus 500 mainly includes:
a coordinate system establishing module 501 for establishing a coordinate system based on a main screen among the plurality of screens;
a contour receiving module 502, configured to receive recording area contour information input by a user;
a coordinate obtaining module 503, configured to receive at least two screen trigger signals based on the recording area profile information, and obtain coordinates of a coordinate point of the recording area;
the calling module 504 is configured to call an interface method of the video capture module, input coordinates of a coordinate point of the recording area, and wait for acquiring screen frame image data.
The functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part. The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing an electronic device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application.
Various changes and specific examples in the method provided by the embodiment of the present application are also applicable to the multi-screen recording apparatus provided by the embodiment of the present application, and through the foregoing detailed description of the multi-screen recording method, those skilled in the art can clearly know the implementation method of the multi-screen recording apparatus in the embodiment, and for the sake of brevity of the description, detailed descriptions are not provided herein.
Fig. 6 is a block diagram of a multi-screen device 600 according to an embodiment of the present disclosure. The multi-screen device 600 can be a mobile phone, a tablet computer, a PC, a server, or the like. As shown in fig. 6, the electronic apparatus 600 includes a memory 601, a processor 602, a communication bus 603, a communication interface 604, an input device 605, and a plurality of screens 606. The memory 601, the processor 602 and the communication interface 604 are connected through a communication bus 603; a plurality of screens 606 are connected to the communication interface 604 for displaying the experimental stimuli; an input device 605 is coupled to the communication interface 604 for user input of screen recordings of corresponding actions.
The input device 605 may be a common PC peripheral component such as a keyboard and a mouse, or may be integrated with the screen 605 to form a touch display screen, so as to implement a touch screen input function.
The memory 601 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 601 may include a program storage area and a data storage area, where the program storage area may store instructions for implementing an operating system, instructions for at least one function, instructions for implementing the multi-screen recording method provided in the above embodiments, and the like; the data storage area can store data and the like related to the multi-screen recording method provided by the embodiment.
Processor 602 may include one or more processing cores. The processor 602 executes various functions of the present application and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 601 to invoke data stored in the memory 601. The Processor 602 may be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microprocessor. It is understood that the electronic devices for implementing the functions of the processor 602 may be other devices, and the embodiments of the present application are not limited in particular.
Embodiments of the present application provide a computer-readable storage medium, which stores a computer program that can be loaded by a processor and execute the multi-screen recording method provided in the foregoing embodiments.
In this embodiment, the computer readable storage medium may be a tangible device that retains and stores instructions for use by an instruction execution device. The computer readable storage medium may be, but is not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any combination of the foregoing. In particular, the computer readable storage medium may be a portable computer diskette, a hard disk, a U-disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a podium random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, an optical disk, a magnetic disk, a mechanical coding device, and any combination thereof.
The computer program in the present embodiment includes a program code for executing the method shown in fig. 1, and the program code may include instructions corresponding to the method steps provided in the foregoing embodiments. The computer program may be downloaded to the respective computing/processing device from a computer-readable storage medium, or may be downloaded to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The computer program may execute entirely on the user's computer, as a stand-alone software package.
In addition, it is to be understood that relational terms such as first and second, and the like, are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims (9)

1. A multi-screen recording method is characterized by comprising the following steps:
establishing a coordinate system based on a main screen of a plurality of screens;
receiving recording area outline information input by a user;
receiving at least two screen trigger signals based on the contour information of the recording area, and acquiring coordinates of coordinate points of the recording area;
and calling an interface method of a video capture module, inputting the coordinates of the coordinate points of the recording area, and waiting for acquiring screen frame image data.
2. The method of claim 1, wherein the recording area profile information comprises a rectangle, a circle, or a regular triangle, and wherein receiving at least two screen trigger signals based on the recording area profile information and obtaining coordinates of coordinate points of a recording area comprises:
receiving a first screen trigger signal and acquiring a coordinate of a first trigger point;
receiving a second screen trigger signal and acquiring a coordinate of a second trigger point;
judging whether the distance between the second trigger point and the first trigger point exceeds a first preset pixel or not;
if so, acquiring coordinates of the coordinate point of the recording area according to the first trigger point and the second trigger point;
if not, the screen trigger signal is waited to be received again.
3. The method of claim 2, wherein the first screen trigger signal is a signal generated by a user's finger touching a screen or clicking a mouse; the second screen trigger signal is a signal generated by the user finger leaving the screen or releasing the mouse.
4. The method of claim 1, wherein the recording area profile information includes an irregular polygon, wherein receiving at least two screen trigger signals based on the recording area profile information, and wherein obtaining coordinates of coordinate points of a recording area comprises:
receiving a current screen trigger signal, and acquiring the coordinates of a trigger point corresponding to the current screen trigger signal;
judging whether the current screen trigger signal is a first screen trigger signal or not;
if the current screen trigger signal is the first screen trigger signal, waiting for receiving the next screen trigger signal, taking the next screen trigger signal as the current screen trigger signal, continuing to receive the current screen trigger signal, and acquiring the coordinates of a trigger point corresponding to the current screen trigger signal;
if the current screen trigger signal is not the first screen trigger signal, judging whether the distance between the trigger points corresponding to the current screen trigger signal and the previous screen trigger signal exceeds a second preset pixel or not;
if the current screen trigger signal does not exceed the second preset pixel, deleting the first screen trigger signal, waiting for receiving the next screen trigger signal, taking the next screen trigger signal as the current screen trigger signal, continuing to receive the current screen trigger signal, and acquiring the coordinate of a trigger point corresponding to the current screen trigger signal;
if the current screen trigger signal exceeds the second preset pixel, judging whether the distance between the current screen trigger signal and the trigger point corresponding to the first screen trigger signal exceeds a third preset pixel;
if the current screen trigger signal exceeds the third preset pixel, waiting for receiving a next screen trigger signal, taking the next screen trigger signal as a current screen trigger signal, continuing to receive the current screen trigger signal, and acquiring the coordinates of a trigger point corresponding to the current screen trigger signal;
and if the coordinate of the coordinate point of the recording area is not beyond the third preset pixel, acquiring the coordinate of the coordinate point of the recording area according to the trigger points corresponding to all the screen trigger signals.
5. The method of any of claims 1 to 4, wherein establishing a coordinate system based on a home screen of the plurality of screens comprises:
identifying a primary screen of the plurality of screens;
and establishing the coordinate system by taking any corner point of the main screen as a coordinate origin.
6. The method of claim 5, further comprising:
after receiving the screen trigger signal, acquiring a first coordinate of a trigger point corresponding to the screen trigger signal;
acquiring a second coordinate of an angular point which is the same as the position of the origin of coordinates in a screen receiving the screen trigger signal;
subtracting the x coordinate of the second coordinate from the first coordinate to obtain a new x coordinate;
subtracting the y coordinate of the second coordinate from the first coordinate to obtain a new y coordinate;
and displaying the new coordinates of the trigger point corresponding to the screen trigger signal.
7. A multi-screen recording device, comprising:
a coordinate system establishing module for establishing a coordinate system based on a main screen among the plurality of screens;
the contour receiving module is used for receiving the recording area contour information input by a user;
the coordinate acquisition module is used for receiving at least two screen trigger signals based on the recording area contour information and acquiring coordinates of coordinate points of a recording area;
and the calling module is used for calling an interface method of the video capturing module, inputting the coordinates of the coordinate points of the recording area and waiting for acquiring the screen frame image data.
8. A multi-screen apparatus, comprising a memory, a processor, a communication bus, a communication interface, an input device, and a plurality of screens;
the memory, the processor and the communication interface are connected through the communication bus;
the plurality of screens are connected with the communication interface and used for displaying experimental stimulation;
the input device is connected with the communication interface and is used for a user to input a screen to record corresponding actions;
the memory has stored thereon a computer program that can be loaded by the processor and that executes the method according to any of claims 1 to 6.
9. A computer-readable storage medium, in which a computer program is stored which can be loaded by a processor and which executes the method of any one of claims 1 to 6.
CN202110194738.6A 2021-02-21 2021-02-21 Multi-screen recording method and device, multi-screen equipment and computer readable storage medium Active CN112954248B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110194738.6A CN112954248B (en) 2021-02-21 2021-02-21 Multi-screen recording method and device, multi-screen equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110194738.6A CN112954248B (en) 2021-02-21 2021-02-21 Multi-screen recording method and device, multi-screen equipment and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN112954248A true CN112954248A (en) 2021-06-11
CN112954248B CN112954248B (en) 2022-12-02

Family

ID=76245022

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110194738.6A Active CN112954248B (en) 2021-02-21 2021-02-21 Multi-screen recording method and device, multi-screen equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN112954248B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140033129A1 (en) * 2012-07-26 2014-01-30 Hon Hai Precision Industry Co., Ltd. Computing device and method for controlling desktop applications
CN105808137A (en) * 2015-01-21 2016-07-27 Lg电子株式会社 Mobile terminal and method for controlling the same
CN109981898A (en) * 2019-03-14 2019-07-05 维沃移动通信有限公司 A kind of method, apparatus and terminal of record screen
CN110688051A (en) * 2019-09-23 2020-01-14 捷开通讯(深圳)有限公司 Screen recording operation method and device, computer readable storage medium and terminal
CN111338536A (en) * 2020-05-20 2020-06-26 北京小米移动软件有限公司 Screen recording method and device of multi-screen electronic equipment, multi-screen electronic equipment and storage medium
CN111679772A (en) * 2020-08-17 2020-09-18 深圳诚一信科技有限公司 Screen recording method and system, multi-screen device and readable storage medium
CN112162669A (en) * 2020-10-10 2021-01-01 珠海格力电器股份有限公司 Screen recording method and device of intelligent terminal, storage medium and processor

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140033129A1 (en) * 2012-07-26 2014-01-30 Hon Hai Precision Industry Co., Ltd. Computing device and method for controlling desktop applications
CN105808137A (en) * 2015-01-21 2016-07-27 Lg电子株式会社 Mobile terminal and method for controlling the same
CN109981898A (en) * 2019-03-14 2019-07-05 维沃移动通信有限公司 A kind of method, apparatus and terminal of record screen
CN110688051A (en) * 2019-09-23 2020-01-14 捷开通讯(深圳)有限公司 Screen recording operation method and device, computer readable storage medium and terminal
CN111338536A (en) * 2020-05-20 2020-06-26 北京小米移动软件有限公司 Screen recording method and device of multi-screen electronic equipment, multi-screen electronic equipment and storage medium
CN111679772A (en) * 2020-08-17 2020-09-18 深圳诚一信科技有限公司 Screen recording method and system, multi-screen device and readable storage medium
CN112162669A (en) * 2020-10-10 2021-01-01 珠海格力电器股份有限公司 Screen recording method and device of intelligent terminal, storage medium and processor

Also Published As

Publication number Publication date
CN112954248B (en) 2022-12-02

Similar Documents

Publication Publication Date Title
EP3907595A1 (en) User interface display method and apparatus, terminal and storage medium
KR102033863B1 (en) Device and method for processing touch input based on intensity
CN109164964B (en) Content sharing method and device, terminal and storage medium
WO2019174477A1 (en) User interface display method and device, and terminal
US8760557B2 (en) User interface for a digital camera
US8587543B2 (en) Display control device and display control method
CN107577414A (en) The method and mobile terminal of split screen display available
EP3690624A1 (en) Display device and method of controlling the same
US20140006033A1 (en) Method and apparatus for processing multiple inputs
WO2019047147A1 (en) Icon moving method and device
KR20140124278A (en) Method for adjusting display area and an electronic device thereof
CN107172347B (en) Photographing method and terminal
WO2017032078A1 (en) Interface control method and mobile terminal
WO2011091762A1 (en) Component display processing method and user device
US20150169134A1 (en) Methods circuits apparatuses systems and associated computer executable code for providing projection based human machine interfaces
CN109683841B (en) Control display method and computing device in multi-display environment
KR20130082352A (en) Apparatus and method for zooming touch screen in electronic device
US20180088665A1 (en) Eye tracking selection validation
CN113655929A (en) Interface display adaptation processing method and device and electronic equipment
US10831338B2 (en) Hiding regions of a shared document displayed on a screen
KR20150027687A (en) A method and system for providing user interaction when capturing content in an electronic device
US9958946B2 (en) Switching input rails without a release command in a natural user interface
US9256358B2 (en) Multiple panel touch user interface navigation
CN112954248B (en) Multi-screen recording method and device, multi-screen equipment and computer readable storage medium
CN107562346A (en) Terminal control method, device, terminal and computer-readable recording medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant