CN113760139A - Information processing method and device, equipment and storage medium - Google Patents
Information processing method and device, equipment and storage medium Download PDFInfo
- Publication number
- CN113760139A CN113760139A CN202110969930.8A CN202110969930A CN113760139A CN 113760139 A CN113760139 A CN 113760139A CN 202110969930 A CN202110969930 A CN 202110969930A CN 113760139 A CN113760139 A CN 113760139A
- Authority
- CN
- China
- Prior art keywords
- display screen
- external display
- desktop
- screen
- system desktop
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 22
- 238000003672 processing method Methods 0.000 title claims abstract description 16
- 238000000034 method Methods 0.000 claims abstract description 62
- 238000004891 communication Methods 0.000 claims description 8
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 238000004590 computer program Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000005266 casting Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Abstract
The application discloses an information processing method, an information processing device, information processing equipment and a storage medium; wherein the method comprises the following steps: screen projection connection with an external display screen is established based on the screen projection instruction; if the screen projection connection with the external display screen is successful, determining a desktop screen projection mode; based on the desktop screen projection mode, projecting a first system desktop corresponding to the desktop screen projection mode to the external display screen; and determining to run the calibration service based on the desktop screen projection mode and the parameter information of the external display screen.
Description
Technical Field
The embodiment of the application relates to electronic technology, and relates to but is not limited to an information processing method, an information processing device, information processing equipment and a storage medium.
Background
After the display content is projected onto the display device, a problem often arises that the display content cannot be fully presented on the display device. For this case, the user is often prompted to manually adjust keys on the display device to zoom or move the display left or right, in the form of a tutorial or notification. However, not only does the above approach require the user to perform a large number of operations on the display device, but the result may also be unsatisfactory, resulting in a poor user experience.
Disclosure of Invention
In view of this, the information processing method, apparatus, device, and storage medium provided in the embodiments of the present application are implemented as follows:
according to an aspect of an embodiment of the present application, there is provided an information processing method including: screen projection connection with an external display screen is established based on the screen projection instruction; if the screen projection connection with the external display screen is successful, determining a desktop screen projection mode; based on the desktop screen projection mode, projecting a first system desktop corresponding to the desktop screen projection mode to the external display screen; and determining to run the calibration service based on the desktop screen projection mode and the parameter information of the external display screen.
According to an aspect of an embodiment of the present application, there is provided an electronic device including a body; the communication device is used for establishing screen projection connection with an external display screen based on the screen projection instruction; a processor disposed on the body for: if the screen projection connection with the external display screen is successful, determining a desktop screen projection mode; based on the desktop screen projection mode, projecting a first system desktop corresponding to the desktop screen projection mode to the external display screen; and determining to run the calibration service based on the desktop screen projection mode and the parameter information of the external display screen.
According to an aspect of the embodiments of the present application, there is provided a computer-readable storage medium on which a computer program is stored, the computer program, when executed by a processor, implementing the method provided by the embodiments of the present application.
In the embodiment of the application, after the electronic equipment is successfully connected with the external display screen in a screen projection manner, the desktop screen projection mode is determined, the first system desktop corresponding to the desktop screen projection mode is projected to the external display screen based on the desktop screen projection mode, and then the calibration service is determined to run based on the desktop screen projection mode and the parameter information of the external display screen. So, when the structural problem because outside display screen leads to the content of first system desktop can not be presented completely, carry out automatic calibration to first system desktop through electronic equipment, can make the content of first system desktop present completely on outside display screen, and do not need user's manual calibration to can promote user's impression and use experience, and save user's learning cost.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the application. It is obvious that the drawings in the following description are only some embodiments of the application, and that for a person skilled in the art, other drawings can be derived from them without inventive effort.
The flow charts shown in the drawings are merely illustrative and do not necessarily include all of the contents and operations/steps, nor do they necessarily have to be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
Fig. 1 is a schematic flow chart illustrating an implementation of an information processing method according to an embodiment of the present application;
fig. 2 is a schematic flow chart illustrating an implementation of an information processing method according to an embodiment of the present application;
fig. 3 is a schematic flow chart illustrating an implementation of an information processing method according to an embodiment of the present application;
fig. 4 is a schematic diagram of a bullet box reminder provided in the embodiment of the present application;
fig. 5 is a schematic diagram illustrating a screen shot content display according to an embodiment of the present application in a partial state;
FIG. 6 is a schematic diagram illustrating a specific location of a desktop with a reference identifier according to an embodiment of the present disclosure;
FIG. 7 is a schematic diagram of another desktop specific location adding reference identifier provided in the embodiment of the present application;
fig. 8 is a schematic flow chart illustrating an implementation of an information processing method according to an embodiment of the present application;
FIG. 9 is a schematic diagram of a projected content overflow display screen according to an embodiment of the present application;
FIG. 10 is a schematic diagram of a method for prompting a user to manually adjust a display according to an embodiment of the present disclosure;
fig. 11 is a schematic flow chart illustrating an implementation of an information processing method according to an embodiment of the present application;
fig. 12 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, specific technical solutions of the present application will be described in further detail below with reference to the accompanying drawings in the embodiments of the present application. The following examples are intended to illustrate the present application but are not intended to limit the scope of the present application.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of the present application only and is not intended to be limiting of the application.
In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.
It should be noted that reference to the terms "first \ second \ third" in the embodiments of the present application does not denote a particular ordering with respect to the objects, and it should be understood that "first \ second \ third" may be interchanged under certain circumstances or of a certain order, such that the embodiments of the present application described herein may be performed in an order other than that shown or described herein.
The embodiment of the present application provides an information processing method, which is applied to an electronic device, and the electronic device may be various types of devices with information processing capability in the implementation process, for example, the electronic device may include a Personal computer (such as a desktop computer, a notebook computer, a mini-notebook computer, a tablet computer, an ultrabook, and the like), a mobile phone, a Personal Digital Assistant (PDA), and the like. And the like. The functions implemented by the method can be implemented by calling program code by a processor in an electronic device, and the program code can be stored in a computer storage medium.
Fig. 1 is a schematic flow chart of an implementation of an information processing method provided in an embodiment of the present application, and as shown in fig. 1, the method may include the following steps 101 to 104:
In the embodiment of the present application, the external display screen may be various types of devices, which is not limited to this. For example, the external display screen may be any one of a display, a television, a projector, a notebook computer, a tablet computer, and the like, and in short, the external display screen may be an electronic device including one display screen.
The screen projection connection between the electronic device and the external display screen may be a wired connection, for example, the electronic device is wired to the external display screen through a High Definition Multimedia Interface (HDMI); the connection may be wireless, but is not limited thereto.
After the screen projection connection is established between the electronic equipment and the external display screen, the electronic equipment can obtain the parameter information of the external display screen. In some embodiments, the parameter information of the external display screen may include a resolution, a screen size, or a resolution corresponding to the screen size.
And 102, if the screen projection connection between the electronic equipment and the external display screen is successful, determining a desktop screen projection mode.
As can be appreciated, the screen projection modes include a desktop screen projection mode, a mirror screen projection mode, and the like. In the desktop screen projection mode, after the electronic device projects a first system desktop (i.e., icons of application programs and system controls for controlling the electronic device are arranged on the first system desktop, and the layout of the first system desktop is determined by a screen based on the external display screen) corresponding to the desktop screen projection mode to the external display screen, on one hand, when relevant operations (for example, operations for the icons of the application programs on the first system desktop or for the system controls) are executed on the first system desktop on the external display screen, the running programs are still on the electronic device, so that the external display screen is not required to have processing capacity, and only a display function is required, and an application scene is wider. In the scene, if the electronic device, such as a smartphone, is connected with an external mouse or/and an external keyboard, the operation or input of the first system desktop corresponding to the desktop screen projection mode can be realized through the external mouse and/or the external keyboard, and in the scene, if the electronic device is not connected with the external mouse or the external keyboard, the operation or input of the first system desktop corresponding to the desktop screen projection mode is realized by using the touch screen of the electronic device as a virtual touch pad (i.e., as a relative coordinate control with an external display screen) or/and a virtual keyboard; on the other hand, the user can also continue to perform other operations on the electronic device, for example, an operation of the electronic device on a mobile phone desktop while the mobile phone is a mobile phone, wherein the mobile phone desktop is laid out with icons of application programs and system controls for controlling the electronic device and is different from the layout of the first system desktop. The operation on the external display screen is not interfered with each other, so that the user experience is better. That is, if the electronic device, such as a smartphone, is connected to an external mouse or/and external keyboard, the external mouse or/and external keyboard is assigned to the first system desktop, and the touch screen or/and virtual keyboard is assigned to the handset desktop. In this scenario, if the electronic device is not connected with an external mouse or an external keyboard, and the touch screen of the electronic device is virtualized as a virtual touch pad or/and a virtual keyboard to realize the operation or input of the first system desktop corresponding to the desktop screen projection mode, the virtual touch pad can be minimized after the operation is completed, and the mobile phone desktop is controlled by the touch screen of the electronic device (i.e., absolute coordinate control with the screen of the mobile phone).
103, the electronic equipment projects a first system desktop corresponding to the desktop screen projecting mode to an external display screen based on the desktop screen projecting mode;
and 104, the electronic equipment determines to run the calibration service based on the desktop screen projection mode and the parameter information of the external display screen.
Before the first system desktop is projected to the external display screen, the electronic equipment adjusts the parameter information of the first system desktop corresponding to the desktop projection mode to be matched with the parameter information of the external display screen according to the parameter information of the electronic equipment and the parameter information of the external display screen, and then projects the first system desktop to the external display screen; therefore, when the screen projection is realized, the phenomenon that the content of the first system desktop overflows or cannot completely occupy the display screen on the external display screen due to the fact that the parameter information of the first system desktop is not matched with the parameter information of the external display screen can be avoided.
In some embodiments, the electronic device adjusts the resolution corresponding to the first system desktop to be the same as the resolution of the external display screen (if the resolution of the external display screen is 640 × 480, the resolution of the first system desktop is adjusted to be 640 × 480) according to the resolution supported by the electronic device and the resolution of the external display screen, and then projects the screen to the external display screen. Therefore, the resolution of the first system desktop projected on the screen is the same as that of the external display screen, so that theoretically, the content of the first system desktop displayed on the external display screen should not overflow.
However, due to the structural problem of the external display screen, when some external display screens are put into use, the problem that edge pixel points are unavailable may occur, and accordingly, the edge pixel points of the screen-projected content displayed on the display screen cannot be presented. Under the condition, when the first system desktop matched with the parameter information of the external display screen is projected to the external display screen, the content of the edge pixel points of the first system desktop cannot be displayed, and therefore the user can be visually presented with the feeling of content overflow of the first system desktop.
For example, assuming that the size of the external display screen is 14 inches, the electronic device is projected onto the external display screen after the size of the first system desktop is set to 14 inches. Due to the structural problem of the external display screen, 0.5 inch pixel points at the edge of the display screen may be displayed in black, so that the problem that the content of the first system desktop is displayed incompletely, namely, the content overflows, is visually presented.
Therefore, in the embodiment of the present application, in order to avoid the above situation, after the electronic device projects the first system desktop to the external display screen, it is determined to run the calibration service, and the content of the first system desktop is calibrated, so that the content of the first system desktop is completely presented on the external display screen.
In the embodiment of the application, the equipment for operating the calibration service is the electronic equipment, so that the external display screen does not need to have the calibration function and only needs to have the display function, and the application scene is wider. For example, an external display screen, even a third party device, can implement the calibration service.
In the embodiment of the application, after the electronic equipment is successfully connected with the external display screen in a screen projection manner, the desktop screen projection mode is determined, the first system desktop corresponding to the desktop screen projection mode is projected to the external display screen based on the desktop screen projection mode, and then the calibration service is determined to run based on the desktop screen projection mode and the parameter information of the external display screen. So, when the structural problem because outside display screen leads to the content of first system desktop can not be presented completely, carry out automatic calibration to first system desktop through electronic equipment, can make the content of first system desktop present completely on outside display screen, and do not need user's manual calibration to can promote user's impression and use experience, and save user's learning cost.
Fig. 2 is a schematic flow chart of an implementation of an information processing method provided in an embodiment of the present application, and as shown in fig. 2, the method may include the following steps 201 to 207:
In the embodiment of the application, after the screen projection connection between the electronic equipment and the external display screen is successfully established, the electronic equipment can obtain the parameter information such as the equipment model of the external display screen. Therefore, the electronic equipment can determine whether the screen projection connection with the external display screen is established for the first time according to the parameter information such as the equipment model of the external display screen in the desktop screen projection mode. For example, the electronic device may compare the device model of the external display screen in the record table pre-stored inside the electronic device with the device model of the external display screen currently establishing the screen projection connection. If the equipment model of the external display screen which is currently established with screen projection connection is not found in the prestored record table, the electronic equipment and the current external display screen are suggested to be in screen projection connection for the first time; if the equipment model of the external display screen which is currently connected with the screen projection is found out in the prestored record table, the fact that the electronic equipment is not connected with the current external display screen through screen projection is suggested for the first time is indicated.
In step 205, the electronic device determines to run a calibration service.
In the embodiment of the application, when the electronic device determines that the electronic device and the external display screen are in screen projection connection for the first time, the electronic device determines to run the calibration service. Therefore, the user can be informed that the electronic equipment has the calibration function, so that the user is guided to use the electronic equipment to perform automatic calibration, the condition that the user performs manual calibration because the user does not know that the electronic equipment has the calibration function is avoided, and the user experience is improved.
And step 206, the electronic equipment acquires corresponding calibration parameters according to the parameter information of the external display screen.
When the electronic device determines that the screen-projecting connection between the electronic device and the external display screen is not established for the first time, it is described that for the current external display screen, the electronic device has already run a calibration service on the first system desktop to which the screen is projected before the connection, and at this time, the electronic device can obtain pre-stored calibration parameters according to the parameter information (such as the device model) of the current external display screen. For example, the electronic device stores, in a pre-stored record table, device information and corresponding calibration parameters of the external display screen that has already established the overspray screen connection with the electronic device and has completed calibration. Therefore, whether the parameter information of the current external display screen exists or not can be searched in a pre-stored recording table, and if the parameter information of the current external display screen exists, the corresponding calibration parameter can be searched in the recording table according to the parameter information of the currently connected external display screen.
In some embodiments, the calibration parameters corresponding to the external display screen may be determined and recorded by performing steps 305 to 307 in the following embodiments.
And step 207, the electronic equipment calibrates the first system desktop according to the corresponding calibration parameters and then projects the first system desktop to an external display screen.
After the electronic equipment obtains the calibration parameters corresponding to the currently connected external display screen, the parameter information corresponding to the first system desktop can be readjusted according to the calibration parameters, so that after the calibrated first system desktop is projected onto the external display screen, an effect of complete content presentation is visually brought to a user.
For example, assuming that the current calibration parameter corresponding to the external display screen is that the size of the system desktop is reduced by 0.5 inches, the electronic device may reduce the size of the first system desktop by 0.5 inches again on the premise that the size of the first system desktop is set to be the same as the size of the external display screen, and then project the reduced first system desktop to the external display screen. In this way, the content of the reduced first system desktop can be completely presented on the external display screen.
In this embodiment of the application, when the electronic device determines that the screen-projecting connection between the electronic device and the external display screen is not established for the first time, it is not necessary to perform the tedious calibration procedure in steps 305 to 307 in the following embodiments after the first system desktop is projected onto the external display screen, but the electronic device directly calibrates the parameter information of the first system desktop before the screen-projecting. Therefore, on one hand, the calibration mode is simpler, the efficiency is higher, and the power consumption is more saved; on the other hand, after the screen is projected, the user is not required to be guided to perform image acquisition through the electronic equipment (for example, the mobile phone is lifted to scan through the camera), so that the user experience can be improved.
Fig. 3 is a schematic flow chart of an implementation of an information processing method according to an embodiment of the present application, and as shown in fig. 3, the method may include the following steps 301 to 310:
301, the electronic equipment establishes screen-projecting connection with an external display screen based on a screen-projecting instruction;
In some embodiments, after the electronic device is successfully connected to the external display screen, the electronic device may be reminded of having an automatic calibration function by a pop-up frame on the electronic device, so as to guide the user to use the electronic device for automatic calibration without manually adjusting the external display screen.
For example, as shown in fig. 4, after the electronic device is successfully connected to the external display screen, a question-asked pop-up frame [ whether the current screen is completely displayed ] may be popped up on the electronic device, and if the user observes that the content of the first system desktop on the external display screen is incompletely displayed, the user may click [ no ], and the electronic device may automatically run the calibration service; or, if the user cannot judge that the content display of the first system desktop on the external display screen is incomplete, the user can click (system automatic determination) to enable the electronic device to automatically run the calibration service, and if the user is reminded to scan the external display screen; alternatively, if the user thinks that no calibration is currently needed, the user can click [ yes ], and the electronic device does not run the calibration service.
In some embodiments, it is determined whether the contents of the system desktop overflow on the external display screen by performing steps 3051-3052 as follows:
step 3051, collecting an image of the external display screen to obtain a first image.
In some embodiments, when the electronic device is a mobile phone, the first image may be acquired by a user by scanning a camera of the mobile phone with respect to an external display screen. The scanning method is not limited, for example, the mobile phone camera may be opened to align to a display area of an external display screen, and a scanned image is obtained by real-time scanning, so that a mobile phone background processes the image obtained by real-time scanning; the display area of the external display screen can be photographed to obtain a photographed image, so that the mobile phone background can process the photographed image; the mobile phone can also be used for recording the display area of the external display screen so as to be processed by the mobile phone background according to the recorded video.
Step 3052, determining whether the content of the first system desktop overflows on the external display screen according to the content of the first system desktop and the first image.
Comparing the content of the first system desktop with the first image, if the content of the first image does not match the content of the first system desktop, or if the content of the first image is the same as the content of the first system desktop and is less than a certain threshold (for example, the content ratio of the first image to the first system desktop is less than 1, which indicates that the content of the first system desktop is incompletely displayed on the external display screen), it can be determined that the first system content overflows on the external display screen.
For example, as shown in fig. 5, the first image obtained by scanning the external display 501 does not include four application icons 503, and therefore, the content of the first system desktop 502 is different. It is apparent that the application icons 503 at the edge of the first system desktop 502 overflow the external display screen 501.
In other embodiments, it is determined whether the contents of the system desktop overflow on the external display screen by performing steps 3053-3056 as follows:
step 3053, based on the desktop screen projection mode, adding a reference mark at a specific position of the desktop of the first system, and then projecting the screen to an external display screen.
In some embodiments, the particular location includes any at least one location point of each edge of the first system desktop or both ends of at least one diagonal of the first system desktop.
For example, as shown in FIG. 6, a reference mark 603 may be placed at each of the four corners of the first system desktop 602, or the reference marks 603 may be placed only at the two ends of a diagonal of the first system desktop 602 in FIG. 6. As another example, as shown in FIG. 7, a reference marker 703 is placed at any at least one location point on each edge of the first system desktop 701.
Reference marks are placed at any at least one position point of each edge of the first system desktop or at two ends of at least one diagonal line of the first system desktop, so that the recognition target can be achieved by using fewer reference marks, and the power consumption of the terminal is saved.
The type of the reference identifier is not limited, for example, the reference identifier may be an icon, or may also be an Interface (User Interface, UI) element, or the like. When the reference mark is an icon, the type, shape and color of the icon are not limited. For example, the icon type may be an application icon, an entertainment icon, an interactive icon, or an explanatory icon, etc.; the shape of the icon can be a circle, a matrix, a triangle, a rhombus or the like; the icon color may be blue, red, white, yellow, or the like.
Step 3054, acquiring an image of the external display screen to obtain a second image;
and step 3055, identifying the reference mark included in the second image to obtain an identification result.
The reference identification points included at the specific position of the first image are all recognized, and it is determined that the content of the first system desktop is completely presented, i.e., the content of the first system desktop does not overflow on the external display screen. If a certain reference identification point included in the specific position of the first image is not recognized, it indicates that the content of the first system desktop is not completely presented, i.e. the content of the first system desktop overflows on the external display screen.
And step 3056, determining whether the content of the first system desktop overflows on the external display screen according to the recognition result.
Before the first system desktop is projected to the external display screen, the reference mark is added to the specific position of the first system desktop, so that whether the reference mark is completely presented on a second image obtained by scanning the external display screen by the electronic equipment can be judged, and whether the content of the first system desktop overflows on the external display screen can be determined. Compared with the same degree of judgment according to the contents of the first system desktop and the first image, the content to be recognized is less, the algorithm is simpler, and the judgment speed is higher.
In some embodiments, after obtaining the calibrated second system desktop, the reference identifier on the second system desktop is removed to obtain a third system desktop; and projecting the third system desktop to an external display screen. Therefore, the content of the third system desktop projected to the external display screen can be completely presented, and the influence on the attractiveness due to the reference mark does not exist.
After the calibrated second system desktop is obtained, the calibration parameters corresponding to the second system desktop and the parameter information of the currently used external display screen are recorded and stored, so that when a subsequent user uses the external display screen again, the first system desktop can be directly adjusted by using the pre-stored calibration parameters through executing steps 308 to 309.
And 308, the electronic equipment acquires corresponding calibration parameters according to the parameter information of the external display screen.
In step 310, the contents of the system desktop are displayed.
In some embodiments, after obtaining the calibrated second system desktop, the following steps 801 to 803 may be further performed, so that the system desktop finally displayed on the external display screen can maximally conform to the personalized requirements of the user, and the user satisfaction is improved:
It can be understood that, when the electronic device performs the method in the foregoing embodiment, the second system desktop obtained after the calibration of the first system desktop may not meet the personalized requirements of the user. Therefore, in the embodiment of the application, the second system desktop on the external display screen is projected onto the electronic device in a mirror image manner, so that the electronic device displays the mirror image interface of the display area of the external display screen, a user can conveniently perform touch operation on the display interface of the electronic device, the second system desktop is calibrated, the calibration process of the second system desktop can be more precise, and the calibration result is more accurate.
In some embodiments, the touch operation may be zoom in, zoom out, move up, down, left, right, etc.
In some embodiments, parameters of the second system desktop may also be adjusted through voice, hover gesture, and the like.
And 803, the electronic device adjusts parameters of the second system desktop according to the touch operation, and projects the adjusted system desktop to an external display screen.
In some embodiments, the method for adjusting the parameters of the second system desktop may further include: and the electronic equipment reduces the second system desktop to a display area smaller than the external display screen according to the received adjusting instruction for reducing the second system desktop, and projects the reduced second system desktop to the external display screen. In this way, the user can drag the system desktop on the external display screen through a device such as a mouse, so that the system desktop is completely presented on the external display screen.
After the mobile phone is projected onto the display device in the form of a mobile desktop, the interface of the mobile desktop is displayed at the end of the display (namely, an external display screen), and the interface mirror image of the mobile desktop is not displayed at the end of the mobile phone, so that the own interface of the mobile phone can be normally displayed.
Due to factors such as the type, size, and resolution of the display or television or projector, it often occurs that the interface 901 of the mobile desktop does not project completely within the display 902, and a portion of the content is out of the display 902 and rendered invisible, similar to the scene shown in fig. 9.
Fig. 10 shows an example of prompting the user for calibration in a tutorial manner, as shown in fig. 10, in a tutorial or notification manner, to adjust the keys on the display 100 to zoom in or out or move left or right if the problem occurs. However, this method gives the user difficulty first, and the user may not know how to operate the display; secondly, in some cases, even if the user adjusts the up, down, left, and right keys of the display, the effect of completely displaying the screen content is not achieved.
Based on this, an exemplary application of the embodiment of the present application in a practical application scenario will be described below.
In the embodiment of the present application, the following methods 1 to 3 are given to achieve calibration of screen projection content.
The method comprises the following steps: in case of a desktop mode (i.e. desktop screen-projection mode) connection (i.e. a screen-projection connection is established), the current display is scanned with the mobile phone and compared to whether the current display content (i.e. the first image) matches the full content of the desktop mode (i.e. the first system desktop) known to the mobile phone (the mobile phone knows a complete version of the full content of the desktop). And if not, automatically zooming the contents of the mobile phone desktop in the display until the contents are matched with the contents of the desktop mode stored at the mobile phone end. As shown in fig. 5, the camera scan finds that the left 4 applications 503 are not displayed on the screen, and begins the zoom operation until the desktop content is fully displayed.
The method 2 comprises the following steps: and placing obviously recognizable UI elements (namely reference marks) at 4 corners of the interface of the desktop mode (or placing four edges of a single color), scanning the current display by using a mobile phone, if all the UI elements (namely the reference marks of the second image) in the desktop mode are not recognized by the camera, indicating that calibration is needed, automatically zooming or moving the contents of the desktop mode in the display until all the UI elements at 4 corners are recognized by the camera, and finishing the calibration. As shown in fig. 6, after the camera scan, it is found that 4 red dots 603 are not displayed on the display screen 601, and the auto-zoom calibration is started.
In addition, whether the screen projection screen is too small is judged by detecting whether the scanned image has black edges, and if the black edges exist, the screen projection screen is enlarged. For example, a pure color picture is pre-stored on the mobile phone, and UI elements are arranged on 4 corners, and if the pure color picture and the 4 UI elements are displayed on the screen, but two (at least one) black edges exist, it indicates that the screen projection screen is too small. If the black edges are positioned at the left side and the right side, the width is automatically increased if the width is not enough; if the black edges are arranged at the upper side and the lower side, the length is not enough, and the length is automatically increased.
The method 3 comprises the following steps: as shown in fig. 11, the user may also select manual calibration, after entering the calibration mode, the interface 111 in the desktop mode is mirrored on the interface 112 of the mobile phone to obtain a mirrored interface 113, and the user performs zooming/moving left and right on the interface (i.e., mirrored interface) in the display through gestures, thereby achieving the calibration effect. The desktop mode interface is mirrored to the mobile phone end, and the mobile phone moves or zooms the interface content of the large screen end through pinching (ping) or sliding (swipe) operation so as to achieve the aim of calibration.
Through the three methods, the screen calibration work can be furthest assisted by a user, and the learning cost of the user is saved.
It should be noted that although the various steps of the methods in this application are depicted in the drawings in a particular order, this does not require or imply that these steps must be performed in this particular order, or that all of the shown steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc.
Based on the foregoing embodiments, an information processing apparatus is provided in an embodiment of the present application, where the apparatus includes modules included in the apparatus and units included in the modules, and may be implemented by a processor; of course, the implementation can also be realized through a specific logic circuit; in implementation, the processor may be a Central Processing Unit (CPU), a Microprocessor (MPU), a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), or the like.
It should be noted that, functional units in the embodiments of the present application may be integrated into one processing unit, may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. Or may be implemented in a combination of software and hardware.
It should be noted that, in the embodiment of the present application, if the method described above is implemented in the form of a software functional module and sold or used as a standalone product, it may also be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing an electronic device to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a magnetic disk, or an optical disk. Thus, embodiments of the present application are not limited to any specific combination of hardware and software.
An electronic device is provided in an embodiment of the present application, fig. 12 is a schematic diagram of a hardware entity of the electronic device in the embodiment of the present application, as shown in fig. 12, the electronic device 120 includes a body 121, a communication device 122, a memory 123 and a processor 124, the memory 123 stores a computer program that can be run on the processor 124, and the processor 124 implements the steps in the method provided in the embodiment when executing the program. The communication device 122 is used for establishing screen projection connection with an external display screen based on a screen projection instruction; a processor 124, disposed on the body 121, for: if the screen projection connection with the external display screen is successful, determining a desktop screen projection mode; based on the desktop screen projection mode, projecting a first system desktop corresponding to the desktop screen projection mode to the external display screen; and determining to run the calibration service based on the desktop screen projection mode and the parameter information of the external display screen.
In some embodiments, the processor 124 is further configured to determine whether the screen-casting connection is established for the first time with the external display screen based on the desktop screen-casting mode and the parameter information of the external display screen; and if the screen projection connection is established for the first time, determining to run the calibration service.
In some embodiments, the processor 124 is further configured to determine whether content of the first system desktop overflows on the external display screen; and if the desktop overflows, calibrating the parameters of the first system desktop so that the contents of the second system desktop obtained after calibration can be completely presented on the external display screen.
In some embodiments, the memory 123 is configured to record calibration parameters corresponding to the second system desktop and parameter information of the external display screen.
In some embodiments, the processor 124 is further configured to, if the screen projection connection with the external display screen is not established for the first time, obtain a corresponding calibration parameter according to the parameter information of the external display screen; and according to the corresponding calibration parameters, the first system desktop is calibrated and then is projected to the external display screen.
In some embodiments, the processor 124 is further configured to perform image acquisition on the external display screen to obtain a first image; and determining whether the content of the first system desktop overflows on the external display screen according to the content of the first system desktop and the first image.
In some embodiments, the processor 124 is further configured to perform image acquisition on the external display screen to obtain a second image; identifying the reference mark included in the second image to obtain an identification result; and determining whether the content of the first system desktop overflows on the external display screen or not according to the identification result.
In some embodiments, the processor 124 is further configured to eliminate the reference identifier on the second system desktop to obtain a third system desktop; and projecting the third system desktop to the external display screen.
In some embodiments, the processor 124 is further configured to display a mirror interface of the display area of the external display screen; detecting touch operation received by the mirror image interface; and adjusting parameters of the second system desktop according to the touch operation, and projecting the adjusted system desktop to the external display screen.
It should be noted that the Memory 123 is configured to store instructions and applications executable by the processor 124, and may also buffer data (e.g., image data, audio data, voice communication data, and video communication data) to be processed or processed by each module in the processor 124 and the electronic device 120, and may be implemented by a FLASH Memory (FLASH) or a Random Access Memory (RAM).
Embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the steps in the methods provided in the above embodiments.
Embodiments of the present application provide a computer program product containing instructions which, when run on a computer, cause the computer to perform the steps of the method provided by the above-described method embodiments.
Here, it should be noted that: the above description of the storage medium and device embodiments is similar to the description of the method embodiments above, with similar advantageous effects as the method embodiments. For technical details not disclosed in the embodiments of the storage medium, the storage medium and the device of the present application, reference is made to the description of the embodiments of the method of the present application for understanding.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" or "some embodiments" means that a particular feature, structure or characteristic described in connection with the embodiments is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" or "in some embodiments" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments. The foregoing description of the various embodiments is intended to highlight various differences between the embodiments, and the same or similar parts may be referred to each other, and for brevity, will not be described again herein.
The term "and/or" herein is merely an association relationship describing an associated object, and means that three relationships may exist, for example, object a and/or object B, may mean: the object A exists alone, the object A and the object B exist simultaneously, and the object B exists alone.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments are merely illustrative, and for example, the division of the modules is only one logical functional division, and other divisions may be realized in practice, such as: multiple modules or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or modules may be electrical, mechanical or other.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical modules; can be located in one place or distributed on a plurality of network units; some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all functional modules in the embodiments of the present application may be integrated into one processing unit, or each module may be separately regarded as one unit, or two or more modules may be integrated into one unit; the integrated module can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: various media that can store program codes, such as a removable Memory device, a Read Only Memory (ROM), a magnetic disk, or an optical disk.
Alternatively, the integrated units described above in the present application may be stored in a computer-readable storage medium if they are implemented in the form of software functional modules and sold or used as independent products. Based on such understanding, the technical solutions of the embodiments of the present application may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing an electronic device to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a removable storage device, a ROM, a magnetic or optical disk, or other various media that can store program code.
The methods disclosed in the several method embodiments provided in the present application may be combined arbitrarily without conflict to obtain new method embodiments.
Features disclosed in several of the product embodiments provided in the present application may be combined in any combination to yield new product embodiments without conflict.
The features disclosed in the several method or apparatus embodiments provided in the present application may be combined arbitrarily, without conflict, to arrive at new method embodiments or apparatus embodiments.
The above description is only for the embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. An information processing method, the method comprising:
screen projection connection with an external display screen is established based on the screen projection instruction;
if the screen projection connection with the external display screen is successful, determining a desktop screen projection mode;
based on the desktop screen projection mode, projecting a first system desktop corresponding to the desktop screen projection mode to the external display screen;
and determining to run the calibration service based on the desktop screen projection mode and the parameter information of the external display screen.
2. The method of claim 1, wherein the determining to run a calibration service based on the desktop projection mode and parameter information of the external display screen comprises:
determining whether the screen projection connection is established for the first time with the external display screen based on the desktop screen projection mode and the parameter information of the external display screen;
and if the screen projection connection is established for the first time, determining to run the calibration service.
3. The method of claim 2, wherein the running a calibration service comprises:
determining whether content of the first system desktop overflows on the external display screen;
and if the desktop overflows, calibrating the parameters of the first system desktop so that the contents of the second system desktop obtained after calibration can be completely presented on the external display screen.
4. The method of claim 3, wherein the method further comprises:
and recording calibration parameters corresponding to the second system desktop and parameter information of the external display screen.
5. The method of claim 4, wherein the method further comprises:
if the screen projection connection is not established for the first time with the external display screen, acquiring corresponding calibration parameters according to the parameter information of the external display screen;
and according to the corresponding calibration parameters, the first system desktop is calibrated and then is projected to the external display screen.
6. The method of claim 3, wherein the determining whether content of the first system desktop overflows on the external display screen comprises:
acquiring an image of the external display screen to obtain a first image;
and determining whether the content of the first system desktop overflows on the external display screen according to the content of the first system desktop and the first image.
7. The method of claim 3, wherein the projecting the first system desktop corresponding to the desktop projection mode to the external display screen based on the desktop projection mode comprises:
based on the desktop screen projection mode, projecting the screen to the external display screen after adding a reference mark on a specific position of the first system desktop;
accordingly, the determining whether the content of the first system desktop overflows on the external display screen includes:
acquiring an image of the external display screen to obtain a second image;
identifying the reference mark included in the second image to obtain an identification result;
and determining whether the content of the first system desktop overflows on the external display screen or not according to the identification result.
8. The method of claim 7, wherein the method further comprises:
eliminating the reference mark on the second system desktop to obtain a third system desktop;
projecting the third system desktop to the external display screen;
wherein the specific position comprises any at least one position point of each edge of the first system desktop, or both ends of at least one diagonal of the first system desktop.
9. The method of claim 3, wherein after running the calibration service, the method further comprises:
a mirror interface to display a display area of the external display screen;
detecting touch operation received by the mirror image interface;
and adjusting parameters of the second system desktop according to the touch operation, and projecting the adjusted system desktop to the external display screen.
10. An electronic device, comprising:
a body;
the communication device is used for establishing screen projection connection with an external display screen based on the screen projection instruction;
a processor disposed on the body for:
if the screen projection connection with the external display screen is successful, determining a desktop screen projection mode;
based on the desktop screen projection mode, projecting a first system desktop corresponding to the desktop screen projection mode to the external display screen;
and determining to run the calibration service based on the desktop screen projection mode and the parameter information of the external display screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110969930.8A CN113760139A (en) | 2021-08-23 | 2021-08-23 | Information processing method and device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110969930.8A CN113760139A (en) | 2021-08-23 | 2021-08-23 | Information processing method and device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113760139A true CN113760139A (en) | 2021-12-07 |
Family
ID=78790868
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110969930.8A Pending CN113760139A (en) | 2021-08-23 | 2021-08-23 | Information processing method and device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113760139A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023202468A1 (en) * | 2022-04-19 | 2023-10-26 | 深圳传音控股股份有限公司 | Display method, smart terminal and storage medium |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112114765A (en) * | 2020-09-27 | 2020-12-22 | 北京小米移动软件有限公司 | Screen projection method and device and storage medium |
-
2021
- 2021-08-23 CN CN202110969930.8A patent/CN113760139A/en active Pending
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112114765A (en) * | 2020-09-27 | 2020-12-22 | 北京小米移动软件有限公司 | Screen projection method and device and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023202468A1 (en) * | 2022-04-19 | 2023-10-26 | 深圳传音控股股份有限公司 | Display method, smart terminal and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11128802B2 (en) | Photographing method and mobile terminal | |
| CN109164964B (en) | Content sharing method and device, terminal and storage medium | |
| US20180232135A1 (en) | Method for window displaying on a mobile terminal and mobile terminal | |
| US10346011B2 (en) | User interface for the application of image effects to images | |
| US20160037056A1 (en) | Information processing apparatus, information processing method, and program | |
| US8004571B2 (en) | Projection-based system, apparatus and program of storing annotated object image | |
| JP7166171B2 (en) | INTERFACE IMAGE DISPLAY METHOD, APPARATUS AND PROGRAM | |
| EP3333844B1 (en) | Display operation method and apparatus, computer program and recording medium | |
| CN110100251A (en) | For handling the equipment, method and graphic user interface of document | |
| US20230345113A1 (en) | Display control method and apparatus, electronic device, and medium | |
| EP3163423B1 (en) | Method and device for setting background of ui control | |
| CN111857532B (en) | Virtual keyboard display method and device and electronic equipment | |
| CN105809695A (en) | Terminal searching method and device based on wearable device | |
| CN104766354B (en) | The method and mobile terminal that a kind of augmented reality is drawn | |
| US20230260167A1 (en) | Image processing method and apparatus | |
| JP2003076355A (en) | Picture display device, picture display method, recording medium, and program | |
| US11770603B2 (en) | Image display method having visual effect of increasing size of target image, mobile terminal, and computer-readable storage medium | |
| CN110618852B (en) | View processing method, view processing device and terminal equipment | |
| US20110037731A1 (en) | Electronic device and operating method thereof | |
| US10609305B2 (en) | Electronic apparatus and operating method thereof | |
| CN113760139A (en) | Information processing method and device, equipment and storage medium | |
| CN111679772B (en) | Screen recording method and system, multi-screen device and readable storage medium | |
| CN106775548B (en) | page processing method and device | |
| CN115883802A (en) | Method for adjusting pixel value of mixed image and projection system thereof | |
| CN113923392A (en) | Video recording method, video recording device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |