CN114090144A - Content display method and device - Google Patents
Content display method and device Download PDFInfo
- Publication number
- CN114090144A CN114090144A CN202111182891.3A CN202111182891A CN114090144A CN 114090144 A CN114090144 A CN 114090144A CN 202111182891 A CN202111182891 A CN 202111182891A CN 114090144 A CN114090144 A CN 114090144A
- Authority
- CN
- China
- Prior art keywords
- area
- screen
- image
- content
- touch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 230000002159 abnormal effect Effects 0.000 claims description 19
- 238000013507 mapping Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 claims description 4
- 238000004891 communication Methods 0.000 abstract description 8
- 230000004044 response Effects 0.000 abstract description 6
- 238000001514 detection method Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 8
- 238000012549 training Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 239000011324 bead Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 238000003708 edge detection Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses a content display method and device, belongs to the technical field of communication, and can solve the problem that electronic equipment does not respond to touch operation or wrong response of a user. The method comprises the following steps: displaying first content in a first area of a screen of an electronic device; under the condition that the screen of the electronic equipment is in a folded state, the first content is displayed in a second area of the screen, and the second area is an area, located in a shooting range of a front camera of the electronic equipment, of the screen and provided with touch control capability. The method is applied to a scene in which content is displayed on a screen of an electronic device.
Description
Technical Field
The application belongs to the technical field of communication, and particularly relates to a content display method and device.
Background
With the development of communication technology, screens of electronic devices are more diversified, for example, capacitive screens, resistive screens.
However, since the capacitive screen operates by current sensing of a human body, if an area of the capacitive screen is abnormal (for example, a crack or a bead occurs on the screen), when a user touches the area of the screen, a phenomenon that the electronic device cannot report a touch operation of the user to a system of the electronic device may occur, or a phenomenon that the touch drifts occurs, so that the electronic device may not respond to the touch operation of the user or may respond incorrectly.
Disclosure of Invention
An object of the embodiments of the present application is to provide a content display method and apparatus, which can solve the problem that an electronic device does not respond to a touch operation or an error response of a user.
In order to solve the technical problem, the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides a content display method, including: displaying first content in a first area of a screen of an electronic device; under the condition that the screen of the electronic equipment is in a folded state, the first content is displayed in a second area of the screen, and the second area is an area, located in a shooting range of a front camera of the electronic equipment, of the screen and provided with touch control capability.
In a second aspect, an embodiment of the present application provides a content display apparatus, including: and a display module. The display module is used for displaying first content in a first area of a screen of the electronic equipment. The display module is further used for displaying the first content in a second area of the screen under the condition that the screen of the electronic equipment is in a folded state, wherein the second area is an area which is located in a shooting range of a front camera of the electronic equipment and has touch control capability.
In a third aspect, embodiments of the present application provide an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, where the program or instructions, when executed by the processor, implement the steps of the method as in the first aspect.
In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method as in the first aspect described above.
In a fifth aspect, embodiments of the present application provide a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method as in the first aspect.
In an embodiment of the application, first content is displayed in a first area of a screen of an electronic device; under the condition that the screen of the electronic equipment is in a folded state, the first content is displayed in a second area of the screen, and the second area is an area, located in a shooting range of a front camera of the electronic equipment, of the screen and provided with touch control capability. According to the scheme, under the condition that the screen of the electronic equipment is in the folded state, the content displayed on the screen can be displayed in a certain area which is positioned in the shooting range of the front camera of the electronic equipment and has touch control capability in the screen, so that when a user performs touch control operation in the area, the front camera can detect the touch control operation of the user in real time, the touch control operation of the user can be responded without being influenced, and the accuracy of responding to the touch control operation of the user is improved. Therefore, the problem that the electronic equipment does not respond to the touch operation of the user or responds incorrectly when the screen is abnormal is solved.
Drawings
Fig. 1 is a schematic diagram of a content display method according to an embodiment of the present application;
fig. 2 is a schematic interface diagram of a touch coordinate provided in an embodiment of the present application;
fig. 3 is an interface schematic diagram of an auxiliary touch-control visual area according to an embodiment of the present disclosure;
FIG. 4 is a schematic interface diagram of area coordinates according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a content display device according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 7 is a hardware schematic diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or described herein. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
In the embodiments of the present application, words such as "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g.," should not be construed as advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.
In the description of the embodiments of the present application, unless otherwise specified, "a plurality" means two or more, for example, a plurality of elements means two or more elements, and the like.
The embodiment of the application provides a content display method and device, wherein first content is displayed in a first area of a screen of electronic equipment; under the condition that the screen of the electronic equipment is in a folded state, the first content is displayed in a second area of the screen, and the second area is an area, located in a shooting range of a front camera of the electronic equipment, of the screen and provided with touch control capability. According to the scheme, under the condition that the screen of the electronic equipment is in the folded state, the content displayed on the screen can be displayed in a certain area which is positioned in the shooting range of the front camera of the electronic equipment and has touch control capability in the screen, so that when a user performs touch control operation in the area, the front camera can detect the touch control operation of the user in real time, the touch control operation of the user can be responded without being influenced, and the accuracy of responding to the touch control operation of the user is improved. Therefore, the problem that the electronic equipment does not respond to the touch operation of the user or responds incorrectly when the screen is abnormal is solved.
The content display method, device and electronic device provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.
As shown in fig. 1, an embodiment of the present application provides a content display method, which includes the following steps S101 and S102.
S101, a content display device displays first content in a first area of a screen of the electronic equipment.
Optionally, the first area may be an entire display area of the screen, or a part of the display area in the screen.
Optionally, in this embodiment of the application, the electronic device may be a folding screen terminal. Further, when the screen of the electronic device is in the unfolded state, the front camera of the electronic device cannot shoot the screen due to the limited shooting range of the front camera, that is, the screen is not in the shooting range of the front camera.
Optionally, an auxiliary display mode is provided in an embodiment of the present application. The embodiments S101 to S102 of the present application can be executed only when the electronic device is in the auxiliary display mode. That is, before S101, the user may trigger the output of a prompt message for prompting the user to start the auxiliary display mode by an input. For example, when the user presses a volume up or down key, the electronic device may be triggered to vibrate to prompt the user that the electronic device initiates the auxiliary display mode.
And S102, under the condition that the screen of the electronic equipment is in a folded state, the content display device displays the first content in a second area of the screen.
The second area is an area of which the screen is located in a shooting range of a front camera of the electronic equipment and has touch control capability.
It should be noted that, because a front camera is required to capture a part of a screen by using the content display method provided in the embodiment of the present application, after the foregoing S101 and before S102, the content display method provided in the embodiment of the present application may further include: the content display device receives input of a user under the condition that a screen of the electronic equipment is in an extension state; in response to the input, a portion of the screens are controlled to collapse. In this way, the content display method provided by the embodiment of the present application can be performed.
Optionally, in a first possible case, when the first area is a whole display area of the screen, the second area is a partial display area in the whole display area, that is, the second area is a partial area in the first area; in a second possible case, in a case where the first area is a part of the display area in the screen, the second area is another display area different from the first area in the screen.
In view of the first possible situation, the step S102 is executed to first scale the display size of the first content according to a target scale, and then display the scaled first content in the second area, where the target scale is a ratio of the display size of the first area to the display size of the second area.
In the second possible case, the above S102 is executed to essentially cancel the displayed first content in the first area of the screen and display the first content in the second area of the screen, that is, update the display area of the first content.
Optionally, since the display area on the screen except the second area is a non-touch area, when the user touches the screen area, the electronic device does not report a touch event to the system, that is, the electronic device does not respond to the touch operation of the user. In addition, the electronic device may display content that does not require touch control or does not display content in a display area of the screen other than the second area, which is determined according to actual use conditions.
Alternatively, S102 may be specifically implemented by S102A described below.
S102A, displaying the first content in the second area of the screen if the preset condition is satisfied.
Wherein, the preset condition is satisfied by any one of the following items: the input times reach the preset times within the preset time, the touch medium is detected within the shooting range of the front-facing camera, the capacitance value of the second area is larger than or equal to the preset threshold value, and the image quality parameter of the second area acquired by the front-facing camera is larger than or equal to the preset parameter.
For example, when the preset condition is met, that the input times reach the preset times within the preset time means that a touch drift phenomenon (i.e., inaccurate touch) occurs, that is, a user clicks the same control multiple times (it is because the drift phenomenon causes inaccurate click), for example, a certain area on the screen is clicked 5 times within 3 seconds; when the preset condition is met, that the touch medium is detected in the shooting range of the front camera means that a user performs touch operation in an area, located in the shooting range of the front camera, of the screen, for example, the user clicks the screen in a second area; if the preset condition is met, that is, an area with an abnormal capacitance value exists in the screen, it means that an abnormal area exists in the screen of the electronic device (for example, the abnormal area has a water drop, that is, the capacitance value of the abnormal area is larger than a preset threshold value without being touched by a user), and the second area is an area except the abnormal area in the screen; in the case that the preset condition is met, that the image quality parameter of the second region acquired by the front camera is greater than or equal to the preset parameter means that an abnormal region (for example, a crack or a water droplet occurs in the abnormal region, that is, the image quality parameter of the abnormal region acquired by the front camera is smaller than the preset parameter) exists in the screen of the electronic device, and the second region is a region which is located within the shooting range of the front camera and is greater than or equal to the preset parameter in the screen.
In the embodiment of the application, under the condition that the screen is in a folded state, whether a preset condition is met is judged; under the condition that the preset condition is met, the first content is displayed in the second area of the screen, so that the first content can be transferred to the second area to be displayed when the electronic equipment cannot normally touch the screen, and then the touch operation of the user on the screen is detected through the camera and response is carried out.
Optionally, after the step S102, the content display method provided in the embodiment of the present application may further include the following steps S103 and S104.
S103, the content display device receives the first input in the second area.
Optionally, in this embodiment of the application, the first input refers to a touch input, and the touch input may be a single-click input, a double-click input, or a sliding input.
And S104, the content display device responds to the first input, and obtains the touch coordinate of the first input.
The touch coordinates are determined according to a second image, and the second image is an image which is acquired through a front camera and comprises a touch medium.
Alternatively, the above S104 may be implemented by the following S103A and S103B.
S104A, the content display apparatus acquires a second image in response to the first input.
Specifically, under the condition that the screen of the electronic equipment is in a folded state, the front camera of the electronic equipment can acquire the image of the screen in real time. When the user performs the first input in the second area, the front camera may be controlled to capture an image including the touch medium, that is, a second image.
S104B, the content display device determines coordinates of the touch medium in the first image by using the target detection algorithm model, and uses the coordinates of the touch medium as touch coordinates.
Optionally, the target detection algorithm model may be factory set for the electronic device or automatically set for a user.
Illustratively, to accurately determine the coordinates of the touch medium, a training set is pre-established, based on the ssd, yolo3 algorithm model, to build a target detection algorithm model for the image including the touch medium. The training content of the training set mainly comprises: and collecting a large number of images comprising the touch media, labeling the area where the touch media are located in each image, and providing coordinate information corresponding to the area where the touch media are located in each image. And finally obtaining a target detection algorithm model through the targeted training of the training set.
That is, each time the target detection algorithm model is used, the number of images including the touch medium collected in the training set increases, so that the calculation accuracy of the target detection algorithm model can be continuously optimized.
It should be noted that after the second image including the touch medium is acquired, the second image may be input into the target detection algorithm model, so that the coordinates of the touch medium are output through calculation of the target detection algorithm model, that is, the coordinates of the touch medium are the touch coordinates of the first input.
It is understood that, when a second image including a touch medium is acquired, a target detection algorithm model is used to determine the finger coordinates of the touch medium in the second image, and the finger coordinates are used as touch coordinates, i.e. another way of acquiring the coordinates is provided. Compared with the mode of acquiring the touch coordinates through touch driving in the prior art, the phenomenon of touch coordinate drifting cannot occur under the condition that the surface of the screen is abnormal, so that the accurate touch coordinates can be acquired.
Illustratively, the content display device is a folding screen mobile phone. As shown in fig. 2, the display area of the mobile phone screen is a rectangular area with a length e and a width f. Assume that the mobile phone displays the contents in the memo in the rectangular area (i.e., the first area). In the case where the screen of the folding-screen mobile phone is in a folded state, as shown in fig. 2, the mobile phone displays the content in the memo in an area 01 (i.e., a second area) in the screen.
Further, if the user clicks on the area 01 at the position 02, the front camera of the folding-screen mobile phone may capture one image including the touch medium, so that the finger coordinates of the touch medium in the one image are calculated as z (x, y) through the target detection algorithm model, that is, the touch coordinates of the user clicking input on the area 01 as shown in fig. 2 are z (x, y).
The embodiment of the application provides a content display method, and under the condition that a screen of an electronic device is in a folded state, content displayed on the screen can be displayed in a certain area which is positioned in a shooting range of a front camera of the electronic device and has touch control capability in the screen, so that when a user performs touch control operation in the area, the front camera can detect the touch control operation of the user in real time, the touch control operation of the user can be responded without being influenced, and the accuracy of responding to the touch control operation of the user is improved. Therefore, the problem that the electronic equipment does not respond to the touch operation of the user or responds incorrectly when the screen is abnormal is solved.
Optionally, after the above S101 and before S102, the content display method provided in the embodiment of the present application may further include the following S105 and S106.
S104, the content display device acquires a first image.
The first image is an image of a screen acquired through a front camera.
Optionally, the first image is any image obtained by acquiring the screen through a front camera under the condition that the screen of the electronic device is in a folded state.
Further, when the image acquired by the front camera is not distorted, the first image is directly the image acquired by the front camera; when the image collected by the front camera is distorted, the first image is an image obtained by correcting the distorted image collected by the front camera.
Specifically, the edge detection algorithm and other image preprocessing algorithms (e.g., OST algorithm) may be combined to perform segmentation on the screen contour in the first image, so as to locate the screen contour. Because the screen of the electronic device is in a folded state, the front camera is an image acquired under an inclined angle, for example, the first image is an irregular trapezoid. However, since the image collected under the inclined angle usually has distortion, the angle of the image can be corrected through a basic formula of perspective change of the two-dimensional image, so that an image with the line of sight of the human eyes forming an angle of 90 degrees with the screen can be obtained. The two-dimensional image perspective change formula can be expressed as the following formula (1) and formula (2):
wherein, (x, y) is the coordinate of the pixel point of the original image, (x ', y') is the coordinate of the pixel point of the top view,
representing a linear transformation, [ c f ]]Indicating translation, [ m n ]]TA perspective transformation is generated.
S106, the content display device determines a second area according to the first image.
The second area is a mapping area of the first image on the screen.
It can be understood that, because the folding angle of the screen of the electronic device changes when the screen is folded to different positions, the shooting range of the front camera of the electronic device changes, that is, the area of the screen within the shooting range of the front camera is also different, so that different first images can be acquired. Therefore, when different second images are acquired in real time, the mapping areas of the first images on the screen are not different, namely the determined second areas are different.
For example, as shown in fig. 3 (a), a fully unfolded side view of the folding screen is shown, in which the shooting areas (i.e., the front camera visible areas) of the front camera are all outside the screen, i.e., the screen is not in the shooting range of the front camera; fig. 3 (b) shows a side view of the folded state of the folded screen, where the screen is located in a shooting range of the front camera (i.e., a visible area of the front camera), and the second area is an auxiliary touch visible area (i.e., a second area) in the lower half screen, i.e., the auxiliary touch visible area is a mapping area of the first image on the screen; fig. 3 (c) is a top view of the folded state of the folded screen, where the screen is located within the shooting range of the front camera (i.e., the visible area of the front camera), the shooting range of the front camera completely falls on the lower half screen of the screen, and the second area is an auxiliary touch visible area (i.e., a second area) in the lower half screen, i.e., the mapping area of the first image on the screen. So, the screen is folded to different positions, and the shooting area of leading camera is different to obtain different first images, and then determine the second region under different fold condition.
It can be understood that after the first image is acquired, since the second area can be determined according to the first image, it is convenient to display the first content in the second area afterwards, so that the user can adjust the touch position on the screen according to the change of the second content display area to prevent the user from touching other areas without touch capability on the screen.
Optionally, after S106, the content display method provided in the embodiment of the present application may further include S108 described below. Accordingly, S101 described above may be specifically realized by S108A described below.
And S108, the content display device calculates the first coordinate of the second area.
The first coordinate is a vertex coordinate of the second area in a target coordinate system, and the target coordinate system is a coordinate system based on the screen.
Specifically, the manner of calculating the first coordinates of the second area includes the following two steps:
(1) since the length (denoted as e) and the width (denoted as f) of the screen are known, and the second area mapped on the screen by the first image is rectangular, the length (denoted as g) and the width (equal to the width of the screen and still equal to f) of the second area can be quickly calculated according to the ratio of the length of the second area to the length of the screen.
(2) A coordinate system, i.e., a target coordinate system, is established with reference to the screen, so that respective coordinates of the four vertices A, B, C and D of the second area can be directly calculated. As shown in FIG. 4, according to the convention of touch coordinates of android system, we regard the measured upper left corner of the screen as the origin of coordinates, and the coordinates of the four vertices of the auxiliary touch-sensitive visual area, i.e. the second area, in FIG. 4 are A (0, e-g), B (f, e-g), C (0, e), and D (f, e), respectively.
S108A, the content display device displays the first content according to the first coordinate.
It is to be understood that, in the case where the first coordinates include 4 vertex coordinates, the second region is a region surrounded by a line connecting every two adjacent vertex coordinates of the 4 vertex coordinates.
According to the content display method provided by the embodiment of the application, after the second area is determined, the first coordinate of the second area can be calculated, so that the first coordinate can be uploaded to a system, and the first content can be displayed according to the first coordinate. Therefore, the visual area of the front camera of the electronic equipment is guaranteed to be the touch range of the user, and the problem that no touch event is reported due to the fact that the user touches the invalid area is avoided.
In the content display method provided in the embodiment of the present application, the execution main body may be a content display apparatus (for example, the content display apparatus is an electronic device or an external device on the electronic device), or a control module in the content display apparatus for executing the content display method. In the embodiment of the present application, a content display apparatus executing a content display method is taken as an example, and the content display apparatus provided in the embodiment of the present application is described.
As shown in fig. 5, the present embodiment provides a content display apparatus 200, which includes a display module 201. A display module 201 for displaying first content in a first area of a screen of an electronic device; and displaying the first content in a second area of the screen when the screen of the electronic equipment is in a folded state, wherein the second area is an area which is located in a shooting range of a front camera of the electronic equipment and has touch control capability.
Optionally, the content display apparatus further includes an obtaining module and a determining module. The acquisition module is further used for acquiring a first image, wherein the first image is an image of a screen acquired through the front camera. And the determining module is used for determining a second area according to the first image, wherein the second area is a mapping area of the first image on the screen.
Optionally, the processing module is further configured to calculate a first coordinate of the second region, where the first coordinate is a vertex coordinate of the second region in a target coordinate system, and the target coordinate system is a coordinate system based on the screen. And the display module is specifically used for displaying the first content according to the first coordinate.
Optionally, the display module is specifically configured to display the first content in a second area of the screen when a preset condition is met; wherein, the meeting the preset condition comprises any one of the following items: the input times reach the preset times within the preset time, the touch medium is detected within the shooting range of the front-facing camera, an area with an abnormal capacitance value exists in the screen, and the image quality parameter of the second area acquired by the front-facing camera is larger than or equal to the preset parameter.
Optionally, the receiving module is further configured to receive the first input in the second area. The acquisition module is used for responding to the first input received by the receiving module and acquiring the touch coordinate of the first input; the touch coordinate is determined according to a second image, and the second image is an image which is acquired through a front camera and comprises a touch medium.
Optionally, the obtaining module is specifically configured to obtain a second image; and determining the coordinates of the touch medium in the second image by adopting a target detection algorithm model, and taking the coordinates of the touch medium as touch coordinates.
The embodiment of the application provides a content display device, because under the condition that a screen of an electronic device is in a folded state, content displayed on the screen can be displayed in a certain area which is positioned in a shooting range of a front camera of the electronic device and has touch control capability in the screen, when a user performs touch control operation in the area, the front camera can detect the touch control operation of the user in real time, so that the touch control operation of the user can be responded without being influenced, and the correctness of responding the touch control operation of the user is improved. Therefore, the problem that the electronic equipment does not respond to the touch operation of the user or responds incorrectly when the screen is abnormal is solved.
The content display device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The content display device in the embodiment of the present application may be a device having an operating system. The operating system may be an android (android) operating system, an ios operating system, or other possible operating systems, and the embodiment of the present application is not particularly limited.
The content display device provided in the embodiment of the present application can implement each process implemented by the method embodiments of fig. 1 to fig. 4, and is not described here again to avoid repetition.
Optionally, as shown in fig. 6, an electronic device 300 is further provided in this embodiment of the present application, and includes a processor 301, a memory 302, and a program or an instruction stored in the memory 302 and executable on the processor 301, where the program or the instruction is executed by the processor 301 to implement each process of the foregoing content display method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and the non-mobile electronic devices described above.
Fig. 7 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 400 includes, but is not limited to: radio unit 401, network module 402, audio output unit 403, input unit 404, sensor 405, display unit 406, user input unit 407, interface unit 408, memory 409, and processor 410.
Those skilled in the art will appreciate that the electronic device 400 may further include a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 410 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 7 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.
The display unit 406 is configured to display first content in a first area of a screen of the electronic device; and displaying the first content in a second area of the screen when the screen of the electronic equipment is in a folded state, wherein the second area is an area which is located in a shooting range of a front camera of the electronic equipment and has touch control capability.
Optionally, the input unit 404 is configured to acquire a first image, where the first image is an image of a screen captured by a front camera. And a processor 410, configured to determine a second area according to the first image, where the second area is a mapping area of the first image on the screen.
Optionally, the processor 410 is further configured to calculate a first coordinate of the second area, where the first coordinate is a vertex coordinate of the second area in a target coordinate system, and the target coordinate system is a coordinate system based on the screen. And a display unit 406, configured to display the first content according to the first coordinate.
Optionally, the display unit 406 is specifically configured to display the first content in the second area of the screen when a preset condition is met; wherein, the meeting the preset condition comprises any one of the following items: the input times reach the preset times within the preset time, the touch medium is detected within the shooting range of the front-facing camera, an area with an abnormal capacitance value exists in the screen, and the image quality parameter of the second area acquired by the front-facing camera is larger than or equal to the preset parameter.
Optionally, the user input unit 407 is configured to receive a first input in the second area. The processor 410 is configured to, in response to a first input received by the user input unit 407, acquire a touch coordinate of the first input; the touch coordinate is determined according to a second image, and the second image is an image which is acquired through a front camera and comprises a touch medium.
Optionally, an input unit 404 is used for acquiring the first image. And the processor 410 is configured to determine coordinates of the touch medium in the first image by using the target detection algorithm model, and use the coordinates of the touch medium as touch coordinates.
The embodiment of the application provides an electronic device, because under the condition that a screen of the electronic device is in a folded state, contents displayed on the screen can be displayed in a certain area which is positioned in a shooting range of a front camera of the electronic device and has touch control capability in the screen, when a user performs touch control operation in the area, the front camera can detect the touch control operation of the user in real time, so that the touch control operation of the user can be responded without being influenced, and the correctness of responding the touch control operation of the user is improved. Therefore, the problem that the electronic equipment does not respond to the touch operation of the user or responds incorrectly when the screen is abnormal is solved.
It should be understood that, in the embodiment of the present application, the input unit 404 may include a Graphics Processing Unit (GPU) 4041 and a microphone 4042, and the graphics processor 4041 processes image data of a still picture or a video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 406 may include a display panel 4061, and the display panel 4061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 407 includes a touch panel 4071 and other input devices 4072. A touch panel 4071, also referred to as a touch screen. The touch panel 4071 may include two parts, a touch detection device and a touch controller. Other input devices 4072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 409 may be used to store software programs as well as various data including, but not limited to, application programs and an operating system. The processor 410 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 410.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the content display method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device in the above embodiment. Readable storage media, including computer-readable storage media such as a computer-read-only memory (ROM), a Random Access Memory (RAM), a magnetic or optical disk, and so forth.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the foregoing content display method embodiment, and the same technical effect can be achieved.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method in the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. A method for displaying content, the method comprising:
displaying first content in a first area of a screen of an electronic device;
under the condition that the screen is in a folded state, the first content is displayed in a second area of the screen, and the second area is an area which is located in a shooting range of a front camera of the electronic equipment and has touch control capability.
2. The method of claim 1, wherein prior to displaying the first content in the second region of the screen, the method further comprises:
acquiring a first image, wherein the first image is an image of the screen acquired by the front camera;
and determining the second area according to the first image, wherein the second area is a mapping area of the first image on the screen.
3. The method of claim 2, wherein after determining the second region from the first image, the method further comprises:
calculating a first coordinate of the second area, wherein the first coordinate is a vertex coordinate of the second area under a target coordinate system, and the target coordinate system is a coordinate system taking the screen as a reference;
the displaying the first content displayed in the first area in the second area includes:
and displaying the first content according to the first coordinate.
4. The method of claim 1, wherein the displaying the first content in the second area of the screen comprises:
displaying the first content in a second area of the screen under the condition that a preset condition is met;
wherein, the meeting the preset condition comprises any one of the following items: and when the input times reach preset times within preset time, detecting a touch medium in the shooting range of the front-facing camera, wherein an area with an abnormal capacitance value exists in the screen, and the image quality parameter of the second area acquired by the front-facing camera is greater than or equal to the preset parameter.
5. The method of claim 1, wherein after the displaying the first content in the second area of the screen, the method further comprises:
receiving a first input in the second region;
responding to the first input, and acquiring touch coordinates of the first input;
the touch coordinates are determined according to a second image, and the second image is an image which is acquired through the front camera and comprises a touch medium.
6. A content display apparatus, characterized in that the content display apparatus comprises a display module;
the display module is used for displaying first content in a first area of a screen of the electronic equipment;
the display module is further used for displaying the first content in a second area of the screen under the condition that the screen of the electronic equipment is in a folded state, and the second area is an area which is located in a shooting range of a front camera of the electronic equipment and has touch control capability.
7. The apparatus of claim 6, wherein the content display apparatus further comprises an obtaining module and a determining module;
the acquisition module is further configured to acquire a first image, where the first image is an image of the screen acquired by the front camera;
the determining module is configured to determine the second area according to the first image, where the second area is a mapping area of the first image on the screen.
8. The apparatus of claim 7, wherein the content display apparatus further comprises a processing module;
the processing module is further configured to calculate a first coordinate of the second region, where the first coordinate is a vertex coordinate of the second region in a target coordinate system, and the target coordinate system is a coordinate system based on the screen;
the display module is specifically configured to display the first content according to the first coordinate.
9. The apparatus of claim 6,
the display module is specifically used for displaying the first content in a second area of the screen under the condition that a preset condition is met;
wherein, the meeting the preset condition comprises any one of the following items: and when the input times reach preset times within preset time, detecting a touch medium in the shooting range of the front-facing camera, wherein an area with an abnormal capacitance value exists in the screen, and the image quality parameter of the second area acquired by the front-facing camera is greater than or equal to the preset parameter.
10. The apparatus of claim 6, wherein the content display apparatus further comprises an acquisition module;
the receiving module is further used for receiving a first input in the second area;
the acquisition module is used for responding to the first input and acquiring the touch coordinate of the first input;
the touch coordinates are determined according to a second image, and the second image is an image which is acquired through the front camera and comprises a touch medium.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111182891.3A CN114090144B (en) | 2021-10-11 | 2021-10-11 | Content display method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111182891.3A CN114090144B (en) | 2021-10-11 | 2021-10-11 | Content display method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114090144A true CN114090144A (en) | 2022-02-25 |
| CN114090144B CN114090144B (en) | 2024-07-19 |
Family
ID=80296711
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111182891.3A Active CN114090144B (en) | 2021-10-11 | 2021-10-11 | Content display method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114090144B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203477811U (en) * | 2013-08-08 | 2014-03-12 | 联想(北京)有限公司 | Foldable support and image collecting device using foldable support |
| CN104991684A (en) * | 2015-07-23 | 2015-10-21 | 京东方科技集团股份有限公司 | Touch control device and working method therefor |
| CN105912293A (en) * | 2016-03-31 | 2016-08-31 | 广东欧珀移动通信有限公司 | Intelligent terminal equipment |
| CN110996034A (en) * | 2019-04-25 | 2020-04-10 | 华为技术有限公司 | Application control method and electronic device |
| CN111131712A (en) * | 2019-12-31 | 2020-05-08 | 维沃移动通信有限公司 | Image processing method and device and electronic equipment |
| US20210303029A1 (en) * | 2020-03-24 | 2021-09-30 | Lepton Computing Llc | Flexible display devices with a modular rigid display |
-
2021
- 2021-10-11 CN CN202111182891.3A patent/CN114090144B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203477811U (en) * | 2013-08-08 | 2014-03-12 | 联想(北京)有限公司 | Foldable support and image collecting device using foldable support |
| CN104991684A (en) * | 2015-07-23 | 2015-10-21 | 京东方科技集团股份有限公司 | Touch control device and working method therefor |
| CN105912293A (en) * | 2016-03-31 | 2016-08-31 | 广东欧珀移动通信有限公司 | Intelligent terminal equipment |
| CN110996034A (en) * | 2019-04-25 | 2020-04-10 | 华为技术有限公司 | Application control method and electronic device |
| CN111131712A (en) * | 2019-12-31 | 2020-05-08 | 维沃移动通信有限公司 | Image processing method and device and electronic equipment |
| US20210303029A1 (en) * | 2020-03-24 | 2021-09-30 | Lepton Computing Llc | Flexible display devices with a modular rigid display |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114090144B (en) | 2024-07-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9052817B2 (en) | Mode sensitive processing of touch data | |
| US9288373B2 (en) | System and method for human computer interaction | |
| US8436832B2 (en) | Multi-touch system and driving method thereof | |
| US9632626B2 (en) | Apparatuses and methods for providing a 3D man-machine interface (MMI) | |
| EP2790089A1 (en) | Portable device and method for providing non-contact interface | |
| EP2972727A1 (en) | Non-occluded display for hover interactions | |
| CN103955339A (en) | Terminal operation method and terminal equipment | |
| US20160196034A1 (en) | Touchscreen Control Method and Terminal Device | |
| TW201439855A (en) | Method and computing device for determining angular contact geometry | |
| US20140104161A1 (en) | Gesture control device and method for setting and cancelling gesture operating region in gesture control device | |
| CN109857306A (en) | Screenshotss method and terminal device | |
| WO2023025060A1 (en) | Interface display adaptation processing method and apparatus, and electronic device | |
| TW201423477A (en) | Input device and electrical device | |
| CN106598422B (en) | hybrid control method, control system and electronic equipment | |
| CN103558957B (en) | A kind of method and device of mobile terminal screen operation | |
| CN112783406B (en) | Operation execution method and device and electronic equipment | |
| WO2024012268A1 (en) | Virtual operation method and apparatus, electronic device, and readable storage medium | |
| US9235338B1 (en) | Pan and zoom gesture detection in a multiple touch display | |
| US20180004402A1 (en) | Method for Scaling Down Effective Display Area of Screen, and Mobile Terminal | |
| WO2022199540A1 (en) | Unread message identifier clearing method and apparatus, and electronic device | |
| CN114090144B (en) | Content display method and device | |
| CN111104570A (en) | Data processing method, electronic device, and storage medium | |
| US20220050528A1 (en) | Electronic device for simulating a mouse | |
| CN114115639A (en) | Interface control method and device, electronic equipment and storage medium | |
| CN110750195A (en) | Display control method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |