CN114666427B

CN114666427B - Image display method, electronic equipment and storage medium

Info

Publication number: CN114666427B
Application number: CN202011444750.XA
Authority: CN
Inventors: 牛庆建
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2020-12-08
Filing date: 2020-12-08
Publication date: 2023-10-27
Anticipated expiration: 2040-12-08
Also published as: CN114666427A

Abstract

The application relates to the field of communication, and discloses an image display method, electronic equipment and a storage medium. Therefore, the first image is displayed in the first display area, and the local area of the first image is displayed in the second display area at the same time, so that a user can conveniently view the details of the local area and the original image at the same time. And the user experience is improved. In addition, the user may operate the local area, and an operation result of operating the local area is displayed on the first display area. Therefore, the first image is convenient for the user to operate, and the experience of the user is further improved.

Description

Image display method, electronic equipment and storage medium

Technical Field

The present application relates to the field of communications, and in particular, to an image display method, an electronic device, and a storage medium.

Background

More and more electronic devices having a display screen are widely used in daily life and work. Such as a cell phone with a display screen, a notebook computer, etc. With the development of screen technology, the folding technology is more mature, and brand new use experience and visual effect are brought to users.

The folding technology is applied to the field of mobile phones to create folding screen mobile phones, and the most intuitive experience of the folding screen mobile phones is that the mobile phone is a screen when the mobile phone is in a folding state. When the folding screen mobile phone is in an unfolding state, the mobile phone is provided with two screens, and the folding screen mobile phone can realize split-screen display or independent display. Currently, split screen displays of a folding screen cell phone display a user interface of an application for each screen. The independent display of the folding screen mobile phone is to enlarge the original size of the image displayed when the mobile phone is in an undeployed state so as to display the original image on two screens. In order to ensure that the picture of the original image is not stretched and deformed, the interface of the original image is cut, so that the whole visual field of a user is reduced. Meanwhile, when the original image has some local area focused by the user, the user can zoom in on the local area through independent display so as to view the details of the local area. However, by the scheme of magnifying and displaying the original image on the two screens, the enlarging effect of the local area is small, and the user can hardly view the local details of the local area of the original image, and meanwhile, the operation of the user on the local area is difficult to complete. Some mobile phones have the function of magnifying an original image by gestures. However, after the original image is enlarged, only a part of the image can be displayed on the screen of the mobile phone, but the complete original image cannot be displayed, so that the experience of the user is low.

Disclosure of Invention

The application aims to provide an image display method, electronic equipment and a storage medium, which are convenient for a user to simultaneously check the original image and the local details of the local area of the original image, thereby improving the experience of the user.

In a first aspect, an embodiment of the present application discloses an image display method, applied to an electronic device, where the image display method includes:

the first image is displayed in the first display area. The method includes receiving a first operation, displaying a first selection frame at a first position of a first image in response to the first operation, and simultaneously displaying a second image in a second display area, the second image being a first partial area of the first image, and content of the second image corresponding to content at the first position.

According to the image display method disclosed by the first aspect of the application, when the original image is displayed on the first display area, the local area of the original image displayed on the second display area can be displayed in an enlarged mode, so that a user can conveniently view the details of the local area and the original image at the same time. And the user experience is improved.

According to some embodiments of the disclosure in the first aspect of the present application, the electronic device may be a single-screen electronic device, such as a single-screen mobile phone; the electronic device may also be a folding screen electronic device, such as a folding screen mobile phone. In addition, the image display method provided by the embodiment of the application can also be applied to different electronic devices, such as the first electronic device and the second electronic device.

According to some embodiments of the disclosure of the first aspect of the present application, the first operation may be an opening operation of an on-screen option (an option in a precision mode), or a gesture operation or a combination key operation or an opening operation of the folding screen electronic device, so that the folding screen electronic device is converted from a folded state to an unfolded state. For example, after the user clicks (as the first operation) the precise mode icon, the electronic device starts the option of the precise mode, or, for example, a finger joint letter starting mode, a gesture sliding screen starting mode (such as a sliding starting mode and a sliding starting mode, and in the embodiment of the present application, a three-finger sliding starting mode is taken as an example), and a volume key long-pressing preset time (such as 5 seconds) starting mode is used. For the finger joint letter starting mode, when the user turns on the switch 1B to select the mode to start the precision mode, the rest of the switch buttons 1B of the starting mode are turned off, so that the user can continue to select the "starting letter", such as the letter "C" as the starting letter of the precision mode.

According to some embodiments of the disclosure in the first aspect of the present application, after the user opens the precision mode option, the precision selection frame (as the first selection frame) may be directly displayed on the first display area, and a local area of the first display area covered by the precision selection frame is used as the image displayed in the second display area. The size of the first selection frame may be adjusted based on a third operation of the user, for example, when the user clicks the first selection frame and contracts, the corresponding size of the first selection frame changes.

According to some embodiments of the disclosure of the first aspect of the present application, after the user opens the precision mode option, a second selection frame may be displayed at a second location of the first image based on a second operation of the user. And simultaneously displaying a third image in the second display area, wherein the third image is a second local area of the first image, and the content of the third image corresponds to the content at the second position. The track drawn by the user on the screen of the electronic device may be any shape and any size of graphics, and the embodiments of the present application are not limited herein.

According to some embodiments of the disclosure of the first aspect of the present application, the partial region (as the fourth image) may also be presented in the second display region based on a specific operation (as the fourth operation) by the user. The local area may be an area preset by the application program. For example, in a game scene, a specific operation for displaying a detail image in the game may be used, for example, a gun with a magnifier is used (when the magnifier is used, the specific operation is that a user clicks a magnifier switching button, and the form of the magnifier switching button is not limited herein, and the embodiment of the present application) uses a telescope, and the like, and the second display area automatically pops up the detail image (the magnifier area or the telescope area is displayed in a magnified manner on the second display area).

According to some embodiments of the disclosure in the first aspect of the present application, for a single-screen electronic device, the first display area may be a full screen of the single-screen electronic device, and the second display area may be an area covering the first display area. The first display area displays a first image, and the second display area displays a partial area of the first image covered by the precision selection frame. The single-screen electronic device displays a precise display area (serving as a second display area) on the screen. The single-screen electronic device in the accurate mode is started to display the original image, the accurate selection frame and the local area of the original image on the screen at the same time (the area covered by the accurate selection frame is the local area, and the local area of the original image is displayed in the accurate display area). The precise display area covers a partial area of the screen of the single-screen electronic device. According to some embodiments of the present application, when the local area of the original image is displayed on the accurate display area, the local area of the original image may be displayed in an enlarged manner on the accurate display area, so that a user may conveniently view details of the local area. In addition, the user can drag the accurate show area to thereby change the position of accurate show area on the screen. According to some embodiments disclosed in the first aspect of the present application, when the folding screen is in the unfolded state, the original image (as the first image) may be displayed on the main screen (as the first display area) of the electronic device, and the local area of the original image may be displayed on the auxiliary screen (as the second display area) of the electronic device. When the folding screen is in a folding state, the folding screen mobile phone can be used as a single screen mobile phone with a single screen, and the folding screen mobile phone can display an original image on a main screen or a secondary screen in a full screen mode (used as a first display area). And displaying a local area of the original image in a precise display area (serving as a second display area) of the main screen or the auxiliary screen correspondingly.

According to some embodiments of the disclosure of the first aspect of the application, the local area of the secondary screen in which the original image is displayed may be selected by a user. After the user opens the accurate mode, the accurate selection frame is displayed on the main screen, and the user can drag the accurate selection frame on the main screen to select a local area in the original image (the coverage area of the accurate selection frame on the original image is the local area of the selected original image). The user can zoom in and zoom out on the accurate selection frame, so that the region which the user wants to select can be selected more flexibly, and the experience of the user is improved.

According to some embodiments disclosed in the first aspect of the present application, after the accurate mode is started, if the folding screen electronic device is not in a folded state, a prompt message is sent to prompt a user to open the folding screen. The prompting modes include but are not limited to the modes of popping prompting words, voice prompts and the like on the screen of the folding screen mobile phone,

according to some embodiments of the disclosure of the first aspect of the present application, the first image is displayed full screen on the first display screen, and the image displayed in the second display area may be displayed full screen enlarged on the second display screen.

According to some embodiments of the disclosure of the first aspect of the present application, in the case where the electronic device includes two electronic devices, the first display area is a display screen of the first electronic device, and the second display area is a display screen of the second electronic device.

The first electronic device and the second electronic device can perform near field communication. After the user opens the accurate mode, the first electronic device and the second electronic device are connected, and the first electronic device displays the original image and the accurate selection frame. The user may operate the precision selection box (operations including, but not limited to, dragging, zooming in, zooming out, etc.) on the electronic device one to select a local area (the coverage area of the precision selection box on the original image is the local area of the selected original image).

The first electronic device transfers the local area to the second electronic device. And the second electronic equipment displays the local area on the screen.

According to some embodiments disclosed in the first aspect of the present application, when the local area of the original image is displayed on the second electronic device, the local area of the original image may be displayed in a full screen zoom manner on the screen, so that a user may conveniently view details of the local area.

According to some embodiments of the disclosure of the first aspect of the present application, a partial region of the original image is displayed in the precision display area (as the second display area). The user may perform an operation (as a fifth operation) on a partial region of the original image in the precision display region and map the operation result back to the original image and display it in the first display region. The purpose of operating the local area of the original image is achieved. Wherein the operation result includes increasing display content or decreasing display content in the second display area. Therefore, the local area of the original image can be independently displayed, and the user can conveniently operate the local area. And the original image and the local area can be displayed at the same time, so that the experience of the user is improved.

According to some embodiments of the disclosure of the first aspect of the present application, displaying the first selection frame at the first location of the first image while displaying the second image at the second display area comprises:

the electronic equipment creates a first selection frame and a second display area;

the electronic equipment acquires a view display layer of a second image covered by the first selection frame;

and the electronic equipment stretches and graphically displays the view display layer in the second display area.

According to some embodiments of the disclosure of the first aspect of the present application, the first selection box and the second display area may be created for the WMS of the electronic device.

According to some embodiments of the disclosure of the first aspect of the present application, the image display method further includes:

detecting a first coordinate at a third location operating on a second image of a second display area;

converting the first coordinate into a second coordinate at a fourth position corresponding to the third position in the first image, synchronizing an operation result at the first coordinate to the second coordinate and displaying in the first display area, wherein the operation result comprises increasing display content or decreasing display content in the second display area.

According to some embodiments of the disclosure of the first aspect of the present application, the first coordinate or the second coordinate is determined in units of pixels.

In a second aspect, an embodiment of the present application further discloses an electronic device, where the electronic device includes:

a memory for storing image display instructions;

and a processor that implements the image display method as any one of the above when executing the image display instruction.

According to the electronic equipment disclosed by the second aspect of the application, when the original image is displayed on the first display area, the local area of the original image displayed on the second display area can be displayed in an enlarged mode, so that a user can conveniently view the details of the local area and the original image at the same time. And the user experience is improved.

In a third aspect, embodiments of the present application also disclose a computer-readable storage medium storing stored image display instructions that when executed by a processor implement an image display method as any of the above.

According to the computer readable storage medium disclosed in the third aspect of the application, when the original image is displayed on the first display area, the local area of the original image displayed on the second display area can be displayed in an enlarged manner, so that a user can conveniently view the details of the local area and the original image at the same time. And the user experience is improved.

Additional features and corresponding advantages of the application will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the application.

Drawings

FIGS. 1 (a) to 1 (c) are schematic diagrams illustrating a configuration of a folding screen electronic device according to an embodiment of the present application;

FIG. 2 (a) is a schematic diagram of an interface of a folding screen electronic device in a folded state according to an embodiment of the present application;

fig. 2 (b) to 2 (c) are schematic views showing interfaces of the folding-screen electronic device in an unfolded state according to an embodiment of the present application;

fig. 3 (a) shows a schematic structural diagram of an electronic device according to an embodiment of the present application;

FIG. 3 (b) shows a software architecture block diagram of an electronic device;

FIGS. 4 (a) and 4 (b) are schematic diagrams illustrating the interface of the precision mode in the embodiment of the present application;

FIG. 5 (a) is a schematic diagram showing a prompt to a user to unfold a folding screen in an embodiment of the application;

FIGS. 5 (b 1) and 5 (b 2) are schematic diagrams showing a first image of a folding screen electronic device according to an embodiment of the present application;

FIGS. 5 (c) to 5 (g) are schematic diagrams showing images of a folding screen electronic device according to an embodiment of the present application;

Fig. 6 (a) is a schematic diagram illustrating a specific implementation flow of an image display method according to an embodiment of the present application;

FIG. 6 (b) is a schematic diagram showing coordinates at a certain position of a precision selection frame according to an embodiment of the present application;

fig. 6 (c) is a schematic diagram illustrating mapping of coordinates of a certain position of a second display area to coordinates of a corresponding position of an original image according to an embodiment of the present application;

FIG. 7 (a) is a schematic diagram of an interface when the single-screen electronic device is not in the accurate mode according to the embodiment of the application;

FIG. 7 (b) is a schematic diagram of an interface when the single-screen electronic device is in the accurate mode in the embodiment of the application;

fig. 7 (c) is a schematic flow chart showing a specific implementation of an image display method according to an embodiment of the present application;

FIG. 7 (d) is a schematic diagram showing selecting coordinates at a certain position of a partial image in a second display area according to an embodiment of the present application;

fig. 7 (e) is a schematic diagram showing mapping of coordinates of a certain position of a second display area to coordinates of a corresponding position of an original image according to an embodiment of the present application;

FIGS. 8 (a) and 8 (b) are schematic diagrams showing images between different electronic devices in an embodiment of the present application;

Fig. 8 (c) is a schematic diagram illustrating a specific implementation flow of an image display method according to an embodiment of the present application;

FIG. 8 (d) is a schematic diagram showing selecting coordinates at a certain position of a partial image in a second display area according to an embodiment of the present application;

fig. 8 (e) is a schematic diagram illustrating mapping of coordinates of a certain position of a second display area to coordinates of a corresponding position of an original image according to an embodiment of the present application;

fig. 9 shows a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 10 shows a schematic structural diagram of an SOC according to an embodiment of the present application.

Detailed Description

The image display method of the electronic equipment provided by the embodiment of the application can be applied to the electronic equipment with the folding screen, the electronic equipment with the independent screen (single-screen electronic equipment) and the like. For an electronic device having a folding screen, the folding screen may be folded to form at least two screens. For example, the folding screen may be folded along a fold edge or fold axis to form a first screen as a primary screen and a second screen as a secondary screen. It will be appreciated that for an electronic device having a folding screen, the interface may be displayed on either the first screen or the second screen when the folding screen is in the folded state. When the folding screen is in the unfolded state, an interface can be displayed on the first screen and the second screen. For an electronic device with a separate single screen, it has a complete one screen to display the interface.

For example, referring to fig. 1 (a), fig. 1 (b) and fig. 1 (c), fig. 1 (a) is a schematic view of a folding-screen electronic device in an unfolded state. The folding screen is an outward folding screen (the display surface of the first screen and the display surface of the second screen are opposite to each other) and can be folded along the folding edge according to the directions 101a and 101b shown in fig. 1 (a), so that the main screen 10 (i.e., the first screen) and the sub-screen 20 (i.e., the second screen) shown in fig. 1 (b) can be formed. The folding screen can be folded over along the folding edges in the directions 102a and 102b shown in fig. 1 (b), and the folding screen in the folded state shown in fig. 1 (c) can be formed. As shown in fig. 1 (c), after the folding screen of the electronic device 1 is completely folded, the first screen and the second screen are opposite to each other and visible to the user. It will be appreciated that the type of folding screen may be other types, and embodiments of the present application are not limited in this regard. If the folding screen is folded inwards (namely, the folding screen turned inwards), the display surface of the first screen is opposite to the display surface of the second screen after the folding screen is folded inwards.

For the electronic device with the folding screen and the electronic device with the independent screen, the embodiment of the application provides an image display method of the electronic device, which can display an original image (as a first image) on a first display area of the screen of the electronic device and display a local area (as a second image, a third image or a fourth image) of the original image on a second display area. And when the original image is displayed on the first display area, the local area of the original image displayed on the second display area can be enlarged and displayed, so that a user can conveniently and simultaneously view the details of the local area and the original image.

For an electronic device with a folding screen, when the folding screen is in an unfolded state, an original image (as a first image) may be displayed on the main screen 10 (as a first display area) of the electronic device, and a local area of the original image may be displayed on the sub-screen 20 (as a second display area) of the electronic device.

The original image is presented full screen (as a first display area) on a separate single screen for a single screen electronic device. And displaying a local area of the original image in the accurate display area (serving as a second display area). The user can operate the local area of the original image in the accurate display area and map the local area back to the original image so as to realize the purpose of operating the local area of the original image. Therefore, the local area of the original image can be independently displayed, and the user can conveniently operate the local area. And the original image and the local area can be displayed at the same time, so that the experience of the user is improved.

It should be noted that when the folding screen is in the folded state, the folding screen mobile phone may be a single screen mobile phone having a single screen, and may display the original image on the main screen 10 or the sub screen 20 in full screen (as the first display area). A partial area of the original image is displayed in correspondence with the precise display area (as the second display area) of the main screen 10 or the sub-screen 20.

According to some embodiments of the present application, an embodiment of the present application provides an image display method of an electronic device. The electronic device 1 may provide a precision mode option (as an option), and after the user selects to turn on the precision mode option, the electronic device may implement a function of simultaneously displaying the original image and a local area of the original image.

An exemplary application scenario of the accurate mode provided by the embodiment of the application applied to a folding screen electronic device is described below by taking the electronic device as a folding screen mobile phone as an example:

fig. 2 (a) shows an interface schematic diagram of a folding screen electronic device in a folded state in an embodiment of the present application. Fig. 2 (b) shows an interface schematic diagram of a folding-screen electronic device in an unfolded state according to an embodiment of the present application.

In fig. 2 (a), the folding screen electronic device is in a folded state so that only a single main screen 10 faces the user, and thus the original image is only shown on the main screen 10. With the game screen shown in fig. 2 (a) as an original image, a shooting game screen is displayed on the main screen 10 of the folding screen electronic device in full screen. The game screen includes information such as the magnifier 1000, the tree 1001, the scene, the map, and teammates playing with the game.

In fig. 2 (b), the user opens the precision mode, and the folding-screen electronic apparatus in the unfolded state displays the original image (such as a game screen of full-screen display shooting) on the main screen 10 (as a first display area), and displays a partial area of the original image (the area of the magnifier and the area around the magnifier are enlarged and displayed) on the sub-screen 20 (as a second display area). In the embodiment of the present application, the local area as shown in fig. 2 (b) refers to the magnifier 1000 and the area around the magnifier 1000.

According to some embodiments of the present application, when a local area of an original image is displayed on the secondary screen 20, the local area of the original image may be displayed on the secondary screen 20 in a full screen manner, so that a user can conveniently view details of the image of the local area, and other additional information, such as characters, may be provided in the local area of the secondary screen 20 in addition to the image.

According to some embodiments of the present application, the local area on the secondary screen 20 where the original image is presented may be selected by the user. As shown in fig. 2 (c), after the user opens the precision mode, the user displays the precision selection box 100 on the main screen 10, and the user may drag the precision selection box 100 on the main screen 10 to select a local area in the original image (the coverage area of the precision selection box 100 on the original image is the local area of the selected original image). The user can zoom in and zoom out on the accurate selection frame, so that the region which the user wants to select can be selected more flexibly, and the experience of the user is improved.

According to some embodiments of the present application, the user may also customize the closed figure formed by drawing the track on the home screen 10 as a precise selection box. The coverage area of the closed graph on the original image is the local area of the original image selected by the user.

According to some embodiments of the present application, a user may operate on a partial region of the secondary screen 20 where the original image is presented. After the user performs an operation (e.g., editing) on the image of the local area on the secondary screen 20, the image of the local area may be mapped back to the corresponding area on the original image of the primary screen 10, so as to ensure consistency between the original image displayed on the primary screen 10 and the image of the local area on the secondary screen 20.

The structure of an electronic device implementing the image display method exemplified by the above embodiment of the present application will be described below.

Fig. 3 (a) is a schematic structural diagram of an electronic device 1 according to an embodiment of the application. As shown in fig. 3 (a), the electronic device 1 may include a processor 410, an external memory interface 420, an internal memory 421, a universal serial bus (universal serial bus, USB) interface 430, a charge management module 440, a power management module 441, a battery 442, an antenna 1, an antenna 2, a mobile communication module 450, a wireless communication module 460, an audio module 470, a speaker 470A, a receiver 470B, a microphone 470C, an earphone interface 470D, a sensor module 480, keys 490, a motor 491, an indicator 492, a camera 493, a display screen 494, and a subscriber identity module (subscriber identification module, SIM) card interface 495, etc. Among other things, the sensor module 480 may include a pressure sensor 480A, a gyroscope sensor 480B, an air pressure sensor 480C, a magnetic sensor 480D, an acceleration sensor 480E, a distance sensor 480F, a proximity light sensor 480G, a fingerprint sensor 480H, a temperature sensor 480J, a touch sensor 480K, an ambient light sensor 480L, a bone conduction sensor 480M, and the like.

It is to be understood that the structure illustrated in the present embodiment does not constitute a specific limitation on the electronic apparatus 1. In other embodiments, the electronic device 1 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 410 may include one or more processing units, such as: the processor 410 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processingunit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller may be a neural and command center of the electronic device 1. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 410 for storing instructions and data. In some embodiments, the memory in the processor 410 is a cache memory. The memory may hold instructions or data that the processor 410 has just used or recycled. If the processor 410 needs to reuse the instruction or data, it may be called directly from the memory. Repeated accesses are avoided, reducing the latency of the processor 410 and thus improving the efficiency of the system.

In some embodiments, processor 410 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuitsound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

It should be understood that the connection relationship between the modules illustrated in this embodiment is only illustrative, and does not limit the structure of the electronic device 1. In other embodiments, the electronic device 1 may also use different interfacing manners in the above embodiments, or a combination of multiple interfacing manners.

The wireless communication function of the electronic device 1 may be implemented by the antenna 1, the antenna 2, the mobile communication module 450, the wireless communication module 460, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 1 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 450 may provide a solution for wireless communication including 2G/3G/4G/5G etc. applied on the electronic device 1. The mobile communication module 450 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 450 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 450 may amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate the electromagnetic waves. In some embodiments, at least some of the functional modules of the mobile communication module 450 may be disposed in the processor 410. In some embodiments, at least some of the functional modules of the mobile communication module 450 may be disposed in the same device as at least some of the modules of the processor 410.

The wireless communication module 460 may provide solutions for wireless communication including wireless local area network (wirelesslocal area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc. applied on the electronic device 1. The wireless communication module 460 may be one or more devices that integrate at least one communication processing module. The wireless communication module 460 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and transmits the processed signals to the processor 410. The wireless communication module 460 may also receive a signal to be transmitted from the processor 410, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, antenna 1 and mobile communication module 450 of electronic device 1 are coupled, and antenna 2 and wireless communication module 460 are coupled, such that electronic device 1 may communicate with a network and other devices through wireless communication techniques. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (codedivision multiple access, CDMA), wideband code division multiple access (wideband code division multipleaccess, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a beidou satellite navigation system (beidounavigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellitesystem, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).

The electronic device 1 implements display functions through a GPU, a display screen 494, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 494 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 410 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 494 is used to display images, videos, and the like. The display screen 494 can be a stand-alone screen to form a single-screen electronic device. Alternatively, the display screen 494 may include a folding screen electronic device that is foldable to form a primary screen (e.g., primary screen 10 shown in FIG. 1 (a)) and a secondary screen (e.g., secondary screen 20 shown in FIG. 1 (a)).

The display screen 494 includes a display panel. The display panel may employ a liquid crystal display (liquid crystaldisplay, LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (flex), a mini, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like.

The electronic device 1 may implement photographing functions through the ISP, the camera 493, the video codec, the GPU, the display screen 494, the application processor, and the like.

The internal memory 421 may be used to store computer-executable program code that includes instructions. The processor 410 executes various functional applications of the electronic device 1 and data processing by executing instructions stored in the internal memory 421. For example, in an embodiment of the present application, the processor 410 may respond to a touch event by a user on the display screen 494 (i.e., the folding screen) by executing instructions stored in the internal memory 421. The internal memory 421 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 1 (e.g., audio data, phonebook, etc.), etc. In addition, the internal memory 421 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flashstorage, UFS), and the like.

The touch sensor 480K, also referred to as a "touch panel". The touch sensor 480K may be disposed on the display screen 494, and the touch sensor 480K and the display screen 494 form a touch screen, which is also called a "touch screen". The touch sensor 480K is used to detect a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display screen 494. In other embodiments, the touch sensor 480K may also be disposed on a surface of the foldable electronic device at a different location than the display screen 494.

The magnetic sensor 480D includes a hall sensor. The folding screen electronic device can detect the opening and closing of the two screens using the magnetic sensor 180D. The acceleration sensor 480E may detect the magnitude of acceleration of the folding screen electronic device in various directions (typically three axes). The magnitude and direction of gravity may be detected when the foldable screen electronic device is stationary. The electronic equipment gesture recognition method can also be used for recognizing the gesture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

The following describes a software system of the electronic device 1 according to the application:

The software system of the electronic device 1 may employ a layered architecture, an event driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the application, taking an Android system with a layered architecture as an example, a software structure of the electronic device 1 is illustrated.

Fig. 3 (b) exemplarily shows a software architecture block diagram of the electronic device 1.

The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun row (Android running time) and system libraries, and a kernel layer, respectively.

The application layer may include a series of application packages.

As shown in fig. 3 (b), the application package may include applications such as cameras, sports, gallery, application store, contacts, mailboxes, cloud sharing, memos, settings, music, short messages, etc.

The application framework layer provides an Application Programming Interface (API) and a programming framework for the application of the application layer. The application framework layer includes a number of predefined functions.

As shown in fig. 3 (b), the application framework layer may include a display policy service, a Power Management Service (PMS), a Display Management Service (DMS). Of course, an activity manager (activity managerservice, AMS), a window management service (window manager service, WMS), a touch event management service (Input Manager Service, IMS), a content provider, a view system, a telephony manager, a resource manager, a notification manager, etc. may also be included in the application framework layer, as embodiments of the present application are not limited in this respect.

Wherein the display policy service is operable to obtain touch instructions of the user from the notification manager. Furthermore, the display policy service can display the content to be displayed on the display screen according to the notification message corresponding to the touch instruction, namely, the content currently displayed on the display screen.

WMS manages windows. The window management service may acquire the size of the display screen of the electronic device 1, determine whether there is a status bar, lock the screen of the electronic device 1, intercept the screen, create a precise selection frame, create a precise display area, and so on. For electronic equipment with folding screens, the main screen is provided with an independent WMS, and the auxiliary screen is also provided with an independent WMS, so that the functions of the respective screens are respectively realized.

The kernel layer may generate a corresponding input event (e.g., a folding screen unfolding event) according to the input operation (e.g., an operation of unfolding a folding screen) by the user on the electronic device 1, and report the event to the application framework layer. The window mode (such as a multi-window mode, a single window mode, or a full screen mode) and the window position and size of the application are set by the activity management server AMS of the application framework layer.

And the window management server WMS of the application program framework layer draws a window according to the setting of the AMS, then sends window data to the display driver of the kernel layer, and displays a corresponding application interface on the folding screen by the display driver. When the folding screen of the electronic device 1 is in a folded state, the electronic device 1 displays the application interface in a full-screen mode. For example, the original image shown in fig. 2 (a). When the folding screen of the electronic device 1 is in an unfolded state, the electronic device 1 displays the application interface in a multi-window mode or a single-window mode. For example, as shown in fig. 2 (b), when the folding screen is in an unfolded state, the original image and a partial area of the original image are displayed in a double window mode.

IMS is used to sense touch events, obtain coordinates at touch locations on the screen, etc.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a lock screen interface including music application icons may include a view showing text and a view showing pictures.

The telephony manager is used to provide communication functions for the electronic device 1. Such as the management of call status (including on, hung-up, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar or in a system lock screen interface. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the mobile phone vibrates, and an indicator light blinks.

Android run time includes a core library and virtual machines. Android run time is responsible for scheduling and management of the Android system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surfacemanager), media library (MediaLibraries), three-dimensional graphics processing library (e.g., openGLES), 2D graphics engine (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The kernel layer, including at least the kernel layer, may include display drivers, input/output device drivers (e.g., keyboard, touch screen, headphones, speakers, microphones, etc.), camera drivers, audio drivers, sensor drivers, and so forth. The embodiment of the present application is not limited in any way.

In the process of displaying the image interface by the electronic device 1, the folding screen of the electronic device 1 may be switched from the folded state to the unfolded state or from the unfolded state to the folded state. At this time, the folding driving (input/output device driving) of the driving layer can detect the folding event input by the user. In the embodiment of the present application, the folding event may be triggered by the user controlling the operation of the folding screen to change from the folded state to the unfolded state, which is referred to as folding event 1. Alternatively, the folding event may be triggered by a user controlling the folding screen to transition from the unfolded state to the folded state, referred to as folding event 2. The folding driver may report folding events to the window manager WMS of the framework layer (i.e. the application framework layer).

Based on the hardware structure and the software system of the electronic device, the image display method will be described below by taking the electronic device 1 as a folding screen mobile phone as an example in combination with an actual application scenario.

The folding screen of the mobile phone is the folding screen shown in fig. 1 (a) to fig. 1 (c), and the folding screen can be folded to form a first screen (such as the main screen 10) and a second screen (such as the auxiliary screen 20) for example, so as to specifically describe the technical scheme provided by the embodiment of the application. When the folding screen is in a folding state, the original image can be displayed on the main screen of the folding screen mobile phone. When the folding screen is in an unfolding state, the primary screen and the secondary screen of the folding screen mobile phone can display the original image and the local area of the original image.

The image display method of the folding screen mobile phone specifically comprises the following steps:

the user opens the precision mode option in the folding screen handset.

Specifically, when the folding screen mobile phone is in the unfolded state, the user can open the accurate mode option on the main screen of the folding screen mobile phone in the manner shown in fig. 4 (a) and fig. 4 (b). The folding screen phone is in an unfolded state so that the main screen 10 and the sub-screen 20 are as one complete screen, and the user can open the precise mode option on the complete screen in the manner shown in fig. 4 (a) and 4 (b).

Fig. 4 (a) and 4 (b) respectively show interface diagrams of the precision mode in the embodiment of the present application.

In fig. 4 (a), a wireless connection icon 101A, a power icon 101B, and a time icon 101C are displayed on top of the electronic device. The status bar 1A of the electronic device includes various icons, such as, but not limited to, a wireless network icon 1A0, a bluetooth icon 1A1, a flashlight icon 1A2, a flight mode icon 1A3, a mobile data icon 1A4, a precision mode icon 1A5, an NFC icon 1A6, a ring icon 1A7, a chinese sharing icon 1A8, a location 1A9, a screen shot 1A10, a personal hotspot 1A11, and the like. After the user clicks the precision mode icon (as the first operation), the electronic device turns on the precision mode. After the user clicks the precise mode icon again, the electronic device turns off the precise mode.

For the start-up mode of the precision mode (as the first operation), including but not limited to the mode shown in fig. 4 (b). Such as a finger joint letter starting mode, a gesture sliding screen starting mode (e.g., a slide starting mode, and a three-finger slide starting mode in the embodiment of the application, a preset time (e.g., 5 seconds) starting mode for a volume key, etc. For the finger joint letter starting mode, when the user turns on the switch 1B to select the mode to start the precision mode, the rest of the switch buttons 1B of the starting mode are turned off, so that the user can continue to select the "starting letter", such as the letter "C" as the starting letter of the precision mode. For the three-finger up-sliding starting mode, when a user selects the mode to start the accurate mode, the user can slide up on the screen of the electronic equipment so as to start the accurate mode. For the volume key long-press 5 second starting mode, when the user selects the mode to start the accurate mode, the user can start the accurate mode by long-press the volume key for 5 seconds. It should be noted that the starting mode of the precision mode may be other modes, and embodiments of the present application are not limited herein.

When the folding screen mobile phone is in a folding state, a user is prompted to unfold the folding screen. The prompting mode includes, but is not limited to, popup prompting characters, voice prompting and the like on the screen of the folding screen mobile phone, wherein the prompting characters can be started in a precise mode as shown in fig. 5 (a), and the characters of the type of "effective after the folding screen is required to be opened" are needed.

When the folding screen is in a folding state, the original image can be displayed on the main screen of the folding screen mobile phone. When the folding screen is in an unfolding state, the primary screen and the secondary screen of the folding screen mobile phone display the original image and the local area of the original image.

Therefore, the detail of the local area is convenient for the user to view by displaying the local area in the auxiliary screen. The method is convenient for the user to operate aiming at the local area, and the user experience is improved.

As shown in the legend of the lower part of fig. 5 (b 1), the current game screen is shown on the main screen 10. After the precise mode is started, when the electronic device detects a specific operation (can be used as a fourth operation), a local area (used as a fourth image) of the original image can be automatically displayed, wherein the local area can be an area preset by an application program. In a game scene, the sub-screen 20 may automatically pop up the detail screen (the sub-screen 20 enlarges and displays the region of the magnifier or the telescope region) based on a specific operation in the game, such as using a gun with the magnifier (when using the magnifier, the specific operation is that the user clicks the magnifier switch button, the form of the magnifier switch button is not limited herein, using a telescope or the like). As shown in the upper part of fig. 5 (b 1), a partial area of the magnifier 1000 is displayed (may be a full screen display or a half screen display) on the sub-screen 20. In addition, the user can operate the scope region shown on the secondary screen 20 and map back to the original game screen of the primary screen 10 (i.e., operation of the local region on the secondary screen 20 can be synchronized to the original game screen of the primary screen 10). Therefore, the user can simultaneously view the complete game picture and the local details of the game picture, and can operate the local details of the original game picture easily. And the user experience is improved.

In other scenes of the game, the user may also determine that the magnifier region is a local region to be accurately displayed (the region covered by the accurate selection frame 100 is a local region) by selecting the accurate selection frame 100 (as the first selection frame) or customizing the closed graph formed by the drawing track (as the second selection frame) as the accurate selection frame. As shown in the legend of the lower part of fig. 5 (b 2), the current game screen is shown on the main screen 10. As shown in the upper part of fig. 5 (b 2), a partial area of the magnifier 1000 is displayed (may be a full screen display or a half screen display) on the sub-screen 20. In addition, the user can operate the scope region shown on the secondary screen 20 and map back to the original game screen of the primary screen 10 (i.e., operation of the local region on the secondary screen 20 can be synchronized to the original game screen of the primary screen 10). Therefore, the user can simultaneously view the complete game picture and the local details of the game picture, and can operate the local details of the original game picture easily. And the user experience is improved.

In a state in which the folding screen mobile phone is in an unfolded state and the user opens the precision mode option, a precision selection box 100 is displayed on the main screen 10. The user can drag the precise selection frame 100 to change positions on the main screen 10, and the user can also enlarge or reduce (as a third operation) the size of the precise selection frame 100 to change the area of the partial area of the selected original. Meanwhile, the track drawn by the user on the main screen can be any shape and any size of graph, and the embodiment of the application is not limited herein.

Next, taking the original image displayed on the main screen of the mobile phone with the current folding screen of the user as a live game, as shown in the partial legend at the lower part of fig. 5 (c), a certain game picture is displayed on the full screen of the main screen, and the image of the current main game is displayed in a floating manner on the display frame 50 at the lower right corner of the main screen.

In a state in which the folding screen phone is in an unfolded state and the user opens the precision mode option, according to some embodiments of the present application, a precision selection box 100 is displayed on the main screen 10. The user may drag the precision selection box to change positions on the main screen 10, and the user may also enlarge or reduce the size of the precision selection box 100 to change the area of the local area of the selected artwork. For example, the user drags the precision selection box and adjusts the size of the precision selection box 100 to completely select the currently anchor image shown in the lower right corner display box.

As shown in the partial legend on fig. 5 (c), the folding-screen mobile phone displays the image in the precise selection box on the secondary screen 20 of the folding-screen mobile phone (which may be a full-screen enlarged display or a half-screen display). The original image of the live game is still displayed on the main screen. Therefore, the user can not only view the complete original game image of the live game, but also see the appearance of the host more clearly. And the user experience is improved.

According to other embodiments of the present application, in a state that the folding-screen mobile phone is in an unfolded state and the user opens the accurate mode option, the user may also use a closed figure formed by a finger or the like which is a custom drawing track along the boundary of the lower right corner display frame of the main screen 10 as the accurate selection frame. The image of the anchor in the display frame enclosed by the closed graph is the local area of the original image selected by the user. In addition, the user may click on the display frame 50 to enlarge and display the content displayed in the display frame 50 on the sub-screen 20.

According to other embodiments of the present application, in a state in which the folding screen mobile phone is in an unfolded state and the user opens the accurate mode option, the user may click on any one position in the display frame of the lower right corner on the main screen 10, and the folding screen mobile phone displays the current anchor image displayed in the display frame on the sub-screen 20 of the folding screen mobile phone.

According to some embodiments of the present application, an image display method of an electronic device is disclosed in the embodiments of the present application. The method can also be applied to different application scenes such as video chat, video playing, text reading, picture editing, games and the like.

Fig. 5 (d) shows a precise display in a scene of a video call. As shown in the left-hand legend of fig. 5 (d), the current user a is using the folding screen phone to make a video call with the user B, the screen of the main screen 10 of the folding screen phone shows the video image of the user a of the video chat being made by the user, and the display box 51 in the upper right corner of the main screen shows the video image of the user B. The user determines a partial area of the original image to be displayed by selecting or customizing the drawing trajectory by the precision selection box 100 and clicking any one position of the display box 51 in the upper right corner. As shown in the legend on the right side of fig. 5 (d), a local area of the original image (e.g., a video image of user B is shown in display box 51) is shown on the secondary screen 20 (which may be a full-screen enlarged display or a half-screen display). Thus, the user can view the video details of himself and herself and the other party at the same time. And the user experience is improved.

Fig. 5 (e) shows a precise display in a scene where a video is viewed and a bullet screen is ejected. As shown in the legend of the lower part of fig. 5 (e), the screen of the main screen 10 shows a bullet screen 52 directly above the video being played. The user determines the area of the display barrage as the local area to be precisely displayed by selecting or custom drawing the track through the precise selection box 100. As shown in the upper part of fig. 5 (e), the sub-screen 20 displays (may be a full-screen enlarged display or a half-screen display) the area of the bullet screen. Therefore, the user can clearly see the details of the barrage part while watching the video, and the experience of the user is improved. It should be noted that, when displaying the shots on the sub-screen 20 in an enlarged manner, each of the shots is displayed in an enlarged manner row by row, i.e., as shown in fig. 5 (e), according to the time of the shots, a first one of the shots is displayed in a first row of the sub-screen 20 in an enlarged manner, a second one of the shots is displayed in a second row of the sub-screen 20 in an enlarged manner, a third one of the shots is displayed in a third row of the sub-screen 20 in an enlarged manner, and so on.

Fig. 5 (f) shows a precise display in a text reading scenario. As shown in the legend on the left side of fig. 5 (f), the screen of the home screen 10 presents an article 53. The user determines the local area to be presented precisely (e.g., lines 1-5 of chapter 53) by way of selection by the precision selection box 100, or custom drawing of a track, etc. As shown in the legend on the right side of fig. 5 (f), the area of lines 1-5 of the article is shown (either as a full screen zoom-in display or as a half screen display, etc.) on the secondary screen 20. Therefore, the user can more clearly view the text content of the article while viewing the original article. And the experience of the user is improved.

Fig. 5 (g) shows a precise display in a scene of picture editing. As shown in the legend on the left side of fig. 5 (g), the screen of the home screen 10 presents a picture 54. The user determines the local area to be accurately displayed of the currently displayed picture (the coverage area of the accurate selection frame 100 on the original picture is the local area to be accurately displayed) through the accurate selection frame 100 selecting or the user-defined drawing track and the like, so as to perform consulting or detail editing, for example, deleting or graffiti the local area, wherein the deleted content can be used as reduced display content, and the graffiti content can be used as increased display content. As shown in the legend on the right side of fig. 5 (g), a local area to be accurately displayed of the currently displayed picture is displayed on the sub-screen 20 (may be a full-screen enlarged display or may be a half-screen display). In addition, the user can operate the partial region shown on the sub-screen 20 (as a fifth operation) and map back to the original picture of the main screen 10 (i.e., the operation on the partial region on the sub-screen 20 can be synchronized to the original picture of the main screen 10). Therefore, the user can simultaneously view the local details of the original picture and the original picture, and can operate the local details of the original picture easily. And the user experience is improved.

Based on the image display method of each application scene, the specific implementation process of the image display method of the electronic device is described below by taking the electronic device of the folding screen type as an example,

referring to fig. 6 (a), fig. 6 (a) is a schematic flow chart of a specific implementation of an image display method according to an embodiment of the present application. Fig. 6 (a) illustrates an image display method using the scene of the picture editing illustrated in fig. 5 (g) as an example, and the image display method includes steps S600 to S612.

Step S600: the electronic device receives a first operation. The electronic device displays a first image on a main screen (as a first display area), and the first operation may be an opening operation of opening an on-screen option (such as a precision mode option), or a gesture operation or a key combination operation as shown in fig. 4 (b). The electronic device may be a folding screen mobile phone mentioned in the above embodiment. The precision mode may be an option (precision mode option) icon on the main screen 10 of the user touch folding screen phone. Specifically, when a user touches the accurate mode icon, the accurate mode opening instruction is triggered after the touch sensor of the folding screen mobile phone detects that the user touches the accurate mode icon on the screen of the folding screen.

Step S601: the electronic device detects whether the folding screen is open (i.e., whether the folding screen is in an unfolded state). If the folding screen is not opened, the electronic device sends out prompt information to prompt the user to open the folding screen. Specifically, the electronic device detects whether the folding screen is opened or not through the magnetic sensor. The prompting information includes, but is not limited to, pop-up prompting characters, voice prompts, etc. on the screen of the folding screen mobile phone, where the prompting characters can be opened in a "precise mode" as shown in fig. 5 (a), and the characters need to be validated after the folding screen is opened. If the folding screen has been opened, step S602 is entered.

Step S602: the electronic device responds to the first operation, the WMS of the main screen creates a precise selection box (as a first selection box) and displays the precise selection box at a first position of the first image, or the WMS creates a track graph (as a second selection box) according to the drawing track of the user on the main screen of the folding screen. The partial area covered by the first selection frame serves as a second image displayed in the second display area. The content of the second image corresponds to the content at the first location. In the embodiment of the present application, taking the picture illustrated in fig. 5 (g) as an example, the WMS of the home screen creates the precise selection box 100 and is placed at the upper layer of the picture 54. The area covered by the precision selection frame 100 is a local area. Among them, WMS is a window management service on the software framework (Framewrok) side of electronic devices. The WMS creates a precise selection frame in various shapes such as square, circular, etc., and the position of the precise selection frame is changed by a different position of the user's touch on the screen detected by the touch sensor. In addition, the touch sensor may detect an enlargement instruction or a reduction instruction (as a third operation) triggered by the user touching the screen to implement an enlargement or reduction precise selection frame, or the like. The local area in the accurate selection frame is the content to be accurately displayed.

Step S603: the WMS of the home screen calls a getView () method of the precise selection frame to acquire a view display layer of a local area in the precise selection frame. The view display layer refers to the image content of the selected local area within the precision selection box (e.g., the view display layer of the local area of the tree selected by the precision selection box 100 in fig. 5 (g)).

Step S604: the WMS of the secondary screen creates a precise display area on the secondary screen of the folding screen. It should be noted that there is no sequence relationship between the step S603 and the step S604, for example, the step S603 may be performed before the step S604 is performed, or the step S603 and the step S604 may be performed simultaneously.

Step S605: the WMS of the secondary screen calls the getView () method and onDraw () method of the precise display area to stretch the view display layer of the partial area within the precise selection frame and to display the view display layer drawing full screen on the secondary screen (i.e., the partial area of the tree within the precise selection frame 100 is displayed full screen on the secondary screen).

Specifically, the WMS of the secondary screen invokes the getView () method of the precise display area to set the view display layer of the local area in the precise selection frame to be displayed on the secondary screen in full screen. If the view display layer of the local area in the accurate selection frame is set to be the flag_fullscreen, the full-screen display of the view display layer is set.

The WMS calls the onDraw () method to draw the view display layer of the local area and display it in full screen in the precise display area of the sub-screen, that is, the local area of the tree in the precise selection box 100 is displayed on the sub-screen in enlargement according to the magnification factor C. The magnification is the ratio of the area of the precision display area to the area of the precision selection frame (or the closed figure of the track drawn by the user).

After the steps S600 to S605 are executed, the local area in the accurate display frame of the main screen is displayed in a full-screen manner on the auxiliary screen, so that a user can conveniently and simultaneously view the original image displayed on the main screen and view the details of the local area on the auxiliary screen, and the user experience is improved.

After the execution of steps S600 to S605, steps S606 to S612 may be continued. The flow of the operation of the partial region of the precise display area will be described below taking the picture illustrated in fig. 5 (g) as an example.

The user can operate the displayed local area on the secondary screen. Meanwhile, the operation of the local area can be mapped back to the original image of the main screen, so that the consistency of the image of the local area of the auxiliary screen and the original image is ensured. Therefore, the local area is displayed on the whole screen of the auxiliary screen (the whole screen on the auxiliary screen is the accurate display area), so that the user can operate the local area conveniently, and the user experience is further improved.

Step S606: the IMS of the home screen obtains the point in the home screen at the bottom left corner of the precision selection box as the start of the local area. As shown in fig. 6 (b), the picture 54 and the precision selection box 100 are shown on the home screen 10. The coordinates of the point in the lower left corner of the precision selection box may be noted as point a (x 1, y 1). The IMS determines the coordinates of the point in the lower left corner of the precision selection frame 100 in pixels with the lower left corner of the entire screen of the home screen as the origin B (0, 0).

Step S607: the IMS of the secondary screen acquires the coordinates (x 2, y 2) of the position C of the local area in the secondary screen touched by the user. Specifically, the sub-screen 20 displays the local area of the tree selected in the accurate selection frame 100 in a full screen mode, and the touch sensor senses the local area of the tree on the sub-screen touched by the user and reports the touch event of the sub-screen touched by the user to the IMS of the sub-screen. The IMS of the sub-screen determines coordinates of a touch position of a touch event of a user touching the sub-screen in units of pixels.

Step S608: the IMS of the secondary screen determines the magnification of the secondary screen compared to the local area on the primary screen. In the embodiment of the application, the amplification factor is denoted as C. And displaying a local area on the auxiliary screen in a full screen mode, wherein the whole screen of the auxiliary screen is used as a precise display area. The area of the accurate display area is the area of the auxiliary screen. The area of the local area on the home screen is then the area of the precision selection box (or closed figure of the user's hand-drawn track). The magnification is the ratio of the area of the precision display area to the area of the precision selection frame (or the closed figure of the track drawn by the user).

Step S609: the IMS of the secondary screen transmits the coordinates (x 2, y 2) of the location C of the local area touched by the user to the IMS of the primary screen. For example, the user draws a track (the track is highlighted with colored lines) in a local area, which track can be automatically synchronized to the original image of the main screen.

Step S610: the IMS of the primary screen converts the coordinates (X2, Y2) at position C of the local area of the tree on the secondary screen into coordinates (X, Y) at the corresponding position D on the primary screen. The function of mapping the operation of the user on the accurate display area back to the original image of the main screen is realized.

Specifically, as shown in fig. 6 (C), the IMS of the primary screen obtains coordinates (X2, Y2) at the position C of the local area of the secondary screen tree corresponding to coordinates (X, Y) at the corresponding position D of the same tree on the primary screen according to the following formula:

X＝x1+x2/C

Y＝y1+y2/C

step S611: the IMS of the home screen reports the coordinates (X, Y) to the WMS.

Step S612: and the WMS receives the converted coordinates (X, Y) to perform event response, and the touch event of the accurate display area is automatically mapped to the main screen. The operation of the user on the sub-screen to the local area of the accurate display area can be synchronized to the original image of the main screen.

It is noted that when the user performs operations such as zooming in, dragging, and zooming out on the precise selection frame displayed on the home screen. The selected local area on the home screen will also change. The secondary screen serves as an accurate display area and refreshes the content of a local area displayed on the secondary screen in real time, specifically, the WMS of the secondary screen calls a getView () method to acquire an accurate display layer of the accurate display area of the secondary screen, the WMS of the primary screen acquires a view display layer of an accurate selection frame, the WMS of the secondary screen calls a getView () method and an onDraw () method of the accurate display area to stretch the view display layer of the local area in the accurate selection frame and display the drawing full screen of the view display layer on the secondary screen to refresh the local area on the secondary screen. At this time, the IMS of the main screen and the IMS of the sub screen newly determine the coordinates (x 1, y 1) of the start point of the local area, the coordinates (x 2, y 2) of the position of the local area touched by the user, the IMS of the sub screen determines the magnification of the sub screen compared to the local area on the main screen, and the like.

Further, the starting point of the local area may be selected as the rest of the position of the precision selection frame. The coordinates of the position are used as the coordinates of the start point of the local area. The starting point of the local area is not limited in the embodiment of the present application.

Through demonstrate local region in the auxiliary screen, the user of being convenient for operates to local region, has promoted user experience and has felt.

The image display method disclosed by the embodiment of the application not only can be used for the above folding screen electronic equipment, but also can be used for single screen electronic equipment (namely, the electronic equipment with only one screen can be used, and the folding screen electronic equipment can be displayed by a main screen as a screen in a folding state). The original image is presented full screen (as a first display area) on a separate single screen 30 for a single screen electronic device. And displaying a local area of the original image in the accurate display area (serving as a second display area). According to some embodiments of the application, the precision display area may cover an upper layer of the first display area.

The following describes an application scenario in which the precision mode provided by the embodiment of the present application is applied to a single-screen electronic device:

fig. 7 (a) shows an interface schematic diagram when the single-screen electronic device in the embodiment of the application does not start the accurate mode, and fig. 7 (b) shows an interface schematic diagram when the single-screen electronic device in the embodiment of the application starts the accurate mode. In fig. 7 (a), the single-screen electronic device when the precision mode is not turned on shows an original image on the screen 30 (as the first display area). Taking the game screen shown in fig. 5 (b) as an example of an original image in fig. 7 (a), a shooting game screen is shown on the main screen 10 of the single-screen electronic device in full screen. The game screen includes information such as the magnifier 1000, the scenery of the tree 1001, the map, and teammates playing with the map.

In fig. 7 (b), the user opens the precision mode, and the single-screen electronic apparatus displays the precision display area 301 (as the second display area) on the screen. The single-screen electronic device when the precision mode is turned on simultaneously displays the original image (such as a game picture of full-screen display shooting), the precision selection frame 100, and a local area of the original image on the screen 30 (the area covered by the precision selection frame 100 is a local area, and the local area of the original image is displayed in the precision display area 301, such as the area of the magnifier 1000 and the area around the magnifier are magnified and displayed). The precision presentation area 301 covers a partial area of the screen of a single-screen electronic device. According to some embodiments of the present application, when the local area of the original image is displayed on the accurate display area 301, the local area of the original image may be displayed in an enlarged manner on the accurate display area, so that the user may conveniently view the details of the local area. In addition, the user may drag the precise display area 301 to change the position of the precise display area 301 on the screen 30.

According to some embodiments of the present application, the magnification of the partial area of the original image enlarged and displayed on the precision display area 301 may be a ratio of the area of the precision display area 301 to the area of the precision selection frame 100.

According to some embodiments of the present application, the area of the precision display area 301 includes, but is not limited to, rectangular, circular, diamond, etc. The area of the precision display area 301 may be smaller than the area of the screen 30. The area of the precise display area 301 can be set in a customized manner, and the embodiment of the application is not limited herein.

According to some embodiments of the present application, a local area of the precision display area 301 where the original image is displayed (e.g., the area of the magnifier 1000 and the area around the magnifier are magnified) may be selected by a user. As shown in fig. 7 (b), after the user opens the precision mode, the precision selection box 100 is displayed on the screen of the single-screen electronic device, and the user may drag the precision selection box 100 on the screen 30 to select a local area in the original image (the coverage area of the precision selection box 100 on the original image is the selected local area of the original image). The user can zoom in and out on the accurate selection frame 100, so that the area which the user wants to select can be selected more flexibly, and the experience of the user is improved.

According to some embodiments of the present application, the user may also customize the closed figure formed by drawing the track on the screen 30 as the precise selection box 100. The coverage area of the closed graph on the original image is the local area of the original image selected by the user. Further, a current game screen is shown on the screen 30. Based on a specific operation in the game, for example, using a gun with a magnifier (when using a magnifier, the specific operation is that a user clicks a magnifier switch button, and the form of the magnifier switch button is not limited herein, the embodiment of the present application) uses a telescope, etc., the precise display area 301 automatically pops up the detail screen (the magnifier area or the telescope area is displayed in a magnified manner on the precise display area 301).

According to some embodiments of the present application, a user may operate on a partial region of the precision display area 301 where the original image is displayed. After the user performs an operation (such as editing) on the image of the local area on the screen 30, the image of the local area can be mapped back to the corresponding area on the original image of the screen 30, so as to ensure the consistency of the original image displayed on the screen 30 and the image of the local area displayed on the accurate display area 301.

The following describes an image display method of a single-screen mobile phone with reference to a specific example, where the image display method of the single-screen mobile phone is specifically as follows:

the user opens the precision mode option. The user can open the precision mode option on the screen of the single-screen handset in the manner shown in fig. 4 (a) and 4 (b).

The single screen handset presents the original image full screen (as the first display area) on a separate single screen 30. And displaying a local area of the original image in the accurate display area (serving as a second display area). The precision display area may cover an upper layer of the first display area. The user can manipulate the local area in the precision display area and map back to the original image. Thereby ensuring the consistency of the original image displayed on the first mobile phone and the image of the local area on the second mobile phone.

The local area of the original image displayed in the accurate display area can be selected by a user dragging, zooming in or zooming out the accurate selection frame. The method can also be selected by a track graph drawn by a user on a screen, and the area covered by the track graph is the selected local area.

Therefore, the local area is displayed in the accurate display area, so that the user can conveniently view the details of the local area. The method is convenient for the user to operate aiming at the local area, and the user experience is improved.

The following describes an image display method of the single-screen mobile phone in combination with an actual application scene:

taking the game screen illustrated in fig. 5 (b) in the above embodiment as an example, an image display method of the single-screen mobile phone is described as an example:

the user opens the precision mode option. As shown in fig. 7 (b), the screen 30 of the single-screen mobile phone displays the original game screen, the precise selection frame 100, the precise display area 301, and the like. The main screen 10 displays the current game screen. A partial region of the magnifier 1000 is displayed on the precision display area 301. In addition, the user can manipulate the magnifier region displayed on the precision display area 301 and map back to the original game screen of the screen 30 (i.e., manipulation of the localized region on the precision display area 301 can be synchronized to the original game screen of the screen 30). Therefore, the user can simultaneously view the complete game picture and the local details of the game picture, and can operate the local details of the original game picture easily. And the user experience is improved. Wherein, the precise selection frame 100 and the precise display area 301 are covered on the upper layer of the original game screen. The coverage area of the precise selection frame 100 on the original game screen is the local area to be precisely displayed, and the image (such as the magnifier area) of the local area selected by the precise selection frame 100 is displayed in the precise display area 301. It is noted that, the user may also determine the local area to be accurately displayed of the currently displayed game picture in a manner of drawing the track to form the track graph (the area of the picture covered by the track graph is the local area).

It is noted that the user may drag, zoom in, or zoom out the precise selection frame 100 to select a partial area of the game screen as a partial area to be precisely displayed.

In addition, the user can drag, zoom in or zoom out the position of the precise display area 301, so as to flexibly adjust the display position and size of the precise display area 301.

Based on the above-mentioned practical application scenario of the image display method of the single-screen electronic device, a specific implementation procedure of the image display method of the electronic device will be described below by taking the electronic device with a single screen as an example:

referring to fig. 7 (c), fig. 7 (c) is a schematic flow chart of a specific implementation of an image display method according to an embodiment of the present application, which includes steps S700-S709.

Step S700: the electronic device receives a first operation. The first image is displayed in a first display area of the electronic device, and the first operation may be an opening operation of opening an on-screen option (such as a precision mode option), or a gesture operation or a key combination operation as shown in fig. 4 (b). The electronic device may be a single-screen mobile phone mentioned in the foregoing embodiment, the first display area may be a full screen of the single-screen mobile phone, and the first image may be an original image. The opening operation of the precise mode option may be that a user triggers a precise mode icon on a screen of the single-screen mobile phone to open, and the precise mode icon on the screen is detected by the touch sensor to be touched by the user, so that a precise mode opening instruction is triggered.

Step S701: the electronic device responds to the first operation, the WMS creates a precise selection box and a precise display area, or the WMS creates a track graph according to a drawing track of a user on a screen of the electronic device. The precise selection frame may be displayed at a first position of the first image, and the precise selection area may be overlaid on the first image as a second display area and display the second image or the third image within the precise selection area. In the embodiment of the present application, taking the picture illustrated in fig. 5 (b) as an example, the WMS of the home screen creates the precise selection frame 100 and is placed at the upper layer of the game screen. The area covered by the precision selection frame 100 is a local area. The precise display area in the embodiment of the present application is located above the magnifier illustrated in fig. 5 (g). Among them, WMS is a window management service on the software framework (Framewrok) side of electronic devices. The WMS creates the precise selection frame and the precise display area in various shapes such as square, round, etc., and the positions of the precise selection frame and the precise display area are changed by different positions of the touch of the user on the screen detected by the touch sensor. In addition, the touch sensor can detect an amplifying instruction or a shrinking instruction triggered by the touch of a user on the screen to realize amplifying or shrinking of the accurate selection frame, the accurate display area and the like. The local area in the accurate selection frame is the content to be accurately displayed. And amplifying and displaying the local area in the accurate selection frame in the accurate display area.

Step S702: the WMS calls the getView () method of the precision selection box to acquire the view display layer of the local area within the precision selection box. The view display layer refers to the image content of the selected partial area within the precision selection frame (e.g., the view display layer of the partial area of the magnifier selected by the precision selection frame 100 in fig. 5 (d)).

Step S703: the WMS calls a getView () method and an onDraw () method of the precise display area to stretch a view display layer of a local area in the precise selection frame and to display a view display layer drawing in the precise display area.

Specifically, the WMS invokes the getView () method of the precision display area to set the view display layer of the local area in the precision selection box to be displayed in an enlarged manner in the precision display area. The image in the accurate selection area as the second display area is displayed with a second magnification, the original image displayed in the first display area is displayed with a first magnification, and the second magnification is larger than the first magnification.

WMS calls onDraw () method to draw view display layer of local area and display it in accurate display area in full screen. (i.e., magnifying the local area of the magnifier within the precision selection frame 100 in the precision display area)

After the steps S700 to S703 are executed, the local area in the accurate display frame is displayed in an enlarged mode in the accurate display area, so that a user can conveniently and simultaneously view the original image displayed on the screen and view the details of the local area on the screen, and the user experience is improved.

After the execution of steps S700 to S703, the execution of step S704-may be continued. The flow of the operation of the partial region of the precise display area will be described below taking the game screen illustrated in fig. 5 (b) as an example.

The user can operate the displayed local area in the accurate display area on the screen. Meanwhile, the operation of the local area can be mapped back to the original image of the screen, so that the consistency of the image of the local area and the original image is ensured. Therefore, the local area is displayed in the accurate display area of the screen, so that the user can operate the local area conveniently, and the user experience is further improved.

Step S704: the point in the IMS acquisition screen at the bottom left corner of the precision selection box serves as the starting point for the local area. As shown in fig. 7 (d), the current game screen is shown on the main screen 10. The user determines that the magnifier region is a local region to be accurately displayed through the mode of selecting by the accurate selection frame 100 or customizing a drawing track and the like (the region covered by the accurate selection frame 100 is the local region). The coordinates of the precision selection box 100 at a certain position E thereof may be denoted as (x 1, y 1). The IMS acquires the coordinate start point and the coordinate end point of the precise display area 301, the coordinate start point F1 of the precise display area 301 may be denoted as (xs, ys), and the coordinate end point of the precise display area may be denoted as F2 (xe, ye). The IMS determines the magnification of the local area on the accurate display area of the original image. In the embodiment of the application, the amplification factor is denoted as C. The magnification is the ratio of the area of the precise display area to the area of the precise selection frame (or the closed graph of the track drawn by the user).

Specifically, the IMS determines the coordinates of the point in the lower left corner of the precision selection frame in units of pixels with the lower left corner of the entire screen as the origin O (0, 0).

Step S705: the touch sensor senses that a user touches the screen to send a touch instruction (touch event), namely, the user touches any one position of a game picture on the touch screen, and each position is uniquely corresponding to coordinates and corresponding pixel points.

Step S706: the IMS judges whether the coordinates of the touch position corresponding to the touch instruction are positioned in the accurate display area. If it is located in the precision display area, the process proceeds to step S707, and if it is not located in the precision display area, the process is performed in accordance with the normal response (i.e., coordinate conversion is not performed).

Specifically, the sitting at the position G touched by the user is marked (x 2, y 2). The IMS judges whether the coordinate of the touch position corresponding to the touch instruction is positioned in the accurate display area or not specifically comprises the following steps: judging whether the coordinates (x 2, y 2) meet the condition of (xs < x2< xe & ys < y2< ye), and if the coordinates (x 2, y 2) meet the condition, indicating that the touch position corresponding to the coordinates (x 2, y 2) at the point G is located in the accurate display area.

Step S707: the IMS converts the coordinates at the corresponding touch location to coordinates on the original image.

Specifically, the IMS obtains the coordinates of position G corresponding to position H on the original image of the screen as (X, Y) according to the following formula:

X＝x1+(x2-xs)/C

Y＝y1+(y2-ys)/C

specifically, as shown in fig. 7 (e), the coordinates of the position G are (X2, Y2), and the coordinates corresponding to the position H on the original image are (X, Y).

Step S708: the IMS reports the coordinates (X, Y) to the WMS.

Step S709: and the WMS receives the converted coordinates (X, Y) to perform event response, and the touch event of the accurate display area is automatically mapped onto the original image. So that the user's operation on the screen to the local area of the precision display area can be synchronized to the original image of the screen.

Note that when the user performs operations such as enlarging, dragging, and reducing the precision selection frame and the precision display area displayed on the screen. The selected local area on the screen will change, as will the position of the precision display area on the screen and the content displayed in the precision display area. The precision display area will refresh the content of the local area presented on the screen in real time. Specifically, the WMS calls the getView () method to obtain the accurate display layer of the accurate display area and the view display layer of the accurate selection frame, and the WMS calls the getView () method and the onDraw () method of the accurate display area to stretch the view display layer of the local area in the accurate selection frame and to display the view display layer in the accurate display area in a drawing and enlarging manner to realize refreshing of the local area. At this time, the IMS redetermines the coordinates (x 1, y 1) of the start point of the local area, the coordinates (x 2, y 2) of the user touch position, the start point and the end point of the coordinates of the precise display area, the magnification of the precise display area compared with the local area, and the like.

Further, the starting point of the local area may be selected as the rest of the position of the precision selection frame. The coordinates of the position are used as the coordinates of the start point of the local area. The coordinate start point and the coordinate end point of the precise display area can be selected as the rest positions, and the embodiment of the application is not limited to this.

The local area is displayed in the accurate display area in an enlarged mode, so that a user can operate on the local area conveniently, and user experience is improved.

The accurate mode not only can be used for the folding screen mobile phone and the single screen mobile phone. The precision mode can also be applied to different electronic devices. The original image is displayed on the first electronic device, and the local area of the original image is displayed on the second electronic device. The first electronic device and the second electronic device may be the same electronic device or different electronic devices. If the first electronic device and the second electronic device are both mobile phones or the first electronic device is a mobile phone and the second electronic device is a notebook computer.

According to some embodiments of the application, the first electronic device and the second electronic device may communicate in the near field. After the user opens the accurate mode, the first electronic device and the second electronic device are connected, and the first electronic device displays the original image and the accurate selection frame. The user may operate the precision selection box (operations including, but not limited to, dragging, zooming in, zooming out, etc.) on the electronic device one to select a local area (the coverage area of the precision selection box on the original image is the local area of the selected original image).

According to some embodiments of the present application, when the local area of the original image is displayed on the second electronic device, the local area of the original image may be displayed in full screen enlargement on the screen, so that the user may conveniently view details of the local area.

According to some embodiments of the present application, a user may also customize a closed figure formed by drawing a track on a screen of the first electronic device as a precise selection frame. The coverage area of the closed graph on the original image is the local area of the original image selected by the user.

According to some embodiments of the present application, a user may operate a local area of the second electronic device in which the original image is displayed. After the user operates (e.g. edits) the image of the local area on the second electronic device, the image of the local area can be mapped back to the corresponding area on the original image of the first electronic device, so that the consistency of the original image displayed on the first electronic device and the image of the local area on the second electronic device is ensured.

According to the technical scheme disclosed by the embodiment of the application, the local area selected by the user can be displayed in an enlarged manner, so that the user can conveniently operate the local area. And the original image and the local area can be displayed at the same time, so that the experience of the user is improved.

Application scenarios that apply to the precision mode may also apply to different electronic devices are described below. Taking the mobile phone as an example of the electronic device I and the electronic device II. And displaying the original image on the first mobile phone and displaying the local area of the original image on the second mobile phone. The first mobile phone and the second mobile phone can communicate with each other.

After the user opens the accurate mode, the first mobile phone and the second mobile phone are connected, and the first mobile phone displays the original image and the accurate selection frame. The user can operate the accurate selection frame (operations include, but are not limited to, dragging, zooming in, zooming out, and the like) on the first mobile phone to select the local area (the coverage area of the accurate selection frame on the original image is the local area of the selected original image).

According to some embodiments of the application, the first handset transfers the local area to the second handset. And displaying the local area on a screen by the second mobile phone.

According to some embodiments of the present application, when the local area of the original image is displayed on the second mobile phone, the local area of the original image may be displayed in a full screen manner, so that the user may conveniently view the details of the local area.

According to some embodiments of the present application, a user may also customize a closed figure formed by drawing a track on a screen of the first mobile phone as a precise selection frame. The coverage area of the closed graph on the original image is the local area of the original image selected by the user.

According to some embodiments of the present application, a user may operate a local area of the second mobile phone in which the original image is displayed. After the user operates (e.g. edits) the image of the local area on the second mobile phone, the image of the local area can be mapped back to the corresponding area on the original image of the first mobile phone, so that the consistency of the original image displayed on the first mobile phone and the image of the local area on the second mobile phone is ensured.

The following describes an image display method between different electronic devices in combination with an actual application scenario:

an exemplary method of displaying images between different electronic devices will be described taking the example of the picture shown in fig. 5 (g) and the example of the game screen shown in fig. 5 (a) in the above-described embodiments as examples: |

The user opens the precision mode option. As shown in fig. 8 (a), the original picture 54 and the precision selection box 100 are shown on the screen of the cell phone one 40. Wherein the precision selection frame 100 covers the upper layer of the original picture. The area covered by the precision selection frame 100 is a local area selected by the user. It is noted that, the user may also determine the local area to be accurately displayed of the currently displayed picture in a manner of drawing the track to form the track graph and the like (the area of the picture covered by the track graph is the local area). The mobile phone 40 transmits the selected local area in the precise selection frame 100 to the second mobile phone 50 through the short-range wireless communication technology. The second handset 50 displays the selected localized area within the precision selection box 100 on the screen. Wherein, the selected local area in the accurate selection frame 100 can be displayed on the screen of the second mobile phone 50 in a full screen manner.

In addition, the user can operate the local area displayed on the second phone 50 and map the local area back to the original picture of the first phone 40 (i.e. the operation on the local area on the second phone 50 can be synchronized to the original picture of the first phone 40). Therefore, the user can simultaneously view the local details of the original picture and the original picture, and can operate the local details of the original picture easily. And the user experience is improved.

As shown in fig. 8 (b), the screen of the first mobile phone 40 displays an original game screen, a precision selection frame 100, and the like. Wherein the precision selection frame 100 is covered on the upper layer of the original game screen. The area covered by the precision selection frame 100 is a local area (e.g., a magnifier area) selected by the user. It is noted that, the user may also determine the local area to be accurately displayed of the currently displayed original game picture in a manner of drawing the track to form the track graph and the like (the area of the picture covered by the track graph is the local area). The mobile phone 40 transmits the selected local area in the precise selection frame 100 to the second mobile phone 50 through the short-range wireless communication technology. The second handset 50 displays the selected localized area within the precision selection box 100 on the screen. Wherein, the selected local area in the accurate selection frame 100 can be displayed on the screen of the second mobile phone 50 in a full screen manner.

It is noted that the user may drag, zoom in or out the partial region of the picture selected by the precision selection frame 100 as the partial region to be precisely displayed.

Based on the above-mentioned example of the actual application scenario in which the precision mode is applied to different electronic devices, a specific implementation procedure of the image display method in which the precision mode is applied to different electronic devices will be described below. Referring to fig. 8 (c), fig. 8 (c) is a schematic flow chart showing a specific implementation of an image display method according to an embodiment of the present application, and fig. 8 (c) illustrates an image display method by taking a picture shown in fig. 5 (g) as an example, where the image display method includes steps S800-S813.

Step S800: the electronic device receives a first operation. The first image is displayed on a display screen of the first electronic device, and the first operation may be an opening operation of opening an on-screen option (such as a precision mode option), or a gesture operation or a key combination operation as shown in fig. 4 (b). The first electronic device may be a single-screen mobile phone or a folding-screen mobile phone as mentioned in the above embodiments. The accurate mode can be that a user triggers an accurate mode icon on a screen of the single-screen mobile phone to start, and the accurate mode icon on the screen is detected by the touch sensor to trigger an accurate mode starting instruction.

Step S801: the electronic device first detects whether a connection is currently established with other devices, such as a bluetooth connection, etc. If a connection is established with another device, the flow proceeds to step S802. If no other connected device exists, the accurate mode display may not be performed, or the accurate mode display may be performed by the electronic device itself according to the method shown in fig. 6 (a) and 7 (b). In the embodiment of the present application, an electronic device two which establishes connection with an electronic device one is described as an example.

Step S802: the WMS of the first electronic device creates a precision selection box (as shown in fig. 7 (b)) or the WMS creates a trajectory graph from the user's drawn trajectory on the home screen of the folding screen. In the embodiment of the present application, taking the picture illustrated in fig. 5 (g) as an example, the WMS of the home screen creates the precise selection box 100 and is placed at the upper layer of the picture 54. The area covered by the precision selection frame 100 is a local area. Among them, WMS is a window management service on the software framework (Framewrok) side of electronic devices. The WMS creates a precise selection frame in various shapes such as square, circular, etc., and the position of the precise selection frame is changed by a different position of the user's touch on the screen detected by the touch sensor. In addition, the touch sensor can detect an amplifying instruction or a shrinking instruction triggered by the touch of the screen by a user to realize amplifying or shrinking the accurate selection frame and the like. The local area in the accurate selection frame is the content to be accurately displayed.

Step S803: the WMS of the first electronic device calls a getView () method of the precise selection frame to acquire a view display layer of a local area in the precise selection frame. The view display layer refers to the image content of the selected local area within the precision selection box (e.g., the view display layer of the local area of the tree selected by the precision selection box 100 in fig. 5 (g)).

Step S804: the WMS of the second electronic device creates a precise display area on the screen of the second electronic device.

Step S805: the first electronic device transmits the view display layer of the local area in the precise selection frame to the second electronic device through the Socket channel (i.e. the local area of the tree in the precise selection frame 100 is displayed in the second electronic device in a full screen mode).

Step S806: and the WMS of the second electronic device calls a getView () method and an onDraw () method of the accurate display area to stretch a view display layer of a local area in the accurate selection frame, and the view display layer is drawn and displayed on a screen of the second electronic device in a full screen mode.

Specifically, the WMS of the second electronic device invokes the getView () method of the precise display area to set the view display layer of the local area in the precise selection frame to be displayed on the second electronic device in full screen. If the view display layer of the local area in the accurate selection frame is set to be the flag_fullscreen, the view display layer is set to be displayed on the second electronic device in a full screen mode.

The WMS calls the onDraw () method to draw the view display layer of the local area and display it in full screen in the precise display area of the screen of the second electronic device. I.e. the local area of the tree within the precision selection box 100 is shown enlarged on the screen of the electronic device two according to the magnification factor C. The magnification is the ratio of the area of the precision display area to the area of the precision selection frame (or the closed figure of the track drawn by the user).

After the steps S800 to S806 are executed, full-screen enlarged display of the local area in the accurate display frame of the first electronic device on the second electronic device is realized, so that a user can conveniently and simultaneously view the original image displayed on the first electronic device and view the details of the local area on the second electronic device, and the user experience is improved.

After the execution of steps S800 to S806, steps S807 to S813 may be continued. The flow of the operation of the partial region of the precise display area will be described below taking the game screen illustrated in fig. 7 (b) as an example.

The user can operate the displayed local area on the screen of the second electronic device. And meanwhile, the operation of the local area can be mapped back to the original image on the first screen of the electronic equipment, so that the consistency of the image of the second local area of the electronic equipment and the original image is ensured. Therefore, the local area is displayed on the second full screen of the electronic equipment (the full screen on the second electronic equipment is the accurate display area), so that the user can conveniently operate the local area, and the user experience is further improved.

Step S807: the IMS of electronic device one obtains the point in the lower left corner of the precision selection box 100 in electronic device one as the starting point of the local area. As shown in fig. 8 (d), the picture 54 and the precision selection box 100 are shown on the electronic device one. The coordinates of the lower left corner of the precision selection box 100 taken on the electronic device one of fig. 8 (d) may be denoted as I (x 1, y 1). The IMS uses the lower left corner of the whole screen of the electronic equipment I as an origin (0, 0), and the IMS of the electronic equipment I determines the coordinates of the point of the lower left corner of the accurate selection frame in units of pixels.

Step S808: the IMS of the second electronic device obtains the coordinates (x 2, y 2) of the position J of the local area touched by the user in the second electronic device. Specifically, the second electronic device displays the partial area of the tree selected in the accurate selection frame 100 in a full screen mode, the touch sensor senses that the second electronic device is touched by the user, and a touch event of the second electronic device touched by the user is reported to the IMS of the second electronic device. The IMS of the second electronic device determines the coordinates of the touch position of the touch event of the second electronic device touched by the user in units of pixels.

Step S809: the IMS of the second electronic device determines the magnification of the local area on the second electronic device compared with the first electronic device. In the embodiment of the application, the amplification factor is denoted as C. And displaying the local area on the second electronic equipment in a full screen mode, wherein the whole screen of the second electronic equipment is used as an accurate display area. The area of the accurate display area is the area of the second electronic device. The area of the local area on the first electronic device is the area of the precision selection frame (or the closed figure of the track drawn by the user). The magnification is the ratio of the area of the precision display area to the area of the precision selection frame (or the closed figure of the track drawn by the user).

Step S810: the IMS of the electronic device two transmits the coordinates (x 2, y 2) of the position J at a certain position of the local area of the tree touched by the user to the IMS of the electronic device one. For example, the user draws a track (the track is highlighted with a colored line) in a localized area, which track may be automatically synchronized to the original image of the first electronic device. The second electronic device may transmit the coordinates (x 2, y 2) of the location J to the IMS of the first electronic device based on the telephone service. Of course, the electronic device one and the electronic device two may also use other communication modes to communicate, which is not limited in this embodiment of the present application.

Step S811: the IMS of the first electronic device converts the coordinates (X2, Y2) at the position J of the local area of the second electronic device upper tree into coordinates (X, Y) corresponding to the same position K of the first electronic device upper tree. The function of mapping the operation of the user on the accurate display area back to the original image of the first electronic device is realized.

Specifically, as shown in fig. 8 (e), the IMS of the electronic device one obtains coordinates (X, Y) at the K position on the electronic device one according to the following formula:

X＝x1+x2/C

Y＝y1+y2/C

step S812: the IMS of the electronic device one reports the coordinates (X, Y) to the WMS.

Step S813: and the WMS receives the converted coordinates (X, Y) to perform event response, and the touch event of the accurate display area is automatically mapped to the first electronic device. The operation of the user on the second electronic device on the local area of the accurate display area can be synchronized to the original image of the first electronic device.

It is noted that when the user performs operations such as zooming in, dragging, and zooming out on the precise selection frame displayed on the electronic device one. The selected localized area on the electronic device may also change. The second electronic device serves as an accurate display area to refresh the content of a local area displayed on the second electronic device in real time, specifically, the second WMS of the second electronic device calls a getView () method to obtain an accurate display layer of the accurate display area of the second electronic device, the first WMS of the first electronic device obtains a view display layer of an accurate selection frame, the second WMS of the second electronic device calls a getView () method and an onDraw () method of the accurate display area to stretch the view display layer of the local area in the accurate selection frame and draw the view display layer to be displayed on the second electronic device in a full screen mode, so that refreshing of the local area in the second electronic device is achieved. At this time, the IMS of the first electronic device and the IMS of the second electronic device redetermine the coordinates (x 1, y 1) of the start point of the local area, the coordinates (x 2, y 2) of the position of the local area touched by the user, the IMS of the second electronic device determines the magnification of the local area on the second electronic device compared with the first electronic device, and so on.

Further, the starting point of the local area may be selected as the rest of the position of the precision selection frame. The coordinates of the position are used as the coordinates of the start point of the local area. The starting point of the local area is not limited in the embodiment of the present invention.

The local area is displayed in the second electronic device, so that a user can operate the local area conveniently, and the user experience is improved.

In some embodiments of the present application, an electronic device is further provided, and an electronic device in the embodiment of the present application is described below with reference to fig. 9. Fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

For at least one embodiment, the controller hub 804 communicates with the processor 801 via a multi-drop bus, such as a Front Side Bus (FSB), a point-to-point interface, such as a Quick Path Interconnect (QPI), or similar connection. The processor 801 executes instructions that control the general type of data processing operations. In one embodiment, controller hub 804 includes, but is not limited to, a Graphics Memory Controller Hub (GMCH) (not shown) and an input/output hub (IOH) (which may be on separate chips) (not shown), where the GMCH includes memory and graphics controllers and is coupled to the IOH.

The electronic device 800 may also include a coprocessor 806 coupled to the controller hub 804 and memory 802. Alternatively, one or both of the memory 802 and the GMCH may be integrated within the processor 801 (as described in the present disclosure), with the memory 802 and the co-processor 806 being directly coupled to the processor 801 and the controller hub 804, the controller hub 804 being in a single chip with the IOH.

In one embodiment, memory 802 may be, for example, dynamic Random Access Memory (DRAM), phase Change Memory (PCM), or a combination of both. Memory 802 may include one or more tangible, non-transitory computer-readable media for storing data and/or instructions therein. The computer-readable storage medium has stored therein instructions, and in particular, temporary and permanent copies of the instructions.

In one embodiment, coprocessor 806 is a special-purpose processor, such as, for example, a high-throughput MIC processor, a network or communication processor, compression engine, graphics processor, GPU, embedded processor, or the like. Optional properties of coprocessor 806 are shown in dashed lines in fig. 9.

In one embodiment, electronic device 800 may further comprise a Network Interface (NIC) 803. The network interface 803 may include a transceiver to provide a radio interface for the device 800 to communicate with any other suitable device (e.g., front end module, antenna, etc.). In various embodiments, the network interface 803 may be integrated with other components of the electronic device 800. The network interface 803 can realize the functions of the communication unit in the above-described embodiment.

In one embodiment, as shown in FIG. 9, the electronic device 800 may further include an input/output (I/O) device 805. Input/output (I/O) devices 805 may include: a user interface, the design enabling a user to interact with the electronic device 800; the design of the peripheral component interface enables the peripheral component to also interact with the electronic device 800; and/or sensors designed to determine environmental conditions and/or location information associated with the electronic device 800.

It is noted that fig. 9 is merely exemplary. That is, although fig. 9 shows that the electronic apparatus 800 includes a plurality of devices such as the processor 801, the controller hub 804, the memory 802, etc., in practical applications, the apparatus using the methods of the present application may include only a part of the devices of the electronic apparatus 800, for example, may include only the processor 801 and the NIC803. The nature of the alternative device is shown in dashed lines in fig. 9.

In some embodiments of the present application, the computer readable storage medium of the electronic device 800 having instructions stored therein may include: instructions, when executed by at least one unit in a processor, cause the apparatus to implement the image display method mentioned in the above embodiments. The instructions, when executed on a computer, cause the computer to perform the image display method as mentioned in the above embodiments.

Referring now to fig. 10, fig. 10 is a schematic diagram illustrating a SOC (System on Chip) 1000 according to an embodiment of the present application. In fig. 10, similar components have the same reference numerals. In addition, the dashed box is an optional feature of a more advanced SoC. The SoC may be used in an electronic device according to an embodiment of the present application, and may implement corresponding functions according to instructions stored therein.

In fig. 10, the SoC 1000 includes: an interconnect unit 1002 coupled to the processor 1001; a system agent unit 1006; a bus controller unit 1005; an integrated memory controller unit 1003; a set or one or more coprocessors 1007 which may include integrated graphics logic, image processors, audio processors, and video processors; a Static Random Access Memory (SRAM) cell 1008; a Direct Memory Access (DMA) unit 1004. In one embodiment, coprocessor 1007 includes a special-purpose processor, such as, for example, a network or communication processor, compression engine, GPU, high-throughput MIC processor, embedded processor, or the like.

One or more computer-readable media for storing data and/or instructions may be included in a Static Random Access Memory (SRAM) unit 1008. The computer-readable storage medium may have stored therein instructions, and in particular, temporary and permanent copies of the instructions.

When SoC 1000 is applied to an electronic device in accordance with the present application, the computer-readable storage medium having instructions stored therein may include: instructions that when executed by at least one unit in the processor cause the electronic device to implement the image display method as mentioned in the above embodiments. The instructions, when executed on a computer, cause the computer to perform the image display method as mentioned in the above embodiments.

In addition, the embodiment of the application also discloses a computer readable storage medium, wherein a processing program is stored on the computer readable storage medium, and the processing program realizes the image display method mentioned in the above embodiment when being executed by a processor.

The computer readable storage medium may be a read-only memory, a random access memory, a hard disk, an optical disk, or the like.

Claims

1. An image display method, characterized by being applied to an electronic device, the electronic device including a folding screen electronic device, the image display method comprising:

displaying a first image in a first display area, wherein the first display area is a screen of a first display screen of the folding screen electronic device, the first image is displayed on the first display screen in a full screen mode, and the folding screen electronic device is in an undeployed state;

receiving a first operation, wherein the first operation is an operation for starting a precision mode;

in response to the first operation, the precision mode is turned on, and,

when the folding screen electronic equipment is in an undeployed state, prompt information is sent out to prompt a user to operate the folding screen electronic equipment to be in a deployed state, when the folding screen electronic equipment is in the deployed state, a first selection frame is displayed at a first position of the first image, meanwhile, a second image is displayed in a second display area, the second image is a first local area of the first image, the content of the second image corresponds to the content at the first position, the second display area is a screen of a second display screen of the folding screen electronic equipment, the second image is displayed on the second display screen in a full-screen amplifying mode, or a second operation of the user is received, in response to the second operation, a second selection frame is displayed at the second position of the first image, a third image is displayed in the second display area, the third image is a second local area of the first image, the content of the third image corresponds to the content at the second position, the second display area is a screen of the second display screen of the folding screen electronic equipment, the second display screen is a full-screen operation of the second display screen of the folding screen, and a closed graph is formed on the second display screen of the folding screen;

Receiving a fourth operation of a user, and displaying a fourth image in the second display area in response to the fourth operation, wherein the fourth image is a third local area of the first image, the content of the fourth image corresponds to the content of the third local area of the first image, the fourth operation is a specific operation of the display content included in the first image by the user preset by an application program corresponding to the first image, the third local area is an area corresponding to the fourth operation in the first image preset by the application program corresponding to the first image, the fourth image is displayed in a full-screen enlarged mode on the second display screen, and the specific operation is irrelevant to the first selection frame;

receiving a fifth operation of a user, wherein the fifth operation comprises an editing operation of the user on the image displayed in the second display area, and the editing operation comprises deletion or graffiti on the image displayed in the second display area;

and in response to the fifth operation, displaying an operation result corresponding to the fifth operation in the second display area, detecting a first coordinate at a third position where the editing operation is performed on the image displayed in the second display area, converting the first coordinate into a second coordinate at a fourth position corresponding to the third position in the first image, synchronizing the operation result at the first coordinate to the second coordinate, and displaying the operation result in the second display area at the second coordinate in the first display area, wherein the operation result includes adding display content or subtracting display content in the second display area, the pruned content is used as reduced display content, and the graffiti content is used as added display content.

2. The image display method according to claim 1, wherein if the first image is a game screen, the game screen includes a magnifier and a magnifier switching button, the fourth operation is a click operation of the magnifier switching button by a user, the third partial region is a magnifier region, and/or the game screen includes a telescope, the fourth operation is a use operation of the telescope by a user, the third partial region is a telescope region.

3. The image display method according to claim 1, wherein a third operation by a user is received, and the size of the first selection frame or the second selection frame is adjusted in response to the third operation.

4. A method of displaying images according to any one of claims 1 to 3, wherein the images included in the first display area are displayed at a first magnification, and the images in the second display area are displayed at a second magnification, the second magnification being greater than the first magnification.

5. The image display method according to any one of claims 1 to 3, wherein the electronic device includes a single-screen electronic device, the first display area is a full screen of a display screen of the single-screen electronic device, and the second display area is an area covering the first display area.

6. The image display method according to any one of claims 1 to 3, wherein the electronic device includes a first electronic device and a second electronic device, the first display area is a display screen of the first electronic device, and the second display area is a display screen of the second electronic device.

7. The image display method according to claim 6, wherein the first image is displayed full screen on a display screen of the first electronic device, and the second image or the third image or the fourth image is displayed full screen enlarged on a display screen of the second electronic device.

8. The image display method according to any one of claims 1 to 3, wherein displaying the first selection frame at the first position of the first image while displaying the second image in the second display area includes:

the electronic device creates the first selection frame and the second display area;

the electronic equipment acquires a view display layer of the second image covered by the first selection frame;

and the electronic equipment stretches the view display layer and displays the view display layer in a drawing mode in the second display area.

9. The image display method according to claim 1, wherein the first coordinate or the second coordinate is determined in units of pixels.

10. An electronic device, the electronic device comprising:

a memory for storing image display instructions;

a processor which, when executing the image display instructions, implements the image display method according to any one of claims 1 to 9.

11. A computer readable storage medium storing image display instructions which when executed by a processor implement the image display method of any one of claims 1-9.