CN114430492A

CN114430492A - Display device, mobile terminal and picture synchronous zooming method

Info

Publication number: CN114430492A
Application number: CN202011179994.XA
Authority: CN
Inventors: 肖成创; 张传强; 林乐; 于颜梅
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2020-10-29
Filing date: 2020-10-29
Publication date: 2022-05-03
Anticipated expiration: 2040-10-29
Also published as: CN114430492B

Abstract

The application provides a display device, a mobile terminal and a picture synchronous zooming method. And when the boundary of the original image exceeds the boundary of the display area, sending a zooming instruction to the display device. The zoom instruction comprises a display position and a zoom scale, and the display device can perform synchronous zooming on the target picture according to the display position and the zoom scale. According to the method, the synchronous zooming of the picture is realized through a mapping algorithm based on the display position and the zooming proportion, and the problem of display dislocation is relieved.

Description

Display device, mobile terminal and picture synchronous zooming method

Technical Field

The application relates to the technical field of smart televisions, in particular to a display device, a mobile terminal and a picture synchronous zooming method.

Background

The smart television is a television product which is based on an Internet application technology, has an open operating system and a chip, has an open application platform, can realize a bidirectional man-machine interaction function, integrates various functions such as audio and video, entertainment, data and the like, and is used for meeting diversified and personalized requirements of users. The smart television can be connected with mobile terminals such as a mobile phone and the like to display contents in the mobile terminals.

For example, the smart television may establish a picture projection connection in a DLNA (Digital Living Network Alliance) mode or the like with the mobile terminal. After the connection relation is established, the mobile terminal can send the displayed picture to the smart television for displaying. And through the established connection relation, operations such as amplification, movement and the like executed on the mobile terminal by a user can be synchronously mapped to the smart television, so that synchronous zooming of the picture is realized.

However, in the display mode that the mobile terminal is directly mirrored on the smart television according to the operation effect of the mobile terminal, the display area is dislocated due to the difference between the screen sizes of the mobile terminal and the smart television. For example, when a displayed picture is enlarged by one time on a mobile phone and the picture is shifted to the right by 200 pixels, if the smart television simply copies the operation of the mobile phone terminal, the enlarged area displayed on the smart television is different from the area operated on the mobile phone due to the inconsistent screen sizes of the mobile phone and the smart television, that is, the problem of display area dislocation occurs.

Disclosure of Invention

The application provides a display device, a mobile terminal and a picture synchronous zooming method, which aim to solve the problem that the display dislocation is easy to occur in the traditional picture synchronous zooming method.

The display equipment, the mobile terminal and the picture synchronous zooming method can be applied to synchronous zooming/moving between the mobile terminal and the display equipment when pictures are presented. Therefore, a screen projection relation needs to be established between a display device and a mobile terminal, and a target picture is displayed through the display, wherein the target picture is a picture with the same content as an original picture displayed in the display; and when the boundary of the original picture exceeds the boundary of the display area of the mobile terminal, synchronously zooming the target picture. According to different synchronous zooming modes, the display device, the mobile terminal and the picture synchronous zooming method provided by the application comprise the following aspects:

in a first aspect, the present application provides a display device comprising a display, a communicator, and a controller. Wherein the display is configured to display a target picture, and the communicator is configured to establish a communication connection with a mobile terminal; the controller is configured to perform the following program steps:

receiving a zooming instruction, wherein the zooming instruction is input by the mobile terminal when the boundary of the original image exceeds the boundary of the display area, and the zooming instruction comprises a display position and a zooming scale; the original picture is a picture displayed in the mobile terminal;

responding to the zooming instruction, and moving the position of a target picture according to the display position, wherein the target picture is a picture displayed in the display;

and zooming the target picture according to the zooming ratio by taking the display position as a reference.

In a second aspect, the present application further provides a mobile terminal including a display unit, a communication unit, and a processing unit. Wherein the display unit is configured to display an original picture; the communication unit is configured to establish a communication connection with a display device; the processing unit is configured to perform the following program steps:

receiving a zoom command input by a user;

in response to the zoom command, performing zooming on the displayed original picture;

if the boundary of the original picture exceeds the display area boundary of the display unit, calculating a display position and a scaling;

sending a zoom instruction to the display device, the zoom instruction including the display position and a zoom scale.

In a third aspect, the present application further provides a method for synchronously zooming a picture, including:

the mobile terminal receives a zooming command input by a user;

the mobile terminal executes zooming on the displayed original picture according to the zooming command;

if the boundary of the original picture exceeds the boundary of the display area, the mobile terminal sends a zooming instruction to display equipment, wherein the zooming instruction comprises a display position and a zooming scale;

the display equipment moves the position of the target picture according to the display position;

As can be seen from the foregoing technical solutions, in some embodiments of the present application, a display device, a mobile terminal and a method for synchronously zooming pictures are provided, where the method may receive a zoom instruction input by a user through the mobile terminal, and zoom an original picture according to the zoom instruction. And when the boundary of the original image exceeds the boundary of the display area, sending a zooming instruction to the display device. The zoom instruction comprises a display position and a zoom scale, and the display device can perform synchronous zooming on the target picture according to the display position and the zoom scale. According to the method, the synchronous zooming of the picture is realized through a mapping algorithm based on the display position and the zooming proportion, and the problem of display dislocation is relieved.

In a fourth aspect, the present application further provides a display device comprising a display, a communicator, and a controller. Wherein the display is configured to display a target picture, and the communicator is configured to establish a communication connection with a mobile terminal; the controller is configured to perform the following program steps:

receiving a zoom instruction sent by the mobile terminal;

responding to the zooming instruction, displaying a target picture in a preset display area of the display, wherein the preset display area covers all display areas in the mobile terminal;

and according to the scaling instruction, performing synchronous scaling on the target picture.

In a fifth aspect, the present application further provides a mobile terminal, which includes a display unit, a communication unit, and a processing unit. Wherein the display unit is configured to display an original picture; the communication unit is configured to establish a communication connection with a display device; the processing unit is configured to perform the following program steps:

receiving a zoom command input by a user;

calculating an adjustment displacement and an adjustment center point in response to the zoom command;

zooming the displayed original picture according to the adjustment displacement and the adjustment central point;

and sending a zooming instruction to the display equipment, wherein the zooming instruction comprises adjusting the displacement or adjusting the central point.

In a sixth aspect, the present application further provides a method for synchronously zooming a picture, including:

the mobile terminal receives a zooming command input by a user;

the mobile terminal calculates an adjustment displacement and an adjustment central point according to the zooming command;

the mobile terminal executes zooming on the displayed original picture and sends a zooming instruction to the display equipment according to the adjustment displacement and the adjustment central point, wherein the zooming instruction comprises the adjustment displacement or the adjustment central point;

the display equipment displays a target picture in a preset display area of the display according to the zooming instruction, wherein the preset display area covers all display areas in the mobile terminal;

and the display equipment executes synchronous zooming on the target picture according to the zooming instruction.

According to the technical solutions, in some embodiments of the present application, a display device, a mobile terminal and a method for synchronously zooming an image are provided, in which after receiving a zoom command, the mobile terminal may calculate an adjustment displacement and an adjustment center point according to the zoom command, so as to zoom an original image. Meanwhile, the mobile terminal also sends a zooming instruction to the display equipment so that the display equipment can zoom the target picture synchronously in a preset display area covering all display areas of the mobile terminal. According to the method, the preset display area covering the whole display area of the mobile terminal is built in the display equipment, so that the zoom command executed on the mobile terminal is synchronously converted to the display equipment, the synchronous zoom of the picture is realized, and the problem of display dislocation is solved.

In a seventh aspect, the present application further provides a display device, comprising a display, a communicator, and a controller. Wherein the display is configured to display a target picture, and the communicator is configured to establish a communication connection with a mobile terminal; the controller is configured to perform the following program steps:

receiving a zoom instruction sent by the mobile terminal; the zooming instruction comprises a reference point and an adjusting parameter, wherein the adjusting parameter is a moving distance and/or a zooming ratio which are obtained by the mobile terminal through calculation according to user input;

responding to the zooming instruction, and acquiring the current display state of the target picture;

and zooming the target picture on the basis of the current display state according to the reference point and the adjusting parameter.

In an eighth aspect, the present application further provides a mobile terminal, which includes a display unit, a communication unit, and a processing unit. Wherein the display unit is configured to display an original picture; the communication unit is configured to establish a communication connection with a display device; the processing unit is configured to perform the following program steps:

receiving a zoom command input by a user;

responding to the zooming command, calculating a reference point and an adjusting parameter, wherein the adjusting parameter is a moving distance and/or a zooming ratio which are obtained by the mobile terminal according to the calculation of user input;

zooming the displayed original picture according to the reference point and the adjusting parameter;

and sending a zooming instruction to the display device, wherein the zooming instruction reference point and the adjusting parameter.

In a ninth aspect, the present application further provides a method for synchronously zooming pictures, including:

the mobile terminal receives a zooming command input by a user;

the mobile terminal calculates a reference point and an adjusting parameter according to the zooming command, wherein the adjusting parameter is a moving distance and/or a zooming ratio which are/is calculated and obtained by the mobile terminal according to user input;

the mobile terminal executes zooming on the displayed original picture and sends a zooming instruction to display equipment according to the reference point and the adjusting parameter, wherein the zooming instruction comprises the reference point and the adjusting parameter;

the display equipment responds to the zooming instruction and acquires the current display state of the target picture;

and the display equipment performs zooming on the target picture on the basis of the current display state according to the reference point and the adjusting parameter.

According to the technical scheme, the embodiments of the present application provide a display device, a mobile terminal and a method for synchronously zooming pictures. In the method, the mobile terminal can calculate a movement distance and/or a zoom ratio according to a user input, and transmit the reference point, the movement distance and/or the zoom ratio to the display device, so that the display device can perform zooming on a displayed picture according to the reference point, the movement distance and/or the zoom ratio on the basis of a current display state according to a received zoom instruction. According to the method, the mobile terminal can directly send the zooming instruction to the display equipment, so that the display equipment can synchronously zoom the displayed picture on the basis of the current display state according to the zooming instruction, and the problem of display dislocation is relieved.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus in an embodiment of the present application;

fig. 2 is a block diagram of a hardware configuration of a display device in an embodiment of the present application;

fig. 3 is a block diagram of a hardware configuration of a control device in the embodiment of the present application;

FIG. 4 is a schematic diagram of a software configuration of a display device in an embodiment of the present application;

FIG. 5 is a schematic diagram of an icon control interface display of an application program of a display device in an embodiment of the present application;

fig. 6 is a schematic diagram of a mobile terminal in an embodiment of the present application;

fig. 7 is a schematic diagram illustrating an effect that a mobile terminal and a display device synchronously display pictures in the embodiment of the present application;

FIG. 8 is a schematic diagram illustrating a synchronous zooming effect of pictures according to an embodiment of the present application;

FIG. 9 is a schematic diagram illustrating a process of scaling a picture synchronously in an embodiment of the present application;

FIG. 10 is a schematic diagram illustrating position calculation in an embodiment of the present application;

fig. 11 is a schematic diagram illustrating an effect of adjusting a picture position to a boundary by a display device in an embodiment of the present application;

FIG. 12 is a schematic diagram illustrating an effect of centering a picture on a display device according to an embodiment of the present application;

FIG. 13 is a schematic diagram illustrating a synchronous zoom effect when a picture does not exceed a boundary of a display area according to an embodiment of the present disclosure;

FIG. 14 is a schematic diagram illustrating a synchronous zoom effect when a picture exceeds a boundary of a display area in an embodiment of the present application;

FIG. 15 is a schematic diagram of a default display area in an embodiment of the present application;

fig. 16 is a schematic diagram illustrating an effect of zooming a target picture in a preset display area according to an embodiment of the present application.

Detailed Description

Reference will now be made in detail to embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following examples do not represent all embodiments consistent with the present application. But merely as exemplifications of systems and methods consistent with certain aspects of the application, as recited in the claims.

To make the objects, embodiments and advantages of the present application clearer, the following description of exemplary embodiments of the present application will clearly and completely describe the exemplary embodiments of the present application with reference to the accompanying drawings in the exemplary embodiments of the present application, and it is to be understood that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments described herein without inventive step, are intended to be within the scope of the claims appended hereto. In addition, while the disclosure herein has been presented in terms of one or more exemplary examples, it should be appreciated that aspects of the disclosure may be implemented solely as a complete embodiment.

It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and are not necessarily intended to limit the order or sequence of any particular one, Unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein.

Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in this application refers to a component of an electronic device (such as the display device disclosed in this application) that is typically wirelessly controllable over a relatively short range of distances. Typically using infrared and/or Radio Frequency (RF) signals and/or bluetooth to connect with the electronic device, and may also include WiFi, wireless USB, bluetooth, motion sensor, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display apparatus 200 through the mobile terminal 100A and the control device.

In some embodiments, the control apparatus 100 may be a remote control 100B, and the communication between the remote control 100B and the display device includes an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, etc., and the display device 200 is controlled by wireless or other wired methods. The user may input a user instruction through keys on the remote controller 100B, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller 100B to implement a function of controlling the display device 200.

The control device 100 may communicate with the display device 200 by a direct wireless connection method or by an indirect connection method. That is, in some embodiments, the control apparatus 100 may communicate with the display device 200 through a direct connection manner such as bluetooth, infrared, or the like. When transmitting the control command, the control apparatus 100 may directly transmit the control command data to the display device 200 through bluetooth or infrared. In other embodiments, the control apparatus 100 may also access the same wireless network as the display device 200 through a wireless router to establish indirect connection communication with the display device 200 through the wireless network. When the control instruction is sent, the control apparatus 100 may send the control instruction data to the wireless router, and then forward the control instruction data to the display device 200 through the wireless router.

In some embodiments, mobile terminal 100A, tablet, computer, laptop, and other smart devices may also be used to control display device 200. For example, the display device 200 is controlled using an application program running on the smart device. The application, through configuration, may provide the user with various controls in an intuitive User Interface (UI) on a screen associated with the smart device.

In some embodiments, the mobile terminal 100A may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 100A and the display device 200 can establish a control instruction protocol, synchronize a remote control keyboard to the mobile terminal 100A, and control the display device 200 by controlling a user interface on the mobile terminal 100A. The audio/video content displayed on the mobile terminal 100A may also be transmitted to the display device 200, so as to implement the synchronous display function.

As also shown in fig. 1, the display apparatus 200 also performs data communication with the server 400 through various communication means. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. Illustratively, the display device 200 receives software program updates, or accesses a remotely stored digital media library, by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers. Other web service contents such as video on demand and advertisement services are provided through the server 400.

The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The particular display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.

The display apparatus 200 may additionally provide an intelligent network tv function of a computer support function including, but not limited to, a network tv, an intelligent tv, an Internet Protocol Tv (IPTV), and the like, in addition to the broadcast receiving tv function.

A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is exemplarily shown in fig. 2.

In some embodiments, at least one of the controller 250, the tuner demodulator 210, the communicator 220, the detector 230, the input/output interface 255, the display 275, the audio output interface 285, the memory 260, the power supply 290, the user interface 265, and the external device interface 240 is included in the display apparatus 200.

In some embodiments, the display 275 is configured to receive the image signals from the output of the first processor 330, and to display video content and images and components of the menu manipulation interface.

In some embodiments, the display 275, includes a display screen assembly for presenting a picture, and a driving assembly that drives the display of an image.

In some embodiments, the video content is displayed from broadcast television content, or alternatively, from various broadcast signals that may be received via wired or wireless communication protocols. Alternatively, various image contents received from the network communication protocol and sent from the network server side can be displayed.

In some embodiments, the display 275 is used to present a user-manipulated UI interface generated in the display apparatus 200 and used to control the display apparatus 200.

In some embodiments, a driver assembly for driving the display is also included, depending on the type of display 275.

In some embodiments, display 275 is a projection display and may also include a projection device and a projection screen.

In some embodiments, communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi chip, a bluetooth communication protocol chip, a wired ethernet communication protocol chip, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver.

In some embodiments, the display apparatus 200 may establish control signal and data signal transmission and reception with the external control device 100 or the content providing apparatus through the communicator 220.

In some embodiments, the user interface 265 may be configured to receive infrared control signals from a control device 100 (e.g., an infrared remote control, etc.).

In some embodiments, the detector 230 is a signal used by the display device 200 to collect an external environment or interact with the outside.

In some embodiments, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light, and parameters changes can be adaptively displayed by collecting the ambient light, and the like.

In some embodiments, the detector 230 may further include an image collector, such as a camera, etc., which may be configured to collect external environment scenes, collect attributes of the user or gestures interacted with the user, adaptively change display parameters, and recognize user gestures, so as to implement a function of interaction with the user.

In some embodiments, the detector 230 may also include a temperature sensor or the like, such as by sensing ambient temperature.

In some embodiments, the display apparatus 200 may adaptively adjust a display color temperature of an image. For example, the display apparatus 200 may be adjusted to display a cool tone when the temperature is in a high environment, or the display apparatus 200 may be adjusted to display a warm tone when the temperature is in a low environment.

In some embodiments, the detector 230 may also be a sound collector or the like, such as a microphone, which may be used to receive the user's voice. Illustratively, a voice signal including a control instruction of the user to control the display device 200, or to collect an ambient sound for recognizing an ambient scene type, so that the display device 200 can adaptively adapt to an ambient noise.

In some embodiments, as shown in fig. 2, the input/output interface 255 is configured to allow data transfer between the controller 250 and external other devices or other controllers 250. Such as receiving video signal data and audio signal data of an external device, or command instruction data, etc.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: the interface can be any one or more of a high-definition multimedia interface (HDMI), an analog or data high-definition component input interface, a composite video input interface, a USB input interface, an RGB port and the like. The plurality of interfaces may form a composite input/output interface.

In some embodiments, as shown in fig. 2, the tuning demodulator 210 is configured to receive a broadcast television signal through a wired or wireless receiving manner, perform modulation and demodulation processing such as amplification, mixing, resonance, and the like, and demodulate an audio and video signal from a plurality of wireless or wired broadcast television signals, where the audio and video signal may include a television audio and video signal carried in a television channel frequency selected by a user and an EPG data signal.

In some embodiments, the frequency points demodulated by the tuner demodulator 210 are controlled by the controller 250, and the controller 250 can send out control signals according to user selection, so that the modem responds to the television signal frequency selected by the user and modulates and demodulates the television signal carried by the frequency.

In some embodiments, the broadcast television signal may be classified into a terrestrial broadcast signal, a cable broadcast signal, a satellite broadcast signal, an internet broadcast signal, or the like according to the broadcasting system of the television signal. Or may be classified into a digital modulation signal, an analog modulation signal, and the like according to a modulation type. Or the signals are classified into digital signals, analog signals and the like according to the types of the signals.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. Therefore, the set top box outputs the television audio and video signals modulated and demodulated by the received broadcast television signals to the main body equipment, and the main body equipment receives the audio and video signals through the first input/output interface.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

As shown in fig. 2, the controller 250 includes at least one of a Random Access Memory 251 (RAM), a Read-Only Memory 252 (ROM), a video processor 270, an audio processor 280, other processors 253 (e.g., a Graphics Processing Unit (GPU), a Central Processing Unit 254 (CPU), a Communication Interface (Communication Interface), and a Communication Bus 256(Bus), which connects the respective components.

In some embodiments, RAM 251 is used to store temporary data for the operating system or other programs that are running, and in some embodiments, ROM 252 is used to store instructions for various system boots.

In some embodiments, the ROM 252 is used to store a Basic Input Output System (BIOS). The system is used for completing power-on self-test of the system, initialization of each functional module in the system, a driver of basic input/output of the system and booting an operating system.

In some embodiments, when the power-on signal is received, the display device 200 starts to power up, the CPU executes the system boot instruction in the ROM 252, and copies the temporary data of the operating system stored in the memory to the RAM 251 so as to start or run the operating system. After the start of the operating system is completed, the CPU copies the temporary data of the various application programs in the memory to the RAM 251, and then, the various application programs are started or run.

In some embodiments, processor 254 is used to execute operating system and application program instructions stored in memory. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some demonstrative embodiments, processor 254 may include a plurality of processors. The plurality of processors may include a main processor and one or more sub-processors. A main processor for performing some operations of the display apparatus 200 in a pre-power-up mode and/or operations of displaying a screen in a normal mode. One or more sub-processors for one operation in a standby mode or the like.

In some embodiments, the graphics processor 253 is used to generate various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And the system comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor 270 is configured to receive an external video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on the direct display device 200.

In some embodiments, video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert an input video frame rate, such as a 60Hz frame rate into a 120Hz frame rate or a 240Hz frame rate, and the normal format is implemented in, for example, an interpolation frame mode.

The display format module is used for converting the received video output signal after the frame rate conversion, and changing the signal to conform to the signal of the display format, such as outputting an RGB data signal.

In some embodiments, the graphics processor 253 and the video processor may be integrated or separately configured, and when the graphics processor and the video processor are integrated, the graphics processor and the video processor may perform processing of graphics signals output to a display, and when the graphics processor and the video processor are separately configured, the graphics processor and the video processor may perform different functions, for example, a GPU + FRC (Frame Rate Conversion) architecture.

In some embodiments, the audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, and amplification processes to obtain an audio signal that can be played in a speaker.

In some embodiments, video processor 270 may comprise one or more chips. The audio processor may also comprise one or more chips.

In some embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated together with the controller in one or more chips.

In some embodiments, the audio output, under the control of controller 250, receives sound signals output by audio processor 280, such as: the speaker 286, and an external sound output terminal of a generating device that can output to an external device, in addition to the speaker carried by the display device 200 itself, such as: external sound interface or earphone interface, etc., and may also include a near field communication module in the communication interface, for example: and the Bluetooth module is used for outputting sound of the Bluetooth loudspeaker.

The power supply 290 supplies power to the display device 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may include a built-in power supply circuit installed inside the display apparatus 200, or may be a power supply interface installed outside the display apparatus 200 to provide an external power supply in the display apparatus 200.

A user interface 265 for receiving an input signal of a user and then transmitting the received user input signal to the controller 250. The user input signal may be a remote controller signal received through an infrared receiver, and various user control signals may be received through the network communication module.

In some embodiments, the user inputs a user command through the control apparatus 100 or the mobile terminal 100A, the user input interface responds to the user input through the controller 250 according to the user input, and the display device 200 responds to the user input through the controller 250.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on the display 275, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

The memory 260 includes a memory storing various software modules for driving the display device 200. Such as: various software modules stored in the first memory, including: at least one of a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

The base module is a bottom layer software module for signal communication between various hardware in the display device 200 and for sending processing and control signals to the upper layer module. The detection module is used for collecting various information from various sensors or user input interfaces, and the management module is used for performing digital-to-analog conversion and analysis management.

For example, the voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is used for controlling the display to display the image content, and can be used for playing the multimedia image content, UI interface and other information. And the communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing a module for data communication between browsing servers. And the service module is used for providing various services and modules including various application programs. Meanwhile, the memory 260 may store a visual effect map for receiving external data and user data, images of various items in various user interfaces, and a focus object, etc.

Fig. 3 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 3, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface, a memory, and a power supply.

The control apparatus 100 is configured to control the display device 200 and may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications that control the display device 200 according to user demands.

In some embodiments, as shown in fig. 1, the mobile terminal 100A or other intelligent electronic device may function similar to the control apparatus 100 after installing an application for manipulating the display device 200. Such as: the user may implement the functions of controlling the physical keys of the apparatus 100 by installing applications, various function keys or virtual buttons of a graphical user interface available on the mobile terminal 100A or other intelligent electronic devices.

The controller 110 includes a processor 112 and RAM 113 and ROM 114, a communication interface 130, and a communication bus. The controller is used for controlling the operation of the control device 100, as well as the communication cooperation among the internal components and the external and internal data processing functions.

The communication interface 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the received user input signal is transmitted to the display apparatus 200. The communication interface 130 may include at least one of a WiFi chip 131, a bluetooth module 132, an NFC module 133, and other near field communication modules.

A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touch pad 142, a sensor 143, keys 144, and other input interfaces. Such as: the user can realize a user instruction input function through actions such as voice, touch, gesture, pressing, and the like, and the input interface converts the received analog signal into a digital signal and converts the digital signal into a corresponding instruction signal, and sends the instruction signal to the display device 200.

The output interface includes an interface that transmits the received user instruction to the display apparatus 200. In some embodiments, the interface may be an infrared interface or a radio frequency interface. Such as: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input-output interface 140. The control device 100 is configured with a communication interface 130, such as: the WiFi, bluetooth, NFC, etc. modules may transmit the user input command to the display device 200 through the WiFi protocol, or the bluetooth protocol, or the NFC protocol code.

And a memory 190 for storing various operation programs, data and applications for driving and controlling the control device 200 under the control of the controller. The memory 190 may store various control signal commands input by a user.

And a power supply 180 for providing operation power support for each element of the control device 100 under the control of the controller. A battery and associated control circuitry.

In some embodiments, the system may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel is started, kernel space is activated, hardware is abstracted, hardware parameters are initialized, and virtual memory, a scheduler, signals and interprocess communication (IPC) are operated and maintained. And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.

Referring to fig. 4, in some embodiments, the system is divided into four layers, which are an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer from top to bottom.

In some embodiments, at least one application program runs in the application program layer, and the application programs can be Window (Window) programs carried by an operating system, system setting programs, clock programs, camera applications and the like; or may be an application developed by a third party developer such as a hi program, a karaoke program, a magic mirror program, or the like. In specific implementation, the application packages in the application layer are not limited to the above examples, and may actually include other application packages, which is not limited in this embodiment of the present application.

The framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resource in the system and obtain the service of the system in execution through the API interface

As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; the file Package Manager (Package Manager) is used for detecting various information related to the application packages currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.

In some embodiments, the activity manager is to: managing the life cycle of each application program and the general navigation backspacing function, such as controlling the exit of the application program (including switching the user interface currently displayed in the display window to the system desktop), opening, backing (including switching the user interface currently displayed in the display window to the previous user interface of the user interface currently displayed), and the like.

In some embodiments, the window manager is configured to manage all window processes, such as obtaining a display size, determining whether a status bar is available, locking a screen, intercepting a screen, controlling a display change (e.g., zooming out, dithering, distorting, etc.) and the like.

In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the core layer includes at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (such as fingerprint sensor, temperature sensor, touch sensor, pressure sensor, etc.), and so on.

In some embodiments, the kernel layer further comprises a power driver module for power management.

In some embodiments, software programs and/or modules corresponding to the software architecture of fig. 4 are stored in the first memory or the second memory shown in fig. 2 or 3.

In some embodiments, taking the magic mirror application (photographing application) as an example, when the remote control receiving device receives an input operation from the remote control 100B, a corresponding hardware interrupt is issued to the kernel layer. The kernel layer processes the input operation into an original input event (including information such as a value of the input operation, a timestamp of the input operation, etc.). The raw input events are stored at the kernel layer. The application program framework layer obtains an original input event from the kernel layer, identifies a control corresponding to the input event according to the current position of the focus and uses the input operation as a confirmation operation, the control corresponding to the confirmation operation is a control of a magic mirror application icon, the magic mirror application calls an interface of the application framework layer to start the magic mirror application, and then the kernel layer is called to start a camera driver, so that a static image or a video is captured through the camera.

In some embodiments, for a display device with a touch function, taking a split screen operation as an example, the display device receives an input operation (such as a split screen operation) that a user acts on a display screen, and the kernel layer may generate a corresponding input event according to the input operation and report the event to the application framework layer. The window mode (such as multi-window mode) corresponding to the input operation, the position and size of the window and the like are set by an activity manager of the application framework layer. And the window management of the application program framework layer draws a window according to the setting of the activity manager, then sends the drawn window data to the display driver of the kernel layer, and the display driver displays the corresponding application interface in different display areas of the display screen.

In some embodiments, as shown in fig. 5, the application layer containing at least one application may display a corresponding icon control in the display, such as: the system comprises a live television application icon control, a video on demand application icon control, a media center application icon control, an application center icon control, a game application icon control and the like.

In some embodiments, the live television application may provide live television via different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.

In some embodiments, a video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.

In some embodiments, the media center application may provide various applications for multimedia content playback. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.

In some embodiments, an application center may provide storage for various applications. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on the smart television. The application center may obtain these applications from different sources, store them in local storage, and then be operable on the display device 200.

In the embodiment of the present application, the mobile terminal 100A refers to a terminal device capable of establishing a communication connection with the display device 200. The mobile terminal 100A may function as the control device 100 of the display apparatus 200. The mobile terminal 100A includes, but is not limited to, a mobile phone, a computer, a tablet computer, a smart wearable device, and the like. For convenience of description, a mobile phone is taken as an example in part of the embodiments of the present application and the drawings of the specification. It should be understood that the handset in the examples may be replaced with other types of mobile terminals 100A to implement the corresponding technical content.

As shown in fig. 6, the mobile terminal 100A may be built with functional devices such as a display unit 310, a communication unit 320, and a processing unit 330, so as to implement basic functions of the mobile terminal 100A. The mobile terminal can also be internally provided with components such as a memory, a camera, a sensor, an audio circuit, a power supply and the like, and is used for being matched with other components to enable the mobile terminal to operate. That is, the display unit 310 may be used to receive input numeric or character information and generate signal input related to user settings and function control of the mobile terminal 100A, and particularly, the display unit 310 may include a touch screen disposed on the front surface of the mobile terminal 100A and may collect touch operations of a user thereon or nearby, such as clicking a button, dragging a scroll box, and the like.

The display unit 310 may also be used to display a Graphical User Interface (GUI) of information input by or provided to the user and various menus of the terminal. Specifically, the display unit 310 may include a display screen disposed on the front surface of the mobile terminal 100A. The display screen may be configured in the form of a liquid crystal display unit 310, a light emitting diode, or the like. The display unit 310 may be used to display various graphical user interfaces described herein.

The touch screen may be covered on the display screen, or the touch screen and the display screen may be integrated to implement the input and output functions of the mobile terminal 100A, and the integrated touch screen may be referred to as a touch display screen for short. The display unit 310 in the present application can display the application programs and the corresponding operation steps.

The display unit 310 may display different image screens according to a display program in the operating system of the mobile terminal 100A. For example, the user may call a display program to display any picture, and the specific content of the picture may be presented in the display unit 310. During the display process, the display program can set a specific area for presenting the picture content and set other areas for presenting the UI of the interface.

The communication unit 320 of the mobile terminal 100A is used to establish a communication connection with the display device 200. The communication unit 320 may establish a communication connection in different communication manners, and therefore, the communication unit 320 may include a Radio Frequency (RF) circuit, a Wireless Fidelity (Wi-Fi) module, a bluetooth module, an infrared module, and the like.

The RF circuit may be used for receiving and transmitting signals during information transmission and reception or during a call, and may receive downlink data of the base station and then send the downlink data to the processing unit 330 for processing; the uplink data may be transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.

Wi-Fi belongs to short-distance wireless transmission technology, a communication terminal can help a user to receive and send e-mails, browse webpages, access streaming media and the like through a Wi-Fi module, and wireless broadband internet access is provided for the user.

And the Bluetooth module is used for performing information interaction with other Bluetooth equipment with the Bluetooth module through a Bluetooth protocol. For example, the communication terminal may establish a bluetooth connection with the display device 200, which is also provided with a bluetooth module, through the bluetooth module, thereby performing data interaction.

The processing unit 330 is a control center of the communication terminal, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the communication terminal and processes data by running or executing software programs stored in the memory and calling data stored in the memory. In some embodiments, processing unit 330 may include one or more processing units; the processing unit 330 may also integrate the application processing unit 330 and the baseband processing unit 330, wherein the application processing unit 330 mainly processes an operating system, a user interface, an application program, and the like, and the baseband processor mainly processes wireless communication.

It will be appreciated that the baseband processor described above may not be integrated into the processing unit 330. In the present application, the processing unit 330 may run an operating system, an application program, a user interface display, and a touch response, and the image synchronous zooming method according to the embodiment of the present application. In addition, the processing unit 330 is coupled with the input unit and the display unit 310.

In this embodiment of the application, the synchronous zooming of the picture refers to that the same picture is displayed on the mobile terminal 100A and the display device 200 respectively, and when a user performs a zooming operation on the mobile terminal 100A, the picture displayed on the mobile terminal 100A is enlarged or reduced according to the zooming operation, and meanwhile, the picture displayed on the display device 200 is also enlarged or reduced according to the zooming operation.

In order to implement synchronous zooming of pictures, before displaying pictures, a communication connection needs to be established between the mobile terminal 100A and the display device 200, for example, the mobile terminal 100A and the display device 200 are connected to the same wireless network through a WiFi connection, as shown in fig. 7. After establishing the wireless connection, the user may perform an interactive operation on the mobile terminal 100A, and control the mobile terminal 100A to display a picture in synchronization with the display device 200. For example, by performing an interactive operation, the mobile terminal 100A may simultaneously transmit a control instruction for synchronously displaying pictures and picture data to the display device 200.

Accordingly, the controller 250 of the display device 200 may first acquire a control instruction input by the mobile terminal 100A and then receive picture data in response to the control instruction, thereby controlling the display 275 to display the picture data. Similarly, according to the UI layout of the display device 200, the display 275 may display the picture data in a preset display area, and the preset display area may have an association relationship with the display boundary in the mobile terminal 100A.

The association relationship means that the picture status displayed on the display device 200 is adapted to the picture status displayed on the mobile terminal 100A. For example, when the mobile terminal 100A is horizontally placed, the preset display area of the display device 200 appears as a rectangular area having a width greater than a height; when the mobile terminal 100A is vertically placed, the preset display area of the display device 200 is presented as a rectangular area having a width smaller than a height.

Obviously, in order to present a better display effect on the display device 200, the preset display area on the display device 200 may be set according to the screen characteristics of the display device 200 and automatically adapt to different forms of pictures. For example, the whole screen area may be used as a preset display area, and when a picture with a different scale is displayed, the picture is zoomed.

The display apparatus 200 may obtain picture data according to different ways. For example, the mobile terminal 100A may directly transmit the picture file to the display device 200, and the display device 200 may display the received picture file. When the user inputs a zoom operation command in the mobile terminal 100A, the mobile terminal 100A adjusts and converts the zoom operation command, and then sends the adjusted and converted zoom operation command to the display device 200. After receiving the zoom instruction, the display device 200 may execute the zoom instruction to zoom the displayed picture.

However, for some display devices 200 and mobile terminals 100A with different screen shapes, the display forms of the same picture on the mobile terminal 100A and the display device 200 are different, which results in that the above synchronous zooming mode cannot accurately execute the zooming instruction after the control instruction input by the user is transmitted to the display device 200. I.e., the zoomed region, on the mobile terminal 100A, does not coincide with the region presented by the display device 200, causing a misalignment problem.

For example, when the user displays a horizontal picture having a width greater than a height in a vertical state of the mobile terminal 100A, the mobile terminal 100A displays the picture in a reduced size with the picture width equal to the width of the display unit 310 of the mobile terminal 100A in order to display the picture completely. Wherein, the reduced picture is close to the middle area. Since the width of the display device 200 is larger than the height, it is adapted to the picture shape, and thus the display may not be reduced.

When the user performs an operation of enlarging the upper left corner region in the mobile terminal 100A, since the reduced and displayed picture is close to the middle region, the user can input an enlargement action instruction in a region to the left and above the middle. At this time, the zoom command sent to the display device 200 is also in the area with the middle part to the left and above, that is, the display device 200 enlarges the area with the middle part to the left and above, but not the area at the upper left corner, and display misalignment is formed.

In order to solve the problem of display misalignment, the application realizes synchronous zooming/moving between the mobile terminal and the display device when the picture is presented through a picture synchronous zooming method. The method comprises the steps that a screen projection relation is established between display equipment and a mobile terminal, and a target picture is displayed through a display, wherein the target picture is the picture with the same content as an original picture displayed in the display; and when the boundary of the original picture exceeds the boundary of the display area of the mobile terminal, synchronously zooming the target picture. According to different synchronous zooming modes, the display device, the mobile terminal and the picture synchronous zooming method provided by the application comprise the following aspects:

some embodiments of the present application provide a method for synchronously zooming pictures, which may be applied to the display device 200 and the mobile terminal 100A. As shown in fig. 8 and 9, the method includes the following steps:

the mobile terminal 100A receives a zoom command input by a user.

In this embodiment, after controlling the mobile terminal 100A and the display device 200 to establish a communication connection relationship, the user may control to display the pictures on the mobile terminal 100A and the display device 200 simultaneously through picture screen projection or a related application program. For convenience of description, in the embodiment of the present application, a picture displayed on the mobile terminal 100A is referred to as an original picture, and a picture displayed on the display device 200 is referred to as a target picture.

After the picture screen-casting program is completed, the user may perform a zooming action on the mobile terminal 100A, so as to control the original picture to be displayed in an enlarged or reduced manner, that is, the mobile terminal 100A may receive a zooming command input by the user. The user may input the zoom command in different manners according to the form of the mobile terminal 100A. For example, when the mobile terminal 100A is a mobile phone device having a touch screen, the user may input a zoom command by inputting a touch operation in which two fingers are separated from each other in a picture display area on the mobile phone touch screen.

A control UI may also be displayed on the mobile terminal 100A, and the user performs related operations through a control in the UI interface, thereby implementing zooming on the displayed original picture. For example, a scroll bar may be provided on the right side of the picture display area, and when the user slides the scroll bar upward, the displayed picture is enlarged; and when the user slides the scroll bar downward, the displayed picture is reduced, thereby completing the input of the zoom command.

After receiving a zoom command input by a user, the mobile terminal 100A performs zooming on the displayed original image according to the zoom command.

In general, in order to zoom the original image, a zoom command input by a user may include control parameters such as a zoom position and a zoom ratio. Wherein the zoom position may be determined according to a position where the user inputs the zoom command. For example, when the user inputs a zoom-in command by separating the two fingers from each other, the zoom position may be the midpoint of the two-finger line. The zoom position may also be determined according to the display state of the picture. For example, when the user performs zooming using the scroll bar, zooming may be performed in accordance with the center position of the current display area, i.e., the display center position is the zoom position. Obviously, in order to zoom in and out at different positions of a picture, when a picture with a larger size is displayed, the position of the picture is moved so that the region to be enlarged is positioned at the center of the display region, and then the scroll bar is dragged to perform an enlarging or reducing operation.

The scaling may also be determined based on a user-entered zoom command. For example, the zoom ratio may have a relationship with a distance by which the user inputs the motion of separating the two fingers from each other, that is, the original image is gradually enlarged as the distance between the two fingers increases, and the larger the distance the two fingers move, the higher the magnification. The zoom scale may also be determined by the distance the user drags the scroll bar. That is, the corresponding relationship between the scaling ratio and the sliding distance may be calibrated on the scroll bar, and when the user moves the scroll bar to any position, the image is scaled to the corresponding multiple.

Accordingly, the mobile terminal 100A may parse the zoom command upon receiving the zoom command to determine the zoom position and the zoom scale specified in the zoom command. And then, according to the zooming position and the zooming scale, zooming operation is carried out on the original image so as to enlarge or reduce the original image.

It should be noted that, in order to present a better zooming effect, in practical applications, the zooming position of each sampling process and the zooming ratio between two adjacent sampling processes can be respectively determined through multiple times of sampling, and the zooming operation is executed, so that the displayed picture can be gradually zoomed in or zoomed out according to the input process of the zooming command, and the effect of gradually zooming in or zoomed out along with the input operation action of the user is realized.

The screen size of the mobile terminal 100A is generally small, and the original picture is generally reduced when displayed on the mobile terminal 100A, and after being projected onto the display device 200, the large screen size of the display 275 may be displayed in accordance with the original picture size. Therefore, when the original picture is displayed on the mobile terminal 100A, a certain interval exists between the picture boundary and the partial boundary of the display region due to the reduced display of the picture. And as the zooming-in process is carried out, the picture boundary is gradually close to the display area boundary. When the picture boundary reaches the display area boundary, it indicates that the current mobile terminal 100A can achieve the maximum complete display state of the original picture in this direction, and is also the original picture size in general.

According to the zooming mode of the picture, the display area boundary directions of the picture which are gradually close to the picture along with the zooming process are different. For example, when the mobile terminal 100A is vertically placed, that is, the width of the display screen is smaller than the height, and a wide-screen picture is displayed, the mobile terminal 100A will zoom according to the width of the picture, so that the picture is zoomed out to a width equal to the width of the display area. At this time, there is a gap between the upper and lower boundaries of the display area and the top and bottom edges of the picture. Similarly, when the mobile terminal 100A is horizontally placed and displays a vertical screen picture, the mobile terminal 100A will be reduced in a manner that the height of the picture is equal to the height of the display area, and at this time, there is a gap between the left and right boundaries of the display area and the left and right sides of the picture.

For convenience of description, in the embodiments of the present application, the display area boundary that can be gradually approached is referred to as a zoom boundary. When the mobile terminal 100A executes the zoom-in command, the picture boundary will gradually approach the zoom boundary due to the zoom-in effect on the picture. When the boundaries of the two are overlapped, if the zoom-in command is continuously input, the mobile terminal 100A continuously zooms in the picture beyond the original size of the picture, so that the picture cannot be completely displayed. Accordingly, the display device 200 also needs to synchronously enlarge the displayed pictures.

That is, in this embodiment, with the input of the zoom instruction by the user, if the original picture boundary exceeds the display area boundary, the mobile terminal 100A sends the zoom instruction to the display device.

When the original image boundary exceeds the zoom boundary, the mobile terminal 100A may send a zoom instruction to the display device 200, so that the display device 200 may perform zooming on the displayed target image according to the zoom instruction, where the zoom instruction includes a display position and a zoom scale. In this embodiment of the application, the display position may be represented by a pixel point on the original image corresponding to the pixel value position of the enlarged picture on the central point of the display area of the mobile terminal 100A. The scaling may then be based on the picture magnification/reduction factor that reaches the display boundary.

By the aid of the method for sending the zooming instruction, when the zooming boundary of the picture displayed by the mobile terminal 100A is reached, the zooming instruction is not sent, the original picture is zoomed only in the mobile terminal 100A, and the target picture does not need to be zoomed on the premise that the display size of the original picture is met; after the picture on the mobile terminal 100A fills the display area in the direction of the zoom boundary, the zoom command is sent to the display device 200 to implement synchronous zoom after the picture is continuously zoomed in.

The display device 200 may move the position of the target picture according to the display position after receiving the zoom instruction.

Since the zoom position designated when the user inputs the zoom command may not completely correspond due to a difference in screen size between the mobile terminal 100A and the display device 200. Therefore, after receiving the zoom instruction, the display device 200 may move the picture according to the display position, so that the zoom position coincides with the center position of the display 275, and thus, in the subsequent zooming process, the zoomed picture region can be displayed in the center region, thereby achieving a better display effect.

That is, after moving the target picture position, the display apparatus 200 performs scaling on the target picture at the scaling ratio with reference to the display position.

As can be seen from the foregoing technical solutions, the image synchronous zooming method provided in the above embodiments may receive, by the mobile terminal 100A, a zooming instruction input by a user, and perform zooming on an original image according to the zooming instruction. When the original picture boundary exceeds the display area boundary, a zoom instruction is transmitted to the display apparatus 200. Wherein the zoom instruction includes a display position and a zoom scale, the display apparatus 200 may perform synchronous zooming on the target picture according to the display position and the zoom scale. According to the method, the synchronous zooming of the picture is realized through a mapping algorithm based on the display position and the zooming proportion, and the problem of display dislocation is relieved.

Based on the above method for synchronously zooming pictures, in some embodiments of the present application, a mobile terminal 100A is further provided, which includes a display unit 310, a communication unit 320, and a processing unit 330. Wherein the display unit 310 is configured to display an original picture; the communication unit 320 is configured to establish a communication connection with a display device; the processing unit 330 is configured to perform the following program steps:

receiving a zoom command input by a user;

if the boundary of the original picture exceeds the display area boundary of the display unit 310, calculating a display position and a scaling;

Similarly, to implement picture-synchronized zooming in conjunction with the mobile terminal 100A, a display device 200 is also provided in some embodiments and includes a display 275, a communicator 220, and a controller 250. Wherein the display 275 is configured to display a target picture, and the communicator 220 is configured to establish a communication connection with the mobile terminal 100A; the controller 250 is configured to perform the following program steps:

receiving a zooming instruction, wherein the zooming instruction is input by the mobile terminal 100A when the boundary of the original image exceeds the boundary of the display area, and the zooming instruction comprises a display position and a zooming scale; the original picture is a picture displayed in the mobile terminal 100A;

According to the mobile terminal 100A and the display device 200 described above, the picture synchronization zooming method in the above embodiments can be implemented by the processing unit 330 and the controller 250 respectively executing configured program steps in some embodiments of the present application. After the communication connection is established, the user may manipulate the mobile terminal 100A, zoom the original image displayed by the mobile terminal 100A, and transmit a zoom instruction to the display apparatus 200 through the communication unit 320 after the original image exceeds the zoom area. The controller 250 of the display device 200 may move and zoom the target picture after receiving the zoom instruction through the communicator 220, thereby implementing a synchronous process with the zoom process in the mobile terminal 100A.

In some embodiments, the scaling process may be comprehensively determined according to the screen size of the mobile terminal 100A and the screen size of the display device to determine the scaling boundary, because the original image is displayed on the mobile terminal 100A and the target image is displayed on the display device 200 in a scaling manner according to different screen sizes, and in practical applications, the original image is scaled to the same extent as the scaling degree of the display device 200 by the mobile terminal 100A and then the scaling is performed to enable the display device 200 to need to display the image locally.

That is, after establishing the picture-on-screen relationship, the mobile terminal 100A may first detect the screen state of itself and the screen state of the display device 200, and determine the zoom boundary of the display area according to the detection result. Thus, the processing unit 330 of the mobile terminal 100A may be further configured to perform the following program steps:

and acquiring the aspect ratio of the display area.

Wherein the display area aspect ratio includes a display area aspect ratio of the display unit 310 and a display area aspect ratio of the display device. In practical applications, in order to obtain the display area aspect ratio of the display unit 310, the processing unit 330 may detect the screen status of the mobile terminal 100A in real time to determine the display area aspect ratio.

Due to the limitation of the interface UI, not all display areas on the screen are used for displaying pictures, so in this embodiment, a display area refers to an area in the interface for displaying pictures. The aspect ratio of the display area refers to the aspect ratio of the area for displaying the picture, that is:

wh_mobile＝W_mobile/H_mobile；

where wh _ mobile is the display area aspect ratio of the mobile terminal 100A; w _ mobile is the width of the picture display area in the mobile terminal 100A; h _ mobile is the height of the picture display area in the mobile terminal 100A.

Obviously, the mobile terminal 100A generally has picture display areas of different shapes for different placement states. The processing unit 330 may determine the display area shape by detecting the placement state of the mobile terminal 100A, and further calculate the display area aspect ratio. For example, it may be determined whether the mobile terminal 100A is currently in the landscape state or the portrait state by detecting a gravity sensor built in the mobile terminal 100A. When the mobile terminal 100A is in the landscape state, the width of the display area is greater than the height, i.e., the aspect ratio of the display area is greater than 1; when the mobile terminal 100A is in the portrait state, the height of the display area is greater than the width, i.e., the display area aspect ratio is less than 1.

It should be noted that, in the calculation process of the aspect ratio of the display area, the processing unit 330 may calculate the actual physical size in the width direction and the height direction of the display area, or may calculate the number of pixels occupied by the width direction and the height direction of the display area, and the actual calculation results are the same.

The aspect ratio of the display area of the display device 200 needs to be acquired from the display device 200 after the mobile terminal 100A establishes a communication connection relationship with the display device 200. For example, when it is necessary to determine the display area aspect ratio, the processing unit 330 may transmit the acquisition instruction to the display apparatus 200 through the communication unit 320. The controller 250 of the display device 200, upon receiving the acquisition instruction, may respond to the acquisition instruction and extract the width and height of the display area on the current display 275, thereby feeding back the width and height data of the display area to the mobile terminal 100A. The processing unit 330 of the mobile terminal 100A then calculates the aspect ratio of the display area of the display device 200 according to the feedback result.

The calculation method of the display area aspect ratio wh _ tv of the display device 200 is the same as that of the mobile terminal 100A, and is not described again.

Similarly, for different types of display devices 200, they have different shaped display areas. Also, with the display device 200 of the partially rotatable display 275, display areas having different shapes are also provided in different rotation states, and thus it is necessary to determine the display area aspect ratio according to the different rotation states in practical applications. For example, when the display apparatus 200 is in the landscape state, the display area aspect ratio wh _ tv is greater than 1; when the display apparatus 200 is in the portrait state, the display area aspect ratio wh _ tv is less than 1.

After obtaining the display area aspect ratio, the process may compare the display area aspect ratio of the display unit 310 with the display area aspect ratio of the display device to determine a zoom boundary.

If the aspect ratio of the display area of the display unit 310 is greater than the aspect ratio of the display area of the display device 200, the left and right sides of the display unit 310 are determined as the zoom boundary. That is, if wh _ tv < wh _ mobile, the zoom boundary of the mobile terminal 100A is the left and right boundaries of the display area in the display unit 310, that is, when the left and right of the picture on the mobile terminal 100A are full of the display area, it is considered that the original image is of the size, and the zoom-in is started to transmit the zoom-in instruction to the display device 200 if the zoom-in is continued; if the left and right boundaries are not reached, the zoom-in command is not transmitted (or the zoom command is transmitted, but the information in the zoom command instructs the display device 200 to maintain the original image state).

If the aspect ratio of the display area of the display unit 310 is smaller than that of the display device, the upper and lower sides of the display unit 310 are determined as the zoom boundaries. That is, if wh _ tv > wh _ mobile, the zoom boundary of the mobile terminal 100A is the upper and lower boundaries of the display area, that is, when the upper and lower parts of the picture on the mobile terminal 100A are full of the display area, it is considered that the original image is of the original size, and the zoom-in is started to be transmitted to the display device 200 when the zoom-in is continued; when the starting boundary is not reached, no zoom-in command is sent.

As can be seen, in the present embodiment, by comparing the display area aspect ratio of the display unit 310 and the display area aspect ratio of the display apparatus 200, it is possible to determine a zoom boundary and to control the transmission of a zoom instruction to the display apparatus 200 according to the zoom boundary. By the aspect ratio of the display area, the display device can adapt to various types of screens of the mobile terminal 100A and the display device 200, and the problem of overlarge display effect difference caused by screen size difference is solved.

After determining the zoom boundary, the processing unit 330 of the mobile terminal 100A automatically sends a zoom instruction to the display device 200 when determining that the display picture exceeds the zoom boundary. Because the sent zooming instruction includes the display position and the zooming scale, but because of the screen size difference between the mobile terminal 100A and the display device 200, the corresponding zooming position when the zooming command is input in the mobile terminal 100A cannot be directly sent to the display device 200, and needs to be converted to a specific area on the picture and then sent to the display device 200, so that the display device 200 can zoom according to the display position, and the problem of display misalignment is alleviated.

For this reason, the processing unit 330 of the mobile terminal 100A also needs to calculate the display position and the zoom scale before sending the zoom instruction. In some embodiments, the display position may be calculated as follows:

Ox＝(W/2-(X0-X1))/W×Px；

Oy＝(H/2-(Y0-Y1))/W×Py；

wherein, (Ox, Oy) is a coordinate of the display position; w is the width of the zoomed picture; h is the height of the zoomed picture; (X0, Y0) display area center point coordinates; (X1, Y1) is the zoomed picture center point coordinates; px is a pixel value in the width direction of the picture; py is the picture height direction pixel value.

In some embodiments, the scaling may be calculated as follows:

Scale＝H1/H0；

or Scale ═ W1/W0;

in the formula, Scale is a scaling; h0 is display area height; h1 is the post-zoom picture height; w0 is the display area width; w1 is the scaled picture width.

For example, as shown in fig. 10, if the display resolution of the original picture is 1920 × 1080, the zoom position is 40% from left to right and 40% from top to bottom of the enlarged picture, corresponding to a pixel point (1920 × 40%), (1080 × 40%), i.e. (768, 432), of the center point of the display area of the mobile phone in the figure (X0, Y0). The information sent to the display device is that the picture display position is (768, 432), enlarged by 2 times.

If the display position to be transmitted to the display device is set to (Ox, Oy) and the scaling ratio is Scale, the case where wh _ tv > wh _ mobile is taken as an example, and the scaling boundary of the mobile terminal 100A is the upper and lower boundaries at this time. Under any reference coordinate system of the screen (x in the horizontal direction and y in the vertical direction), the coordinates of the a/B/C/D/E/F points are directly accessible to the mobile terminal 100A, and the picture width and height pixels Px, Py are also known, then the scaling is:

Scale＝(Cy-Ay)/(Fy-Dy)；

wherein Cy, Ay, Fy, and Dy represent y-axis coordinate values of C, A, F, D, i.e., a display area height H0 is Cy-Ay; the post-zoom picture height H1 is Fy-Dy.

Also, the coordinates of the display region center point G (X0, Y0) and the coordinates of the post-zoom picture center point H (X1, Y1) are calculated, respectively, that is:

X0＝Gx＝(Dx+Ex)/2；Y0＝Gy＝(Dy+Ey)/2；

X1＝Hx＝(Ax+Bx)/2；Y1＝Hy＝(Ay+By)/2；

therefore, the enlarged picture size: h ═ AC ═ Cy-Ay; and W is AB, Bx-Ax.

Then, Hx-Gx and Hy-Gy in the following formula are the moving distances of the center point of the magnified picture compared with the center point of the original picture in the x-axis and y-axis directions, therefore:

Ox＝(AB/2-(Hx-Gx))/AB×Px；

Oy＝(AC/2-(Hy-Gy))/AC×Py。

in summary, after calculating the display position and the zoom ratio, the mobile terminal 100A may transmit the calculated (Ox, Oy) and the Scale to the display device 200 through the data transmission channel, so that the display device 200 can move and zoom the displayed picture according to the transmitted display position and zoom ratio.

In some embodiments, in order to adapt to the screen form of the display 275 of the display device 200, the display device 200 needs to move the displayed picture to make the picture in a proper position, and then perform zooming so that the area zoomed by the user is in a proper range of the display 275, so the step of moving the position of the target picture according to the display position further includes the following steps:

moving the target picture to a default position;

traversing pixel points corresponding to the display positions in the target picture;

and moving the target picture to set the pixel point to be coincided with the central point of the display.

After receiving the zoom instruction, the display device 200 may extract the display position and the zoom ratio in the zoom instruction through the controller 250 in response to the zoom instruction, and execute a related display control program, first reset the picture to a default display position, then move the position of the (Ox, Oy) pixel point of the picture to the center of the screen, and then zoom the picture by Scale times at the center of the screen.

The default position may be an initial display position determined according to the last moving or zooming process, or may be a designated position on the UI interface in the display device 200. By moving the picture to the default position, the area corresponding to the zooming position in the picture can be conveniently identified, thereby being beneficial to realizing synchronous zooming.

In order to obtain a better display effect, in some cases, as shown in fig. 11 and 12, the step of performing scaling on the target picture according to the scaling ratio with reference to the display position further includes:

detecting a boundary of a target picture after zooming is executed;

judging whether the boundary of the target picture exceeds the boundary of a display area of the display;

if the target picture boundary exceeds the display area boundary of the display, moving the position of the zoomed target picture so as to enable the target picture boundary to be overlapped with the display area boundary;

and if the boundary of the target picture does not exceed the boundary of the display area of the display, moving the position of the target picture to enable the target picture to be displayed in the middle.

As shown in fig. 13 and 14, after performing the scaling of the picture, the display device 200 may detect the boundary of the target picture to determine whether the boundary of the target picture exceeds the boundary of the display area. If the display area of the display device 200 can exceed the display area on one or both borders at this time, the borders are adjusted to be right at the display border positions to display larger picture contents. And if both sides of the enlarged picture do not reach the boundary, automatically moving the picture to the middle position for displaying.

As can be seen from the above embodiments, the mobile terminal 100A and the display device 200 can synchronize map scaling in the case where wh _ tv > wh _ mobile. In the whole synchronous scaling process, the incidence relation between the pictures displayed in the mobile terminal 100A and the display device 200 is determined according to the display position, and the scaling position specified by the user on the mobile terminal 100A is mapped into the display device 200, so that after scaling is performed according to the corresponding scaling ratio, the scaling of the pictures displayed in the display device 200 is completed. Not only is synchronous zooming realized, but also screen form difference between the mobile terminal 100A and the display device 200 can be adapted, and the problem of display dislocation is relieved.

It should be noted that the mobile terminal 100A may perform sampling during the whole zooming process of the user operation, and perform multiple calculations and send zooming instructions during the whole zooming process, so as to achieve smooth operation effect. The method adopted in the above embodiment is also applicable to the display process of the vertical picture when wh _ tv > wh _ mobile. If wh _ tv is less than wh _ mobile, that is, when the display device 200 is in the vertical screen mode or the mobile terminal 100A is in the horizontal state, the synchronous zooming method should be based on the left and right boundaries of the display area when the mobile terminal 100A selects the zoom-in boundary, and the rest of the calculation principles are the same and will not be described again.

The mobile terminal 100A and the display device 200 may also perform synchronous display by using a picture screen projection method. That is, in some embodiments, the mobile terminal 100A may directly transmit the displayed content to the display device 200 through the established communication connection, and the display device 200 directly displays the screen-shot content. At this time, when the user inputs a zoom action instruction, since the content displayed on the mobile terminal 100A is changed according to the zoom action instruction, the screen projection screen transmitted to the display device 200 is also changed, achieving the effect of synchronous zooming.

In order to implement synchronous zooming between the mobile terminal 100A and the display device 200, some embodiments of the present application further provide a synchronous zooming method, including the following steps:

a zoom instruction transmitted by the mobile terminal 100A is received.

As in the above-described embodiment, before the picture synchronization zoom method is executed, the mobile terminal 100A first establishes a communication connection relationship with the display apparatus 200, and sends a zoom instruction to the display apparatus 200 after establishing the communication connection. The display device 200 may receive a zoom instruction through the communicator.

And responding to the zooming instruction, and displaying the target picture in a preset display area of the display.

After receiving the zoom instruction, the display device 200 may construct a preset display area on the display 275 according to the zoom instruction, where the preset display area covers the entire display area in the mobile terminal 100A. For example, after the user executes the zoom-in command on the mobile terminal 100A, the display device 200 may construct a preset display area sufficient to cover the mobile terminal 100A, so that a picture is displayed in the preset display area.

The preset display area may be in conformity with the display area in the mobile terminal 100A in the form of a boundary, and when the displayed contents are the same, the positions of the displayed contents in the display areas within the respective areas are also in conformity, so that the zoom command executed on the mobile terminal 100A may be directly transferred to the display device 200.

That is, the display device 200 may perform synchronous scaling on the target picture according to the scaling instruction.

In this embodiment, by constructing the preset display area covering all the display areas in the mobile terminal 100A in the display device 200, the display position relationship of the picture in the mobile terminal 100A can be retained, so that the zoom position and the zoom scale can be directly applied to the zoom instruction, the display device 200 can directly execute the zoom action according to the zoom position and the zoom scale, and the problem of display misalignment is avoided.

Based on the above method for synchronously zooming pictures, some embodiments of the present application further provide a display device 200, which includes a display 275, a communicator 220 and a controller 250. Wherein the display 275 is configured to display a target picture, and the communicator 220 is configured to establish a communication connection with the mobile terminal 100A; the controller 250 is configured to perform the following program steps:

receiving a zoom instruction transmitted by the mobile terminal 100A;

in response to the zoom instruction, displaying a target picture in a preset display area of the display, where the preset display area covers all display areas in the mobile terminal 100A;

Since there is a large difference in the overall sizes of the screens of the mobile terminal 100A and the display device, the zoom command input by the user on the mobile terminal 100A causes data deviation when directly applied to the display device 200. For example, a user inputs a touch action with two separated fingers on a mobile phone to input a zoom command. Due to the limitation of the length of the finger and the mobile phone screen, the distance between the finger and the mobile phone screen is generally 1-10cm, and since the actual size of the picture displayed by the display device 200 is large, the corresponding scaling ratios of the distance between the finger and the display device 200 are different, so that the synchronicity of the picture scaling process is easily damaged.

For this reason, in some embodiments of the present application, the mobile terminal 100A may further perform the following steps before sending the zoom instruction to the display device 200:

a zoom command input by a user is received.

In this embodiment, the mobile terminal 100A may receive the zoom command input by the user in the manner in the above-described embodiment. Similarly, the zoom command may include a zoom position and a zoom scale, and different ways are supported to complete the input of the zoom command.

In response to the zoom command, an adjustment displacement and an adjustment center point are calculated.

Upon receiving a zoom command input by a user, the mobile terminal 100A may calculate an adjustment displacement and an adjustment center point according to the zoom command. The adjustment distance is used to indicate the zoom ratio, and may be a distance in a control action determined according to a zoom command input by a user, for example, a separation distance of two fingers. The center of gravity point is the point used to mark the zoom position, e.g., the midpoint of the line connecting the two finger touch points.

It should be noted that, in practical applications, in order to implement synchronous control on the picture viewing process, when displaying a picture, a user may input a moving command in addition to a zooming command, for example, by displaying local content in the picture in a sliding touch manner. For such a movement command, the mobile terminal 100A may transmit the movement location point and the movement distance to the display device 200 to cause the display device 200 to move the picture in synchronization.

And zooming the displayed original picture according to the adjustment displacement and the adjustment central point.

After calculating the adjustment displacement and the adjustment center point, the mobile terminal 100A may determine a zoom position according to the adjustment center point, and determine a zoom scale according to the adjustment displacement, and perform zooming on the displayed original image. Meanwhile, the mobile terminal 100A further sends a zoom instruction to the display device 200 according to the adjustment displacement or the adjustment center point, where the zoom instruction includes the adjustment displacement or the adjustment center point.

Based on the above method, there is also provided in some embodiments a mobile terminal 100A including a display unit 310, a communication unit 320, and a processing unit 330. Wherein the display unit 310 is configured to display an original picture; the communication unit 320 is configured to establish a communication connection with a display device; the processing unit 330 is configured to perform the following program steps:

receiving a zoom command input by a user;

Due to the screen size difference between the mobile terminal 100A and the display device 200, after the zoom instruction is sent to the display device 200, the display device 200 may also adjust the zoom parameter according to the adjustment displacement or the adjustment center point in the zoom instruction, thereby performing zooming on the picture.

That is, in some embodiments, according to the scaling instruction, the step of performing synchronous scaling on the target picture further includes:

analyzing the zooming instruction to obtain an adjusting displacement;

according to the proportional relation between the display area in the mobile terminal 100A and the preset display area, the adjusted displacement is converted into a scaling size in an equal proportion mode;

and zooming the picture in the preset display area according to the zooming size.

In this embodiment, after receiving the zoom instruction, the controller 250 may analyze the zoom instruction to obtain an adjustment displacement, and then convert the adjustment displacement into a zoom size according to a proportional relationship between the mobile terminal 100A and the display area in the display device 200, so as to perform zooming on the picture in the preset display area according to the zoom size.

For example, when the screen size (in pixels) of the display 275 of the display device 200 is 5 times the screen size (in pixels) of the display unit 310 of the mobile terminal 100A, the zoom size parsed in the zoom instruction is L0, and the zoom size is scaled to 5 × L0, that is, the zoom size can be obtained.

In some embodiments, the step of performing synchronous scaling on the target picture further comprises:

analyzing the zooming instruction to obtain an adjusting central point;

positioning a central point of a target picture;

moving the target picture to enable the center point of the target picture to coincide with the adjustment center point;

and zooming the picture in the preset display area by taking the central point of the target picture as a reference.

In order to determine the position of the picture to be zoomed on the display device 200, the controller 250, after acquiring the zoom instruction, may parse the zoom instruction to obtain an adjustment center point, and at the same time, locate the center point of the displayed target image, and move the target picture so that the center point of the target picture coincides with the adjustment center point, even if the zoomed position is in the middle region of the display 275, and then perform zooming on the picture in the preset display region with the center point of the target picture as a reference.

As can be seen, in the above embodiment, the display device 200 may determine the scaling and the scaling displacement of the image displayed by the display device 200 according to the adjustment displacement and the adjustment center point, respectively, so as to convert the scaling command received by the mobile terminal 100A into the scaling instruction adapted to the display device 200 to adapt to the screen size difference between the mobile terminal 100A and the display device 200.

As can be seen from the foregoing technical solutions, the image synchronous zooming method provided in the foregoing embodiments may calculate the adjustment displacement and the adjustment center point according to the zooming command after the mobile terminal 100A receives the zooming command, so as to zoom the original image. Meanwhile, the mobile terminal 100A further sends a zoom instruction to the display device, so that the display device synchronously zooms the target picture in a preset display area covering all display areas of the mobile terminal 100A. According to the method, the preset display area covering all the display areas of the mobile terminal 100A is built in the display equipment, so that the zoom command executed on the mobile terminal 100A is synchronously converted to the display equipment, the pictures are synchronously zoomed, and the problem of display dislocation is solved.

the mobile terminal 100A receives a zoom command input by a user;

the mobile terminal 100A calculates a reference point and an adjustment parameter according to the zoom command, where the adjustment parameter is a moving distance and/or a zoom ratio calculated by the mobile terminal 100A according to user input;

the mobile terminal 100A performs zooming on the displayed original image and sends a zooming instruction to the display device 200 according to the reference point and the adjustment parameter, wherein the zooming instruction includes the reference point and the adjustment parameter;

the display device 200 responds to the zooming instruction to acquire the current display state of the target picture;

the display device 200 performs scaling on the target picture on the basis of the current display state in accordance with the reference point and the adjustment parameter.

The difference from the above-described embodiment is that, in the present embodiment, the mobile terminal 100A directly transmits the reference point and the adjustment parameter to the display device 200, and the display device 200 may then perform zooming on the currently displayed picture according to the reference point and the adjustment parameter. That is, the operation on the mobile terminal 100A is repeatedly engraved on the display device 200, and the mobile terminal 100A may transmit a zoom instruction representing an adjustment parameter amount on the basis of the current display of the mobile terminal 100A, that is, a parameter amount for moving a picture based on the current display state, and/or a picture zoom amount based on a reference point to the display device 200.

Based on this, if the initial picture display effect of the mobile terminal 100A and the display device 200 is corresponding, the operation result for the previous state is also corresponding at each step, and according to the recursive generalization, the result for each subsequent operation is also corresponding. That is, in this embodiment, the sufficient information for the mobile terminal 100A and the display device 200 to perform synchronous zooming is: if the operation performed on the picture in the mobile terminal 100A is movement, the display device 200 is notified of which direction it has moved by how much distance; if the operation performed on the picture in the mobile terminal 100A is zooming, the display device 200 is notified of how many times it is zoomed based on which point.

Based on the above-mentioned picture synchronization zooming method, in some embodiments of the present application, a display device 200 includes a display 275, a communicator 220, and a controller 250. Wherein the display 275 is configured to display a target picture, and the communicator 220 is configured to establish a communication connection with the mobile terminal 100A; the controller 250 is configured to perform the following program steps:

receiving a zoom instruction transmitted by the mobile terminal 100A; the zoom instruction comprises a reference point and an adjusting parameter, wherein the adjusting parameter is a moving distance and/or a zoom ratio calculated and obtained by the mobile terminal 100A according to user input;

Based on the above method, there is also provided in some embodiments a mobile terminal 100A including a display unit 310, a communication unit 320, and a processing unit 330. Wherein the display unit 310 is configured to display an original picture; the communication unit 320 is configured to establish a communication connection with the display apparatus 200; the processing unit 330 is configured to perform the following program steps:

receiving a zoom command input by a user;

in response to the zoom command, calculating a reference point and an adjustment parameter, where the adjustment parameter is a moving distance and/or a zoom ratio calculated by the mobile terminal 100A according to a user input;

As can be seen from the above technical solutions, some embodiments of the present application provide a display device 200, a mobile terminal 100A and a method for synchronously zooming pictures. In the method, the mobile terminal 100A may calculate a movement distance and/or a zoom ratio according to a user input, and transmit a reference point, a movement distance, and/or a zoom ratio to the display apparatus 200, so that the display apparatus 200 may perform zooming on a displayed picture according to the reference point, the movement distance, and/or the zoom ratio on the basis of a current display state according to a received zoom instruction. According to the method, the mobile terminal 100A can directly send the zooming instruction to the display device 200, so that the display device 200 can zoom the displayed picture synchronously on the basis of the current display state according to the zooming instruction, and the problem of display dislocation is relieved.

The embodiments provided in the present application are only a few examples of the general concept of the present application, and do not limit the scope of the present application. Any other embodiments extended according to the scheme of the present application without inventive efforts will be within the scope of protection of the present application for a person skilled in the art.

Claims

1. A display device, comprising:

a display;

a communicator configured to establish a communication connection with a mobile terminal;

a controller configured to:

establishing a screen projection relation with the mobile terminal;

displaying a target picture through the display, wherein the target picture is a picture with the same content as the original picture displayed in the display;

and when the boundary of the original picture exceeds the boundary of the display area of the mobile terminal, synchronously zooming the target picture.

2. The display device according to claim 1, wherein in the step of synchronously zooming the target picture, the controller is further configured to:

receiving a zooming instruction, wherein the zooming instruction is input by the mobile terminal when the boundary of the original image exceeds the boundary of the display area, and the zooming instruction comprises a display position and a zooming scale;

responding to the zooming instruction, and moving the position of the target picture according to the display position;

3. The display device according to claim 2, wherein in the step of moving the position of the target picture in accordance with the display position, the controller is further configured to:

moving the target picture to a default position;

4. The display device according to claim 2, wherein in the step of performing scaling on the target picture at the scaling ratio with the display position as a reference, the controller is further configured to:

detecting a boundary of a target picture after zooming is executed;

and if the target picture boundary exceeds the display area boundary of the display, moving the position of the zoomed target picture so as to enable the target picture boundary to be overlapped with the display area boundary.

5. The display device according to claim 4, wherein in the step of performing scaling on the target picture at the scaling ratio with the display position as a reference, the controller is further configured to:

6. The display device according to claim 1, wherein in the step of synchronously zooming the target picture, the controller is further configured to:

receiving a zoom instruction sent by the mobile terminal;

7. The display device according to claim 6, wherein in the step of performing synchronous scaling on the target picture according to the scaling instruction, the controller is further configured to:

analyzing the zooming instruction to obtain an adjusting displacement;

according to the proportional relation between a display area in the mobile terminal and the preset display area, the adjusted displacement is converted into a scaling size in an equal proportion mode;

8. The display device according to claim 6, wherein in the step of performing synchronous scaling on the target picture according to the scaling instruction, the controller is further configured to:

analyzing the zooming instruction to obtain an adjusting central point;

positioning a central point of a target picture;

9. The display device according to claim 1, wherein in the step of synchronously zooming the target picture, the controller is further configured to:

receiving a zooming instruction sent by the mobile terminal, wherein the zooming instruction comprises a reference point and an adjusting parameter, and the adjusting parameter is a moving distance and/or a zooming ratio calculated and obtained by the mobile terminal according to user input;

10. A mobile terminal, comprising:

a display unit;

a communication unit configured to establish a communication connection with a display device;

a processing unit configured to:

receiving a zoom command input by a user;

11. The mobile terminal of claim 10, wherein in the step of calculating the display position and the zoom ratio, the processing unit is further configured to:

acquiring a display area aspect ratio, wherein the display area aspect ratio comprises a display area aspect ratio of the display unit and a display area aspect ratio of the display device;

comparing the display area aspect ratio of the display unit with the display area aspect ratio of the display device to determine a zoom boundary;

if the display area aspect ratio of the display unit is larger than that of the display equipment, determining the left side and the right side of the display unit as the zooming boundaries;

and if the width-height ratio of the display area of the display unit is smaller than that of the display area of the display equipment, determining the upper side and the lower side of the display unit as the zooming boundaries.

12. A method for synchronously zooming pictures, comprising:

the mobile terminal receives a zooming command input by a user;