WO2021088790A1 - Display style adjustment method and apparatus for target device - Google Patents

Display style adjustment method and apparatus for target device Download PDF

Info

Publication number
WO2021088790A1
WO2021088790A1 PCT/CN2020/126110 CN2020126110W WO2021088790A1 WO 2021088790 A1 WO2021088790 A1 WO 2021088790A1 CN 2020126110 W CN2020126110 W CN 2020126110W WO 2021088790 A1 WO2021088790 A1 WO 2021088790A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
target device
display style
intention information
intention
Prior art date
Application number
PCT/CN2020/126110
Other languages
French (fr)
Chinese (zh)
Inventor
刘正阳
Original Assignee
北京字节跳动网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京字节跳动网络技术有限公司 filed Critical 北京字节跳动网络技术有限公司
Publication of WO2021088790A1 publication Critical patent/WO2021088790A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods

Definitions

  • the embodiments of the present disclosure relate to the field of computer technology, and in particular to a method, apparatus, electronic device, and computer-readable medium for adjusting a display style of a target device.
  • the content of the present invention is used to introduce concepts in a brief form, and these concepts will be described in detail in the following specific embodiments.
  • the content of the present invention is not intended to identify the key features or essential features of the technical solution required to be protected, nor is it intended to be used to limit the scope of the technical solution required to be protected.
  • Some embodiments of the present disclosure propose a display style adjustment method, apparatus, electronic device, and computer-readable medium for a target device.
  • some embodiments of the present disclosure provide a display style adjustment method for a target device.
  • the method includes: determining whether a user's face of the target device is displayed in the target image; For the user’s face, determine the user’s intention information based on at least one of the distance between the target device and the user and the target image.
  • the intention information is used to characterize the user’s intention to adjust the display style of the target device; adjust the target device based on the intention information Display style.
  • some embodiments of the present disclosure provide a display style adjustment apparatus for a target device, including: a first determining unit configured to determine whether the target device's user's face is displayed in the target image; and second The determining unit is configured to, in response to determining that the user’s face is displayed in the target image, determine the user’s intention information based on at least one of the distance between the target device and the user and the target image, where the intention information is used to characterize the user’s The adjustment intention of the display style of the device; the adjustment unit is configured to adjust the display style of the target device based on the intention information.
  • some embodiments of the present disclosure provide an electronic device, including: one or more processors; a storage device, on which one or more programs are stored. When one or more programs are stored by one or more The processor executes, so that one or more processors implement the method described in any implementation manner of the first aspect.
  • some embodiments of the present disclosure provide a computer-readable medium on which a computer program is stored, wherein the program is executed by a processor to implement the method described in any implementation manner in the first aspect.
  • One of the above-mentioned various embodiments of the present disclosure has the following beneficial effects: by determining the user's intention information, and adjusting the display style of the target device based on the intention information, a more personalized and targeted style display is realized, so that the display The matching degree between the style and the user is higher.
  • determining the user's intention information based on the distance from the user and/or the target image, it can adapt to different scene requirements.
  • Figures 1 and 2 are schematic diagrams of an application scenario of a method for adjusting a display style of a target device according to some embodiments of the present disclosure.
  • FIG. 3 is a flowchart of a display style adjustment method for a target device according to some embodiments of the method of the present disclosure.
  • Fig. 4 is a schematic diagram of another application scenario of a method for adjusting a display style of a target device according to some embodiments of the present disclosure.
  • FIG. 5 is a flowchart of other embodiments of a method for adjusting a display style of a target device according to the present disclosure.
  • Fig. 6 is a schematic structural diagram of some embodiments of a display style adjustment apparatus for a target device according to the present disclosure.
  • FIG. 7 is a schematic structural diagram of an electronic device suitable for implementing some embodiments of the present disclosure.
  • Figures 1 and 2 are schematic diagrams of an application scenario of a method for adjusting a display style of a target device according to some embodiments of the present disclosure.
  • the display style adjustment method for the target device in some embodiments of the present disclosure is generally executed by the terminal device.
  • the terminal device can be hardware or software.
  • the terminal device may be various electronic devices with a display screen and supporting display, including but not limited to smart phones, tablet computers, vehicle-mounted terminals, and so on.
  • the terminal device is software, it can be installed in the electronic devices listed above. It can be implemented, for example, as multiple software or software modules for providing distributed services, or as a single software or software module. There is no specific limitation here.
  • users can use terminal devices to interact with the server through the network to receive or send messages.
  • the execution subject of the method for adjusting the display style of the target device may be the news application 102 installed on the smart phone 101.
  • User A can browse news through the news application 102.
  • the news application 102 can capture the facial image of the user A through the camera 103 on the smartphone 101.
  • the news application 102 can use various face detection algorithms to determine whether the face of user A is displayed therein.
  • the intention information 203 of the user A is determined.
  • the user's intention information 203 is obtained by inputting the facial image 201 into the pre-trained user intention recognition model 202.
  • the font size of the smartphone 101 can be enlarged based on the intention information 203, and the result is shown on the right side of FIG. 1.
  • FIG. 3 there is shown a process 300 of some embodiments of a method for adjusting a display style of a target device according to the present disclosure.
  • the method for adjusting the display style of the target device includes the following steps:
  • Step 301 Determine whether the face of the user of the target device is displayed in the target image.
  • the execution subject of the method for adjusting the display style of the target device may be the above-mentioned target device, or may be an application installed on the target device.
  • the above-mentioned execution subject may first determine whether the face of the user of the target device is displayed in the target image.
  • the target image can be any image.
  • the target image can be determined by designation or by filtering through certain conditions.
  • the image currently captured by the camera of the target device can be used as the target image.
  • an image that meets the conditions for example, the latest shot and the shooting time is no more than three seconds from the current time
  • an image library for example, "album"
  • the target device can be any electronic device with a display screen.
  • the electronic device currently used by the user can be used as the target device.
  • the method of detecting key points of the face can be used to determine whether the face of the user of the target device is displayed in the image.
  • the user of the target device does not constitute any restriction on the user.
  • Step 302 In response to determining that the user's face is displayed in the target image, determine the user's intention information based on at least one of the distance between the target device and the user and the target image.
  • the above-mentioned execution subject may determine the user's intention information based on at least one of the distance between the target device and the user and the target image.
  • the intention information is used to characterize the user's intention to adjust the display style of the target device.
  • the intent information includes but is not limited to: adjusting font, font size, color, display position, etc. related information. For example, it can be "enlarge font size", “lighten color”, and so on.
  • the above-mentioned execution subject may determine the user's intention information based on the target image.
  • the target image may be input to a pre-trained user intention recognition model to obtain user intention information.
  • the user intention recognition model may be a trained artificial neural network.
  • a large number of training samples can be used to train multi-layer convolutional neural networks and LSTM (Long Short-Term Memory) multiple iterations to obtain a user intention recognition model.
  • the training samples include sample images and corresponding sample intention information.
  • the sample intention information corresponding to the sample image can be obtained through manual labeling and other methods.
  • the sample image in the training sample can be used as the input of the multi-layer convolutional neural network
  • the sample intention information corresponding to the input sample image can be used as the expected output of the multi-layer convolutional neural network
  • the user intention recognition model can be trained.
  • the difference between the actual output and the sample intention information can be calculated based on various loss functions, and the parameters of the multilayer convolutional neural network can be adjusted by means of stochastic gradient descent, until the preset conditions are met, and the training ends.
  • the trained multi-layer convolutional neural network can be used as the user intention recognition model.
  • the target image is input into a pre-trained user feature extraction model to obtain feature information corresponding to the face displayed in the target image.
  • the feature information is used to describe various features of the face displayed in the target image (for example, gender, age, occupation, etc.).
  • the user feature extraction model may be a trained artificial neural network.
  • a large number of training samples can be used to train a multi-layer convolutional neural network and LSTM (Long Short-Term Memory) multiple iterations to obtain a user feature extraction model.
  • the training samples include images and labeled feature information. On this basis, the user's intention information is determined based on the characteristic information.
  • the user's intention information can be determined based on the characteristic information through preset processing logic or by querying the corresponding correspondence table. For example, if the obtained feature information is "female", the user's intention information can be determined as "adjust the color to pink” by querying the corresponding correspondence table.
  • the above-mentioned execution subject may determine the user's intention information based on the distance between the target device and the user.
  • the distance between the target device and the user can be obtained in a variety of ways. For example, it can be detected by a distance sensor set in the target device. For another example, it can also be obtained by manual input. On this basis, as an example, it can be obtained by querying the correspondence table. Among them, a large number of distances and corresponding best display styles are stored in the correspondence table. That is, here, the optimal display style can be determined as the user's intention information.
  • the above-mentioned execution subject may determine the user's intention information based on the target image and the distance between the target device and the user.
  • the user's intention information can be determined based on the target image and the distance between the target device and the user in a variety of ways.
  • the first intention information and the second intention information may be obtained based on the target image and the distance between the target device and the user, respectively.
  • the user's intention information is obtained by fusing the first intention information and the second intention information. Since the target image and the distance between the target device and the user are used in combination, the determined user's intention information is more accurate.
  • Step 303 Adjust the display style of the target device based on the intention information.
  • the above-mentioned execution subject may adjust the display style of the target device based on the intention information. For example, if the user's intention information is "adjust the color to pink", the above-mentioned execution subject may adjust the color to pink.
  • the display style may include but is not limited to at least one of the following: font, font size, color, display position, and so on.
  • the display font size of the target device may be adjusted based on the intent information.
  • the candidate display style may be determined based on the intent information. Then, it is determined whether the candidate display style satisfies a preset condition.
  • the preset conditions can be various conditions that limit the display style.
  • the preset condition may be: whether the target device supports the candidate display style. So as to avoid the situation of displaying garbled characters due to the unsupported device.
  • the display style of the target device is adjusted to the candidate display style.
  • the above method further includes: obtaining user feedback information after the display style is adjusted; adjusting the intent information based on the user feedback information to obtain the modified intent information; updating based on the target image and the modified intent information User intention recognition model.
  • the user feedback information can be used to describe the user's feedback on the adjusted display style.
  • the user feedback information may be "satisfied", “unsatisfied”, “font size is too large”, “font size is too small”, “color is too bright” and so on.
  • the user feedback information after the adjustment of the display style can be obtained in a variety of ways.
  • user feedback information can be obtained by receiving text manually input by the user.
  • the voice input by the user can be received, and the voice can be analyzed to obtain user feedback information.
  • an image of the user's face can be photographed, and the facial image can be analyzed to obtain user feedback information.
  • the intention information is adjusted based on the user feedback information, and the revised intention information is obtained.
  • the specific adjustment method can be determined according to actual needs.
  • the user intention recognition model is updated based on the target image and the revised intention information. Specifically, the target image and the revised intention information can be used as a new training sample. The user intention recognition model is trained based on the new training samples.
  • FIG. 4 shows a schematic diagram of another application scenario of the method for adjusting the display style of the target device according to some embodiments of the present disclosure.
  • the user's facial image 404 can be captured by a camera, and the facial image 404 can be image analyzed to obtain user feedback information 405.
  • the user feedback information 405 takes "the font size is too large" as an example.
  • the intention information 403 can be adjusted based on the user feedback information 405 to obtain the revised intention information 406.
  • the intention information 403 can be adjusted to "enlarge the font size by 2 times” to obtain the revised intention information 406, for example, "enlarge the font size by 1.5 times".
  • the target image 401 and the revised intention information 406 can be used as a new training sample 407.
  • the user intention recognition model 402 is trained based on the new training samples 407 to update the user intention recognition model 402. This makes the intention information obtained through the user intention recognition model 402 more accurate.
  • the method provided by some embodiments of the present disclosure realizes a more personalized and targeted style display by determining the user's intention information and adjusting the display style of the target device based on the intention information, so that the display style matches the user. The degree is higher. In this process, by determining the user's intention information based on the distance from the user and/or the target image, it can adapt to different scene requirements.
  • FIG. 5 shows a process 500 of other embodiments of the method for adjusting the display style of the target device.
  • the process 500 of the method for adjusting the display style of the target device includes the following steps:
  • Step 501 Determine whether the face of the user of the target device is displayed in the target image.
  • Step 502 in response to determining that the user's face is displayed in the target image, determine the user's intention information based on at least one of the distance between the target device and the user and the target image.
  • the intention information is used to characterize the user's intention to adjust the display style of the target device.
  • steps 501-502 and the technical effects brought by them can be referred to those embodiments corresponding to FIG. 3, which will not be repeated here.
  • Step 503 Adjusting the display style of the target device based on the intent information includes the following sub-steps:
  • Step 5031 Determine whether the target device is in a static state relative to the user, and whether the duration of the static state exceeds a preset threshold.
  • the executive body may determine whether the target device is in a stationary state relative to the user.
  • step 5032 may continue to be executed.
  • the subsequent steps may be abandoned and the display style adjustment is not performed.
  • Step 5032 in response to determining that the target device is in a static state relative to the user, and the duration of the static state exceeds a preset threshold, adjust the display style of the target device based on the intention information.
  • the display style of the target device in response to determining that the target device is in a static state relative to the user and the duration of the static state exceeds a preset threshold, is adjusted based on the intention information. Thereby, it can be ensured that the adjustment of the display style is triggered only when the target device is in a relatively stable state. For some scenes where the target device is unstable relative to the user, for example, the mobile phone suddenly falls, the user suddenly leaves, etc., avoiding display style adjustments, which can avoid occupying processing resources and saving system overhead.
  • the display style adjustment method for the target device in some embodiments corresponding to FIG. 5 adds a determination before adjusting the display style of the target device.
  • the steps of the target device's state relative to the user. it can be ensured that the display style adjustment is triggered only when the target device is in a relatively stable state, which avoids occupying processing resources and saves system overhead.
  • the present disclosure provides some embodiments of a display style adjustment apparatus 600 for a target device. These apparatus embodiments are the same as those of the methods shown in FIG. 3. Corresponding to the example, the device can be specifically applied to various electronic devices.
  • the apparatus 600 for adjusting the display style of the target device in some embodiments includes: a first determining unit 601, a second determining unit 602, and an adjusting unit 603.
  • the first determining unit 601 is configured to determine whether the face of the user of the target device is displayed in the target image.
  • the second determining unit 602 is configured to, in response to determining that the user's face is displayed in the target image, determine the user's intention information based on at least one of the distance between the target device and the user and the target image, where the intention information is used to characterize the user The intention to adjust the display style of the target device.
  • the adjustment unit 603 is configured to adjust the display style of the target device based on the intention information.
  • the intention information is used to characterize the user's intention to adjust the display font size of the target device; and the adjustment unit 603 is further configured to adjust the display font size of the target device based on the intention information.
  • the second determining unit 602 is further configured to input the target image into a pre-trained user intent recognition model to obtain user intent information.
  • the second determining unit 602 is further configured to: input the target image into a pre-trained user feature extraction model to obtain feature information corresponding to the face displayed in the target image; The information adjusts the display style of the target device.
  • the adjustment unit 603 is further configured to: determine a candidate display style based on the intent information; determine whether the candidate display style satisfies a preset condition; in response to determining that the candidate display style satisfies the preset condition To adjust the display style of the target device to the candidate display style.
  • the adjustment unit 603 is further configured to: determine whether the target device is in a static state relative to the user, and whether the duration of the static state exceeds a preset threshold; in response to determining that the target device is relatively When the user is in a static state and the duration of the static state exceeds a preset threshold, the display style of the target device is adjusted based on the intention information.
  • the apparatus 600 further includes: an acquisition unit (not shown in the figure), a correction unit (not shown in the figure), and an update unit (not shown in the figure).
  • the acquiring unit is configured to: acquire user feedback information after the display style is adjusted;
  • the correcting unit is configured to adjust the intent information based on the user feedback information to obtain the corrected intent information;
  • the updating unit is configured to: based on the target image and the correction The intent information updates the user intent recognition model.
  • FIG. 7 shows a schematic structural diagram of an electronic device 700 suitable for implementing some embodiments of the present disclosure.
  • the terminal devices in some embodiments of the present disclosure may include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals, etc. (E.g. car navigation terminals) and other mobile terminals and fixed terminals such as digital TVs, desktop computers, etc.
  • the electronic device shown in FIG. 7 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.
  • the electronic device 700 may include a processing device (such as a central processing unit, a graphics processor, etc.) 701, which may be loaded into a random access device according to a program stored in a read-only memory (ROM) 702 or from a storage device 708.
  • the program in the memory (RAM) 703 executes various appropriate actions and processing.
  • various programs and data required for the operation of the electronic device 700 are also stored.
  • the processing device 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704.
  • An input/output (I/O) interface 705 is also connected to the bus 704.
  • the following devices can be connected to the I/O interface 705: including input devices 706 such as touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, liquid crystal display (LCD), speakers, vibration An output device 707 such as a device; a storage device 708 such as a memory card; and a communication device 709.
  • the communication device 709 may allow the electronic device 700 to perform wireless or wired communication with other devices to exchange data.
  • FIG. 7 shows an electronic device 700 having various devices, it should be understood that it is not required to implement or have all of the illustrated devices. It may alternatively be implemented or provided with more or fewer devices. Each block shown in FIG. 7 may represent one device, or may represent multiple devices as needed.
  • the process described above with reference to the flowchart may be implemented as a computer software program.
  • some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart.
  • the computer program may be downloaded and installed from the network through the communication device 709, or installed from the storage device 708, or installed from the ROM 702.
  • the processing device 701 the above-mentioned functions defined in the methods of some embodiments of the present disclosure are executed.
  • the computer-readable medium described in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two.
  • the computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a combination of any of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable removable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device.
  • a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • the computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium.
  • the computer-readable signal medium may send, propagate, or transmit the program for use by or in combination with the instruction execution system, apparatus, or device .
  • the program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wire, optical cable, RF (Radio Frequency), etc., or any suitable combination of the above.
  • the client and server can communicate with any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium.
  • Communication e.g., communication network
  • Examples of communication networks include local area networks (“LAN”), wide area networks (“WAN”), the Internet (for example, the Internet), and end-to-end networks (for example, ad hoc end-to-end networks), as well as any currently known or future research and development network of.
  • the above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or it may exist alone without being assembled into the electronic device.
  • the above-mentioned computer-readable medium carries one or more programs.
  • the electronic device determines whether the face of the user of the target device is displayed in the target image; in response to determining the target The user’s face is displayed in the image. Based on at least one of the distance between the target device and the user and the target image, the user’s intention information is determined.
  • the intention information is used to characterize the user’s intention to adjust the display style of the target device; The information adjusts the display style of the target device.
  • the computer program code used to perform the operations of some embodiments of the present disclosure can be written in one or more programming languages or a combination thereof, the programming languages including object-oriented programming languages-such as Java, Smalltalk, C++ , Also includes conventional procedural programming languages-such as "C" language or similar programming languages.
  • the program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server.
  • the remote computer can be connected to the user’s computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to Connect via the Internet).
  • LAN local area network
  • WAN wide area network
  • each block in the flowchart or block diagram may represent a module, program segment, or part of code, and the module, program segment, or part of code contains one or more for realizing the specified logical function Executable instructions.
  • the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two blocks shown in succession can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved.
  • each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart can be implemented by a dedicated hardware-based system that performs the specified functions or operations Or it can be realized by a combination of dedicated hardware and computer instructions.
  • the units described in some embodiments of the present disclosure may be implemented in software or hardware.
  • the described unit may also be provided in the processor, for example, it may be described as: a processor includes a first determining unit, a second determining unit, and an adjusting unit. Wherein, the names of these units do not constitute a limitation on the unit itself under certain circumstances.
  • the adjustment unit can also be described as "a unit that adjusts the display style of the target device based on intent information.”
  • exemplary types of hardware logic components include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Product (ASSP), System on Chip (SOC), Complex Programmable Logical device (CPLD) and so on.
  • FPGA Field Programmable Gate Array
  • ASIC Application Specific Integrated Circuit
  • ASSP Application Specific Standard Product
  • SOC System on Chip
  • CPLD Complex Programmable Logical device
  • a display style adjustment method for a target device including: determining whether the face of the user of the target device is displayed in the target image; Based on at least one of the distance between the target device and the user and the target image, determine the user’s intention information.
  • the intention information is used to characterize the user’s intention to adjust the display style of the target device; adjust the target device’s intention based on the intention information. Display style.
  • the intention information is used to characterize the user's intention to adjust the display font size of the target device; and adjusting the display style of the target device based on the intention information includes: adjusting the display font size of the target device based on the intention information.
  • determining the user's intention information includes: inputting the target image into a pre-trained user intention recognition model to obtain User's intention information.
  • determining the user's intention information based on at least one of the distance between the target device and the user and the target image includes: inputting the target image into a pre-trained user feature extraction model to obtain The feature information corresponding to the face displayed in the target image; the display style of the target device is adjusted based on the feature information.
  • adjusting the display style of the target device based on the intent information includes: determining a candidate display style based on the intent information; determining whether the candidate display style satisfies a preset condition; Set the conditions to adjust the display style of the target device to the candidate display style.
  • adjusting the display style of the target device based on the intention information includes: determining whether the target device is in a static state relative to the user, and whether the duration of the static state exceeds a preset threshold; in response to determining the target The device is in a static state relative to the user, and the duration of the static state exceeds a preset threshold, and the display style of the target device is adjusted based on the intention information.
  • the method further includes: obtaining user feedback information after the display style is adjusted; adjusting the intent information based on the user feedback information to obtain revised intent information; and updating the user intent based on the target image and the revised intent information Identify the model.
  • a display style adjustment apparatus for a target device, including: a first determining unit configured to determine whether the face of a user of the target device is displayed in the target image; The second determining unit is configured to, in response to determining that the user’s face is displayed in the target image, determine the user’s intention information based on at least one of the distance between the target device and the user and the target image, where the intention information is used to characterize the user’s The adjustment intention of the display style of the target device; the adjustment unit is configured to adjust the display style of the target device based on the intention information.
  • an electronic device including: one or more processors; a storage device, on which one or more programs are stored, when one or more programs are stored by one or more One processor executes, so that one or more processors implement any of the above-mentioned methods.
  • a computer-readable medium having a computer program stored thereon, wherein the program is executed by a processor to implement any of the above-mentioned methods.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Biophysics (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A display style adjustment method and apparatus for a target device, an electronic device, and a computer readable medium. The method comprises: determining whether the face of a user of a target device is displayed in a target image (301); in response to determining that the face of the user is displayed in the target image, determining intent information of the user on the basis of at least one of the distance between the target device and the user, and the target image (302), the intent information being used for representing the user's adjustment intent for the display style of the target device; and adjusting the display style of the target device on the basis of the intent information (303). More personalized and targeted style display is achieved.

Description

用于目标设备的显示样式调整方法和装置Method and device for adjusting display style of target equipment
相关申请的交叉引用Cross-references to related applications
本申请基于申请号为201911077857.2、申请日为2019年11月6日,名称为“用于目标设备的显示样式调整方法和装置”的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此引入本申请作为参考。This application is filed based on the Chinese patent application with the application number 201911077857.2, the filing date of November 6, 2019, and the title "Display style adjustment method and device for target equipment", and the priority of the Chinese patent application is claimed. The entire content of the Chinese patent application is hereby incorporated into this application as a reference.
技术领域Technical field
本公开的实施例涉及计算机技术领域,具体涉及用于目标设备的显示样式调整方法、装置、电子设备和计算机可读介质。The embodiments of the present disclosure relate to the field of computer technology, and in particular to a method, apparatus, electronic device, and computer-readable medium for adjusting a display style of a target device.
背景技术Background technique
随着互联网技术的发展和以手机为例的电子设备的普及,人们的日常生活发生了巨大的改变。人们可以通过各种电子设备以及其上安装的各类应用满足诸如出行、娱乐、学习、购物等等各种需求。相关的应用通常需要用户根据自己的需求调整显示样式。With the development of Internet technology and the popularization of electronic devices such as mobile phones, people's daily lives have undergone tremendous changes. People can meet various needs such as travel, entertainment, learning, shopping, etc. through various electronic devices and various applications installed on them. Related applications usually require users to adjust the display style according to their needs.
发明内容Summary of the invention
本发明内容部分用于以简要的形式介绍构思,这些构思将在后面的具体实施方式部分被详细描述。本发明内容部分并不旨在标识要求保护的技术方案的关键特征或必要特征,也不旨在用于限制所要求的保护的技术方案的范围。The content of the present invention is used to introduce concepts in a brief form, and these concepts will be described in detail in the following specific embodiments. The content of the present invention is not intended to identify the key features or essential features of the technical solution required to be protected, nor is it intended to be used to limit the scope of the technical solution required to be protected.
本公开的一些实施例提出了用于目标设备的显示样式调整方法、装置、电子设备和计算机可读介质。Some embodiments of the present disclosure propose a display style adjustment method, apparatus, electronic device, and computer-readable medium for a target device.
第一方面,本公开的一些实施例提供了一种用于目标设备的显示样式调整方法,该方法包括:确定目标图像中是否显示有目标设备的用户的面部;响应于确定目标图像中显示有用户的面部,基于目标设备与用户之间的距离、目标 图像中的至少一项,确定用户的意图信息,意图信息用于表征用户对于目标设备的显示样式的调整意图;基于意图信息调整目标设备的显示样式。In the first aspect, some embodiments of the present disclosure provide a display style adjustment method for a target device. The method includes: determining whether a user's face of the target device is displayed in the target image; For the user’s face, determine the user’s intention information based on at least one of the distance between the target device and the user and the target image. The intention information is used to characterize the user’s intention to adjust the display style of the target device; adjust the target device based on the intention information Display style.
第二方面,本公开的一些实施例提供了一种用于目标设备的显示样式调整装置,包括:第一确定单元,被配置成确定目标图像中是否显示有目标设备的用户的面部;第二确定单元,被配置成响应于确定目标图像中显示有用户的面部,基于目标设备与用户之间的距离、目标图像中的至少一项,确定用户的意图信息,意图信息用于表征用户对于目标设备的显示样式的调整意图;调整单元,被配置成基于意图信息调整目标设备的显示样式。In a second aspect, some embodiments of the present disclosure provide a display style adjustment apparatus for a target device, including: a first determining unit configured to determine whether the target device's user's face is displayed in the target image; and second The determining unit is configured to, in response to determining that the user’s face is displayed in the target image, determine the user’s intention information based on at least one of the distance between the target device and the user and the target image, where the intention information is used to characterize the user’s The adjustment intention of the display style of the device; the adjustment unit is configured to adjust the display style of the target device based on the intention information.
第三方面,本公开的一些实施例提供了一种电子设备,包括:一个或多个处理器;存储装置,其上存储有一个或多个程序,当一个或多个程序被一个或多个处理器执行,使得一个或多个处理器实现如第一方面中任一实现方式描述的方法。In a third aspect, some embodiments of the present disclosure provide an electronic device, including: one or more processors; a storage device, on which one or more programs are stored. When one or more programs are stored by one or more The processor executes, so that one or more processors implement the method described in any implementation manner of the first aspect.
第四方面,本公开的一些实施例提供了一种计算机可读介质,其上存储有计算机程序,其中,程序被处理器执行时实现如第一方面中任一实现方式描述的方法。In a fourth aspect, some embodiments of the present disclosure provide a computer-readable medium on which a computer program is stored, wherein the program is executed by a processor to implement the method described in any implementation manner in the first aspect.
本公开的上述各个实施例中的一个实施例具有如下有益效果:通过确定用户的意图信息,以及基于意图信息调整目标设备的显示样式,实现了更具个性化和针对性的样式显示,使得显示样式与用户之间的匹配程度更高。在此过程中,通过基于与用户之间的距离和/或目标图像,确定用户的意图信息,能够适应不同的场景需求。One of the above-mentioned various embodiments of the present disclosure has the following beneficial effects: by determining the user's intention information, and adjusting the display style of the target device based on the intention information, a more personalized and targeted style display is realized, so that the display The matching degree between the style and the user is higher. In this process, by determining the user's intention information based on the distance from the user and/or the target image, it can adapt to different scene requirements.
附图说明Description of the drawings
结合附图并参考以下具体实施方式,本公开各实施例的上述和其他特征、优点及方面将变得更加明显。贯穿附图中,相同或相似的附图标记表示相同或相似的元素。应当理解附图是示意性的,原件和元素不一定按照比例绘制。The above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent in conjunction with the accompanying drawings and with reference to the following specific implementations. Throughout the drawings, the same or similar reference signs indicate the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.
图1和图2是本公开的一些实施例的用于目标设备的显示样式调整方法的一个应用场景的示意图。Figures 1 and 2 are schematic diagrams of an application scenario of a method for adjusting a display style of a target device according to some embodiments of the present disclosure.
图3是根据本公开的方法的一些实施例的用于目标设备的显示样式调整方法的流程图。FIG. 3 is a flowchart of a display style adjustment method for a target device according to some embodiments of the method of the present disclosure.
图4是根据本公开的一些实施例的用于目标设备的显示样式调整方法的另一个应用场景的示意图。Fig. 4 is a schematic diagram of another application scenario of a method for adjusting a display style of a target device according to some embodiments of the present disclosure.
图5是根据本公开的用于目标设备的显示样式调整方法的另一些实施例的流程图。FIG. 5 is a flowchart of other embodiments of a method for adjusting a display style of a target device according to the present disclosure.
图6是根据本公开的用于目标设备的显示样式调整装置的一些实施例的结构示意图。Fig. 6 is a schematic structural diagram of some embodiments of a display style adjustment apparatus for a target device according to the present disclosure.
图7是适于用来实现本公开的一些实施例的电子设备的结构示意图。FIG. 7 is a schematic structural diagram of an electronic device suitable for implementing some embodiments of the present disclosure.
具体实施方式Detailed ways
下面将参照附图更详细地描述本公开的实施例。虽然附图中显示了本公开的某些实施例,然而应当理解的是,本公开可以通过各种形式来实现,而且不应该被解释为限于这里阐述的实施例。相反,提供这些实施例是为了更加透彻和完整地理解本公开。应当理解的是,本公开的附图及实施例仅用于示例性作用,并非用于限制本公开的保护范围。Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only used for exemplary purposes, and are not used to limit the protection scope of the present disclosure.
另外还需要说明的是,为了便于描述,附图中仅示出了与有关发明相关的部分。在不冲突的情况下,本公开中的实施例及实施例中的特征可以相互组合。In addition, it should be noted that, for ease of description, only the parts related to the relevant invention are shown in the drawings. In the case of no conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other.
需要注意,本公开中提及的“第一”、“第二”等概念仅用于对不同的装置、模块或单元进行区分,并非用于限定这些装置、模块或单元所执行的功能的顺序或者相互依存关系。It should be noted that the concepts of “first” and “second” mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units. Or interdependence.
需要注意,本公开中提及的“一个”、“多个”的修饰是示意性而非限制性的,本领域技术人员应当理解,除非在上下文另有明确指出,否则应该理解为“一个或多个”。It should be noted that the modifications of “a” and “a plurality of” mentioned in the present disclosure are illustrative and not restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as “one or Multiple".
本公开实施方式中的多个装置之间所交互的消息或者信息的名称仅用于说明性的目的,而并不是用于对这些消息或信息的范围进行限制。The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes, and are not used to limit the scope of these messages or information.
下面将参考附图并结合实施例来详细说明本公开。Hereinafter, the present disclosure will be described in detail with reference to the drawings and in conjunction with the embodiments.
图1和图2是本公开的一些实施例的用于目标设备的显示样式调整方法的一个应用场景的示意图。Figures 1 and 2 are schematic diagrams of an application scenario of a method for adjusting a display style of a target device according to some embodiments of the present disclosure.
本公开的一些实施例的用于目标设备的显示样式调整方法一般由终端设备执行。The display style adjustment method for the target device in some embodiments of the present disclosure is generally executed by the terminal device.
需要说明的是,终端设备可以是硬件,也可以是软件。当终端设备为硬件时,可以是具有显示屏并支持显示的各种电子设备,包括但不限于智能手机、平板电脑、车载终端等等。当终端设备为软件时,可以安装在上述所列举的电子设备中。其可以实现成例如用来提供分布式服务的多个软件或软件模块,也可以实现成单个软件或软件模块。在此不做具体限定。It should be noted that the terminal device can be hardware or software. When the terminal device is hardware, it may be various electronic devices with a display screen and supporting display, including but not limited to smart phones, tablet computers, vehicle-mounted terminals, and so on. When the terminal device is software, it can be installed in the electronic devices listed above. It can be implemented, for example, as multiple software or software modules for providing distributed services, or as a single software or software module. There is no specific limitation here.
根据实际需要,用户可以使用终端设备通过网络与服务器交互,以接收或发送消息等。According to actual needs, users can use terminal devices to interact with the server through the network to receive or send messages.
在图1和图2所示的应用场景下,用于目标设备的显示样式调整方法的执行主体可以是智能手机101上安装的新闻应用102。用户A可以通过新闻应用102浏览新闻。在此过程中,新闻应用102可以通过智能手机101上的摄像头103捕获用户A的面部图像。In the application scenarios shown in FIGS. 1 and 2, the execution subject of the method for adjusting the display style of the target device may be the news application 102 installed on the smart phone 101. User A can browse news through the news application 102. In this process, the news application 102 can capture the facial image of the user A through the camera 103 on the smartphone 101.
在此基础上,继续参考图2,对于通过摄像头捕获的用户A的面部图像201,新闻应用102可以利用各种人脸检测算法,确定其中是否显示有用户A的面部。响应于确定其中显示有用户A的面部,基于面部图像201,确定用户A的意图信息203。在本应用场景下,通过将面部图像201输入预先训练的用户意图识别模型202,从而得到用户的意图信息203。在本应用场景下,以用户的意图信息203为“字号放大2倍”为例,可以基于意图信息203放大智能手机101的字号,结果如图1右侧所示。On this basis, continuing to refer to FIG. 2, for the facial image 201 of user A captured by the camera, the news application 102 can use various face detection algorithms to determine whether the face of user A is displayed therein. In response to determining that the face of the user A is displayed therein, based on the face image 201, the intention information 203 of the user A is determined. In this application scenario, the user's intention information 203 is obtained by inputting the facial image 201 into the pre-trained user intention recognition model 202. In this application scenario, taking the user's intention information 203 as "enlarged font size by 2 times" as an example, the font size of the smartphone 101 can be enlarged based on the intention information 203, and the result is shown on the right side of FIG. 1.
继续参考图3,示出了根据本公开的用于目标设备的显示样式调整方法的一些实施例的流程300。该用于目标设备的显示样式调整方法,包括以下步骤:Continuing to refer to FIG. 3, there is shown a process 300 of some embodiments of a method for adjusting a display style of a target device according to the present disclosure. The method for adjusting the display style of the target device includes the following steps:
步骤301,确定目标图像中是否显示有目标设备的用户的面部。Step 301: Determine whether the face of the user of the target device is displayed in the target image.
在一些实施例中,用于目标设备的显示样式调整方法的执行主体可以是上述目标设备,也可以是目标设备上安装的应用。上述执行主体可以首先确定目标图像中是否显示有目标设备的用户的面部。其中,目标图像可以是任意的图像。目标图像的确定可以通过指定,也可以通过一定的条件筛选得到。例如,可以将当前通过目标设备的摄像头捕获的图像作为目标图像。又如,也可以从图像库(例如“相册”)中选取符合条件(例如,最新拍摄的且拍摄时间距当前时间不超过三秒)的图像作为目标图像。目标设备可以是具有显示屏的任意电子设备。作为示例,可以将用户当前使用的电子设备作为目标设备。In some embodiments, the execution subject of the method for adjusting the display style of the target device may be the above-mentioned target device, or may be an application installed on the target device. The above-mentioned execution subject may first determine whether the face of the user of the target device is displayed in the target image. Among them, the target image can be any image. The target image can be determined by designation or by filtering through certain conditions. For example, the image currently captured by the camera of the target device can be used as the target image. For another example, an image that meets the conditions (for example, the latest shot and the shooting time is no more than three seconds from the current time) can be selected from an image library (for example, "album") as the target image. The target device can be any electronic device with a display screen. As an example, the electronic device currently used by the user can be used as the target device.
实践中,可以通过各种方式确定目标图像中是否显示有目标设备的用户的面部。例如,可以通过人脸关键点检测的方法确定图像中是否显示有目标设备的用户的面部。又如,可以通过图像相似度计算的方式确定目标图像中是否显示有目标设备的用户的面部。In practice, it can be determined in various ways whether the face of the user of the target device is displayed in the target image. For example, the method of detecting key points of the face can be used to determine whether the face of the user of the target device is displayed in the image. For another example, it is possible to determine whether the face of the user of the target device is displayed in the target image by means of image similarity calculation.
需要说明的是,这里,目标设备的用户并不对用户构成任何限定。It should be noted that, here, the user of the target device does not constitute any restriction on the user.
步骤302,响应于确定目标图像中显示有用户的面部,基于目标设备与用户之间的距离、目标图像中的至少一项,确定用户的意图信息。Step 302: In response to determining that the user's face is displayed in the target image, determine the user's intention information based on at least one of the distance between the target device and the user and the target image.
在一些实施例中,响应于确定目标图像中显示有用户的面部,上述执行主体可以基于目标设备与用户之间的距离、目标图像中的至少一项,确定用户的意图信息。其中,意图信息用于表征用户对于目标设备的显示样式的调整意图。作为示例,意图信息包括但不限于:调整字体、字号、颜色、显示位置等等的相关信息。例如,可以是“放大字号”、“调亮颜色”等等。In some embodiments, in response to determining that the user's face is displayed in the target image, the above-mentioned execution subject may determine the user's intention information based on at least one of the distance between the target device and the user and the target image. Among them, the intention information is used to characterize the user's intention to adjust the display style of the target device. As an example, the intent information includes but is not limited to: adjusting font, font size, color, display position, etc. related information. For example, it can be "enlarge font size", "lighten color", and so on.
在一些实施例中,作为示例,上述执行主体可以基于目标图像确定用户的意图信息。In some embodiments, as an example, the above-mentioned execution subject may determine the user's intention information based on the target image.
在一些实施例的可选的实现方式中,可以将目标图像输入预先训练的用户意图识别模型,得到用户的意图信息。其中,用户意图识别模型可以是经过训练的人工神经网络。例如,可以利用大量训练样本对多层卷积神经网络、LSTM(Long Short-Term Memory,长短期记忆网络)进行多次迭代训练,得到用户意图识别模型。其中,训练样本包括样本图像以及对应的样本意图信息。实践中,样本图像对应的样本意图信息可以通过人工标注等方式得到。作为示例,可以将训练样本中的样本图像作为多层卷积神经网络的输入,将与输入的样本图像对应的样本意图信息作为多层卷积神经网络的期望输出,训练得到用户意图识别模型。具体的,可以基于各种损失函数计算实际输出与样本意图信息之间的差异,并利用随机梯度下降等方式调整多层卷积神经网络的参数,直至满足预设条件,训练结束。最后,可以将训练完成后的多层卷积神经网络作为用户意图识别模型。In an optional implementation of some embodiments, the target image may be input to a pre-trained user intention recognition model to obtain user intention information. Among them, the user intention recognition model may be a trained artificial neural network. For example, a large number of training samples can be used to train multi-layer convolutional neural networks and LSTM (Long Short-Term Memory) multiple iterations to obtain a user intention recognition model. Among them, the training samples include sample images and corresponding sample intention information. In practice, the sample intention information corresponding to the sample image can be obtained through manual labeling and other methods. As an example, the sample image in the training sample can be used as the input of the multi-layer convolutional neural network, and the sample intention information corresponding to the input sample image can be used as the expected output of the multi-layer convolutional neural network, and the user intention recognition model can be trained. Specifically, the difference between the actual output and the sample intention information can be calculated based on various loss functions, and the parameters of the multilayer convolutional neural network can be adjusted by means of stochastic gradient descent, until the preset conditions are met, and the training ends. Finally, the trained multi-layer convolutional neural network can be used as the user intention recognition model.
在一些实施例的可选的实现方式中,将目标图像输入预先训练的用户特征提取模型,得到目标图像中所显示的面部对应的特征信息。其中,特征信息用于描述目标图像中所显示的面部的各种特征(例如,性别、年龄、职业等等)。 其中,作为示例,用户特征提取模型可以是经过训练的人工神经网络。作为示例,可以利用大量训练样本对多层卷积神经网络、LSTM(Long Short-Term Memory,长短期记忆网络)进行多次迭代训练,得到用户特征提取模型。其中,训练样本包括图像以及标注的特征信息。在此基础上,基于特征信息确定用户的意图信息。作为示例,可以通过预设的处理逻辑或通过查询相应的对应关系表实现基于特征信息确定用户的意图信息。例如,若得到的特征信息为“女”,可以通过查询相应的对应关系表,从而确定用户的意图信息为“将颜色调整为粉色”。In an optional implementation of some embodiments, the target image is input into a pre-trained user feature extraction model to obtain feature information corresponding to the face displayed in the target image. Among them, the feature information is used to describe various features of the face displayed in the target image (for example, gender, age, occupation, etc.). Among them, as an example, the user feature extraction model may be a trained artificial neural network. As an example, a large number of training samples can be used to train a multi-layer convolutional neural network and LSTM (Long Short-Term Memory) multiple iterations to obtain a user feature extraction model. Among them, the training samples include images and labeled feature information. On this basis, the user's intention information is determined based on the characteristic information. As an example, the user's intention information can be determined based on the characteristic information through preset processing logic or by querying the corresponding correspondence table. For example, if the obtained feature information is "female", the user's intention information can be determined as "adjust the color to pink" by querying the corresponding correspondence table.
在一些实施例中,作为示例,上述执行主体可以基于目标设备与用户之间的距离,确定用户的意图信息。其中,目标设备与用户之间的距离可以通过多种方式得到。例如,可以通过目标设备中设置的距离传感器检测得到。又如,也可以通过人工输入的方式得到。在此基础上,作为示例,可以通过查询对应关系表得到。其中,对应关系表中存储有大量的距离与对应的最佳显示样式。也就是说,这里,可以将最佳显示样式确定为用户的意图信息。In some embodiments, as an example, the above-mentioned execution subject may determine the user's intention information based on the distance between the target device and the user. Among them, the distance between the target device and the user can be obtained in a variety of ways. For example, it can be detected by a distance sensor set in the target device. For another example, it can also be obtained by manual input. On this basis, as an example, it can be obtained by querying the correspondence table. Among them, a large number of distances and corresponding best display styles are stored in the correspondence table. That is, here, the optimal display style can be determined as the user's intention information.
进一步的,在一些实施例中,作为示例,上述执行主体可以基于目标图像以及目标设备与用户之间的距离,确定用户的意图信息。其中,确定目标设备与用户之间的距离的具体方法,可以参考本公开的其他可选的方式中的阐述,在此不再赘述。根据实际需要,可以通过多种方式基于目标图像以及目标设备与用户之间的距离,确定用户的意图信息。例如,可以分别基于目标图像和目标设备与用户之间的距离得到第一意图信息和第二意图信息。在此基础上,融合第一意图信息和第二意图信息得到用户的意图信息。由于结合使用了目标图像以及目标设备与用户之间的距离,使得确定的用户的意图信息更加准确。Further, in some embodiments, as an example, the above-mentioned execution subject may determine the user's intention information based on the target image and the distance between the target device and the user. For the specific method for determining the distance between the target device and the user, reference may be made to the description in other optional manners of the present disclosure, and details are not described herein again. According to actual needs, the user's intention information can be determined based on the target image and the distance between the target device and the user in a variety of ways. For example, the first intention information and the second intention information may be obtained based on the target image and the distance between the target device and the user, respectively. On this basis, the user's intention information is obtained by fusing the first intention information and the second intention information. Since the target image and the distance between the target device and the user are used in combination, the determined user's intention information is more accurate.
步骤303,基于意图信息调整目标设备的显示样式。Step 303: Adjust the display style of the target device based on the intention information.
在一些实施例中,上述执行主体可以基于意图信息调整目标设备的显示样式。例如,用户的意图信息为“将颜色调整为粉色”,上述执行主体可以将颜色调整为粉色。其中,根据意图信息的不同,显示样式可以包括但不限于以下至少一项:字体、字号、颜色、显示位置等等。In some embodiments, the above-mentioned execution subject may adjust the display style of the target device based on the intention information. For example, if the user's intention information is "adjust the color to pink", the above-mentioned execution subject may adjust the color to pink. Wherein, according to different intention information, the display style may include but is not limited to at least one of the following: font, font size, color, display position, and so on.
在一些实施例的可选的实现方式中,可以基于意图信息调整目标设备的显示字号。In an optional implementation of some embodiments, the display font size of the target device may be adjusted based on the intent information.
在一些实施例的可选的实现方式中,可以基于意图信息,确定候选显示样式。然后,确定候选显示样式是否满足预设条件。根据实际需要,预设条件可以是对于显示样式进行限定的各种条件。例如,预设条件可以是:目标设备是否支持候选显示样式。从而避免由于设备不支持造成显示乱码等情形。响应于确定候选显示样式满足预设条件,将目标设备的显示样式调整为候选显示样式。In an optional implementation manner of some embodiments, the candidate display style may be determined based on the intent information. Then, it is determined whether the candidate display style satisfies a preset condition. According to actual needs, the preset conditions can be various conditions that limit the display style. For example, the preset condition may be: whether the target device supports the candidate display style. So as to avoid the situation of displaying garbled characters due to the unsupported device. In response to determining that the candidate display style satisfies the preset condition, the display style of the target device is adjusted to the candidate display style.
在一些实施例的可选的实现方式中,上述方法还包括:获取显示样式调整后的用户反馈信息;基于用户反馈信息对意图信息进行调整,得到修正意图信息;基于目标图像和修正意图信息更新用户意图识别模型。In an optional implementation manner of some embodiments, the above method further includes: obtaining user feedback information after the display style is adjusted; adjusting the intent information based on the user feedback information to obtain the modified intent information; updating based on the target image and the modified intent information User intention recognition model.
在这些实现方式中,用户反馈信息可以用于描述用户对于调整后的显示样式的反馈。例如,用户反馈信息可以是“满意”、“不满意”、“字号过大”“字号过小”“颜色太亮”等等。根据实际需要,可以通过多种方式获取显示样式调整后的用户反馈信息。例如,可以接收用户手动输入文本的方式获取用户反馈信息。又如,可以接收用户输入的语音,以及对语音进行分析,得到用户反馈信息。再如,可以在显示样式调整后,对用户的面部进行图像拍摄,对面部图像进行分析,得到用户反馈信息。在此基础上,基于用户反馈信息对意图信息进行调整,得到修正意图信息。具体的调整方式,可以根据实际需要进行确定。最后,基于目标图像和修正意图信息更新用户意图识别模型。具体的,可以将目标图像和修正意图信息作为新的训练样本。基于新的训练样本对用户意图识别模型进行训练。In these implementations, the user feedback information can be used to describe the user's feedback on the adjusted display style. For example, the user feedback information may be "satisfied", "unsatisfied", "font size is too large", "font size is too small", "color is too bright" and so on. According to actual needs, the user feedback information after the adjustment of the display style can be obtained in a variety of ways. For example, user feedback information can be obtained by receiving text manually input by the user. For another example, the voice input by the user can be received, and the voice can be analyzed to obtain user feedback information. For another example, after the display style is adjusted, an image of the user's face can be photographed, and the facial image can be analyzed to obtain user feedback information. On this basis, the intention information is adjusted based on the user feedback information, and the revised intention information is obtained. The specific adjustment method can be determined according to actual needs. Finally, the user intention recognition model is updated based on the target image and the revised intention information. Specifically, the target image and the revised intention information can be used as a new training sample. The user intention recognition model is trained based on the new training samples.
继续参考图4,其示出了根据本公开的一些实施例的用于目标设备的显示样式调整方法的另一个应用场景的示意图。Continue to refer to FIG. 4, which shows a schematic diagram of another application scenario of the method for adjusting the display style of the target device according to some embodiments of the present disclosure.
在本应用场景下,在放大字号后,可以通过摄像头捕获用户的面部图像404,以及对该面部图像404进行图像分析,得到用户反馈信息405。用户反馈信息405以“字号过大”为例。In this application scenario, after the font size is enlarged, the user's facial image 404 can be captured by a camera, and the facial image 404 can be image analyzed to obtain user feedback information 405. The user feedback information 405 takes "the font size is too large" as an example.
在此基础上,可以基于用户反馈信息405对意图信息403进行调整,得到修正意图信息406。继续以用户反馈信息405“字号过大”为例。可以对意图信息403为“字号放大2倍”进行调整,得到修正意图信息406,例如“字号放大1.5倍”。最后,可以将目标图像401和修正意图信息406作为新的训练样本407。基于新的训练样本407对用户意图识别模型402进行训练,以对用户意图识别 模型402进行更新。使得通过用户意图识别模型402得到的意图信息更加准确。On this basis, the intention information 403 can be adjusted based on the user feedback information 405 to obtain the revised intention information 406. Continue to take the user feedback message 405 "Font size is too large" as an example. The intention information 403 can be adjusted to "enlarge the font size by 2 times" to obtain the revised intention information 406, for example, "enlarge the font size by 1.5 times". Finally, the target image 401 and the revised intention information 406 can be used as a new training sample 407. The user intention recognition model 402 is trained based on the new training samples 407 to update the user intention recognition model 402. This makes the intention information obtained through the user intention recognition model 402 more accurate.
本公开的一些实施例提供的方法,通过确定用户的意图信息,以及基于意图信息调整目标设备的显示样式,实现了更具个性化和针对性的样式显示,使得显示样式与用户之间的匹配程度更高。在此过程中,通过基于与用户之间的距离和/或目标图像,确定用户的意图信息,能够适应不同的场景需求。The method provided by some embodiments of the present disclosure realizes a more personalized and targeted style display by determining the user's intention information and adjusting the display style of the target device based on the intention information, so that the display style matches the user. The degree is higher. In this process, by determining the user's intention information based on the distance from the user and/or the target image, it can adapt to different scene requirements.
进一步参考图5,其示出了用于目标设备的显示样式调整方法的另一些实施例的流程500。该用于目标设备的显示样式调整方法的流程500,包括以下步骤:With further reference to FIG. 5, it shows a process 500 of other embodiments of the method for adjusting the display style of the target device. The process 500 of the method for adjusting the display style of the target device includes the following steps:
步骤501,确定目标图像中是否显示有所述目标设备的用户的面部。Step 501: Determine whether the face of the user of the target device is displayed in the target image.
步骤502,响应于确定目标图像中显示有用户的面部,基于目标设备与用户之间的距离、目标图像中的至少一项,确定用户的意图信息。 Step 502, in response to determining that the user's face is displayed in the target image, determine the user's intention information based on at least one of the distance between the target device and the user and the target image.
其中,意图信息用于表征用户对于目标设备的显示样式的调整意图。Among them, the intention information is used to characterize the user's intention to adjust the display style of the target device.
在一些实施例中,步骤501-502的具体实现及其所带来的技术效果可以参考图3对应的那些实施例,在此不再赘述。In some embodiments, the specific implementation of steps 501-502 and the technical effects brought by them can be referred to those embodiments corresponding to FIG. 3, which will not be repeated here.
步骤503,基于意图信息调整目标设备的显示样式,包括以下子步骤:Step 503: Adjusting the display style of the target device based on the intent information includes the following sub-steps:
步骤5031,确定目标设备相对于用户是否处于静止状态,以及处于静止状态的时长是否超过预设阈值。Step 5031: Determine whether the target device is in a static state relative to the user, and whether the duration of the static state exceeds a preset threshold.
在一些实施例中,执行主体可以确定目标设备相对于用户是否处于静止状态。实践中,作为示例,可以通过连续拍摄多张图像,对多张图像进行运动检测,从而确定目标设备相对于用户是否处于静止状态。作为示例,在用户处于静止状态的场景下,还可以通过目标设备中设置的加速度传感器等多种传感器检测目标设备相对于用户是否处于静止状态。若确定目标设备相对于用户处于静止状态可以继续确定处于静止状态的时长是否超过预设阈值。若确定目标设备相对于用户处于静止状态,以及处于静止状态的时长超过预设阈值,可以继续执行步骤5032。可选的,若确定目标设备相对于用户处于非静止状态或处于静止状态的时长未超过预设阈值,可以放弃执行后续步骤,不进行显示样式调整。In some embodiments, the executive body may determine whether the target device is in a stationary state relative to the user. In practice, as an example, it is possible to perform motion detection on the multiple images by continuously shooting multiple images, so as to determine whether the target device is in a static state relative to the user. As an example, in a scenario where the user is in a stationary state, it is also possible to detect whether the target device is in a stationary state relative to the user through various sensors such as an acceleration sensor provided in the target device. If it is determined that the target device is in a static state relative to the user, it can continue to determine whether the duration of the static state exceeds the preset threshold. If it is determined that the target device is in a static state relative to the user, and the duration of the static state exceeds the preset threshold, step 5032 may continue to be executed. Optionally, if it is determined that the duration of the target device being in a non-stationary state or in a stationary state relative to the user does not exceed a preset threshold, the subsequent steps may be abandoned and the display style adjustment is not performed.
步骤5032,响应于确定目标设备相对于用户处于静止状态,以及处于静止状态的时长超过预设阈值,基于意图信息调整目标设备的显示样式。 Step 5032, in response to determining that the target device is in a static state relative to the user, and the duration of the static state exceeds a preset threshold, adjust the display style of the target device based on the intention information.
在一些实施例中,在步骤5031的基础上,响应于确定目标设备相对于用户 处于静止状态,以及处于静止状态的时长超过预设阈值,基于意图信息调整目标设备的显示样式。从而可以保证在目标设备处于比较稳定的状态才触发显示样式的调整。而对于一些目标设备相对于用户不稳定的场景,例如,手机突然掉落、用户有事忽然离开等场景,避免进行显示样式调整,从而可以避免占用处理资源,节约系统开销。In some embodiments, on the basis of step 5031, in response to determining that the target device is in a static state relative to the user and the duration of the static state exceeds a preset threshold, the display style of the target device is adjusted based on the intention information. Thereby, it can be ensured that the adjustment of the display style is triggered only when the target device is in a relatively stable state. For some scenes where the target device is unstable relative to the user, for example, the mobile phone suddenly falls, the user suddenly leaves, etc., avoiding display style adjustments, which can avoid occupying processing resources and saving system overhead.
从图5中可以看出,与图3对应的一些实施例的描述相比,图5对应的一些实施例中的用于目标设备的显示样式调整方法在调整目标设备的显示样式之前增加了确定目标设备相对于用户的状态的步骤。由此,可以保证在目标设备处于比较稳定的状态才触发显示样式的调整,避免占用处理资源,节约系统开销。It can be seen from FIG. 5 that, compared with the description of some embodiments corresponding to FIG. 3, the display style adjustment method for the target device in some embodiments corresponding to FIG. 5 adds a determination before adjusting the display style of the target device. The steps of the target device's state relative to the user. As a result, it can be ensured that the display style adjustment is triggered only when the target device is in a relatively stable state, which avoids occupying processing resources and saves system overhead.
进一步参考图6,作为对上述各图所示方法的实现,本公开提供了一种用于目标设备的显示样式调整装置600的一些实施例,这些装置实施例与图3所示的那些方法实施例相对应,该装置具体可以应用于各种电子设备中。With further reference to FIG. 6, as an implementation of the methods shown in the above figures, the present disclosure provides some embodiments of a display style adjustment apparatus 600 for a target device. These apparatus embodiments are the same as those of the methods shown in FIG. 3. Corresponding to the example, the device can be specifically applied to various electronic devices.
如图6所示,一些实施例的用于目标设备的显示样式调整装置600包括:第一确定单元601、第二确定单元602和调整单元603。其中,第一确定单元601被配置成确定目标图像中是否显示有目标设备的用户的面部。第二确定单元602被配置成响应于确定目标图像中显示有用户的面部,基于目标设备与用户之间的距离、目标图像中的至少一项,确定用户的意图信息,意图信息用于表征用户对于目标设备的显示样式的调整意图。调整单元603被配置成基于意图信息调整目标设备的显示样式。As shown in FIG. 6, the apparatus 600 for adjusting the display style of the target device in some embodiments includes: a first determining unit 601, a second determining unit 602, and an adjusting unit 603. The first determining unit 601 is configured to determine whether the face of the user of the target device is displayed in the target image. The second determining unit 602 is configured to, in response to determining that the user's face is displayed in the target image, determine the user's intention information based on at least one of the distance between the target device and the user and the target image, where the intention information is used to characterize the user The intention to adjust the display style of the target device. The adjustment unit 603 is configured to adjust the display style of the target device based on the intention information.
在一些实施例的一些可选的实现方式中,意图信息用于表征用户对于目标设备的显示字号的调整意图;以及调整单元603进一步被配置成基于意图信息调整目标设备的显示字号。In some optional implementations of some embodiments, the intention information is used to characterize the user's intention to adjust the display font size of the target device; and the adjustment unit 603 is further configured to adjust the display font size of the target device based on the intention information.
在一些实施例的一些可选的实现方式中,第二确定单元602进一步被配置成:将目标图像输入预先训练的用户意图识别模型,得到用户的意图信息。In some optional implementation manners of some embodiments, the second determining unit 602 is further configured to input the target image into a pre-trained user intent recognition model to obtain user intent information.
在一些实施例的一些可选的实现方式中,第二确定单元602进一步被配置成:将目标图像输入预先训练的用户特征提取模型,得到目标图像中所显示的面部对应的特征信息;基于特征信息调整目标设备的显示样式。In some optional implementations of some embodiments, the second determining unit 602 is further configured to: input the target image into a pre-trained user feature extraction model to obtain feature information corresponding to the face displayed in the target image; The information adjusts the display style of the target device.
在一些实施例的一些可选的实现方式中,调整单元603进一步被配置成: 基于意图信息,确定候选显示样式;确定候选显示样式是否满足预设条件;响应于确定候选显示样式满足预设条件,将目标设备的显示样式调整为候选显示样式。In some optional implementation manners of some embodiments, the adjustment unit 603 is further configured to: determine a candidate display style based on the intent information; determine whether the candidate display style satisfies a preset condition; in response to determining that the candidate display style satisfies the preset condition To adjust the display style of the target device to the candidate display style.
在一些实施例的一些可选的实现方式中,调整单元603进一步被配置成:确定目标设备相对于用户是否处于静止状态,以及处于静止状态的时长是否超过预设阈值;响应于确定目标设备相对于用户处于静止状态,以及处于静止状态的时长超过预设阈值,基于意图信息调整目标设备的显示样式。In some optional implementations of some embodiments, the adjustment unit 603 is further configured to: determine whether the target device is in a static state relative to the user, and whether the duration of the static state exceeds a preset threshold; in response to determining that the target device is relatively When the user is in a static state and the duration of the static state exceeds a preset threshold, the display style of the target device is adjusted based on the intention information.
在一些实施例的一些可选的实现方式中,装置600还包括:获取单元(图中未示出)、修正单元(图中未示出)和更新单元(图中未示出)。其中,获取单元被配置成:获取显示样式调整后的用户反馈信息;修正单元被配置成:基于用户反馈信息对意图信息进行调整,得到修正意图信息;更新单元被配置成:基于目标图像和修正意图信息更新用户意图识别模型。In some optional implementation manners of some embodiments, the apparatus 600 further includes: an acquisition unit (not shown in the figure), a correction unit (not shown in the figure), and an update unit (not shown in the figure). Wherein, the acquiring unit is configured to: acquire user feedback information after the display style is adjusted; the correcting unit is configured to adjust the intent information based on the user feedback information to obtain the corrected intent information; the updating unit is configured to: based on the target image and the correction The intent information updates the user intent recognition model.
在这些实施例中,通过确定用户的意图信息,以及基于意图信息调整目标设备的显示样式,实现了更具个性化和针对性的样式显示,使得显示样式与用户之间的匹配程度更高。在此过程中,通过基于与用户之间的距离和/或目标图像,确定用户的意图信息,能够适应不同的场景需求。In these embodiments, by determining the user's intention information and adjusting the display style of the target device based on the intention information, a more personalized and targeted style display is realized, so that the display style is more closely matched with the user. In this process, by determining the user's intention information based on the distance from the user and/or the target image, it can adapt to different scene requirements.
下面参考图7,其示出了适于用来实现本公开的一些实施例的电子设备700的结构示意图。本公开的一些实施例中的终端设备可以包括但不限于诸如移动电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、车载终端(例如车载导航终端)等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。图7示出的电子设备仅仅是一个示例,不应对本公开的实施例的功能和使用范围带来任何限制。Referring now to FIG. 7, it shows a schematic structural diagram of an electronic device 700 suitable for implementing some embodiments of the present disclosure. The terminal devices in some embodiments of the present disclosure may include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals, etc. (E.g. car navigation terminals) and other mobile terminals and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG. 7 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.
如图7所示,电子设备700可以包括处理装置(例如中央处理器、图形处理器等)701,其可以根据存储在只读存储器(ROM)702中的程序或者从存储装置708加载到随机访问存储器(RAM)703中的程序而执行各种适当的动作和处理。在RAM 703中,还存储有电子设备700操作所需的各种程序和数据。处理装置701、ROM 702以及RAM 703通过总线704彼此相连。输入/输出(I/O)接口705也连接至总线704。As shown in FIG. 7, the electronic device 700 may include a processing device (such as a central processing unit, a graphics processor, etc.) 701, which may be loaded into a random access device according to a program stored in a read-only memory (ROM) 702 or from a storage device 708. The program in the memory (RAM) 703 executes various appropriate actions and processing. In the RAM 703, various programs and data required for the operation of the electronic device 700 are also stored. The processing device 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704. An input/output (I/O) interface 705 is also connected to the bus 704.
通常,以下装置可以连接至I/O接口705:包括例如触摸屏、触摸板、键盘、 鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置706;包括例如液晶显示器(LCD)、扬声器、振动器等的输出装置707;包括例如存储卡等的存储装置708;以及通信装置709。通信装置709可以允许电子设备700与其他设备进行无线或有线通信以交换数据。虽然图7示出了具有各种装置的电子设备700,但是应理解的是,并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。图7中示出的每个方框可以代表一个装置,也可以根据需要代表多个装置。Generally, the following devices can be connected to the I/O interface 705: including input devices 706 such as touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, liquid crystal display (LCD), speakers, vibration An output device 707 such as a device; a storage device 708 such as a memory card; and a communication device 709. The communication device 709 may allow the electronic device 700 to perform wireless or wired communication with other devices to exchange data. Although FIG. 7 shows an electronic device 700 having various devices, it should be understood that it is not required to implement or have all of the illustrated devices. It may alternatively be implemented or provided with more or fewer devices. Each block shown in FIG. 7 may represent one device, or may represent multiple devices as needed.
特别地,根据本公开的一些实施例,上文参考流程图描述的过程可以被实现为计算机软件程序。例如,本公开的一些实施例包括一种计算机程序产品,其包括承载在计算机可读介质上的计算机程序,该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的一些实施例中,该计算机程序可以通过通信装置709从网络上被下载和安装,或者从存储装置708被安装,或者从ROM 702被安装。在该计算机程序被处理装置701执行时,执行本公开的一些实施例的方法中限定的上述功能。In particular, according to some embodiments of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In some such embodiments, the computer program may be downloaded and installed from the network through the communication device 709, or installed from the storage device 708, or installed from the ROM 702. When the computer program is executed by the processing device 701, the above-mentioned functions defined in the methods of some embodiments of the present disclosure are executed.
需要说明的是,本公开的一些实施例所述的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开的一些实施例中,计算机可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开的一些实施例中,计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质,该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用 或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输,包括但不限于:电线、光缆、RF(射频)等等,或者上述的任意合适的组合。It should be noted that the computer-readable medium described in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a combination of any of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable removable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium. The computer-readable signal medium may send, propagate, or transmit the program for use by or in combination with the instruction execution system, apparatus, or device . The program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wire, optical cable, RF (Radio Frequency), etc., or any suitable combination of the above.
在一些实施方式中,客户端、服务器可以利用诸如HTTP(HyperText Transfer Protocol,超文本传输协议)之类的任何当前已知或未来研发的网络协议进行通信,并且可以与任意形式或介质的数字数据通信(例如,通信网络)互连。通信网络的示例包括局域网(“LAN”),广域网(“WAN”),网际网(例如,互联网)以及端对端网络(例如,ad hoc端对端网络),以及任何当前已知或未来研发的网络。In some embodiments, the client and server can communicate with any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium. Communication (e.g., communication network) interconnects. Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (for example, the Internet), and end-to-end networks (for example, ad hoc end-to-end networks), as well as any currently known or future research and development network of.
上述计算机可读介质可以是上述电子设备中所包含的;也可以是单独存在,而未装配入该电子设备中。上述计算机可读介质承载有一个或者多个程序,当上述一个或者多个程序被该电子设备执行时,使得该电子设备:确定目标图像中是否显示有目标设备的用户的面部;响应于确定目标图像中显示有用户的面部,基于目标设备与用户之间的距离、目标图像中的至少一项,确定用户的意图信息,意图信息用于表征用户对于目标设备的显示样式的调整意图;基于意图信息调整目标设备的显示样式。The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or it may exist alone without being assembled into the electronic device. The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: determines whether the face of the user of the target device is displayed in the target image; in response to determining the target The user’s face is displayed in the image. Based on at least one of the distance between the target device and the user and the target image, the user’s intention information is determined. The intention information is used to characterize the user’s intention to adjust the display style of the target device; The information adjusts the display style of the target device.
可以以一种或多种程序设计语言或其组合来编写用于执行本公开的一些实施例的操作的计算机程序代码,所述程序设计语言包括面向对象的程序设计语言—诸如Java、Smalltalk、C++,还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中,远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)——连接到用户计算机,或者,可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。The computer program code used to perform the operations of some embodiments of the present disclosure can be written in one or more programming languages or a combination thereof, the programming languages including object-oriented programming languages-such as Java, Smalltalk, C++ , Also includes conventional procedural programming languages-such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user’s computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to Connect via the Internet).
附图中的流程图和框图,图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分,该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应 当注意,在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个接连地表示的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions, and operations of the system, method, and computer program product according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or part of code, and the module, program segment, or part of code contains one or more for realizing the specified logical function Executable instructions. It should also be noted that, in some alternative implementations, the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two blocks shown in succession can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations Or it can be realized by a combination of dedicated hardware and computer instructions.
描述于本公开的一些实施例中的单元可以通过软件的方式实现,也可以通过硬件的方式来实现。所描述的单元也可以设置在处理器中,例如,可以描述为:一种处理器包括第一确定单元、第二确定单元和调整单元。其中,这些单元的名称在某种情况下并不构成对该单元本身的限定,例如,调整单元还可以被描述为“基于意图信息调整目标设备的显示样式的单元”。The units described in some embodiments of the present disclosure may be implemented in software or hardware. The described unit may also be provided in the processor, for example, it may be described as: a processor includes a first determining unit, a second determining unit, and an adjusting unit. Wherein, the names of these units do not constitute a limitation on the unit itself under certain circumstances. For example, the adjustment unit can also be described as "a unit that adjusts the display style of the target device based on intent information."
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如,非限制性地,可以使用的示范类型的硬件逻辑部件包括:现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、片上系统(SOC)、复杂可编程逻辑设备(CPLD)等等。The functions described hereinabove may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Product (ASSP), System on Chip (SOC), Complex Programmable Logical device (CPLD) and so on.
根据本公开的一个或多个实施例,提供了一种用于目标设备的显示样式调整方法,包括:确定目标图像中是否显示有目标设备的用户的面部;响应于确定目标图像中显示有用户的面部,基于目标设备与用户之间的距离、目标图像中的至少一项,确定用户的意图信息,意图信息用于表征用户对于目标设备的显示样式的调整意图;基于意图信息调整目标设备的显示样式。According to one or more embodiments of the present disclosure, there is provided a display style adjustment method for a target device, including: determining whether the face of the user of the target device is displayed in the target image; Based on at least one of the distance between the target device and the user and the target image, determine the user’s intention information. The intention information is used to characterize the user’s intention to adjust the display style of the target device; adjust the target device’s intention based on the intention information. Display style.
根据本公开的一个或多个实施例,意图信息用于表征用户对于目标设备的显示字号的调整意图;以及基于意图信息调整目标设备的显示样式,包括:基于意图信息调整目标设备的显示字号。According to one or more embodiments of the present disclosure, the intention information is used to characterize the user's intention to adjust the display font size of the target device; and adjusting the display style of the target device based on the intention information includes: adjusting the display font size of the target device based on the intention information.
根据本公开的一个或多个实施例,基于目标设备与用户之间的距离、目标图像中的至少一项,确定用户的意图信息,包括:将目标图像输入预先训练的用户意图识别模型,得到用户的意图信息。According to one or more embodiments of the present disclosure, based on at least one of the distance between the target device and the user and the target image, determining the user's intention information includes: inputting the target image into a pre-trained user intention recognition model to obtain User's intention information.
根据本公开的一个或多个实施例,基于目标设备与用户之间的距离、目标图像中的至少一项,确定用户的意图信息,包括:将目标图像输入预先训练的用户特征提取模型,得到目标图像中所显示的面部对应的特征信息;基于特征 信息调整目标设备的显示样式。According to one or more embodiments of the present disclosure, determining the user's intention information based on at least one of the distance between the target device and the user and the target image includes: inputting the target image into a pre-trained user feature extraction model to obtain The feature information corresponding to the face displayed in the target image; the display style of the target device is adjusted based on the feature information.
根据本公开的一个或多个实施例,基于意图信息调整目标设备的显示样式,包括:基于意图信息,确定候选显示样式;确定候选显示样式是否满足预设条件;响应于确定候选显示样式满足预设条件,将目标设备的显示样式调整为候选显示样式。According to one or more embodiments of the present disclosure, adjusting the display style of the target device based on the intent information includes: determining a candidate display style based on the intent information; determining whether the candidate display style satisfies a preset condition; Set the conditions to adjust the display style of the target device to the candidate display style.
根据本公开的一个或多个实施例,基于意图信息调整目标设备的显示样式,包括:确定目标设备相对于用户是否处于静止状态,以及处于静止状态的时长是否超过预设阈值;响应于确定目标设备相对于用户处于静止状态,以及处于静止状态的时长超过预设阈值,基于意图信息调整目标设备的显示样式。According to one or more embodiments of the present disclosure, adjusting the display style of the target device based on the intention information includes: determining whether the target device is in a static state relative to the user, and whether the duration of the static state exceeds a preset threshold; in response to determining the target The device is in a static state relative to the user, and the duration of the static state exceeds a preset threshold, and the display style of the target device is adjusted based on the intention information.
根据本公开的一个或多个实施例,方法还包括:获取显示样式调整后的用户反馈信息;基于用户反馈信息对意图信息进行调整,得到修正意图信息;基于目标图像和修正意图信息更新用户意图识别模型。According to one or more embodiments of the present disclosure, the method further includes: obtaining user feedback information after the display style is adjusted; adjusting the intent information based on the user feedback information to obtain revised intent information; and updating the user intent based on the target image and the revised intent information Identify the model.
根据本公开的一个或多个实施例,提供了一种用于目标设备的显示样式调整装置,包括:第一确定单元,被配置成确定目标图像中是否显示有目标设备的用户的面部;第二确定单元,被配置成响应于确定目标图像中显示有用户的面部,基于目标设备与用户之间的距离、目标图像中的至少一项,确定用户的意图信息,意图信息用于表征用户对于目标设备的显示样式的调整意图;调整单元,被配置成基于意图信息调整目标设备的显示样式。According to one or more embodiments of the present disclosure, there is provided a display style adjustment apparatus for a target device, including: a first determining unit configured to determine whether the face of a user of the target device is displayed in the target image; The second determining unit is configured to, in response to determining that the user’s face is displayed in the target image, determine the user’s intention information based on at least one of the distance between the target device and the user and the target image, where the intention information is used to characterize the user’s The adjustment intention of the display style of the target device; the adjustment unit is configured to adjust the display style of the target device based on the intention information.
根据本公开的一个或多个实施例,提供了一种电子设备,包括:一个或多个处理器;存储装置,其上存储有一个或多个程序,当一个或多个程序被一个或多个处理器执行,使得一个或多个处理器实现如上述任一的方法。According to one or more embodiments of the present disclosure, there is provided an electronic device, including: one or more processors; a storage device, on which one or more programs are stored, when one or more programs are stored by one or more One processor executes, so that one or more processors implement any of the above-mentioned methods.
根据本公开的一个或多个实施例,提供了一种计算机可读介质,其上存储有计算机程序,其中,程序被处理器执行时实现上述任一的方法。According to one or more embodiments of the present disclosure, there is provided a computer-readable medium having a computer program stored thereon, wherein the program is executed by a processor to implement any of the above-mentioned methods.
以上描述仅为本公开的一些较佳实施例以及对所运用技术原理的说明。本领域技术人员应当理解,本公开的实施例中所涉及的发明范围,并不限于上述技术特征的特定组合而成的技术方案,同时也应涵盖在不脱离上述发明构思的情况下,由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本公开的实施例中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。The above description is only some preferred embodiments of the present disclosure and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solution formed by the specific combination of the above technical features, and should also cover the above-mentioned inventive concept without departing from the above-mentioned inventive concept. Other technical solutions formed by any combination of technical features or their equivalent features. For example, the above-mentioned features and the technical features disclosed in the embodiments of the present disclosure (but not limited to) having similar functions are replaced with each other to form a technical solution.

Claims (10)

  1. 一种用于目标设备的显示样式调整方法,包括:A method for adjusting the display style of a target device, including:
    确定目标图像中是否显示有所述目标设备的用户的面部;Determining whether the face of the user of the target device is displayed in the target image;
    响应于确定所述目标图像中显示有所述用户的面部,基于所述目标设备与所述用户之间的距离、所述目标图像中的至少一项,确定所述用户的意图信息,所述意图信息用于表征所述用户对于所述目标设备的显示样式的调整意图;In response to determining that the face of the user is displayed in the target image, determining the user's intention information based on at least one of the distance between the target device and the user and the target image, the The intention information is used to characterize the user's intention to adjust the display style of the target device;
    基于所述意图信息调整所述目标设备的显示样式。The display style of the target device is adjusted based on the intention information.
  2. 根据权利要求1所述的方法,其中,所述意图信息用于表征所述用户对于所述目标设备的显示字号的调整意图;以及The method according to claim 1, wherein the intention information is used to characterize the user's intention to adjust the display font size of the target device; and
    所述基于所述意图信息调整所述目标设备的显示样式,包括:The adjusting the display style of the target device based on the intention information includes:
    基于所述意图信息调整所述目标设备的显示字号。Adjusting the display font size of the target device based on the intention information.
  3. 根据权利要求1所述的方法,其中,所述基于所述目标设备与所述用户之间的距离、所述目标图像中的至少一项,确定所述用户的意图信息,包括:The method according to claim 1, wherein the determining the intention information of the user based on at least one of the distance between the target device and the user and the target image comprises:
    将所述目标图像输入预先训练的用户意图识别模型,得到所述用户的意图信息。The target image is input into a pre-trained user intention recognition model to obtain the user's intention information.
  4. 根据权利要求1所述的方法,其中,所述基于所述目标设备与所述用户之间的距离、所述目标图像中的至少一项,确定所述用户的意图信息,包括:The method according to claim 1, wherein the determining the intention information of the user based on at least one of the distance between the target device and the user and the target image comprises:
    将所述目标图像输入预先训练的用户特征提取模型,得到所述目标图像中所显示的面部对应的特征信息;Inputting the target image into a pre-trained user feature extraction model to obtain feature information corresponding to the face displayed in the target image;
    基于所述特征信息确定所述用户的意图信息。Determine the user's intention information based on the characteristic information.
  5. 根据权利要求1所述的方法,其中,所述基于所述意图信息调整所述目标设备的显示样式,包括:The method according to claim 1, wherein the adjusting the display style of the target device based on the intent information comprises:
    基于所述意图信息,确定候选显示样式;Determining a candidate display style based on the intention information;
    确定所述候选显示样式是否满足预设条件;Determining whether the candidate display style satisfies a preset condition;
    响应于确定所述候选显示样式满足所述预设条件,将所述目标设备的显示样式调整为所述候选显示样式。In response to determining that the candidate display style satisfies the preset condition, the display style of the target device is adjusted to the candidate display style.
  6. 根据权利要求1所述的方法,其中,所述基于所述意图信息调整所述目标设备的显示样式,包括:The method according to claim 1, wherein the adjusting the display style of the target device based on the intent information comprises:
    确定所述目标设备相对于所述用户是否处于静止状态,以及处于静止状态的时长是否超过预设阈值;Determining whether the target device is in a static state relative to the user, and whether the length of time in the static state exceeds a preset threshold;
    响应于确定所述目标设备相对于所述用户处于静止状态,以及处于静止状态的时长超过预设阈值,基于所述意图信息调整所述目标设备的显示样式。In response to determining that the target device is in a static state relative to the user, and the duration of the static state exceeds a preset threshold, the display style of the target device is adjusted based on the intention information.
  7. 根据权利要求3所述的方法,其中,所述方法还包括:The method according to claim 3, wherein the method further comprises:
    获取显示样式调整后的用户反馈信息;Obtain user feedback information after the display style is adjusted;
    基于所述用户反馈信息对所述意图信息进行调整,得到修正意图信息;Adjusting the intention information based on the user feedback information to obtain revised intention information;
    基于所述目标图像和所述修正意图信息更新所述用户意图识别模型。The user intention recognition model is updated based on the target image and the revised intention information.
  8. 一种用于目标设备的显示样式调整装置,包括:A display style adjustment device for target equipment, including:
    第一确定单元,被配置成确定目标图像中是否显示有所述目标设备的用户的面部;The first determining unit is configured to determine whether the face of the user of the target device is displayed in the target image;
    第二确定单元,被配置成响应于确定所述目标图像中显示有所述用户的面部,基于所述目标设备与所述用户之间的距离、所述目标图像中的至少一项,确定所述用户的意图信息,所述意图信息用于表征所述用户对于所述目标设备的显示样式的调整意图;The second determining unit is configured to, in response to determining that the face of the user is displayed in the target image, determine the target image based on at least one of the distance between the target device and the user and the target image. The user’s intention information, where the intention information is used to characterize the user’s intention to adjust the display style of the target device;
    调整单元,被配置成基于所述意图信息调整所述目标设备的显示样式。The adjustment unit is configured to adjust the display style of the target device based on the intention information.
  9. 一种电子设备,包括:An electronic device including:
    一个或多个处理器;One or more processors;
    存储装置,其上存储有一个或多个程序,A storage device on which one or more programs are stored,
    当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现如权利要求1-7中任一所述的方法。When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1-7.
  10. 一种计算机可读介质,其上存储有计算机程序,其中,所述程序被处理器执行时实现如权利要求1-7中任一所述的方法。A computer readable medium having a computer program stored thereon, wherein the program is executed by a processor to implement the method according to any one of claims 1-7.
PCT/CN2020/126110 2019-11-06 2020-11-03 Display style adjustment method and apparatus for target device WO2021088790A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911077857.2A CN110851032A (en) 2019-11-06 2019-11-06 Display style adjustment method and device for target device
CN201911077857.2 2019-11-06

Publications (1)

Publication Number Publication Date
WO2021088790A1 true WO2021088790A1 (en) 2021-05-14

Family

ID=69598691

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/126110 WO2021088790A1 (en) 2019-11-06 2020-11-03 Display style adjustment method and apparatus for target device

Country Status (2)

Country Link
CN (1) CN110851032A (en)
WO (1) WO2021088790A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110851032A (en) * 2019-11-06 2020-02-28 北京字节跳动网络技术有限公司 Display style adjustment method and device for target device
CN112507385B (en) * 2020-12-25 2022-05-10 北京字跳网络技术有限公司 Information display method and device and electronic equipment
CN113138705A (en) * 2021-03-16 2021-07-20 青岛海尔空调器有限总公司 Method, device and equipment for adjusting display mode of display interface

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105426021A (en) * 2015-12-21 2016-03-23 魅族科技(中国)有限公司 Method for displaying character and terminal
CN107491684A (en) * 2017-09-22 2017-12-19 广东巽元科技有限公司 A kind of screen control device and its control method based on recognition of face
CN109032345A (en) * 2018-07-04 2018-12-18 百度在线网络技术(北京)有限公司 Apparatus control method, device, equipment, server-side and storage medium
CN110851032A (en) * 2019-11-06 2020-02-28 北京字节跳动网络技术有限公司 Display style adjustment method and device for target device

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102045429B (en) * 2009-10-13 2015-01-21 华为终端有限公司 Method and equipment for adjusting displayed content
US20130002722A1 (en) * 2011-07-01 2013-01-03 Krimon Yuri I Adaptive text font and image adjustments in smart handheld devices for improved usability
CN103458115B (en) * 2013-08-22 2016-04-13 Tcl通讯(宁波)有限公司 The processing method of mobile terminal automatic capture system font size and mobile terminal
CN106126017A (en) * 2016-06-20 2016-11-16 北京小米移动软件有限公司 Intelligent identification Method, device and terminal unit
CN106201261A (en) * 2016-06-30 2016-12-07 捷开通讯(深圳)有限公司 A kind of mobile terminal and display picture adjusting method thereof
CN106529449A (en) * 2016-11-03 2017-03-22 英华达(上海)科技有限公司 Method for automatically adjusting the proportion of displayed image and its display apparatus
CN106778623A (en) * 2016-12-19 2017-05-31 珠海格力电器股份有限公司 A kind of terminal screen control method, device and electronic equipment
CN107968890A (en) * 2017-12-21 2018-04-27 广东欧珀移动通信有限公司 theme setting method, device, terminal device and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105426021A (en) * 2015-12-21 2016-03-23 魅族科技(中国)有限公司 Method for displaying character and terminal
CN107491684A (en) * 2017-09-22 2017-12-19 广东巽元科技有限公司 A kind of screen control device and its control method based on recognition of face
CN109032345A (en) * 2018-07-04 2018-12-18 百度在线网络技术(北京)有限公司 Apparatus control method, device, equipment, server-side and storage medium
CN110851032A (en) * 2019-11-06 2020-02-28 北京字节跳动网络技术有限公司 Display style adjustment method and device for target device

Also Published As

Publication number Publication date
CN110851032A (en) 2020-02-28

Similar Documents

Publication Publication Date Title
US11455830B2 (en) Face recognition method and apparatus, electronic device, and storage medium
CN110162670B (en) Method and device for generating expression package
WO2021088790A1 (en) Display style adjustment method and apparatus for target device
CN109993150B (en) Method and device for identifying age
CN111767371B (en) Intelligent question-answering method, device, equipment and medium
CN112153460B (en) Video dubbing method and device, electronic equipment and storage medium
WO2021114979A1 (en) Video page display method and apparatus, electronic device and computer-readable medium
CN111459364B (en) Icon updating method and device and electronic equipment
CN111897950A (en) Method and apparatus for generating information
CN110008926B (en) Method and device for identifying age
CN110046571B (en) Method and device for identifying age
CN111126159A (en) Method, apparatus, electronic device, and medium for tracking pedestrian in real time
CN111461965B (en) Picture processing method and device, electronic equipment and computer readable medium
WO2020221115A1 (en) Method and device for displaying information
CN112990176A (en) Writing quality evaluation method and device and electronic equipment
CN113628097A (en) Image special effect configuration method, image recognition method, image special effect configuration device and electronic equipment
CN112309389A (en) Information interaction method and device
CN110765304A (en) Image processing method, image processing device, electronic equipment and computer readable medium
CN114550728B (en) Method, device and electronic equipment for marking speaker
CN113033552B (en) Text recognition method and device and electronic equipment
CN111062995B (en) Method, apparatus, electronic device and computer readable medium for generating face image
CN113409208A (en) Image processing method, device, equipment and storage medium
CN112309387A (en) Method and apparatus for processing information
CN112418233A (en) Image processing method, image processing device, readable medium and electronic equipment
CN111652432A (en) Method and device for determining user attribute information, electronic equipment and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20884955

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20884955

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 05.09.2022)

122 Ep: pct application non-entry in european phase

Ref document number: 20884955

Country of ref document: EP

Kind code of ref document: A1