Classifications

• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
  • G09G5/10—Intensity circuits
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
  • G06K19/00—Record carriers for use with machines and with at least a part designed to carry digital markings
  • G06K19/06—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
  • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
  • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
  • G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
  • G06Q20/00—Payment architectures, schemes or protocols
  • G06Q20/30—Payment architectures, schemes or protocols characterised by the use of specific devices or networks
  • G06Q20/32—Payment architectures, schemes or protocols characterised by the use of specific devices or networks using wireless devices
  • G06Q20/327—Short range or proximity payments by means of M-devices
  • G06Q20/3274—Short range or proximity payments by means of M-devices using a pictured code, e.g. barcode or QR-code, being displayed on the M-device
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
  • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
  • G09G5/37—Details of the operation on graphic patterns
  • G09G5/373—Details of the operation on graphic patterns for modifying the size of the graphic pattern

Definitions

• This disclosure relates to a program, a display control device, and a display control method.
• Patent Document 1 describes an information code reading system in which, when a display change instruction is obtained from a payment device by decoding an instruction code captured by an imaging unit in a mobile terminal, the display unit is controlled by a control unit to change the display state of the payment code in accordance with the display change instruction.
• Patent Document 1 in order for the mobile terminal to change the display state of the payment code, the reading device must issue a display change instruction, which does not sufficiently improve user convenience.
• This point is not limited to payment codes as in Patent Document 1.
• Conventional technology has not been able to sufficiently improve user convenience when the code screen is displayed.
• One of the purposes of this disclosure is to increase user convenience.
• the program disclosed herein causes the display control device to function as a display control unit that displays a code screen including a code on the display unit of the display control device, and as a posture information acquisition unit that acquires posture information related to the posture of the display control device when the code screen is displayed on the display unit, and the display control unit changes the display of the code screen based on the posture information.
• First embodiment A first embodiment, which is an example of an embodiment of a program, a display control device, and a display control method according to the present disclosure, will be described.
• a display control system including a display control device and another device will be exemplified.
• the sensor unit 16 includes at least one sensor.
• the sensor unit 16 includes a sensor used to detect the attitude of the display control device 10.
• the sensor used to detect the attitude of the display control device 10 may be a known sensor.
• the sensor unit 16 may include an acceleration sensor, a gyro sensor, a geomagnetic sensor, an angle sensor, or a combination of these.
• the sensor unit 16 may also include a sensor called a motion sensor that includes multiple of these sensors.
• the sensor unit 16 may also include other sensors that are not used to detect the attitude of the display control device 10.
• the imaging unit 17 includes at least one camera.
• the imaging unit 17 may include at least one of an in-camera and an out-camera.
• the in-camera is a camera arranged on the same surface of the display control device 10 as the surface on which the display unit 15 is arranged.
• the out-camera is a camera arranged on the opposite surface of the display control device 10 to the surface on which the display unit 15 is arranged.
• the first embodiment gives an example in which the imaging unit 17 has a different configuration from the sensor unit 16, but because the optical element included in the imaging unit 17 is also a type of sensor, the imaging unit 17 may be part of the sensor unit 16.
• the reading device 20 is a device that reads the code described below.
• the reading device 20 is a POS terminal, a self-checkout terminal, a smartphone, a mobile phone not classified as a smartphone, a tablet, a wearable terminal, a handheld terminal, an ATM, an automatic ticket gate, or a personal computer.
• the reading device 20 includes a control unit 21, a memory unit 22, a communication unit 23, an operation unit 24, a display unit 25, and a reading unit 26.
• the hardware configurations of the control unit 21, the memory unit 22, the communication unit 23, the operation unit 24, and the display unit 25 may be the same as those of the control unit 11, the memory unit 12, the communication unit 13, the operation unit 14, and the display unit 15, respectively.
• the reading unit 26 includes at least one code reader.
• the reading unit 26 may include a known code reader.
• the reading unit 26 may include a barcode reader, a two-dimensional code reader, a camera, a scanner, or a combination of these.
• the first embodiment illustrates an example in which the reading unit 26 is included in the reading device 20, but the reading unit 26 may also be connected externally to the reading device 20.
• the reading device 20 may include only the reading unit 26, without including the control unit 21, memory unit 22, communication unit 23, operation unit 24, and display unit 25.
• the server 30 is a server computer.
• the server 30 includes a control unit 31, a memory unit 32, and a communication unit 33.
• the hardware configurations of the control unit 31, the memory unit 32, and the communication unit 33 may be similar to those of the control unit 11, the memory unit 12, and the communication unit 13, respectively.
• the display control system 1 only needs to include at least one computer.
• the computers included in the display control system 1 are not limited to the example in FIG. 1.
• the display control system 1 may include only the display control device 10 and the reading device 20.
• the server 30 exists outside the display control system 1.
• the display control system 1 may only include the display control device 10 and the server 30.
• the reading device 20 exists outside the display control system 1.
• the display control system 1 may only include the display control device 10.
• the reading device 20 and the server 30 exist outside the display control system 1.
• the display control system 1 may include the display control device 10 and another computer not shown in FIG. 1.
• the display control system 1 is used for a payment service.
• a payment service is a service that provides electronic payments (cashless payments) to users.
• the display control system 1 may be used for services other than payment services. Services in which the display control system 1 is used are not limited to payment services.
• the display control system 1 may be used for services in which codes are used in some form.
• the display control system 1 may be used for an electronic ticket service, a coupon distribution service, an entrance/exit management service, a check-in service, a communication service, a financial service, a travel reservation service, an e-commerce service, a public transportation service, an administrative service, or other services.
• the display control device 10 corresponds to a smartphone of a user who uses a payment service.
• a payment app which is an application for the payment service, is pre-installed on the display control device 10.
• the payment app is an example of a program related to the present disclosure.
• the display control device 10 controls the display of various screens in the payment service based on the payment app.
• the display control device 10 may also control the display of various screens based on another program, such as a browser (for example, a script embedded in HTML, an application other than the payment service, or an operating system), rather than the payment app.
• a browser for example, a script embedded in HTML, an application other than the payment service, or an operating system
• FIG. 2 shows an example of how a user uses a payment service.
• the display control device 10 communicates with the server 30 and executes a login process for the user to log in to the payment service. If the login process is successful, the display control device 10 communicates with the server 30 and displays on the display unit 15 a code screen SC that includes a code C generated based on information required for payment (for example, a code ID that can temporarily identify the user).
• a code screen SC that includes a code C generated based on information required for payment (for example, a code ID that can temporarily identify the user).
• code C includes both a barcode and a two-dimensional code, but code C may also include only a barcode, or only a two-dimensional code.
• the code screen SC may include both a barcode and a two-dimensional code, or only a barcode or a two-dimensional code.
• Code C may be a known code. If a code that is not classified as a barcode or a two-dimensional code (for example, a code whose appearance changes over time) is used, code C may also be another code.
• code C can be used for any purpose.
• the example in Figure 2 shows a case in which code C is used for payment based on a payment source designated by the user, but code C may also be used for other purposes.
• code C may be used as a points card, for charging electronic money, for identifying coupons, for a user to check in at a specified location, or as identification such as a membership card. If the display control device 10 is used for a service other than a payment service, code C may be used for any purpose in that other service.
• Figure 3 is a diagram showing an example of the change in the attitude of the display control device 10 when reading the code C. Details of the code screen SC are omitted from Figure 3.
• the first embodiment takes as an example a case where a user uses a payment service to pay for goods or services at a store that is a member of the payment service.
• the user is located to the left of the display control device 10.
• a store clerk is located to the right of the display control device 10.
• the user holds the display control device 10 in an attitude such that the display unit 15 of the display control device 10 faces the user.
• the user launches the payment app and confirms that the code screen SC is displayed on the display unit 15.
• the user when the user confirms that the code screen SC is displayed on the display unit 15, the user changes the orientation of the display control device 10 so that the display unit 15 of the display control device 10 faces the store clerk, as shown in the lower part of Figure 3, and presents the code screen SC to the store clerk.
• the store clerk then uses the reading unit 26 to read the code C on the code screen SC displayed on the display unit 15 facing towards them.
• the reading device 20 communicates with the server 30 and executes the payment.
• the payment process using the code C may be similar to that of known payment services.
• the display control device 10 dynamically changes the size of the code C based on its own posture.
• Figure 4 is a diagram showing an example of a code screen SC in which the size of the code C is dynamically changed based on the orientation of the display control device 10.
• the code screen SC on the left side of Figure 4 is an example of a code screen SC when the display control device 10 is in the orientation shown in the upper part of Figure 3.
• the display control device 10 displays the code C so that a certain amount of white space is left, rather than displaying the code C to the full width of the display unit 15. This improves visibility for the user. For example, it becomes easier for the user to check not only the code C, but also other parts of the code screen SC.
• the code screen SC on the right side of Figure 4 is an example of the code screen SC when the display control device 10 is in the lower position of Figure 3.
• the display control device 10 changes the size of the code C so that the code C is displayed across the entire width of the display unit 15.
• the barcode within the code C fills the entire width of the display unit 15, but the two-dimensional code within the code C may also fill the entire width of the display unit 15.
• the user's visibility is slightly reduced, but since this is the stage where the user is about to present the code C, the readability of the code C is prioritized. Because the code C is displayed large, it is easier for the reading unit 26 to read the code C.
• the display control device 10 of the first embodiment controls the display of the code screen SC so that the size of the code C changes based on its own posture. For example, when the display control device 10 is in a posture where the display unit 15 is facing the user, the display control device 10 does not display the code C as large, thereby improving the visibility of the code screen SC. When the display control device 10 is in a posture where the user is presenting the code C, the display control device 10 enlarges the code C in preparation for reading. In this way, the display control device 10 can improve user convenience. Details of the display control system 1 of the first embodiment will be described below.
• FIG. 5 is a diagram illustrating an example of functions realized in the first embodiment.
• the display control device 10 includes a data storage unit 100, a posture information acquisition unit 101, and a display control unit 102.
• the data storage unit 100 is realized by the storage unit 12.
• the posture information acquisition unit 101 and the display control unit 102 are each realized by the control unit 11.
• the data storage unit 100 stores data necessary for displaying the code screen SC.
• the data storage unit 100 stores a payment app.
• the payment app causes the display control device 10 to function as the posture information acquisition unit 101 and the display control unit 102.
• the data storage unit 100 stores the other program.
• the other program causes the display control device 10 to function as the posture information acquisition unit 101 and the display control unit 102.
• the attitude of the display control device 10 can also be said to be the attitude of the display unit 15. If the display control device 10 is not integrated with the display unit 15 (for example, if the main body of the display control device 10 and the display unit 15 are connected by a cable), the attitude of the display control device 10 is the attitude of the display unit 15, which is one of the components of the display control device 10.
• the orientation information acquisition unit 101 acquires, as orientation information, tilt information related to the tilt of the display control device 10.
• the tilt of the display control device 10 is the difference between a reference axis (e.g., vertical or horizontal direction) or plane (e.g., vertical or horizontal plane) in space and a reference axis (e.g., longitudinal or lateral direction) or plane (e.g., the surface of the display unit 15) in the display control device 10.
• the tilt of the display control device 10 is the angle between these.
• the orientation information acquisition unit 101 may acquire orientation information regarding the orientation of the display control device 10 as the orientation information.
• the orientation of the display control device 10 is the direction in which the surface of the display control device 10 is facing (for example, the direction of a perpendicular line with an arbitrary position on the surface as its foot).
• the direction of a perpendicular line with an arbitrary position on the surface of the display unit 15 (for example, the position of the center of the display unit 15) as its foot is the orientation of the display control device 10.
• the orientation information acquisition unit 101 may acquire both tilt information and orientation information as the orientation information.
• the method for acquiring the orientation information may be a publicly known method.
• the orientation information acquisition unit 101 may acquire the orientation information based on a publicly known algorithm.
• the method for acquiring the tilt information may be a publicly known method.
• the orientation information acquisition unit 101 may acquire the tilt information based on a publicly known algorithm. For example, the orientation information acquisition unit 101 acquires the orientation information based on a detection signal from the sensor unit 16.
• the orientation information acquisition unit 101 may calculate the gravity vector of the display control device 10 based on an acceleration sensor included in the sensor unit 16, and acquire the orientation information based on this gravity vector.
• the orientation information acquisition unit 101 may calculate the angular velocity of the display control device 10 based on a gyro sensor included in the sensor unit 16, and acquire the orientation information based on this angular velocity.
• the orientation information acquisition unit 101 may acquire the orientation information by integrating information obtained from multiple sensors included in the sensor unit 16.
• the posture information acquisition unit 101 may acquire posture information at each of a plurality of points in time.
• the posture information acquisition unit 101 acquires the latest posture information at predetermined time intervals based on the latest detection signal from the sensor unit 16. In other words, the posture information acquisition unit 101 periodically acquires the latest posture information.
• the posture information acquisition unit 101 may record a history of posture information in the data storage unit 100.
• the posture information acquisition unit 101 may not periodically acquire the latest posture information, but may acquire it irregularly.
• the posture information acquisition unit 101 may acquire posture information at least when the code screen SC is displayed.
• the posture information acquisition unit 101 may also acquire posture information when the code screen SC is not displayed.
• the attitude information does not have to indicate all of the roll angle ⁇ X, pitch angle ⁇ Y, and yaw angle ⁇ Z, and may indicate only one or two of the roll angle ⁇ X, pitch angle ⁇ Y, and yaw angle ⁇ Z.
• the attitude information acquisition unit 101 may calculate only the roll angle ⁇ X and pitch angle ⁇ Y, and not calculate the yaw angle ⁇ Z.
• the attitude information acquisition unit 101 does not acquire tilt information as attitude information, and acquires only orientation information as attitude information, it may calculate only the yaw angle ⁇ Z, and not calculate at least one of the roll angle ⁇ X and pitch angle ⁇ Y.
• the attitude information may be publicly known information.
• the attitude information is not limited to Euler angles.
• the attitude information may be expressed in a quaternion in which the attitude is expressed by four real numbers, a rotation matrix in which the attitude is expressed by a 3x3 matrix, an axis-angle representation in which the rotation angle is expressed by a unit vector in three-dimensional space, a direction cosine matrix in which the rotation of a coordinate system in three-dimensional space is expressed, a direction angle in which the attitude is expressed by the angle between two vectors, or in another format.
• the attitude information acquisition unit 101 may acquire the attitude information using an acquisition method according to the format used as the attitude information.
• the display control unit 102 displays a code screen SC including the code C on the display unit 15 of the display control device 10. For example, when the payment app is launched, the display control device 10 communicates with the server 30 and acquires information (e.g., a code ID) necessary for displaying the code C. The information necessary for displaying the code C is information to be coded. The display control unit 102 generates the code C based on the information necessary for displaying the code C. If the information necessary for displaying the code C is stored in the data storage unit 100 in advance, the display control device 10 does not particularly communicate with the server 30, and the display control unit 102 generates the code C.
• information e.g., a code ID
• the method for generating code C may be a method defined by a publicly known standard.
• the type of code C may also be a publicly known type.
• the display control unit 102 executes a series of processes required to display the code screen SC by executing a payment app. This series of processes is indicated in the program code of the payment app. If a program other than the payment app is used, this series of processes is indicated in the program code of the other program.
• the display control unit 102 changes the display of the code screen SC based on the posture information. Changing the display of the code screen SC by the display control unit 102 means that the display control unit 102 changes the display of at least a portion of the code screen SC. In other words, the display control unit 102 performing control to change content that is visually recognizable to humans corresponds to the display control unit 102 changing the display of the code screen SC.
• changing the size, brightness, color, pattern, blinking effects, display position, orientation, image type, or a combination of these of the components of the code screen SC constitutes a change in display.
• the components of the code screen SC are objects displayed on the code screen SC.
• the components of the code screen SC may be code C, images other than code C, text, user interface parts, or other elements.
• changing the brightness of the code screen SC itself also constitutes a change in display.
• the display control unit 102 changes the display of the chord screen SC by changing the size of the chord C on the chord screen SC, but the display control unit 102 may also change the display of the chord screen SC by changing the brightness of the chord screen SC, the color of the chord C, the background color of the chord screen SC, the pattern of the chord screen SC, the effect of the chord C, the orientation of the chord C, the type of chord C, or a combination of these.
• the display control unit 102 determines whether the posture indicated by the posture information is a predetermined posture, and changes the display of the code screen SC based on the result of this determination.
• the predetermined posture is a posture that serves as a reference for whether or not the display of the code screen SC is changed. If the display control unit 102 determines that the posture indicated by the posture information is not a predetermined posture, it does not change the display of the code screen SC, and if it determines that the posture indicated by the posture information is a predetermined posture, it changes the display of the code screen SC. In other words, the display control unit 102 changes the display of the code screen SC when the posture indicated by the posture information is determined to be a predetermined posture.
• the display control unit 102 displays the code screen SC in a first display method.
• the display control unit 102 determines whether the display control device 10 has changed from the first posture to a second posture based on the posture information. When it is determined that the display control device 10 has changed from the first posture to the second posture, the display control unit 102 displays the code screen SC in the second display method. When it is determined that the display control device 10 has returned from the second posture to the first posture, the display control unit 102 may return the code screen SC to the first display method.
• first and second orientations may be defined in the payment app, or may be defined in setting data referenced by the payment app.
• the setting data is assumed to be stored in the data storage unit 100.
• the display control unit 102 determines whether the display control device 10 is in the first orientation or the second orientation based on at least one of the payment app and the setting data.
• the first and second display methods may be defined in the payment app, or may be defined in setting data referenced by the payment app.
• the display control unit 102 may control the display method of the code screen SC based on at least one of the payment app and the setting data.
• the orientation at the top of Figure 3 corresponds to the first orientation.
• the orientation at the bottom of Figure 3 corresponds to the second orientation.
• the display control unit 102 changes the display of the code screen SC based on the tilt information.
• the display control unit 102 calculates the angle ⁇ XY between the horizontal plane (X-Y plane) and the longitudinal direction of the display control device 10 based on the roll angle ⁇ X and pitch angle ⁇ Y indicated by the tilt information.
• the angle ⁇ XY is an example of tilt. Therefore, any reference to the angle ⁇ XY can be read as tilt. Any tilt other than the angle ⁇ XY may be used.
• the tilt may be represented in a form other than an angle (for example, a vector or coordinates).
• the display control unit 102 determines that the display control device 10 is in the first orientation. If the display control device 10 is determined to be in the first orientation, the display control unit 102 causes the display unit 15 to display a code screen SC including a code C of a first size, as shown on the left side of FIG. 4. If the angle ⁇ XY is negative, the display control unit 102 determines that the display control device 10 is in the second orientation. If the display control device 10 is determined to be in the second orientation, the display control unit 102 causes the display unit 15 to display a code screen SC including a code C of a second size that is larger than the first size, as shown on the right side of FIG. 4.
• the threshold value for determining the first and second attitudes may be any value. In the above example, the threshold value is 0, but the threshold value may be a positive or negative value.
• the threshold value is assumed to be stored in the data storage unit 100. For example, if the threshold value is -10 degrees, the display control unit 102 may determine that the display control device 10 has assumed the second attitude when the angle ⁇ XY in FIG. 6 becomes less than -10 degrees. The threshold value is assumed to be stored in the data storage unit 100.
• the method by which the display control unit 102 changes the size of the code C may be a known method.
• the display control unit 102 may change the size of the code C by executing image processing to stretch the image. If a parameter indicating the size of the code C is stored in the data storage unit 100, the display control unit 102 may change the size of the code C by changing the parameter.
• the extent to which the display control unit 102 makes the code C larger is assumed to be indicated in the payment app or the setting data described above. If multiple sizes of code C are prepared in advance as separate images, the display control unit 102 may change the size of the code C by switching the code C to be displayed. Furthermore, the display control unit 102 may make the code C smaller, rather than larger, based on posture information.
• the reading device 20 includes a data storage unit 200 and a processing execution unit 201.
• the data storage unit 200 is realized by the storage unit 22.
• the processing execution unit 201 is realized by the control unit 21.
• the data storage unit 200 stores data necessary for reading the code C.
• the data storage unit 200 stores a store app, which is a program for stores that are members of a payment service.
• the store app causes the reading device 20 to function as the processing execution unit 201.
• the data storage unit 200 stores the other program.
• the other program causes the reading device 20 to function as the processing execution unit 201.
• the processing execution unit 201 executes a predetermined process when the code C is read.
• the predetermined process is a process that is executed based on information extracted from the code C.
• the display control system 1 is used for a payment service, so the predetermined process is a process for payment.
• the processing execution unit 201 executes the predetermined process by extracting a code ID from the code C and sending a payment request including the code ID to the server 30.
• the payment request is a request for payment.
• the payment request may be in the same format as data adopted in known payment services.
• the payment request may include the payment amount, the store ID, or other information.
• the predetermined process is not limited to a process for payment.
• the predetermined process may be a process that corresponds to the service for which the display control system 1 is used. For example, if the display control system 1 is used for an electronic ticket service, the process execution unit 201 obtains, from code C, an electronic ticket ID that allows the user to enter a facility with an electronic ticket. The process execution unit 201 may execute the predetermined process by sending an authentication request including the electronic ticket ID to the server 30. The authentication request is a request to confirm the validity of the electronic ticket ID. When the process execution unit 201 receives information indicating the authentication result of the electronic ticket ID from the server 30, it causes the authentication result to be displayed on the display unit 25.
• the processing execution unit 201 obtains the coupon ID of the coupon held by the user from the code C.
• the processing execution unit 201 may execute predetermined processing by sending a usage request including the coupon ID to the server 30.
• the usage request is a request to use the coupon.
• the processing execution unit 201 receives information from the server 30 indicating that coupon usage is permitted, it applies the coupon to the product or service for which the user is paying. If the display control system 1 is used for another service, the processing execution unit 201 may execute predetermined processing according to the other service.
• the server 30 includes a data storage unit 300 and a process execution unit 301.
• the data storage unit 300 is realized by the storage unit 32.
• the process execution unit 301 is realized by the control unit 31.
• the data storage unit 300 stores data necessary for a predetermined process.
• the data storage unit 300 stores a user database that stores various information about users who use payment services.
• the user database stores user IDs, passwords, code IDs, payment method information about the payment methods used by the user in the payment service, and usage history information about the user's usage history of the payment service.
• the server 30 issues a code ID based on predetermined issuance rules so that the code ID does not overlap with other code IDs.
• the data storage unit 300 only needs to store data necessary for the other process.
• the data storage unit 300 may store data for electronic tickets or coupons.
• the processing execution unit 301 executes a predetermined process when the code C is read.
• the predetermined process executed by the processing execution unit 201 is a process on the side of the reading device 20, whereas the process executed by the processing execution unit 301 is a process on the side of the server 30.
• the process may otherwise be the same as the process described for the processing execution unit 201.
• the processing execution unit 301 upon receiving a payment request from the reading device 20, the processing execution unit 301 executes the predetermined process by executing payment based on information such as a code ID included in the payment request.
• the processing execution unit 301 may execute authentication in an electronic ticket service, permission to use a coupon in a coupon distribution service, or other processing as the predetermined process.
• the processing execution unit 301 may execute processing according to the service for which the display control system 1 is used as the predetermined process.
• Fig. 7 is a diagram showing an example of processing executed in the first embodiment.
• Fig. 7 shows processing of the display control device 10 among the processing executed in the display control system 1.
• the processing of Fig. 7 is executed by the control unit 11 executing a program (e.g., a payment application) stored in the storage unit 12.
• a program e.g., a payment application
• Each step of Fig. 7 is an example of a step included in the display control method according to the present disclosure.
• the display control device 10 acquires posture information based on the detection signal from the sensor unit 16 (S14). Details of the processing of S14 are as explained above in relation to the processing content of the posture information acquisition unit 101.
• the display control unit 102 changes the display of the code screen SC based on the posture information (S15), and this processing ends. Details of the processing of S15 are as explained above in relation to the processing content of the display control unit 102.
• the display control device 10 of the first embodiment acquires posture information when a code screen SC is displayed on the display unit 15.
• the display control device 10 changes the display of the code screen SC based on the posture information. This allows the display control device 10 to flexibly display the code screen SC on the display unit 15 in accordance with the posture information, thereby improving user convenience. For example, when the display control device 10 is in a posture that does not require preparation for reading the code C, the display control device 10 can prioritize user visibility by not displaying the code C as large. When the display control device 10 is in a posture that requires preparation for reading the code C, the display control device 10 enlarges the code C to make it easier to read, thereby preventing the code C from taking a long time to read. Because the user does not need to perform a special operation (e.g., tapping the code screen SC) to change the display of the code screen SC, the display control device 10 can reduce the operational burden on the user.
• a special operation e.g., tapping the code screen SC
• the display control device 10 changes the display of the code screen SC based on the angle (e.g., 30 degrees from horizontal) at which the head of the display control device 10 (the top of the code screen SC) is lowered, thereby changing the display of the code screen SC when code C is about to be read, thereby improving user convenience.
• the display control device 10 changes the display of the code screen SC based on that orientation, thereby changing the display of the code screen SC when code C is about to be read, thereby improving user convenience.
• the display control device 10 changes the display of the code screen SC by changing the size of the code C on the code screen SC. This allows the display control device 10 to display the code C at a flexible size according to the posture information. For example, when the posture does not require preparation for reading the code C, the code C is not displayed so large, and user visibility can be prioritized. When the posture requires preparation for reading the code C, the display control device 10 enlarges the code C to make it easier to read, thereby preventing it from taking a long time to read the code C. Because the user does not need to perform any special operation (for example, tapping the code screen SC) to change the size of the code C, the display control device 10 can reduce the operational burden on the user.
• any special operation for example, tapping the code screen SC
• the sensor unit 16 includes a sensor capable of detecting light.
• the sensor unit 16 includes at least one of an ambient light sensor and an optical sensor other than an ambient light sensor (e.g., a photodiode or phototransistor).
• the sensor unit 16 may not be an optical sensor capable of detecting the brightness of light, but may be an optical sensor capable of detecting the presence or absence of light above a certain brightness.
• the sensor unit 16 of the second embodiment does not need to include a sensor for detecting attitude (e.g., an acceleration sensor or gyro sensor) described in the first embodiment.
• the display control device 10 of the second embodiment therefore improves user convenience by changing the display of the code screen SC depending on the light incident on the display control device 10 so that reading of the code C is less likely to fail. Details of the display control system 1 of the second embodiment will be described below.
• FIG. 8 is a diagram showing an example of functions realized in the second embodiment.
• the functions of the reading device 20 and the server 30 are the same as those in the first embodiment.
• Some functions of the display control device 10 are the same as those in the first embodiment.
• functions of the display control device 10 that are different from those in the first embodiment will be described.
• the display control device 10 includes a data storage unit 100, a display control unit 102, and an optical information acquisition unit 103.
• the data storage unit 100 may be the same as that in the first embodiment.
• the display control device 10 may not include the orientation information acquisition unit 101 or at least some of the functions of the display control unit 102 described in the first embodiment.
• the display control unit 102 of the second embodiment may not include a function for changing the display of the code screen SC based on orientation information.
• the display control device 10 may not even acquire orientation information.
• a configuration in which the display control device 10 does not include a function for changing the display of the code screen SC based on orientation information is also within the scope of the present disclosure.
• the display control device 10 of the second embodiment may be a device whose orientation does not change in principle.
• the display control device 10 may be a device whose orientation is fixed.
• the light information acquisition unit 103 acquires light information related to light to the display control device 10 when the code screen SC is displayed on the display unit 15.
• the light to the display control device 10 is light in the surroundings of the display control device 10.
• the light to the display control device 10 may include not only direct light to the display control device 10 but also light reflected by other objects such as walls.
• the light to the display control device 10 may include not only natural light but also light output from a light.
• the light to the display control device 10 may be light in the environment surrounding the display control device 10.
• the light information acquisition unit 103 may acquire light information before the code screen SC is displayed on the display unit 15.
• the light information indicates the degree of brightness of light.
• the degree of brightness of light can also be referred to as light intensity.
• the degree of brightness of light is also sometimes called luminance, luminous intensity, or brightness.
• the unit used to indicate the degree of brightness of light may be a known unit.
• the degree of brightness of light may be expressed in lux, candela, nits, or other units.
• the degree of brightness of light may not be expressed in common units, but may be expressed in unique units such as dark, normal, or bright.
• an example is given in which the degree of brightness of light is expressed numerically, but the degree of brightness of light may also be expressed in other forms, such as letters or symbols.
• the light information may not be the degree of brightness of the light, but may simply indicate whether the light is brighter than a reference value.
• the light information may not be information that can express the degree of brightness of the light in three or more levels, but may be binary information that indicates whether the light is brighter than a reference value.
• the light information is binary, it can also be said to be information that indicates whether light that is brighter than a reference value has been detected.
• the light information acquisition unit 103 acquires light information based on the detection signal of the sensor unit 16.
• the sensor unit 16 includes an ambient light sensor
• the light information acquisition unit 103 detects the degree of brightness of light in the environment surrounding the display control device 10 based on the ambient light sensor, and acquires light information that indicates the degree of brightness of the light.
• the light information acquisition unit 103 may acquire light information at each of a plurality of points in time.
• the light information acquisition unit 103 acquires the latest light information based on the latest detection signal from the sensor unit 16 at predetermined time intervals. In other words, the light information acquisition unit 103 periodically acquires the latest light information.
• the light information acquisition unit 103 may record the history of light information in the data storage unit 100.
• the light information acquisition unit 103 may not periodically acquire the latest light information, but may acquire it irregularly.
• the light information acquisition unit 103 may acquire light information at least when the code screen SC is displayed.
• the light information acquisition unit 103 may also acquire light information when the code screen SC is not displayed.
• the display control unit 102 changes the display of the code screen SC based on the light information.
• the display control unit 102 changes the display of the code screen SC by changing the size of the code C on the code screen SC.
• the display control unit 102 may change the display of the code screen SC by changing the brightness of the code screen SC, the color of the code C, the background color of the code screen SC, the pattern of the code screen SC, the effect of the code C, the orientation of the code C, the type of code C, or a combination thereof.
• the display control unit 102 determines whether the light indicated by the light information is a predetermined light, and changes the display of the code screen SC based on the result of this determination.
• the predetermined light is light that serves as the criterion for whether the display of the code screen SC is changed. If the display control unit 102 determines that the light indicated by the light information is not a predetermined light, it does not change the display of the code screen SC, and if it determines that the light indicated by the light information is a predetermined light, it changes the display of the code screen SC. In other words, the display control unit 102 changes the display of the code screen SC when the light indicated by the light information is determined to be a predetermined light, as a condition (trigger).
• the display control unit 102 displays the code screen SC in the first display method.
• the display control unit 102 determines whether the display control device 10 has changed from the first light to the second light based on the light information. When it is determined that the display control device 10 has changed from the first light to the second light, the display control unit 102 displays the code screen SC in the second display method. When it is determined that the display control device 10 has returned from the second light to the first light, the display control unit 102 may return the code screen SC to the first display method.
• the types of light that the first light and second light are may be defined in the payment app, or may be defined in setting data referenced by the payment app.
• the setting data is assumed to be stored in the data storage unit 100.
• the display control unit 102 determines whether the display control device 10 is using the first light or the second light based on at least one of the payment app and the setting data.
• the types of display methods that the first and second display methods are may be defined in the payment app, or may be defined in setting data referenced by the payment app.
• the display control unit 102 may control the display method of the code screen SC based on at least one of the payment app and the setting data.
• the light indicated by the light information may become darker due to the shadow of the reading unit 26, so the display control unit 102 changes the display of the code screen SC when it detects such a change in light.
• the display control unit 102 when the light information indicates the first light, the display control unit 102 causes the display unit 15 to display the code screen SC including the code C of the first size, as shown on the left side of FIG. 4.
• the display control unit 102 causes the display unit 15 to display a code screen SC including a code C of a second size that is larger than the first size, as shown on the right side of Figure 4.
• the display control unit 102 changes the size of the code C to a second size larger than the first size, as shown on the right side of FIG. 4. Note that the amount of change may refer to the increase in the brightness of the light.
• the display control unit 102 may not change the display of the code screen SC, and may change the display of the code screen SC if it determines that light is no longer detected.
• the display control unit 102 may change the display of the code screen SC if the state changes from one in which it is determined that light is detected to one in which it is determined that light is no longer detected.
• Fig. 9 is a diagram showing an example of processing executed in the second embodiment.
• Fig. 9 shows processing of the display control device 10 among the processing executed in the display control system 1.
• the processing of Fig. 9 is executed by the control unit 11 executing a program (e.g., a payment application) stored in the storage unit 12.
• a program e.g., a payment application
• Each step of Fig. 9 is an example of a step included in the display control method according to the present disclosure.
• S20 to S23 are the same as S10 to S13, respectively.
• the display control device 10 acquires light information based on the detection signal from the sensor unit 16 (S24). Details of the processing of S24 are as explained above in relation to the processing content of the light information acquisition unit 103.
• the display control unit 102 changes the display of the code screen SC based on the light information (S25), and this processing ends. Details of the processing of S25 are as explained above in relation to the processing content of the display control unit 102.
• the display control device 10 of the second embodiment acquires light information when a code screen SC is displayed on the display unit 15.
• the display control device 10 changes the display of the code screen SC based on the light information. This allows the display control device 10 to flexibly display the code screen SC on the display unit 15 in accordance with the light information, thereby improving user convenience. For example, when the light does not need to be prepared for reading the code C, the display control device 10 can prioritize user visibility by not displaying the code C as large. As shown in FIG. 3 , when a user holds up the code C, the shadow of the reading unit 26 obscures the area around the user's hand.
• the display control device 10 enlarges the code C to make it easier to read, thereby preventing the code C from taking a long time to read. Because the user does not need to perform a special operation (e.g., tapping the code screen SC) to change the display of the code screen SC, the display control device 10 can reduce the user's operational burden.
• a special operation e.g., tapping the code screen SC
• the display control device 10 also acquires light information at each of a plurality of points in time.
• the display control device 10 detects changes in light based on the light information at each of the plurality of points in time, and changes the display of the code screen SC based on the changes in light.
• This allows the display control device 10 to display a flexible code screen SC on the display unit 15 that responds to changes in light, thereby improving user convenience.
• the display control device 10 can prioritize user visibility by not displaying code C as large.
• the display control device 10 can increase the size of code C to make it easier to read, preventing it from taking a long time to read code C.
• the display control device 10 changes the display of the code screen SC by changing the size of the code C on the code screen SC. This allows the display control device 10 to display the code C at a flexible size according to the light information. For example, in the case of light that does not require preparation for reading the code C, the code C is not displayed so large, and user visibility can be prioritized. In the case of light that does require preparation for reading the code C, the display control device 10 enlarges the code C to make it easier to read, thereby preventing it from taking a long time to read the code C. Because the user does not need to perform a special operation (for example, tapping the code screen SC) to change the size of the code C, the display control device 10 can reduce the operational burden on the user.
• a special operation for example, tapping the code screen SC
• the display control unit 102 changes the display of the code screen SC based on posture information.
• the display control unit 102 changes the display of the code screen SC based on light information.
• the display control unit 102 determines, based on a predetermined determination method, whether or not the code C is about to be read by the reading unit 26, and changes the display of the code screen SC based on the result of that determination.
• the predetermined determination method is a method for determining whether or not the code C is about to be read by the reading unit 26.
• the predetermined determination method can also be said to be a method for determining whether or not to change the display of the code screen SC.
• the determination method based on posture information described in the first embodiment is an example of a predetermined determination method.
• the determination method based on light information described in the second embodiment is an example of a predetermined determination method.
• the predetermined determination method may be a determination method other than the determination methods described in each of the first and second embodiments.
• the specified determination method may be a determination method based on a captured image generated by the image capture unit 17.
• the display control device 10 acquires the captured image generated by the in-camera of the image capture unit 17.
• the display control unit 102 performs image analysis of the captured image and determines whether the reading unit 26 has approached.
• the approach of the reading unit 26 may be determined based on a known object detection algorithm.
• the object detection algorithm may be a template matching method, an edge detection method, a method using a machine learning model, or another method.
• the data storage unit 100 stores a template image in which the reading unit 26 is shown as a template.
• the display control unit 102 determines whether the code C is about to be read by the reading unit 26 based on the template image and a known algorithm in the template matching method, by determining whether the reading unit 26 is shown in the captured image.
• the reading unit 26 being shown in the captured image corresponds to the code C being about to be read by the reading unit 26.
• the absence of the reading unit 26 being shown in the captured image corresponds to the code C not being about to be read by the reading unit 26.
• the display control unit 102 can make a determination based on the other object detection algorithm.
• the specified determination method may be a determination method based on the object detection sensor or proximity sensor of the sensor unit 16.
• the object detection sensor or proximity sensor may be a known sensor.
• the display control device 10 acquires object information regarding the object detection result based on the detection signal of the object detection sensor or proximity sensor of the sensor unit 16.
• the object information indicates the detection result of the object detection sensor or proximity sensor of the sensor unit 16.
• the display control unit 102 may determine whether code C is about to be read by the reading unit 26 based on the object information. If the object information indicates the detection of an object or the proximity of an object, this corresponds to code C being about to be read by the reading unit 26. If the object information does not indicate the detection of an object or the proximity of an object, this corresponds to code C not being about to be read by the reading unit 26.
• the predetermined determination method is not limited to the above example.
• the predetermined determination method may be whether or not the user has checked in at a store, whether or not the display control device 10 has detected a beacon emitted by the reading device 20, a method in which the sensor unit 16 includes a depth sensor and uses the depth of an object detected by the depth sensor, or any other determination method.
• the display control unit 102 may make a determination using these other determination methods.
• the display control unit 102 does not change the display of the code screen SC when it is determined that code C is not about to be read by the reading unit 26, but changes the display of the code screen SC when it is determined that code C is about to be read by the reading unit 26. In other words, the display control unit 102 changes the display of the code screen SC when the condition (trigger) is that code C is about to be read by the reading unit 26.
• the process for changing the display of the code screen SC may be the same as in at least one of the first and second embodiments.
• the display control unit 102 repeatedly changes the display of the code screen SC while it is determined that the specified processing has not been executed.
• the display control unit 102 stops changing the display of the code screen SC when it is determined that the specified processing has been executed.
• the display control unit 102 repeatedly changes the display of the code screen SC until it is determined that the specified processing has been executed.
• the display control unit 102 stops changing the display of the code screen SC when the specified processing has been executed.
• the display control unit 102 may transition to a screen other than the code screen SC when the specified processing has been executed.
• Figure 19 is a diagram showing an example of a captured image.
• the in-camera of the capturing unit 17 captures an image in the direction perpendicular to the surface of the display control device 10 on which the display unit 15 is arranged, and generates captured image I.
• the in-camera may repeatedly generate captured image I based on a predetermined frame rate.
• the light information acquisition unit 103 determines whether or not there is a locally bright area based on the captured image I. If the light information acquisition unit 103 determines that there is a locally bright area in the captured image I, it acquires color information indicating the color of the image.
• the light information acquisition unit 103 may determine whether a color that is the same as or similar to the color of light emitted by the reading unit 26 is locally shown in the captured image I.
• a color that is similar to the color of light emitted by the reading unit 26 is a color whose difference from the pixel value of the light emitted by the reading unit 26 is less than a threshold value.
• the light information acquisition unit 103 acquires light information indicating that a specific light color is shown in the captured image I. In the example of FIG.
• the light information acquisition unit 103 acquires light information indicating that red light is shown in the captured image I.
• the light information acquisition unit 103 acquires light information indicating that white light is shown in the captured image I.
• the display control device 10 of variant 2-6 can prevent a decrease in the visibility of the code on the code screen SC.
• the display control device 10 can prevent the code C from extending beyond the code screen SC, making the code C unreadable.
• Modification 2-7 For example, in the second embodiment, as in Modification 1-7, the display control unit 102 may change the display of the code screen SC by changing the brightness of the code screen SC.
• Modification 2-7 takes as an example a case in which the display control unit 102 changes the size of the code C and also changes the brightness of the code screen SC as in the second embodiment, but the display control unit 102 may change the brightness of the code screen SC without changing the size of the code C. In other words, the display control unit 102 may change the display of the code screen SC by changing only the brightness of the code screen SC.
• the display control unit 102 may determine the degree of change in the display of the code screen SC based on the light information, and change the display of the code screen SC based on that degree.
• the meaning of the degree of change in the display is as explained in Modification 1-8.
• Modification 2-8 gives an example in which both of these correspond to the degree of change in the display, but only one of the size of the code C or the brightness of the code screen SC may correspond to the degree of change in the display.
• the display control device 10 determines the degree of change to the display of the code screen SC based on the light information, and changes the display of the code screen SC based on that degree. This allows the display control device 10 to display a more flexible code screen SC on the display unit 15 in accordance with the light information, thereby improving user convenience. For example, if the code screen SC is at maximum brightness in a darker-than-usual location, such as a movie theater or event venue, the code screen SC may stand out. However, in such cases, the display control device 10 can prevent the code screen SC from standing out by reducing the degree of brightness of the code screen SC.
• Modification 2-9 For example, in the second embodiment, similar to Modification 1-9, the display control unit 102 may repeatedly change the display of the code screen SC. Similarly to Modification 1-9, the display control unit 102 may switch the size of the code C or the brightness of the code screen SC. This process is different in that it is performed based on light information, but the process of repeatedly changing the display of the code screen SC is similar to Modification 1-9.
• the display control unit 102 may estimate the distance between the display control device 10 and the reading device 20 that reads the code C based on the light information, and change the display of the code screen SC based on this distance.
• the display control unit 102 in Variation 2-11 estimates the distance based on the brightness level indicated by the light information. For example, in a holding-type reading method, the brightness level increases as the display control device 10 gets closer to the reading unit 26, so the display control unit 102 estimates the distance so that the higher the brightness level, the closer the distance. In other words, the display control unit 102 estimates the distance so that the lower the brightness level, the farther the distance.
• the display control unit 102 may not change the display of the code screen SC when the distance is equal to or greater than a threshold, and may change the display of the code screen SC when the distance is less than the threshold.
• the display control device 10 is not limited to a device operated by a user.
• the display control device 10 may also be a device that is not operated by a user.
• the display control device 10 may also be a device in a store.
• the display control device 10 may cause the display unit 15 to display a code screen SC including a code C generated based on a store ID that can identify the store.
• the user's device such as a smartphone, may correspond to the reading device 20.
• the store clerk points the display control device 10, which is a store tablet or the like, toward the user and prompts the user to read the code C.
• the display control device 10, which is a store tablet or the like may change the display of the code screen SC based on at least one of posture information and light information.
• program according to the present disclosure can also be configured as follows.
• the posture information acquisition unit acquires the posture information at each of a plurality of time points; the display control unit detects a change in the posture based on the posture information at each of the plurality of time points, and changes the display of the code screen based on the change in posture.
• the display control unit detects a rotation of the display control device as a change in the attitude, and changes the display of the code screen based on the rotation of the display control device.
• the display control unit changes the display of the code screen by changing a display position of a lower content that is displayed below the code on the code screen without changing a display position of an upper content that is displayed above the code on the code screen.
• the display control unit changes the display of the code screen by changing the brightness of the code screen.
• the display control unit determines a degree of change to the display of the code screen based on the posture information, and changes the display of the code screen based on the degree.
• (1-12) the display control unit repeatedly changes the display of the code screen.
• the program according to the second embodiment can also be configured as follows.
• the light information acquisition unit acquires the light information at each of a plurality of time points; the display control unit detects a change in the light based on the light information at each of the plurality of time points, and changes the display of the code screen based on the change in the light.
• the reference degree setting unit sets the reference degree based on the light information acquired when the code screen is displayed on the display unit.
• the light information acquisition unit acquires color information relating to a color of the light as the light information; the display control unit changes the display of the code screen based on the color information.
• the light information acquisition unit acquires the color information based on an in-camera of the display control device.
• the display control unit changes the display of the code screen by changing the size of the code on the code screen.
• the program further causes the display control device to function as an execution determination unit that determines whether a predetermined process that is to be executed when the code is read by a reading device has been executed; the display control unit repeatedly changes the display of the code screen while it is determined that the predetermined process is not being executed.
• the display control unit estimates a distance between the display control device and a reading device that reads the code based on the light information, and changes the display of the code screen based on the distance.
• the program according to the third embodiment can also be configured as follows. (3-1) causing the display control device to function as a display control unit that displays a code screen including the code on a display unit of the display control device; the display control unit determines whether the code is about to be read by a reading device based on a predetermined determination method, and changes the display of the code screen based on the result of the determination. program. (3-2)
• the predetermined determination method is a determination method based on the posture information described in any one of (1-1) to (1-13), and has any one of the functions of (1-1) to (1-13).
• (3-3) The predetermined determination method is a determination method based on the optical information described in any one of (2-1) to (2-15), and has any one of the functions of (2-1) to (2-15).

Landscapes

• Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Business, Economics & Management (AREA)
• Computer Hardware Design (AREA)
• Strategic Management (AREA)
• Accounting & Taxation (AREA)
• Computer Networks & Wireless Communication (AREA)
• General Business, Economics & Management (AREA)
• Health & Medical Sciences (AREA)
• Electromagnetism (AREA)
• General Health & Medical Sciences (AREA)
• Toxicology (AREA)
• Artificial Intelligence (AREA)
• Computer Vision & Pattern Recognition (AREA)
• User Interface Of Digital Computer (AREA)

Priority Applications (4)

Applications Claiming Priority (1)

Publications (1)

Family

ID=97219138

Family Applications (1)

Country Status (4)

Citations (3)

Family Cites Families (1)

• 2024
  • 2024-03-27 CN CN202480028184.4A patent/CN121079691A/zh active Pending
  • 2024-03-27 WO PCT/JP2024/012376 patent/WO2025203352A1/ja active Pending
  • 2024-03-27 EP EP24875764.3A patent/EP4651021A1/en active Pending
  • 2024-03-27 JP JP2026509562A patent/JPWO2025203352A1/ja active Pending

Patent Citations (3)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events