KR20240175670A - Electronic device and method for displaying a content in virtual environment - Google Patents

Abstract

A wearable device may include a first display positioned with respect to a left eye of a user. The wearable device may include a second display positioned with respect to a right eye of the user. The wearable device may include a camera. The wearable device may include a processor. The wearable device may include a memory storing instructions. The instructions, when executed by the processor, may cause the wearable device to display content having a first displaying size on the first display and the second display such that the content is perceived as being positioned at a first depth in a 3 dimensional virtual environment. The instructions, when executed by the processor, may cause the wearable device to display the content on the first display and the second display in a second display size substantially equal to the first display size, such that the content is recognized as being located at a second depth exceeding the first depth in the 3D virtual environment when the content is displayed for a time period greater than a reference time.

Description

ELECTRONIC DEVICE AND METHOD FOR DISPLAYING A CONTENT IN VIRTUAL ENVIRONMENT

The descriptions below relate to electronic devices and methods for displaying content within a virtual environment.

In order to provide an enhanced user experience, electronic devices are being developed that provide virtual environment services that display computer-generated information in conjunction with external objects in the real world. The electronic devices may include wearable devices that can be worn by a user. For example, the electronic devices may include user equipment, AR glasses, and/or a head-mounted device (HMD).

A wearable device may include a display. The wearable device may include a camera. The wearable device may include a processor. The processor may be configured to display content having a first size in a first area of a virtual environment, through at least a portion of a display area of the display. The processor may be configured to identify, based on the camera, whether a time for which a user of the wearable device gazes at the content having the first size is greater than or equal to a reference time. The processor may be configured to display, based on identifying that the time is greater than or equal to the reference time, the content having a second size different from the first size in a second area identified from a reference location corresponding to the user in the virtual environment, through at least a portion of the display.

A wearable device may include a display. The wearable device may include a camera. The wearable device may include a processor. The processor may be configured to display content, which is displayed in a first area within a virtual environment and has a first size within the virtual environment, through at least a portion of the display. The processor may be configured to identify whether a function for adjusting a focal length is activated. The processor may be configured to maintain displaying the content, which has the first size within the first area, through at least a portion of the display based on identifying that the function is deactivated. The processor may be configured to, based on identifying that the function is activated, change a location from the first area to a second area having a different depth from a reference location within the virtual environment for adjusting the focal length, change a size from the first size to a second size according to the adjustment of the focal length, and display, through at least a portion, the content having the second size within the second area. The reference location may represent a location within the virtual environment corresponding to a user of the wearable device.

A wearable device may include a first display positioned with respect to a left eye of a user. The wearable device may include a second display positioned with respect to a right eye of the user. The wearable device may include a camera. The wearable device may include a processor. The wearable device may include a memory storing instructions. The instructions, when executed by the processor, may cause the wearable device to display content having a first displaying size on the first display and the second display such that the content is perceived as being positioned at a first depth in a 3 dimensional virtual environment. The instructions, when executed by the processor, may cause the wearable device to display the content on the first display and the second display in a second display size substantially equal to the first display size, such that the content is recognized as being located at a second depth exceeding the first depth in the 3D virtual environment when the content is displayed for a time period greater than a reference time.

FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.
FIG. 2a illustrates an example of a perspective view of a wearable device.
FIG. 2b illustrates an example of one or more hardware devices arranged within a wearable device.
Figures 3a and 3b illustrate examples of the appearance of a wearable device.
Figures 4a and 4b illustrate examples of how to display content based on focal length within a virtual environment.
Figure 5 illustrates an exemplary block diagram of a wearable device.
Figure 6 illustrates an example flow diagram for a method of displaying content according to focal length within a virtual environment.
Figure 7 shows examples of display areas of a display for displaying content according to focal length.
Figure 8 illustrates an example of an operational flow for a method of adjusting a focal length and obtaining an adjusted result based on capability information about the focal length.
Figure 9 illustrates an example flowchart of a method for displaying content having different sizes depending on focal length within a virtual environment.
Figure 10 illustrates an example flow diagram for a method of displaying content according to depth within a virtual environment.

The terms used in this disclosure are only used to describe specific embodiments and may not be intended to limit the scope of other embodiments. The singular expression may include the plural expression unless the context clearly indicates otherwise. The terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by a person having ordinary skill in the art described in this disclosure. Among the terms used in this disclosure, terms defined in general dictionaries may be interpreted as having the same or similar meaning as the meaning they have in the context of the related technology, and shall not be interpreted in an ideal or excessively formal meaning unless explicitly defined in this disclosure. In some cases, even if a term is defined in this disclosure, it cannot be interpreted to exclude embodiments of the present disclosure.

In the various embodiments of the present disclosure described below, a hardware-based approach is described as an example. However, since the various embodiments of the present disclosure include techniques using both hardware and software, the various embodiments of the present disclosure do not exclude a software-based approach.

In addition, in the present disclosure, in order to determine whether a specific condition is satisfied or fulfilled, the expression "more than" or "less than" may be used, but this is only a description for expressing an example and does not exclude the description of more than or less than. A condition described as "more than" may be replaced with "more than," a condition described as "less than" may be replaced with "less than," and a condition described as "more than and less than" may be replaced with "more than and less than." In addition, hereinafter, "A" to "B" mean at least one of the elements from A to (including A) and from (including B).

FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in the volatile memory (132), process the command or data stored in the volatile memory (132), and store result data in the nonvolatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphic processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a given function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

The auxiliary processor (123) may control at least a portion of functions or states associated with at least one of the components of the electronic device (101) (e.g., the display module (160), the sensor module (176), or the communication module (190)), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing device) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. Such learning may be performed, for example, in the electronic device (101) itself on which the artificial intelligence model is executed, or may be performed through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers. The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may additionally or alternatively include a software structure.

The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or nonvolatile memory (134).

The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

The audio output module (155) can output an audio signal to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive an incoming call. According to one embodiment, the receiver can be implemented separately from the speaker or as a part thereof.

The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) can include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) can include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can obtain sound through an input module (150), or output sound through an audio output module (155), or an external electronic device (e.g., an electronic device (102)) (e.g., a speaker or a headphone) directly or wirelessly connected to the electronic device (101).

The sensor module (176) can detect an operating state (e.g., power or temperature) of the electronic device (101) or an external environmental state (e.g., user state) and generate an electric signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., the electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that a user can perceive through a tactile or kinesthetic sense. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module (180) can capture still images and moving images. According to one embodiment, the camera module (180) can include one or more lenses, image sensors, image signal processors, or flashes.

The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery (189) can power at least one component of the electronic device (101). In one embodiment, the battery (189) can include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

The communication module (190) may support establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., the electronic device (102), the electronic device (104), or the server (108)), and performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., the application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module or a power line communication module). Among these communication modules, a corresponding communication module may communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) may use subscriber information (e.g., international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196) to identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199).

The wireless communication module (192) can support a 5G network and next-generation communication technology after a 4G network, for example, NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), terminal power minimization and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) may support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) may support various requirements specified in an electronic device (101), an external electronic device (e.g., electronic device (104)), or a network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL) each, or 1 ms or less for round trip) for URLLC realization.

The antenna module (197) can transmit or receive signals or power to or from the outside (e.g., an external electronic device). According to one embodiment, the antenna module (197) can include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) can include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), can be selected from the plurality of antennas by, for example, the communication module (190). A signal or power can be transmitted or received between the communication module (190) and the external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) can be additionally formed as a part of the antenna module (197).

According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC positioned on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) positioned on or adjacent a second side (e.g., a top side or a side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

At least some of the above components may be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, a general purpose input and output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)).

In one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). In one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform at least a part of the function or service. One or more external electronic devices that receive the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide an ultra-low latency service by using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an IoT (Internet of Things) device. The server (108) may be an intelligent server using machine learning and/or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199). The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

FIG. 2a illustrates an example of a perspective view of a wearable device. FIG. 2b illustrates an example of one or more hardware elements arranged within the wearable device.

According to one embodiment, the wearable device (101) may have a form of glasses that are wearable on a body part of the user (e.g., the head). The wearable device (101) of FIGS. 2A and 2B may be an example of the electronic device (101) of FIG. 1. The wearable device (101) may include a head mounted display (HMD). For example, the housing of the wearable device (101) may include a flexible material, such as rubber and/or silicone, that is configured to fit closely to a portion of the user's head (e.g., a portion of the face surrounding both eyes). For example, the housing of the wearable device (101) may include one or more straps that are able to be twined around the user's head, and/or one or more temples that are attachable to ears of the head.

Referring to FIG. 2A, according to one embodiment, a wearable device (101) may include at least one display (250) and a frame (200) supporting at least one display (250).

According to one embodiment, the wearable device (101) may be worn on a part of a user's body. The wearable device (101) may provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to a user wearing the wearable device (101). For example, the wearable device (101) may display a virtual reality image provided from at least one optical device (282, 284) of FIG. 2B on at least one display (250) in response to a designated gesture of the user acquired through the motion recognition camera (260-2, 264) of FIG. 2B. For example, the display (250) may include at least a part of the display module (160) of FIG. 1.

In one embodiment, at least one display (250) can provide visual information to a user. For example, at least one display (250) can include a transparent or translucent lens. At least one display (250) can include a first display (250-1) and/or a second display (250-2) spaced apart from the first display (250-1). For example, the first display (250-1) and the second display (250-2) can be positioned at positions corresponding to the left and right eyes of the user, respectively.

Referring to FIG. 2B, at least one display (250) can provide a user with visual information transmitted from external light and other visual information that is distinct from the visual information through a lens included in the at least one display (250). The lens can be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. For example, at least one display (250) can include a first surface (231) and a second surface (232) opposite to the first surface (231). A display area can be formed on the second surface (232) of the at least one display (250). When a user wears the wearable device (101), external light can be transmitted to the user by being incident on the first surface (231) and transmitted through the second surface (232). As another example, at least one display (250) can display an augmented reality image combined with a virtual reality image provided from at least one optical device (282, 284) on a real screen transmitted through external light, on a display area formed on the second surface (232).

In one embodiment, at least one display (250) can include at least one waveguide (233, 234) that diffracts light emitted from at least one optical device (282, 284) and transmits the diffracted light to a user. The at least one waveguide (233, 234) can be formed based on at least one of glass, plastic, or polymer. A nano-pattern can be formed on at least a portion of an exterior or interior of the at least one waveguide (233, 234). The nano-pattern can be formed based on a grating structure having a polygonal and/or curved shape. Light incident on one end of the at least one waveguide (233, 234) can be propagated to the other end of the at least one waveguide (233, 234) by the nano-pattern. At least one waveguide (233, 234) may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)), a reflective element (e.g., a reflective mirror). For example, at least one waveguide (233, 234) may be arranged within the wearable device (101) to guide a screen displayed by at least one display (250) to the user's eyes. For example, the screen may be transmitted to the user's eyes based on total internal reflection (TIR) occurring within the at least one waveguide (233, 234).

The wearable device (101) can analyze an object included in a real image collected through a shooting camera (245), combine a virtual object corresponding to an object to be provided with augmented reality among the analyzed objects, and display the virtual object on at least one display (250). The virtual object can include at least one of text and image for various information related to the object included in the real image. The wearable device (101) can analyze the object based on a multi-camera such as a stereo camera. For the object analysis, the wearable device (101) can execute SLAM (simultaneous localization and mapping) using a multi-camera, an IMU (inertial measurement units) (or an IMU sensor), and/or a ToF (time-of-flight). A user wearing the wearable device (101) can view an image displayed on at least one display (250).

According to one embodiment, the frame (200) may be formed as a physical structure that allows the wearable device (101) to be worn on the user's body. According to one embodiment, the frame (200) may be configured so that, when the user wears the wearable device (101), the first display (250-1) and the second display (250-2) may be positioned corresponding to the user's left and right eyes. The frame (200) may support at least one display (250). For example, the frame (200) may support the first display (250-1) and the second display (250-2) to be positioned corresponding to the user's left and right eyes.

Referring to FIG. 2A, the frame (200) may include a region (220) that at least partially contacts a part of the user's body when the user wears the wearable device (101). For example, the region (220) of the frame (200) that contacts a part of the user's body may include a region that contacts a part of the user's nose, a part of the user's ear, and a part of the side of the user's face that the wearable device (101) makes contact with. According to one embodiment, the frame (200) may include a nose pad (210) that contacts a part of the user's body. When the wearable device (101) is worn by the user, the nose pad (210) may contact a part of the user's nose. The frame (200) may include a first temple (204) and a second temple (205) that contact another part of the user's body that is distinct from the part of the user's body.

For example, the frame (200) may include a first rim (201) that surrounds at least a portion of the first display (250-1), a second rim (202) that surrounds at least a portion of the second display (250-2), a bridge (203) that is arranged between the first rim (201) and the second rim (202), a first pad (211) that is arranged along a portion of an edge of the first rim (201) from one end of the bridge (203), a second pad (212) that is arranged along a portion of an edge of the second rim (202) from the other end of the bridge (203), a first temple (204) that extends from the first rim (201) and is fixed to a portion of an ear of the wearer, and a second temple (205) that extends from the second rim (202) and is fixed to a portion of an ear opposite the ear. The first pad (211) and the second pad (212) may be in contact with a portion of the user's nose, and the first temple (204) and the second temple (205) may be in contact with a portion of the user's face and a portion of the user's ear. The temples (204, 205) may be rotatably connected to the rim through the hinge units (206, 207) of FIG. 2B. The first temple (204) may be rotatably connected to the first rim (201) through the first hinge unit (206) disposed between the first rim (201) and the first temple (204). The second temple (205) may be rotatably connected to the second rim (202) through the second hinge unit (207) disposed between the second rim (202) and the second temple (205). According to one embodiment, the wearable device (101) can identify an external object (e.g., a user's fingertip) touching the frame (200) and/or a gesture performed by the external object by using a touch sensor, a grip sensor, and/or a proximity sensor formed on at least a portion of a surface of the frame (200).

According to one embodiment, the wearable device (101) may include hardwares (e.g., hardwares to be described later based on the block diagram of FIG. 5) that perform various functions. For example, the hardwares may include a battery module (270), an antenna module (275), at least one optical device (282, 284), speakers (e.g., speakers (255-1, 255-2)), microphones (e.g., microphones (265-1, 265-2, 265-3)), a light-emitting module (not shown), and/or a printed circuit board (PCB) (290) (e.g., a printed circuit board). The various hardwares may be arranged within the frame (200).

According to one embodiment, the microphones (e.g., microphones 265-1, 265-2, 265-3) of the wearable device (101) may be disposed on at least a portion of the frame (200) to acquire a sound signal. A first microphone (265-1) disposed on the bridge (203), a second microphone (265-2) disposed on the second rim (202), and a third microphone (265-3) disposed on the first rim (201) are illustrated in FIG. 2B , but the number and arrangement of the microphones (265) are not limited to the embodiment of FIG. 2B . When the number of microphones (265) included in the wearable device (101) is two or more, the wearable device (101) may identify the direction of the sound signal by using a plurality of microphones disposed on different portions of the frame (200).

In one embodiment, at least one optical device (282, 284) can project a virtual object onto at least one display (250) to provide various image information to a user. For example, at least one optical device (282, 284) can be a projector. At least one optical device (282, 284) can be positioned adjacent to at least one display (250) or can be included within at least one display (250) as a part of at least one display (250). In one embodiment, the wearable device (101) can include a first optical device (282) corresponding to a first display (250-1) and a second optical device (284) corresponding to a second display (250-2). For example, at least one optical device (282, 284) may include a first optical device (282) disposed at an edge of the first display (250-1) and a second optical device (284) disposed at an edge of the second display (250-2). The first optical device (282) may transmit light to a first waveguide (233) disposed on the first display (250-1), and the second optical device (284) may transmit light to a second waveguide (234) disposed on the second display (250-2).

In one embodiment, the camera (260) may include a recording camera (245), an eye tracking camera (ET camera) (260-1), and/or a motion recognition camera (260-2). The recording camera (245), the eye tracking camera (260-1), and the motion recognition cameras (260-2, 264) may be positioned at different locations on the frame (200) and may perform different functions. The gaze tracking camera (260-1) may output data representing a gaze of a user wearing the wearable device (101). For example, the wearable device (101) may detect the gaze from an image including the user's pupils obtained through the gaze tracking camera (260-1). An example in which the gaze tracking camera (260-1) is positioned toward the user's right eye is illustrated in FIG. 2B, but the embodiment is not limited thereto, and the gaze tracking camera (260-1) may be positioned solely toward the user's left eye, or toward both eyes.

In one embodiment, the capturing camera (245) can capture an actual image or background to be aligned with a virtual image in order to implement augmented reality or mixed reality content. The capturing camera (245) can capture an image of a specific object existing at a location viewed by the user and provide the image to at least one display (250). The at least one display (250) can display one image in which information about a real image or background including an image of the specific object acquired using the capturing camera (245) and a virtual image provided through at least one optical device (282, 284) are superimposed. In one embodiment, the capturing camera (245) can be placed on a bridge (203) disposed between the first rim (201) and the second rim (202).

The gaze tracking camera (260-1) can implement more realistic augmented reality by tracking the gaze of a user wearing the wearable device (101) and thereby matching the user's gaze with visual information provided to at least one display (250). For example, when the wearable device (101) looks straight ahead, the wearable device (101) can naturally display environmental information related to the user's front at a location where the user is located on at least one display (250). The gaze tracking camera (260-1) can be configured to capture an image of the user's pupil in order to determine the user's gaze. For example, the gaze tracking camera (260-1) can receive gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the gaze tracking camera (260-1) can be placed at positions corresponding to the user's left and right eyes. For example, the gaze tracking camera (260-1) may be positioned within the first rim (201) and/or the second rim (202) to face the direction in which the user wearing the wearable device (101) is positioned.

The gesture recognition camera (260-2, 264) can recognize the movement of the user's entire body, such as the user's torso, hand, or face, or a part of the body, and thereby provide a specific event on a screen provided on at least one display (250). The gesture recognition camera (260-2, 264) can recognize the user's gesture (gesture recognition), obtain a signal corresponding to the gesture, and provide a display corresponding to the signal on at least one display (250). The processor can identify the signal corresponding to the gesture, and perform a designated function based on the identification. In one embodiment, the gesture recognition camera (260-2, 264) can be disposed on the first rim (201) and/or the second rim (202).

The camera (260) included in the wearable device (101) is not limited to the above-described gaze tracking camera (260-1), motion recognition camera (260-2, 264). For example, the wearable device (101) can identify an external object included in the FoV by using the camera (260) positioned toward the user's FoV. The wearable device (101) identifying the external object can be performed based on a sensor for identifying the distance between the wearable device (101) and the external object, such as a depth sensor and/or a ToF (time of flight) sensor. The camera (260) positioned toward the FoV can support an autofocus function and/or an OIS (optical image stabilization) function. For example, the wearable device (101) may include a camera (260) (e.g., a face tracking (FT) camera) positioned toward the face to obtain an image including the face of a user wearing the wearable device (101).

Although not shown, in one embodiment, the wearable device (101) may further include a light source (e.g., an LED) that emits light toward a subject (e.g., a user's eye, face, and/or an external object within the FoV) being captured using the camera (260). The light source may include an LED of an infrared wavelength. The light source may be disposed on at least one of the frame (200) and the hinge units (206, 207).

In one embodiment, the battery module (270) may supply power to electronic components of the wearable device (101). In one embodiment, the battery module (270) may be disposed within the first temple (204) and/or the second temple (205). For example, the battery module (270) may be a plurality of battery modules (270). The plurality of battery modules (270) may be disposed within each of the first temple (204) and the second temple (205). In one embodiment, the battery module (270) may be disposed at an end of the first temple (204) and/or the second temple (205).

The antenna module (275) can transmit signals or power to the outside of the wearable device (101), or receive signals or power from the outside. In one embodiment, the antenna module (275) can be positioned within the first temple (204) and/or the second temple (205). For example, the antenna module (275) can be positioned close to one surface of the first temple (204) and/or the second temple (205).

The speaker (255) can output an acoustic signal to the outside of the wearable device (101). The acoustic output module may be referred to as a speaker. In one embodiment, the speaker (255) may be positioned within the first temple (204) and/or the second temple (205) so as to be positioned adjacent to an ear of a user wearing the wearable device (101). For example, the speaker (255) may include a second speaker (255-2) positioned within the first temple (204) and thus positioned adjacent to the user's left ear, and a first speaker (255-1) positioned within the second temple (205) and thus positioned adjacent to the user's right ear.

The light-emitting module (not shown) may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state or emit light with an action corresponding to a specific state in order to visually provide information about a specific state of the wearable device (101) to the user. For example, when the wearable device (101) requires charging, it may emit red light at a regular cycle. In one embodiment, the light-emitting module may be disposed on the first rim (201) and/or the second rim (202).

Referring to FIG. 2b, according to one embodiment, the wearable device (101) may include a printed circuit board (PCB) (290). The PCB (290) may be included in at least one of the first temple (204) or the second temple (205). The PCB (290) may include an interposer positioned between at least two sub-PCBs. One or more hardwares included in the wearable device (101) (e.g., hardwares illustrated by different blocks in FIG. 5) may be positioned on the PCB (290). The wearable device (101) may include a flexible PCB (FPCB) for interconnecting the hardwares.

According to one embodiment, the wearable device (101) may include at least one of a gyro sensor, a gravity sensor, and/or an acceleration sensor for detecting a posture of the wearable device (101) and/or a posture of a body part (e.g., a head) of a user wearing the wearable device (101). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and/or acceleration based on designated three-dimensional axes (e.g., x-axis, y-axis, and z-axis) that are perpendicular to each other. The gyro sensor may measure an angular velocity about each of the designated three-dimensional axes (e.g., x-axis, y-axis, and z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyro sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the wearable device (101) may identify a user's motion and/or gesture performed to execute or terminate a specific function of the wearable device (101) based on the IMU.

Figures 3a and 3b illustrate examples of the appearance of a wearable device.

The wearable device (101) of FIGS. 3A and 3B may be an example of the electronic device (101) of FIG. 1. According to one embodiment, an example of the appearance of a first side (310) of a housing of the wearable device (101) may be illustrated in FIG. 3A, and an example of the appearance of a second side (320) opposite to the first side (310) may be illustrated in FIG. 3B.

Referring to FIG. 3A, a first surface (310) of a wearable device (101) according to one embodiment may have a form attachable on a body part of a user (e.g., the face of the user). Although not shown, the wearable device (101) may further include a strap for being fixed on a body part of a user, and/or one or more temples (e.g., the first temple (204) and/or the second temple (205) of FIGS. 2A and 2B). A first display (250-1) for outputting an image to a left eye among the user's two eyes, and a second display (250-2) for outputting an image to a right eye among the user's two eyes may be disposed on the first surface (310). The wearable device (101) is formed on the first surface (310) and may further include a rubber or silicone packing to prevent interference by light (e.g., ambient light) different from light radiated from the first display (250-1) and the second display (250-2).

According to one embodiment, the wearable device (101) may include cameras (260-3, 260-4) for capturing and/or tracking both eyes of the user adjacent to each of the first display (250-1) and the second display (250-2). For example, the cameras (260-3, 260-4) may be referred to as ET cameras. According to one embodiment, the wearable device (101) may include cameras (260-5, 260-6) for capturing and/or recognizing the face of the user. The cameras (260-5, 260-6) may be referred to as FT cameras.

Referring to FIG. 3b, cameras (e.g., cameras 260-7, 260-8, 260-9, 260-10, 260-11, 260-12)) and/or sensors (e.g., depth sensors (330)) for obtaining information related to the external environment of the wearable device (101) may be disposed on a second surface (320) opposite to the first surface (310) of FIG. 3a. For example, the cameras (260-7, 260-8, 260-9, 260-10) may be disposed on the second surface (320) to recognize external objects. For example, using the cameras (260-11, 260-12), the wearable device (101) may obtain images and/or videos to be transmitted to each of the user's two eyes. The camera (260-11) may be placed on the second face (320) of the wearable device (101) to obtain an image to be displayed through the second display (250-2) corresponding to the right eye among the two eyes. The camera (260-12) may be placed on the second face (320) of the wearable device (101) to obtain an image to be displayed through the first display (250-1) corresponding to the left eye among the two eyes.

According to one embodiment, the wearable device (101) may include a depth sensor (330) disposed on the second surface (320) to identify a distance between the wearable device (101) and an external object. Using the depth sensor (330), the wearable device (101) may obtain spatial information (e.g., a depth map) for at least a portion of the FoV of a user wearing the wearable device (101).

Although not shown, a microphone may be placed on the second side (320) of the wearable device (101) to acquire sound output from an external object. The number of microphones may be one or more depending on the embodiment.

As described above, according to one embodiment, the wearable device (101) may include hardware (e.g., cameras (260-7, 206-8, 260-9, 260-10), and/or depth sensor (330)) for identifying a body part including a user's hand. The wearable device (101) may identify a gesture indicated by a motion of the body part. The wearable device (101) may provide a UI based on the identified gesture to a user wearing the wearable device (101). The UI may support a function for editing images and/or videos stored in the wearable device (101). The wearable device (101) may communicate with an external electronic device different from the wearable device (101) in order to more accurately identify the gesture.

The wearable device (101) of FIGS. 2A to 3B (or the electronic device (101) of FIG. 1) can provide a virtual environment. For example, the virtual environment can represent an example of extended reality (XR) provided through the wearable device (101). For example, XR can include augmented reality (AR), virtual reality (VR), and mixed reality (MR). For example, the wearable device (101) for AR can provide augmented information based on a real object. For example, the wearable device (101) can include AR glasses or VR glasses for providing information to a user based on a real object. For example, the wearable device (101) can include a VST (video see-through) device.

The virtual environment provided by the wearable device (101) may include virtual objects having different depths. The virtual objects may be referred to as contents. For example, when a user wearing the wearable device (101) views the content, a focal length may change depending on the content. The focal length may represent a focal length of the wearable device (101) with respect to the user's eye. For example, since the location of the content with respect to the eye generally does not change while the user is viewing the content, the focal length may be fixed to a specific distance. Accordingly, the user's eyesight may be deteriorated. In contrast, in the case of a user using the virtual environment including virtual objects having different depths, since various focal lengths are used depending on the virtual objects, the user's eyesight may be improved. However, even within the virtual space, when using fixed content, there may still be a problem that the focal length is fixed to a specific distance. Hereinafter, the present disclosure describes a device and method for using various focal lengths for specific content when using the content within the virtual environment. In FIGS. 4A and 4B, a method for displaying content within the virtual environment according to a dynamic focal length of a user is described.

Figures 4a and 4b illustrate examples of how to display content according to focal length within a virtual environment.

The methods of FIGS. 4a and 4b can be performed by the wearable device (101) of FIGS. 2a to 3b (or the electronic device of FIG. 1).

Referring to FIGS. 4A and 4B , a user (400) may wear a wearable device (101). For example, the wearable device (101) may include an HMD. For example, the HMD may be worn on the head of the user (400). FIGS. 4A and 4B illustrate an HMD including two displays (250-1, 250-2) as an example of the wearable device (101), but the embodiments of the present disclosure are not limited thereto. For example, the wearable device (101) may include one display or three displays. In addition, for example, the wearable device (101) may include a lens having a fixed focal length. When using a plurality of displays including lenses having fixed focal lengths, the wearable device (101) may adjust the focal length using the plurality of displays. Alternatively, for example, the wearable device (101) may include a lens having a variable focal length. When utilizing a display including a lens having a variable focal length, the wearable device (101) can adjust the focal length by adjusting the lens having a variable focal length within the display. Referring to FIGS. 4A and 4B , the wearable device (101) may provide a virtual environment. For example, the virtual environment may include content (410). For example, the content (410) may be referred to as a virtual object or a visual object displayed within the virtual environment. FIGS. 4A and 4B illustrate content (410) as an example of a two-dimensional (2D) object, but embodiments of the present disclosure are not limited thereto. For example, embodiments of the present disclosure may include content (410) as a three-dimensional (3D) object. In the above-described example, the wearable device (101) can express depth according to the position of a virtual object within the virtual environment through at least one display including a lens having a fixed focal length or a lens having a variable focal length.

Referring to FIGS. 4A and 4B, while using the virtual environment through the wearable device (101), the wearable device (101) may display content (410) having a specified size on a specified location within the virtual environment. For example, the wearable device (101) may display content (410) having a first size (420) within a first area of the virtual environment. For example, the first area (or the first depth of the virtual environment) may indicate a location within the virtual environment where the focal length is a first distance (430). The wearable device (101) may display content (410) having a first size (420) within the first area through at least one display (250). For example, in order to display content (410) having a first size (420) within the first area, the wearable device (101) may display a first image (440-1) through at least a portion of an active area of the first display (250-1). In addition, for example, in order to display content (410) having a first size (420) within the first area, the wearable device (101) may display a second image (440-2) through at least a portion of an active area of the second display (250-2). In order to display content (410) having a first size (420) within the first area, the areas occupied by each of the first image (440-1) and the second image (440-2) within the active area may be substantially the same. However, the positions within the display areas of the first image (440-1) and the second image (440-2) may be different from each other. Specific details related to this are described in FIG. 7 below.

Referring to FIG. 4A, the wearable device (103) can display content (410) having a first size (420) in a second area different from the first area through at least one display (250). For example, the second area (or the second depth of the virtual environment) can indicate a location in the virtual environment where the focal length is the second distance (435). The wearable device (101) can display content (410) having a first size (420) in the second area through at least one display (250). For example, in order to display the content (410) having the first size (420) in the second area, the wearable device (101) can display an image (445-1) through at least a portion of an active area of the first display (250-1). In addition, for example, in order to display content (410) having a first size (420) within the second area, the wearable device (101) may display an image (445-2) through at least a part of the display area of the second display (250-2). As the first distance (430) changes to the second distance (435), the size occupied by the image (445-1 or 445-2) in the display area may change. For example, the display size of the image (445-1) may be smaller than the display size of the first image (440-1). Or, for example, the display size of the image (445-2) may be smaller than the display size of the second image (440-2). This means that, in order to represent perspective, the wearable device (101) can change the size occupied by the image (445-1 or 445-2) in the display area as the depth changes from the distance (430) to the second distance (435) that is deeper.

In contrast, in FIG. 4b below, in order to protect the eyesight of a user (400) according to embodiments of the present disclosure, an example is illustrated in which an area (or depth) in which content (410) is displayed is changed according to the time at which content (410) is displayed, and a size of content (410) within the virtual environment is changed according to the changed area (or depth). In this case, even if the size within the virtual environment is changed, the size of an image for displaying content (410) on at least one display (250) can be substantially maintained the same.

Referring to FIG. 4B, while the user (400) views the content (410) through the wearable device (101), the wearable device (101) may change the size and location of the content (410). For example, the wearable device (101) may change the location of the content (410) within the virtual environment from the first area to the second area. For example, the second area may represent a location within the virtual environment where the focal distance is the second distance (460). The second distance (460) may represent a distance that is longer than the first distance (430). In addition, the wearable device (101) may enlarge the size of the content (410) from the first size (420) to the second size (450). In other words, the wearable device (101) can display content (410) having a changed size when displaying content (410) of a changed focal length. At this time, the wearable device (101) can display content (410) having a second size (450) within the second area through at least one display (250). For example, in order to display content (410) having a second size (450) within the second area, the wearable device (101) can display a third image (470-1) through at least a part of the active area of the first display (250-1). In addition, for example, in order to display content (410) having a second size (450) within the second area, the wearable device (101) may display a fourth image (470-2) through at least a portion of the display area of the second display (250-2). In order to display content (410) having a second size (450) within the second area, the areas occupied by each of the third image (470-1) and the fourth image (470-2) within the display area may be substantially the same. However, the positions of each of the third image (470-1) and the fourth image (470-2) within the display area may be different from each other. At this time, the difference between the first image (440-1) of the first display (250-1) and the second image (440-2) of the second display (250-2) may be greater than the difference between the third image (470-1) of the first display (250-1) and the fourth image (470-2) of the second display (250-2). For example, the difference may represent a difference between coordinates of designated positions of each of the images (e.g., the first image (440-1) and the second image (440-2) or the third image (470-1) and the fourth image (470-2)). Specific details related thereto are described below in FIG. 7.

Referring to FIG. 4B, the wearable device (101) can change the position and size of displaying the content (410) in order to change the focal length. For example, the wearable device (101) can change the position and size of displaying the content (410) in order to change the focal length within a specified range. For example, the specified range can be identified based on capability information of adjusting the focal length of the user (400). For example, the capability information can include at least one of a minimum length and a maximum length for the focal length of the user (400), or a preferred focal length of the user (400). The maximum length can also be referred to as a limit distance for the focal length of the user (400). For example, when the minimum distance of the specified range is the first distance (430) and the maximum distance is the second distance (460), the wearable device (101) can display content (410) having a size between the first size (420) and the second size (450). At this time, the content (410) having a size between the first size (420) and the second size (450) can be displayed at a location within the virtual environment between the first area and the second area. For example, the size of the content (410) can be identified based on the location within the virtual environment. For example, the size can be linearly proportional to the distance from a reference location corresponding to the user (400) within the virtual environment to the location of the content (410) within the virtual environment. For example, the distance can substantially correspond to the focal length. In the example of FIG. 4B, when the focal length is gradually changed from the first distance (430) to the second distance (460), the wearable device (101) can gradually enlarge the size of the content (410) from the first size (420) to the second size (450). Conversely, when the focal length is gradually changed from the second distance (460) to the first distance (430), the wearable device (101) can gradually reduce the size of the content (410) from the second size (450) to the first size (420). As described above, the wearable device (101) can enlarge and reduce the location and size at which the content (410) is displayed in order to prevent the focal length of the user (400) from being fixed.

As described above, while the location and size of the content (410) being displayed are changed, the content (410) recognized by the user (400) may remain substantially the same. For example, the range within the display area (or display) occupied by each of the first image (440-1) and the second image (440-2) representing the content (410) having the first size (420) within the first area may be substantially the same as the range within the display area (or display) occupied by each of the third image (470-1) and the fourth image (470-2) representing the content (410) having the second size (450) within the second area. Accordingly, while the location and size of the content (410) are changed within the specified range, the user (400) may not recognize the change in the focal distance for viewing the content (410). In other words, the user (400) can perceive that the position or size of the content (410) being viewed is maintained without change.

In FIG. 4B, for convenience of explanation, a wearable device (101) that expresses content (410) having different depths by using binocular parallax (e.g., a first image (440-1) or a third image (470-1) of a first display (250-1) and a second image (440-2) or a fourth image (470-2) of a second display (250-2)) is exemplified, but the embodiments of the present disclosure are not limited thereto. For example, a wearable device (101) including a variable focus lens may display content (410) having different depths (or focal lengths) even without using binocular parallax. In the case of a wearable device (101) including a variable focus lens, even if the content (410) is displayed through one display, the content (410) having different depths may be expressed.

As described above, the device and method according to the embodiment of the present disclosure can display the content (410) using a variable focal length while maintaining the viewing experience of the user (400) using the content (410). Accordingly, the device and method according to the embodiment of the present disclosure can prevent the user's (400) ability to adjust the focal length from deteriorating when viewing the content (410). In addition, the device and method according to the embodiment of the present disclosure can provide a user experience similar to viewing substantially the same content even when the focal length is changed. In addition, the device and method according to the embodiment of the present disclosure can perform training for protecting the eyesight of the user (400) without consuming additional resources. Specific details related to the training are described in FIG. 8 below.

Figure 5 illustrates an exemplary block diagram of a wearable device.

The wearable device (101) of FIG. 5 may be an example of the electronic device (101) of FIG. 1 and the wearable device (101) of FIGS. 2A to 3B.

Referring to FIG. 5, according to one embodiment, a wearable device (101) may include at least one of a processor (120), a memory (130), a camera (510), and a display (520). The processor (120), the memory (130), the camera (510), and the display (520) may be electrically and/or operably coupled with each other by a communication bus. Hereinafter, the hardware components being operably coupled may mean that a direct connection or an indirect connection is established between the hardware components, either wired or wireless, such that a second hardware component is controlled by a first hardware component among the hardware components. Although illustrated based on different blocks, the embodiment is not limited thereto, and some of the hardware components illustrated in FIG. 5 (e.g., at least a portion of the processor (120) and the memory (130)) may be included in a single integrated circuit such as a system on a chip (SoC). The type and/or number of hardware components included in the wearable device (101) are not limited to those illustrated in FIG. 5. For example, the wearable device (101) may include only some of the hardware components illustrated in FIG. 5.

For example, the wearable device (101) may be connected to an external electronic device (not shown) based on a wired network and/or a wireless network. For example, the wired network may include a network such as the Internet, a local area network (LAN), a wide area network (WAN), or a combination thereof. For example, the wireless network may include a network such as long term evolution (LTE), 5g new radio (NR), wireless fidelity (WiFi), Zigbee, near field communication (NFC), Bluetooth, Bluetooth low-energy (BLE), or a combination thereof. The wearable device (101) may be directly connected to the external electronic device, or may be indirectly connected via one or more routers and/or access points (APs).

According to one embodiment, the processor (120) of the wearable device (101) may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), and a field programmable gate array (FPGA). As an example, the hardware component for processing data may include a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processing (DSP), and/or a neural processing unit (NPU). The number of processors (120) may be one or more. For example, the processor (120) may have a multi-core processor structure such as a dual core, a quad core, or a hexa core. The processor (120) of FIG. 5 may include at least a part of the processor (120) of FIG. 1.

According to one embodiment, the memory (130) of the wearable device (101) may include a hardware component for storing data and/or instructions input to and/or output from the processor (120). The memory (130) may include, for example, a volatile memory such as a random-access memory (RAM), and/or a non-volatile memory such as a read-only memory (ROM). The volatile memory may include, for example, at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a Cache RAM, and a pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, a compact disc, and an embedded multimedia card (eMMC). The memory (130) of FIG. 5 may include at least a part of the memory (130) of FIG. 1.

According to one embodiment, the camera (510) of the wearable device (101) may include one or more optical sensors (e.g., a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor) that generate an electrical signal representing a color and/or brightness of light. The plurality of optical sensors included in the camera (510) may be arranged in the form of a two-dimensional array. The camera (510) may acquire the electrical signals of each of the plurality of optical sensors substantially simultaneously, and generate an image corresponding to light reaching the optical sensors of the two-dimensional grid and including a plurality of pixels arranged in a two-dimensional manner. For example, photographic data captured using the camera (510) may mean one image acquired from the camera (510). For example, video data captured using the camera (510) may mean a sequence of a plurality of images acquired from the camera (510) according to a specified frame rate. A wearable device (101) according to one embodiment may further include a camera (510) positioned toward a direction in which the camera receives light and a flash light for outputting light in the direction. The number of cameras (510) included in the wearable device (101) may be one or more, as described above with reference to FIGS. 2A and 2B, and/or FIGS. 3A and 3B.

According to one embodiment, the display (520) of the wearable device (101) can output visualized information (e.g., images of FIG. 4b, images of FIG. 7) to the user. The number of displays (520) included in the wearable device (101) may be one or more. For example, the display (520) may be controlled by the processor (120) and/or a graphic processing unit (GPU) (not shown) to output visualized information to the user. The display (520) may include a flat panel display (FPD) and/or electronic paper. The FPD may include a liquid crystal display (LCD), a plasma display panel (PDP), a digital mirror device (DMD), one or more light emitting diodes (LEDs), and/or micro LEDs. The LEDs may include organic LEDs (OLEDs). The display (520) of FIG. 5 may include at least a portion of the display module (160) of FIG. 1. The display (520) of FIG. 5 may represent an example of at least one display (250) of FIG. 2a.

In one embodiment, light transmission may occur through at least a portion of the display (520). The wearable device (101) may provide a user experience related to augmented reality by providing a combination of light output through the display (520) and light transmitting through the display (520) to the user. Referring to FIGS. 2A and 2B and/or 3A and 3B , the display (520) of the wearable device (101) according to one embodiment may have a structure for covering the entire field-of-view (FoV) of the user, or radiating light toward the FoV, while being worn on a body part of the user, such as the head. Although not shown, the wearable device (101) may include other output means for outputting information in forms other than visual or auditory forms. For example, the wearable device (101) may include at least one speaker for outputting an audio signal, and/or a motor (or actuator) for providing haptic feedback based on vibration.

According to one embodiment, a communication circuit (not shown) of a wearable device (101) may include hardware for supporting transmission and/or reception of an electrical signal between the wearable device (101) and an external electronic device. The communication circuit may include, for example, at least one of a modem, an antenna, and an O/E (optical/electronic) converter. The communication circuit may support transmission and/or reception of an electrical signal based on various types of communication means, such as Ethernet, Bluetooth, BLE (Bluetooth low energy), ZigBee, LTE (long term evolution), and 5G NR (new radio). The communication circuit of FIG. 5 may include at least a part of the communication module (190) and/or the antenna module (197) of FIG. 1.

Although not shown, the wearable device (101) according to one embodiment may include output means for outputting information in a form other than a visualized form. For example, the wearable device (101) may include a speaker for outputting an acoustic signal. For example, the wearable device (101) may include a motor for providing haptic feedback based on vibration.

Referring to FIG. 5, according to an embodiment, one or more instructions (or commands) representing operations and/or actions to be performed on data by a processor (120) of the wearable device (101) may be stored in the memory (130) of the wearable device (101). A set of one or more instructions may be referred to as a program, firmware, an operating system, a process, a routine, a sub-routine, and/or an application. Hereinafter, when an application is installed in an electronic device (e.g., the wearable device (101)), it may mean that one or more instructions provided in the form of an application are stored in the memory (130), and that the one or more applications are stored in a format executable by the processor of the electronic device (e.g., a file having an extension specified by the operating system of the wearable device (101)). According to one embodiment, the wearable device (101) may perform the operations of FIGS. 6, 8, 9, and 10 by executing one or more instructions stored in the memory (130).

Referring to FIG. 5, one or more instructions included in the memory (130) may be divided into a contents outputting portion (531), a sight protection portion (533), and/or a focal length training portion (535). For example, each of the contents outputting portion (531), the sight protection outputting portion (533), and the focal length training portion (535) may be implemented as a program or software.

For example, the wearable device (101) can display at least one content within the virtual environment using the content output unit (531). For example, the wearable device (101) can render the content based on rendering information for the content within the virtual environment using the content output unit (531). For example, the rendering information can include at least one of a z-index, brightness, transparency, pixel, and color for the content. The wearable device (101) can display an image in which the content is rendered using the content output unit (531) through the display (520).

For example, the wearable device (101) can change the position and size of the content within the virtual environment by using the vision-protecting output unit (533). For example, the wearable device (101) can adjust the focal length of a user (e.g., the user (400) of FIGS. 4A and 4B) by using the vision-protecting output unit (533). For example, in order to adjust the focal length, the wearable device (101) can change the position and size of the content. For example, the size of the content can be identified based on the position of the content. For example, the size can be proportional to the difference between the position of the content and a reference position corresponding to the user within the virtual environment. For example, the reference position can represent a virtual position within the virtual environment where the gaze of the user starts. The difference between the reference position and the position of the content can correspond to the focal length. In other words, as the focal length increases, the position of the content may move away from the reference position, and thus the size of the content may increase. Conversely, as the focal length decreases, the position of the content may move closer to the reference position. Accordingly, the size of the content may decrease. The range in which the focal length is adjusted may be identified based on at least one of the user's ability information for adjusting the focal length, or the characteristics of the content. For example, the ability information may include at least one of the user's response speed related to the user's focal length adjustment, the minimum length and the maximum length for the user's focal length, or the user's preferred focal length. For example, the characteristics of the content may include at least one of the play speed of the content or the type of the content. The type of the content may include a static type such as text or an image, or a dynamic type such as a video.

For example, the wearable device (101) may output substantially the same image using the content output unit (531) while changing the location and size of the content based on the vision protection output unit (533). Referring to FIG. 4B, the area occupied by each of the first image (440-1) and the second image (440-2) representing the content (410) having the first size (420) within the first region within the display area of the display (520) may be substantially the same as the area occupied by each of the third image (470-1) and the fourth image (470-2) representing the content (410) having the second size (450) within the second region within the display area of the display (520). In other words, the resolution of the display (520) for the first image (440-1) and the second image (440-2) may correspond to the resolution of the display (520) for the third image (470-1) and the fourth image (470-2). Specific details related thereto are described in FIG. 7 below.

For example, the wearable device (101) can perform training for the user's focal length using the focal length training unit (535). For example, the wearable device (101) can identify capability information for the user's focal length using the focal length training unit (535). For example, the capability information can be identified through the user's eye calibration. For example, the eye calibration can be executed when the user initially wears the wearable device (101) or based on an input by the user. For example, the wearable device (101) can perform adjustment for the user's focal length based on the identified capability information using the focal length training unit (535). For example, the wearable device (101) can change the location and size of the content within the virtual environment based on the capability information. For example, the wearable device (101) can identify a range in which the position and size of the content will be changed based on the capability information. For example, the wearable device (101) can identify a result of the focal length adjustment using the focal length training unit (535) while the position and size of the content are changed within the range according to the adjustment of the focal length. For example, the wearable device (101) can identify an actual focal length of the user. For example, the wearable device (101) can identify the actual focal length by tracking the gaze of the user using the camera (510). For example, the wearable device (101) can identify a difference between the actual focal length and a focal length identified (or calculated) based on the capability information. The difference between the actual focal length and the identified focal length can be included in the result. The wearable device (101) may store the result in the memory (130). For example, the wearable device (101) may perform an adjustment optimized for the user by performing an adjustment of the focal length based on the stored result. In addition, the wearable device (101) may perform training of the ability to adjust the focal length by adjusting the position of the content in the virtual environment to correspond to a focal length that is out of the user's limit focal length, which is identified based on the ability information. The limit focal length may be included in a range in which the position and size of the content are to be changed. The focal length that is out of the limit focal length may be referred to as a training range. For example, the wearable device (101) may perform an adjustment of the focal length for the training range that is identified based on the result, using the vision protection output unit (533). Specific details related thereto are described in FIG. 8 below.

Figure 6 illustrates an example flow diagram for a method of displaying content according to focal length within a virtual environment.

At least some of the above methods of FIG. 6 may be performed by the wearable device (101) of FIG. 5. For example, at least some of the above methods may be controlled by the processor (120) of the wearable device (101).

Referring to FIG. 6, in operation (600), the wearable device (101) may obtain an input for displaying content. In FIG. 6, the content as one object is described as an example, but the embodiment of the present disclosure is not limited thereto. For example, the wearable device (101) may obtain an input for displaying a plurality of contents. According to one embodiment, the wearable device (101) may display a virtual environment. For example, the wearable device (101) may display the virtual environment in response to the execution of a software application for providing the virtual environment. For example, the software application may represent an example of one service for providing the virtual environment. For example, while the software application is running, the wearable device (101) may obtain an input for displaying the content. For example, the input may include a user input of a user wearing a wearable device (101).

In operation (605), the wearable device (101) may display content having a specified size within a specified area of the virtual environment. According to one embodiment, the wearable device (101) may display the content having the specified size within the specified area based on the input. For example, the specified area may be referred to as an initial area set by the user in which the content is to be displayed. For example, the specified size may be referred to as an initial size set by the user in which the content is to be displayed. For example, the specified size (or the initial size) may represent an area of the content with respect to a direction in which the user views the content. Hereinafter, for convenience of explanation, the specified area may be referred to as a first area, and the specified size may be referred to as a first size. For example, the wearable device (101) may display the content having the first size within the first area of the virtual environment. For example, the first region may represent a location within the virtual environment where the user's focal length is a first distance. According to one embodiment, the wearable device (101) may render an image (or images) for displaying the content based on the specified size and the specified location. The rendered image may be displayed through the display region of the display (520), thereby displaying the content having the first size within the first region.

According to one embodiment, the content having the first size within the first area may be displayed through at least a portion of a display area of the display (520) of the wearable device (101). For example, the display area may represent the entire area in which an image may be displayed through the display (520). For example, the at least portion may represent a part or the entirety of a display area for displaying the content having the first size within the first area among the display areas. When the display (520) includes a plurality of displays (e.g., the first display (250-1) and the second display (250-2) of FIG. 2) (or display areas), the wearable device (101) may display a first image through at least a portion of a first display area of the first display (250-1) and a second image through at least a portion of a second display area of the second display (250-2). The first image and the second image may represent images for displaying the content having the first size within the first area. For example, the first display area may be positioned with respect to the user's left eye. For example, the second display area may be positioned with respect to the user's right eye. Positioning with respect to the left or right eye may indicate that it is positioned in an area viewable through the user's left or right eye. In the above-described example, an example of a wearable device (101) that uses a method of representing the content and the depth of the content using binocular parallax is described, but the embodiments of the present disclosure are not limited thereto. For example, a wearable device (101) including a variable focus lens may display content having different depths (or focal lengths) by using the variable focus lens within the display (520) even without using binocular parallax.

In operation (610), the wearable device (101) can identify whether the vision protection function is activated. The vision protection function can indicate a function of changing the position and size of the content within the virtual environment in order to protect the user's eyesight. At this time, as the position and the size of the content are changed, the focal length while the user views the content can be changed. In addition, as the size is changed based on the position of the content while the user views the content, the size of the content recognized by the user in which it is displayed externally can be maintained constant. The size of the externally displayed can be identified based on the ratio (or resolution) of the area for the content (e.g., at least a portion) to the display area of the display (520). In other words, even if the position and the size of the content within the virtual environment are changed, the size of the content in which it is displayed externally can be maintained substantially constant. Accordingly, while the user's viewing experience while viewing the content remains constant, the user's focal length can be dynamically changed. Accordingly, the user's eyesight can be protected according to the dynamic focal length.

According to one embodiment, the wearable device (101) can identify whether the vision protection function is activated within the software application providing the virtual environment. According to one embodiment, the wearable device (101) can identify whether the vision protection function is activated within the setting of the wearable device (101). In other words, the vision protection function can be applied to each software application or to all software applications. In addition, for example, the vision protection function can be set for each content.

In operation (610), if the vision protection function is activated, the wearable device (101) can perform operation (620). Alternatively, in operation (610), if the vision protection function is deactivated, the wearable device (101) can perform operation (615).

In operation (615), the wearable device (101) can maintain the size and position of the content. For example, the wearable device (101) can maintain the size of the content as the first size and the position as the first area. For example, the wearable device (101) can maintain a state of displaying the content having the first size within the first area in response to identifying that the vision protection function is deactivated.

In operation (620), the wearable device (101) can identify whether the time (or time period) at which the content is displayed is longer than or equal to a reference time. According to one embodiment, the wearable device (101) can identify whether the time at which the content is displayed is longer than or equal to the reference time in response to identifying that the vision protection function is activated.

In one embodiment, the reference time may be identified based on at least one of the user's ability information for adjusting the focal length or the characteristic of the content. The ability information may include at least one of the user's reaction speed related to the focal length adjustment, the minimum length and the maximum length for the user's focal length, or the user's preferred focal length. For example, the characteristic of the content may include at least one of the play speed of the content or the type of the content. The type of the content may include a static type such as text or an image or a dynamic type such as a video. For example, the reference time may be set longer for a person with a slow reaction speed (e.g., an elderly person) than for a person with a fast reaction speed (e.g., a young person). Alternatively, the reference time may be set longer for a person with a dynamic content (or a fast play speed) than for a person with a static content (or a slow play speed).

In operation (620), if the time is greater than or equal to the reference time, the wearable device (101) can perform operation (625). Conversely, in operation (620), if the time is less than or equal to the reference time, the wearable device (101) can perform operation (620) again. For example, the wearable device (101) can identify whether the time is greater than or equal to the reference time.

In operation (625), the wearable device (101) can change the size and position of the content. According to one embodiment, the wearable device (101) can change the size and position of the content in response to identifying that the time is greater than or equal to the reference time. For example, the wearable device (101) can change the first size and the first area of the content to a second size different from the first size and a second area different from the first area, respectively. According to one embodiment, the wearable device (101) can identify the second size and the second area based on the capability information. For example, the wearable device (101) can identify the second area and the second size based on the capability information including a focal length preferred by the user. For example, the second area can represent an area that is changed from the first area in order to change to a focal length preferred by the user. For example, the second region may represent a location within the virtual environment where the focal distance linearly changes from the first region, and the second distance may represent a focal distance preferred by the user or a focal distance between the first distance and the focal distance preferred by the user. In other words, the second region may differ from the first region in a depth identified from a reference location corresponding to the user within the virtual environment. For example, when the second distance from a reference location corresponding to the user within the virtual environment is further than the first distance, the second size may be larger than the first size. The second size may be enlarged from the first size. Also, for example, when the second distance from a reference location corresponding to the user within the virtual environment is closer than the first distance, the second size may be smaller than the first size. The second size may be reduced from the first size. Even in the above-described cases, the size at which the content recognized by the user is displayed externally may be maintained constant. Specific details related to this are described in Figure 7 below.

In one embodiment, the change in the size and position of the content may be repeated by reducing and enlarging. For example, the wearable device (101) may expand the size of the content from the first size to the second size, and then reduce it from the second size back to the first size. Or, for example, the wearable device (101) may reduce the size of the content from the second size to the first size, and then enlarge it from the first size back to the second size. Or, for example, the wearable device (101) may repeat the reducing and enlarging according to a specified cycle.

Referring to FIG. 6, the wearable device (101) may change the size and position of the content whenever it identifies that the time is greater than or equal to the reference time. For example, the wearable device (101) may change from the content having the first size and the first position to the content having the second size and the second position. Thereafter, in response to identifying that the time is greater than or equal to the reference time, the wearable device (101) may change from the content having the second size and the second position to the content having a third size and a third position. The third position, which changes from the first position to the second position, may be changed linearly. The linear change may indicate that the change is made by a specified length. For example, the specified length may be in centimeters. However, the embodiments of the present disclosure are not limited thereto. In addition, while changing from the first position to the third position, the size of the content may be linearly changed from the first size to the second size to the third size. The size of the content may be linearly changed in proportion to the position of the content that is linearly changed. However, the embodiments of the present disclosure are not limited thereto.

FIG. 6 illustrates an example of changing the size and position of the content in response to identifying a case where the time at which the content is displayed is greater than or equal to the reference time, but the embodiments of the present disclosure are not limited thereto.

According to one embodiment, the wearable device (101) may change the size and position of the content by determining whether the time for which the user of the wearable device (101) gazes at the content (hereinafter, gaze time) is longer than the reference gaze time, if the time is longer than the reference time. Specific details related thereto are described in FIG. 9 below.

According to one embodiment, the wearable device (101) can identify whether the size and position of the content are changed based on other conditions. For example, if the eye protection function is set for the content, the wearable device (101) can identify that the size and position of the content are changed. For example, if the content is a web page, the web page is generally used for a specified period of time, and thus the eye protection function can be set for the content. In other words, the eye protection function can be set for each content. In addition, for example, the wearable device (101) can identify whether the content is a visual object floating on the display (520). For example, the floating visual object can indicate an object that is always displayed in a part of the display area of the display (520) regardless of the location within the virtual environment. If the above content is a floating visual object, the wearable device (101) can change the size and position of the content.

In addition, in FIG. 6, an example in which the content is enlarged as it gets farther away or reduced as it gets closer is described, but the embodiment of the present disclosure is not limited thereto. For example, within a range of focal distances defined by the minimum distance and maximum distance of the focal distance of the user included in the capability information, the reduction and enlargement of the content may be repeated. In other words, the wearable device (101) may change the location and size of the content and display it within the range.

In operation (630), the wearable device (101) may display the content based on the changed size and position. For example, the wearable device (101) may display the content having the second size within the second area. According to one embodiment, the wearable device (101) may render an image (or images) for displaying the content based on the changed size and position. The rendered image may be displayed through the display area of the display (520), thereby displaying the content having the second size within the second area.

According to one embodiment, the wearable device (101) may maintain a value indicating a z-index of the content while the location of the content is changed from the first area to the second area. For example, the wearable device (101) may set the value to a value higher than a second value indicating a z-index of second content positioned between the first area and the second area while the location of the content is changed from the first area to the second area. In other words, the value indicating the z-index of the content may be a value higher than the second value indicating the z-index of the second content. For example, the higher the z-index, the closer the second content may be displayed to a reference location corresponding to the user within the virtual environment. Based on the setting, the second content may be prevented from being displayed on the content as the location of the content is changed from the first area to the second area. According to one embodiment, the wearable device (101) may display the content by rendering it based on the z-index. For example, since the second value of the second content is lower than the value of the content, the wearable device (101) may render only the content. Accordingly, the wearable device (101) may display only the content. Or, for example, after rendering both the content and the multi-second content, the wearable device (101) may refrain from displaying the second content having a lower z-index than the content, and display only the content. In the above example, it is described that the wearable device (101) displays the content closer to the reference position as the z-index has a higher value, but the embodiments of the present disclosure are not limited thereto. For example, depending on the rendering method, the lower the z-index value, the closer the wearable device (101) may display the content to the reference position.

According to one embodiment, the content having the second size in the second area may be displayed through at least a portion of a display area of the display (520) of the wearable device (101). The at least a portion for displaying the content having the second size in the second area may correspond to the at least a portion for displaying the content having the first size in the first area. In other words, an area of the at least a portion for displaying the content having the second size in the second area may correspond to an area of the at least a portion for displaying the content having the first size in the first area. However, an image (or images) for displaying the content having the second size in the second area may be different from an image (or images) for displaying the content having the first size in the first area. For example, a position within the display area of an image (or images) for displaying the content having the second size within the second area may be different from a position within the display area of an image (or images) for displaying the content having the first size within the first area.

As in the example described above, the display (520) may include a plurality of displays (or display areas) (e.g., the first display (250-1) and the second display (250-2) of FIG. 2). For example, in order to display the content having the twelfth size within the second area, the wearable device (101) may display a third image through at least a portion of the first display area of the first display (250-1) and a fourth image through at least a portion of the second display area of the second display (250-2). The third image and the fourth image may represent images for displaying the content having the second size within the second area. For example, the first display area may be positioned with respect to the user's left eye. For example, the second display area may be positioned with respect to the user's right eye. Positioned relative to the left or right eye may indicate that it is positioned in an area viewable through the left or right eye of the user. In the above example, an example of a wearable device (101) that uses a method of representing the content and the depth of the content by using binocular parallax is described, but the embodiments of the present disclosure are not limited thereto. For example, a wearable device (101) including a variable focus lens may display content having different depths (or focal lengths) by using the variable focus lens within the display (520), even without using binocular parallax.

Figure 7 shows examples of display areas of a display for displaying content according to focal length.

In FIG. 7, for convenience of explanation, a method of expressing depth of the content within a virtual environment based on binocular parallax is described as an example in which the display (520) of the wearable device (101) includes two displays (250-1, 250-2) (or display areas). However, the embodiment of the present disclosure is not limited thereto. For example, a wearable device (101) including a variable focus lens may display content having different depths (or focal lengths) by using the variable focus lens within the display (520), even without using binocular parallax. The depth may be identified based on a distance from a reference position within the virtual environment corresponding to a user of the wearable device (101) to the content.

FIG. 7 illustrates an example (700) of displaying the content having the first size within the first area, which is an example described in FIG. 6, and an example (750) of displaying the content having the second size within the second area. The second area may represent a location within the virtual environment corresponding to a focal distance further than the first area. Accordingly, the second size may be a size that is enlarged compared to the first size. In FIG. 7, the case where the second area represents a focal distance further than the first area is exemplified, but the embodiments of the present disclosure are not limited thereto. For example, the second area may represent a focal distance closer than the first area. In this case, the second size may be reduced compared to the first size.

Referring to example (700) of FIG. 7, in order to display the content having the first size within the first area, the wearable device (101) may display a first image (700-1) through the first display (250-1) and display a second image (700-2) through the second display (250-2). For example, the wearable device (101) may display the first image (700-1) through at least a part of the first display area of the first display (250-1). Additionally, the wearable device (101) may display the second image (700-2) through at least a part of the second display area of the second display (250-2). The area (or first display size) of at least a portion of the first display area for the first image (700-1) may correspond to the area (or first display size) of at least a portion of the second display area for the second image (700-2). In this case, the position of at least a portion of the first display area for the first image (700-1) may be different from the position of at least a portion of the second display area for the second image (700-2). For example, the coordinate of a specified position (e.g., the upper left corner) (710) of the first image (700-1) may be (x1, y1), and the coordinate of a specified position (e.g., the upper left corner) (720) of the second image (700-2) may be (x2, y2). Based on the difference between the designated location (710) and the designated location (720), the content having the first size located within the first area can be displayed. In other words, based on the difference, the depth of the content can be identified. For example, the depth of the content can be referenced as in the following mathematical equation.

The above z may represent the depth of the content within the virtual environment, the b may represent the distance between the user's two eyes (baseline), the f may represent the focal length of the lens of the display (520) on which the content will be displayed, and the d may represent the disparity between the images for the content. For example, the disparity between the images may represent the difference between the coordinate x1 of the designated location (710) of the first image (700-1) and the coordinate x2 of the designated location (720) of the second image (700-2).

Referring to example (750) of FIG. 7, in order to display the content having the second size within the second area, the wearable device (101) may display a third image (750-1) through the first display (250-1) and display a fourth image (750-2) through the second display (250-2). For example, the wearable device (101) may display the third image (750-1) through at least a part of the first display area of the first display (250-1). Additionally, the wearable device (101) may display the fourth image (750-2) through at least a part of the second display area of the second display (250-2). The area (or second display size) of at least a portion of the first display area for the third image (750-1) may correspond to the area (or second display size) of at least a portion of the second display area for the fourth image (750-2). In other words, the first display size for displaying the first image (700-1) and the second image (700-2) may be substantially the same as the second display size for displaying the third image (750-1) and the fourth image (750-2). In this case, the position of at least a portion of the first display area for the third image (750-1) may be different from the position of at least a portion of the second display area for the fourth image (750-2). For example, the coordinate of a designated location (e.g., the upper left vertex) (760) of the third image (750-1) may be (x3, y3), and the coordinate of a designated location (e.g., the upper left vertex) (770) of the fourth image (750-2) may be (x4, y4). Based on another difference between the designated location (760) and the designated location (770), the content having the second size positioned within the second area may be displayed. In other words, the depth of the content may be identified based on the difference.

The difference (d1) between the designated location (710) and the designated location (720) of the example (700) may be greater than the other difference (d2) between the designated location (760) and the designated location (770) of the example (750). For example, the difference (d1) may be identified based on (x1, y1) and (x2, y2). For example, the other difference (d2) may be identified based on (x3, y3) and (x4, y4). In the above example, the difference (d1) may be a value greater than the other difference (d2). This may be because the content having the first size within the first area is positioned at a closer focal distance than the content having the second size within the second area. In other words, when the focal distance is close, the image displayed on the first display (250-1) (e.g., the first image (700-1)) and the image displayed on the second display (250-2) (e.g., the second image (700-2)) may be further different from each other than the image displayed on the first display (250-1) (e.g., the third image (750-1)) and the image displayed on the second display (250-2) (e.g., the fourth image (750-2)) when the focal distance is far. For example, the difference between the positions at which an image (e.g., the first image (700-1)) displayed on a first display (250-1) and an image (e.g., the second image (700-2)) displayed on a second display (250-2) when the focal distance is close may be greater than the difference between the positions at which an image (e.g., the third image (750-1)) displayed on a first display (250-1) and an image (e.g., the fourth image (750-2)) displayed on a second display (250-2) when the focal distance is far. However, even in the example described above, the size of the area occupied by each image within the display area may be maintained substantially the same. This may be to maintain the size of the content recognized by the user constant even if the focal distance of the user changes.

According to one embodiment, the wearable device (101) may perform scaling when generating an image to be displayed on the displays (250-1, 250-2). For example, the scaling may be referred to as screen interpolation. For example, the wearable device (101) may maintain the size of the image displayed on the displays (250-1, 250-2) substantially the same even if the size of the content within the virtual environment changes. In this case, the wearable device (101) may perform down scaling when generating an image for the content having a relatively large size compared to a reference size. In other words, the images for the content having the second size in the virtual environment (e.g., the third image (700-3) and the fourth image (700-2)) may include a part of the content having the second size based on the downscaling. Alternatively, at this time, the wearable device (101) may perform upscaling when generating an image for the content having a relatively smaller size compared to the reference size. In other words, the images for the content having the first size in the virtual environment (e.g., the first image (700-1) and the second image (700-2)) may further include an interpolated part for the content having the first size and at least a part of the content. For convenience of explanation, a case is exemplified where the reference size is a size between the first size and the second size, but the embodiments of the present disclosure are not limited thereto. For example, when the first size is the reference size, images for the content having the first size (e.g., the first image (700-1) and the second image (700-2)) can be generated without scaling. In this case, images for the content having the second size (e.g., the third image (700-3) and the fourth image (700-2)) can be generated based on the downscaling.

As described above, the device and method according to the embodiment of the present disclosure can display content using a variable focal length while maintaining the user's viewing experience using the content. Accordingly, the device and method according to the embodiment of the present disclosure can prevent the user's ability to adjust the focal length from deteriorating when viewing the content. In addition, the device and method according to the embodiment of the present disclosure can provide a user experience similar to viewing substantially the same content even when the focal length is changed. In addition, the device and method according to the embodiment of the present disclosure can perform training for protecting the user's eyesight without consuming additional resources. Specific details related to the training are described in FIG. 8 below.

Figure 8 illustrates an example of an operational flow for a method of adjusting a focal length and obtaining an adjusted result based on capability information about the focal length.

At least some of the above methods of FIG. 8 may be performed by the wearable device (101) of FIG. 5. For example, at least some of the above methods may be controlled by the processor (120) of the wearable device (101).

Referring to FIG. 8, in operation (800), the wearable device (101) may obtain capability information on the user's focal length. For example, the capability information may indicate information on the user's capability to adjust the focal length. For example, the wearable device (101) may perform eye calibration when the user wears the wearable device (101) or based on the user's input. For example, when the user initially wears the wearable device (101), the eye calibration may be performed. The eye calibration may indicate a function of measuring the capability information of the user. For example, based on the eye calibration, the minimum distance and maximum distance for the user's focal length and the user's preferred focal length may be identified. The user's preferred focal length may indicate the focal length that the user's eyes adjust most quickly and accurately. The maximum distance may also be referred to as a limit distance for the user's focal length.

In operation (805), the wearable device (101) may display the content within a state in which the vision protection function is activated. For example, the wearable device (101) may display the content having a specified size within a specified area within the virtual environment. The wearable device (101) may identify whether the vision protection function is activated while displaying the content having the specified size within the specified area. As described above, displaying the content having the specified size within the specified area may be performed before, simultaneously with, or after identifying whether the vision protection function is activated. In the following examples, for convenience of explanation, an example in which the content having a first size within a first area is displayed is described.

In operation (810), the wearable device (101) can change the size and position of the content based on the capability information. For example, the capability information may represent the capability information about the user obtained based on the eye calibration. According to one embodiment, the wearable device (101) can change the size and position of the content based on the capability information obtained based on the eye calibration. For example, the size and position of the content can be changed based on a range of the user's focal distance included in the capability information. For example, the range can be defined based on the minimum distance and the maximum distance of the user's focal distance. For example, the wearable device (101) can change from a first distance, which is a focal distance corresponding to the first region, to a second distance that is different from the first distance within the range. At this time, the wearable device (101) can change the position and size of the content corresponding to the second distance. For example, the wearable device (101) may change the size and location of the content corresponding to the second distance to a second size and a second area. The second area may have a depth identified from a reference location corresponding to the user within the virtual environment that is different from the first area.

In one embodiment, the change in the size and position of the content may be repeated by reducing and enlarging. For example, the wearable device (101) may expand the size of the content from the first size to the second size, and then reduce it from the second size back to the first size. Or, for example, the wearable device (101) may reduce the size of the content from the second size to the first size, and then enlarge it from the first size back to the second size. Or, for example, the wearable device (101) may repeat the reducing and enlarging according to a specified cycle.

In operation (815), the wearable device (101) can identify a result of the user's focal length adjustment for the changed content. According to one embodiment, the wearable device (101) can display the content based on the changed position and size. For example, the wearable device (101) can display the content having the second size within the second area. While the content having the second size within the second area is displayed, the wearable device (101) can identify a movement of the user's eyes. For example, based on the movement of the eyes, the wearable device (101) can identify a result of the focal length adjustment. For example, the wearable device (101) can identify an actual focal length of the user identified according to the movement of the eyes. The wearable device (101) can obtain the result including the difference between the second distance corresponding to the second area where the content having the second size is displayed and the actual focal length. For example, the wearable device (101) can identify, based on the result, how similarly the user's eyes have moved to a target focal length (e.g., the second distance).

In operation (820), the wearable device (101) can store the identified result. According to one embodiment, the wearable device (101) can store the identified result in the memory (130). For example, the identified result can be used when the wearable device (101) changes the size and position of the content having the second size within the second area. In other words, the capability information can be updated based on the identified result.

The method of FIG. 8 may include measuring capability information for the focal length, changing the size and position of the content based on the measured capability information, measuring the actual focal length of the user while displaying the changed content, thereby identifying the result of the adjustment, and updating the capability information based on the identified result. However, the embodiment of the present disclosure is not limited thereto. According to one embodiment, the wearable device (101) may change the size and position of the content to correspond to a focal length outside the range for the focal length identified based on the capability information. In other words, the size and position of the content may be changed to have a focal length outside the range. The focal length outside the range may be referred to as a training range. According to one embodiment, the wearable device (101) may perform training for the ability to adjust the focal length by changing the size and position of the content to a focal length within the training range. For example, when the training is performed, the wearable device (101) can obtain information about the training range in which the size and location of the content are changed. For example, the information about the training range can include information about the focal length within the training range and the distance (length) by which the focal length within the training range is outside the range. In addition, the wearable device (101) can identify the degree to which the user's adjustment ability is expected to improve according to the training. According to one embodiment, the wearable device (101) can display a visual object representing the information about the training range and the degree through the display (520). Accordingly, the user can check the training result for the user's adjustment ability for the focal length.

In one embodiment, the wearable device (101) may perform vision correction of the user based on the training. For example, the wearable device (101) may perform vision correction of the user by performing adjustment of the focal length within the training range. In one embodiment, the wearable device (101) may perform the training according to a mode of the wearable device (101). For example, the wearable device (101) may activate a training function based on identifying that the mode is a training mode. Activating the training function may be referred to as performing the training. Alternatively, the wearable device (101) may deactivate the training function based on identifying that the mode is another mode (e.g., a normal mode or a content concentration mode). Disabling the training function may be referred to as refraining from or skipping the training. In addition, according to one embodiment, the wearable device (101) may disable the training function based on identifying that a designated function is being executed. For example, the designated function may include a function for eye protection of the user. For example, the designated function may include a blue light filter function for a screen displayed through a display of the wearable device (101) (e.g., displays (250-1, 250-2)). Or, for example, the designated function may include a night mode (or dark mode) for a screen displayed through the display of the wearable device (101) (e.g., displays (250-1, 250-2)). Or, for example, the designated function may include a low power mode for reducing battery consumption of the wearable device (101). However, the embodiment of the present disclosure is not limited thereto. In addition, according to one embodiment, the wearable device (101) may deactivate the training function based on the usage time. For example, the usage time may represent the time that the user uses the virtual environment provided through the wearable device (101). For example, the wearable device (101) may deactivate the training function when the usage time exceeds the reference usage time. This may be for the purpose of protecting the user's eyesight.

Figure 9 illustrates an example flowchart of a method for displaying content having different sizes depending on focal length within a virtual environment.

At least some of the above methods of FIG. 9 may be performed by the wearable device (101) of FIG. 5. For example, at least some of the above methods may be controlled by the processor (120) of the wearable device (101).

Referring to FIG. 9, in operation (900), the wearable device (101) may display content having a first size within a first area of a virtual environment. According to one embodiment, the wearable device (101) may obtain an input for displaying the content having the first size within the first area. For example, the wearable device (101) may display the virtual environment in response to the execution of a software application for providing the virtual environment. For example, the software application may represent an example of a service providing the virtual environment. For example, in a state where the software application is executed, the wearable device (101) may obtain an input for displaying the content. For example, the input may include a user input of a user wearing the wearable device (101).

According to one embodiment, the wearable device (101) may display the content having the first size within the first area based on the input. For example, the first area may be referred to as an initial area set by the user where the content is to be displayed. For example, the first size may be referred to as an initial size set by the user where the content is to be displayed. For example, the first size (or the initial size) may represent an area of the content with respect to a direction in which the user views the content. For example, the first area may represent a location within the virtual environment where the user's focal length is the first distance. According to one embodiment, the wearable device (101) may render an image (or images) for displaying the content based on the first size and the first area. By displaying the rendered image through the display area of the display (520), the content having the first size can be displayed within the first area.

According to one embodiment, the content having the first size within the first area may be displayed through at least a portion of a display area of the display (520) of the wearable device (101). For example, the display area may represent the entire area in which an image may be displayed through the display (520). For example, the at least a portion may represent a portion of a display area for displaying the content having the first size within the first area among the display areas. When the display (520) includes a plurality of displays (e.g., the first display (250-1) and the second display (250-2) of FIG. 2) (or display areas), the wearable device (101) may display the first image through at least a portion of the first display area of the first display (250-1) and the second image through at least a portion of the second display area of the second display (250-2). The first image and the second image may represent images for displaying the content having the first size within the first area. For example, the first display area may be positioned with respect to the user's left eye. For example, the second display area may be positioned with respect to the user's right eye. Positioning with respect to the left or right eye may indicate that it is positioned in an area viewable through the user's left or right eye. In the above-described example, an example of a wearable device (101) that uses a method of representing the content and the depth of the content using binocular parallax is described, but the embodiments of the present disclosure are not limited thereto. For example, a wearable device (101) including a variable focus lens may display content having different depths (or focal lengths) by using the variable focus lens within the display (520) even without using binocular parallax.

In operation (905), the wearable device (101) can identify whether the gaze time is longer than the reference gaze time. For example, the wearable device (101) can identify whether the gaze time of gazing at the content is longer than the reference gaze time. For example, after recognizing that the time for which the content is displayed is longer than the reference time, the wearable device (101) can determine whether the gaze time is longer than the reference gaze time. However, the embodiment of the present disclosure is not limited thereto. For example, the wearable device (101) can identify whether the gaze time is longer than the reference gaze time without performing a comparison between the time and the reference time. Or, for example, the wearable device (101) can perform a comparison between the time and the reference time and a comparison between the gaze time and the reference gaze time together.

According to one embodiment, the wearable device (101) can identify whether the vision protection function is activated. The vision protection function can indicate a function of changing the position and size of the content within the virtual environment in order to protect the user's eyesight. At this time, as the position and the size of the content are changed, the focal length while the user views the content can be changed. In addition, as the size is changed based on the position of the content while the user views the content, the size of the content recognized by the user in which it is displayed externally can be maintained constant. The size of the externally displayed can be identified based on the ratio (or resolution) of the area for the content (e.g., at least a portion) to the display area of the display (520). In other words, even if the position and the size of the content within the virtual environment are changed, the size of the content in which it is displayed externally can be maintained constant. Accordingly, while the user's viewing experience while viewing the content remains constant, the user's focal length can be dynamically changed. Accordingly, the user's eyesight can be protected according to the dynamic focal length.

According to one embodiment, the wearable device (101) can identify whether the vision protection function is activated within the software application providing the virtual environment. According to one embodiment, the wearable device (101) can identify whether the vision protection function is activated within the setting of the wearable device (101). In other words, the vision protection function can be applied to each software application or to all software applications. In addition, for example, the vision protection function can be set for each content.

In one embodiment, when the vision protection function is activated, the wearable device (101) can identify whether the gaze time is greater than or equal to the reference gaze time. In one embodiment, the wearable device (101) can identify whether the gaze time is greater than or equal to the reference gaze time in response to identifying that the vision protection function is activated. For example, the gaze time may represent a time during which the user's gaze tracked through the camera (510) is located within an area corresponding to the content. For example, the area corresponding to the content may represent at least a portion of the display area.

According to one embodiment, the reference gaze time may be identified based on at least one of the user's ability information for adjusting the focal length or the characteristic of the content. The ability information may include at least one of the user's reaction speed related to the focal length adjustment, the minimum length and the maximum length for the user's focal length, or the user's preferred focal length. For example, the characteristic of the content may include at least one of the play speed of the content or the type of the content. The type of the content may include a static type such as text or an image or a dynamic type such as a video. For example, the reference gaze time may be set longer for a person with a slow reaction speed (e.g., an elderly person) than for a person with a fast reaction speed (e.g., a young person). Alternatively, the reference gaze time may be set longer for a person with a dynamic content (or a fast play speed) than for a person with a static content (or a slow play speed).

In contrast, according to one embodiment, when the vision protection function is deactivated, the wearable device (101) may maintain the size and position of the content. For example, the wearable device (101) may maintain the size of the content as the first size and the position as the first area. For example, the wearable device (101) may maintain a state of displaying the content having the first size within the first area in response to identifying that the vision protection function is deactivated.

In operation (910), the wearable device (101) may display content having a second size within a second area. For example, the wearable device (101) may display, through at least a portion of the display, the content having a second size different from the first size within a second area having a different depth from the first area and a reference location corresponding to the user within the virtual environment, based on identifying that the gaze time is greater than or equal to the reference gaze time.

In one embodiment, the wearable device (101) can change the size and position of the content. For example, the wearable device (101) can change the size and position of the content in response to identifying that the gaze time of the gaze is greater than or equal to the reference gaze time. For example, the wearable device (101) can change the first size and the first area of the content to the second size and the second area, which are different from the first size and different from the first area, respectively.

In one embodiment, the wearable device (101) can identify the second size and the second area based on the capability information. For example, the wearable device (101) can identify the second area and the second size based on the capability information including the user's preferred focal length. For example, the second area can represent an area that changes from the first area in order to change to the user's preferred focal length. For example, the second area can represent a location in the virtual environment where the focal length linearly changes from the first area, indicating a second distance. The second distance can represent the user's preferred focal length or a focal length between the first distance and the user's preferred focal length. For example, when the second distance from a reference location corresponding to the user in the virtual environment is further than the first distance, the second size can be larger than the first size. In other words, the second size can be enlarged from the first size. In contrast, if the second distance from the reference position corresponding to the user in the virtual environment is closer than the first distance, the second size may be smaller than the first size. In other words, the second size may be reduced from the first size. Even in the above-described case, the size at which the content recognized by the user is displayed externally may be maintained constant.

In the example of FIG. 9, an example of changing the size and position of the content in response to identifying that the gaze time of gazing at the content is longer than the reference gaze time is illustrated, but the embodiment of the present disclosure is not limited thereto. According to one embodiment, the wearable device (101) may identify whether to change the size and position of the content based on other conditions. For example, the wearable device (101) may identify that the size and position of the content are changed when the eye protection function is set for the content. For example, when the content is a web page, the eye protection function may be set for the content since the web page is generally used in a manner of gazing at for a specified time. In addition, for example, the wearable device (101) may identify whether the content is a visual object floating on the display (520). For example, the floating visual object may represent an object that is always displayed in a portion of the display area of the display (520), regardless of its location within the virtual environment. If the content is the floating visual object, the wearable device (101) may change the size and location of the content.

In addition, in FIG. 9, an example in which the content is enlarged as it gets farther away or reduced as it gets closer is described, but the embodiment of the present disclosure is not limited thereto. For example, within a range of focal distances defined by the minimum distance and maximum distance of the focal distance of the user included in the capability information, the reduction and enlargement of the content may be repeated. In other words, the wearable device (101) may change the location and size of the content and display it within the range.

According to one embodiment, the wearable device (101) may display the content based on the changed second size and the second area. For example, the wearable device (101) may display the content having the second size within the second area. According to one embodiment, the wearable device (101) may render an image (or images) for displaying the content based on the changed size and position. The rendered image may be displayed through the display area of the display (520), thereby displaying the content having the second size within the second area.

According to one embodiment, the wearable device (101) may maintain a value indicating a z-index of the content while the location of the content is changed from the first area to the second area. For example, the wearable device (101) may set the value to a value higher than a second value indicating a z-index of second content positioned between the first area and the second area while the location of the content is changed from the first area to the second area. In other words, the value indicating the z-index of the content may be a value higher than the second value indicating the z-index of the second content. For example, the higher the z-index, the closer it may be displayed to a reference location corresponding to the user within the virtual environment. Based on the above setting, the second content can be prevented from being displayed on the content as the location of the content changes from the first area to the second area. According to one embodiment, the wearable device (101) can display the content by rendering it based on the z-index. For example, since the second value of the second content is lower than the value of the content, the wearable device (101) can render only the content. Accordingly, the wearable device (101) can display only the content. Alternatively, for example, after rendering both the content and the second content, the wearable device (101) can refrain from displaying the second content having a lower z-index than the content, and display only the content.

According to one embodiment, the content having the second size in the second area may be displayed through at least a portion of a display area of the display (520) of the wearable device (101). The at least a portion for displaying the content having the second size in the second area may correspond to the at least a portion for displaying the content having the first size in the first area. In other words, an area of the at least a portion for displaying the content having the second size in the second area may correspond to an area of the at least a portion for displaying the content having the first size in the first area. However, an image (or images) for displaying the content having the second size in the second area may be different from an image (or images) for displaying the content having the first size in the first area. For example, a position within the display area of an image (or images) for displaying the content having the second size within the second area may be different from a position within the display area of an image (or images) for displaying the content having the first size within the first area.

As in the example described above, the display (520) may include a plurality of displays (or display areas) (e.g., the first display (250-1) and the second display (250-2) of FIG. 2). For example, in order to display the content having the twelfth size within the second area, the wearable device (101) may display a third image through at least a portion of the first display area of the first display (250-1) and a fourth image through at least a portion of the second display area of the second display (250-2). The third image and the fourth image may represent images for displaying the content having the second size within the second area. For example, the first display area may be positioned with respect to the user's left eye. For example, the second display area may be positioned with respect to the user's right eye. Positioned relative to the left or right eye may indicate that it is positioned in an area viewable through the left or right eye of the user. In the above example, an example of a wearable device (101) that uses a method of representing the content and the depth of the content by using binocular parallax is described, but the embodiments of the present disclosure are not limited thereto. For example, a wearable device (101) including a variable focus lens may display content having different depths (or focal lengths) by using the variable focus lens within the display (520), even without using binocular parallax.

Figure 10 illustrates an example flow diagram for a method of displaying content according to depth within a virtual environment.

At least some of the above methods of FIG. 10 may be performed by the wearable device (101) of FIG. 5. For example, at least some of the above methods may be controlled by the processor (120) of the wearable device (101).

In operation (1010), the wearable device (101) can display the content having a first display size on the first display (250-1) and the second display (250-2) such that the content is perceived as being located at a first depth in a 3D virtual environment.

For example, the 3D virtual environment may represent the virtual environment providing the XR environment. For example, the first depth may represent a location within the 3D virtual environment where the focal length of the user of the wearable device (101) is a first distance (e.g., the first distance (430) of FIG. 4B). For example, the first depth may be referred to as a first area within the 3D virtual environment.

For example, the wearable device (101) may be displayed through at least a portion of the display areas of the first display (250-1) and the second display (250-2). For example, the at least portion may represent a part or all of the display area for displaying the content having the first display size among the display areas. For example, the wearable device (101) may display the first image through at least a portion of the first display area of the first display (250-1) and the second image through at least a portion of the second display area of the second display (250-2). The first image and the second image may represent images for displaying the content having the first display size. For example, the first display area may be positioned with respect to the user's left eye. For example, the second display area may be positioned with respect to the user's right eye. Positioning relative to the left or right eye may indicate that it is positioned in an area viewable through the user's left or right eye.

According to one embodiment, the wearable device (101) may obtain an input for displaying the content. For example, the wearable device (101) may display the virtual environment in response to the execution of a software application for providing the 3D virtual environment. For example, the software application may represent an example of a service for providing the virtual environment. For example, while the software application is executed, the wearable device (101) may obtain an input for displaying the content. For example, the input may include a user input of a user wearing the wearable device (101).

According to one embodiment, the wearable device (101) can identify whether the vision protection function is activated. The vision protection function may indicate a function of changing the position and size of the content within the 3D virtual environment in order to protect the user's eyesight. At this time, as the position and the size of the content are changed, the focal length while the user views the content may be changed. In addition, as the size is changed based on the position of the content while the user views the content, the size of the content recognized by the user in which it is displayed externally may be maintained constant. The size of the externally displayed content may be identified based on the ratio (or resolution) of the area for the content (e.g., at least a portion) to the display area of the first display (250-1) and the second display (250-2). In other words, even if the position and the size of the content within the virtual environment are changed, the size of the content in which it is displayed externally may be maintained substantially constant. Accordingly, while the user's viewing experience remains constant while the user views the content, the user's focal length can be dynamically changed.

In one embodiment, the wearable device (101) can identify whether the vision protection function is activated within the software application providing the 3D virtual environment. In one embodiment, the wearable device (101) can identify whether the vision protection function is activated within the setting of the wearable device (101). In other words, the vision protection function can be applied to each software application or to all software applications. In addition, for example, the vision protection function can be set for each content.

In one embodiment, when the vision protection function is disabled, the wearable device (101) can maintain the size and the location of the content within the 3D virtual environment. For example, the wearable device (101) can maintain the size of the content as a first size and the location as a first area. For example, the wearable device (101) can maintain a state of displaying the content having the first size within the first area in response to identifying that the vision protection function is disabled.

According to one embodiment, when the vision protection function is activated, the wearable device (101) can identify whether the time period during which the content is displayed is longer than or equal to a reference time. According to one embodiment, in response to identifying that the vision protection function is activated, the wearable device (101) can identify whether the time period during which the content is displayed is longer than or equal to the reference time.

In one embodiment, the reference time may be identified based on at least one of the user's ability information for adjusting the focal length or the characteristic of the content. The ability information may include at least one of the user's reaction speed related to the focal length adjustment, the minimum length and the maximum length for the user's focal length, or the user's preferred focal length. For example, the characteristic of the content may include at least one of the play speed of the content or the type of the content. The type of the content may include a static type such as text or an image or a dynamic type such as a video. For example, the reference time may be set longer for a person with a slow reaction speed (e.g., an elderly person) than for a person with a fast reaction speed (e.g., a young person). Alternatively, the reference time may be set longer for a person with a dynamic content (or a fast play speed) than for a person with a static content (or a slow play speed).

In operation (1020), the wearable device (101) may display the content in a second display size substantially same as the first display size on the first display (250-1) and the second display (250-2) so that the content is recognized as being located at a second depth exceeding the first depth in the 3D virtual environment when the content is displayed for the time period longer than the reference time. In the example, the second depth exceeding the first depth is described as an example, but the embodiments of the present disclosure are not limited thereto. For example, the second depth may be less than or equal to the first depth.

In one embodiment, the wearable device (101) can change the size of the content within the 3D virtual environment while changing the location within the 3D virtual environment from the first depth to the second depth. In one embodiment, the wearable device (101) can change the size of the content in response to identifying that the time interval is greater than or equal to the reference time. For example, the wearable device (101) can change the first size and the first area of the content to a second size different from the first size and a second area different from the first area, respectively.

In one embodiment, the change in the size and position of the content may be repeated by reducing and enlarging. For example, the wearable device (101) may expand the size of the content from the first size to the second size, and then reduce it from the second size back to the first size. Or, for example, the wearable device (101) may reduce the size of the content from the second size to the first size, and then enlarge it from the first size back to the second size. Or, for example, the wearable device (101) may repeat the reducing and enlarging according to a specified cycle.

As described above, the wearable device (101) can maintain the display sizes of the content displayed on the first display (250-1) and the second display (250-2) substantially the same while changing the location within the 3D virtual environment from the first depth to the second depth. For example, the wearable device (101) can maintain the display size from the first display size to the second display size which is substantially the same as the first display size even when the location changes from the first depth to the second depth. In other words, the wearable device (101) can display the content having the second display size on the first display (250-1) and the second display (250-2) so as to be recognized as being located at the second depth.

For an example of a method in which the wearable device (101) displays the first display size and the second display size in the display areas of the first display (250-1) and the second display (250-2), reference may be made to FIG. 7. In addition, for a specific example of a method in which the wearable device (101) obtains a result for the user's focal length and performs training and vision correction based on the result, reference may be made to FIG. 8. In addition, for a specific example of a method in which the wearable device (101) displays the content having the second display size at the second depth based on the time that the user's gaze is positioned within the first display size of the content, reference may be made to FIG. 9.

As described above, the wearable device (101) may include a display (520). The wearable device (101) may include a camera (510). The wearable device (101) may include a processor (120). The processor (120) may be configured to display content having a first size in a first area of a virtual environment through at least a portion of a display area of the display (520). The processor (120) may be configured to identify, based on the camera (510), whether a time for which a user of the wearable device (101) gazes at the content having the first size is greater than or equal to a reference time. The processor (120) may be configured to display, through at least a portion of the display (520), the content having a second size different from the first size within a second area having a different depth from a reference location corresponding to the user within the first area and the virtual environment, based on identifying that the time is greater than or equal to the reference time.

In one embodiment, when the first region represents a first location within the virtual environment where the user's focal length corresponds to a first distance from the reference position, and the second region represents a second location within the virtual environment where the focal length corresponds to a second distance from the reference position that is longer than the first distance, the second size may be larger than the first size.

In one embodiment, when the first region represents a first location within the virtual environment where a focal length of the user from the reference position corresponds to a first distance (length), and the second region represents a second location within the virtual environment where the focal length corresponds to a second distance from the reference position where the focal length is shorter than the first distance, the second size may be smaller than the first size.

In one embodiment, the processor (120) may be configured to identify whether a function for adjusting a focal length of the user is activated. The processor (120) may be configured, in response to identifying that the function is activated, to identify whether the time is greater than or equal to the reference time. The processor (120) may be configured, in response to identifying that the function is deactivated, to maintain display of the content having the first size within the first area through the at least a portion of the display area of the display (520).

In one embodiment, the processor (120) may be configured to obtain an input for displaying the content. The processor (120) may be configured to, in response to the input, display the content having the first size through at least a portion of the content. Each of the first size and the first area may be specified by the user.

In one embodiment, the reference time may be identified based on the play speed of the content, or the capability information for adjusting the focal distance of the user. The capability information may include a range of the focal distance of the user.

According to one embodiment, the content having the first size in the first area may be displayed based on a first image displayed in a first display area of the display (520) positioned with respect to the left eye of the user and a second image displayed in a second display area of the display (520) positioned with respect to the right eye of the user. The content having the second size in the second area may be displayed based on a third image displayed in the first display area and a fourth image displayed in the second display area.

In one embodiment, when the second size is larger than the first size, a difference between a coordinate for a specified location of the first image and a coordinate for a specified location of the second image may be greater than a difference between a coordinate for a specified location of the third image and a coordinate for a specified location of the fourth image.

According to one embodiment, the processor (120) may be configured to obtain capability information on a focal length of the user based on performing eye calibration for the user. The processor (120) may be configured to change a size of the content from the first size to the second size and change a location of the content from the first area to the second area based on the capability information. The capability information may include a range of a focal length of the user.

In one embodiment, the processor (120) may be configured to identify a result of a user's adjustment of a focal length for the content having the second size within the second area, based on the capability information. The result may include a difference between a calculated focal length of the user based on the second area and an actual focal length of the user.

According to one embodiment, the processor (120) may be configured to maintain a value representing a z-index of the content while the location of the content is changed from the first area to the second area.

In one embodiment, the processor (120) may be configured to identify whether the content is a visual object floating on the display (520). The processor (120) may be configured to, in response to identifying that the content is the floating visual object, change a size of the content from the first size to the second size and change a location of the content from the first area to the second area.

In one embodiment, the time may represent the time at which the user's gaze is positioned within at least a portion of the area representing the content.

In one embodiment, the content may include a two-dimensional object or a three-dimensional object within the virtual environment.

As described above, the wearable device (101) may include a display (520). The wearable device (101) may include a camera (510). The wearable device (101) may include a processor (120). The processor (120) may be configured to display content, which is displayed in a first area within a virtual environment and has a first size within the virtual environment, through at least a portion of the display (520). The processor (120) may be configured to identify whether a function for adjusting a focal length is activated. The processor (120) may be configured to maintain displaying the content, which has the first size within the first area, through at least a portion of the display based on identifying that the function is deactivated. The processor (120) may be configured to, based on identifying that the function is activated, change a location from the first area to a second area having a different depth identified from a reference location within the virtual environment for adjusting the focal length, change a size from the first size to a second size according to the adjustment of the focal length, and display the content having the second size within the second area through at least a portion of the location. The reference location may indicate a location within the virtual environment corresponding to a user of the wearable device (101).

In one embodiment, when the first region represents a position within the virtual environment at which the focal distance from the reference position corresponds to a first distance (length), and the second region represents a position within the virtual environment at which the focal distance from the reference position corresponds to a second distance longer than the first distance, the second size may be larger than the first size.

According to one embodiment, the display (520) may include a first display area positioned with respect to a left eye of a user of the wearable device (101) and a second display area positioned with respect to a right eye of the user. The content having the first size in the first area may be displayed based on a first image displayed in the first display area and a second image displayed in the second display area. The content having the second size in the second area may be displayed based on a third image displayed in the first display area and a fourth image displayed in the second display area.

In one embodiment, when the second size is larger than the first size, a difference between a coordinate for a specified location of the first image and a coordinate for a specified location of the second image may be greater than a difference between a coordinate for a specified location of the third image and a coordinate for a specified location of the fourth image.

According to one embodiment, the processor (120) may be configured to obtain capability information for the focal length based on performing eye calibration for the user. The processor (120) may be configured to change the size from the first size to the second size and change the location from the first area to the second area based on the capability information. The capability information may include a range of the focal length.

According to one embodiment, the processor (120) may be configured to maintain a value representing a z-index of the content while the location changes from the first area to the second area.

As described above, the wearable device (101) may include a first display (250-1) positioned with respect to the user's left eye. The wearable device (101) may include a second display (250-2) positioned with respect to the user's right eye. The wearable device (101) may include a camera (510). The wearable device (101) may include a processor (120). The wearable device (101) may include a memory that stores instructions. The instructions, when executed by the processor (120), may cause the wearable device to display the content having a first displaying size on the first display (250-1) and the second display (250-2) such that the content is perceived as being located at a first depth in a 3 dimensional virtual environment. The instructions, when executed by the processor (120), may cause the wearable device to display the content at a second displaying size substantially equal to the first displaying size on the first display (250-1) and the second display (250-2) such that the content is perceived as being located at a second depth in the 3 dimensional virtual environment exceeding the first depth if the content is displayed for a time period greater than a reference time.

In one embodiment, the size of the content within the 3D virtual environment at the first depth of the 3D virtual environment can have a first size. The size of the content within the 3D virtual environment at the second depth of the 3D virtual environment can have a second size larger than the first size.

In one embodiment, the first depth may represent a first location within the 3D virtual environment where a focal length of the user corresponds to a first length. The second depth may represent a second location within the 3D virtual environment where the focal length corresponds to a second length greater than the first length.

In one embodiment, the instructions, when executed by the processor (120), may cause the wearable device to identify whether a function for adjusting a focal length of the user is activated. The instructions, when executed by the processor (120), may cause the wearable device, in response to identifying that the function is activated, to identify whether the time interval is greater than or equal to the reference time. The instructions, when executed by the processor (120), may cause the wearable device, in response to identifying that the function is deactivated, to maintain display of the content having the first display size on the first display (250-1) and the second display (250-2) such that the content is recognized as being located at the first depth in the 3D virtual environment.

In one embodiment, the instructions, when executed by the processor (120), may cause the wearable device to obtain an input for displaying the content. The instructions, when executed by the processor (120), may cause the wearable device to, in response to the input, display the content having the first display size on the first display (250-1) and the second display (250-2). The first depth may be specified by the user.

In one embodiment, the reference time may be identified based on the play speed of the content, or the capability information for adjusting the focal length of the user. The capability information may include a range of the focal length of the user.

According to one embodiment, the content having the first display size on the first display (250-1) and the second display (250-2) may be displayed based on a first image displayed on a first display area of the first display (250-1) having the first display size and a second image displayed on a second display area of the second display (250-2) having the first display size. The content having the second display size on the first display (250-1) and the second display (250-2) may be displayed based on a third image displayed on a third display area of the first display (250-1) having the second display size and a fourth image displayed on a fourth display area of the second display (250-2) having the second display size.

According to one embodiment, a difference between coordinates for a specified location in the first image and coordinates for the specified location in the second image may be greater than a difference between coordinates for the specified location in the third image and coordinates for the specified location in the fourth image.

In one embodiment, the instructions, when executed by the processor (120), may cause the wearable device to obtain capability information about a focal length of the user based on performing eye calibration for the user. The instructions, when executed by the processor (120), may cause the wearable device to change a location of the content in the 3D virtual environment from the first depth to the second depth based on the capability information. The capability information may include a range of a focal length of the user.

In one embodiment, the instructions, when executed by the processor (120), may cause the wearable device to identify a result of a user's adjustment of a focal length for the content having the second display size changed based on the capability information. The result may include a difference between the user's focal length calculated based on the second depth and the user's actual focal length.

In one embodiment, the instructions, when executed by the processor (120), may cause the wearable device to maintain a value representing a z-index of the content while the location of the content in the 3D virtual environment changes from the first depth to the second depth.

In one embodiment, the instructions, when executed by the processor (120), may cause the wearable device to identify whether the content is a visual object floating on the first display (250-1) and the second display (250-2). The instructions, when executed by the processor (120), may cause the wearable device to, in response to identifying the content as the floating visual object, change a location of the content in the 3D virtual environment from the first depth to the second depth.

In one embodiment, the instructions, when executed by the processor (120), may cause the wearable device to identify, based on the camera (510), whether a gazing time of the user is greater than or equal to a reference gazing time, in response to the time period being greater than or equal to the reference time. The instructions, when executed by the processor (120), may cause the wearable device to display the content having the second display size at the second depth based on identifying that the gazing time is greater than or equal to the reference gazing time. The gazing time may represent a time during which the user's gaze is positioned within the first display size.

In one embodiment, the content may include a two-dimensional object or a three-dimensional object within the 3D virtual environment.

The electronic devices according to various embodiments disclosed in this document may be devices of various forms. The electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliance devices. The electronic devices according to embodiments of this document are not limited to the above-described devices.

It should be understood that the various embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly dictates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be an integrally configured component or a minimum unit of the component or a portion thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the called at least one instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a commodity. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store ^TM ) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a part of the computer program product may be at least temporarily stored or temporarily generated in a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or an intermediary server.

According to various embodiments, each component (e.g., a module or a program) of the above-described components may include a single or multiple entities, and some of the multiple entities may be separately arranged in other components. According to various embodiments, one or more components or operations of the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, the multiple components (e.g., a module or a program) may be integrated into one component. In such a case, the integrated component may perform one or more functions of each of the multiple components identically or similarly to those performed by the corresponding component of the multiple components before the integration. According to various embodiments, the operations performed by the module, program, or other component may be executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims (14)

In a wearable device (101),
A first display (250-1) positioned with respect to the user's left eye;
A second display (250-2) positioned against the user's right eye;
camera (510);
Processor (120); and
Contains memory that stores instructions,
The above instructions, when executed by the processor (120), cause the wearable device to:
Displaying the content having a first displaying size on the first display (250-1) and the second display (250-2) so that the content is perceived as being located at a first depth in a 3 dimensional virtual environment; and
When the content is displayed for a time period longer than a reference time, the content is displayed on the first display (250-1) and the second display (250-2) in a second display size that is substantially the same as the first display size so that the content is recognized as being located at a second depth exceeding the first depth in the 3D virtual environment.
Wearable device (101).
In claim 1,
The size of the content within the 3D virtual environment at the first depth of the 3D virtual environment has a first size, and
The size of the content within the 3D virtual environment at the second depth of the 3D virtual environment has a second size larger than the first size,
Wearable device (101).
In claim 1,
The first depth represents a first location within the 3D virtual environment where the user's focal length corresponds to a first length, and
The second depth represents a second location within the 3D virtual environment corresponding to a second distance where the focal length is longer than the first distance,
Wearable device (101).
In claim 1,
The above instructions, when executed by the processor (120), cause the wearable device to:
Identify whether the function for adjusting the focal length of the user is activated;
In response to identifying that the above function is activated, identifying whether the time interval is greater than or equal to the reference time;
In response to identifying that the above function is disabled, causing display of the content having the first display size on the first display (250-1) and the second display (250-2) so that the content is recognized as being located at the first depth in the 3D virtual environment.
Wearable device (101).
In claim 1,
The above instructions, when executed by the processor (120), cause the wearable device to:
Obtain input for displaying the above content;
In response to the above input, cause the content having the first display size to be displayed on the first display (250-1) and the second display (250-2),
The above first depth is specified by the user,
Wearable device (101).
In claim 1,
The above reference time is identified based on the play speed of the content or the capability information of adjusting the user's focal distance, and
The above capability information includes the range of the user's focal length,
Wearable device (101).
In claim 1,
The content having the first display size on the first display (250-1) and the second display (250-2) is displayed based on a first image displayed in a first display area having the first display size of the first display (250-1) and a second image displayed in a second display area having the first display size of the second display (250-2), and
The content having the second display size on the first display (250-1) and the second display (250-2) is displayed based on a third image displayed in a third display area having the second display size of the first display (250-1) and a fourth image displayed in a fourth display area having the second display size of the second display (250-2).
Wearable device (101).
In claim 7,
The difference between the coordinates for the specified position of the first image and the coordinates for the specified position of the second image is greater than the difference between the coordinates for the specified position of the third image and the coordinates for the specified position of the fourth image.
Wearable device (101).
In claim 1,
The above instructions, when executed by the processor (120), cause the wearable device to:
Based on performing eye calibration for the user, ability information on the user's focal length is obtained; and
Based on the above capability information, causing the location of the content in the 3D virtual environment to be changed from the first depth to the second depth,
The above capability information includes the range of the user's focal length,
Wearable device (101).
In claim 9,
The above instructions, when executed by the processor (120), cause the wearable device to:
Causing to identify the result of a user's adjustment of the focal length for the content having the second display size changed based on the above capability information,
The above result includes the difference between the user's focal length calculated based on the second depth and the user's actual focal length.
Wearable device (101).
In claim 1,
The above instructions, when executed by the processor (120), cause the wearable device to:
causing a value representing a z-index of said content to be maintained while the position of said content in said 3D virtual environment changes from said first depth to said second depth;
Wearable device (101).
In claim 1,
The above instructions, when executed by the processor (120), cause the wearable device to:
Identifying whether the content is a visual object floating on the first display (250-1) and the second display (250-2), and
In response to identifying that said content is said floating visual object, causing a location of said content in said 3D virtual environment to change from said first depth to said second depth;
Wearable device (101).
In claim 1,
The above instructions, when executed by the processor (120), cause the wearable device to:
In response to the time interval being longer than the above reference time, identifying whether the gazing time of the user is longer than the reference gazing time based on the camera (510); and
Based on identifying that the above gaze time is greater than or equal to the reference gaze time, causing the content having the second display size to be displayed at the second depth;
The above gaze time indicates the time that the user's gaze is positioned within the first display size.
Wearable device (101).
In claim 1,
The content includes a two-dimensional object or a three-dimensional object within the 3D virtual environment.
Wearable device (101).

Images