Abstract: A head mounted display system for displaying image content to a user comprises at least one display configured to be worn by a user to present virtual content to first and second eyes of a user, one or more inwardly facing sensors or camera configured to monitor one or both of the users eye and processing electronics. This head mounted display system is configured such that virtual content activity can be initiated and/or driven from eye inputs such as gaze direction, eyelid motions (e.g., blinking), and/or other eye gestures.

Abstract: An extended Reality (XR) system provides methodologies for clipping a virtual object displayed to a user. The XR system provides an XR user interface that includes a virtual object. The XR system captures tracking video frame data of a hand of the user and generates a clipping mask based on the tracking video frame data. The XR system generates a clipped virtual object by applying the clipping mask to the virtual object and displays the clipped virtual object in the XR user interface.

Abstract: A computer-implemented method for enabling gesture-based interactions between a computer program and a user is disclosed. According to certain embodiments, the method may include initiating the computer program. The method may also include detecting that a condition has occurred. The method may also include activating a gesture-based operation mode of the computer program. The method may also include receiving gesture data generated by a sensor, the gesture data representing a gesture performed by the user. The method may further include performing a task based on the gesture data.

Abstract: The present disclosure provides method and apparatus for configuring a mouse device through pressure detection, and further proposes a corresponding mouse device. Pressure detected between the mouse device and an operation surface may be obtained. An operating state corresponding to the pressure may be determined. The mouse device may be configured to the operating state.

Abstract: Disclosed is an automobile, including a vehicle body and a rearview system. A vehicle cabin is provided inside the vehicle body, the vehicle body includes a roof and a tailgate directly connected to the roof, and the tailgate is made of an opaque material; the rearview system is provided on the vehicle body and including an exterior rearview mirror, an interior rearview mirror module and a first camera module, the exterior rearview mirror and the first camera module are both located outside the vehicle cabin, the interior rearview mirror module is located in the vehicle cabin, the interior rearview mirror module includes an inner rearview display screen electrically connected to the first camera module and provided with an image display mode; and in the image display mode, the inner rearview display screen is configured to display driving environment behind the automobile captured by the first camera module.

Abstract: In a method for training a gesture recognition model, gesture data is collected from an inertial measurement unit (IMU) positioned on one side of a user, wherein the IMU is capable of collecting data when positioned on either side of the user. A transformation is applied to the gesture data, wherein the transformation generates transformed gesture data that is independent of either side of the user. A gesture recognition model is trained using the transformed gesture data.

Abstract: Embodiments provide a mouse device that includes with a plurality of touch areas on one or more mouse buttons. The mouse device includes a touch panel, a press switch, a button cover and a control panel. The touch panel triggers a corresponding touch signal when any one of the plurality of touch areas respectively corresponding to a plurality of input events is pressed. A switch signal is triggered when the press switch is pressed. The button cover is used to receive a pressing operation of pressing, toward inside, the touch panel, and press the press switch via the touch panel. When receiving the touch signal and the switch signal, the control panel triggers the input event of the pressed touch area.

Abstract: An electronic device, includes one or more processors and a display screen including first, second, third, and fourth edges. The first edge and the second edge are parallel to a first direction, the third edge and the fourth edge are parallel to a second direction perpendicular to the first direction, and a cursor moves on the display screen with a mobile device. A computer program, when executed by the one or more processors, enables the electronic device to, when the cursor moves to the third edge and an intersection point between a straight line pointed to by the mobile device, when a plane on which the display screen is located is not between a straight line on which the third edge lies and a straight line on which the fourth edge lies, control the cursor to no longer move in the first direction with the mobile device.

Abstract: A mouse device includes a multi-touch region on a button. The mouse device includes a touchpad, a press switch, a button cover and a control board. The touchpad triggers a corresponding touch signal when any one of a plurality of touch regions respectively corresponding to a plurality of input events is pressed. A switch signal is triggered when the press switch is pressed. The button cover is used to accept a pressing operation of pressing toward an inner side to press the touchpad, and to press the press switch through the touchpad. When receiving the touch signal and the switch signal, the control board triggers the input event of the pressed touch region.

Abstract: A display apparatus for a vehicle including a screen unit configured to output vehicle operation information and an image of each function, and a driving unit configured to adjust a position of the screen unit through a rotary pop-up. The range of exposure of a display area may be selectively adjusted through the adjustment of the position of the screen part by the driving part, and a predetermined image may be output according to the range of exposure of the display area.

Abstract: A flexible display device for a vehicle includes a casing having an opening, a display part to be retracted or extended into or out of the casing through the opening, a display driver configured to move the display part, and a display winder configured to wind the display part based on movement of the display part.

Abstract: Aspects of the present disclosure are directed to a universal tracking module (UTM) capable of tracking six degrees of freedom of objects. In artificial reality environments, six degrees of freedom tracking refers to the ability to track an object moving and rotating freely in three-dimensional space along three axes of movement and rotation. Six degrees of freedom tracking provides high precision in tracking movement and rotation in 3D space, enabling more accurate and realistic representations of objects and interactions in virtual and augmented reality environments, thereby allowing for more realistic and immersive experiences. In examples, the UTM includes a plurality of light-emitting diodes such that an image of the UTM can be utilized to determine the position and orientation of the UTM and the object to which the UTM is attached.

Abstract: A head up display apparatus capable of suppressing discomfort to a user caused by an operating noise while preventing damage by sunlight is provided. Further, it contributes to “Goal 3: Ensure healthy lives and promote well-being for all at all ages” in the Sustainable Development Goals (SDGs). Thus, a video light projector 6 includes a drive mechanism 14 and projects video light emitted from a video display 11 to a display region 8, thereby making the projected video light visually recognized as a virtual image. A controller judges whether or not a door unlock signal which is one of information related to a transportation is received, and judges whether or not to cause the video display 11 to start displaying the video by operating the drive mechanism 14 in the video light projector 6 based on a display start condition when the door unlock signal is received.

Abstract: A computer that includes a processor and a memory, the memory including instructions executable by the processor to provide direct backlighting to a display device by generating a first image at a first viewing angle during a first time period by energizing an LED zone to a first luminance, controlling a first LCD zone to be at a first transparency and controlling a second LCD zone to be non-transparent. A second image can be generated at a second viewing angle during a second time period by energizing the LED zone to a second luminance, controlling the first LCD zone to be non-transparent and controlling the second LCD zone to a second transparency.

Abstract: A system for use with at least one affordance in space, the affordance including at least one controllable operating characteristic, the system for controlling the operating characteristic and comprising a gadget including a housing, an output device, at least a first sensor for sensing the gadget in space and generating sensed information, a processor programmed to perform the steps of receiving sensed information from the at least a first sensor, using the sensed information to determine the location and orientation of the gadget in space, using the location and orientation of the gadget in space to identify at least one target object in a targeted juxtaposition with respect to the gadget and controlling the output device to indicate that at least one target object has been targeted.

Abstract: A communication device includes a controller configured to: receive a first IP address of a first external device as an input by a user; store the first IP address received as a first setting in a memory; receive first name information including a first name of the first external device as an input by the user; store the first name information received as a second setting different from the first setting in the memory; obtain a second IP address of the first external device by performing a name resolution with the first name; determine whether the second IP address matches with the first IP address; and in a case where the controller determines that the second IP address does not match with the first IP address, perform a specific process that is relevant to storing the second IP address in the memory as the first setting.

Abstract: The present invention discloses a method, device, equipment, and computer-readable storage medium for operating an application program based on somatosensory. The method includes: obtaining original sensor data of a motion sensor from the smart wearable device; calibrating a multi-dimensional coordinate system of the motion sensor to obtain a unified matrix of the sensor coordinate system after multi-dimensional calibration; preprocessing the original motion data through standardization to obtain a standardized sensor data stream; obtaining a motion feature vector from the standardized sensor data stream; The application program operation method based on somatosensory of the present invention has the advantage of converting the motion sensor data of the smart wearable device into a universal input event, thereby realizing cross-platform human-computer interaction.

Abstract: The method can include: recording a neural state, determining a latent array, and determining an output based on the latent array. In variants, the method can function to enable a subject to use neural signals to navigate within a high-dimensional concept space to control an output (e.g., image generation, motor control, communication, etc.).

Abstract: AR-enabled wearable electronic devices such as smart glasses are adapted for use as an (Internet of Things) IoT remote control device where the user can control a pointer on a television screen, computer screen, or other IoT enabled device to select items by looking at them and making selections using gestures. Built-in six-degrees-of-freedom (6DoF) tracking capabilities are used to move the pointer on the screen to facilitate navigation. The display screen is tracked in real-world coordinates to determine the point of intersection of the user's view with the screen using raycasting techniques. Hand and head gesture detection are used to allow the user to execute a variety of control actions by performing different gestures. The techniques are particularly useful for smart displays that offer AR-enhanced content that can be viewed in the displays of the AR-enabled wearable electronic devices.

Abstract: A head mounted device includes a housing and an elongate member configured to support the housing with respect to the head of a user. A controller is configured to determine a correction based on a change in position of the display enclosure relative to the elongate member.

Abstract: A hand gesture tracking device, method, and non-transitory computer readable storage medium thereof are provided. The device performs hand gesture tracking corresponding to a user based on multiple real-time images and an inertial sensing data. The device determines whether a virtual object associated with a haptic feedback interaction is contacted based on the hand gesture tracking. In response to determining that the virtual object associated with the haptic feedback interaction is contacted, the device triggers a haptic feedback device of a wearable device to perform the haptic feedback interaction corresponding to a time interval. The device inactivates the inertial sensing data corresponding to the wearable device to perform the hand gesture tracking corresponding to the time interval.

Abstract: An information processing device is capable of causing a user to visually recognize a real space via a display. The information processing device recognizes a particular hand gesture performed by the user. The information processing device 1) displays a first frame in accordance with the particular hand gesture on the display, and 2) continues displaying the first frame for at least a predetermined amount of time after the particular hand gesture is recognized, even in a case where a state transitions to a state where the particular hand gesture is not recognized after the first frame is displayed The information processing device, in a state where the first frame is displayed on the display, executes particular processing with regard to a range of the real space indicated by the first frame out of the real space.

Abstract: A reader comprehension assessment and electronic book content generation system that uses artificial intelligence (AI), machine learning (ML), and multi-modal signals from a reader of an electronic book to assess comprehension and generate new content based on those assessments in real-time is disclosed. The reader comprehension assessment and electronic book content generation system actively measures the reader's ability and intention through gaze tracking, audio analysis, and touch tracking. The AI then combines these signals with personal preference data and creates customized content on the fly to deliver the optimal learning experience across curricula.

Abstract: The present disclosure generally relates to a dynamic user interface having an indication of time. The dynamic user interface having the indication of time further includes one or more geometric regions that intersect the indication of time, such that colors of the indication of time are different on opposite sides of a boundary of the one or more geometric regions that intersect the indication of time. The one or more geometric regions may shift and/or change over time, thereby providing a custom and/or unique dynamic user interface having the indication of time.

Abstract: Systems and methods described herein provide a haptic feedback system and method for touch-based function row keyboards that leverages existing components on laptop computers to provide tactile feedback for users when a touch function row key is pressed. According to one embodiment, an Information Handling System (IHS) includes a keyboard with a touch function row having multiple touch keys, a mouse pad with one or more electro-acoustic transducers, and executable instructions that receive a message indicating that one of the touch keys of the touch function row has been pressed. In response to the received message, the instructions actuate at least one of the electro-acoustic transducers to provide haptic feedback for the one pressed touch key.

Abstract: A controlling method for an unmanned aerial vehicle (UAV) that includes an image device. The controlling method includes transmitting, by a remote controller when a dial of a dial structure of the remote controller is rotated, a first control signal for changing imaging device information of an imaging device of the UAV via a signal transmitting device of the remote controller. The imaging device information comprises at least one of an operating mode of the imaging device, a shutter speed of the imaging device, an aperture size of the imaging device, a light sensitivity of the imaging device, or a preview image of the imaging device. The controlling method further includes transmitting a second control signal for confirming imaging device information via the signal transmitting device by the controller when the dial is slid with a displacement.

Abstract: An electronic device, method, and computer program product enable screen capture and playback of an extendable display provided by a flexible display coupled across a front side of a flexible display support structure that moves relative to a first housing. A remaining portion of the flexible display either scrolls up or rolls onto a backside of the base housing. A controller of the electronic device determines dimensions of a front display based on data from a position sensor. The controller presents visual content on the flexible display. In response to a trigger to screen record the visual content, the controller records in media file(s) frame(s) of the front display along with position data of the flexible display support structure. For playback, the controller activates the translation mechanism to match the position data and presents the frame(s) on corresponding portions of the flexible display from which the frame(s) was captured.

Abstract: An electronic device is provided. The electronic device obtains current spatial information on a physical space where a user is positioned using a sensor, generates a greater number of virtual objects than the number of unavailable authentication objects based on at least one authentication object among a plurality of authentication objects being unavailable in the current spatial information, outputs the generated virtual objects to a plurality of positions including a physical position of an unavailable authentication object, and determines that authentication is successful based on a user input that selects a generated virtual object and an available authentication object as a registered sequence.

Abstract: A method for providing adaptive game assistance during gameplay is described. The method includes providing access to play a game for a game session by a user via a game controller and accessing a profile model of the user during the game session. The profile model is a machine learning model used for predicting gaming skills from select game contexts in games. The method further includes detecting a context in the game during the game session where the profile model predicts that the user lacks a gaming skill to advance in the game and activating a haptic cue to the game controller, wherein the haptic cue is a vibration to a specific region of the game controller. The vibration to the specific region is suggestive of a type of input to be made using the game controller to advance in the game.

Abstract: Various implementations assess user interactions to trigger user interface responses. Some implementations associate user gaze with user interface elements using one or more criteria that enable interpreting the user's gaze in ways that are consistent with user intentions and/or expectations. In some implementations, a user's gaze is associated with a user interface element when the user gazes at the user interface element. When the gaze leaves the user interface element (e.g., intentionally or unintentionally), the association may be maintained or discontinued using one or more criteria to be consistent with user intentions and/or expectations. In some implementations, this involves determining whether to continue associating a user's gaze with a user interface element so that the gaze-to-element association is maintained in certain circumstances (e.g., blinks and saccades) but discontinued in other circumstances (e.g.

Abstract: Systems and methods for gesture control are described. In some embodiments, a system for assessing a reaction performance of a user engaging with an interactive digital program based on biopotentials detected at an external surface of a skin portion of the user may be provided. The system may include the wearable device comprising one or more electrodes configured to be disposed adjacent to an external surface of the skin portion. A first timestamp may be determined indicating a first time at which a stimulus condition is presented to the user. A second timestamp may be determined indicating a second time at which the biopotential signals indicate an intention by the user to perform a responsive action in response to the stimulus condition. A subject response time for the user may be determined based at least on the first timestamp and the second timestamp.

Abstract: An auditory feedback system according to the present invention is provided. The auditory feedback system comprises: an acceleration sensor configured to measure the body inclination of a user who walks or exercises while wearing a wireless earphone; and a control unit configured to determine whether the body inclination is greater than or equal to a predetermined angle with respect to a body center line, wherein the control unit can control the wireless earphone to provide a first type of music as first auditory feedback if the body inclination is determined to be in a neutral state of being less than the predetermined angle, and provide a second type of music as second auditory feedback if the body inclination is determined to be in an inclined state of being greater than or equal to the predetermined angle.

Abstract: Disclosed is a flexible display device for a vehicle, including a casing with an opening defined therein, a display unit capable of being retracted into and extended out of the casing via the opening, a display driver for moving the display unit, and a display winder for winding the display unit thereon based on the movement of the display unit.

Abstract: An apparatus, system, and method of reducing and controlling values of at least one characteristic (e.g., impedance) associated with biopotential-signal sensors is provided. The apparatus, system, and method includes monitoring—based on data from a wearable device that includes a biopotential-signal sensor, a characteristic-stabilizing component, and a characteristic monitor—a characteristic at the sensor-skin interface that impacts the biopotential-signal sensor's ability to sense biopotential signals. In accordance with selecting a biopotential-signal sensitivity need, provide an adjustment (e.g., stimulation) to the characteristic in accordance with a sensitivity-stabilizing mode until the characteristic satisfies the first biopotential-signal sensitivity need. The adjustments may be provided in various methods to achieve desired results.

Abstract: A method, a system, and computer program product for rendering a visual representation of a target object using a selection of a first position on the surface of the target object. A reference surface is determined based on selected positions on the surface of the target object. A graphical object overlaying the visual representation of the target object is rendered. A location of the graphical object in the graphical user interface is based on the reference surface. The graphical object has a perimeter including the perimeter positions. A perimeter position of the perimeter positions is mapped to a second point on a three-dimensional representation of the target object. A distance between a first point and a second point on the three-dimensional representation of the target object is less than or equal to a second distance. The first point on the three-dimensional representation is associated with the first position.

Abstract: An operation panel includes a touch position sensor configured to output an electrical signal corresponding to a contact area between a finger of a user and a switch and a controller to which an electrical signal is input from the touch position sensor. The controller is configured to: determine that the finger of the user and the touch position sensor are in contact with each other when the calculation value calculated based on the electrical signal input from the touch position sensor exceeds the preset first threshold value, and set, based on the calculation value, the second threshold value larger than the first threshold value in accordance with a magnitude of the calculation value; and determine that the touch position sensor is in the operation state of being operated when the calculation value exceeds the second threshold value.

Abstract: There is provided an information processing device that accepts an input of an emulation setting relating to a function of a display monitor as a target of emulation and executes a display output of an image rendered by executing an application program to a display monitor actually connected, in such a manner as to emulate a state in which a display monitor with a function represented by the accepted emulation setting is virtually connected.

Abstract: One variation of a system includes a substrate including: a first layer including a first spiral trace coiled in a first direction; a second layer arranged below the first layer and including a second spiral trace coiled in a second direction and cooperating with the first spiral trace to form a multi-layer inductor; and a sensor layer including an array of drive and sense electrode pairs. The system also includes: a cover layer arranged over the substrate and defining a touch sensor surface; and a first magnetic element arranged below the substrate and defining a first polarity facing the multi-layer inductor. The system further includes a controller configured to drive an oscillating voltage across the multi-layer inductor to oscillate the substrate in response to detecting an input on the touch sensor surface based on electrical values from the set of drive and sense electrode pairs.

Abstract: An information processing device including processing circuitry. The information processing device, by the processing circuitry, is configured to register a designated image; receive a request for a combination image; acquire a context of the registered image by analyzing the image in response to the request; acquire parameter values related to the registered image among parameter values updated according to an activity of a user; determine an object from the acquired context and the acquired parameter values; and combine the determined object with the registered image and present a combination image to the user.

Abstract: A data processing method based on augmented reality is provided. The method includes: displaying a captured image of a scene in a human-computer interaction interface, the captured image comprising at least one object; identifying a subject object from the at least one object, the subject object being an only object or an object with a largest size in the captured image; and displaying at least one piece of information associated with the subject object in the human-computer interaction interface.

Abstract: The present technology provides an eye information detection device including two or more non-visible light sources, a diffractive optical element, and a light reception system. The two or more non-visible light sources have different light emission wavelengths. The diffractive optical element is disposed on an optical path of non-visible light emitted from each of the two or more non-visible light sources and reflected by an eye. The light reception system receives the non-visible light reflected by the eye and passing through the diffractive optical element. According to the present technology, it is possible to make improvement regarding the highly accurate detection of the information of the eye.

Abstract: Methods and systems for providing notifications in an extended reality (XR) environment are described herein. A computing device may provide, to a user and via an XR device, an XR environment. The computing device may detect one or more first locations of one or more display devices. At least one first display device of the one or more display devices may be in a physical environment around the XR device. The computing device may retrieve one or more notifications for display in the XR environment and determine, based on the one or more first locations of the one or more display devices, one or more second locations for the one or more notifications. The computing device may then provide, in the XR environment and at the one or more second locations, the one or more notifications.

Abstract: To provide a display control system in which a terminal device and a display device operate in tandem. The display control system comprises a terminal device 10 having an image-capture unit, a display device 50 for displaying video, and a control device 20 for controlling the display device 50. The terminal device 10 or the control device 20 identifies a capture range in video displayed by the display device 50 on the basis of an image captured by the image-capture unit. The control device 50 controls the display state of the video displayed by the display device 50 on the basis of the identified capture range. This configuration allows for interactive special effects such as making an object in the capture range of the terminal device 10 disappear from the video or making objects in the capture range of the terminal device 10 appear in the video.

Abstract: There is provided an information processing device capable of suppressing a decrease in recognition accuracy of a recognition target. The information processing device includes a presentation control unit configured to control a presentation unit to present, to a user, notification information prompting to change an orientation of at least any one of a first part or a second part, on the basis of determination that the first part shields the second part recognized on the basis of a captured image including the first part of a body of the user in an imaging range.

Abstract: A three-dimensional computer-generated environment can be presented to a user. The user can create a virtual representation of a real-world object within the computer-generated environment by directing an input device towards the real-world object and tracing contours of the real-world object. The virtual representation can include voxels. The user can edit the virtual representation or create a new virtual object formed of voxels by depositing or removing voxels at virtual locations within the computer-generated environment based on selection inputs, release inputs, and optionally movement inputs detected by the input device. In some cases, the user can provide inputs via another input source, such as a hand of the user, that are detected by additional sensors or devices.

Abstract: A golf swing instructional training system is provided. The system includes a display, at least one image capturing device, a neural network, and a biomechanics assessment server. The image capturing device transmits data for use in analyzing motion of a user using the system. The neural network receives data transmitted from the image capturing device. The display is coupled to neural network and displays data received from the user and generated from the neural network. The biomechanics assessment server analyzes data transmitted from the capturing device and any input by the user. The assessment server includes at least a biomechanics rules library for use in analyzing the motion of the user based on body landmarks of the user identified by the neural network. The biomechanics rules library includes at least a golf club database, and a swing database.

Abstract: This disclosure provides a hand tracking device. The hand tracking device includes a storage circuit and a processor. The storage circuit stores a program code. The processor is coupled to the storage circuit and accesses the program code. The processor is configured to obtain a hand motion curve of a hand during a period of time. The processor is configured to obtain an object motion curve of an object during the period of time. The processor is configured to determine whether the hand is holding the object based on the hand motion curve and the object motion curve.

Abstract: Systems and techniques are described herein for pose estimation of a person. For instance, a method for pose estimation of a person is provided. The method may include obtaining an image of the person; obtaining a head pose of the person; determining a search region of the image based on the head pose; and determining a pose of the person based on the search region.

Abstract: An electronic device includes a casing, a flexible pen plug, and a locking member. The casing includes a pen slot and a first engaging portion located beside the pen slot. The flexible pen plug is detachably disposed in the pen slot, and includes a door portion, a second engaging portion connected to the door portion, a first wall portion close to the second engaging portion, and a second wall portion away from the second engaging portion. An insertion space is formed between the first wall portion and the second wall portion. When the flexible pen plug is disposed in the pen slot, the second engaging portion is engaged with the first engaging portion. The locking member is detachably screwed to the door portion, partially extends into the insertion space, and is located between the first wall portion and the second wall portion.

Abstract: Implementations of camera architectures for combined eye-tracking and outward-tracking are provided. One example includes a near-eye device comprising: a frame comprising an arm; an eye illuminator disposed on the arm of the frame, wherein the eye illuminator is configured to project light to an eye of a user; an imaging system disposed on the arm of the frame, wherein the imaging system comprises: an image sensor; and a color filter array comprising: a first set of filters for allowing the projected light from the eye illuminator to pass; and a second set of filters for allowing visible light to pass; and a lens comprising an optical element for: directing the projected light from the eye illuminator to the eye of the user; and directing light reflected off the eye of the user to the imaging system.