CN119585027A

CN119585027A - Hand-held video game controller

Info

Publication number: CN119585027A
Application number: CN202280098387.1A
Authority: CN
Inventors: 马科·埃罗马基; 吉里·帕卡里宁
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2022-07-20
Filing date: 2022-07-20
Publication date: 2025-03-07
Also published as: WO2024017465A1

Abstract

A hand-held controller (101) comprises a body (102), the body (102) supporting a layout of input elements (103) for detecting user input, and comprising a set of mechanically connected body assemblies (301 to 309) convertible between a plurality of different configurations (401, 1101, 1201, 1401). The body assembly (301 to 309) comprises a base assembly (301), a plurality of primary connection assemblies (302 to 305) respectively connected directly to the base assembly (301), and a plurality of secondary connection assemblies (306 to 309) respectively connected indirectly to the base assembly (301) through at least one primary connection assembly (302 to 305). The hand-held controller (101) is preferably switchable between at least a game controller configuration (401), a steering wheel configuration (1401) and at least one weapon configuration (1101, 1201). A method of assembling a hand-held controller (101) is provided.

Description

Hand-held video game controller

Technical Field

The present application relates to a hand-held controller, and more particularly to a hand-held game controller that is convertible between different configurations.

Background

It is well known that various hand-held controllers enable a user to control the functions of an electronic device by manually operating the input elements of the hand-held controller, for example, a remote control device can wirelessly control home audio-visual devices (e.g., televisions, optical media players, radios, and media stream players), and a game controller enables a user to control the progress of a game (e.g., a game on a PC or a game console).

The common appearance and general architecture of hand-held game controllers has been focused on a single piece design, typically characterized by a center stop region between the grip regions. A game controller, which may be referred to as a "universal" or "universal" game controller, provides a fixed layout of input elements (e.g., buttons and rockers) that can be mapped to menu navigation and gameplay actions of a particular game platform. Such game controllers have inflexibility in that the same fixed layout of input elements is used regardless of the type of game that the player plays, which may affect the user experience.

Another game controller may be referred to as a "dedicated" or "custom" game controller in an attempt to provide a better user experience for a player with a more targeted, more realistic design, and thus may resemble a steering wheel, a pedal, an airplane steering column, a particular type of weapon, or a particular piece of athletic equipment. However, the lack of versatility of such game controllers may result in players having different game controllers that can only be selectively used during the course of the game, which is difficult to switch.

It is desirable for a user of a handheld game controller to be able to switch its configuration to match a particular type of game. It is also desirable that the user be able to change the configuration of the handheld game controller during the course of the game to match the particular scene or action being played in the game. For example, during game play, a character may transition from driving a vehicle to participating in a battle. It is also desirable that the handheld game controller be capable of integrating one or more functions that may provide audio and/or visual and/or haptic effects, and may also connect with at least one other peripheral device, such as a camera or motion sensor, to enhance the immersive experience.

Disclosure of Invention

According to a first aspect, a handheld controller is provided. The hand-held controller includes a body supporting a layout of input elements for detecting user input, the body including a set of mechanically coupled body components that are switchable between a plurality of different configurations, the body components including a base component, a plurality of primary connection components, and a plurality of secondary connection components, wherein each primary connection component is movably secured to the base component by a connection between the primary connection component and the base component to guide movement of the primary connection component relative to the base component, each primary connection component is directly connected to the base component, and each secondary connection component is movably secured to the primary connection component or the other secondary connection components by a connection between the secondary connection components and the primary connection component or the other secondary connection components to guide movement of the secondary connection components relative to the primary connection component or the other secondary connection components, each secondary connection component is indirectly connected to the base component by at least one primary connection component.

The hand-held controller may be switched between at least 3, 4,5, 6, 7, 8, 9, or 10 different configurations. Thus, the set of mechanically coupled body assemblies described above can be converted between a number of different configurations, which can help to enhance the user experience.

In one example, the plurality of different configurations includes at least a game controller configuration, a steering wheel configuration, and at least one weapon configuration.

The at least one weapon configuration may include one or more of a knife or stick configuration and a gun configuration.

The "knife" configuration may represent any other similar implement with a blade, such as a knife, sword, or the like. A "stick-type" configuration may refer to any other similar item having an elongated shape, such as a stick or the like. The "gun-type" configuration may be similar to any of a variety of types of firearms, such as, for example, shotgun, submachine gun, sniper rifle, assault rifle, handgun, and the like.

In one example, the set of mechanically coupled body assemblies includes a primary coupling assembly that is slidably moveable along a single axis relative to the base assembly.

In one example, the set of mechanically coupled body assemblies includes two or more primary coupling assemblies that are each rotatable about a single axis relative to the base assembly. The hand-held controller may include two or more primary connection assemblies that are rotatable about a common axis relative to the base assembly.

The use of a single axis coupling has several benefits including, but not limited to, reduced freedom of movement between connected body components, which facilitates maintaining reliable electrical through signal transmission, self-guiding movement of one body component relative to the other, which facilitates rapid, easy and reliable switching between different configurations, and low cost manufacturing.

In one example, the set of mechanically coupled body assemblies includes at least one secondary coupling assembly that is (i) movably secured to the primary coupling assembly by a coupling between the secondary coupling assembly and the primary coupling assembly to guide movement of the secondary coupling assembly relative to the primary coupling assembly, and (ii) movably secured to the other secondary coupling assembly by a coupling between the secondary coupling assembly and the other secondary coupling assembly to guide movement between the secondary coupling assembly and the other secondary coupling assembly.

In one example, the base assembly has a first end and a second end, the set of mechanically coupled body assemblies including a first subset of body assemblies extending from the first end of the base assembly and a second subset of body assemblies extending from the second end of the base assembly. The first subset of body components may include a plurality of primary connection components and the second subset of body components may include one primary connection component and a plurality of secondary connection components. The set of mechanically coupled body assemblies may form a configuration in which the body has an upper stop portion and left and right handles.

The body may include a powered actuator arrangement that is selectively operable to activate automatic switching of the set of mechanically connected body components between different configurations. In one example, the transition between configurations may be accomplished manually or automatically by the powered actuator arrangement.

The input element layout of the handheld controller may include a plurality of buttons.

The body may support at least one camera. The body may support an omni-directional camera. The body may support at least one speaker. The body may support a microphone. The body may support at least one motion sensor. The body may support a haptic actuator.

In one example, the body includes a configuration sensing layout for sensing a relative layout of the body components, thereby determining a current configuration of the set of mechanically connected body components.

The body may include an orientation sensing arrangement for determining a current orientation of the set of mechanically coupled body components.

In one example, the body includes a wireless communication device for enabling wireless communication between the handheld controller and at least one host supporting wireless communication. For example, the host supporting wireless communications may be a gaming machine, smart television, AR/VR headset, smart phone, and the like.

In one example, the body includes a binaural renderer for providing an audio output for reproduction by headphones, the binaural renderer functioning to render sound with reference to the calculated relative positions of the handheld controller and the user's head.

The hand-held controller may be used for low-latency communications with a communicatively coupled wireless headset.

In one example, the handheld controller includes a pair of true wireless stereo headphones, and the body defines a receiving area for releasably receiving the pair of true wireless headphones. The earplug may be removably secured by a snap-fit arrangement of the receiving area.

The body may include a charging arrangement for charging the headset when placed in the receiving area.

In one example, the body includes a mobile device docking station for releasably physically securing and communicatively connecting a mobile device to the handheld controller.

The integrated connection and audiovisual functionality may be used in different ways to enhance the user experience.

According to a second aspect, a method of assembling a hand-held controller is provided. The hand-held controller includes a body supporting a layout of input elements for detecting user input, the method including assembling the body by connecting a plurality of body assemblies to form a mechanically connected set of body assemblies convertible between a plurality of different configurations such that a first plurality of body assemblies of the body assemblies are directly connected to a base assembly of the plurality of body assemblies, respectively, each body assembly of the first plurality of body assemblies is movably secured to the base assembly by a connection between the body assemblies and the base assembly to guide movement of the body assembly relative to the base assembly, a second plurality of body assemblies of the body assemblies is indirectly connected to the base assembly by at least one body assembly of the first plurality of body assemblies, each body assembly of the second plurality of body assemblies is movably secured to a connection between the body assemblies of the first plurality of body assemblies or other body assemblies of the second plurality of body assemblies of the body assemblies relative to the second plurality of body assemblies of the other body assemblies of the first plurality of body assemblies.

The plurality of different configurations may include at least 3,4, 5, 6, 7, 8, 9, or 10 different configurations, which may include at least a game controller configuration, a steering wheel configuration, and at least one weapon configuration, which may include at least one of a knife or stick configuration, and a gun configuration.

Other specific and preferred aspects of the invention are set forth below.

Drawings

The invention will be described in more detail below with reference to the attached drawing figures, in which:

FIG. 1 shows a front perspective view of a hand-held controller;

FIG. 2 shows a rear perspective view of the hand-held controller;

FIG. 3 shows an exploded view of the handheld controller;

FIG. 4 shows the handheld controller in a game controller configuration;

FIGS. 5-13 illustrate a hand-held controller in different weapon configurations;

FIG. 14 shows the hand-held controller in a steering wheel configuration;

FIGS. 15-23 illustrate different transitions of the handheld controller from one configuration to another;

FIG. 24 illustrates the switchability of a handheld controller during a game, which may be switched between different configurations to accommodate different scenarios of the game;

FIG. 25 illustrates a first handheld controller in one configuration and a second handheld controller in another configuration;

FIG. 26 illustrates an alternative actuation function of the handheld controller;

FIG. 27 illustrates the architecture of a handheld controller;

FIGS. 28 and 29 illustrate the device connection function of the handheld controller;

FIGS. 30-32 illustrate the audio output function of the handheld controller;

FIG. 33 illustrates other functions of the handheld controller;

FIG. 34 illustrates the camera function of the handheld controller;

FIG. 35 illustrates the audio processing functions of the handheld controller;

fig. 36 shows the earphone storage function of the handheld controller.

Detailed Description

Examples are described in sufficient detail below with reference to the accompanying drawings to enable one of ordinary skill in the art to practice the devices, systems, and/or processes described herein. It will be understood, however, that the invention is not limited to the precise examples described and/or shown, and that various changes and modifications may be effected therein by one skilled in the art without departing from the scope of the invention as defined in the appended claims.

In the following description, all directional terms (e.g., upper, lower, radial and axial) are used with respect to the drawings and should not be construed to limit the scope of the invention as defined in the appended claims unless otherwise specifically indicated in the context.

The figures are not necessarily to scale, and in some instances, the figures may be exaggerated or simplified for reference only.

Unless otherwise defined, all terms (including technical and scientific terms) used herein are to be interpreted according to the habits of the art. In addition, features referred to herein in the singular may be one or more features unless the context clearly indicates otherwise. Similarly, the terms "comprising" and/or "having" as used herein both refer to the presence of one or more of the stated features and do not preclude the presence or addition of one or more other features, unless the context clearly indicates otherwise.

A hand-held controller is disclosed herein that includes a body supporting a layout of input elements for detecting user input, the body including a set of mechanically coupled body assemblies that are convertible between a plurality of different configurations (preferably at least 3 different configurations), preferably at least a game controller configuration, a steering wheel configuration, and at least one weapon configuration. The body assembly includes a base assembly, a plurality of primary connection assemblies, and a plurality of secondary connection assemblies. Each primary linkage assembly is movably secured to the base assembly by a connection between the primary linkage assembly and the base assembly to guide movement of the primary linkage assembly relative to the base assembly, each primary linkage assembly being directly connected to the base assembly. Each secondary connection assembly is movably secured to the primary connection assembly or the other secondary connection assembly by a connection between the secondary connection assembly and the primary connection assembly or the other secondary connection assembly to guide movement of the secondary connection assembly relative to the primary connection assembly or the other secondary connection assembly, each secondary connection assembly being indirectly connected to the base assembly by at least one primary connection assembly.

Also disclosed herein is a method of assembling a handheld controller including a body supporting a layout of input elements for detecting user input. The method includes assembling the body by connecting a plurality of body assemblies to form a mechanically connected set of body assemblies that are convertible between a plurality of different configurations. The assembly of the body assemblies is such that a first one of the body assemblies is directly connected to a base assembly of the plurality of body assemblies, respectively, each of the first plurality of body assemblies is movably secured to the base assembly by a connection between the body assemblies and the base assembly to guide movement of the body assembly relative to the base assembly, a second one of the body assemblies is indirectly connected to the base assembly by at least one of the first plurality of body assemblies, each of the second plurality of body assemblies is movably secured to the body assembly of the first plurality of body assemblies or the other body assemblies of the second plurality of body assemblies by a connection between the body assemblies and the body assembly of the first plurality of body assemblies or the other body assemblies of the second plurality of body assemblies to guide movement of the body assembly of the second plurality of body assemblies relative to the first plurality of body assemblies or the second plurality of body assemblies.

Further disclosure is made below with reference to the accompanying drawings.

Fig. 1 and 2 illustrate a specific example provided handheld controller 101, the handheld controller 101 having a front side 100 and a back side 200, fig. 1 illustrating a perspective view of the front side 100, and fig. 2 illustrating a perspective view of the back side 200. The hand held controller also has a first side 110, a second side 120, a top 130, and a bottom 140. As described in detail below, the design handheld controller 101 may be switched between a number of different configurations. The specific example provides a handheld controller 101 designed for gaming, but may also be used for non-gaming applications.

The hand-held controller 101 includes a body as shown at 102 that supports an input element layout as shown at 103 for detecting user input. The input element layout 103 may include any suitable one or more types of input elements, such as buttons, rockers, dials, trackballs, switches, touch pads, pinch switches, microphones. In this illustrated example, the input element layout 103 includes a plurality of buttons, e.g., button 104.

Fig. 3 shows an exploded view of the body 102. The body 102 includes a set of mechanically coupled body components that are convertible between a plurality of different configurations. As described in further detail below, the body assembly includes a base assembly, a plurality of primary connection assemblies, and a plurality of secondary connection assemblies. Each primary linkage assembly is movably secured to the base assembly by a connection between the primary linkage assembly and the base assembly to guide movement of the primary linkage assembly relative to the base assembly, each primary linkage assembly being directly connected to the base assembly. Each secondary connection assembly is movably secured to the primary or other secondary connection assembly by a connection between the secondary connection assembly and the primary or other secondary connection assembly to guide movement of the secondary connection assembly relative to the primary or other secondary connection assembly, each secondary connection assembly being indirectly connected to the base assembly by at least one primary connection assembly.

In this particular example, the body assembly includes a base assembly 301, a plurality of primary connection assemblies including first, second, third, and fourth primary connection assemblies 302-305, and a plurality of secondary connection assemblies including first, second, third, and fourth primary connection assemblies 306-309.

In one example, the primary connection assembly is slidable relative to the base assembly.

In this particular example, a first primary connection component 302 is slidably connected to a base component 301. The first primary connection component 302 is slidable along a single axis (in both directions) relative to the base component 301, as indicated by arrow 310.

In one example, each of the at least two primary connection assemblies is rotatable about a single axis relative to the base assembly.

In this particular example, the second primary connection assembly 303 is rotatably connected to the base assembly 301 and is rotatable relative to the base assembly 301 about the first rotational axis 311.

In one example, the body assembly includes two or more primary connection assemblies that are rotatable about a common axis relative to the base assembly.

In this particular example, the third and fourth primary connection assemblies 304, 305 are rotatably coupled to the base assembly 301, respectively, and are rotatable relative to the base assembly 301 about a second axis of rotation 312, with the third and fourth primary connection assemblies 304, 305 disposed on opposite sides of the base assembly 301 (the third primary connection assembly 304 facing the front 100 of the body 102 and the fourth primary connection assembly 305 facing the back 200).

In one example, the body assembly includes at least one secondary connection assembly movably secured to the primary connection assembly by a connection between the secondary connection assembly and the primary connection assembly to guide movement of the secondary connection assembly relative to the primary connection assembly, the secondary connection assembly also movably secured to the other secondary connection assemblies by a connection between the secondary connection assembly and the other secondary connection assemblies to guide movement between the secondary connection assembly and the other secondary connection assemblies.

In this particular example, the first secondary connection assembly 306 is rotatably coupled to the second primary connection assembly 303 for rotation about a third axis of rotation 313, the third secondary connection assembly 307 is rotatably coupled to the first secondary connection assembly 306 for rotation about a third axis of rotation 314, the third secondary connection assembly 308 is rotatably coupled to the second secondary connection assembly 307 for rotation about a fourth axis of rotation 315, and the fourth secondary connection assembly 309 is rotatably coupled to the third secondary connection assembly 308 for rotation about a fourth axis of rotation 316.

Thus, as shown, the first secondary connection assembly 306 is mechanically connected to a primary connection assembly (second primary connection assembly 303) and a secondary connection assembly (second secondary connection assembly 307), the second secondary connection assembly 307 and the third secondary connection assembly 308 are mechanically connected to two secondary connection assemblies (first secondary connection assembly 306 and third secondary connection assembly 308, and second secondary connection assembly 307 and fourth secondary connection assembly 309), respectively, and the fourth secondary connection assembly 309 is mechanically connected to another secondary connection assembly (third secondary connection assembly 308).

Of the primary connection assemblies 303-305 that are rotatable relative to the base assembly 301, the third primary connection assembly 304 has a free end 316 and the fourth primary connection assembly 305 has a free end 317. Of the second connection assemblies 306 through 309, the fourth second connection assembly 309 has a free end 318.

XYZ coordinates are shown in fig. 3. The depth of the body 102 (between the front side 100 and the back side 200) is indicated in the Z-direction, the width of the body 102 (between the first side 110 and the second side 120) is indicated in the X-direction, and the height of the body 102 (between the top 130 and the bottom 140) is indicated in the Y-direction.

As shown, of the rotation axes 311 to 316, the axes 311, 312, 314, and 316 extend in the Z direction, the axis 313 extends in the X direction, and the axis 315 extends in the Y direction.

In one example, the set of mechanically coupled body assemblies includes a first subset of body assemblies extending from a first end of the base assembly and a second subset of body assemblies extending from a second end of the base assembly.

In one example, the first subset of body components includes a plurality of primary connection components and the second subset of body components includes one primary connection component and a plurality of secondary connection components.

In this particular example, the set of mechanically coupled body members 301-309 includes a first subset of body members (shown generally at 319) extending from a first end 320 of the base member 301 and a second subset of body members (shown generally at 320) extending from a second opposite end 322 of the base member 301, the first subset of body members 319 including a fourth stage connection member 304 and a fifth stage connection member 305, the second subset of body members 321 including a second stage connection member 303 and first-fourth stage connection members 306-309.

As shown, the set of mechanically coupled body assemblies 301-309 may form a configuration in which the body 102 has an upper stop portion 323 and left and right handles 324, 325.

In one example, the body assembly is convertible between at least 3 different configurations. In other examples, the body assembly may be switched between at least 4,5, 6, 7, 8, 9, or 10 different configurations.

In a preferred example, the body assembly is convertible between a plurality of different configurations including at least a game controller configuration, a steering wheel configuration, and at least one weapon configuration. The at least one weapon configuration may include one or more of a knife or stick configuration and a gun configuration. The term "knife" as used herein is intended to encompass other bladed items, such as knives, swords, and the like. The term "stick-type" as used herein is also intended to encompass other items having an elongated shape, such as sticks and the like. The term "gun-type" as used herein is intended to encompass many types of firearms, such as shotguns, submachine guns, sniper rifles, assault rifles, pistols, and the like.

According to this particular example, the body components of the handheld controller 101 may be switched between 10 different configurations.

As shown in fig. 4, the body 102 is in a game controller configuration 401 (which may be referred to as a "standard game controller configuration" layout, but it should be understood that the handheld controller 101 is suitable for non-gaming applications); as shown in fig. 5, the body 102 is in a first weapon configuration 501 (which may be referred to as a "shotgun-type" configuration) that is a gun-type configuration; as shown in fig. 6, the body 102 is in a second weapon configuration 601 (which may be referred to as a "mini-submachine gun" layout) that is a gun-type configuration; as shown in fig. 7, the body 102 is in a third weapon configuration 701 (which may be referred to as a "submachine gun" layout) as a gun-type configuration, as shown in fig. 8, the body 102 is in a fourth weapon configuration 801 (which may be referred to as a "long assault gun" layout) as a gun-type configuration, as shown in fig. 9, the body 102 is in a fifth weapon configuration 901 (which may be referred to as a "long assault gun" layout) as a gun-type configuration, as shown in fig. 10, the body 102 is in a sixth weapon configuration 1001 (which may be referred to as a "short assault gun" layout) as a gun-type configuration, as shown in fig. 10, the body 102 is in a seventh weapon configuration 1101 (which may be referred to as a "pistol" layout) as a gun-type configuration, as shown in fig. 12, the body 102 is in an eighth weapon configuration 1201 (which may be referred to as a "short assault gun" layout) as a stick-type configuration, as shown in fig. 13, the body 102 is in a ninth weapon configuration 1001 (which may be referred to as a "long assault gun" layout) as shown in fig. 14, and the body 102 is in a disc 1401 as shown in fig. 14.

Fig. 15 shows the body 102 transitioning from the game controller configuration 401 shown in fig. 4 to the steering wheel configuration 1401 shown in fig. 14.

As shown in a and B, when the body 102 is in the game controller configuration 401, the first, second, third and fourth secondary connection assemblies 306-309 rotate together about the rotation axis 313 until the deployed position shown in C is reached. As shown in B and C, the third and fourth secondary link assemblies 308, 309 rotate together about the axis of rotation 315 until the deployed position shown in E is reached. As shown at E, the third primary linkage assembly 304 is rotated about the rotational axis 312 until the position shown at F is reached, the free end 318 of the fourth secondary linkage assembly 309 interfaces with the free end 317 of the fourth primary linkage assembly 305, completing the transition to the steering wheel configuration 1401.

Fig. 16 shows the transition of the main body 102 from the game controller configuration 401 shown in fig. 4 to the long blade configuration 1301 shown in fig. 13.

As shown in a, when the body 102 is in the game controller configuration 401, the fourth primary linkage assembly 305 rotates about the rotational axis 312 and the first, second, third and fourth secondary linkage assemblies 306-309 rotate together about the rotational axis 311 until a configuration shown in B is reached, in which the third primary linkage assembly 304 rotates about the rotational axis 312 until a position shown in C is reached, completing the transition to the long blade configuration 1301. It will be appreciated that the third primary linkage assembly 304 rotates about the axis 312 in a direction opposite to the direction of rotation of the fourth primary linkage assembly 305, the free end 318 of the fourth primary linkage assembly 305 moves toward the base member 301, and the free end 317 of the third primary linkage assembly 304 moves away from the base member 301.

Fig. 17 shows the transition of the main body 102 from the game controller configuration 401 shown in fig. 4 to the pistol-type configuration 1101 shown in fig. 11. When the body 102 is in the game controller configuration 401, the third and fourth stage linkage assemblies 304, 305 are rotated about the rotational axis 312 in the same direction to move their free ends 317, 318 toward the base member 301 until the position shown at B is reached, completing the transition to the pistol configuration 1101.

Fig. 18 shows the transition of the main body 102 from the game controller configuration 401 shown in fig. 4 to the mini submachine gun type configuration 601 shown in fig. 6. As shown in a, the main body 102 initially transitions from the game controller configuration 401 to a pistol-type configuration 1101 shown in B. As shown in B, when the body 102 is in the pistol configuration 1101, the first primary connection assembly 302 moves to the extended position shown in C, completing the transition to the mini submachine gun configuration 601.

Fig. 19 shows the body 102 transitioning from the game controller configuration 401 shown in fig. 4 to the short bar configuration 1201 shown in fig. 12. As shown in a, the main body 102 initially transitions from the game controller configuration 401 to a pistol-type configuration 1101 shown in B. As shown at B, when the body 102 is in the pistol configuration 1101, the first, second, third and fourth secondary connection assemblies 306 through 309 rotate together about the axis of rotation 313 until the extended position shown at C is reached, completing the transition to the stub configuration 1201.

Fig. 20 shows the body 102 transitioning from the game controller configuration 401 shown in fig. 4 to the short assault rifle type configuration 1001 shown in fig. 10. When the body 102 is in the game controller configuration 401, as shown in a, the third stage linkage assembly 304 is rotated about the rotational axis 312 to move its free end 317 away from the base member 301 until the position shown in B is reached, completing the transition to the short assault rifle configuration 1001.

Fig. 21 shows the body 102 transitioning from the game controller configuration 401 shown in fig. 4 to the sniper rifle-type configuration 501 shown in fig. 5. When the body 102 is in the game controller configuration 401, the third stage linkage assembly 304 is rotated about the rotational axis 312 to move its free end 317 toward the base member 301, and the fourth stage linkage assembly 305 is rotated about the rotational axis 312 to move its free end 318 away from the base member 301 until the arrangement shown at B is reached, as shown at a. As shown in B, the first primary connection assembly 302 is moved to the extended position shown in C, completing the transition to the sniper rifle type configuration 501.

Fig. 22 shows the transition of the body 102 from the game controller configuration 401 shown in fig. 4 to the submachine gun type layout 701 shown in fig. 7. When the body 102 is in the game controller configuration 401, the third stage linkage assembly 304 is rotated about the rotational axis 312 to move its free end 317 away from the base member 301, and the fourth stage linkage assembly 305 is rotated about the rotational axis 312 to move its free end 318 toward the base member 301 until the arrangement shown at B is reached, as shown at a. As shown in B, first primary linkage assembly 302 moves to the extended position shown in C, completing the transition to submachine gun type layout 701.

Fig. 23 shows the body 102 transitioning from the game controller configuration 401 shown in fig. 4 to the long assault rifle-type layout 801 shown in fig. 8. As shown at a, when the body 102 is in the game controller configuration 401, the fourth stage connection assembly 305 is rotated about the rotational axis 312 to move its free end 318 away from the base member 301 until the arrangement shown at B is reached. As shown in B, the first primary connection assembly 302 moves to the extended position shown in C, completing the transition to the long assault rifle type layout 801.

The hand-held controller 101 may be conveniently switched between different configurations during the course of a game, and by this design, a user may quickly and robustly effect such switching.

For example, as shown in fig. 24, the body 102 of the handheld controller 101 may be in a steering wheel configuration 1401 in a driving scenario, then transition to a gun-type configuration 801 in a shooting scenario 2402, then to a gun-type configuration 101 in a subsequent shooting scenario 2403, then to a standard game controller configuration 401, and then to a stick-type configuration 1201 in a batting scenario 2405.

As shown in FIG. 25, two players 2501, 2502 may play together, each player using a respective handheld controller 101A, 101B, but one player 2501 uses the handheld controller 101A in one configuration and the other player 2502 uses the handheld controller 101B in a different configuration. For example, one player 2501 may control a character that is driving a vehicle, thus using the handheld controller 101A in a steering wheel configuration 1401, while another player 2501 may control a character that is a passenger in the vehicle but is competing with an off-vehicle enemy, thus using the handheld controller 101A in a gun-type configuration 1101. Thus, the handheld controller 101 provides the benefit that multiple players can share the same gameplay and switch roles by using different configurations of the handheld controller 101 in a multi-player mode, thereby increasing realism and improving team gaming experience.

It should be appreciated that the above-described set of mechanically connected components is assembled with the most suitable (limited/minimal) number of single-axis couplings (axial joints and linear (sliding) connections). In the specifically illustrated example of the body 102 of the hand-held controller 101, as best seen in fig. 3, only a single linear (sliding) connection is used. The use of a single axis coupling reduces the freedom of movement between the connected body components, which is advantageous for maintaining reliable electrical through signal transmission, self-guided movement of one body component relative to the other, which is advantageous for quick, easy and reliable switching between different configurations, so as not to affect the fluency of the game, and low cost manufacture. In addition, this function also helps to electrically power the above-described set of mechanically coupled body assemblies.

In one embodiment, as shown in FIG. 26, the body 102 includes a powered actuator arrangement, shown generally at 2601, that is selectively operable to activate automatic switching of the set of mechanically linked body assemblies between different configurations. Thus, the transition of the body 102 from at least one configuration to the other configuration may be electrically activated. In a preferred embodiment, each available transition between configurations can be achieved by a powered actuator arrangement. In one embodiment, the transition between configurations may be accomplished manually or automatically by a powered actuator arrangement.

The powered actuator arrangement may include any suitable arrangement of components for switching between different configurations. A rotary motor such as a DC motor 2602, an electromagnetic solenoid actuator, a piezoelectric actuator, a shape memory alloy actuator with or without a transmission member (e.g., a bevel gear 2603, a spur gear 2604, a worm gear 2605, or an internal gear 2606 for rotational connection, and a rack and pinion gear 2607 for linear (sliding) connection) may be used to drive the moving system elements.

Any suitable activation arrangement (generally as shown at 2608) may be used to activate the powered actuator arrangement to effect a transition to a different configuration of the body 102. The activation arrangement may comprise at least one control element of any suitable type, for example a button, a dial or a suitable sensor.

In one embodiment, the body 102 includes a configuration sensing layout, generally indicated at 2605, for sensing the relative layout of the body components, thereby determining the current configuration of the set of mechanically connected body components.

The convertible handheld controller 101 provides a more immersive user experience for a third person, first person, or multiplayer game based on actions, adventure, and racing. Fast game play requires fast switching between modes, whereas manual switching takes only a few seconds to complete. Alternatively, the joint between the body components may also include small hall sensors with moving magnets that electrically indicate the position of the moving member to the processing unit, and then the hand-held controller may send feedback signals to the host game console of which UI mode is currently being used.

Fig. 27 shows the architecture of the handheld controller 101.

The multimedia module 2701 of the body 102 is shown. Multimedia module 2701 may include any number of components including, but not limited to, cameras, speakers, microphones, sensors, processors, in order to provide one or more different functions including, but not limited to, those specifically described below.

It is to be understood that different layouts of the body components may be used in different examples. The number of body members may vary, the manner in which the body members are mechanically connected to form a set of mechanically connected body members may vary, the size of the body members may vary, and the type of body members may vary. For example, the body assembly may be a unitary assembly or may be an adjustable multi-component assembly. In one particular example, the body assembly 304 is shown as being of unitary form, but the replacement body assembly 304' is also shown as comprising a plurality of components, namely a first component 304A and a second component 304B, the two components 304A, 304B being rotatable together about the axis 212, the second component 304B being rotatable relative to the first component 304A about a different axis 2702.

A method of assembling a hand-held controller disclosed herein that includes a body that supports a layout of input elements for detecting user input includes assembling a body by connecting a plurality of body assemblies to form a mechanically connected set of body assemblies that are convertible between a plurality of different configurations such that a first plurality of the body assemblies is directly connected to a base assembly of the plurality of body assemblies, respectively, each of the first plurality of body assemblies is movably secured to the base assembly by a connection between the body assemblies and the base assembly to guide movement of the body assembly relative to the base assembly, a second plurality of the body assemblies is indirectly connected to the base assembly by at least one of the first plurality of body assemblies, each of the second plurality of body assemblies is movably secured to a second plurality of the body assemblies of the first plurality of body assemblies by a connection between the body assemblies and a body assembly of the first plurality of body assemblies or another body assembly of the second plurality of body assemblies to guide movement of the body assembly of the second plurality of body assemblies relative to the other body assemblies of the first plurality of body assemblies.

In one example, the resulting hand-held controller is convertible between at least 3 different configurations, preferably at least a game controller configuration, a steering wheel configuration, and at least one weapon configuration, which may include one or more of a knife or stick configuration and a gun configuration.

As described below, the handheld controller 101 may be configured for use with a variety of different media devices.

Referring now to fig. 28 and 29, in one embodiment, as shown, the body 102 includes a mobile device docking station 2801, the mobile device docking station 2801 being used to releasably physically secure and communicatively connect the mobile device 2802 to the handheld controller 101. The mobile device docking station 2801 may be used to physically secure and communicatively connect the smartphone to the handheld controller 101. Thus, the hand-held controller may be used as a telephone accessory. In this particular example, the mobile device docking station 2801 is disposed on top 130 of the handheld controller 101 and is designed to support the mobile device 2702 such that the body 102 of the handheld controller 101 is unaffected by transitioning between different configurations. As shown in fig. 28, the mobile device 2802 is docked with the handheld controller 101 with the body 102 in a first configuration (the steering wheel configuration shown) and, as shown in fig. 29, the mobile device 2802 is docked with the handheld controller 101 with the body 102 in a second, different configuration (the weapon (gun) configuration shown).

In this particular example, the mobile device docking station 2801 is provided by the multimedia module 2701 or electrically connected to the multimedia module 2701.

Referring now to fig. 30-32, in one embodiment, the body 102 supports at least one speaker. As shown in fig. 30, the body 102 is in a weapon configuration (i.e., a long assault rifle type layout 801) and includes at least one speaker, such as speaker 3001. During play, various audio effects may be output to match actions in the game, for example, when firing a gun, two sounds may be generated, one being a "pop (bang)" sound output by the first speaker 3001 at one location 3002 (toward the firing end of the weapon) and the other being a "shell pop (CARTRIDGE EJECTING)" sound output by the second speaker 3003 at a different location 3004 (toward the handle end of the weapon) (similar to a metallic "click") sound, the different speaker locations outputting a particular sound being selected with reference to where each sound is emitted by a real weapon. As shown in fig. 31, the body 102 is in another weapon configuration (i.e., a pistol-type layout 1101) and supports speakers (not shown) that may be used to output a "pop" sound from location 3002, a "pop" sound from location 3101, and so forth. As shown in fig. 32, the body 102 is in yet another weapon configuration (i.e., a stick-type layout 1201) and supports a speaker layout for outputting sound of "ping (swoosh)" when the handheld controller 101 is moved (e.g., in the direction shown by arrow 3201). It should be appreciated that any suitable audio special effects (SFX) may be provided. The function of the speaker layout is to provide an immersive audio experience to enhance the user experience. One or each of the speakers in the speaker arrangement may be provided by the audiovisual module 2701 or electrically connected to the audiovisual module 2701.

Referring now to fig. 33, in one embodiment, the body 102 of the hand-held controller 101 supports at least one microphone, such as microphone 3301. The microphone may be of any suitable type and may be used for any suitable purpose or purposes. For example, a microphone may be used to record a user's voice, control menu navigation and/or game actions for a particular game platform, control functions of the handheld controller 101, and/or enable the user to communicate with other people at a remote location.

In one embodiment, the body 102 supports at least one camera, for example, camera 3302. The camera may be of any suitable type and may be used for any suitable purpose or purposes. The camera may be an omni-directional camera. The cameras may be RGB or IR cameras.

In one embodiment, the body 102 supports at least one motion sensor, e.g., motion sensor 3303. The motion sensor may be of any suitable type and may be used for any suitable purpose or purposes. The motion sensor may be a gyroscope, an accelerometer, an inertial measurement unit (inertial measurement unit, IMU). The motion sensor may be used to detect the pointing position of the handheld controller 101 and the motion of the handheld controller 101.

For example, the motion sensor may be used to control menu navigation and/or game actions for a particular game platform and/or to control the functionality of the handheld controller 101.

In one embodiment, the body 102 supports at least one haptic actuator sensor, e.g., haptic actuator 3304. The haptic actuator may be of any suitable type and may be used for any suitable purpose or purposes. For example, the haptic actuator may be used to confirm menu selections and/or to provide feedback corresponding to game actions to enhance the user experience.

In one embodiment, the body 102 includes an orientation sensing arrangement, shown generally at 3305, that functions to determine the current orientation of the set of mechanically coupled body components. The position sensing layout may be of any suitable type and may be used for any suitable purpose or purposes.

In one embodiment, the body 102 includes a wireless communication device, shown generally as 3306, that functions to enable wireless communication between the handheld controller 101 and at least one host (shown generally as 3307) that supports wireless communication. For example, the wireless communication enabled host 3307 may be a gaming machine, smart television, AR/VR headset, smart phone, and the like.

In one embodiment, the body 102 includes a binaural renderer, shown generally at 3308, the function of which is to provide an audio output for reproduction by headphones. In one specific example, the function of the binaural renderer is to render sound with reference to the calculated relative positions of the handheld controller 101 and the user's head.

According to this specifically illustrated example, referring again to the previous figures, the base assembly 301 houses the main hardware components, such as a battery, a processor, a haptic feedback actuator, audio drive circuitry, a camera and motion sensor (e.g., gyroscope, accelerometer), and a wireless transmitter such as bluetooth or Wi-Fi. There are different electromechanical connections between the base assembly 301 and the left and right handles 324, 325 and the first primary connection assembly 302. The front face of the base assembly 301 supports an array of input elements 3309.

The first primary connection assembly 302 surrounds the base assembly 302 and supports the audiovisual module 2701 and the array of input elements 310 on its front face. The audio elements may include a stereo microphone and speakers to provide special audio effects to the handheld controller 101. For example, the camera may be an ultra wide angle or omni-directional 360 degree RGB or IR camera that is capable of monitoring/tracking the surrounding environment to identify factors such as user behavior or space factors. Left and right handles 324, 325, which are hinged to base assembly 301 and rotatable 180 degrees (along the Y-axis), do not include any active electronics, but in other examples one or both handles may include active electronics. The right hand grip 325 is important to provide a steering wheel configuration 1401. The second primary connection assembly 303 is axially hinged to the base assembly 301 (along the Y-axis) and further includes an axial hinge joint connected to the first secondary connection assembly 306 (along the X-axis) that is dependent from the other axial joint of the second secondary connection assembly 307 (along the Y-axis). The second secondary connection assembly 307 is axially connected (along the Z-axis) to a third secondary connection assembly 308, and the third secondary connection assembly 308 is also axially connected (along the Y-axis) to a fourth secondary connection assembly 309.

Referring now to fig. 34, there is shown a field of view 3401 of a 360 degree camera 3302 supported on the top 130 of the body 102 of the hand-held controller 101. As shown by line 3402, in this example, the function of camera 3302 is to scan the environment and record 3D data that can be used for gaming. The camera 3302 may be used to monitor the user's movements and surrounding events, especially when a mobile media device (smart phone, VR/AR headset) is used with the handheld controller 101. Camera 3302 may implement depth functionality and may scan the real world spatial environment and convert the spatial environment to a 3D digital representation (simultaneous localization and mapping (Simultaneous Localization AND MAPPING, SLAM)).

Referring now to fig. 35 and 36, the integrated audio functionality provides a number of benefits. As shown in fig. 35, the integration of the head/headphones with the controller may enable binaural rendering within the handheld controller 101.

In one example, the handheld controller 101 receives multi-channel (e.g., 7.1) or object audio, indicated by arrow 3501, from a game console or HMD 3502, calculates (e.g., using IMU sensors in the handheld controller 101) the head orientation of the user 3503 and the position of the handheld controller 101, and renders virtual sound sources (e.g., gunshot from the direction of the handheld controller 101, other sounds from the virtual direction in the game environment) at the correct positions for output to the user's head/headphones 3504, as indicated by arrow 3505.

As shown in fig. 36, in this particular example, the hand-held controller 101 includes an earphone 3601, preferably a pair of truly wireless stereo headphones (TWS earplugs), and the body 102 defines a receiving area shown at 3602 for releasably receiving the earphone 3601. Further, the body 102 includes a charging arrangement (shown at 3603) for charging the headset 3601 when placed in the receiving area 3602.

The binaural function as described above can be achieved by connecting the headset 3601 directly to the handheld controller 101 wirelessly, instead of an external host.

The hand-held controller 101 is preferably used for low latency communications with a wireless headset that is communicatively coupled. The low latency connection is preferably a proprietary connection.

Many game players do not have multi-speaker Hi-Fi audio settings, especially in mobile games. Therefore, the use of headphones to reproduce the game sound directly into the user's ear is an excellent compromise. In fact, headphones are often the only sound effect setting possible to obtain high quality 3D audio. Since augmented reality (xR) games rely heavily on 3D audio to provide the correct audio experience, wireless headphones are preferred as an integral part of the game setup.

In this particular example, in use, the headset 3601 may be "pop-up" from the handheld controller 101 and placed over the user's ear. When not in use, the headset 3601 may be "pushed" into the handheld controller 101 for charging and storage.

One advantage of using a TWS headset integrated into the game controller is that a proprietary RF codec can be used to transfer audio or other data between the handheld controller 101 and the headset 3601, thus achieving much lower latency than allowed by the Bluetooth standard or the like. This will lead to a smoother game experience and better immersion. For 3D audio, the headphones may be equipped with inertial measurement unit (inertial measurement unit, IMU) sensors, which help determine the head orientation of the user (possibly by supplementing xR head-mounted-display (HMD) data).

For example, low latency proprietary connections between IMU sensors (in the TWS headset 3601 and the handheld controller 101), the binaural renderer 3308 (in the handheld controller 101), and playback (the TWS headset 3601) are particularly advantageous for games that require fast response (e.g., first person shooter games).

The handheld controller described herein may have the following features:

A single unit architecture, integration;

An electromechanical structure which is low in price and convenient to manufacture;

The compatibility is strong, the portable (the size is similar to that of the existing single-chip controller), and the portable electronic device can be matched with different media equipment (a display, VR glasses and a smart phone);

A large number of conversion functions (+10 choices);

fast, reliable switching between different configurations (achieved by self-guiding architecture, supported by single-axis joints (without spherical joints);

The option of using a small actuator for electrical switching of the operation mode is also possible by a single-axis joint design;

realistic conversion patterns, realistic profiles of different UI settings (wheels, rifle, pistol, machine gun, knife);

the local support integrates haptic and audio effects.

Claims

1. A handheld controller, characterized in that the handheld controller comprises:

A body supporting an input element layout for detecting user input, wherein the body comprises:

A set of mechanically connected body components convertible between a plurality of different configurations, wherein the body components include:

Basic components;

a plurality of primary connection assemblies, wherein each primary connection assembly is movably fixed to the base assembly via a connection between the primary connection assembly and the base assembly to guide movement of the primary connection assembly relative to the base assembly,

Each primary connection component is directly connected to the base component;

A plurality of secondary connection components, wherein each secondary connection component is movably fixed to the primary connection component or the other secondary connection components through the connection between the secondary connection component and the primary connection component or the other secondary connection components to guide the movement of the secondary connection component relative to the primary connection component or the other secondary connection components, and each secondary connection component is indirectly connected to the base component through at least one primary connection component.

2. The handheld controller according to claim 1, characterized in that the multiple different configurations include at least 3, 4, 5, 6, 7, 8, 9 or 10 different configurations.

3. The handheld controller according to claim 1 or 2, wherein the plurality of different configurations at least comprises:

Game controller configuration;

Steering wheel configuration;

At least one weapon configuration.

4. The handheld controller according to claim 3, wherein the at least one weapon configuration comprises one or more of the following configurations:

Knife or stick configuration;

Gun type configuration.

5. The handheld controller according to any one of claims 1 to 4, characterized in that the handheld controller comprises a primary connection component, and the primary connection component can slide along a single axis relative to the base component.

6. The handheld controller according to any one of claims 1 to 5, characterized in that the handheld controller comprises two or more primary connection components, each of which is rotatable around a single axis relative to the base component.

7. The handheld controller according to claim 6, characterized in that the handheld controller comprises two or more primary connection components, and the two or more primary connection components can rotate around a common axis relative to the base component.

8. A handheld controller according to any one of claims 1 to 7, characterized in that the handheld controller comprises at least one secondary connecting component, wherein the secondary connecting component is movably fixed to the primary connecting component through the connection between the secondary connecting component and the primary connecting component to guide the movement of the secondary connecting component relative to the primary connecting component, and the secondary connecting component is also movably fixed to other secondary connecting components through the connection between the secondary connecting component and other secondary connecting components to guide the movement between the secondary connecting component and the other secondary connecting components.

9. The handheld controller according to any one of claims 1 to 8, wherein the base component has a first end and a second end, and the set of mechanically connected body components comprises:

a first body assembly subset extending from said first end of said base assembly;

A second body assembly subset extends from the second end of the base assembly.

10. The handheld controller according to claim 9, wherein the first main component subset includes a plurality of primary connection components, and the second main component subset includes a primary connection component and a plurality of secondary connection components.

11. A handheld controller according to any one of claims 1 to 10, characterized in that the body includes a power actuator layout, which is selectively operable to activate automatic conversion of the set of mechanically connected body components between different configurations.

12. The handheld controller according to any one of claims 1 to 11, wherein the main body supports at least one of the following:

at least one camera, optionally an omnidirectional camera;

at least one speaker;

microphone;

at least one motion sensor;

Haptic actuator.

13. A handheld controller according to any one of claims 1 to 12, characterized in that the body includes a configuration sensing layout, which is used to sense the relative layout of the body components, thereby determining the current configuration of the set of mechanically connected body components.

14. A handheld controller according to any one of claims 1 to 13, characterized in that the body includes an orientation sensing arrangement for determining a current orientation of the set of mechanically connected body components.

15. The handheld controller according to any one of claims 1 to 14, characterized in that the main body includes a wireless communication device, and the wireless communication device is used to realize wireless communication between the handheld controller and at least one host supporting wireless communication.

16. The handheld controller according to claim 15 is characterized in that the main body includes a binaural renderer, which is used to provide audio output for headphones to reproduce, and the function of the binaural renderer is to render sound with reference to the calculated relative position of the handheld controller and the user's head.

17. The handheld controller according to claim 15 or 16, characterized in that the handheld controller is used to perform low-latency communication with a wireless headset in communication connection.

18. The handheld controller according to any one of claims 1 to 17, characterized in that the handheld controller includes a pair of true wireless stereo headphones, and the main body defines a receiving area for releasably receiving the pair of true wireless stereo headphones.

19. The handheld controller according to claim 18, wherein the main body comprises a charging layout for charging the headset when the headset is placed in the receiving area.

20. The handheld controller according to any one of claims 1 to 19, wherein the main body comprises a mobile device docking station, wherein the mobile device docking station is used to releasably physically fix and communicatively connect a mobile device to the handheld controller.

21. The handheld controller according to any one of claims 1 to 20, wherein the input element arrangement comprises a plurality of buttons.

22. A method of assembling a handheld controller, wherein the handheld controller includes a body supporting an arrangement of input elements for detecting user input, the method comprising:

The body is assembled by connecting a plurality of body components to form a set of mechanically connected body components convertible between a plurality of different configurations, such that:

A first plurality of body assemblies among the body assemblies are directly connected to a base assembly among the plurality of body assemblies, respectively, and each body assembly among the first plurality of body assemblies is movably fixed to the base assembly through a connection between the body assembly and the base assembly to guide movement of the body assembly relative to the base assembly;

A second plurality of body components among the body components are indirectly connected to the base component through at least one body component among the first plurality of body components, and each body component among the second plurality of body components is movably fixed to the body component among the first plurality of body components or the other body components among the second plurality of body components through the connection between the body component and the body components among the first plurality of body components or the other body components among the second plurality of body components to guide the movement of the body components among the second plurality of body components relative to the body components among the first plurality of body components or the second plurality of body components.

23. The method of claim 22, wherein the plurality of different configurations comprises at least 3, 4, 5, 6, 7, 8, 9 or 10 different configurations.

24. The method according to claim 22 or 23, characterized in that the multiple different configurations at least include:

Game controller configuration;

Steering wheel configuration;

At least one weapon configuration.

25. The method of claim 24, wherein the at least one weapon configuration comprises one or more of the following configurations:

Knife or stick configuration;

Gun type configuration.