[Multiplayer] Voice chat ported from OMP #1913

yohjimane · 2025-07-09T05:06:16Z

Core Features

Real-time voice communication with Opus codec integration for high-quality audio compression
Distance-based voice attenuation with dynamic range adjustment
Push-to-talk controls with configurable key bindings (kVOICE_CHAT, kVOICE_DISTANCE)
Visual indicator, microphone icon in main HUD
Cross-platform audio support with input device selection

Technical Implementation

Audio Libraries: Integrated Opus 1.5.2 and SpeexDSP 1.2.1 for professional-grade audio processing
Voice Classes:
- VoiceChat - Main voice chat management
- VoiceSender - Voice transmission handling
- Voice packet processing in xrServer
UI Integration: Added voice indicators to UIMainIngameWnd and UIGameCustom

Ported from OMP commit 62b3da92837c44b3bae66b7f07677e56fee9c83b

Ported from OMP commit 41d8c755a81dd93c342dc5945ad20149908d7028

…ects Ported from OMP commit df2fbd07b8b58c25693b2617da01250a7d043fc5

Ported from OMP commit 6b2a0d57be1510ebfec4c842e2a8f20478299e5d

…all bypassing parent class Ported from OMP commit 1828ca4810a7c10abc746f9a3986ca416f68bdec

Ported from OMP commit 04ebdfeba25a1fc8fed8ab3c8ab9d44e13865c6c

Ported from OMP commit 5803358d8beae8511593ae307573fe983069bf09

yohjimane · 2025-07-09T05:09:26Z

I think the audio input selection is a little bugged, but I'm able to transmit my voice in any multiplayer mode and hear it on my wife's PC with this update 😃

- Move upgrade manager from alife_simulator to Level for MP support - Add inventory::upgrade::Manager to Level class - Initialize upgrade manager in OnAlifeSimulatorLoaded for server/single - Initialize upgrade manager in Load_GameSpecific_Before for clients - Add proper cleanup in Level destructor Source: OMP commit 37300539

- Remove ai().get_alife() checks from UIActorMenuInitialize.cpp - Remove ai().get_alife() checks from UIInvUpgradeProperty.cpp - Remove ai().get_alife() checks from UIInventoryUpgradeWnd.cpp - Update inventory_item_upgrade.cpp to use Level().UpgradeManager() - Remove single player only restriction from net_Spawn_install_upgrades Source: OMP commit b70a5582

- Add game_cl_freemp_messages.cpp for client-side repair success handling - Add game_sv_freemp_upgrade_and_repair.cpp for server-side repair logic - Add TranslateGameMessage method to game_cl_freemp.h/cpp - Add OnPlayerRepairItem method to game_sv_freemp.h/cpp - Add GE_REPAIR_ITEM case to inventory_item.cpp OnEvent method - Add OnSuccessRepairMP method to UIActorMenu.h and UIActorMenuUpgrade.cpp - Modify UIActorMenu_script.cpp RepairEffect_CurItem for MP support - Add GE_REPAIR_ITEM, GAME_EVENT_MP_REPAIR, GAME_EVENT_MP_REPAIR_SUCCESS constants - Add GE_REPAIR_ITEM server processing in xrServer_process_event.cpp Source: OMP commit 5ede6c85

- Comment out m_preconditions() call to prevent crash during testing - Comment out m_effects() call to prevent crash during testing - Comment out m_prerequisites() call to prevent crash during testing - These calls were apparently for testing function validity only Source: OMP commit f86314c9

- Add OnPlayerInstallUpgrade server-side handling in game_sv_freemp - Add client-side upgrade success handling in game_cl_freemp_messages - Add GAME_EVENT_MP_INSTALL_UPGRADE and GAME_EVENT_MP_INSTALL_UPGRADE_SUCCESS - Add OnSuccessUpgradeInstallMP method to UIActorMenu - Add upgrade_install_mp method to inventory upgrade manager - Modify net_Spawn_install_upgrades to use MP-specific upgrade installation - Add can_upgrade_install method to upgrade manager - Update init_install to handle both single and multiplayer modes Source: OMP commit 686fef02

- Add GE_WPN_UNLOAD_AMMO and GE_WPN_UPDATE_AMMO message types - Modify UnloadMagazine to handle MP with proper ammo synchronization - Add OnEvent method to CWeaponMagazined for MP ammo handling - Add UnloadWeapon method to UIActorMenu for client-server communication - Remove IsGameTypeSingle() restriction from weapon unload UI - Update weapon unload calls to use new UnloadWeapon method - Add server broadcast for weapon unload events Source: OMP commit 24dfa253

Port of OMP commit d4fb5f79e3c2db47fb1b01843bfe138e96dfcb0c

Added M_VOICE_MESSAGE handling with distance-based voice chat relay. Includes OnVoiceMessage method that forwards voice packets to nearby players. Port of OMP commit c30024739a81730dcef9a96e97dc043e3ba4da74

Added voice chat UI elements for multiplayer: - Microphone icon with active/inactive states - Voice distance text display - SetActiveVoiceIcon and SetVoiceDistance methods Port of OMP commit af9b7c6ed86da3722a2dea7c1ba2abe6106712bb

Added method to check if any dialogs are currently shown. Returns true if ActorMenu, PdaMenu, or TalkMenu is shown. Port of OMP commit e39534a6b64e0e1262bc0497e07cefef882c2f93

Added button actions for voice chat functionality: - kVOICE_CHAT for activating voice chat - kVOICE_DISTANCE for switching voice distance Port of OMP commit 4c8baf78230ec3e786fd2dad9bee6ccfbcfdd5cc

Class for sending voice packets over network with distance settings. Implements IVoicePacketSender interface for voice chat system. Port of OMP commit b2d3e8320ab895c81a584ebbfe18a6fb9b1db000

Created VoiceChat class for handling voice communication in multiplayer. Added AF_DISPLAY_VOICE_ICON actor flag for voice indicator display. VoiceChat includes distance switching, message handling, and voice icons. Combined ports of OMP commits: - d53e7c2d12ea600a078a05dc8d1469dbc37b4952 (actor flag) - 9c544b1101af66b9ea7ce89f6bc812269ec888f1 (VoiceChat class)

Added complete voice chat functionality to FreeMP game mode: - Voice message handling in Level_network_messages - OnVoiceMessage virtual method in game_cl_base - VoiceChat integration in game_cl_freemp with keyboard controls - Distance switching, voice icons, and network message processing Port of OMP commit 5d7198eeeda7d7e2719655c61733debd00119ce9

Added OnScreenResolutionChanged virtual method to game_cl_base and implemented it in game_cl_freemp to restore voice distance UI after screen resolution changes. HUDManager already calls Game().OnScreenResolutionChanged(). Port of OMP commit d2832530849f39b93a8f3fcb1359a71b33fa8873

…grade manager

Added SpeexDSP libraries for voice chat audio preprocessing: - 64-bit and 32-bit Windows DLLs (libspeexdsp-1.dll) - Import libraries (speexdsp.lib) - Complete header files for echo cancellation, preprocessing, and resampling This enables voice chat audio processing capabilities for multiplayer voice communication features.

- Added opus headers (opus.h, opus_custom.h, opus_defines.h, opus_multistream.h, opus_projection.h, opus_types.h) - Added opus libraries for x64 and x86 architectures - Added opus DLL binaries for x64 and x86 architectures - Required for voice chat audio compression in multiplayer mode Ported from OMP engine commit 981dde9d677a51bb99fa6a49cf21e2972fc5331c

- Add ISoundVoiceChat forward declaration to Sound.h - Add GetSoundVoiceChat() method to ISoundManager interface - Add SoundVoiceChat member to CSoundRender_CoreA class - Initialize SoundVoiceChat in _initialize() and cleanup in _clear() - Override update() method in CSoundRender_CoreA to call SoundVoiceChat::Update() - Fix SoundVoiceChat.h to use proper <al.h>/<alc.h> includes - Add missing ISoundRecorder.h and IStreamPlayer.h to xrSound.vcxproj - Minor cleanup in SoundVoiceChat.cpp and VoiceChat.cpp This enables xrGame to access voice chat functionality through the sound system via GetSoundVoiceChat() method, providing the foundation for voice communication in multiplayer gameplay. Ported from OMP commit: 4bf5824db4d7a36a878b960f0d802f73b778e0c5

yohjimane added 7 commits July 3, 2025 00:25

[xrGame] Artefact.cpp - removed artifact particles in legs for FMP mode

9d942f8

Ported from OMP commit 62b3da92837c44b3bae66b7f07677e56fee9c83b

[xrGame] Actor - added hit marks from mutants for multiplayer

55dcbae

Ported from OMP commit 41d8c755a81dd93c342dc5945ad20149908d7028

[xrGame] game_cl_freemp - added faction synchronization for Actor obj…

e2751a8

…ects Ported from OMP commit df2fbd07b8b58c25693b2617da01250a7d043fc5

[xrGame] UIActorMenu - improved characterInfo display for FMP mode

e0a4008

Ported from OMP commit 6b2a0d57be1510ebfec4c842e2a8f20478299e5d

[xrGame] game_cl_freemp - added game_cl_GameState::shedule_Update() c…

1a6627e

…all bypassing parent class Ported from OMP commit 1828ca4810a7c10abc746f9a3986ca416f68bdec

[xrGame] game_sv_freemp - added AddMoneyToPlayer method

a247595

Ported from OMP commit 04ebdfeba25a1fc8fed8ab3c8ab9d44e13865c6c

[xrUICore] UIListBox - removed StringTable().translate() in AddTextItem

66ea6e4

Ported from OMP commit 5803358d8beae8511593ae307573fe983069bf09

yohjimane requested a review from Masterkatze as a code owner July 9, 2025 05:06

github-project-automation bot added this to Roadmap Jul 9, 2025

github-actions bot added Sound UI External (3rd party) This issue is related to external component used by our project. Game assets A feature or an issue that involves gamedata change labels Jul 9, 2025

yohjimane added 16 commits July 8, 2025 22:19

[xrSound] Created interfaces for main voice chat classes

1d9d3ab

Port of OMP commit d4fb5f79e3c2db47fb1b01843bfe138e96dfcb0c

[xrGame] Implemented voice packet processing in xrServer

e6ff841

Added M_VOICE_MESSAGE handling with distance-based voice chat relay. Includes OnVoiceMessage method that forwards voice packets to nearby players. Port of OMP commit c30024739a81730dcef9a96e97dc043e3ba4da74

[xrGame] CUIGameCustom - added HasShownDialogs() method

affc750

Added method to check if any dialogs are currently shown. Returns true if ActorMenu, PdaMenu, or TalkMenu is shown. Port of OMP commit e39534a6b64e0e1262bc0497e07cefef882c2f93

[xrGame] Added voice chat action keys kVOICE_CHAT, kVOICE_DISTANCE

0a70f6b

Added button actions for voice chat functionality: - kVOICE_CHAT for activating voice chat - kVOICE_DISTANCE for switching voice distance Port of OMP commit 4c8baf78230ec3e786fd2dad9bee6ccfbcfdd5cc

[xrGame] Created VoiceSender class

0bd7dc1

Class for sending voice packets over network with distance settings. Implements IVoicePacketSender interface for voice chat system. Port of OMP commit b2d3e8320ab895c81a584ebbfe18a6fb9b1db000

Fixed build after claude cherry-picked commits

f580bf3

yohjimane added 4 commits July 8, 2025 22:21

Fix crash when launching original multiplayer modes due to missing up…

b097bf7

…grade manager

Fix build

617715d

[Gamedata] necessary files and changes for voice chat

e893268

Enable voicechat in all mp modes

a4a8ca4

yohjimane force-pushed the yohji/feat/multiplayer-pt2 branch from fbaefcf to aab3c02 Compare July 9, 2025 05:24

yohjimane added 9 commits July 8, 2025 22:26

[xrSound] Add opus and libspeexdsp as dependencies

1583ab0

[xrSound] Add new voicechat files to project

0676246

[Gamedata] Add vanilla ui_mm_opt_sound.script

d7b72bf

[Gamedata/xrEngine/xrSound] Add option for input device

956089b

Fix release master gold build, fixed incorrect name for opus dll file

5b41d80

[xrGame] Fix voice chat, enable it for all mp modes

c9e0fa4

yohjimane force-pushed the yohji/feat/multiplayer-pt2 branch from aab3c02 to c9e0fa4 Compare July 9, 2025 05:26

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

[Multiplayer] Voice chat ported from OMP #1913

[Multiplayer] Voice chat ported from OMP #1913

Uh oh!

yohjimane commented Jul 9, 2025 •

edited

Loading

Uh oh!

yohjimane commented Jul 9, 2025

Uh oh!

Uh oh!

Uh oh!

[Multiplayer] Voice chat ported from OMP #1913

Are you sure you want to change the base?

[Multiplayer] Voice chat ported from OMP #1913

Uh oh!

Conversation

yohjimane commented Jul 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Core Features

Technical Implementation

Uh oh!

yohjimane commented Jul 9, 2025

Uh oh!

Uh oh!

yohjimane commented Jul 9, 2025 •

edited

Loading