Documentation
Real-time Audio and Video
Function Overview

Function Overview

Last updated：2025-02-12 20:16

ZEGO Express SDKs provide rich APIs for you to quickly build audio/video calling and live streaming capabilities into your applications based on ZEGO's cloud live streaming platform. With a powerful audio/video processing engine and a global real-time network, the platform is providing high-quality and reliable cloud audio/video streaming services to businesses around the world.

ZEGO Express SDKs are available for all major platforms, including Android, iOS, Mac, Windows, and Web.

Method	Description
uploadLog	Upload local logs
setRoomScenario	set room scenario
destroyEngine	destroy Engine.
setGeoFence	Set Geo Fence.
setEngineOptions	Set engine advanced configuration.
use	Import module, you can import other modules on demand through this interface.
setTurnServer	Turn server configuration for proxy.
callExperimentalAPI	The error log information alert indicates that the default test environment is all on
checkSystemRequirements	Support capability detection interface
off	Delete the registered callback event
on	Register callback event
enableMultiRoom	turn on multi room mode
presetLogConfig	Default log configuration
setLogConfig	Advanced log configuration
setCloudProxyConfig	Set up cloud proxy configuration.
setLocalProxyConfig	Set local proxy configuration.
setDebugVerbose	The error log information alert indicates that the default test environment is all on
getVersion	Get the current SDK version

Room functions

Method	Description
loginRoom	Login room
switchRoom	switch room
logoutRoom	Exit the room and no longer accept various state in the room
renewToken	Update room permission token
setRoomExtraInfo	Set room extra information

Stream Publishing Functions

Method	Description
createStreamCompositor	Create a broadcast station
setSEIConfig	Set SEI related configuration information
setEngineConfig	Set engine advanced configuration.
createStream	Create push streaming data sources, including camera microphone collection source data, screen sharing data, third-party source data (other source data that can be played on the page)
createZegoStream	Create an instance of the push object ZegoLocalStream. The integrated functions of ZegoLocalStream include camera microphone capture, screen sharing capture, third-party source data (other source data that can be played on the page), and playback preview of the collected stream.
updatePublishingStream	Used to update audio and video tracks of ZegoLocalStream instances that are being pushed
getPublishingStreamQuality	Get the publishing stream quality.
getElectronScreenSources	Called when screen sharing is required in the electron framework to return screen list data
destroyStream	Destroy the created stream data
checkVideoTrackIsActive	Check whether the video track is active.
checkAudioTrackIsActive	Check whether the audio track is active.
startPublishingStream	Start publishing stream
stopPublishingStream	Stop pushing the local stream to the remote end (Zego server)
sendSEI	Sends Supplemental Enhancement Information.
setVideoConfig	Modify push streaming parameters
setAudioConfig	Modify the relevant parameters of push streaming audio
replaceTrack	Replace the audio and video tracks of the media stream
addTrack	Add an audio or video track to a media stream.
removeTrack	Remove video track from media stream.
setCaptureVolume	After the stream is created, the volume can be adjusted through this interface
setDummyCaptureImagePath	Set the path of the still picture to be pushed off
setStreamExtraInfo	Set additional information for the stream
addPublishCdnUrl	Notify the instant server to forward the stream to the CDN
removePublishCdnUrl	Notify the instant server to stop forwarding the stream to the CDN
mutePublishStreamVideo	Close/open the streaming screen being pushed
mutePublishStreamAudio	Turn on/off the streaming sound that is being pushed, including the sound of the microphone and mixed background music
setEffectsBeauty	Turn beauty effect on or off
setLowlightEnhancement	Set low light enhancement.
enableDualStream	enable dual stream
setLowStreamParameter	set low stream parameter
enableHardwareEncoder	On/off hardware encoding.
enableAutoSwitchDevice	Turn on or off automatic switching of related devices
initBackgroundModule	Initialize the background processing module.
setBackgroundBlurOptions	Set parameters for background blur of the stream.
setVirtualBackgroundOptions	Set virtual background related processing parameters.
setTransparentBackgroundOptions	Set transparent background related processing parameters.
enableBackgroundProcess	Turn on background processing.
setVoiceChangerParam	Sound modification processing.
setVoiceChangerPreset	Sound modification processing.
setReverbPreset	Set reverb via preset enum.
enableVirtualStereo	Enable or disable the virtual stereo effect when streaming.
enableAiDenoise	Incoming media stream, turn AI noise reduction on or off
setAiDenoiseMode	Incoming media stream, turn AI noise reduction on or off
setStreamAlignmentProperty	Turn on or off the mixed flow precise alignment function.
playAudio	Play a audio of the media stream to be pushed or that has been pushed on the page.
playCaptureAudio	Plays the latest media stream audio that is being captured.
playCaptureVideo	Plays a video of the latest media stream being captured on the page.
playVideo	Play a video of the media stream to be pushed or that has been pushed on the page.
stopAudio	Stop playing the audio in the stream to be pushed or being pushed.
stopCaptureAudio	Stop capturing audio.
stopCaptureVideo	Stop capturing video.
stopPlayCaptureAudio	Stop playing the audio of the latest captured media stream.
stopPlayCaptureVideo	Stop the page from playing all the latest streaming videos that are being captured.
stopVideo	Stop playing the video in the stream to be pushed or being pushed.
resumeAudio	Restore the audio that is being pushed or is being pushed on the playback page.
resumeVideo	Restore the video that is being pushed or is being pushed on the playback page.
startCaptureCamera	Start capturing camera video stream.
startCaptureCameraAndMicrophone	Start capturing camera and microphone stream.
startCaptureCustomAudio	Start capturing custom audio stream.
startCaptureCustomVideo	Start capturing custom video stream.
startCaptureCustomVideoAndAudio	Start capturing custom video and audio stream.
startCaptureMicrophone	Start capturing microphone audio stream.
startCaptureScreen	Start capturing the screen sharing video stream.
startCaptureScreenWithAudio	Start capturing the screen sharing video and sharing audio stream.
setVolume	Set the volume at which to play the audio that is being pushed or is being streamed.
useAudioOutputDevice	Switch the audio output device.
on	Register callback event.
off	Unregister callback events.
takeStreamSnapshot	Client screenshot

Stream Playing Functions

Method	Description
setCaptureAudioFrameCallback	Set the callback for streaming raw audio data
startPlayingStream	Start playing stream
stopPlayingStream	Stop pulling remote streams (Zego server)
mutePlayStreamVideo	Stop or resume pulling video stream
setAudioFrameCallback	Set the callback for streaming raw audio data
setPlayStreamVideoType	Set the play video stream type
muteAllPlayAudioStreams	Whether the pull stream receives all audio data (including newly pulled streams in the room later)
muteAllPlayVideoStreams	Whether the pull stream receives all audio data (including newly pulled streams in the room later)
mutePlayStreamAudio	Stop or resume pulling audio streams
getPlayingStreamQuality	Get the playing stream quality.

Instant Messaging Functions

Method	Description
sendBarrageMessage	Send room barrage message, the message is not guaranteed to be reliable
sendBroadcastMessage	Send broadcast message (messages are guaranteed to be reliable)
sendCustomCommand	send custom command, the message is reliable

Stream Mixing Functions

Method	Description
startAutoMixerTask	Start auto mixer task
startMixerTask	Start mixer task
stopAutoMixerTask	Stop server-side mixer task
stopMixerTask	Stop server-side mixer task
setMixerTaskConfig	Mixed flow advanced configuration

Audio Mixing Functions

Method	Description
startMixingAudio	Start Mixing Audio
stopMixingAudio	Stop mixing audio
setMixingAudioVolume	Set the mixing volume
enableLiveAudioEffect	Enables or disables the sound enhancement.
setAudioChangerParam	The incoming audio is altered.

Device Management Functions

Method	Description
enableVideoCaptureDevice	Turn on/off the video capture device.
enumDevices	Obtain the device hardware information and provide the device id parameter for operating the hardware device interface.
getCameras	Get the list of camera devices and provide the device id parameter for operating the hardware device interface.
getMicrophones	Get the list of microphone devices and provide the device id parameter for operating the hardware device interface.
getSpeakers	Get the list of speaker devices and provide the device id parameter for operating the hardware device interface.
useFrontCamera	Switch camera
useVideoDevice	Switch camera
useAudioDevice	Switch microphone
useAudioOutputDevice	Switch the audio output device.
setSoundLevelDelegate	Set whether to monitor the sound wave and the sound wave callback interval
isMicrophoneMuted	Get microphone mute status
muteMicrophone	mute microphone

Stream View

Method	Description
play	Play the audio and video of the media stream on the page.
stop	Stop showing audio and video on the page.
resume	Resume playing audio and video on the page.
setAudioMuted	Switch audio playback.
setVideoMuted	Switch video playback.
useAudioOutputDevice	Switch the audio output device.
setVolume	Set the audio playback volume.
on	Register callback event.
off	Unregister callback events.
takeStreamSnapshot	Client screenshot
createLocalStreamView	Create a local media stream player component instance object.
createRemoteStreamView	Create a remote media stream player component instance object.

Audio Effect Player

Method	Description
start	Start playing sound effects.
stop	Stop playing sound effects.
pause	Start playing sound effects.
resume	Resume playing sound.
setVolume	Setting the playback volume of a single sound effect will set both the local playback volume and the streaming volume.
getTotalDuration	Get the total duration of the specified sound effect resource.
getCurrentProgress	Get the current playback progress.
seekTo	Set the playback progress.
createAudioEffectPlayer	Create a audio effect player instance.
loadAudioEffect	Load sound resources.
unloadAudioEffect	Unload the sound resource.

Range Audio Functions

Method	Description
createRangeAudioInstance	Create a range voice instance object.
setVoiceChangerParam
setVoiceChangerPreset
enableAudioSourceUpdateChecker	Whether to check for changes to users in range.
on	Register callback event.
off	Unregister callback events.
setAudioReceiveRange	Set the maximum range of audio reception distances.
updateSelfPosition	Update the position and orientation of the listener.
updateAudioSource	Add or update sound source position information.
enableSpatializer	Switch Spatializer.
enableMicrophone	Switch microphone.
selectMicrophone	Specifies the microphone device.
selectSpeaker	Specifies the speaker device.
enableSpeaker	Switch speaker.
setRangeAudioCustomMode	High-level customization mode for setting range voices.
setRangeAudioMode	Set the range audio mode.
setTeamID	Set the team ID.
setPositionUpdateFrequency	Set how often the location is updated in real-time inside the SDK.
setRangeAudioVolume	Set the local playback volume of the range audio.
enableAiDenoise	Scope Voice turns AI noise reduction on or off.
isAudioContextRunning	Determine whether the AudioContext object is enabled.
resumeAudioContext	Enable the internal AudioContext object.
setStreamVocalRange	Set the streaming audio sending range.
updateStreamPosition	Update the position of the pull stream.
setCustomSourceVocalRange	Set custom sound source send range.
updateCustomSourcePosition	Add or update custom sound source location information.

Copyrighted Music

Method	Description
initCopyrightedMusic	Initialize the copyright music module.
on	Register callback event.
sendExtendedRequest	Send an extension feature request.
requestResource	Send an extension feature request.
getSharedResource	Get shared song resources.
getLrcLyric	Get the lyrics in lrc format.
getKrcLyricByToken	Get lyrics in krc format.
download	Download a song or accompaniment.
clearCache	Clear song cache.
startScore	Start Scoring.
stopScore	Stop Scoring.
pauseScore	pause scoring.
resumeScore	resume scoring.
resetScore	reset the score.
getPreviousScore	Get the score of the previous sentence.
getAverageScore	Get the average rating.
getTotalScore	Get the total score.
getFullScore	Get full marks.
getStandardPitch	Get standard pitch data.
getCurrentPitch	Get real-time pitch data.
setScoringLevel	Set the scoring difficulty level.
createCopyrightedMusic	Create a copyrighted music instance object.
destroyCopyrightedMusic	Destroy a copyrighted music instance object.

Real-Time Sequential Data

Method	Description
createRealTimeSequentialDataManager	Create real-time sequential data instance objects
destroyRealTimeSequentialDataManager	destroy real-time sequential data instance objects
startBroadcasting	start Broadcasting
stopBroadcasting	stop Broadcasting
sendRealTimeSequentialData	send RealTime Sequential Data
startSubscribing	start Subscribing
stopSubscribing	stopSubscribing
on	Register callback event.
off	Unregister callback events.

Player plug-in (Separate integration)

Method	Description
ZegoExpressPlayer	Player plug-in constructor
destroy	Destroy player
fullScreen	Player plays in full screen
getPlayQuality	Player get quality
onCanPlay	Player CDN resource playable callback
onError	Player error callback
onLoaded	CDN resource loading end callback
onMediaInfoUpdate	Playback CDN resource media information update callback
onPaused	Player rendering pause callback
onPlay	Player rendering (play resource) starts callback
onPlaying	Playback loads enough data that playback can be resumed.
onRecvSEI	A callback when the player receives SEI data
onResetPlayQuality	A callback when the player resets the streaming quality statistics
onTimeUpdate	Callback for current playback time change
onWaiting	Playback has stopped due to temporary lack of data.
pause	The player starts playing
play	The player starts playing
resume	The player re-pulls the current CDN live stream.
setBufferInterval
setMuted	Player settings playback mute switch
setVolume	Player volume settings
stop	Stop playing the resource and no longer load the currently specified media
verify	Player authentication