Musical stems
Isolate vocals, bass, drums, guitars, strings, piano, keys, and wind from any audio file using AI algorithms.
DetailsYour toolbox for creative control
Music AI Portal Modules
Our Developer Platform lays out Modules as fundamental building blocks, and each component can be used to build your application. Sorted into categories based on their functionalities, the Modules condense advanced technology into units of musical potency.
Stem Separation Modules
The individual music source separation components that can be used to build your application.
Cinematic stems
Isolate vocals, effects, and music stems from any audio file, tailored for film and video industry post-production.
DetailsVocals stems
Isolate lead and backing vocals from any audio file with high precision.
DetailsGuitar parts
Isolate rhythm and solo guitar parts from any audio file.
DetailsDrum stems
Isolate individual drum sounds including kick drums, snares, toms, hi-hats, and cymbals from any drum audio file.
DetailsInstrumental stem
Isolate the instrumental stem from any audio file.
DetailsGuitar stems
Separate acoustic and electric guitars from any audio file with the remaining audio elements contained in a separate output.
DetailsTranscription Modules
The individual AI transcription components that can be used to build your application.
BPM
Transcribe beats and calculate the tempo (beats per minute) from an input audio file, providing you with useful information for reproducing the rhythm of the track.
DetailsChords
Transcribe chords and root key from audio, providing a timeline of chord annotations in different classes (e.g., Complex Jazz, Simple Jazz, Complex Pop and Simple Pop) and bass detection.
DetailsSections
Segment audio files into sections with annotated labels.
DetailsLyrics
Transcribe and align Lyrics from any audio file, converting sung content into textual form. This model is optimized for transcribing singing. For speech transcription, please use the Speech Transcription module.
DetailsSpeech
Transcribe and align Speech from any audio file. Converting spoken content into textual form. This model is optimized for speech transcription. For singing/lyrics transcription, please use the Lyrics Transcription module.
DetailsTranslation
Translate transcriptions (speech or lyrics) to the desired language.
DetailsMixing Modules
The individual audio mixing component that can be used to build your application.
Audio mixer
Mix a collection of audio channels, customizing individual channel volumes and phase inversion.
DetailsVideo mixer
Generate videos mixed with audio and subtitles.
DetailsAutomix (By RoEx)
AI-powered multitrack mixing: Work with up to 8 channels and achieve a professional, balanced mix.
DetailsMastering Modules
The individual audio mastering component that can be used to build your application.
Mastering
Master the audio using another reference mastering allowing customization of bit depth, normalization, and limiting.
DetailsAI Mastering
Generate a mastered version of input audio using advanced AI algorithms.
DetailsSpatial upmixing
Spacial mastering of stereo refrences and stems, powered by Masterchannel.
DetailsGenerators Modules
The individual metronome generation component that can be used to build your application.
Metronome
Generate metronome audio based on the input beat map, allowing customization of speed and choice of metronome sound.
DetailsText-to-speech
Convert text to speech with the option to translate to another language. It includes two demo voices (Male and Female). To train your own voice model, please contact sales.
DetailsEncoding Modules
The individual encoding components that can be used to build your application.
Audio encoder
Convert and encode the input audio file to a different format, bit rate, sample rate, and number of channels, supporting various common audio codecs and formats.
DetailsCSV encoder
Convert JSON to CSV format.
DetailsSubtitle encoder
Convert and encode the input subtitle file to a different format, supporting various common subtitle formats.
DetailsEffects Modules
The individual effects components that can be used to build your application.
Dynamic limiter
Apply a dynamic range limiter to control and limit audio signal loudness (iLUFS) while preserving dynamic range.
DetailsLimiter
Apply a limiter to selectively control signal peaks while preserving sound quality.
DetailsNormalize
Normalize audio adjusting peak volume levels to the specified decibel (dB) value, while maintaining the dynamics and balance of the original audio.
DetailsOverdrive
Apply the Overdrive effect to amplify audio, adding a rich, powerful, and slightly distorted tone.
DetailsPitch shift
Adjust the pitch of audio, shifting up or down by a specified number of cents.
DetailsReverb
Add the reverb effect to an audio file, simulating the sound reflections and reverberations within a room, hall or space while allowing customization of various parameters.
DetailsReverse
Reverse the audio file so that it plays backward from the end to the beginning without affecting other audio properties.
DetailsSpeed
Adjust the playback speed of the audio, using a customizable factor ranging from 0 to 10. This will modify both the audio's tempo and pitch. If you prefer to maintain the original pitch, consider using the Tempo effect instead.
DetailsTempo
Adjust the tempo of the audio file without affecting pitch, using a customizable factor ranging from 0 to 10.
DetailsUtilities Modules
The individual music utilities components that can be used to build your application.
Static file
A static input that will use a single file for processing. A helpful ingredient when reference mastering.
DetailsSegment
Extract a specified segment from an audio file, retaining chosen duration starting from a designated point in time.
DetailsSegments
Extract segments from an audio file based on a segment array with 'start' and 'end' properties
DetailsVocal pitch shift suggestion
Compute pitch shift suggestions based on vocal range map and input audio target.
DetailsLyrics and speech alignment
Match audio containing speech or singing with corresponding subtitle lines or words, providing word-by-word and line-by-line aligned data in JSON format.
DetailsAudio activity detection
Generate a timeline marking periods of audio activity.
DetailsPad
Add silence to the beginning and/or end of your audio file to create space before and after the audio content.
DetailsClassification Modules
The individual classification components that can be used to build your application.
Vocal pitch map
Compute and return vocal pitch from audio(s), providing a pitch map for each MIDI key from 0 to 127.
DetailsAudio tagging
Classify audio segments for simplified metadata management and content discovery.
DetailsSynthetic voice detection
Classify AI-generated audio content, particularly focusing on AI-Generated vocals.
DetailsLanguage identification
Classify AI-generated audio content, particularly focusing on AI-Generated vocals.
DetailsFile metadata
Extract media file metadata including duration, sample rate, channel count, bit depth, and codec.
DetailsMusic metadata
Provide deep insights into music tracks for advanced categorization and analysis, powered by Cyanite.ai.
DetailsMusic presence
Detect music presence in audio files.
DetailsEnhancement Modules
The individual enhancement components that can be used to build your application.
Vocals upsampling
This module processes voice recordings for both speech or singing, and upsamples them to 48 KHz.
DetailsSpeech noise suppression
Remove background noise from voice recordings. It is useful for cleaning up recordings made in noisy environments, such as a busy street or a crowded restaurant.
DetailsStyle Transfer Modules
The individual style transfer components that can be used to build your application.
Source separation metrics
Provide comprehensive metrics for audio source separation quality including SDR, SI-SDR, SNR, and SI-SNR.
DetailsVoice transfer
Transfer the timbre from one voice to another. Currently supporting two demo voices. To train your own voice transfer model (Private model ID), please contact sales.
DetailsIO Modules
The individual input/output components that can be used to build your application.
Ready to take your project to the next level?
Start now — or reach out for assistance.