Editing Surround Sound with Kdenlive¶

At the time of writing, Kdenlive only supports rendering a project to a video containing stereo audio. It is not possible to render to more audio channels or to explicitly map audio tracks to channels in the rendered audio. In order to edit and create surround sound, some manual steps, including external tools, are required.

This guide is using a six-channel 5.1 surround sound as example.

External Tools Used Here¶

Audacity - Free Audio Editor and Recorder
avconv - A Video and Audio Converter

Bemerkung

Kdenlive uses ffmpeg, while on (k)ubuntu, ffmpeg is deprecated and avconv is used instead. So these (and possibly other) distributions already have avconv installed.

Creating New Surround Sound¶

This guide describes one possible workaround using Audacity to create and render a 5.1 surround sound audio track that can be added to the video rendered by Kdenlive.

Bemerkung

More advanced features such as surround panning (i.e. let a sound move from rear to front) are beyond the capabilities of Audacity - but it is possible to create similar effects manually.

Create and Edit Surround Sound with Audacity¶

The following example of a simple 5.1 surround sound is used in this guide:

Some original field recording from the front (stereo)
Some voice from the (front) center (mono)
Some music from the rear (stereo)

If, like in this example, some original field recording from a video clip is supposed to be used to create the surround sound audio track, it can be easily extracted using Kdenlive with Extract Audio ‣ Wav 48000Hz from the context menu of the clip. This creates a WAV audio file in the same folder where the video clip is located.

The audio clips to be used in this example are:

Field.wav (stereo) for Front L+R
Voice.wav (mono) for Center
Music.mp3 (stereo) for Surround L+R (rear)

In a new Audacity project, they can be imported in the above order with Menu ‣ File ‣ Import ‣ Audio…, the project should now look something like this:

The channel mapping for 5.1 surround sound is:

1 - Front Left
2 - Front Right
3 - Center
4 - LFE
5 - Surround Left
6 - Surround Right

Bemerkung

LFE is often referred to as „subwoofer channel“, which is not quite correct. A surround sound speaker setup is perfectly valid without subwoofer. In this case the surround sound system will redirect the LFE channel to „large“ speakers, usually the front speakers.

The stereo track „Field“ can now be mapped to Front L+R, „Voice“ to Center and „Music“ to Surround L+R. There is just one problem: the Surround (rear) speakers of a surround speaker system are usually „small“ and not able to reproduce low frequencies. So it would be necessary to map the low frequency range of the „Music“ track to the LFE channel, otherwise the music might sound a little „thin“.

To do this, the „Music“ track can simply be duplicated with Menu ‣ Edit ‣ Duplicate after selecting it, and then Split Stereo to Mono from the context menu of the third track. Then one of the two mono tracks can be deleted; the other one can be renamed to „LFE“.

Now the „Equalization…“ effect could be used to cut off frequencies above around 100Hz from the „LFE“ track, and reverse, cut off frequencies below around 100Hz from the „Music“ track.

Bemerkung

Creating technically perfect surround sound is a science all of its own and thus beyond the scope of this guide - please refer to respective resources on the web for details.

What remains for now is to make sure that the surround sound track has the same length as the video track it should be added to. The video track used in this example has a length of 1:00 minute, so the lengths of the audio tracks in Audacity are adjusted accordingly.

The Audacity project should now look something like this:

The next thing to do is to export the project to a multichannel 5.1 surround sound audio file. The format used here is AC-3 (Dolby Digital).

Before exporting, Audacity needs to be configured to allow exporting to a multichannel audio file: In Menu ‣ Edit ‣ Preferences, under Import/Export, select „Use custom mix (for example to export a 5.1 multichannel file)“.

The project can now be exported into a 5.1 surround sound audio file:

Select Menu ‣ File ‣ Export…
Provide a name for „Name“ and select „AC3 Files (FFmpeg)“
Click Options… and choose „512 kbps“ as „Bit Rate“

The „Advanced Mixing Options“ dialog should show up. The number of „Output Channels“ should be 6 and the channel mapping should already be correct:

The result of the export should be an *.ac3 file which is playable with e.g. VLC or Dragon Player.

Muxing Video and Audio Together¶

The final step is to add the surround sound audio track to the video track, assuming the video was rendered without audio.

Bemerkung

When muxing audio and video files into one file, the actual streams are just copied, and not transcoded. So there is no quality loss to either the audio or the video streams. Also, because the streams are just copied, muxing is very fast.

Assuming the video track was rendered to Video.mkv and the surround sound was exported to 5.1.ac3 the command to mux both to Video-5.1.mkv with avconv would be:

avconv -i Video.mkv -i 5.1.ac3 -c copy -map 0:0 -map 1:0 Video-5.1.mkv

The result should be an MKV video containing a Dolby Digital 5.1 surround sound audio track.

Editing Existing Surround Sound¶

When adding a clip with more than two channels to a project, Kdenlive creates an audio thumbnail that correctly shows all audio channels:

Kdenlive timeline (Note: Older version!)¶

The clip can be edited and (audio) effects applied to it, and all appears to work just fine - but once rendering the project, it turns out that the audio track in the resulting video file is 2 channels (stereo) only.

The following steps provide a manual workaround for this issue.

Extract and Split the Audio Track¶

The first step is to extract the audio track from the video clip. This can be done in Kdenlive with Extract Audio ‣ Wav 48000Hz from the context menu of the clip. This creates a WAV audio file in the same folder as where the video clip is located.

The extracted WAV audio file can then be opened in Audacity, it should show all 6 channels, these are:

1 - Front Left
2 - Front Right
3 - Center
4 - LFE
5 - Surround Left
6 - Surround Right

Bemerkung

LFE (Low Frequency Effects) is often referred to as „subwoofer channel“, which is not quite correct. A surround sound speaker setup is perfectly valid without subwoofer. In this case the surround sound system will redirect the LFE channel to „large“ speakers, usually the front speakers.

The idea now is to split the surround sound into four separate (stereo/mono) audio files that Kdenlive can handle:

Front (stereo)
Center (mono)
LFE (mono)
Surround (stereo)

First, Audacity needs to be configured to not always export to stereo audio files: In Edit ‣ Preferences, under Import/Export, select „Use custom mix (for example to export a 5.1 multichannel file)“.

Now, tracks 1+2 and 5+6 should be turned into stereo tracks by choosing Make Stereo Track from the context menu of the 1st and the 5th track, respectively. This should result in 4 tracks, two stereo and two mono.

Next, the 4 tracks should be renamed to „Front“, „Center“, „LFE“ and „Surround“ starting from the top, using Name… from the context menu of each track.

The tracks now look like this:

After all this hard work, exporting the four tracks to four separate audio files is easy with Menu ‣ File ‣ Export ‣ Export Multiple…. Use „WAV“ as „Export format“, the rest of the settings should already be okay: „Split files based on: Tracks“ and „Name files: Using Label/Track name“.

The „Edit metadata“ dialog might pop up for each track. It is fine to just say OK. At the end there should be a confirmation dialog and four audio files should have been exported: Front.wav, Center.wav, LFE.wav and Surround.wav.

Import Audio Tracks into Kdenlive¶

The previously created audio files can now be added to the Kdenlive project using Menu ‣ Project ‣ Add Clip.

Since there are only two audio tracks in a project by default, it is necessary to add two more using Menu ‣ Project ‣ Tracks ‣ Insert Track before adding the four audio tracks to the timeline.

The next thing to do is to group the four audio tracks with the video clip by selecting all of them and then choosing Menu ‣ Timeline ‣ Group Clips.

Bemerkung

Don’t forget to mute the original audio track in the video clip if necessary!

The Kdenlive project should now be ready for the usual editing, like cutting clips and adding effects, and should look something like this:

Kdenlive project example (Note: older version!)¶

Rendering the Project¶

Since it is not possible to render the project with a surround sound audio track, some manual steps are necessary to work around this.

First, the video track needs to be rendered without audio. This is simply done by rendering the project as it would normally be done, but without audio, by deselecting the Audio checkbox.

Then, each of the four surround sound audio tracks Front.wav, Center.wav, LFE.wav and Surround.wav needs to be rendered into a separate audio file. For each of them, do the following:

Exporting audio only in separate tracks¶

Mute all other audio tracks
Click on Render…
Enter a respective file name for Output file
Select preset Audio only
Select profile WAV
Make sure Audio is checked
Make sure Separate file for each audio track is not checked
Click on Render to file

Bemerkung

Unfortunately, the mono tracks Center.wav and LFE.wav are rendered as stereo tracks, and there seems to be no way to avoid this. But this can be handled later in Audacity.

Compose a Surround Sound Audio File¶

Now the separate audio tracks rendered by Kdenlive need to be „merged“ into a single multichannel 5.1 surround sound audio file. This is again done in Audacity:

Import Front.wav, Center.wav, LFE.wav and Surround.wav (in this order!) using File ‣ Import ‣ Audio…

„Center“ and „LFE“ are now stereo, which is not what is needed. This can be fixed by selecting Split Stereo to Mono from the context menu of each track, and deleting one of the two resulting mono tracks.

Eventually, there should be four tracks in the Audacity project:

Front (stereo)
Center (mono)
LFE (mono)
Surround (stereo)

The project can now be exported into a 5.1 surround sound audio file:

Select File ‣ Export…
Provide a name for „Name“ and select „AC3 Files (FFmpeg)“
Click Options… and choose 512 kbps as „Bit Rate“

The Advanced Mixing Options dialog should show up. The number of Output Channels should be 6 and the channel mapping should already be correct:

The result of the export should be an *.ac3 file which is playable with i.e. VLC or Dragon Player.

Muxing Video and Audio Together¶

Since video and audio was rendered separately, both need to be multiplexed into a single file containing both the video and audio stream.

Bemerkung

When muxing audio and video files into one file, the actual streams are just copied, and not transcoded. So there is no quality loss to either the audio or the video streams. Also, because the streams are just copied, muxing is very fast.

Assuming the video track was rendered to Video.mkv and the surround sound was exported to 5.1.ac3, the command to mux both to Video-5.1.mkv with avconv would be:

avconv -i Video.mkv -i 5.1.ac3 -c copy -map 0:0 -map 1:0 Video-5.1.mkv

The result should be an MKV video containing a Dolby Digital 5.1 surround sound audio track.