Click here to Skip to main content
15,394,635 members
Articles / Multimedia / Video
Posted 16 Jul 2012


73 bookmarked

H.264 CUDA Encoder DirectShow Filter in C#

Rate me:
Please Sign up or sign in to vote.
5.00/5 (36 votes)
16 Jul 2012CPOL2 min read
Article describes how to make H.264 Video Encoder DirectShow Filter using NVIDIA encoder API in C#

Image 1


Implementation of this filter is based on my BaseClasses.NET library which described in my previous post (Pure .NET DirectShow Filters in C#). So you can see how to implement encoder filters. Implementation uses NVIDIA CUDA Encoding API.


Filter implemented same way as described in previous article. It uses TransformFilter as a base class and overrides its methods. Encoding settings can be configured via IH264Encoder interface:

public interface IH264Encoder 
    int get_Bitrate([Out] out int plValue); 
    int put_Bitrate([In] int lValue); 
    int get_RateControl([Out] out rate_control pValue); 
    int put_RateControl([In] rate_control value); 
    int get_MbEncoding([Out] out mb_encoding pValue); 
    int put_MbEncoding([In] mb_encoding value); 
    int get_Deblocking([Out,MarshalAs(UnmanagedType.Bool)] out bool pValue); 
    int put_Deblocking([In,MarshalAs(UnmanagedType.Bool)] bool value); 
    int get_GOP([Out,MarshalAs(UnmanagedType.Bool)] out bool pValue); 
    int put_GOP([In,MarshalAs(UnmanagedType.Bool)] bool value); 
    int get_AutoBitrate([Out,MarshalAs(UnmanagedType.Bool)] out bool pValue); 
    int put_AutoBitrate([In,MarshalAs(UnmanagedType.Bool)] bool value); 
    int get_Profile([Out] out profile_idc pValue); 
    int put_Profile([In] profile_idc value); 
    int get_Level([Out] out level_idc pValue); 
    int put_Level([In] level_idc value); 
    int get_SliceIntervals([Out] out int piIDR,[Out] out int piP); 
    int put_SliceIntervals([In] ref int piIDR,[In] ref int piP); 

Via that interface it is possible to configure settings. Implementation how to handle it you can find in filter property page implementation.


First I made the interop of CUDA Video Encoder API:

public static extern int NVCreateEncoder(out IntPtr pNVEncoder); 
public static extern int NVDestroyEncoder(IntPtr hNVEncoder); 
public static extern int NVIsSupportedCodec(IntPtr hNVEncoder, uint dwCodecType); 
public static extern int NVIsSupportedCodecProfile(IntPtr hNVEncoder, uint dwCodecType, uint dwProfileType); 
public static extern int NVSetCodec(IntPtr hNVEncoder, uint dwCodecType); 
public static extern int NVGetCodec(IntPtr hNVEncoder, out uint pdwCodecType); 
public static extern int NVIsSupportedParam(IntPtr hNVEncoder, NVVE_EncodeParams dwParamType); 
public static extern int NVSetParamValue(IntPtr hNVEncoder, NVVE_EncodeParams dwParamType, IntPtr pData); 
public static extern int NVGetParamValue(IntPtr hNVEncoder, NVVE_EncodeParams dwParamType, IntPtr pData); 
public static extern int NVSetDefaultParam(IntPtr hNVEncoder); 
public static extern int NVCreateHWEncoder(IntPtr hNVEncoder); 
public static extern int NVGetSPSPPS(IntPtr hNVEncoder, IntPtr pSPSPPSbfr, 
       int nSizeSPSPPSbfr, out int pDatasize); 
public static extern int NVEncodeFrame(IntPtr hNVEncoder, 
       [MarshalAs(UnmanagedType.LPStruct)] NVVE_EncodeFrameParams pFrmIn, uint flag, IntPtr pData); 
public static extern int NVGetHWEncodeCaps(); 
public static extern void NVRegisterCB(IntPtr hNVEncoder, NVVE_CallbackParams cb, IntPtr pUserdata); 

The function NVRegiserCB is used for registering encoder callbacks in the NVVE_CallbackParams structure. For that we need to make the delegate for each callback method.

public delegate IntPtr PFNACQUIREBITSTREAM(ref int pBufferSize, IntPtr pUserdata); 
public delegate void PFNRELEASEBITSTREAM(int nBytesInBuffer, IntPtr cb, IntPtr pUserdata);
public delegate void PFNONBEGINFRAME([MarshalAs(UnmanagedType.LPStruct)] NVVE_BeginFrameInfo pbfi, IntPtr pUserdata); 
public delegate void PFNONENDFRAME([MarshalAs(UnmanagedType.LPStruct)] NVVE_EndFrameInfo pefi, IntPtr pUserdata); 

public struct NVVE_CallbackParams 
    public IntPtr pfnacquirebitstream; 
    public IntPtr pfnreleasebitstream; 
    public IntPtr pfnonbeginframe; 
    public IntPtr pfnonendframe; 

In filter we should static methods according that delegates and make delegate variables in a class - this is major thing to have them in a class scope not local.

private CUDA.PFNACQUIREBITSTREAM m_fnAcquireBitstreamDelegate = new CUDA.PFNACQUIREBITSTREAM(AcquireBitstream); 
private CUDA.PFNRELEASEBITSTREAM m_fnReleaseBitstreamDelegate = new CUDA.PFNRELEASEBITSTREAM(ReleaseBitstream); 
private CUDA.PFNONBEGINFRAME m_fnOnBeginFrame = new CUDA.PFNONBEGINFRAME(OnBeginFrame); 
private CUDA.PFNONENDFRAME m_fnOnEndFrame = new CUDA.PFNONENDFRAME(OnEndFrame); 

// initialization of the callback
CUDA.NVVE_CallbackParams _callback = new CUDA.NVVE_CallbackParams(); 
_callback.pfnacquirebitstream = Marshal.GetFunctionPointerForDelegate(m_fnAcquireBitstreamDelegate); 
_callback.pfnonbeginframe = Marshal.GetFunctionPointerForDelegate(m_fnOnBeginFrame); 
_callback.pfnonendframe = Marshal.GetFunctionPointerForDelegate(m_fnOnEndFrame); 
_callback.pfnreleasebitstream = Marshal.GetFunctionPointerForDelegate(m_fnReleaseBitstreamDelegate); 

// registering callbacks
CUDA.NVRegisterCB(m_hEncoder, _callback, Marshal.GetIUnknownForObject(this));

Configuring Encoder

Main methods for open configuring and closing encoder:

protected HRESULT OpenEncoder() 
protected HRESULT ConfigureEncoder() 
protected HRESULT CloseEncoder() 

Parameters for configuration I put into specified structure:

protected struct Config 
    public uint Profile; 
    public CUDA.NVVE_FIELD_MODE Fields; 
    public CUDA.NVVE_RateCtrlType RateControl; 
    public bool bCabac; 
    public int IDRPeriod; 
    public int PPeriod; 
    public long Bitrate; 
    public bool bGOP; 
    public bool bAutoBitrate; 
    public bool bDeblocking; 

To configure encoder used one API NVSetParamValue. This API allows to setting up all parameters and accept IntPtr as argument for value, here is an example of using it:

IntPtr _ptr = IntPtr.Zero; 
int[] aiSize = new int[2]; 
aiSize[0] = _bmi.Width; 
aiSize[1] = Math.Abs(_bmi.Height); 
_ptr = Marshal.AllocCoTaskMem(Marshal.SizeOf(typeof(int)) * aiSize.Length); 
hr = (HRESULT)CUDA.NVSetParamValue(m_hEncoder, CUDA.NVVE_EncodeParams.NVVE_OUT_SIZE, _ptr); 

Receiving and delivering samples

First we override the OnReceive method. In this method we fill NVVE_EncodeFrameParams structure and call the NVEncodeFrame API. Note: we do not call the base class OnReceive method.

public override int OnReceive(ref IMediaSampleImpl _sample)
        AMMediaType pmt;
        if (S_OK == _sample.GetMediaType(out pmt))
    CUDA.NVVE_EncodeFrameParams _params = new CUDA.NVVE_EncodeFrameParams();
         _params.Height       = m_nHeight;
    _params.Width        = m_nWidth;
    _params.Pitch        = m_nWidth;
    if (m_SurfaceFormat == CUDA.NVVE_SurfaceFormat.YUY2 || m_SurfaceFormat == CUDA.NVVE_SurfaceFormat.UYVY)
        _params.Pitch *= 2;
    _params.PictureStruc     = CUDA.NVVE_PicStruct.FRAME_PICTURE; 
         _params.SurfFmt          = m_SurfaceFormat;
    _params.progressiveFrame = 1;
         _params.repeatFirstField = 0;
    _params.topfieldfirst    = 0;
    _sample.GetPointer(out _params.picBuf);
    _params.bLast = m_evFlush.WaitOne(0) ? 1 : 0;
    HRESULT hr = (HRESULT)CUDA.NVEncodeFrame(m_hEncoder, _params, 0, m_dptrVideoFrame);
    return hr;

Delivering samples performed inside encoder callbacks. In AccureBitstream we query for new sample from output pin allocator and returns it buffer pointer:

private static IntPtr AcquireBitstream(ref int pBufferSize, IntPtr pUserData)
    H264EncoderFilter pEncoder = (H264EncoderFilter)Marshal.GetObjectForIUnknown(pUserData);
    pEncoder.m_pActiveSample = IntPtr.Zero;
    pBufferSize = 0;
    HRESULT hr = (HRESULT)pEncoder.Output.GetDeliveryBuffer(out pEncoder.m_pActiveSample,null,null, AMGBF.None);
    IntPtr pBuffer = IntPtr.Zero;
    if (SUCCEEDED(hr))
                 IMediaSampleImpl pSample = new IMediaSampleImpl(pEncoder.m_pActiveSample);
            AMMediaType pmt;
            if (S_OK == pSample.GetMediaType(out pmt))
                           pEncoder.SetMediaType(PinDirection.Output, pmt);
        pBufferSize = pSample.GetSize();
        pSample.GetPointer(out pBuffer);
    return pBuffer;

In OnBeginFrame callback routine we save settings for the sample:

private static void OnBeginFrame(CUDA.NVVE_BeginFrameInfo pbfi, IntPtr pUserData)
    H264EncoderFilter pEncoder = (H264EncoderFilter)Marshal.GetObjectForIUnknown(pUserData);
    pEncoder.m_bSyncSample = (pbfi != null && pbfi.nPicType == CUDA.NVVE_PIC_TYPE_IFRAME);

The ReleaseBitstream method used to call sample delivery:

private static void ReleaseBitstream(int nBytesInBuffer, IntPtr cb, IntPtr pUserData)
    H264EncoderFilter pEncoder = (H264EncoderFilter)Marshal.GetObjectForIUnknown(pUserData);
    IMediaSampleImpl pSample = new IMediaSampleImpl(pEncoder.m_pActiveSample);
    pEncoder.m_pActiveSample = IntPtr.Zero;
    if (pSample.IsValid)
        long _start, _stop;
        _start = pEncoder.m_rtPosition;
        _stop = _start + pEncoder.m_rtFrameRate;
        pEncoder.m_rtPosition = _stop;
        pSample.SetTime(_start, _stop);
        pEncoder.Output.Deliver(ref pSample);

Filter Overview

Property page with available settings to configure.

Image 2

Filter supports next media types as an input: NV12, YV12, UYVY, YUY2, YUYV, IYUV and format VideoInfo amd VideoInfo2. For planar types picture width should be 16 aligned, otherwise type rejected as filter not provide own allocator.

Output types from filter are H264 in VideoInfo and VideoInfo2 formats, AVC1 with Mpeg2Video format and NALU size length - 4. I made filter to be available for connection to Avi Mux filter along with common mp4 mts flv and mkv multiplexors. I set timestamps in media samples according DTS not PTS, but that not issue for good decoders and allows to embed video into AVI even if closed gop used with large IDR period. 

Image 3

I have good perfomance using that filter and it works fine with 4% CPU usage on 30 FPS playback 1280x720 video. And that for VC-1 decoding H264 encoding, decoding and preview.

Image 4


  • 15-07-2012 - Initial version.


This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)


About the Author

Maxim Kartavenkov
Software Developer (Senior)
Russian Federation Russian Federation
I'm a professional multimedia developer (more than 10 years) in any kind of applications and technologies related to it, such as DirectShow, Direct3D, WinMM, OpenGL, MediaFoundation, WASAPI, Windows Media and other including drivers development of Kernel Streaming, Audio/Video capture drivers and audio effects. Have experience in following languages: C, C++, C#, delphi, C++ builder, VB and VB.NET. Strong knowledge in math and networking.

Comments and Discussions

QuestionWindows 10 fails to connect this filter Pin
Gaamaa Resosa10-Jun-20 7:40
MemberGaamaa Resosa10-Jun-20 7:40 
QuestionRegAsm Error RA0000 Error?! Pin
Member 1361997610-Mar-20 4:09
MemberMember 1361997610-Mar-20 4:09 
Questionx264 Compression on image Pin
Member 432365914-Dec-14 22:50
MemberMember 432365914-Dec-14 22:50 
QuestionI need Delphi Source Pin
farat22-Jun-14 22:11
Memberfarat22-Jun-14 22:11 
AnswerRe: I need Delphi Source Pin
Maxim Kartavenkov22-Jun-14 23:04
MemberMaxim Kartavenkov22-Jun-14 23:04 
QuestionRegister Problem Pin
h.ahmadi8624-May-14 5:55
Memberh.ahmadi8624-May-14 5:55 
AnswerRe: Register Problem Pin
Maxim Kartavenkov9-Jun-14 19:29
MemberMaxim Kartavenkov9-Jun-14 19:29 
GeneralRe: Register Problem Pin
h.ahmadi869-Jun-14 22:34
Memberh.ahmadi869-Jun-14 22:34 
QuestionSettings on the prop page not saved. Pin
soorya prakash5-Nov-13 2:43
Membersoorya prakash5-Nov-13 2:43 
AnswerRe: Settings on the prop page not saved. Pin
Maxim Kartavenkov6-Nov-13 0:58
MemberMaxim Kartavenkov6-Nov-13 0:58 
GeneralRe: Settings on the prop page not saved. Pin
soorya prakash7-Nov-13 6:34
Membersoorya prakash7-Nov-13 6:34 
AnswerRe: Settings on the prop page not saved. Pin
Maxim Kartavenkov7-Nov-13 6:42
MemberMaxim Kartavenkov7-Nov-13 6:42 
GeneralRe: Settings on the prop page not saved. Pin
soorya prakash7-Nov-13 6:47
Membersoorya prakash7-Nov-13 6:47 
GeneralRe: Settings on the prop page not saved. Pin
Maxim Kartavenkov7-Nov-13 8:00
MemberMaxim Kartavenkov7-Nov-13 8:00 
GeneralRe: Settings on the prop page not saved. Pin
soorya prakash7-Nov-13 8:16
Membersoorya prakash7-Nov-13 8:16 
GeneralRe: Settings on the prop page not saved. Pin
Maxim Kartavenkov7-Nov-13 18:42
MemberMaxim Kartavenkov7-Nov-13 18:42 
GeneralRe: Settings on the prop page not saved. Pin
soorya prakash7-Nov-13 19:00
Membersoorya prakash7-Nov-13 19:00 
GeneralRe: Settings on the prop page not saved. Pin
Maxim Kartavenkov7-Nov-13 19:30
MemberMaxim Kartavenkov7-Nov-13 19:30 
GeneralRe: Settings on the prop page not saved. Pin
soorya prakash7-Nov-13 19:31
Membersoorya prakash7-Nov-13 19:31 
Questioncalling unmanaged filter from c# (in WPF) Pin
ofer bahar28-Sep-13 22:41
Memberofer bahar28-Sep-13 22:41 
AnswerRe: calling unmanaged filter from c# (in WPF) Pin
ofer bahar30-Sep-13 3:45
Memberofer bahar30-Sep-13 3:45 
QuestionGenerating AVI files are choppy Pin
rvangaal28-Aug-13 6:31
Memberrvangaal28-Aug-13 6:31 
AnswerRe: Generating AVI files are choppy Pin
Maxim Kartavenkov29-Aug-13 20:58
MemberMaxim Kartavenkov29-Aug-13 20:58 
QuestionThanks for the API Pin
Member 86891126-Jul-13 10:51
MemberMember 86891126-Jul-13 10:51 
AnswerRe: Thanks for the API Pin
Maxim Kartavenkov9-Jul-13 19:25
MemberMaxim Kartavenkov9-Jul-13 19:25 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.