Sample Image - DesktopCaptureWithMouse.jpg

Introduction

This article shows how you can capture screen images including the mouse cursor.

Background

Screen capturing is a very useful way of resource sharing as used in applications like Remote Desktop, Virtual Network Computing (VNC), where a user can access, view, and interact with a remote desktop as his own desktop. Also, it is used in non ethical applications like hacking applications, where a hacker can hack a computer using some malicious server application, and the server then frequently takes screenshots of the prey machine and sends them to the clients. You will see a lot of source code resources over the internet discussing how to take screenshots of the desktop or an area of the desktop but none of them discuss how to capture the mouse cursor bitmap with the screenshot. Sometimes it becomes necessary to capture the mouse to see the whole activity of the hacked machine. First, we will discuss here what the actual problem is.

Problem

Most of us think that the mouse cursor image is a part of the desktop display but actually it works on an upper layer over the desktop. Windows always tracks mouse with a “Hot Spot”, the actual position seen by the Windows.

Currently, there are two common ways to capture and manipulate the desktop image:

Copy the desktop bitmap data from Video Memory to the System Memory. Do processing and then again blit it back to the Video Memory. This can be easily done using the BitBlt() or the StretchBlt() APIs provided by Win32.
Another way is to directly manipulate the desktop bitmap in the Video Memory if enough memory is available as provided by DirectDraw.

Both of these don’t provide us the facility to capture the mouse cursor image with the desktop image.

Solution

The solution to the problem of capturing the mouse cursor image with the desktop image is quite simple.

First, get the bitmap of the screen using BitBlt(). I have provided a simple function named CaptureDesktop() in the CaptureScreen.cs file that captures the screen bitmap as almost all the codes available over the internet do.

Then capture the mouse cursor bitmap as:

Get Cursor Icon:

First, get the cursor information using the Win32 GetCursorInfo(). The function fills the CURSORINFO structure provided as a parameter. Don't forget to initialize the cbSize member of the structure before passing it as an argument. Then we check whether the cursor is visible or not, by checking for the equality of the flags member of the filled structure with the CURSOR_SHOWING constant. If they are equal then we get the handle to the cursor icon using the CopyIcon() function that takes the hCursor member of the above filled structure.

Get Cursor Position:

Now, we have to get the Icon information so that we can get the hotspot position. This information is easily retrieved using the GetIconInfo() function. Here is the C# implementation of the mouse capturing function:

static Bitmap CaptureCursor(ref int x, ref int y)
{
   Bitmap bmp;
   IntPtr hicon;
   Win32Stuff.CURSORINFO ci = new Win32Stuff.CURSORINFO(); 
   Win32Stuff.ICONINFO icInfo;
   ci.cbSize = Marshal.SizeOf(ci);
   if(Win32Stuff.GetCursorInfo(out ci))
   {
       if (ci.flags == Win32Stuff.CURSOR_SHOWING)
       { 
           hicon = Win32Stuff.CopyIcon(ci.hCursor);
           if(Win32Stuff.GetIconInfo(hicon, out icInfo))
           {
               x = ci.ptScreenPos.x - ((int)icInfo.xHotspot);
               y = ci.ptScreenPos.y - ((int)icInfo.yHotspot);
               Icon ic = Icon.FromHandle(hicon);
               bmp = ic.ToBitmap(); 

               return bmp;
           }
       }
   }
   return null;
}

We now have both the bitmaps, i.e., the desktop bitmap and the mouse cursor bitmap with its position on the screen. Now, it's time to place the mouse cursor bitmap on the desktop bitmap. I have provided the following function that places the mouse cursor image over the desktop bitmap at the proper position:

public static Bitmap CaptureDesktopWithCursor()
{     
   int cursorX = 0;
   int cursorY = 0;
   Bitmap desktopBMP;
   Bitmap cursorBMP;
   Bitmap finalBMP;
   Graphics g;
   Rectangle r;
   desktopBMP = CaptureDesktop();
   cursorBMP = CaptureCursor(ref cursorX, ref cursorY);
   if(desktopBMP != null)
   {
       if (cursorBMP != null)
       {
           r = new Rectangle(cursorX, cursorY, 
                   cursorBMP.Width, cursorBMP.Height);
           g = Graphics.FromImage(desktopBMP);
           g.DrawImage(cursorBMP, r);
           g.Flush();
           return desktopBMP;
       }
       else
           return desktopBMP;
   }
   return null;
}

The bitmap with the cursor is now ready to be rendered over a viewer surface (a PictureBox used here). Since the viewer's visible area is smaller than the desktop bitmap area, scaling has been used in the function that displays the cooked desktop image.

// ssWithMouseViewer is the PictureBox control
private void Display(Bitmap desktop)
{
    Graphics g;
    Rectangle r;
    if(desktop != null)
    {
        r = new Rectangle(0,0,ssWithMouseViewer.Width, 
                            ssWithMouseViewer.Height);
        g = ssWithMouseViewer.CreateGraphics();
        g.DrawImage(desktop,r);
        g.Flush();
    }
}

Note

The binary image provided is compiled with Visual Studio .NET 2005 so you have to install .NET Framework 2.0.

Known problems

I have tested the application on my machine with no known problems, so I expect the same behavior on your machine.

Capturing the Desktop Screen with the Mouse Cursor Image