Just look for it in 'AJAX Extensions' Tab in the toolbox.
Apart from that, you can even type that directly in your ASPX. Try pasting,
<asp:UpdatePanel ID="upExplorer" runat="server" UpdateMode="Conditional">
<ContentTemplate>
</ContentTemplate>
</asp:UpdatePanel>