Add this in your logout button.
<asp:Button ID="btnLogout" runat="server" Text="Logout" OnClientClick="return confirm('Are you sure to logout?') />
But, this will display
Ok
and
Cancel
button. If you need
Yes
and
No
you have to create your own custom control.