Your code seems perfectly okay.
You have a different problem. It is page postback.
What happens, when you click a server button, the page postback occurs and I am sure you have some code of loading list box in page_load event.
Try this
protected void Page_Load(object sender, EventArgs e)
{
if (!IsPostBack)
{
}
}
This will work.
cheers