Re: Problems with a memory leak - C# Discussion Boards

Burt Harris7-Dec-02 15:17

7-Dec-02 15:17

In my experience, calling GC.Collect() is always a bad idea. It throws of the heuristics the garbage collector uses, and ends up costing you performance because it artificially advances objects into higher generations.

I'd suggest you apply the Allocation Profiler to find out if you've got managed memory problem. This tool is great.

Note that if you've got code using COM interop or P/Invoke, it possible that you've got a classic memory leak. Instead of using the task manager to monitor memory, you can use perfmon. Use the Process object's Virtual Memory, Private Bytes, and Working Set counters on your process, which show overall numbers, then add the ".NET CLR Memory" counter named "# Bytes in all heaps" for you process. If they both grow, your probably holding on to managed memory too long, if just the process ones grow, its unmanaged memory.

Burt Harris

Re: Problems with a memory leak

Omega5017-Dec-02 16:27

Omega501

7-Dec-02 16:27

Thanks. I'll check that out.

The reason I am calling GC explicitly was to see the impact on memory usage, ie. does it free up all the memory and from my logs it's not. In the logs (when graphed) you can easily see the high and low memory usage climbing over time - every time the GC kicks in it doesn't free up as much memory as the previous time. This is with or without calling GC explicitly. The only things I have in the program (outside of labels/textboxes) is the datagrid and a timer. The timer (2 secs) is used to call WMI to check cpu usage, and to read the event logs every 10 secs. Even without these added in, just running the timer to check memory usage and logging the results the memory still gets used in a similar, but smaller, cycle. I am checking the memory usage with this

<br />
    // get current instance of the app<br />
    CheckMem = Process.GetCurrentProcess();<br />
    //get current memory<br />
    CurrentMemory = CheckMem.PrivateMemorySize;<br />

Is there a problem with using this method?

To check the cycling behaviour I have avoided creating/destroying objects as much as possible, and I am now just changing the values of the objects
(ie. clearing the datatable that is the source for the datagrid, and programatically adding in new rows as relevent, both the datatable and the datarow are defined "Globally" (to use vb terms, not sure of the c# term)).

I am either explicitly destroying objects when they are finished, or implicitly when the function has finished its job. Where I know I will be using them elsewhere I make them global. This doesn't seem to have stopped the cycling, but it does seem to have slowed it down.

Re: Problems with a memory leak

Burt Harris8-Dec-02 11:42

Burt Harris

8-Dec-02 11:42

With a call to Process.GetCurrentProcess() inside a timer event routine, I saw working set growth similar to what you described. The trick is every time you call Process.GetCurrentProcess, it's creating a new object, and it's a fairly heavyweight object...

Try moving the call to Process.GetCurrentProcess() outside of your timer event routine. I made it a member of my Form class and memory growth went away completely. Since its not going to change, you could even make it a static member.

static private Process p = Process.GetCurrentProcess()

private void timer1_Elapsed(object sender, System.Timers.ElapsedEventArgs e) {
    label3.Text = DateTime.Now.ToString("hh:mm:ss");
    label1.Text = p.PrivateMemorySize.ToString();
    label4.Text = p.WorkingSet.ToString();
}

Creating the Process object just once is the real fix for you, but the other thing to point out is that this object implements IDisposable. Whenever an object implements IDisposable, you'll get much better perormance if you manage it's lifetime, and call Dispose() on it when done. This is so important, the C# language added the using statement just for this.

Ignoring the advise of my second paragraph, I left the Process.GetCurrentProcess inside the timer event routine, but wrote it like this:

using (Process p = Process.GetCurrentProcess()) {
    label1.Text = p.PrivateMemorySize.ToString();
    label4.Text = p.WorkingSet.ToString();
}

Net result: Memory grew a little, but stabilized.

So here's what all this means. Creating a System.Diagnostics.Process directly or indirectly allocates a chunk of unmanaged memory. This unmanaged memory isn't released until either: 1) IDisposable.Dispose is called (implied in my using statement), or 2) the object is garbage collected.

Option 1 (Dispose) is far preferred to option 2, because 2 is far less predictable. But for this paricular case, option 0 (creating the object once and reusing it) is the best.

Burt Harris

Re: Problems with a memory leak

Omega5019-Dec-02 10:52

Omega501

9-Dec-02 10:52

I tried out those suggestions but there still seems to be a problem.

Trying the

<br />
using (Process p = Process.GetCurrentProcess){<br />
...<br />
}<br />

method, I was still showing a similar memory usage. When I tried the

static private Process p = Process.GetCurrentProcess()

method, I was amazed - No memory usage increase was found once the program started. I ran the program overnight and the memory values where the same in the morning as when the program started. Is this saying there isn't a memory leak or that it isn't updating the values properly?

This was using

<br />
static private Process p = Process.GetCurrentProcess();<br />
...<br />
<br />
private void GetCurrentMemory(){<br />
  intCurrentMem = p.WorkingSet;<br />
  // or<br />
  intCurrentMem = p.PrivateMemorySize;<br />
<br />

Both of these returned non-changing values. Am I right in thinking that over a period of 10 hours, there should be some change in memory usage for a program? This program goes out and rotates through 3 event logs (every 10 secs for testing purposes) looking for errors and when an error is found it checks to see if it has already recorded that error in the datatable (I don't want to see 10 entries of "cd-rom has a bad block" or similar, once is enough). This is a fair amount of work that it's doing but using the static process object the memory doesn't change. Changing it to the "Using(...)" format brings back the memory creep though.

Re: Problems with a memory leak

Burt Harris9-Dec-02 21:28

Burt Harris

9-Dec-02 21:28

Yup, your right, the static approach is misleading. You can fix it by calling p.Refresh(). The memory isn't exactly static in my simple example, but it stabilizes after a few minutes. I saw the same basic pattern with the using statement.

None the less, the bytes/second allocated seems quite high. I ran the allocaiton profiler on it, and found that the bulk of memory dynamically allocated for my simple test was in System.Diagnostics.ThreadInfo. Again, it looks like the System.Diagnostics.Process class is rather heavyweight for your purpose. I guess it's snapshotting a whole bunch of information you don't need...

You can get working set size from the Environment object, it's lots cheaper, but even with this, I do see an ongoing increase in private bytes by just reading Envrionment.WorkingSet. Interesting... Allocation Profiler says its related to security checks code, that's more what I expect. I leave it running for quite some time and eventually the GC kicks in and trims working set back. I haven't left this running overnight, but I will...

Burt Harris

Re: Problems with a memory leak

Omega50111-Dec-02 22:14

Omega501

11-Dec-02 22:14

I added in the .Refresh() and the memory usage started changing like it used to. Seeing this, I left it running for a few hours and after 7+ hours, the memory usage has a peak of 110 meg (set 5 mins ago), a current memory of 60 meg, and it never dropped below its initial value of 20 meg since the app started.

The main memory usage seems to occur when reading the event log, as when it is checking cpu usage the memory changes a small amount (~100k) but seems stable. It seems to be having problems when reading the event log into a datatable and then displaying that in a datagrid.

It also seems, since I made the Process object static, that a) initial memory usage has jumped (from 10 meg to 20 meg), and that peak memory usage has doubled as well (previously it peaked around 40 - 50 meg, now it's 110 meg).

I am not talking about a lot of data being stored in memory consistently - the datatable has a max of 10 records, and I clear the datatable at the beggining of each loop through the current log (cycling through system, security, application logs every 10 secs for testing purposes).

Is it the Process that is using up so much memory? - I call the p.WorkingSet every 2 secs currently, but now I am only calling the
Refresh(), not creating a new instance of the object. Is there a more "light weight" way of checking the memory usage of a the current app? Maybe calling the Process object is itself causing the high memory usage?

Re: Problems with a memory leak

David Stone8-Dec-02 5:56

David Stone

8-Dec-02 5:56

Welcome to CP Burt! It's always nice to have more people from Microsoft here to answer questions. Wink | ;)

So you work in the Speech group huh? Gotta say, I love the .NET Speech SDK. Very nice...even more so that it works with ASP.NET. Cool | :cool:

I send my kudos along to your team.

How did you find out about CP? Was it purely accidental, a coworker mentioning it to you, or was there an internal memo that everybody should monitor what Nick says in his column? Big Grin | :-D

I don't know whether it's just the light but I swear the database server gives me dirty looks everytime I wander past.
-Chris Maunder

Microsoft has reinvented the wheel, this time they made it round.
-Peterchen on VS.NET

Re: Problems with a memory leak

Burt Harris8-Dec-02 10:50

Burt Harris

8-Dec-02 10:50

Thank you David. Glad you like the .NET Speech SDK. I can't take much credit for it, I've been working on a related project that hasn't shipped yet, but if you like the SDK, we're probably on the right track.

I found CodeProject tracking down rumors that turned out to be Pavel Zolnikov's Command Prompt Explorer Bar. Now that's some cool software. I'm still studying it, but already I'm impressed.

So there wasn't any sort of all-hands memo, but I will say that there is awareness inside Microsoft as to how important it is we contribute to the developer community. I heard a VP up my reporting chain say he tries to start and end each day solving a customer problem, on message boards or elsewhere. I don't know what forums he haunts, but that's pretty cool.

Topics like this seem like a good place for me. I've got solid server-grade code written in C#, and handling audio data with near real-time requirements. There are a lot of people, (even within Microsoft), who are skeptical of managed code, but my team has taken the plunge, and making it work for our somewhat challenging performance goals hasn't been that hard.

Turning back to the original topic of this thread, what I've learned is that managed memory doesn't mean you won't have memory problems: there are new kinds of memory problems. Understanding the memory allocation behavior your apps is key. With a tools like the allocation profiler, and a little patience, I think most developers will find that solving the new style memory problems (generally performance) a lot easier to diagnose and address than old-style ones (like dangling pointers).

Even with tuning, managed apps will generally use more memory than unmanaged ones, but very high memory consumption indicates a bug in either.

Burt Harris

Re: Problems with a memory leak

David Stone8-Dec-02 17:09

David Stone

8-Dec-02 17:09

Burt Harris (msft) wrote:
I found CodeProject tracking down rumors that turned out to be Pavel Zolnikov's Command Prompt Explorer Bar. Now that's some cool software. I'm still studying it, but already I'm impressed.

Laugh | :laugh:

I think everybody loves that thing! I use it all the time. It's worth the extra few seconds it takes to start up cmd.exe and put it in the window.

Burt Harris (msft) wrote:
So there wasn't any sort of all-hands memo, but I will say that there is awareness inside Microsoft as to how important it is we contribute to the developer community. I heard a VP up my reporting chain say he tries to start and end each day solving a customer problem, on message boards or elsewhere. I don't know what forums he haunts, but that's pretty cool.

That's really cool. I'm glad to know that most of you guys really are concerned with our comments. I for one, laugh at people who say that Microsoft is a huge corporate giant that doesn't care. And I can do that because of people like you, your VP, Eric Gunnerson, and Nick Hodapp. I must say kudos to you guys. It's a lot easier to solve a problem when someone with the inside scoop comes along to help you out.

EndDialog

peterchen7-Dec-02 10:02

peterchen

7-Dec-02 10:02

My quest for .NET equivalents doesn't seem to end.

How do I "EndDialog" a Form? Close() works, but I can't pass a result for ShowDialog.

I already found the Button.DialogResult member, but I want to do some extra processing before closing the dialog.

If I could find a souvenir / just to prove the world was here [sighist]

Re: EndDialog

Burt Harris7-Dec-02 10:13

Burt Harris

7-Dec-02 10:13

Funny, I thought I replied to this already.

You can override the value assigned to the DialogResult property when the user clicks the Close button by setting the DialogResult property in an event handler for the Closing event of the form.

Burt Harris

Re: EndDialog

peterchen7-Dec-02 10:47

peterchen

7-Dec-02 10:47

Burt Harris (msft) wrote:
Funny, I thought I replied to this already.

yep, got three notifs Cool | :cool:

thanks!

If I could find a souvenir / just to prove the world was here [sighist]

plz ans these

imran_rafique7-Dec-02 9:23

imran_rafique

7-Dec-02 9:23

Q1-if a system is in loggoff state and i call
GetUserName(..).
is the function fails,and return value is zero?
and how did i know that the system is in loggoff state?
//////////////////////////////////////////////////////////

Q2-how i will trap the WlxDialogbox and where msgina asks for the userid,password
and fill in the fields by my self?
can any body help me in this regard?
//////////////////////////////////////////////////////////

Q3-how did i find the system32 path programatically?
//////////////////////////////////////////////////////////

Q4-if i call BlockInput(true)
and then i want to use postmessage or sendmessages for keyboard and mouse
will these messages works?
/////////////////////////////////////////////////////

r00d0034@yahoo.com

Re: plz ans these

Burt Harris7-Dec-02 10:02

Burt Harris

7-Dec-02 10:02

Sounds like your trying to replace the login dialog. This is intentionally difficult (near impossible) to do. NT/W2K/XP guarentees that when you type Ctrl+Alt+Delete, the dialog is the trusted login dialog, and not something that might steal your password.

If you want auto-login, there is a registry setting that lets you specify a username and password. I'd only reccomend using this if the machine is in a physcially secure location.

Burt Harris

Custom TextBox Drawing

mikasa7-Dec-02 8:13

mikasa

7-Dec-02 8:13

I am trying to do some Custom Drawing within the TextBox in .NET. I have finally figured out how to do it and the gradient Background / ForeColors look great! However, there is a big drawback. It seems that when the TextBox receives focus, for some reason it makes the Text twice the size (from 8pt to 16pt)! WTF | :WTF:

Would anyone know why this is happening? I can't really post the Source Code because there is a lot! I am Deriving from the TextBox and Setting the Styles on it to:

SetStyle(ControlStyles.UserPaint, True)
SetStyle(ControlStyles.ResizeRedraw, True)
SetStyle(ControlStyles.DoubleBuffer, True)
SetStyle(ControlStyles.AllPaintingInWmPaint, True)

The TextBox then handles mainly the OnPaint & OnPaintBackground. I've also had to handle the OnLostFocus / OnGotFocus to do painting to override the Base painting since Painting events do not fire unless all the Text is Selected.

Re: Custom TextBox Drawing

Burt Harris7-Dec-02 10:05

Burt Harris

7-Dec-02 10:05

Perhaps you are manipulating the hDC scaling parameters and not restoring them before calling the base class.

Burt Harris

Re: Custom TextBox Drawing

mikasa9-Dec-02 2:21

mikasa

9-Dec-02 2:21

I'll look into it, but I don't think so since I don't even know how to do that Poke tongue | ;-P

Internet Connection

Mazdak7-Dec-02 5:34

Mazdak

7-Dec-02 5:34

I want to see if I am connected to internet and have the ability to show connections dialog box,I know how to do it with Rasapi32.lib library,I want to know if .NET provide some classes for it or not.

Mazy

"And the carpet needs a haircut, and the spotlight looks like a prison break
And the telephone's out of cigarettes, and the balcony is on the make
And the piano has been drinking, the piano has been drinking...not me...not me-Tom Waits

Re: Internet Connection

mikasa7-Dec-02 8:15

mikasa

7-Dec-02 8:15

I believe so, within the System.Net Classes. I can't remeber but there is some code out there somewhere on doing Connections with .NET. Check www.planetsourcecode.com.

Re: Internet Connection

leppie8-Dec-02 2:53

leppie

8-Dec-02 2:53

I started working on a RAS wrapper for .NET , but I have no RAS connection anymore so development stopped. I can mail you what I have, to be honest I cant remember how far I got in respect to UI bit, but it has the abilty to connect/disconnect, enum dialups/connections. [edit] seems UI support is there Roll eyes | :rolleyes:

[/edit]

Let me know Smile | :)

DBHelper - SQL Stored Procedure Wrapper & Typed DataSet Generator for .NET

Re: Internet Connection

Mazdak8-Dec-02 3:24

Mazdak

8-Dec-02 3:24

Thank you leppie,I just want to learn how to dialup with C# (with .NET framework).I know how to do it with RAS library in C#,I want to know if .NET has any support for itself,not with old library . Smile | :)

Mazy

"And the carpet needs a haircut, and the spotlight looks like a prison break
And the telephone's out of cigarettes, and the balcony is on the make
And the piano has been drinking, the piano has been drinking...not me...not me-Tom Waits

Re: Internet Connection

leppie8-Dec-02 3:34

leppie

8-Dec-02 3:34

Mazdak wrote:
I just want to learn how to dialup with C# (with .NET framework).I know how to do it with RAS library in C#,I want to know if .NET has any support for itself,not with old library .

No support, but what you will see in the future perhaps is wrappers like the Office assembles which makes use from .NET easier.

Smile | :)

DBHelper - SQL Stored Procedure Wrapper & Typed DataSet Generator for .NET

process and network path

imran_rafique7-Dec-02 0:33

imran_rafique

7-Dec-02 0:33

i want to start a process.for that purpose i am using
this code?

string strProcName"c:\\yplayerinstall.exe";
Process	tmpProcess;
tmpProcess = new Process();
tmpProcess.EnableRaisingEvents=true;
tmpProcess.StartInfo.FileName=strProcName;
try
  {
  tmpProcess.Start();
  while(! tmpProcess.Responding)   System.Windows.Forms.Application.DoEvents();
 }
catch
{}

the above code run sucessfully but when i want to start that exe on the network it does not run.
for example the path is this
-------------------------------------------
\\Imran1\SOFTWARE\Yahoo Player\yplayerinstall.exe
--------------------------------------------
where imran1 is computer name and rest of them are folder names.
if i type this address on start->run then the process executed.
Prcess.start does not work i dont know why?
although i have full rights and i can start that exe by double clicking it?

r00d0034@yahoo.com

Re: process and network path

mikasa7-Dec-02 8:16

mikasa

7-Dec-02 8:16

Is this a Windows Installer package you are trying to run or a standard EXE? I have noticed that when I try to run Install Packages based on Windows Installer, they will not run unless I Map a drive to the Network directory I am installing from. Have no idea why...

Re: process and network path

Burt Harris7-Dec-02 9:22

Burt Harris

7-Dec-02 9:22

I think this is by design. The .NET Framework implements a code access security model, that limits access not only based on who is running the code, but where the code came from. The idea is to prevent malicious code from doing damage to your system.

Code installed on your local machine is granted full permissions by default, but code downloaded from another machine is limited based on concepts similar to the Internet Explorer security zones, local intranet, internet, trusted sites, restricted sites. Its possible to change the policies that determine what code can do what, but in your case that's probably not the right thing to do.

It sounds like you're trying to write an installer program. Packaging your application as a Windows Installer package (.MSI file) is a better approach. In installing your package, the user makes a decision to trust your code, then it runs from the local machine, with full permissions. If you need to perform special steps during setup you use a "custom action", which are supported in .NET using the System.Configuration.Install.Installer class hierarchy.

It's not a simple change, but learning about it is probably worth while. Try adding a Visual Studio "deployment project" to your solution. Select the deployment project in the solution explorer and be sure to click on the icons that appear at the top of the solution explorer, they aren't obvious at first, once you discover them your on your way.

Burt Harris

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.