Anyone else experiencing memory leaks?

Posted on
Fri Jun 07, 2019 6:27 am
Umtauscher offline
User avatar
Posts: 404
Joined: Oct 03, 2014
Location: Cologne, Germany

Anyone else experiencing memory leaks?

Lately I have been experiencing memory leaks on my Indigo machine.
It is running for 5 days now and has already expanded the swap file to 15 GB and has 5 Gb swapped.

After a reboot and everything started there is now swap used.
I use 7.3.1 btw.
I have already stopped all non essential apps on that machine but the swap keeps growing and growing so that I have to reboot the machine regularly now. This has never been an issue before.
Is anyone else seeing something like this.
Could it be a plugin or is it Indigo itsself? How do I find out?
Any ideas would be helpful.
Thanks
Wilhelm
Last edited by Umtauscher on Sat Jun 08, 2019 4:46 am, edited 1 time in total.

Posted on
Fri Jun 07, 2019 6:49 am
FlyingDiver offline
Posts: 3292
Joined: Jun 07, 2014
Location: Southwest Florida, USA

Re: Anyone else experiencing meory leaks?

Run Activity Monitor and see what processes are using the most memory.
Attachments
Screen Shot 2019-06-07 at 8.48.30 AM.png
Screen Shot 2019-06-07 at 8.48.30 AM.png (168.69 KiB) Viewed 786 times

joe (aka FlyingDiver)
my plugins: http://forums.indigodomo.com/viewforum.php?f=177

Posted on
Fri Jun 07, 2019 7:05 am
Umtauscher offline
User avatar
Posts: 404
Joined: Oct 03, 2014
Location: Cologne, Germany

Re: Anyone else experiencing memory leaks?

There is no process with extended memory usage but the swap is growing...
What am I missing?
Last edited by Umtauscher on Sat Jun 08, 2019 4:46 am, edited 1 time in total.

Posted on
Fri Jun 07, 2019 7:09 am
FlyingDiver offline
Posts: 3292
Joined: Jun 07, 2014
Location: Southwest Florida, USA

Re: Anyone else experiencing meory leaks?

Post a screen shot of the Activity Monitor window.

joe (aka FlyingDiver)
my plugins: http://forums.indigodomo.com/viewforum.php?f=177

Posted on
Fri Jun 07, 2019 7:13 am
Umtauscher offline
User avatar
Posts: 404
Joined: Oct 03, 2014
Location: Cologne, Germany

Re: Anyone else experiencing memory leaks?

Here you go!
Attachments
Bildschirmfoto 2019-06-07 um 15.12.00.JPG
Bildschirmfoto 2019-06-07 um 15.12.00.JPG (269.32 KiB) Viewed 772 times
Last edited by Umtauscher on Sat Jun 08, 2019 4:47 am, edited 1 time in total.

Posted on
Fri Jun 07, 2019 7:27 am
FlyingDiver offline
Posts: 3292
Joined: Jun 07, 2014
Location: Southwest Florida, USA

Re: Anyone else experiencing meory leaks?

It really doesn't look like it's Indigo. But there are a couple of Python processes with relatively high memory usage, so it would be worth figuring out what they are. You can use the ps command with the -p option to figure out what process those are:

Code: Select all
home:~ miniserver$ ps -p 551
  PID TTY           TIME CMD
  551 ??         6:11.48 python /Library/Application Support/Perceptive Automation/Indigo 7.3/IndigoWebServer/IndigoWebServer.py -i1176 -w8176 -cn


Other than that, I see you have File Services, Perl (x2), Ruby, and a bunch of other stuff running. 4GB RAM is really marginal for what you've got going.

joe (aka FlyingDiver)
my plugins: http://forums.indigodomo.com/viewforum.php?f=177

Posted on
Fri Jun 07, 2019 8:31 am
Umtauscher offline
User avatar
Posts: 404
Joined: Oct 03, 2014
Location: Cologne, Germany

Re: Anyone else experiencing memory leaks?

The three topmost python task are all "AppleCalenderServer 5.2.1"
Maybe I am not understanding this correctly, but they are all under 100MB. This doesn't seem much.
This is all normal Mac Server stuff and there is nothing updated from Apple side since this is 10.9.5
The only thing that gets updated are Indigo and the plugins.

I could upgrade the RAM, sure, but this would only buy me less that a week every 4 GB, unless I am misinterpreting the scenario.
In my opinion such a machine should be able to run for years without having to restart.
Last edited by Umtauscher on Sat Jun 08, 2019 4:47 am, edited 1 time in total.

Posted on
Fri Jun 07, 2019 8:57 am
FlyingDiver offline
Posts: 3292
Joined: Jun 07, 2014
Location: Southwest Florida, USA

Re: Anyone else experiencing meory leaks?

Umtauscher wrote:
The three topmost python task are all "AppleCalenderServer 5.2.1"
Maybe I am not understanding this correctly, but they are all under 100MB. This doesn't seem much.
This is all normal Mac Server stuff and there is nothing updated from Apple side since this is 10.9.5
The only thing that gets updated are Indigo and the plugins.

I could upgrade the RAM, sure, but this would only buy me less that a week every 4 GB, unless I am misinterpreting the scenario.
In my opinion such a machine should be able to run for years without having to restart.


Take it up with Apple. The evidence is that it's not Indigo or plugins. It's the OS in general that's doing it. My guess is that it's client connections causing file system caching. The more stuff it's trying to cache due to file services (or whatever) the less room it's got for idle process memory, which it then has to swap. I'm guessing file sharing caching due to the high number of threads and ports that AppleFileServer is using.

And no, it wouldn't be linear growth. If these were memory leaks, then the process allocations would be growing. But they're not. So it's OS usage of the memory. Which will plateau at some point.

And you're running a really old OS without any of the more recent memory optimizations.

joe (aka FlyingDiver)
my plugins: http://forums.indigodomo.com/viewforum.php?f=177

Posted on
Fri Jun 07, 2019 9:02 am
FlyingDiver offline
Posts: 3292
Joined: Jun 07, 2014
Location: Southwest Florida, USA

Re: Anyone else experiencing meory leaks?

The other question I have is what is ACTUALLY causing you to reboot? Are you running out of room for the swap file? Or are you doing it because you don't like it growing? If you don't reboot for several weeks, is it still growing at 5GB/week?

joe (aka FlyingDiver)
my plugins: http://forums.indigodomo.com/viewforum.php?f=177

Posted on
Fri Jun 07, 2019 9:41 am
Umtauscher offline
User avatar
Posts: 404
Joined: Oct 03, 2014
Location: Cologne, Germany

Re: Anyone else experiencing memory leaks?

Well I used to not bother about that Mac. It used to run months without hickup.
Why would a system that is stable and not connected to the internet become more unstable if it wasn't for the updates I installed?
So I looked at the memory and swap usage and seemed to find the problem there and the cause of slowing down.
When I reboot that machine, it becomes responsive again und runs ok for a while (meaning a few weeks).
Something must have changed.
So I thought I would ask if anyone else was seeing the same problem.
If all of you are fine, I have to search somewhere else.
Thanks anyway for your help.
Cheers
Wilhelm

P.S: I will observe a few weeks and report back.

Posted on
Sun Jun 09, 2019 5:58 am
Umtauscher offline
User avatar
Posts: 404
Joined: Oct 03, 2014
Location: Cologne, Germany

Re: Anyone else experiencing memory leaks?

Hi Joe,

I put 16GB of memory into my mini yesterday and I think it's save to say, my problems are gone now.
Comparing the memory usage on the same machine gives me more insight now.
I seems OSX needs quite some time after starting until it stabilizes the memory usage.
Sorry if my "minimalistic" trial caused some confusion.
I think it's safe to say having about double the memory needed for all running tasks gives an optimized performance.
Thanks for your input.
Cheers
Wilhelm

Posted on
Sun Jun 09, 2019 6:50 am
FlyingDiver offline
Posts: 3292
Joined: Jun 07, 2014
Location: Southwest Florida, USA

Re: Anyone else experiencing memory leaks?

8GB might have been enough, 16GB certainly is. One of the issues is that the older versions of Mac OS show process memory in Activity Monitor, but not file cache memory (as I recall). So even though it looks like there's plenty for the process sizes you have, you don't get to use all of it.

joe (aka FlyingDiver)
my plugins: http://forums.indigodomo.com/viewforum.php?f=177

Posted on
Mon Jul 15, 2019 3:35 pm
siclark offline
Posts: 895
Joined: Jun 13, 2017
Location: UK

Re: Anyone else experiencing memory leaks?

58GB for Indigo Client on my 2017 iMac. Do I win a prize?

No wonder it was running slowly!

Posted on
Mon Jul 15, 2019 3:48 pm
jay (support) offline
Site Admin
User avatar
Posts: 15629
Joined: Mar 19, 2008
Location: Austin, Texas

Re: Anyone else experiencing memory leaks?

siclark wrote:
58GB for Indigo Client on my 2017 iMac. Do I win a prize?

No wonder it was running slowly!


Can you describe the environment more please? (OS version, Indigo version, local or remote client, plugins, etc)

Jay (Indigo Support)
Twitter | Facebook | LinkedIn

Posted on
Mon Jul 15, 2019 3:58 pm
siclark offline
Posts: 895
Joined: Jun 13, 2017
Location: UK

Re: Anyone else experiencing memory leaks?

evidence!
its an imac 2017 i7 with 24GB RAM. connecting to indigo server running on a 2019 mac mini All latest OS
Attachments
Screenshot 2019-07-15 at 22.31.34.png
Screenshot 2019-07-15 at 22.31.34.png (139.67 KiB) Viewed 360 times

Who is online

Users browsing this forum: Google [Bot] and 1 guest