git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

memory leak in Camel


Hi there,
 
I have the following problem: I’m running a Camel application that is triggered by a RESTful POST call. With each trigger, it contacts certain http addresses, downloads files to the file system, parses them, and sends some parsed informations to another service with a REST call.
 
All this is executed on VERY large data amount with many files and so on. My problem is: I run into a severe memory leak.
 
I’ve installed JProfiler and was trying to catch that leak. What is amazing to me is that there are after only a couple of minutes about 100 000 objects of the type “TreeMap$Entry”. I drilled down to them in JProbe and found that there are lots of message headers in main memory, for example things like
  • Connection=keep alive
  • CamelFileNameProduced=C:/path/to/the/produced/file
  • cache-control=no-cache
  • log=F
  • getMethod=isStatisticsEnabled
 
All these entries waste the main memory, and even garbage collection does not get rid of them. My expectation is that after the steps I’ve described in my first sentence have finished, the main memory should almost look as empty as it was before the first entry of the RESTful call.
 
Please find attached an xml file that is exported from JProfiler:
And this HTML file was also exported by JProfiler and may have a clearer view on what was going on:
 
 
I’m having a hard time these days because I’m fighting with my colleagues to use Apache Camel. If they’ve found that memory leak, I’m going to lose that battle. So please help.
 
Many thanks in advance!
 
Kind regards,
Christian Jacob
 
Innogy SE
Retail IT
Integration and Digital Solutions (AFS-IGI)
Rellinghauser Str. 37
45128 Essen
T intern: 70-20581
T extern: +49 (0)201 12 20582
T mobil: +49 (0)1622843981
Fax: +49 (0)201 12 24796
mailto: christian.jacob@xxxxxxxxxx
 
----------------------------------------------------------------
innogy SE
Vorsitzender des Aufsichtsrates: Dr. Erhard Schipporeit
Vorstand: Uwe Tigges (Vorsitzender), Dr. Hans Buenting,
Dr. Bernhard Guenther, Arno Hahn, Martin Herrmann, Hildegard Mueller
Sitz der Gesellschaft: Essen, Eingetragen beim Amtsgericht Essen,
Handelsregister-Nr. HRB 27091, USt-IdNr. DE304171711

Attachment: Heap_walker_Incoming_References.xml
Description: Heap_walker_Incoming_References.xml



( ! ) Warning: include(msgfooter.php): failed to open stream: No such file or directory in /var/www/git/apache-camel-users/msg03458.html on line 132
Call Stack
#TimeMemoryFunctionLocation
10.0008368648{main}( ).../msg03458.html:0

( ! ) Warning: include(): Failed opening 'msgfooter.php' for inclusion (include_path='.:/var/www/git') in /var/www/git/apache-camel-users/msg03458.html on line 132
Call Stack
#TimeMemoryFunctionLocation
10.0008368648{main}( ).../msg03458.html:0