Sean was right a while back about threads popping up in a Spoon-Carte
environment.
It was caused by a weirdness in the Apache Commons HTTP client library that
didn't release a connection upon calling ... releaseConnection().

The reason was hard to find but apparently if you create a new HTTPClient()
object it also creates a simple connection pool of one connection. Since
it's a pool of one it keeps the connection open. Since new pools and new
connections are created all the time & the connections are never ever
released. Nifty!

I'm copying the rest of the devs in case anyone else (like me) was too lazy
to use a MultiThreadedHttpConnectionManager to create an HTTPClient.

The problem's been fixed in PDI 4.2.0 a while back (with the
SlaveConnectionManager singleton) but I'd thought I'd mention it anyway in
case anyone else is using that library. Sneaky things these loose threads,
they are.

Regards,
Matt

2011/4/22 Sean J. Flatley <sflatley (AT) pentaho (DOT) com>

> I have a simple transformation, text file input hopped to a text file
> output. The text file output is running on a cluster.
>
> The transformation is attached.
>
> Running the transformation in debug mode shows that text file input
> reads all rows from the customer-100 sample file. The text output step
> gets the first row from the text input step and hangs there.
>
> I set up the carte servers for remote debugging and tracked down where
> the log statement is written, in the RemoteStep class at line 493. I
> stepped though the debugger to the baseStep.putRowto method.
>
> Here is where things get weird.
>
> At line 1299 is a synchronized (this) block. Stepping through the code
> stops here. *Every 10 seconds or so a new thread pops up.*
>
> Have you seen this before?
>
>
>
>



--
Matt Casters <mcasters (AT) pentaho (DOT) org>
Chief Data Integration, Kettle founder, Author of Pentaho Kettle
Solutions<http://www.amazon.com/Pentaho-Kettle-Solutions-Building-Integration/dp/0470635177>
(Wiley <http://eu.wiley.com/WileyCDA/WileyTitle/productCd-0470635177.html>)
Fonteinstraat 70, 9400 OKEGEM - Belgium - Cell : +32 486 97 29 37
Pentaho : The Commercial Open Source Alternative for Business Intelligence

--
You received this message because you are subscribed to the Google Groups "kettle-developers" group.
To post to this group, send email to kettle-developers (AT) googlegroups (DOT) com.
To unsubscribe from this group, send email to kettle-developers+unsubscribe (AT) g...oups (DOT) com.
For more options, visit this group at http://groups.google.com/group/kettle-developers?hl=en.