PDA

View Full Version : GreenPlum Database with Kettle (Hanging )



Murali N
10-17-2007, 03:21 PM
All,
We are currently using Greenplum Database for our Data warehouse and using Kettle to do the transformation.

Every time we do a Kettle job to do Type I or Type 2 transformation we get atleast one of the transformation hang (every time it's a different transformation though).

I then got to kill the job and "vacuum analyze the table in the db" and rerun them manually.

Please remember there is not much data to load but it still hangs.

We ended up rewriting the whole Type2 transformation into SQL Procedures and it works cool.

Any suggestions will be appreciated.

Regards
Murali


__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "kettle-developers" group.
To post to this group, send email to kettle-developers (AT) googlegroups (DOT) com
To unsubscribe from this group, send email to kettle-developers-unsubscribe (AT) googlegroups (DOT) com
For more options, visit this group at http://groups.google.com/group/kettle-developers?hl=en
-~----------~----~----~----~------~----~------~--~---

Matt Casters
10-17-2007, 03:41 PM
Murali,

This is a developer list, not a support forum.
If you think that somehow Kettle is the cause of the Greenplum deadlock (and
you seem to think so) then file a bug report.

Please have the sense to include as many of the items below as you can:
- the version of your Pentaho Data Integration installation
- the version of your Greenplum database
- the platform you're running on
- the SQL script to create the database
- the transformation
- the execution log

Thank you for helping us to help yourself.

All the best,

Matt


On Wednesday 17 October 2007 21:16:53 Murali N wrote:
> All,
> We are currently using Greenplum Database for our Data warehouse and
> using Kettle to do the transformation.
>
> Every time we do a Kettle job to do Type I or Type 2 transformation we
> get atleast one of the transformation hang (every time it's a different
> transformation though).
>
> I then got to kill the job and "vacuum analyze the table in the db" and
> rerun them manually.
>
> Please remember there is not much data to load but it still hangs.
>
> We ended up rewriting the whole Type2 transformation into SQL Procedures
> and it works cool.
>
> Any suggestions will be appreciated.
>
> Regards
> Murali
>
>
> __________________________________________________
> Do You Yahoo!?
> Tired of spam? Yahoo! Mail has the best spam protection around
> http://mail.yahoo.com
>


--
Matt
____________________________________________
Matt Casters
Chief Data Integration - Kettle founder
Pentaho, Open Source Business Intelligence
http://www.pentaho.org -- mcasters (AT) pentaho (DOT) org
Tel. +32 (0) 486 97 29 37

--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "kettle-developers" group.
To post to this group, send email to kettle-developers (AT) googlegroups (DOT) com
To unsubscribe from this group, send email to kettle-developers-unsubscribe (AT) googlegroups (DOT) com
For more options, visit this group at http://groups.google.com/group/kettle-developers?hl=en
-~----------~----~----~----~------~----~------~--~---