Two new steps/plugins - XML Join and Meta Data Step

[Ingo Klose]

Hello,

Jens advised me to send this mail to the Kettle Dev mailing list.

I have developed two plugins for the Pentaho customer GEK, which they would like to contribute back to the community.

1. XML Join - A Step that lets you join two XML documents or lets you add tags from one stream to a XML document in the second.
2. Meta Data Structure - A step that lets you read out the meta data of an incoming stream (field information and row count) for later use such as documenting.

I already put the two steps in JIRA

http://jira.pentaho.com/browse/PDI-1234 : XML Join
http://jira.pentaho.com/browse/PDI-1235 : Meta Data Structure


My question is, what are the odds that you will include the steps into the 3..1 release.

I also posted changes to two additional steps in JIRA:

http://jira.pentaho.com/browse/PDI-1215 : Textfile output - Read file name from field and variable support for separator and enclosure
http://jira.pentaho.com/browse/PDI-1223 : Add XML - Some changes to have more flexibility to build XML fragments. (probably not fully backward compatible)

Same question, what are the odds that the changes make it into 3.1?

Please let me know what I can do to ease the integration of those changes.

Thanks a lot.

Regards,
Ingo




--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "kettle-developers" group.
To post to this group, send email to kettle-developers (AT) googlegroups (DOT) com
To unsubscribe from this group, send email to kettle-developers-unsubscribe (AT) g...oups (DOT) com
For more options, visit this group at http://groups.google.com/group/kettle-developers?hl=en
-~----------~----~----~----~------~----~------~--~---

[Sven.Boden]

I like the XML Join, Meta Data Structure is also ok. For Meta Data Structure the row count seems a bit "misplaced".

I'm against PDI-1223 for the simple fact that it breaks backwards compatibility. What's your explanation of breaking compatibility for people currently using "Add XML" step?

Also not that fond of PDI-1215... that also activates unwanted side-effects (try the split option, or the line count with your options switched on), and opens up a small can of worms ;-) . Besides there are easy ways around it even in current PDI.

Regards,
Sven

>----- Oorspronkelijk bericht -----
>Van: Ingo Klose [mailto:Ingo.Klose (AT) Gek (DOT) de]
>Verzonden: vrijdag, mei 16, 2008 08:51 AM
>Aan: kettle-developers (AT) googlegroups (DOT) com
>Onderwerp: Two new steps/plugins - XML Join and Meta Data Step
>
>
>Hello,
>
>Jens advised me to send this mail to the Kettle Dev mailing list.
>
>I have developed two plugins for the Pentaho customer GEK, which they would like to contribute back to the community.
>
>1. XML Join - A Step that lets you join two XML documents or lets you add tags from one stream to a XML document in the second.
>2. Meta Data Structure - A step that lets you read out the meta data of an incoming stream (field information and row count) for later use such as documenting.
>
>I already put the two steps in JIRA
>
>http://jira.pentaho.com/browse/PDI-1234 : XML Join
>http://jira.pentaho.com/browse/PDI-1235 : Meta Data Structure
>
>
>My question is, what are the odds that you will include the steps into the 3.1 release.
>
>I also posted changes to two additional steps in JIRA:
>
>http://jira.pentaho.com/browse/PDI-1215 : Textfile output - Read file name from field and variable support for separator and enclosure
>http://jira.pentaho.com/browse/PDI-1223 : Add XML - Some changes to have more flexibility to build XML fragments. (probably not fully backward compatible)
>
>Same question, what are the odds that the changes make it into 3.1?
>
>Please let me know what I can do to ease the integration of those changes.
>
>Thanks a lot.
>
>Regards,
>Ingo
>
>
>
>
>>
>
>



--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "kettle-developers" group.
To post to this group, send email to kettle-developers (AT) googlegroups (DOT) com
To unsubscribe from this group, send email to kettle-developers-unsubscribe (AT) g...oups (DOT) com
For more options, visit this group at http://groups.google.com/group/kettle-developers?hl=en
-~----------~----~----~----~------~----~------~--~---

[Jens Bleuel]

Before we go to feature freeze ("We

[Matt Casters]

I have no problem is if all is backward compatible.

We seem to be quite on schedule, but if the steps get added, I would like some
help documenting these new steps as well as the changes :-)

It sounds like 3.1 will be another amazing release :-)

Cheers,

Matt


On Monday 19 May 2008 21:09:58 Jens Bleuel wrote:[color=blue]
> Before we go to feature freeze ("We

[ingo.klose]

Hi,

My bad for taking the conversation offline, sorry about that.

@Matt: I will be glad to help you documenting the new steps and
changes.

Thx and regards,
Ingo



Matt Casters wrote:
> I have no problem is if all is backward compatible.
>
> We seem to be quite on schedule, but if the steps get added, I would like some
> help documenting these new steps as well as the changes :-)
>
> It sounds like 3.1 will be another amazing release :-)
>
> Cheers,
>
> Matt
>
>
> On Monday 19 May 2008 21:09:58 Jens Bleuel wrote:
> > Before we go to feature freeze ("We�re projecting to go into feature
> > freeze (M3/RC1) around May 22nd."):
> >
> > I think it is a good addition and I heard that Ingo & Sven discussed a
> > bit more and the AddXML step is now backward compatible (guys: I would
> > like it a lot more, when the discussion would be public next time....).
> >
> > I would like to see these new steps and changes in 3.1 ;-)
> >
> > Any votes for/against?
> >
> > Cheers,
> > Jens
> >
> > Sven.Boden schrieb:
> > > I like the XML Join, Meta Data Structure is also ok. For Meta Data
> > > Structure the row count seems a bit "misplaced".
> > >
> > > I'm against PDI-1223 for the simple fact that it breaks backwards
> > > compatibility. What's your explanation of breaking compatibility for
> > > people currently using "Add XML" step?
> > >
> > > Also not that fond of PDI-1215... that also activates unwanted
> > > side-effects (try the split option, or the line count with your options
> > > switched on), and opens up a small can of worms ;-) . Besides there are
> > > easy ways around it even in current PDI.
> > >
> > > Regards,
> > > Sven
> > >
> > >> ----- Oorspronkelijk bericht -----
> > >> Van: Ingo Klose [mailto:Ingo.Klose (AT) Gek (DOT) de]
> > >> Verzonden: vrijdag, mei 16, 2008 08:51 AM
> > >> Aan: kettle-developers (AT) googlegroups (DOT) com
> > >> Onderwerp: Two new steps/plugins - XML Join and Meta Data Step
> > >>
> > >>
> > >> Hello,
> > >>
> > >> Jens advised me to send this mail to the Kettle Dev mailing list.
> > >>
> > >> I have developed two plugins for the Pentaho customer GEK, which they
> > >> would like to contribute back to the community.
> > >>
> > >> 1. XML Join - A Step that lets you join two XML documents or lets you
> > >> add tags from one stream to a XML document in the second. 2. Meta Data
> > >> Structure - A step that lets you read out the meta data of an incoming
> > >> stream (field information and row count) for later use such as
> > >> documenting.
> > >>
> > >> I already put the two steps in JIRA
> > >>
> > >> http://jira.pentaho.com/browse/PDI-1234 : XML Join
> > >> http://jira.pentaho.com/browse/PDI-1235 : Meta Data Structure
> > >>
> > >>
> > >> My question is, what are the odds that you will include the steps into
> > >> the 3.1 release.
> > >>
> > >> I also posted changes to two additional steps in JIRA:
> > >>
> > >> http://jira.pentaho.com/browse/PDI-1215 : Textfile output - Read file
> > >> name from field and variable support for separator and enclosure
> > >> http://jira.pentaho.com/browse/PDI-1223 : Add XML - Some changes to have
> > >> more flexibility to build XML fragments. (probably not fully backward
> > >> compatible)
> > >>
> > >> Same question, what are the odds that the changes make it into 3.1?
> > >>
> > >> Please let me know what I can do to ease the integration of those
> > >> changes.
> > >>
> > >> Thanks a lot.
> > >>
> > >> Regards,
> > >> Ingo
>
>
>
> --
> Matt
> ____________________________________________
> Matt Casters
> Chief Data Integration - Kettle founder
> Pentaho, Open Source Business Intelligence
> http://www.pentaho.org -- mcasters (AT) pentaho (DOT) org
> Tel. +32 (0) 486 97 29 37
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "kettle-developers" group.
To post to this group, send email to kettle-developers (AT) googlegroups (DOT) com
To unsubscribe from this group, send email to kettle-developers-unsubscribe (AT) g...oups (DOT) com
For more options, visit this group at http://groups.google.com/group/kettle-developers?hl=en
-~----------~----~----~----~------~----~------~--~---

[Matt Casters]

Apart from the "Text File Output" step that now throws NPE's and a new
performance problem because of the environmentSubstitues of
separators/enclosures, I'm done with the 4 PDI cases.

I'll try to get Text File Output back on the rails today.

Matt


On Tuesday 20 May 2008 09:36:11 ingo.klose wrote:
> Hi,
>
> My bad for taking the conversation offline, sorry about that.
>
> @Matt: I will be glad to help you documenting the new steps and
> changes.
>
> Thx and regards,
> Ingo
>
> Matt Casters wrote:
> > I have no problem is if all is backward compatible.
> >
> > We seem to be quite on schedule, but if the steps get added, I would like
> > some help documenting these new steps as well as the changes :-)
> >
> > It sounds like 3.1 will be another amazing release :-)
> >
> > Cheers,
> >
> > Matt
> >
> > On Monday 19 May 2008 21:09:58 Jens Bleuel wrote:
> > > Before we go to feature freeze ("We�re projecting to go into feature
> > > freeze (M3/RC1) around May 22nd."):
> > >
> > > I think it is a good addition and I heard that Ingo & Sven discussed a
> > > bit more and the AddXML step is now backward compatible (guys: I would
> > > like it a lot more, when the discussion would be public next time....)..
> > >
> > > I would like to see these new steps and changes in 3.1 ;-)
> > >
> > > Any votes for/against?
> > >
> > > Cheers,
> > > Jens
> > >
> > > Sven.Boden schrieb:
> > > > I like the XML Join, Meta Data Structure is also ok. For Meta Data
> > > > Structure the row count seems a bit "misplaced".
> > > >
> > > > I'm against PDI-1223 for the simple fact that it breaks backwards
> > > > compatibility. What's your explanation of breaking compatibility for
> > > > people currently using "Add XML" step?
> > > >
> > > > Also not that fond of PDI-1215... that also activates unwanted
> > > > side-effects (try the split option, or the line count with your
> > > > options switched on), and opens up a small can of worms ;-) . Besides
> > > > there are easy ways around it even in current PDI.
> > > >
> > > > Regards,
> > > > Sven
> > > >
> > > >> ----- Oorspronkelijk bericht -----
> > > >> Van: Ingo Klose [mailto:Ingo.Klose (AT) Gek (DOT) de]
> > > >> Verzonden: vrijdag, mei 16, 2008 08:51 AM
> > > >> Aan: kettle-developers (AT) googlegroups (DOT) com
> > > >> Onderwerp: Two new steps/plugins - XML Join and Meta Data Step
> > > >>
> > > >>
> > > >> Hello,
> > > >>
> > > >> Jens advised me to send this mail to the Kettle Dev mailing list.
> > > >>
> > > >> I have developed two plugins for the Pentaho customer GEK, which
> > > >> they would like to contribute back to the community.
> > > >>
> > > >> 1. XML Join - A Step that lets you join two XML documents or lets
> > > >> you add tags from one stream to a XML document in the second. 2.
> > > >> Meta Data Structure - A step that lets you read out the meta data of
> > > >> an incoming stream (field information and row count) for later use
> > > >> such as documenting.
> > > >>
> > > >> I already put the two steps in JIRA
> > > >>
> > > >> http://jira.pentaho.com/browse/PDI-1234 : XML Join
> > > >> http://jira.pentaho.com/browse/PDI-1235 : Meta Data Structure
> > > >>
> > > >>
> > > >> My question is, what are the odds that you will include the steps
> > > >> into the 3.1 release.
> > > >>
> > > >> I also posted changes to two additional steps in JIRA:
> > > >>
> > > >> http://jira.pentaho.com/browse/PDI-1215 : Textfile output - Read
> > > >> file name from field and variable support for separator and
> > > >> enclosure http://jira.pentaho.com/browse/PDI-1223 : Add XML - Some
> > > >> changes to have more flexibility to build XML fragments. (probably
> > > >> not fully backward compatible)
> > > >>
> > > >> Same question, what are the odds that the changes make it into 3.1?
> > > >>
> > > >> Please let me know what I can do to ease the integration of those
> > > >> changes.
> > > >>
> > > >> Thanks a lot.
> > > >>
> > > >> Regards,
> > > >> Ingo
> >
> > --
> > Matt
> > ____________________________________________
> > Matt Casters
> > Chief Data Integration - Kettle founder
> > Pentaho, Open Source Business Intelligence
> > http://www.pentaho.org -- mcasters (AT) pentaho (DOT) org
> > Tel. +32 (0) 486 97 29 37
>
>


--
Matt
____________________________________________
Matt Casters
Chief Data Integration - Kettle founder
Pentaho, Open Source Business Intelligence
http://www.pentaho.org -- mcasters (AT) pentaho (DOT) org
Tel. +32 (0) 486 97 29 37

--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "kettle-developers" group.
To post to this group, send email to kettle-developers (AT) googlegroups (DOT) com
To unsubscribe from this group, send email to kettle-developers-unsubscribe (AT) g...oups (DOT) com
For more options, visit this group at http://groups.google.com/group/kettle-developers?hl=en
-~----------~----~----~----~------~----~------~--~---