US and Worldwide: +1 (866) 660-7555

Search Forums:

Type: Posts; User: gutlez; Keyword(s):

Page 1 of 64 1 2 3 4

Search Forums: Search took 0.22 seconds.

  1. You can work with the community to develop what...

    You can work with the community to develop what it is that you want to do.

    If I were doing it by hand, I would:
    1) Create a list of the tables to be moved
    2) For each Table in the list:
    a) Pull...
  2. Replies
    4
    Views
    80

    If you use DB Repository, then the Start Time,...

    If you use DB Repository, then the Start Time, End Time, and Status are recorded to a log table automatically.
    You could also configure the LOGGING items in the Transform Settings. (Ctrl-T in spoon...
  3. Replies
    3
    Views
    100

    Unfortunately, I have no experience with Pentaho...

    Unfortunately, I have no experience with Pentaho Support.
    I have, on the other hand, had lots of experience with the community. They usually answer questions really fast, but sometimes questions...
  4. Replies
    3
    Views
    92

    No I'm meaning to take the flow GB_Org_WA -> ......

    No I'm meaning to take the flow GB_Org_WA -> ... -> Update Master in one transform, and the flow GB_Org_WA -> ... -> Update Slaves in another transform.

    No temp tables. No temp files. Just two...
  5. Replies
    3
    Views
    92

    Your "Modified_Flow.ktr" looks like it shouldn't...

    Your "Modified_Flow.ktr" looks like it shouldn't deadlock, unless there's a DB deadlock happening.

    I would really try to break the work that you are doing down into the component steps:
    1) Update...
  6. Replies
    11
    Views
    212

    Start taking steps to determine where your...

    Start taking steps to determine where your bottleneck is.

    Table Input (with Join in it) -> Filter Rows -> Text File Output
    This will help you identify if the issue is with your table input.
    ...
  7. Is that the output of the Get Data from XML, or...

    Is that the output of the Get Data from XML, or from the REST step?

    Can you get the REST to return something other than CSV?
    If you can't get it to return something other than CSV, you may need...
  8. Replies
    11
    Views
    212

    Is this not just Select...

    Is this not just
    Select column-A,column-B,column-C, TableB.Key from ITF_FIN_INST left outer join TableB on (TableB.ColumnC = ITF_FIN_INST.column-C)

    Then filter rows for TableB.Key is null. Any...
  9. Replies
    11
    Views
    212

    Diptesh, Is there a good reason that you are...

    Diptesh,

    Is there a good reason that you are going Table Input -> DB Lookup?
    If these are in the the same DB, you can improve performance by including the lookup in the Table Input.

    Remember...
  10. I'm sorry, I'm not understanding you... ...

    I'm sorry, I'm not understanding you... Something is getting lost in translation.


    Metadata Injection allows you to dynamically reconfigure a known transformation to accept other inputs /...
  11. Replies
    1
    Views
    63

    To me that depends on the expected input flow. ...

    To me that depends on the expected input flow.

    If you are expecting all account numbers to come in to the lookup, then I would pre-load the lookup table and do a join (of one type or another).
    If...
  12. Replies
    1
    Views
    70

    Pentaho itself does this for CI....

    Pentaho itself does this for CI.
    http://ci.pentaho.com/

    However, this is for updating PDI, and making sure that it doesn't change the output of transformations.
    There must be a way to accomplish...
  13. I would say that it depends on the situation. ...

    I would say that it depends on the situation.

    For performance tuning, move what you can to the DB.
    For long term maintenance and clarity of what is being done, put it in PDI.
    For a balance of...
  14. Have you considered buying a support contract...

    Have you considered buying a support contract from Pentaho?
    I notice that more than a few of your posts mention "Its urgent"

    This is a community site. That means that community members will...
  15. In short, DON'T. Use the CSV input step or the...

    In short, DON'T.

    Use the CSV input step or the Text File Input step. That's what they are there for.

    If you *HAVE* to process inside of the transform, then use "split field" step (based on , )...
  16. Ok, so... What version of PDI are you using? ...

    Ok, so... What version of PDI are you using?
    what DB?
    what DB Driver?

    What is the definition of 'PRIMARY'?
  17. Remove the ID from the Update Fields grid. There...

    Remove the ID from the Update Fields grid.
    There was also a recent report on here that there's an issue with Oracle with this step. Upgrading the to latest Oracle JDBC client fixed it.
  18. Replies
    3
    Views
    147

    Starting Spoon, Kitchen, or Pan with a different...

    Starting Spoon, Kitchen, or Pan with a different KETTLE_HOME will allow you to have a different kettle.properties per run of PDI.
    Alternatively, you could look at an old project (...
  19. Replies
    3
    Views
    147

    Have a look at kettle.properties, since that file...

    Have a look at kettle.properties, since that file will pre-set your variables on startup.
  20. Replies
    6
    Views
    134

    Also, have a good look at the Step Statistics...

    Also, have a good look at the Step Statistics step, which will tell you about how many rows were sent to the DB Procedure, and how many rows came back.
  21. Replies
    9
    Views
    178

    How would you handle this if there were multiple...

    How would you handle this if there were multiple files?
    How would you handle this if the file was missing its header row, and had the wrong delimiter?

    By writing to a file or table log, you can...
  22. Replies
    5
    Views
    161

    Can you try it on a Win7 machine instead of a...

    Can you try it on a Win7 machine instead of a Win8 machine?
    Is it a UNC mapped path, or a local disk?
  23. ODBC Connections are not supported in Java 1.8,...

    ODBC Connections are not supported in Java 1.8, and have been depreciated for a very long time now.
    Try it again with a JDBC connection.
  24. Replies
    6
    Views
    134

    Have a look at the "Call DB Procedure...

    Have a look at the "Call DB Procedure" step...
  25. If you were doing it by hand, would you be able...

    If you were doing it by hand, would you be able to do it in a single step, or would you need to look at all 4 fields?
    I'd bet that you would need to look at all 4 fields, so to make your logic clear...
  26. Why not embed your business logic into a Formula...

    Why not embed your business logic into a Formula step, and then use a switch-case to send to the appropriate Table Output?

    You actually gain a lot of understanding in the flow if you use Filter...
  27. Replies
    6
    Views
    134

    In BI Server, or in PDI?

    In BI Server, or in PDI?
  28. Replies
    8
    Views
    181

    The slowdown could be being caused by the Insert...

    The slowdown could be being caused by the Insert / Update step, rather than the execute SQL Statement step.
    You should really be using the Table Input rather than the DB Join, but I'm not not sure...
  29. Replies
    8
    Views
    181

    Posting images of your transform isn't helpful,...

    Posting images of your transform isn't helpful, especially when the image is illegible.
    Post the actual transform.
  30. Replies
    5
    Views
    156

    There's a fix on the boards here that have you...

    There's a fix on the boards here that have you add a couple of lines to your spoon.sh

    If you search carefully for it, you should be able to find it.
  31. Your SQL script step will run for each row that...

    Your SQL script step will run for each row that is fed to it.
    If you have 1000 rows in a layout similar to:
    DataGrid -> Table Ouptut -> SQL Script

    Then your SQL script will be run 1000 times.
  32. Replies
    8
    Views
    181

    Without the transform, there's not a lot that we...

    Without the transform, there's not a lot that we can suggest.

    However, your throughput will depend highly on how far (network wise) your PDI install is from your database.
  33. Replies
    8
    Views
    181

    Are you sure you're only sending one record as...

    Are you sure you're only sending one record as input, or are you sending multiple rows of that one value?

    I've seen beginners think they are sending only one value, when they are sending 10 of the...
  34. Yeah, I've found that it works in some places,...

    Yeah, I've found that it works in some places, but not in others. I should probably put JIRA (Bug) records in when I find places it doesn't work.
    However, I've found that mapped drives *ALWAYS*...
  35. UNC is not fully supported in PDI. If you map it...

    UNC is not fully supported in PDI.
    If you map it to a drive letter, it will work.
  36. You are correct - Parameters can only be strings....

    You are correct - Parameters can only be strings.

    One common method is to collapse the string array into a CSV string, and then explode the array of parameters back out inside the PDI transform.
  37. Have a look at the Join steps.

    Have a look at the Join steps.
  38. Replies
    2
    Views
    159

    This to me means that your Insert/Update step is...

    This to me means that your Insert/Update step is not configured to look at the correct keys for that table.

    Whatever it is looking up for keys is not finding the row, and goes to insert, but the...
  39. Replies
    4
    Views
    240

    A place to start:...

    A place to start:
    https://github.com/pentaho/pentaho-reporting

    There was an article or two on here about how to set up your build environment, but I can't find them quickly :(
  40. I'm pretty sure Matt answered this on his blog, a...

    I'm pretty sure Matt answered this on his blog, a LONG time ago.

    http://www.ibridge.be/?p=273
    http://www.ibridge.be/?p=201
    http://www.ibridge.be/?p=194
  41. Replies
    4
    Views
    182

    You might want to check the checkbox "Destination...

    You might want to check the checkbox "Destination is a file"
  42. Replies
    2
    Views
    127

    The other common flow is to set up the following...

    The other common flow is to set up the following type of structure:

    - Incoming
    - InProgress
    - Processed
    - Error

    Files come into the Incoming directory, and as soon as they have been seen,...
  43. Replies
    8
    Views
    186

    I don't know. However, if you're pulling data...

    I don't know.

    However, if you're pulling data from a data warehouse, why not just grab it directly with a Table Input?
  44. Replies
    2
    Views
    126

    Parameters do support variable substitution (if...

    Parameters do support variable substitution (if the variables are named correctly!), but I don't think you can use a circular reference... so you can't set the default value of test to ${test}
    ...
  45. Replies
    8
    Views
    186

    None that I'm aware of. Is the procedure...

    None that I'm aware of.
    Is the procedure supposed to help with the reading of the data?
  46. Replies
    8
    Views
    186

    Missing headers is sometimes OK... But missing...

    Missing headers is sometimes OK... But missing rows will be considered the end of data for that tab.
    And yes, CONSISTENT input is key.
  47. Try changing the log level in the batch file from...

    Try changing the log level in the batch file from basic to rowlevel. Then review the logs... It will usually tell you something useful.
    I can't run your sample because the "Validate" step calls...
  48. That's the intent of the configuration option......

    That's the intent of the configuration option...
    It should help!
  49. Replies
    8
    Views
    186

    Quite a few times. Just remember to change the...

    Quite a few times.
    Just remember to change the Spreadsheet Engine on the first tab to Apache POI or Apache POI Streaming.

    If you can't get it to work, post a REALLY simple example of what you're...
  50. Replies
    2
    Views
    166

    Look through the samples. There used to be an...

    Look through the samples. There used to be an example in there.
Results 1 to 50 of 3176
Page 1 of 64 1 2 3 4