Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Read many lines in data grid to job executor

  1. #1
    Join Date
    Dec 2015
    Posts
    9

    Default Read many lines in data grid to job executor

    Hi



    I have a main job , which connects with a transformation . This tranformation have a data grid with 2 lines and several columns, which connects with a job executor . My problem is that when you run the job running it runs only the first line how do I it runs each row of data grid ?

    Main
    Name:  main.PNG
Views: 35
Size:  5.0 KB

    Tranformation Inner
    Name:  transformation.jpg
Views: 37
Size:  22.6 KB
    Parameters
    Name:  Paramiter.jpg
Views: 39
Size:  29.0 KB

    Job Final
    Name:  jobfinal.jpg
Views: 36
Size:  6.5 KB

  2. #2
    Join Date
    Dec 2015
    Posts
    9

    Default

    Hi

    I solved this problem, but now I have another problem.
    I have a main Job, seeking the parameters of a transformation , passes this parameter to another job that has an internal transformation. This internal transformation should also receive the parameters of the main job . But it does not receive the parameters and also does not run .
    Log from the main job :

    2015/12/18 10:48:48 - Spoon - Iniciando o job...
    2015/12/18 10:48:48 - Incial Full - Início da execução do job
    2015/12/18 10:48:48 - Incial Full - Starting entry [DadosOrgs]
    2015/12/18 10:48:48 - DadosOrgs - Loading transformation from XML file [file:///C:/ETL/Testes/Full.ktr]
    2015/12/18 10:48:48 - Full - Expedindo in�cio para transforma��o [Full]
    2015/12/18 10:48:48 - Full - Nr de argumentos detectados:10
    2015/12/18 10:48:48 - Full - Esta n�o � uma repeti��o de transforma��o
    2015/12/18 10:48:48 - Full - Foram encotrados 4 steps diferentes para executar.
    2015/12/18 10:48:48 - Full - Alocando rowsets...
    2015/12/18 10:48:48 - Full - Alocando rowsets para o step 0 --> Data Grid
    2015/12/18 10:48:48 - Full - c�pias pr�vias = 1, pr�ximas c�pias=1
    2015/12/18 10:48:48 - Full - Transforma��o alocou novo rowset [Data Grid.0 - Filter rows.0]
    2015/12/18 10:48:48 - Full - Foram alocados 1 rowsets por step 0 --> Data Grid
    2015/12/18 10:48:48 - Full - Alocando rowsets para o step 1 --> Filter rows
    2015/12/18 10:48:48 - Full - c�pias pr�vias = 1, pr�ximas c�pias=1
    2015/12/18 10:48:48 - Full - Transforma��o alocou novo rowset [Filter rows.0 - Copy rows to result.0]
    2015/12/18 10:48:48 - Full - c�pias pr�vias = 1, pr�ximas c�pias=1
    2015/12/18 10:48:48 - Full - Transforma��o alocou novo rowset [Filter rows.0 - Dummy (do nothing).0]
    2015/12/18 10:48:48 - Full - Foram alocados 3 rowsets por step 1 --> Filter rows
    2015/12/18 10:48:48 - Full - Alocando rowsets para o step 2 --> Copy rows to result
    2015/12/18 10:48:48 - Full - Foram alocados 3 rowsets por step 2 --> Copy rows to result
    2015/12/18 10:48:48 - Full - Alocando rowsets para o step 3 --> Dummy (do nothing)
    2015/12/18 10:48:48 - Full - Foram alocados 3 rowsets por step 3 --> Dummy (do nothing)
    2015/12/18 10:48:48 - Full - Alocando Steps & StepData...
    2015/12/18 10:48:48 - Full - Transforma��o ir� alocar o step [Data Grid] do tipe [DataGrid]
    2015/12/18 10:48:48 - Data Grid.0 - distribution activated
    2015/12/18 10:48:48 - Data Grid.0 - Starting allocation of buffers & new threads...
    2015/12/18 10:48:48 - Data Grid.0 - Step info: nrinput=0 nroutput=1
    2015/12/18 10:48:48 - Data Grid.0 - output rel. is 1:1
    2015/12/18 10:48:48 - Data Grid.0 - Found output rowset [Data Grid.0 - Filter rows.0]
    2015/12/18 10:48:48 - Data Grid.0 - Finished dispatching
    2015/12/18 10:48:48 - Full - Transforma��o alocou um novo step: [Data Grid].0
    2015/12/18 10:48:48 - Full - Transforma��o ir� alocar o step [Filter rows] do tipe [FilterRows]
    2015/12/18 10:48:48 - Filter rows.0 - distribution activated
    2015/12/18 10:48:48 - Filter rows.0 - Starting allocation of buffers & new threads...
    2015/12/18 10:48:48 - Filter rows.0 - Step info: nrinput=1 nroutput=2
    2015/12/18 10:48:48 - Filter rows.0 - Got previous step from [Filter rows] #0 --> Data Grid
    2015/12/18 10:48:48 - Filter rows.0 - input rel is 1:1
    2015/12/18 10:48:48 - Filter rows.0 - Found input rowset [Data Grid.0 - Filter rows.0]
    2015/12/18 10:48:48 - Filter rows.0 - output rel. is 1:1
    2015/12/18 10:48:48 - Filter rows.0 - Found output rowset [Filter rows.0 - Copy rows to result.0]
    2015/12/18 10:48:48 - Filter rows.0 - output rel. is 1:1
    2015/12/18 10:48:48 - Filter rows.0 - Found output rowset [Filter rows.0 - Dummy (do nothing).0]
    2015/12/18 10:48:48 - Filter rows.0 - Finished dispatching
    2015/12/18 10:48:48 - Full - Transforma��o alocou um novo step: [Filter rows].0
    2015/12/18 10:48:48 - Full - Transforma��o ir� alocar o step [Copy rows to result] do tipe [RowsToResult]
    2015/12/18 10:48:48 - Copy rows to result.0 - distribution activated
    2015/12/18 10:48:48 - Copy rows to result.0 - Starting allocation of buffers & new threads...
    2015/12/18 10:48:48 - Copy rows to result.0 - Step info: nrinput=1 nroutput=0
    2015/12/18 10:48:48 - Copy rows to result.0 - Got previous step from [Copy rows to result] #0 --> Filter rows
    2015/12/18 10:48:48 - Copy rows to result.0 - input rel is 1:1
    2015/12/18 10:48:48 - Copy rows to result.0 - Found input rowset [Filter rows.0 - Copy rows to result.0]
    2015/12/18 10:48:48 - Copy rows to result.0 - Finished dispatching
    2015/12/18 10:48:48 - Full - Transforma��o alocou um novo step: [Copy rows to result].0
    2015/12/18 10:48:48 - Full - Transforma��o ir� alocar o step [Dummy (do nothing)] do tipe [Dummy]
    2015/12/18 10:48:48 - Dummy (do nothing).0 - distribution activated
    2015/12/18 10:48:48 - Dummy (do nothing).0 - Starting allocation of buffers & new threads...
    2015/12/18 10:48:48 - Dummy (do nothing).0 - Step info: nrinput=1 nroutput=0
    2015/12/18 10:48:48 - Dummy (do nothing).0 - Got previous step from [Dummy (do nothing)] #0 --> Filter rows
    2015/12/18 10:48:48 - Dummy (do nothing).0 - input rel is 1:1
    2015/12/18 10:48:48 - Dummy (do nothing).0 - Found input rowset [Filter rows.0 - Dummy (do nothing).0]
    2015/12/18 10:48:48 - Dummy (do nothing).0 - Finished dispatching
    2015/12/18 10:48:48 - Full - Transforma��o alocou um novo step: [Dummy (do nothing)].0
    2015/12/18 10:48:48 - Full - Esta transforma��o pode ser repetida com a data de repeti��o : 2015/12/18 10:48:48
    2015/12/18 10:48:48 - Full - Inicializando 4 steps...
    2015/12/18 10:48:48 - Data Grid.0 - Released server socket on port 0
    2015/12/18 10:48:48 - Filter rows.0 - Released server socket on port 0
    2015/12/18 10:48:48 - Copy rows to result.0 - Released server socket on port 0
    2015/12/18 10:48:48 - Dummy (do nothing).0 - Released server socket on port 0
    2015/12/18 10:48:48 - Full - Step [Data Grid.0] inicializado sem falhas.
    2015/12/18 10:48:48 - Full - Step [Filter rows.0] inicializado sem falhas.
    2015/12/18 10:48:48 - Full - Step [Copy rows to result.0] inicializado sem falhas.
    2015/12/18 10:48:48 - Full - Step [Dummy (do nothing).0] inicializado sem falhas.
    2015/12/18 10:48:48 - Data Grid.0 - Iniciando execução...
    2015/12/18 10:48:48 - Filter rows.0 - Iniciando execução...
    2015/12/18 10:48:48 - Full - Transforma��o alocou 4 threads e 3 rowsets.
    2015/12/18 10:48:48 - Copy rows to result.0 - Iniciando execução...
    2015/12/18 10:48:48 - Dummy (do nothing).0 - Iniciando execução...
    2015/12/18 10:48:48 - Data Grid.0 - Finished processing (I=0, O=0, R=0, W=2, U=0, E=0)
    2015/12/18 10:48:48 - Filter rows.0 - Finished processing (I=0, O=0, R=2, W=2, U=0, E=0)
    2015/12/18 10:48:48 - Dummy (do nothing).0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
    2015/12/18 10:48:48 - Copy rows to result.0 - Finished processing (I=0, O=0, R=2, W=2, U=0, E=0)
    2015/12/18 10:48:48 - Incial Full - Starting entry [InicialCategoria]
    2015/12/18 10:48:48 - InicialCategoria - Starting entry [HTTP]
    2015/12/18 10:48:48 - HTTP - Start of HTTP job entry.
    2015/12/18 10:48:48 - HTTP - Connecting to URL: http://b2b.extra.com.br/Arquivos/Cat...idParceiro=121
    2015/12/18 10:48:48 - HTTP - Resource type: application/zip, last modified on: Wed Dec 31 21:00:00 BRT 1969.
    2015/12/18 10:48:48 - HTTP - Finished writing 31756 bytes to result file [C:\ETL\Testes\Processamento\OI\Categoria\Download\Categoria.zip]
    2015/12/18 10:48:48 - InicialCategoria - Starting entry [Unzip file]
    2015/12/18 10:48:48 - InicialCategoria - Starting entry [CategoriaPai]
    2015/12/18 10:48:49 - CategoriaPai - Loading transformation from XML file [file:///C:/ETL/Testes/Categoria/CategoriaPai.ktr]
    2015/12/18 10:48:49 - InicialCategoria - Starting entry [CategoriaFilho]
    2015/12/18 10:48:49 - CategoriaFilho - Loading transformation from XML file [file:///C:/ETL/Testes/Categoria/CategoriaFilho.ktr]
    2015/12/18 10:48:49 - InicialCategoria - Starting entry [CategoriaNeto]
    2015/12/18 10:48:49 - CategoriaNeto - Loading transformation from XML file [file:///C:/ETL/Testes/Categoria/CategoriaNeto.ktr]
    2015/12/18 10:48:49 - InicialCategoria - Starting entry [Success]
    2015/12/18 10:48:49 - InicialCategoria - Finished job entry [Success] (result=[true])
    2015/12/18 10:48:49 - InicialCategoria - Finished job entry [CategoriaNeto] (result=[true])
    2015/12/18 10:48:49 - InicialCategoria - Finished job entry [CategoriaFilho] (result=[true])
    2015/12/18 10:48:49 - InicialCategoria - Finished job entry [CategoriaPai] (result=[true])
    2015/12/18 10:48:49 - InicialCategoria - Finished job entry [Unzip file] (result=[true])
    2015/12/18 10:48:49 - InicialCategoria - Finished job entry [HTTP] (result=[true])
    2015/12/18 10:48:49 - InicialCategoria - Starting entry [HTTP]
    2015/12/18 10:48:49 - HTTP - Start of HTTP job entry.
    2015/12/18 10:48:49 - HTTP - Connecting to URL: http://b2b.extra.com.br/Arquivos/Cat...idParceiro=121
    2015/12/18 10:48:49 - HTTP - Resource type: application/zip, last modified on: Wed Dec 31 21:00:00 BRT 1969.
    2015/12/18 10:48:49 - HTTP - Finished writing 31756 bytes to result file [C:\ETL\Testes\Processamento\Adimax\Categoria\Download\Categoria.zip]
    2015/12/18 10:48:49 - InicialCategoria - Starting entry [Unzip file]
    2015/12/18 10:48:49 - InicialCategoria - Starting entry [CategoriaPai]
    2015/12/18 10:48:49 - CategoriaPai - Loading transformation from XML file [file:///C:/ETL/Testes/Categoria/CategoriaPai.ktr]
    2015/12/18 10:48:49 - InicialCategoria - Starting entry [CategoriaFilho]
    2015/12/18 10:48:49 - CategoriaFilho - Loading transformation from XML file [file:///C:/ETL/Testes/Categoria/CategoriaFilho.ktr]
    2015/12/18 10:48:49 - InicialCategoria - Starting entry [CategoriaNeto]
    2015/12/18 10:48:49 - CategoriaNeto - Loading transformation from XML file [file:///C:/ETL/Testes/Categoria/CategoriaNeto.ktr]
    2015/12/18 10:48:49 - InicialCategoria - Starting entry [Success]
    2015/12/18 10:48:49 - InicialCategoria - Finished job entry [Success] (result=[true])
    2015/12/18 10:48:49 - InicialCategoria - Finished job entry [CategoriaNeto] (result=[true])
    2015/12/18 10:48:49 - InicialCategoria - Finished job entry [CategoriaFilho] (result=[true])
    2015/12/18 10:48:49 - InicialCategoria - Finished job entry [CategoriaPai] (result=[true])
    2015/12/18 10:48:49 - InicialCategoria - Finished job entry [Unzip file] (result=[true])
    2015/12/18 10:48:49 - InicialCategoria - Finished job entry [HTTP] (result=[true])
    2015/12/18 10:48:49 - Incial Full - Starting entry [Success]
    2015/12/18 10:48:49 - Incial Full - Finished job entry [Success] (result=[true])
    2015/12/18 10:48:49 - Incial Full - Finished job entry [InicialCategoria] (result=[true])
    2015/12/18 10:48:49 - Incial Full - Finished job entry [DadosOrgs] (result=[true])
    2015/12/18 10:48:49 - Incial Full - Job execution finished
    2015/12/18 10:48:49 - Spoon - O Job finalizou.


    That line for me this strange , as are the internal changes that have not implemented

    2015/12/18 10:48:48 - InicialCategoria - Starting entry [CategoriaPai]
    2015/12/18 10:48:49 - CategoriaPai - Loading transformation from XML file [file:///C:/ETL/Testes/Categoria/CategoriaPai.ktr]
    2015/12/18 10:48:49 - InicialCategoria - Starting entry [CategoriaFilho]
    2015/12/18 10:48:49 - CategoriaFilho - Loading transformation from XML file [file:///C:/ETL/Testes/Categoria/CategoriaFilho.ktr]
    2015/12/18 10:48:49 - InicialCategoria - Starting entry [CategoriaNeto]
    2015/12/18 10:48:49 - CategoriaNeto - Loading transformation from XML file [file:///C:/ETL/Testes/Categoria/CategoriaNeto.ktr]
    2015/12/18 10:48:49 - InicialCategoria - Starting entry [Success]




    Some idea of the problem? Can someone help me?

  3. #3
    Join Date
    Dec 2015
    Posts
    9

    Default

    Hi I solved this problem.

    I set the wrong transaction

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.