Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Weka scoring plugin traceback: Problem loading model file

  1. #1

    Default Weka scoring plugin traceback: Problem loading model file

    I'm on 64-bit Windows 7 running Pentaho 6.0.1.0-386 that has the Weka jar already in the deployment named pdi-wekascoring-plugin-6.0.1.0-386. I'm using Weka 3.6.13 to create the model. I have saved my model from the Weka Explorer and opened it up in Pentaho. I then attached the CSV reader. The attached shows the Jump and then Java traceback. Getting an index out of bounds.


    I'm able to get the fields and preview them just fine in the CSV node. Then when I run the flow I get the TB.

    Since Weka requires ARFF files might this somehow cause an issue when attempting to read CSV files?

    Here's the row level log file

    2016/04/04 10:41:37 - General - Logging plugin type found with ID: CheckpointLogTable
    2016/04/04 10:41:38 - cfgbuilder - Warning: The configuration parameter [org] is not supported by the default configuration builder for scheme: sftp
    2016/04/04 10:41:44 - DBCache - Loading database cache from file: [C:\Users\jmetcalf\.kettle\db.cache-6.0.1.0-386]
    2016/04/04 10:41:44 - DBCache - We read 0 cached rows from the database cache!
    2016/04/04 10:41:45 - General - Starting agile-bi
    2016/04/04 10:41:45 - Spoon - Trying to open the last file used.
    2016/04/04 10:41:46 - cfgbuilder - Warning: The configuration parameter [org] is not supported by the default configuration builder for scheme: sftp
    2016/04/04 10:41:46 - cfgbuilder - Warning: The configuration parameter [org] is not supported by the default configuration builder for scheme: sftp
    2016/04/04 10:41:46 - class org.pentaho.agilebi.platform.JettyServer - WebServer.Log.CreateListener localhost:10000
    2016/04/04 10:44:22 - Spoon - org.pentaho.di.ui.spoon.delegates.SpoonStepsDelegate@138f0661
    2016/04/04 10:46:44 - Spoon - Save to file or repository...
    2016/04/04 10:46:44 - Spoon - File written to [C:\Users\jmetcalf\Downloads\WekaScoring\WekaScoring\docs\data\WekaScoring.ktr]
    2016/04/04 10:46:44 - DBCache - We wrote 0 cached rows to the database cache!
    2016/04/04 10:46:44 - WekaScoring - Transformation is pre-loaded.
    2016/04/04 10:46:44 - WekaScoring - nr of steps to run : 2 , nr of hops : 0
    2016/04/04 10:46:44 - Spoon - Transformation opened.
    2016/04/04 10:46:44 - Spoon - Launching transformation [WekaScoring]...
    2016/04/04 10:46:44 - Spoon - Started the transformation execution.
    2016/04/04 10:46:44 - WekaScoring - Dispatching started for transformation [WekaScoring]
    2016/04/04 10:46:44 - WekaScoring - Nr of arguments detected:0
    2016/04/04 10:46:44 - WekaScoring - This is not a replay transformation
    2016/04/04 10:46:44 - WekaScoring - I found 2 different steps to launch.
    2016/04/04 10:46:44 - WekaScoring - Allocating rowsets...
    2016/04/04 10:46:44 - WekaScoring - Allocating rowsets for step 0 --> CSV file input
    2016/04/04 10:46:44 - WekaScoring - Allocated 0 rowsets for step 0 --> CSV file input
    2016/04/04 10:46:44 - WekaScoring - Allocating rowsets for step 1 --> Weka Scoring
    2016/04/04 10:46:44 - WekaScoring - Allocated 0 rowsets for step 1 --> Weka Scoring
    2016/04/04 10:46:44 - WekaScoring - Allocating Steps & StepData...
    2016/04/04 10:46:44 - WekaScoring - Transformation is about to allocate step [CSV file input] of type [CsvInput]
    2016/04/04 10:46:44 - WekaScoring - Step has nrcopies=1
    2016/04/04 10:46:44 - CSV file input.0 - distribution activated
    2016/04/04 10:46:44 - CSV file input.0 - Starting allocation of buffers & new threads...
    2016/04/04 10:46:44 - CSV file input.0 - Step info: nrinput=0 nroutput=0
    2016/04/04 10:46:44 - CSV file input.0 - Finished dispatching
    2016/04/04 10:46:44 - WekaScoring - Transformation has allocated a new step: [CSV file input].0
    2016/04/04 10:46:44 - WekaScoring - Transformation is about to allocate step [Weka Scoring] of type [WekaScoring]
    2016/04/04 10:46:44 - WekaScoring - Step has nrcopies=1
    2016/04/04 10:46:44 - Weka Scoring.0 - distribution activated
    2016/04/04 10:46:44 - Weka Scoring.0 - Starting allocation of buffers & new threads...
    2016/04/04 10:46:44 - Weka Scoring.0 - Step info: nrinput=0 nroutput=0
    2016/04/04 10:46:44 - Weka Scoring.0 - Finished dispatching
    2016/04/04 10:46:44 - WekaScoring - Transformation has allocated a new step: [Weka Scoring].0
    2016/04/04 10:46:44 - WekaScoring - This transformation can be replayed with replay date: 2016/04/04 10:46:44
    2016/04/04 10:46:44 - WekaScoring - Initialising 2 steps...
    2016/04/04 10:46:44 - CSV file input.0 - Released server socket on port 0
    2016/04/04 10:46:44 - Weka Scoring.0 - Released server socket on port 0
    2016/04/04 10:46:44 - WekaScoring - Step [CSV file input.0] initialized flawlessly.
    2016/04/04 10:46:44 - WekaScoring - Step [Weka Scoring.0] initialized flawlessly.
    2016/04/04 10:46:44 - CSV file input.0 - Starting to run...
    2016/04/04 10:46:44 - Weka Scoring.0 - Starting to run...
    2016/04/04 10:46:44 - WekaScoring - Transformation has allocated 2 threads and 0 rowsets.
    2016/04/04 10:46:44 - Weka Scoring.0 - ERROR (version 6.0.1.0-386, build 1 from 2015-12-03 11.37.25 by buildguy) : Unexpected error
    2016/04/04 10:46:44 - Weka Scoring.0 - ERROR (version 6.0.1.0-386, build 1 from 2015-12-03 11.37.25 by buildguy) : java.lang.NullPointerException
    2016/04/04 10:46:44 - Weka Scoring.0 - at org.pentaho.di.scoring.WekaScoring.processRow(WekaScoring.java:206)
    2016/04/04 10:46:44 - Weka Scoring.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
    2016/04/04 10:46:44 - Weka Scoring.0 - at java.lang.Thread.run(Unknown Source)
    2016/04/04 10:46:44 - Weka Scoring.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=1)
    2016/04/04 10:46:44 - WekaScoring - Transformation detected one or more steps with errors.
    2016/04/04 10:46:44 - WekaScoring - Transformation is killing the other steps!
    2016/04/04 10:46:44 - WekaScoring - Looking at step: CSV file input
    2016/04/04 10:46:44 - CSV file input.0 - Header row skipped in file 'C:\Users\jmetcalf\Dropbox\SAS\MachineLearning\Santander\TrainOutliersRemovedCooksDSLIMMED.csv'
    2016/04/04 10:46:44 - CSV file input.0 - Stopped while putting a row on the buffer
    2016/04/04 10:46:44 - CSV file input.0 - Finished processing (I=2, O=0, R=0, W=0, U=0, E=0)
    2016/04/04 10:46:44 - WekaScoring - Looking at step: Weka Scoring
    2016/04/04 10:46:44 - WekaScoring - searching for annotations
    2016/04/04 10:46:44 - WekaScoring - no annotations found
    2016/04/04 10:46:44 - WekaScoring - ERROR (version 6.0.1.0-386, build 1 from 2015-12-03 11.37.25 by buildguy) : Errors detected!
    2016/04/04 10:46:44 - Spoon - The transformation has finished!!
    2016/04/04 10:46:44 - WekaScoring - ERROR (version 6.0.1.0-386, build 1 from 2015-12-03 11.37.25 by buildguy) : Errors detected!
    2016/04/04 10:46:44 - WekaScoring - ERROR (version 6.0.1.0-386, build 1 from 2015-12-03 11.37.25 by buildguy) : Errors detected!
    2016/04/04 10:49:51 - cfgbuilder - Warning: The configuration parameter [org] is not supported by the default configuration builder for scheme: sftp
    2016/04/04 10:49:51 - cfgbuilder - Warning: The configuration parameter [org] is not supported by the default configuration builder for scheme: sftp
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - ERROR (version 6.0.1.0-386, build 1 from 2015-12-03 11.37.25 by buildguy) : Problem loading model file
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - ERROR (version 6.0.1.0-386, build 1 from 2015-12-03 11.37.25 by buildguy) : java.lang.IndexOutOfBoundsException: Index: 173, Size: 0
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at java.util.ArrayList.rangeCheck(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at java.util.ArrayList.get(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at weka.core.Instances.attribute(Instances.java:350)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at weka.core.Instances.classAttribute(Instances.java:439)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.di.scoring.WekaScoringDialog.checkAbilityToProduceProbabilities(WekaScoringDialog.java:1103)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.di.scoring.WekaScoringDialog.loadModel(WekaScoringDialog.java:856)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.di.scoring.WekaScoringDialog.access$700(WekaScoringDialog.java:71)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.di.scoring.WekaScoringDialog$11.widgetSelected(WekaScoringDialog.java:759)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.di.scoring.WekaScoringDialog.open(WekaScoringDialog.java:821)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.di.ui.spoon.delegates.SpoonStepsDelegate.editStep(SpoonStepsDelegate.java:125)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.di.ui.spoon.Spoon.editStep(Spoon.java:8728)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.di.ui.spoon.trans.TransGraph.editStep(TransGraph.java:3032)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.di.ui.spoon.trans.TransGraph.editStep(TransGraph.java:2090)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.di.ui.spoon.trans.TransGraph.mouseDown(TransGraph.java:864)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1339)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7939)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9214)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:653)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at java.lang.reflect.Method.invoke(Unknown Source)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92)
    2016/04/04 10:49:51 - org.pentaho.di.scoring.WekaScoringMeta@f1be5ac5 - ERROR (version 6.0.1.0-386, build 1 from 2015-12-03 11.37.25 by buildguy) : Problem loading model file

  2. #2
    Join Date
    Aug 2006
    Posts
    1,741

    Default

    PDI ships with Weka 3.7.11. Models created in 3.6 can't be loaded by 3.7. You'll need to download and install Weka 3.7.11, and then recreate your model(s). If you want to use the latest version of Weka (3.7.13) then it is simply a matter of replacing the pdm-*.jar file in the lib directory of the weka scoring plugin in your PDI installation with the weka.jar file that comes with the Weka distribution.

    Cheers,
    Mark.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.