Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Running Weka in HPC with Slurm

  1. #1
    Join Date
    Nov 2016
    Posts
    1

    Red face Running Weka in HPC with Slurm

    Hello Guys. Need some help.

    I need to run weka in a very large data. I gotta access to a High Performance Computer, wich uses Slurm to allocate nodes and executes jobs.
    However, I don't think weka commands are running in parallel tasks, and if I'm distributing task right on the cores.

    Would apreciate help from someone that already used weka with Slurm.

    Thanks in advance.

  2. #2
    Join Date
    Aug 2006
    Posts
    1,741

    Default

    How are you parallelising Weka tasks? Are you using the distirbutedWeka packages for Hadoop/Spark? I've used distirubtedWeka for Hadoop and Spark on a Torque cluster (not using any Torque-specific stuff however).

    Cheers,
    Mark.

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.