Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Using Samba/smbclient in Kettle

  1. #1
    Join Date
    May 2012
    Posts
    3

    Default Using Samba/smbclient in Kettle

    Hi,

    I have a job which copies a file to a windows share via Samba.
    The file is approx 150 Mb and has about half a million lines.

    The first method I tried and would have preferred to use was to use the “Copy files” job with a destination of:

    smb://${domain}\\${username}:${password}@${destination}/${dir}

    however this took about 30 minutes to copy the file which was unacceptable.

    I tried using smbclient on the command line and found this only took 4 minutes to copy the file so I have now changed my job to a “Execute a shell script” job which runs the command line:

    /usr/bin/smbclient ${destination} ${password} -U ${username} -W ${domain} -c "cd ${dir} ; put ${filename} "

    and this too took 4 minutes which is still quite long but more acceptable.

    My question is, why the difference and is there a better way to do this ?

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    There are some things going on in the Apache Commons VFS library that are not really efficient.
    We're planning to upgrade to a more recent version but the testing and migration takes a while.

  3. #3
    Join Date
    May 2012
    Posts
    3

    Default

    Quote Originally Posted by MattCasters View Post
    There are some things going on in the Apache Commons VFS library that are not really efficient.
    We're planning to upgrade to a more recent version but the testing and migration takes a while.
    OK Thank you Matt.
    I will use the Shell method in the meantime.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.