Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Creating large(>5gig, 100k item) Zip files with Kettle

  1. #1

    Default Creating large(>5gig, 100k item) Zip files with Kettle

    We need to create a very large zip file and are having a few issues, not sure if this is a limit within kettle or not.

    I have the step setup to not compress the files at all and it seems to be able to create the zip fine, but I'm getting an 'unsupported compression method' error with 7-zip when I try to open files within the archive.

    If I generate the zip manually with 7-zip it works fine. If I cut down the size of the zip it also works.

    Any ideas?

  2. #2

    Default

    Since Kettle doesn't seem to be able to handle this I ended up using a linux shell script to do it. Had to install the latest version of the zip tool(info-zip.org) to handle the large files but that was about it.

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.