Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: Problem to download multiple images and getting the HASH code of them

  1. #1

    Default Problem to download multiple images and getting the HASH code of them

    Dear All,

    I need to do the following:
    Step1: From CSV input get the URL field that has ‘HTTP’ links, to down images to some folder.
    Step2: once they are downloaded get the HASH code of the images
    Step3: rename the images in the folder with the HASH code value
    Step4: remove the Duplicates images in the folder based on the hash code.

    For step1, I have tried this following:
    http://www.joyofdata.de/blog/batch-d...entaho-kettle/
    But this option has got lot of limitations:

    • it has problem when the one of the rows does not have URL link provided
    • It can only name the files based on the filename (with other variable it Is not working good)


    Step2: Here I am using calculator with SHA1.
    Step3: here I have to rename the IMAGE (files) that are downloaded in the STEP1 with the HASH code from step2.

    What is the optimal way to combine steps1, step2 to 3?
    Can someone suggest some ways?

    Regards,
    R
    Last edited by theperk2; 12-18-2015 at 11:59 AM.

  2. #2
    Join Date
    Apr 2008
    Posts
    4,696

    Default

    How is this request different than the two other threads that you've opened on this?
    At least one of the other threads has answers for parts of this.

  3. #3

    Default


    Hallo Gutlez,
    the major issue I am facing in this whole scenario is: how to download multiple images from HTTP request? I have to get the input for this multipledownload from other transformations. is it possbile to integrate these to steps?

    if yes, how?

  4. #4
    Join Date
    Apr 2008
    Posts
    4,696

    Default

    The answer to that is in the 4th thread you've started on the same topic.
    Each question relating to part of the work that you're trying to do doesn't need its own thread, you can ask us to help with the whole thing in one thread.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.