Hitachi Vantara Pentaho Community Forums
Results 1 to 9 of 9

Thread: How to build pentaho-platform from Github

  1. #1
    Join Date
    Nov 2016
    Posts
    8

    Default How to build pentaho-platform from Github

    Hi All,

    I have to build pentaho-platform from source on my ubuntu machine.

    Things that I have found out -

    1. There is one post - http://stackoverflow.com/questions/1...rm-from-github . According to the answers, I can build pentaho-platform using steps -
      • Copy file dev_build.xml to build.xml
      • Execute: ant dev-resolve
      • Execute: ant dev-build


    2. I have also checked on the http://ci.pentaho.com/, there are jenkins job for individual modules e.g. pentaho-platform-api, pentaho-platform-core, pentaho-platform-scheduler, pentaho-platform-extensions etc. So instead of building complete pentaho-platform, should I build all its modules separately?


    Taking some reference from the link http://wiki.pentaho.com/display/Serv...o+Platform+7.0, build steps could be -

    • Install jdk-8, ant, maven, git
    • Clone the pentaho-platform code from github repository
    • Set environment variables.
    • Go to individual folder (api, build-utils, etc) and execute "ant clean-all resolve publish-local"


    Anyone please guide me what are the exact steps to build pentaho-platform.

    Thanks in advance.


  2. #2
    Join Date
    Nov 2011
    Posts
    1,229

    Default

    ant -f dev_build.xml dev-rebuild-merged-server

    This will iterate all projects and run the resolve compile publish-local for all of them. And then do the assembly.
    Pedro Vale
    --
    CTools Product Development
    http://www.webdetails.pt

  3. #3
    Join Date
    Nov 2016
    Posts
    8

    Default

    Thanks for sharing the information.
    I will try these steps and will let you know in case of any issues.

  4. #4
    Join Date
    Nov 2016
    Posts
    8

    Default

    Hi Pedro,

    I have performed following steps :

    • Install jdk-8, ant, maven, git on my ubuntu VM
    • Set environment variables
    • Clone the pentaho-platform code (master branch) from github repository.
    • cd pentaho-platform
    • ant -f dev_build.xml dev-rebuild-merged-server


    Observed following error -
    BUILD FAILED
    /pentaho-platform/dev_build.xml:53: The following error occurred while executing this line:
    /pentaho-platform/dev_build.xml:55: The following error occurred while executing this line:
    /pentaho-platform/extensions/build.xml:70: The following error occurred while executing this line:
    /pentaho-platform/extensions/build.xml:105: Warning: Could not find file /pentaho-platform/extensions/wadlExtension.xml to copy.

    Added error output as an attachment.
    Is there any bug regarding this Or let me know if I am missing something ?
    Attached Files Attached Files

  5. #5
    Join Date
    Nov 2011
    Posts
    1,229

    Default

    Not really. That should be it.

    I tried it on my local machine and did not get that error. I had to nuke my ivy cache a couple of times but it managed to build and assemble the whole thing.

    The error you're getting is here:

    /pentaho-platform/extensions/src/org/pentaho/platform/web/http/api/resources/RepositoryResource.java:70: error: unmappable character for encoding ASCII
    [javadoc] * The RepositoryResource service retrieves the repository files through various methods. ??Allows you to execute repository content.
    [javadoc] ^
    [javadoc] /pentaho-platform/extensions/src/org/pentaho/platform/web/http/api/resources/RepositoryResource.java:70: error: unmappable character for encoding ASCII
    [javadoc] * The RepositoryResource service retrieves the repository files through various methods. ??Allows you to execute repository content.
    [javadoc]


    Maybe something in your encoding? What do you have on line 70 for that file. Maybe it got corrupted when you cloned (I know, weird).
    Pedro Vale
    --
    CTools Product Development
    http://www.webdetails.pt

  6. #6
    Join Date
    Nov 2016
    Posts
    8

    Default

    Sorry for the delay in reply for your queries and thanks for pointing out that particular error.

    There were garbage character in the file at line no. 70. (really weird)
    To fix this, I have tried to set option -> export JAVA_TOOL_OPTIONS=-Dfile.encoding=UTF-8
    Afterwards, I didn't get error related to "unmappable character".

    However build failed with download errors for following jar files -
    [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
    [ivy:resolve] :: FAILED DOWNLOADS ::
    [ivy:resolve] :: ^ see resolution messages for details ^ ::
    [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
    [ivy:resolve] :: pentaho-library#libbase;7.1-SNAPSHOT!libbase.jar(source)
    [ivy:resolve] :: pentaho-library#libxml;7.1-SNAPSHOT!libxml.jar(source)
    [ivy:resolve] :: pentaho-library#libcss;7.1-SNAPSHOT!libcss.jar(source)
    [ivy:resolve] :: pentaho#pentaho-metadata;7.1-SNAPSHOT!pentaho-metadata.jar(source)
    [ivy:resolve] :: pentaho-library#libformula;7.1-SNAPSHOT!libformula.jar(source)
    [ivy:resolve] :: pentaho-kettle#kettle-dbdialog;7.1-SNAPSHOT!kettle-dbdialog.jar(source)
    [ivy:resolve] :: pentaho#pentaho-vfs-browser;7.1-SNAPSHOT!pentaho-vfs-browser.jar(source)
    [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::

    As per logs (attached), it is trying to download sources.jar file for above packages e.g. - http://nexus.pentaho.org/content/gro...47-sources.jar file, which is not present at repository right now.

    Currently I am cloning master branch, should I change branch/release and pickup any stable one ?
    Attached Files Attached Files

  7. #7
    Join Date
    Nov 2011
    Posts
    1,229

    Default

    clear your ivy cache (remove folders inside pentaho-library, pentaho and pentaho-kettle)
    Pedro Vale
    --
    CTools Product Development
    http://www.webdetails.pt

  8. #8
    Join Date
    Nov 2016
    Posts
    8

    Default

    I have tried to rebuild after cleaning ivy cache, but still getting same download error for sources.jar file.
    Anything else that I need to update in dev_build.xml or in build.properties?

    JFYI - I am building this package on Ubuntu VM (16.04 with ppc64le architecture)

    Thanks,
    Samruddhi

  9. #9
    Join Date
    Nov 2016
    Posts
    8

    Default

    Thanks Pedro for your inputs so far. Finally I am able to build this package after syncing code from "tag - 7.0.0.0-R"

    As per the previous errors, I was getting download errors for SNAPSHOT versions of jar files (e.g. 7.0-SNAPSHOT and 7.1-SNAPSHOT).
    Although I have switched from master branch to 7.0.0.1 branch, its still using SNAPSHOT versions. Version information is present in file /pentaho-platform/extensions/build.properties.

    Product version in build.properties in 7.0.0.0-R tag is 7.0.0.0-25 and on pentaho repository for all dependent packages, their jar files with same version are present. e.g.
    http://nexus.pentaho.org/content/gro...7.0.0.0-25.jar
    http://nexus.pentaho.org/content/gro...25-sources.jar

    Best Regards,
    Samruddhi

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2017 Pentaho Corporation. All Rights Reserved.