Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Loading data from a file in real time basis in a table

  1. #1

    Default Loading data from a file in real time basis in a table

    Hi,

    We want to load out apache web log files in a relational DB (msql). We are using mysql bul uplaod of the penntho for the same. Currently we are running a job at end of each day to load that days file.

    Will it be possible to load the file on real time basis (something like tail -f) , which is job is running and loads data in the table whenever there is a new row appended to the file.

    Any pointer will be appreciated.

    Regards
    Hemant Jain

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    This is most certainly possible even though you would have to write said "tail -f" algorithm.
    It's harder than it sounds since most loggers switch files and so on.

  3. #3

    Default

    Why didn't you use the "mod_log_sql" module for your apache instance? This one will allow you to log your apache straight to a database instead of the classic logfile - in realtime.

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.