Pentaho Community Forums

Hola a todos

mayrelis — Sat, 25 May 2013 20:16:31 GMT

Soy nueva en la implementacion de reportes utilizando pentaho. Tengo creado mi primer reporte y cuando voy a publicar el reporte en el pentaho server me da el error que veran a continuacion y quisiera saber si me falta algun paso, ya instala el jdk y configure las variables entornos del sistema y tengo corriendo el tomcat del pentaho BI server, agradezco cualquier ayuda que me puedan dar.
org.pentaho.reporting.designer.extensions.pentaho.repository.util.PublishException: Publish failed, please see server logs for further details.
at org.pentaho.reporting.designer.extensions.pentaho.repository.util.PublishUtil.publish(PublishUtil.java:247)
at org.pentaho.reporting.designer.extensions.pentaho.repository.actions.PublishToServerTask.run(PublishToServerTask.java:119)
at java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:251)
at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:705)
at java.awt.EventQueue.access$000(EventQueue.java:101)
at java.awt.EventQueue$3.run(EventQueue.java:666)
at java.awt.EventQueue$3.run(EventQueue.java:664)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$1.doIntersectionPrivilege(ProtectionDomain.java:76)
at java.awt.EventQueue.dispatchEvent(EventQueue.java:675)
at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:211)
at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:128)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:117)
at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:113)
at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:105)
at java.awt.EventDispatchThread.run(EventDispatchThread.java:90)

Brand New Original 2 X Pioneer CDJ-2000 Turntable + DJM-2000 Mixer Package….$2000

djreal009 — Sat, 25 May 2013 18:16:14 GMT

DJ REAL MUSICAL INSTRUMENT has continued to attract a highly committed and passionate community of musicians, DJs, composers and all electronics consumer all over the world. We are a well recognized Disc Jockey and Electronics seller.We offer the best price and a fast free shipping by dealing with us with complete confidence, These Products Come with their full Accessories and 1Year International Warranty...All our product are Brand New Original Products not refurbished Products
We currently offer free shipping for both new and regular buyer's ( You can take part in this offer)
We are ready to ship Worldwide
Via : FedEx / UPS AND DHL

Contact: djrealmusicalinstrument@outlook.com

PRICE LIST:

Sampler

Akai MPC1000 Music Production Center………………..$500
Akai MPC4000-Plus – 64 Voice Sampling Drum Machine………$1600
Akai MPC2500 Music Production Center…………..$1000
Akai MPC5000 Music Production Centre…………..$2480
Akai APC 40 Albeton Controller……………………..$1500
Akai MPC2000XL-MCD Production Station…………….$800
Akai MPC500 MIDI Production System/Sampler………$250

Allen & Heath Xone:92 Fader DJ Mixer………..$1000
Allen & Heath Xone:464 16 Input Pro Club DJ Mixer……$1100
Allen & Heath Xone 4D………..$1300
Allen and Heath XONE 2D Digital MIDI USB Controller DJ…..$400
Allen & Heath GL 4000 40ch.Mixer w/2 PSU……….$3700
Allen Heath GL 2400 32 ch console GL2400-32 mixer…..$1800
Allen Heath GL 2400 40 ch console GL2400-40 mixer……$2800
Allen & Heath Xone 2D Pro DJ MIDI Controller……….$470
Allen & Heath Xone2 464 and xone 2 Xone2…..$1200
Allen & Heath Xone2 Battle Mixer………$280
Allen & Heath Xone:62 Fader DJ Mixer…..$700

Behringer BCD2000 B-Control Deejay………$150
Behringer Refurbished VMX1000 Pro DJ Mixer ……..$200
Behringer DJX700 5-Channel Pro DJ Mixer ….$130

Roland SP-404 Portable Power Sampler with FX…..$250
Roland VK-8M Organ Sound Module…….$350
Roland SP-555 Creative Sampler Workstation……$200
Roland SonicCell 128-Voice Expandable Synth Module with Audio Interface……..$500
Roland PM-30 PM30 Drum Monitor 200 Watt ……$460
Roland Fantom-XR Sound Module……….$700

Yamaha Tyros 4 61-Key Arranger Workstation Keyboard w/speaker & Stand........$1500
Yamaha MOTIF ES Rack Module………$500
Yamaha VL70-M Virtual Acoustic Tone Generator……$400
Yamaha Refurbished Motif ES Rack Module……..$300
Yamaha MOTIF XS8 88-Key Synthesizer .............$ 2.000 usd
Yamaha MOTIF XS6 61-Key Synthesizer ..............$ 1.350 usd
Yamaha Motif Rack ES ...............$ 550usd
Yamaha Motif workstation XS7 76-Key ..............$ 1.350 usd
Yamaha PSR-S900 61-Key Arranger Workstation ..........$ 970usd

Technics SL-1210MK2 Turntable………………….$250
Technics SL-1210M5G Pro Turntable……………..$350
Technics SL-DZ1200 Digital Turntable………..$500

Gemini CDT-05 Professional Hybrid CD/Turntable Combo……..$300
American Audio Velocity Professional Dual CD/MP3 Player……$400
Cortex dMIX-300 Digital Music Control Station………$300
B-52 Prodigy FX DJ Workstation…………….$650

Hercules DJ Console MK2 Dual Deck DJ Mixer …..$300
Hercules DJ Console RMX Controller....$320
Urei 1605 DJ Club Mixer……………$700
Urei 1601 Digital Scratch Mixer………$320
Vestax PMC-05PROIII DJ Mixer…..$500
Vestax PMC-500 DJ Mixer…….$1100
Vestax PMC-05PROSL DJ Mixer with Sampling…..$450
Vestax PMC-06 Pro A 2 Channel DJ Scratch Mixer……$300
Vestax VCI-100 Tabletop DJ MIDI Controller ……….$350
Vestax VCI-300 MIDI DJ Controller+Serato…….$570
Vestax PMC-08Pro Professional Hybrid Digital Mixer…..$550

Korg M3-88 Key Workstation / Sampler ..........$ 1.850 usd
Pa2XPro Korg 76-key Arranger Keyboard ........$ 2.000 usd
Korg TR61 61-key Workstation .........$ 510usd
Korg M3 73 Workstation 73-key / Sampler ......$ 1.450 usd
Korg M3 61 Workstation 61-Key .......$ 1,250 usd
Korg PA50 Arranger Workstation ........$ 490usd
Korg X50 Synthesizer .........$ 400usd
Arrang Pa800 KORG PRO .........$ 1500 usd
Korg TR88 88-key Workstation ........$ 980usd
KORG TRITON TR61 ........$ 500usd

Numark CDX Direct-Drive CD Turntable……$500
Numark TTX Direct-Drive Turntable…………$300
Numark X2 Pro Hybrid Turntable And CD / MP3 Player…..$700
Numark DVD01 Dual DVD Player………$400
Numark 5000FX 12" 5-Channel Tabletop Mixer ….$400
Numark DXM09 Digital DJ Mixer…$350
Numark NS7 DJ Turntabel Controller………$700

Denon DN-X500 Professional 19" Mixer …$250
Denon DN-X100 Professional 2-Channel DJ Mixer……$150
Denon DN-S5000 Tabletop DJ CD Player…$400
Denon DN-D9000 Dual Pro CD Player…..$700
Denon DJ Compact CD/USB Media Player and Controller…..$320

Denon DN-D4500 Dual CD/MP3 Player….$300
Denon DN-S3000 Table Top DJ CD Player Refurb……$200
Denon DN-S3500 Professional CD/MP3 Turntable…..$470
Denon DN-S3700 DJ Digital Media Turntable......$580
Denon DN-D6000 Dual CD MP3 Player Refurb……….$300
Denon DN-D6000 Dual CD MP3 Player……………….$400
Denon DN-HD2500 Hard Disk Media Player/Controller…$400
Denon DN-X900 Professional 19" Analog/Digital Mixer…..$350

2 X Pioneer CDJ-2000 Turntable + DJM-2000 Mixer Package…….$2000
Pioneer CMX-3000 Dual Rackmount CD Player……….$600
Pioneer DJM-400 Mixer …..$400
Pioneer DJM-800 Mixer……$700
Pioneer DJM-1000 Mixer….$1400
Pioneer DJM-2000 Mixer....$1700
Pioneer DJM-5000 Mixer….$800
Pioneer DJM-600 mixer…..$500
Pioneer EFX-1000 Performance Effector Digital Effects Processor..$650
Pioneer DJM-500 mixer…..$450
Pioneer DJM-300 mixer….$350
Pioneer DJM-3000 mixer…$500
Pioneer DJM-707 mixer….$400
Pioneer DJM-700-S Mixer..$700
Pioneer DJM-909 mixer….$800
Pioneer EFX-500 mixer….$350
Pioneer CDJ-400 Turntable….$430
Pioneer CDJ-1000MK2…..$450
Pioneer CDJ-1000MK3…..$600
Pioneer CDJ-900 Professional Multi-Player…..$1000
Pioneer CDJ-2000 CD Turntable……$1400
Pioneer CDJ-200 Pro CD Player……$230
Pioneer DVJ-X1 DJ Video Player……..$1000

SPEAKER
JBL PRX518S (18" Self Powered Subwoofer System)….$500
JBL PRX518S Self-Powered Subwoofer Pair….$1100
JBL 2 EON 515 EON515 Powered PA DJ Speaker Portable cost...$1400
JBL PRX515 (15" 2 – Way Self-Powered Sound)….$1100
JBL PRX515 2-Way 15" Speaker Cabinet .$400

CAR RADIO
Becker Mexico 7948 Retro Active With Ipod:$1200
Pioneer AVIC Z130BT.....$900
Pioneer AVIC-X710BT........$500
Pioneer AVH-P3100DVD.....$4000
Pioneer AVH-P4100DVD....$370
Pioneer AVIC-Z110BT....$700

HOME THREATRE

Bose® Lifestyle V25 Home Entertainment System ........... $1,000.00
Bose® Lifestyle V35 Home Entertainment System ........... $1,950.00
Bose® Lifestyle 235 Home Entertainment System ........... $900.00
Bose® Lifestyle T10 Home Entertainment System ............. $750.00
Bose® Lifestyle T20 Home Entertainment System ............. $809.00
Bose 3-2-1 GS Series III Home Entertainment System ... $700.00
Bose CineMate® GS Series II Entertainment System ..... $600.00
Bose Sound-Dock 10 Speaker System For IPod …......... $300.00
Bose VideoWave 46 Black Entertainment System LCD HDTV ...$2,000

Contact this E-mail address for bookings/ Information

Contact: djrealmusicalinstrument@outlook.com

Powered by DJ REAL MUSICAL INSTRUMENT®
Copyright ©2008 - 2013, DJ REAL MUSICAL INSTRUMENT®.

Brand New Original 2 X Pioneer CDJ-2000 Turntable + DJM-2000 Mixer Package….$2000

djreal009 — Sat, 25 May 2013 18:11:16 GMT

Brand New Original 2 X Pioneer CDJ-2000 Turntable + DJM-2000 Mixer Package….$2000

djreal009 — Sat, 25 May 2013 18:09:06 GMT

Brand New Original 2 X Pioneer CDJ-2000 Turntable + DJM-2000 Mixer Package….$2000

djreal009 — Sat, 25 May 2013 18:02:17 GMT

Is group possible in PRD when using CGG?

timfu83 — Sat, 25 May 2013 16:07:58 GMT

Hi,
I have 2 depending graphs in CDE - in 1st one I can set parameter via firechange for the 2nd graph. Is it possible in PRD to make the 2nd graph using group function(URL from CGG)? Output should be 1st graph plus 2nd graph for each category(parameter in 1st graph in CDE).

Thanks a lot for your tips.

CGG and format in Pentaho report designer

timfu83 — Sat, 25 May 2013 15:53:11 GMT

Hello,
I'm trying to prepare some reports that should look like dashboards. Therefore I'm using CGG. Using the URL I'm getting different outputs(s. picture below).
Have you any idea what to do - x-axis moved, y-axis not shown, frames are looking differently... I'm using CCC2 ...

Thanks for your help.

CDE_vs_PRD.jpg

Attached Images

CDE_vs_PRD.jpg (16.3 KB)

Tomek Link, Condensed nearest neighbor

kontomaris — Sat, 25 May 2013 14:28:26 GMT

I would like to ask you if there is any implementation of these under-sampling majority class methods in WEKA.
Thank you very much

in which scene we should use "Append streams" step?

aomidata — Sat, 25 May 2013 10:20:36 GMT

hello,i am a newer in kettle,and study hard.who can tell me,in which scene we should use "Append streams" step?

3x very much

Data configuration in BI server

sacpv04 — Sat, 25 May 2013 04:33:26 GMT

Dear all.
sorry I am new in pentaho so I may have some questions is not good. But I try to have question.
If we want to have new database for BI clients, We must login in to Pentaho Admin Console to create new datasource. In any ways, We can create new database for BI clients by using configuration.xml ? If there is not clear information, please lets me know.
thankyou very much

dimension lookup/update inserts duplicate rows

TimP — Fri, 24 May 2013 21:35:31 GMT

Hi
I'm struggling because it keeps inserting duplicates.
All my strings are trimmed. All my numbers are ints. Looking at old postings I found this:
But I don't understand the response. Rows out of order? Can somebody explain please?
Thanks
Tim

Dimension Lookup-Update : Duplicate rows

I am currently using Dimension Lookup-Update step.
I have the "Update the dimension" check box enabled.
In the Fields tab,
When the "Type of the dimension update" is "Insert"
I think it is supposed to insert a new dimension record version only if One or more attributes were different.
But, in my case,
eventhough I have the same set of data, a new row is being inserted.

Am I missing something? Correct me if my understanding is wrong.

Thanks,
Om
----------------------
Spoon version -4.3.0
DB2 v9.5.0.808
Windows XP

Reply With Quote
08-10-2010, 01:43 PM
#2

MattCasters
Chief Data Integration

Join DateNov 1999Posts9,535

Well, make sure to never offer rows of data out of order. That is NOT supported.

get different columns from CDA query

marcolino — Fri, 24 May 2013 19:35:47 GMT

Hi all,
i have a BAR chart (CCC2) and i want to display on it only a subset of columns coming from mdx query.
Is it possible to set it from code on barchart object?

Thanks in advance.
Yamas

Admin-Console in BI Server 4.8?

mikea — Fri, 24 May 2013 18:06:47 GMT

Nevermind. Thanks anyways.

How to use De Normalizer in the right way

Giovanni — Fri, 24 May 2013 14:31:24 GMT

Hi all,

I got a data strem where I have data split in rows.
I need to group this lines in a single row and report all the data of several lines on a single row one aside the other one .
The number of lines are unpredictable.

Please take one eye to attachment files.
There is a 7 rows sample.
Many thanks
Giovannino

Attached Images

re normalizer.jpg (34.2 KB)

Attached Files

denormalizer_test.ktr (15.2 KB)
lines.csv.txt (512 Bytes)

mail transformation

uddhija — Fri, 24 May 2013 13:20:43 GMT

hello All,

Please help me in making use of mail transformation .
I have entered the SMTP server ip address.
And added sender ' s and receivers mail address of mine.
Pls illustrate how to run this successfully with bare minimum inputs in mail transformation !!!
If possible please give an example also !!!:)

Pentaho escaping characters

solid_rock — Fri, 24 May 2013 12:17:23 GMT

Hi everybody, I'm totally new at Pentaho and I'm having some problems with my first project. Basically, I have an xml input and I want to generate an xml output, so I've created a transformation and added a "Get data from XML" component, a "Modified Java Script Value", and a "XML Output"; the input component just reads the XML file, in the Java Script step I created a variable to hold the xml content of the file and also I read some values on it (the function's code is at the bottom) and the XML Output just generates the file. The problem is that the generated xml escapes all the "<" and ">" symbols; I've tried adding a "Replace in String" component and specifying the symbols to replace (< by < and > by >) but nothing happened, does anybody have some tip?
This is the javascript code:

Code:

var xml;

if (xml==null) {

 xml = new XML();

 var xml =

 

  

   {parteactora_pub}

   

  

 

;

}

And this is what I get:

<cases-doc>
<marginal>
<marginal-yea>Yonhy Lescano Ancieta</marginal-yea>
<marginal-num/>
</marginal>
</cases-doc>

Any help will be appreciated, regards

How to do look up on a flat file look up for a flat file source..

arpit016 — Fri, 24 May 2013 11:48:47 GMT

How to do look up on a flat file look up for a flat file source..?

Switch Case step

sportinguista — Fri, 24 May 2013 11:17:20 GMT

Hi:

I´m trying to get data from two different sources based on a parameter´s value.

So I put a Switch/Case step wich reads my parameter and chooses:

if 1 => read data from a text file input.
If 2 => reads data from a binary file (implemented in a process row method of a UDJC).

Problem is that whatever my parameter´s value is, it reads data from both sources at the same time, instead of one of them.

Why is this happening? Is there any alternative way to implement that?

Thank yoy very much. Bye!

Writing a book - "Pentaho for Big Data Analytics"

manojrpatil — Fri, 24 May 2013 10:49:45 GMT

Guys, I am planning to write a book on this topic and was wondering what could me the main topics. So far on top of my head, I could think of pdi connectivity with hadoop likes, pentaho analytics, dashboard with different visualizations.

I googled around and found no such book available. Any such book in process, if anyone is aware of?

I think BI (aka BA) platform is the right place for this post as the whole analytic goal is to visualize the results so even if pdi (along with big data connectors!), mondrian, prd would be required, at the end BI would be the one to tie it together with lot of added things. I was wondering if I could get some pointers which could help making the content real rich.

Any help is very much appreciated!

cst problem

Darbon — Fri, 24 May 2013 10:28:56 GMT

Hi, i need to install the cst tool but i have some problems.
I have installed the lastest trial version of pentaho and i need to know the right code for the MantleSettings.properties.

num-startup-urls=1
startup-url-1=/pentaho/content/pentaho-cdf/RenderXCDF?solution=CST&path=%2F&action=cst.xcdf&template=mantle
startup-name-1=CST

I don't have this path into my installation folder and i can't understand which is the root of this path.After this i want to understand the mean of this:

<=!=[=C=D=A=T=A=[/pentaho/Pivot?solution=steel-wheels&path=analysis&action=analysis_customers.analysisview.xaction]=]=>

Into the cdata keyword there is a path (which root?) followed by 3 parameters (solution,path,action). Action is the object but i can't understand solution and path. Can i have a working example? Thanks in advance.

How to speed up the table input?

hanyong — Fri, 24 May 2013 09:00:43 GMT

How to speed up the table input?my current speed is just 22 records in 1 second.

Export options restriction.

Naseeruddin — Fri, 24 May 2013 07:40:32 GMT

Hi Team,

Can we restrict the export options in Pentaho report designer?
When we click on the exort option(green arrow buttion) , we get various export options like pdf,excel Excel,Excel 2007 etc.
I want only Excel to display in that list. Is it possible? If possible can you please suggest how to achieve the same.

Thank you.
Naseer.

what is the difference between execute sql script and execute row sql script ?

uddhija — Fri, 24 May 2013 07:38:03 GMT

hello All,

i am completely new to pentaho . i am working on transformations and learning the basics .
Can anyone please help me out in determining the difference between execute sql script and execute row sql script with a simple example ??

Lock excel cells

Naseeruddin — Fri, 24 May 2013 07:35:44 GMT

Hi Team,

When i export to excel i want the cells to be locked (non editable) so that the user does not change the data in the excel report.

Can you please help on the same ASAP like How to keep the cells locked(non editable) after the report is exported to Excel.

Thank you in advance.

Naseer.

forex robot

rocky1234 — Fri, 24 May 2013 07:17:42 GMT

Robot are playing a vital role to change the world, in order for the fast development and smooth development of a place, state, country, nation robots have a vital role example forex robot , now a days the world are depended upon robots.

cda cache inconsistency

ErikAndersson — Fri, 24 May 2013 06:33:23 GMT

Hi

I think I posted this in the wrong forum so I repost it here instead.

We have a folder in .../pentaho-solutions in where we store our dashboards and we also have a Public folder within that folder
Something like:
.../pentaho-solutions/afolder
.../pentaho-solutions/afolder/Public

for dashboards in .../pentaho-solutions/afolder all is fine.

But, for dashboards in .../pentaho-solutions/afolder/Public the scheduler caches the queries like:
afolder/Public/datasource.cda (as seen in CDA Cache Manager)
When accessing a dashboard via a browser it gets cached like
/afolder/Public/datasource.cda (as seen in CDA Cache Manager)

The extra slash in the beginning makes it so I don't get a match on the scheduled queries and all queries will be ran at runtime.

I suspect this commit (https://github.com/webdetails/cda/co...leManager.java) introduced a bug and will take a closer look at it.

Cheers / Erik

Updating BI Server Kettle Version Without Completely updating the BI server???

rishbeck1988 — Fri, 24 May 2013 05:59:48 GMT

Hi All,

We have pentaho BI server version 4.1.0 Stable version. We are facing issues with one of the kettle steps i.e. update step( the batch update step doesn't work properly). This particular issue has been resolved in Kettle 4.3.0 build. I wanted to know is it possible to upgrade Kettle in the existing Pentaho BI server without degrading/influencing performance of other features of kettle. Can this be carried for report designer as well??

Thanks

Reusing sub-reports in multiple reports

briantd — Thu, 23 May 2013 23:50:40 GMT

Is it possible to reuse sub-reports? I'd like to create a library of sub-reports for use as building blocks, but am unclear as to whether this is even possible.

Thanks,
-Brian

What I should use for reporting, design studio or report designer?

thangpm — Thu, 23 May 2013 23:22:56 GMT

Hi all,

I'm a newbie in pentaho. I'm studing design studio and report designer to create reports with chart.
I don't know what is best choice and what is different between design studio and report designer in reporting.

Anyone can help me to figure it out?

Thanks,
Thang.

Disjunction function in Pentaho Analyzer

paulo.f.rezende — Thu, 23 May 2013 20:18:36 GMT

Hello everybody!
I have a question, I have an application developed in MicroStrategy and am migrating it to Pentaho.
In MicroStrategy I have the option of having the filters disjunctions (OR-type conditions).
However, the Pentaho Analyzer tab of filters can only put functions like AND.
Any way I would choose a filter OR the other?

Eg. name equal to shopping center or beach?

Thank's guys!

Association rules with Weka

mtefe — Thu, 23 May 2013 18:54:54 GMT

Hello,

as I said in another post I have to work with weka and my goal is to know what are the diseases most associated with a given disease.

Also as I said in a previous post I have created an excel file where the columns are the variables, such as age, country, gender and all diseases that i found associated (now are about 200 columns / variables). The lines have the data for each patient (276 patient records) and indication of which diseases he has (in each column put a 1 or a 0, "1 = has the disease" and "0 = no disease"). several diseases appear only once in the data set.

i use the apriori algorithm on weka, but the association rules that i get are not responding to my goal. I've tried various values in the support and confidence and also in the number of rules but still can not reach my goal. Also strange is the fact that the variable “main disease”, common to all patients (therefore always with value 1 in all patients), never appears in the association rules obtained.

So, I would like to know your opinion on my
questions:

1) is this the best method (this kind of data organization with all variables in columns and 0 and 1 values in each row) to achieve my goal with WEKA ?
2) can the number of variables and the sample size (200 variables and 276 records) be causing bad rules? the sample must necessarily be larger?

my apologies for the long post but I'm desperate about this job
Thank you for your attention and for your help

Marco

Pentaho CDE Javascript

hadfi — Thu, 23 May 2013 18:42:11 GMT

Hi everybody,

I'm trying with cde Pentaho to create a dashboard include a pie chart I put a function javascript to create an action listener but the function returned undefined values this is the code of the function

function(s,c,v){
/* replace value of param_zone when you click on an area of PieChart
s: series, c: category, v: value */
Dashboards.fireChange('param_zone',c);
}

Thank you.
regards hadfi

Parameters based on last time job was ran?

jbarsoum — Thu, 23 May 2013 17:33:40 GMT

Hi All,

I have an insert / update step in one of my jobs and a 'lastupdate' field on one of my db tables.

I'm wondering if I can edit my parameters to use that lastupdate field and run based on the last time the job was ran. Is there a specific synatax I can use in that "Default Value" section?

Thanks in advance for your help.

John B

Table input metadata trouble

joao.ciocca — Thu, 23 May 2013 17:04:52 GMT

so, I have this table input which reads from SQL giving me a number field and an empty string field. Then, with switch, depending on the number, I use set field value to a certain string... or so I wanted to, 'cause when I try to run, I get this error:

Code:

Set field value to a constant.0 - ERROR : Error in step : 

Set field value to a constant.0 - ERROR : field1 String : There was a data type error: the data type of java.lang.String object [string1] does not correspond to value meta [String]

Set field value to a constant 2.0 - ERROR : Error in step : 

Set field value to a constant 2.0 - ERROR : field1 String : There was a data type error: the data type of java.lang.String object [string2] does not correspond to value meta [String]

Set field value to a constant 4.0 - ERROR : Error in step : 

Set field value to a constant 4.0 - ERROR : field1 String : There was a data type error: the data type of java.lang.String object [string3] does not correspond to value meta [String]

Set field value to a constant 3.0 - ERROR : Error in step : 

Set field value to a constant 3.0 - ERROR : field1 String : There was a data type error: the data type of java.lang.String object [string4] does not correspond to value meta [String]

Putting a "Select values" after the input, "changing" type from field to String won't do anything.

Pentaho escaping characters

solid_rock — Thu, 23 May 2013 16:07:04 GMT

Code:

var xml;

if (xml==null) {

 xml = new XML();

 var xml =

 

  

   {parteactora_pub}

   

  

 

;

}

And this is what I get:

<cases-doc>
<marginal>
<marginal-yea>Yonhy Lescano Ancieta</marginal-yea>
<marginal-num/>
</marginal>
</cases-doc>

Any help will be appreciated, regards

Endless loop in Single Threader

ngarcin — Thu, 23 May 2013 15:26:40 GMT

Hi,

When using the Single Threader with the fix http://jira.pentaho.com/browse/PDI-8191, if the sub-transformation doesn't have any error, the single threader transformation never ends.
I think the fix made in PDI-8191 contains an error, see my comment here: http://jira.pentaho.com/browse/PDI-8...comment-146998.
Would it be possible to re-open PDI-8191?

Regards,
Nicolas

Is it a bug in Microsoft Excel Input step while importing from a Time type column?

pxr — Thu, 23 May 2013 14:35:34 GMT

Hi,

siutation:
we have an excel spreadsheet filled by some business people and they do not agree to change the datatypes of it etc.

In this excel there is a column of type Time (the format is HH:Mi:SS) and there are values of how long something executed. For example:
V1
11:00:00
23:59:59
24:00:00
23:59:59
00:20:08
24:01:01
25:39:51
25:39:52

PDI spoon shows the preview and inserts into file and database:
V1
1899/12/30 11:00:00.000
1899/12/30 23:59:59.000
1900/01/01 00:20:08.000
1899/12/30 23:59:59.000
1899/12/30 00:20:08.000
1900/01/01 00:21:09.000
1900/01/01 01:59:59.000
1900/01/01 01:39:52.000

As you can see the initial date for the time column is 1899-12-30. For some reason when the Time column is more than 23:59:59 then there is never the date 1899-12-31. We could get away with that, but for some reason not only one day is added, but alsi 20 minutes and 8 seconds. And this 20 minutes and 8 seconds is added to all the times until 25:39:52, after than everything is correct again.

We can deal with 1899-12-31 not showing up, as this is probably because of excel epoch on this date.

But the addition of 20 minutes and 8 seconds for the period 24:00:00 - 25:39:51 does not compute at all.

Does anybody know why is that? How to still get the correct time values?

Br,
pxr

Kettle installation

hamurcufatih@gmail.com — Thu, 23 May 2013 13:26:18 GMT

I have downloaded pdi-ce-4.4.0-stable from source forge and then extracted to the Desktop. Afterwards, I have created a new variable for PENTAHO_JAVA_HOME its value is java jdk but whenever I have clicked on the spoon.bat, spoon is not run. What should I do ? How can I understand the error ? Are there any log file which shows me why spoon is not running ? Help !

How to do a difference of imported data

Djay — Thu, 23 May 2013 13:18:37 GMT

Hello All,

I'm quite new in Kettle usage and I found it very useful and I want first to thank you for the job done.

I have a usecase that sounds to me quite standard. I want to load on a regular basis a set of data which represents the latest view of a stock. The thing I would like to do is to get the difference between 2 imports and show what has changed.
My first idea is to load each time the sotck in the same table with a column importDate (set through a Get System Data).

For the moment, I'm doing (but it doesn't work) a transformation that :
1/ Get the latest 2 dates of import : Table input with :

Code:

select top 2 importDate  from MySotck

group by importDate

order by importDate desc

2/ Switch in 2 parallels branches to get the data for each date of import and send the date to next step
3/ Doing a sort and then a Merge Diff (which is really heavy)
4/ I would like then to export (in file or table) the differences

I hope I'm clear enough. Here is my transformation which does not work :(

To summary my problems:
- how to send the different dates in parameter to each branch ?
- how to get the difference only between the two imports?

Do you have any idea or do you know any example that have the same behaviour?

Thanks for your help,
Gerald

cda cache inconsistency

ErikAndersson — Thu, 23 May 2013 13:17:42 GMT

Hi

We have a folder in .../pentaho-solutions in where we store our dashboards and we also have a Public folder within that folder
Something like:
.../pentaho-solutions/afolder
.../pentaho-solutions/afolder/Public

for dashboards in .../pentaho-solutions/afolder all is fine.

But, for dashboards in .../pentaho-solutions/afolder/Public the scheduler caches the queries like:
afolder/Public/datasource.cda (as seen in CDA Cache Manager)
When accessing a dashboard via a browser it gets cached like
/afolder/Public/datasource.cda (as seen in CDA Cache Manager)

The extra slash in the beginning makes it so I don't get a match on the scheduled queries and all queries will be ran at runtime.

Anyone else having this problem?

Any leads on how to fix this?

Cheers / Erik

Specific listener not working in Bar chart in pentaho CDE

vipin.goyal — Thu, 23 May 2013 09:43:30 GMT

I have created a parameter whose value is changed through Dashboards.fireChange command. The parameter is set as a listener for the CCC bar chart component. During execution, when the parameter value gets changed, the bar chart component does not respond.
Is this a bug with the bar chart component?
I have simulated the same thing with the pie chart and bullet chart components also where it is working fine.
Also, when the parameter value gets changed through the select component, then the bar chart gets refreshed.
So, I guess the problem is with the use of Dashboards.fireChange with the bar chart component. Could you please put some light on the issue.

specifying columns for pie chart in CDE

vipin.goyal — Thu, 23 May 2013 09:31:21 GMT

I need to create a pie chart that includes selected columns from my data set.
From my sql dataset, I am getting 4 columns. I need to specify the columns to pick for the pie chart in pentaho CDE. How could I do that?

Which is the best way to ask for initial parameters to use during trasformation

Giovanni — Thu, 23 May 2013 08:45:12 GMT

Hi all,

I need to have an initial prompt which ask to running trasformation user to pass some parameters (possible formatted in the right way).

For istance I have to ask for "Starting Date" and "Ending Date" (dd/mm/yyyy).
Then I have to add these variable as Between on several SQL queries on singular steps.

Or I need to ask for a variable stored in a table using something like a select box to choose it.

Many thanks
Giovanni

I'm here again.Who can help me with an API example?

suwb — Thu, 23 May 2013 07:52:25 GMT

Just like I said, the TransBuilder.java(an API example supplied by Kettle itself) cannot work,and I don't know why.
Since now I know how to upload files,please help me check what is wrong in my codes or give me another example.
Here is the exception:

Exception in thread "main" java.lang.NullPointerException
at org.pentaho.di.trans.steps.tableinput.TableInput.closePreviousQuery(TableInput.java:202)
at org.pentaho.di.trans.steps.tableinput.TableInput.dispose(TableInput.java:252)
at org.pentaho.di.trans.Trans.prepareExecution(Trans.java:652)
at org.pentaho.di.trans.Trans.execute(Trans.java:275)
at kettle_suwb.main(kettle_suwb.java:263)

Here is the website
http://wiki.pentaho.com/display/EAI/...transformation

Attached Files

kettle_suwb.java (11.8 KB)

Could not find the main class: org.pantaho.di.pan.Pan

vsraju — Thu, 23 May 2013 06:41:46 GMT

Hi,

i created Transformation(Validate.ktr) and it is running Successfully in Spoon.. so, i wanna to create Batch(Pan.bat) of Transformation(Validate.ktr).

My Batch code is below,
batch.jpg
and Execute that Transformation through Batch file, it got Exception
Exception.jpg

Any help Please !!!

Note in Batch code:
set KETTLE_HOME=C:\Kettle_4.4
set PATH=C:\Program Files (x86)\Java\jre6\bin;.;%PATH%

Attached Images

batch.jpg (19.7 KB)
Exception.jpg (29.3 KB)

I'm from China.I need to create transformation with only Java codes

suwb — Thu, 23 May 2013 01:48:01 GMT

First,please ingore my mistakes about English.

Then,here is my question:I am not allowed to use the Kettle GUI,or the repository.What I can use is the types and methods that is supplied by the kettle source codes.In the kettle 3.2.0stable version,there is an example 'TransBuilder.java' in the the folder 'extra'(I'm not sure if you guys know this),and my code is just from there,but it cannot work,and I struggle for this for a long time.

I don't know if you understand,please help me find out what's wrong,or if you have any other examples,just let me know,I really need your help.
360截图20130523093443214.jpg
Sorry for the code,I don't konw how to upload a 'txt' file.

import java.io.DataOutputStream;
import java.io.File;
import java.io.FileOutputStream;
import org.pentaho.di.core.Const;
import org.pentaho.di.core.NotePadMeta;
import org.pentaho.di.core.database.Database;
import org.pentaho.di.core.database.DatabaseMeta;
import org.pentaho.di.core.exception.KettleException;
import org.pentaho.di.core.logging.LogWriter;
import org.pentaho.di.core.util.EnvUtil;
import org.pentaho.di.trans.StepLoader;
import org.pentaho.di.trans.Trans;
import org.pentaho.di.trans.TransHopMeta;
import org.pentaho.di.trans.TransMeta;
import org.pentaho.di.trans.step.StepMeta;
import org.pentaho.di.trans.step.StepMetaInterface;
import org.pentaho.di.trans.steps.tableinput.TableInputMeta;
import org.pentaho.di.trans.steps.tableoutput.TableOutputMeta;
/**
* 这个类用于动态创建转换
* @author 苏文波
*/
public class table_to_table
{
//数据库连接信息
public static final String[] databasesXML = {
""+
"kettle_bs"+
"localhost"+
"MYSQL"+
"Native"+
"123"+
"3306"+
"root"+
"suwb"+
""+
""+
""+
""
};

/**
* 使用输入参数（如读取表名）来创建转换
* @param transformationName 转换名
* @param sourceDatabaseName 读取的源数据库名
* @param sourceTableName 读取的源表名
* @param sourceFields 期望从源表中读取的字段名
* @param targetDatabaseName 读取的目标数据库名
* @param targetTableName 期望写入的目标表名
* @param targetFields 目标表中的字段名(与源字段的字段数相同)
* @return A new transformation 返回一个新的转换
* @throws KettleException In the rare case something goes wrong 异常处理
*/
public static final TransMeta buildCopyTable(String transformationName,
String sourceDatabaseName, String sourceTableName,
String[] sourceFields, String targetDatabaseName,
String targetTableName, String[] targetFields)
throws KettleException
{
EnvUtil.environmentInit();
try
{
// 创建转换
// 创建一个transMeta对象
TransMeta transMeta = new TransMeta();
transMeta.setName(transformationName);

// 加入数据库连接,根据XML文件读取数据库资料
// 创建数据库对象，将数据库对象databaseMeta作为属性添加到transMeta对象中
//for (int i=0;i //{
DatabaseMeta databaseMeta = new DatabaseMeta(databasesXML[0]);
transMeta.addDatabase(databaseMeta);
//}

DatabaseMeta sourceDBInfo = transMeta.findDatabase(sourceDatabaseName);
DatabaseMeta targetDBInfo = transMeta.findDatabase(targetDatabaseName);

// 添加注释
String note = "Reads information from table [" + sourceTableName+ "] on database [" + sourceDBInfo + "]" + Const.CR;
note += "After that, it writes the information to table [" + targetTableName + "] on database [" + targetDBInfo + "]";
NotePadMeta txt = new NotePadMeta(note, 150, 10, -1, -1);//五个参数分别为字符串，坐标（x，y），宽，高；
transMeta.addNote(txt);

// 创建一个源数据步骤
String fromstepname = "read from [" + sourceTableName + "]";//步骤名：表输入
TableInputMeta t_input = new TableInputMeta(); //一个表输入源
t_input.setDatabaseMeta(sourceDBInfo); //该表所在的数据库
String selectSQL = "SELECT "+Const.CR;//Const.CR相当于1个回车换行
for (int i=0;i {
if (i>0) selectSQL+=", ";
else selectSQL+=" ";
selectSQL+=sourceFields[i]+Const.CR;
}
selectSQL+="FROM "+sourceTableName;
t_input.setSQL(selectSQL);
//设定取数据的sql语句,如果知道要取的字段的话，应该可以直接String selectSQL = "SELECT xxx from"+sourceTableName;

// 以下将源数据步骤作为属性添加到transMeta对象中
StepLoader steploader = StepLoader.getInstance();
String fromstepid = steploader.getStepPluginID(t_input);
StepMeta fromstep = new StepMeta(fromstepid, fromstepname, (StepMetaInterface) t_input);//StepMeta类包含定义步骤所需的一切信息
fromstep.setLocation(150, 100);
fromstep.setDraw(true);
fromstep.setDescription("Reads information from table [" + sourceTableName + "] on database [" + sourceDBInfo + "]");
transMeta.addStep(fromstep);

/**
// 增加逻辑来重命名字段
// 创建一个数据处理对象，此处为一个v_input对象。该对象用于选择指定的源数据的列，将其中的数据送到目标数据库的指定列
SelectValuesMeta v_input = new SelectValuesMeta();
v_input.allocate(0, 0, sourceFields.length);

for (int i = 0; i < sourceFields.length; i++)
{
v_input.getMeta()[i].setName(sourceFields[i]); //设定源列
v_input.getMeta()[i].setRename(targetFields[i]); //设定目标列
}

//以下将该对象作为属性添加到transMeta对象中
String selstepname = "Rename field names";
String selstepid = steploader.getStepPluginID(v_input);
StepMeta selstep = new StepMeta(selstepid, selstepname, (StepMetaInterface) v_input);
selstep.setLocation(350, 100);
selstep.setDraw(true);
selstep.setDescription("Rename field names");
transMeta.addStep(selstep);

//创建一个数据流对象d_hop，用于连接源和v_input对象
//并将该数据流对象作为属性添加到transMeta对象中
TransHopMeta d_hop = new TransHopMeta(fromstep, selstep);
transMeta.addTransHop(d_hop);
fromstep = selstep;
*/

//创建一个目标对象，此处目标为数据库输出
String tostepname = "write to [" + targetTableName + "]";
TableOutputMeta t_ouput = new TableOutputMeta(); //创建一个表输出对象
t_ouput.setDatabaseMeta(targetDBInfo); //设置该表所在数据库
t_ouput.setTablename(targetTableName); //设置目标表的表名。若目标数据库中不存在该表，则创建表
t_ouput.setCommitSize(200);
t_ouput.setTruncateTable(true);
//将该目标对象作为属性添加到transMeta对象中
String tostepid = steploader.getStepPluginID(t_ouput);
StepMeta tostep = new StepMeta(tostepid, tostepname, (StepMetaInterface) t_ouput);
tostep.setLocation(550, 100);
tostep.setDraw(true);
tostep.setDescription("Write information to table [" + targetTableName + "] on database [" + targetDBInfo + "]");
transMeta.addStep(tostep);

// 建立一个数据流对象hop，用于连接源步骤和目标步骤
TransHopMeta c_hop = new TransHopMeta(fromstep, tostep);
transMeta.addTransHop(c_hop);
// 如果我们还在这儿，就重写转换
return transMeta;
}
catch (Exception e)
{
throw new KettleException("不好意思，出错了哦", e);
}
}
/**
1　　创建一个新的转换
2　　保存转换为XML文件
3　　生成SQL的目标表
4　　执行转换
5　　删除目标表使这个程序可重复的
* @param args
*/
public static void main(String[] args) throws Exception
{
EnvUtil.environmentInit();
//初始化环境
/**
* LogWriter log = LogWriter.getInstance("TransBuilder.log", true, LogWriter.LOG_LEVEL_DETAILED);

// 加载所有插件和步骤
StepLoader stloader = StepLoader.getInstance();
if (!stloader.read())
{
log.logError("TransBuilder", "Error loading Kettle steps & plugins... stopping now!");
return;
}
*/
LogWriter.getInstance("table_to_table.log", true, LogWriter.LOG_LEVEL_DETAILED);

// 加载步骤
StepLoader.init(); //初始化

// 我们所需的参数
String fileName = "NewTrans.xml";
String transformationName = "kettle_test";
String sourceDatabaseName = "su1";
String sourceTableName = "bs5";
String sourceFields[] = {
"no",
"name",
"height",
"weight"
};
String targetDatabaseName = "su1";
String targetTableName = "bs7";
String targetFields[] = {
"a",
"b",
"c",
"d"
};

// 调用方法，创建转换
TransMeta transMeta = table_to_table.buildCopyTable(
transformationName,
sourceDatabaseName,
sourceTableName,
sourceFields,
targetDatabaseName,
targetTableName,
targetFields
);

// 保存为xml文件
String xml = transMeta.getXML();
//System.out.println(xml);
DataOutputStream dos = new DataOutputStream(new FileOutputStream(new File(fileName)));
dos.write(xml.getBytes("UTF-8"));
dos.close();
System.out.println("Saved transformation to file: "+fileName);

// 这个sql是建表的语句，是数据库没有对应的表时，会执行的语句
String sql = transMeta.getSQLStatementsString();
System.out.println(sql);

// 对目标表执行sql
Database targetDatabase = new Database(transMeta.findDatabase(targetDatabaseName));
targetDatabase.connect();
targetDatabase.execStatements(sql);

// 执行整个转换
Trans trans = new Trans(transMeta);
trans.execute(null);
trans.waitUntilFinished();

// 为了程序可重复，执行完后删除目标表
//targetDatabase.execStatement("drop table "+targetTableName);
//targetDatabase.disconnect();
}

}

Attached Images

360截图20130523093443214.jpg (22.1 KB)

How to obtain bag of words for known vocabulary? Weka in Java

chtnverma — Wed, 22 May 2013 21:05:46 GMT

I am using Weka on Java to do a text classification task. I have 1000 training instances, and test instances that are streamed to me. At one time, I have only one test instance. The vocabulary V1 created on the training instances has 20,000 words. My intent is to learn the vocabulary V1 once, and represent a given test instance in bag of words representation using V1.
I can obviously re-calculate the vocabulary every time I have a test instance as follows:

StringtoWordVector filter = new StringToWordVector();
filter.setInputFormat(TrainInstances);
Instances FilteredTrainInstances = Filter.useFilter(TrainInstances, filter);
Instances FilteredTestInstances = Filter.useFilter(TestInstances, filter);
System.out.println(FilteredTestInstances);

This gives me the desired output, ie:

@<Info of 20,000 attributes>
followed by representation of the test instance:
{95 1,991 1,1262 1,6336 1,8517 1,10128 1}

which is what I want. However, I don't want to calculate vocabulary everytime and so I tried to store it using SerializationHelper. Now given a test instance, when I read the filter using SerializationHelper, and use it by Filter.useFilter, the representation is not on basis of V1, rather on basis of newly created vocabulary based on test video.

StringToWordVector filter = (StringToWordVector) weka.core.SerializationHelper.read(Path_of_Saved_Filter_onDisk);
Instances FilteredTestInstances = Filter.useFilter(TestInstances, filter);
System.out.println(FilteredTestInstances);

This gives me:

@<Info of 6 attributes>
followed by representation of the test instance:
{1 1, 2 1, 3 1, 4 1, 5 1, 6 1}

which is not what I want.
I expected setInputFormat to store vocabulary information in filter, and useFilter to just apply it. From what it appears, first use of useFilter calculated the vocabulary. I couldn't find accuracy documentation of this.
How can I obtain the bag of word vector in terms of original vocabulary? I don't want to have to load the training instances again, and I know there must be a way to do this..
Thanks in advance!

A different XML structure, how to parse it?

suanmeiguo — Wed, 22 May 2013 21:05:08 GMT

The example structure here: http://forecast.weather.gov/MapClick...pe=digitalDWML

k-p1h-n1-0

2013-05-22T17:00:00-04:00

2013-05-22T18:00:00-04:00

2013-05-22T19:00:00-04:00

2013-05-22T20:00:00-04:00

2013-05-22T21:00:00-04:00

2013-05-22T22:00:00-04:00

72
70
68
65
65

In this xml, all temperatures are put together in the same node, all time are put together in the same node, so how do I parse and map each temperature to the correct time? right now I'm just process each node and add a sequence, but is there any other way? or some xpath can do this?

Thank you

Maximum Number of Columns in Adhoc Report

birtPentahoUser8 — Wed, 22 May 2013 20:12:51 GMT

I have an adhoc report where we would like to include more than 100 columns and export it as Excel/CSV for analysis. However, whenever I add more than 100 columns, the report's resultset suddenly becomes 0 rows and no data is returned. I have turned my log4j debug level up to DEBUG, but no new error message appears in the log file. I did extract the SQL query from the log files and the query is valid and returns 16 rows with 100+ columns when run directly against mysql. However, the adhoc tool still displays no data in the report's output.

Is there a maximum number of columns in an adhoc report? If so, is the limit 100 columns?

Problem with shared dimension names in virtual cubes

paulo.f.rezende — Wed, 22 May 2013 19:51:06 GMT

Hello guys,
I have a situation that I could not solve and would like the opinion of you.

I have the following structure of cubes / facts:

CUB_1
FACT_TABLE 1
TIME_DIM_CUB_1 (use share dimension TIME_DIM with foreign key time_id_1), name: Time_1
DIM_2
MEASURE_1

CUB_2
FACT_TABLE 2
TIME_DIM_CUB_2 (use share dimension TIME_DIM with foreign key time_id_2), name: Time_2
TIME_DIM (use share dimension TIME_DIM with foreign key time_id_3), name: Time_3
DIM_2
MEASURE_2

TIME_DIM
Name: Time
-Hierarchy TIME
- Year
- Month
- Day

Where the size TIME_DIM is a shared dimension. When I explore the cube in any analysis tool (Analyzer / JPivot) is given the name I gave the cub, eg. when I use CUB_1 name is displayed Time_1.

However, when I make a virtual cube with the following structure:

VIRTUAL_CUBE
TIME_DIM_CUB_1
TIME_DIM_CUB_2
TIME_DIM
MEASURE_1
MEASURE_2

In the analysis tool (Analyzer / JPivot) is presented as follows

Name: Time
- Year
- Month
- Day
- Year
- Month
- Day
- Year
- Month
- Day

But what I need is to be displayed in the virtual cube, the three hierarchies separately, as in:

Name: Time_1
- Year
- Month
- Day

Name: Time_2
- Year
- Month
- Day

Name: Time_3
- Year
- Month
- Day

Any suggestions?

Thanks for the help guys!

Unauthorized Access Error installing plugins from Marketplace

alucard1626 — Wed, 22 May 2013 16:18:40 GMT

Hi all, i got an error on my pentaho CE deploy. I had set a Pentaho CE server with Active Directory authentication using my own roles definition, all working good, i can stablish permissions to the reports or cubes based on roles or users, but when i try to install a plugin from the marketplace with any account (including admins) i get this error:

Error installing
Unauthorized Access. Your Pentaho roles do not allow you to make changes to plugins.

where can change the marketplace authentication? i tryed to override permissions on /biserver-ce/pentaho-solutions/system/pentaho.xml as this:

but nothing working, can someone help me???

How connect Pentaho Data Integration with Amazon RDS?

madpin — Wed, 22 May 2013 15:50:35 GMT

I´m having difficult with create a new connection on Pentaho Data Integration (Kettle) with Amazon RDS, Amazon needs a CA Cert, and I dont know how to input it to connection.
Someone can help me?
Tkx,

Error executiong table input reading XML

nko — Wed, 22 May 2013 15:24:01 GMT

Hi,
I need to extract values from an XML field executing a query directly from an input table step. (I can't use the read XML step due to the high memory needed for the high amount of data)

I noticed a strange behaviour... maybe due to the clause ";WITH XMLNAMESPACES(default, val)"

In the table input step I'm able to see results from the preview button, but if I check the output field of the table input step, no field are shown.
In the same way this kind of query causes me problems in a database join step.

I'm using the geokettle 2.5.

I attach an example of my transformation,

Thanks

Attached Files

Transformation forum.ktr (29.3 KB)

Synchronize two tables, and add a timestamp only when certain columns are updated

Gone Surfing — Wed, 22 May 2013 14:53:23 GMT

Hi,
I need to keep a SRC table synchronized with a DST table.
I prepared a simple transformation that reads the source table, and that does a Insert / Update on the destination table, and it is working fine.

But I also need to add two timestamps on the DST table:

timestamp1 that reflects the datetime of when that row has been inserted or updated;
timestamp2 that reflects the datetime of when certain fields have been updated.

e.g.
If any field in the source table changes, I need to update those fields in the destination table, and I need to update timestamp1.
But I want to update timestamp2 only if col1 or col2 have been updated. If there's a change only on non_important_column, I need to update that field and also timestamp1, but not timestamp2.

I'm currently using some triggers on the DST table to achieve my result, and they are working, but I'd prefer to keep all the logic inside the trasformation.
Is there a native way of doing this in kettle?

Thanks

unable to start BI server with jdk or jre 1.6 - but with jre 1.7 works

bllmtt — Wed, 22 May 2013 14:26:55 GMT

As in the subject line I can't start the BI server (4.8 stable) using jre or jdk 1.6 (update 45) on my linux (RH) test server.
I get this error message from catalina.out "Error occurred during initialization of VM. java/lang/NoClassDefFoundError: java/lang/Object"
But I had also unziped into a directory the jre 1.7 (update 21) and pointing at it into the start-pentaho.sh file (just changing the export JAVA_HOME line), and everything works fine!!
I must use the 1.6 version for compatibility so I can't run the server using the workaround above.
Thanks for the help
Matteo

Joining large files via MapReduce with Kettle

better — Wed, 22 May 2013 13:52:38 GMT

I have to very large files that are table exports from an RDBMS (tab-delimited), and the files are stored in HDFS. I need to "join" these two files on one of the "columns".

If you are familiar with Pig, you know that it is possible to use MapReduce to join files within HDFS. I was wondering if there is a way from within Kettle to join files using MapReduce. I know you can use a Join Rows step, but I don't think that uses the power of the Hadoop cluster to do the work. I also know that you could layer the files under HBase, but since I'm using this for ETL, the files won't be static.

Any pointers would be appreciated.

-Barry

Left join in virtual cubes

paulo.f.rezende — Wed, 22 May 2013 13:51:52 GMT

Hello guys,
I have a situation that I could not solve and would like the opinion of you.

I have two cubes, as follows:

CUB_1
FACT_TABLE 1
DIM_1
DIM_2
MEASURE_1
MEASURE_2

CUB_2
FACT_TABLE 2
DIM_1
DIM_2
MEASURE_3
MEASURE_4

I built a virtual cube to integrate my two cubes, my two tables facts, and everything worked perfectly. My problem was when I include a new cub:

CUB_3
FACT_TABLE 3
DIM_1
DIM_3
MEASURE_5

When I filter by any attribute DIM_2 that exists in CUB_1 and CUB_2 are not presented metrics CUB_3, I think because there is no dim_2 in CUB_3.
I think a possible solution would be to use some type structure like LEFT JOIN, just do not know how to do this using the mondrian

Thank you in advance for help!

Simple Evaluation step - I am getting The previous result is empty! in error log

JoyDivision — Wed, 22 May 2013 12:34:18 GMT

Hi

I think I did exactly as http://wiki.pentaho.com/display/EAI/...28Job+Entry%29 wiki said but I am getting this error.

What in seven heavens could I have done wrong...sigh

Attached Files

Simple Evaluation.kjb (11.3 KB)
Copy Rows To Result.ktr (10.4 KB)

[Experimenter] Csv output not coherent

farinadiceci — Wed, 22 May 2013 12:24:06 GMT

I've run a couple experiments (ten fold cross validation for 21 algorithms) and I noticed that the outputted csv file as something wrong between the header and the columns: my guess is that the header shall be shifted 2 position to the right.

As anyone experienced something like this? I've not tried the arff output format yet (I'll need the time and memory to rerun the experiments).

(I'm attaching one of those csvs)
http://dfiles.eu/files/zbj4ll308

transformation parameter bug?

PietroB — Wed, 22 May 2013 12:20:07 GMT

Hi, I have this problem: I have defined a parameter p1 in a transformation (in the properties, as expected named parameter), but spoon can't see it (ctr+space opens a list without it).
If I type it manually, it never gets substituted with the actual value that I have specified as the default, it passes thru as ${p1} (literally)
I'm using 4.4.2 compiled under win7x64.

SFTP lock after try to connect many times with wrong password

marinov — Wed, 22 May 2013 10:53:51 GMT

Hi everyone
How can I prevent the sftp step to try connect to the server no more then one time.

Problemas con report designer

arenla — Wed, 22 May 2013 09:40:35 GMT

Hola a todos,

Soy nuevo en esto, y no se muy bien si debo exponer mi problema aquí.
Tengo mi pentaho funcionando sin problemas en un servidor externo, y acceso sin problemas.

Ahora es donde viene mi problema, estoy haciendo report en local con el report designer, y si intento hacer una conexión de datos mediante JDBC me da error.
no consigo hacer la conexión remota.
He probado de hacerlo desde el servidor una conexión en local y ok, pero lo pruebo en remoto no me deja. (Y no es problema del conector jdbc con mysql porque lo tengo puesto)

Ademas también he visto, que si las pruebas las hago en el server, y cambio localhost por su ip, también me peta, no me coge la conexión el report designer.

Alguien sabe a que es debido esto? o porque motivo? llevo días buscando una solución por internet pero no encuentro nada. Muchas Gracias.

Running transformation(with date parameter) in unix

Papu — Wed, 22 May 2013 06:07:16 GMT

Hi,
While running the transformations (with parameters including date) in unix, it did not fetch the records for the given input. No rows are found in my target. I guess,it is not taking the given date in date format. Any suggestions?

- Thanksss

Upgrade BI server 3.8 to 4.5

gawadesk — Wed, 22 May 2013 06:05:42 GMT

Hi,

In our current production environment we are using BI Server 3.8 stable version. Now we want to upgrade BI Server to 4.5 stable version.

I didn't got any documentation about upgrade process. Can I get any help on this ?

Thanks,
Krishna Gawade.

Pentaho on existing Tomcat 7

pavel.orehov — Wed, 22 May 2013 06:03:49 GMT

Hi,

I wonder if there is a way to run Pentaho Web application on existing Tomcat 7 as standard war (not have to be closed war) ?

I'm not familiar with BI server that comes by default with Pentaho installation. Actually, I see Tomcat inside and not sure what additional things BI server adds.

Thanks,
Pavel

SugarCRM Plugin

aabadi — Wed, 22 May 2013 01:35:15 GMT

Does anybody knows something about the SugarCRM plugin for Kettle??

I cannot find it, Ive searched on http://wiki.pentaho.com/display/EAI/SugarCRM+Plugin, but when you follow the link, the plugin is not there :(

Any help you can provide, I will very much appreciate.

Thanks in advance!

Can't save analysis view on BI server

brightlee6 — Tue, 21 May 2013 22:07:45 GMT

I developed a OLAP schema using pentaho schema workbench, published to BI server successfully. Then I used new analysis view to prepare a special view for my purpose. When I saved the view but got "ANALYSISSAVER.ERROR_0006 - Save is disabled". I googled around but couldn't find right answer. Not sure if anyone had same issue as mine.

A few days back, I could save these view to files, not sure why I can't do it now. Also there is no errors from log files for this action.

I attached the error image for your reference. I use Pentaho Community BI 4.8.

Thanks a lot.

Attached Images

Screen Shot 2013-05-21 at 2.43.56 PM.jpg (23.6 KB)

Excel Writer - very slow

gibon — Tue, 21 May 2013 19:19:07 GMT

Hi everybody,
we have a job to create a new xlsx file. This new file is created using a template file. Our template is a xlsx file with many sheets (charts, pivot table, ... and 15 data sheets).

For each data sheet we have one query (on Oracle db). Our job is working, but with low performance (almost one hour of running).

We did a test using the text file as the target and the job ran around 5 minutes, then the tuning on the queryes is ok.

Any ideia for reduce this big execution time?

parameters doubts

armonick — Tue, 21 May 2013 16:06:06 GMT

Hello,

First of all I thank the help you may offer.

I explain:

I have a transformation that is very simple: make a select from a table and insert them into other records.

I need two things I do not know how to do:

1. - That when transformation runs, check the records that already exist in the target database and update only those that have changed and insert the new. But they have not changed not touch.

Two. - I have a field in the source table is VISITDATE. I need to pass as parameter the starting date and records not select records with the field VISITDATE

I created, on the tab of the transformation parameters, the startdate parameter, but as I do that by executing a transformation I ask the value of the start date and also make me VISITDATE filter

I do not know if I explained well, but thanks anyway.

Greetings to all!

Help with Paired Bar-Line Example on webdetails site (in CDE)

loganseth — Tue, 21 May 2013 15:24:10 GMT

In trying to use this example:
http://www.webdetails.pt/ctools/ccc....-line-measures

and am not sure how (if possible) to correlate some of the fields in the example code (which is, really really awesome, btw, that these examples exist. if you are new and want to learn, visit this site and try to build these examples, for the love...)

so the issue I have is I'm not editing the cdfde files (just using CDE and things like 'pre-execution') and not sure how to implement these portions of the example:

Quote:

readers: ['measure, series, category, value'],

dimensions: {
// Explicitly define the "measure" dimension
// (change the defaults that would
// otherwise take effect)
measure: {
// If you want to hide the special
// "measure" dimension from the tooltip:
isHidden: true,

// Fine tune the labels
formatter: function(v) {
switch(v) {
case 'Count':
return "Count";
case 'AvgLatency':
return "Avg. Latency";
}
return v + '';
}
}
},

etc...

Do I wrap it in a function in pre-execution? Example of how to do this?

Edit the cdfde file?

As always, many thanks for this awesome tool.

Transformation preview works, run gets stuck?

joao.ciocca — Tue, 21 May 2013 14:54:56 GMT

Sooooooooo... I have a simple transformation that reads XLS, denormalizes and normalizes data. When I preview the result, everything shows up fine - denormalize gets 2904 reads 2222 writes, normalize gets 2222 reads and 79992 writes. But when I try to run, denormalize finishes with 2904 read 2222 written, normalize reads 834 writes 30002 and stops. No errors, no crashes, it justs says it's running but nothing happens. I've left it "running" for almost an hour now, and it's going nowhere. Ideas?

Repeating headers throughout file in variable places

sdhayes — Tue, 21 May 2013 13:36:28 GMT

Hi,

I am trying to import a pseudo log file, which has an initial 6 rows, prefixed by a #
These rows have variable numbers of columns, the first row has the maximum of 6.

This causes Pentaho to misread the underlying structure of the *actual* data, which has 18 columns.

Can you suggest how to handle this?

Thanks
Stuart

Scheduling a dynamic xaction calling PDI Component

satran — Tue, 21 May 2013 12:30:26 GMT

Hi,

I have an xaction which accepts dynamic parameters and pass the parameters to a PDI Job which executes accordingly. Each time the parameter value only gets changed but the job will be constant. What I want to do is, If first time, the parameters are passed, I want to schedule and run the xaction or PDI job with the given parameters. So, each time if the scheduled job or xaction runs, it should use the same parameter.

Likewise , using the same job , I will schedule different times but my parameter will have to get changed accordingly . How to do that ?

How to implement scheduling for xaction other Pentaho Admin Console ?

Integrate Cruise Control with Spoon

kalanis — Tue, 21 May 2013 09:49:48 GMT

I need to integrate Cruise Control with Spoon and use it to execute the jobs. It is much appreciated if anyone who has done a similar thing can share their thoughts on how to do this. Thanks in advance.

Uninstall Kettle 4.2 Community Edition

randyamos — Tue, 21 May 2013 04:21:18 GMT

Hi,

I downloaded and setup Kettle 4.2 community edition but now I need to download the Enterprise Edition 4.2.1 (need to hook up to an enterprise server for contract work) and I think it would be best if I completely remove the community edition. How do I do that to make sure I have removed everything and get a clean install for the EE? I've been looking for hours but can't find anything on removing it. There is no uninstall file.

Thanks!!
Randy

Get data from xml - unable to handle strange character such as

suanmeiguo — Tue, 21 May 2013 02:11:11 GMT

I'm using get data from xml step to retrive data from an API. Unfortunitely the api returns strange characters such as , , etc. And Kettle stops because of the error raised when get data from xml step encounters those characters.

So is there anyway to filter out those characters or make kettle continue ignoring those characters?

Really appreciate your help. I've spend tons of time on this, any clue will be very useful. Thank you.

Report designer 3.9.1.: Embedded call to engine produces charts in pdf not html

mnl — Mon, 20 May 2013 23:02:12 GMT

When invoking the reporting engine in embedded fashion (using sample code from 3.9.1. sdk) and putting all the jar files from the lib directory of report designer and the lib directory of the report designer SDK, the pdf output file contains all the subreport embedded bar charts but the html version did not - it is blank white space!

Both version show the report header and the banded tabular output after the subr-reports and other fields in the master report.

There are no warning at all; The sdk sample program was modified in eclipse, i.e. AbstractReportGenerator and its derived class. So nothing special about the engine invocation from java.

Is there a way to set a debug mode where the java embedded call to the reporting engine will tell us why he is ignoring drawing the bar graphs in the 4 embedded sub-reports when the output format is html mode?:confused:

Is it missing jar files or something else? There are no warnings

Environment Centos, report designer 3.9..1, sdk also 3.9.1. Eclipse Helios Java

PDI doesn't start using Ubuntu 13.04

gcotton — Mon, 20 May 2013 21:33:54 GMT

Hi, I'm using PDI 4.4.0.
I just update my OS to Ubuntu 13.04, and now PDI doesn't start

After Repository Login, the window crash. Running from command line I get this:

INFO 20-05 15:29:54,256 - RepositoriesMeta - Reading repositories XML file: /home/gcotton/.kettle/repositories.xml
The program 'SWT' received an X Window System error.
This probably reflects a bug in the program.
The error was 'BadDrawable (invalid Pixmap or Window parameter)'.
(Details: serial 18171 error_code 9 request_code 62 minor_code 0)
(Note to programmers: normally, X errors are reported asynchronously;
that is, you will receive the error a while after causing it.
To debug your program, run it with the --sync command line
option to change this behavior. You can then get a meaningful
backtrace from your debugger if you break on the gdk_x_error() function.)

I'm using Oracle 7 JDK

Thanks in advance for any help

Table input: Number instead of BigNumber?

joao.ciocca — Mon, 20 May 2013 20:31:13 GMT

this is a quick one: is there anyway to output Number instead of BigNumber? I'm working on a injected transformation with ETL metadata, and I don't wanna put a select values there between the input and append streams just to change BigNumber to Number...

=edit=
and more on this... what's the difference between "String(12)" and "String(12)"? Append Streams is complaining about this, it's both inputs have a String(12) field...

Problem on preview of Table Input

Wiler — Mon, 20 May 2013 20:04:52 GMT

I have this setup on Table Input for testing....

Code:

SELECT 'L' tp_afastamento, regexp_replace(p.nu_cpf, '[^0-9]', '') nr_cpf_magistrado, l.dt_inicio, l.dt_fim

        FROM srh.TB_LICENCA l, srh.TB_PESSOA p, srh.tb_pessoa_complemento pc, sap1.juiz j

        WHERE   p.ID_PESSOA = L.ID_SERVIDOR

            AND p.ID_PESSOA = pc.ID_PESSOA

            AND SUBSTR(pc.NU_MATRICULA,6,4) = j.cd_matricula

            AND ST_LICENCA = 'H'



        UNION



        SELECT 'F' tp_afastamento, regexp_replace(p.nu_cpf, '[^0-9]', '') nr_cpf_magistrado, dt_inicio,dt_fim

        FROM srh.tb_ferias_periodo f,  srh.TB_PESSOA p, srh.tb_pessoa_complemento pc, sap1.juiz j

        WHERE   p.ID_PESSOA = f.ID_SERVIDOR

            AND p.ID_PESSOA = pc.ID_PESSOA

            AND SUBSTR(pc.NU_MATRICULA,6,4) = j.cd_matricula

            AND F.FL_SITUACAO_PERIODO = 'H'

              

        UNION



        SELECT 'V' tp_afastamento, regexp_replace(p.nu_cpf, '[^0-9]', '') nr_cpf_magistrado, TRUNC(DTHR_INICIO) DT_INICIO, TRUNC(DTHR_FIM) DT_FIM

        FROM srh.Tb_Viagem_Servico V, srh.TB_PESSOA p, srh.tb_pessoa_complemento pc, sap1.juiz j

        WHERE   p.ID_PESSOA = v.ID_SERVIDOR

            AND p.ID_PESSOA = pc.ID_PESSOA

            AND SUBSTR(pc.NU_MATRICULA,6,4) = j.cd_matricula

              

        ORDER BY 2,3;-- Ordenado por data inicial

and for some reason, it won't start. If I press preview, it says

Code:

Falhou a inicialização de pelo menos um step. A Execução não pode sere iniciada! 

Which means: "We failed to initialize at least one step.  Execution can not begin!"

If I click details, all I get is this

Code:

org.pentaho.di.core.exception.KettleException: 

Falhou a inicialização de pelo menos um step. A Execução não pode sere iniciada! ("We failed to initialize at least one step.  Execution can not begin!")



    at org.pentaho.di.trans.Trans.prepareExecution(Trans.java:932)

    at org.pentaho.di.ui.trans.dialog.TransPreviewProgressDialog.doPreview(TransPreviewProgressDialog.java:140)

    at org.pentaho.di.ui.trans.dialog.TransPreviewProgressDialog.access$000(TransPreviewProgressDialog.java:52)

    at org.pentaho.di.ui.trans.dialog.TransPreviewProgressDialog$1.run(TransPreviewProgressDialog.java:85)

    at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:113)

I've already seen this thread (http://forums.pentaho.com/showthread...-Rows-crashing), but the solution isn't applicable for my problem.

Joining Normalized Data Files

skylane — Mon, 20 May 2013 19:16:26 GMT

Hi,

I have several normalized data files that I need to combine with regular table data (e.g. a product table). The normalized data files contain location and quantity. The location and qty data have too many discrete values to make columnar and left join.

EXAMPLE

------------------------------

Product File:

PRODUCT_ID|VENDOR_NO|MODEL_ID
123|0089|MX678
124|3454|DV345
125|3242|BH848

Location Data file:

PRODUCT_ID|LOCATION_ID|QTY

125|100|4
125|101|6
125|56|10
125|38|5
124|55|0
124|357|4
124|210|6
123|38|20
123|235|15

The final output I'd like is a vertical data file, something like this:

PRODUCT_ID 123
VENDOR_NO 0089
MODEL_ID MX678
LOCATION_38 20
LOCATION_235 15
EOR
PRODUCT_ID 124
VENDOR_NO 3454
MODEL_ID DV345
LOCATION_55 0
LOCATION_357 4
LOCATION_210 6
EOR
PRODUCT_ID 125
...

I've tried a few options thus far but am pretty much stuck. Any help would be greatly appreciated!

Thanks!

Fred

Need Help With Row Injector Please

bakero — Mon, 20 May 2013 16:01:37 GMT

Hello,

I'm trying to dynamically inject a CSV row for transformation using the java API. I've defined the transformation using spoon which contains a Row Injector, CSV File Input, and XML File Output. I load this ktr file in java and wish to add a CSV row dynamically for transforming. I've had to add the input file name via a RowProducer and the file is now found. This file is actually a dummy file with no rows as it seems I must have a file for the transformation. I've tried to add a CSV row via the RowProducer as well but it's treated as if it's a file name not a data row. Am I going about this the wrong way? Can someone please point me in the right direction?

Thank you!

Java process that calls transformations via API runs out of memory

dbron0000 — Mon, 20 May 2013 14:40:23 GMT

Hi All,

I have a Java process that consumes RabbitMQ messages and submits the payload via the Java API for Transformations to process. It works well - except that the jobs that use the Ruby plugin consume memory that isn't released via Garbage Collection. It's only 2 class files (which I am attaching).

My questions are:

Is there a better way to call the Java API that would more reliably release memory?
Is there something that I may have missed in our approach?
Has anyone had a similar task that they approached differently?

- Short explanation of attached files -
Rabbitqueuemanager.txt is a java file that consumes events off a RabbitMQ queue and passes them to a defined transformation (read from a queues.xml config file)
xformlauncher.txt is a java file that accepts the necessary variables (payload, transformation name, repository credentials) and launches the transformation.

My concern is that if these transformations leak memory - others have the potential. My goal is better encapsulation.

Thanks,

David

Attached Files

xformlauncher.txt (3.8 KB)
rabbitqueuemanager.txt (2.8 KB)

I have one doubt about function MultiValueQuery

vinecz — Mon, 20 May 2013 13:15:32 GMT

Sr,

howz going ?

I'm using a MultiValueQuery in my parameter to return the values of my another query.

i have just one Column with 7 lines and my return just show the first value of my parameter.

and my question is how to show all of my results using multivaluequery. or if have another way to get it.

im waiting this answar asap.

thanks

Possible bug with "Select values" and Group By?

JoyDivision — Mon, 20 May 2013 12:35:01 GMT

Hi

I try usually to do all my casting in "Select values" metadata step not use scripting steps.

For my great annoyance it seems datetime conveted to date "YYYY-MM-DD" is still treated as original datetime by Group By step:(

Sample attached

Attached Files

Group_By_DateTime_MetaData_To_Date.ktr (13.3 KB)

how to get batch_id in the target table

arpit016 — Mon, 20 May 2013 11:48:26 GMT

I want to load a target table , and every time i run the job it should update the batch _id column in the table with the current batch no.

Please help!

Aggregate doesn't use the best table when use with inside
DreamingFighter — Mon, 20 May 2013 09:37:24 GMT
Hi all, when working with Mondrian I encounter a strange problem this morning:
- I create a Time dimension that have data from 2001 to 2020: D_PRD. Config in xml file:

Code:

`<=!=[=C=D=A=T=A=[ ( D_PRD.prd_id >= 20120101 and D_PRD.prd_id < 20140101]=]=>`

- I create a fact table that have 2 dimension, one is Time dimension: F_FACT_TABLE
- I create an aggregate table that only have Time dimension at Day level: AGG_01_F_FACT_TABLE
- I create another aggregate table that only have Time dimension at Month level: AGG_02_F_FACT_TABLE

Because I add condition to the dimension configuration, Mondrian never use the second aggregate table AGG_02_F_FACT_TABLE. Below is 2 SQL for when I add condition (SQL 1) and then remove it (SQL 2)
SQL 1:

Code:

select "D_PRD"."YEAR" as "c1", "D_PRD"."MONTH" as "c2", sum("AGG_01_F_FACT_TABLE"."T_ORG_COST") as "m0", sum("AGG_01_F_FACT_TABLE"."T_PROM_COST") as "m1", sum("AGG_01_F_FACT_TABLE"."T_TOT_COST") as "m2" from "MONDRIAN_TEST"."AGG_01_F_FACT_TABLE" "AGG_01_F_FACT_TABLE", "MONDRIAN_TEST"."D_PRD" "D_PRD" where "AGG_01_F_FACT_TABLE"."PRD_ID" = "D_PRD"."PRD_ID" and (D_PRD.prd_id >= 20120101 and D_PRD.prd_id < 20140101) and "AGG_03_THANGLD_MONDRIAN"."PRD_ID" = "D_PRD"."PRD_ID" and "D_PRD"."YEAR" = 2013 group by "D_PRD"."YEAR", "D_PRD"."MONTH"

SQL 2:

Code:

`select "AGG_02_F_FACT_TABLE"."YEAR" as "c1", "AGG_02_F_FACT_TABLE"."MONTH" as "c2", sum("AGG_02_F_FACT_TABLE"."T_ORG_COST") as "m0", sum("AGG_02_F_FACT_TABLE"."T_PROM_COST") as "m1", sum("AGG_02_F_FACT_TABLE"."T_TOT_COST") as "m2" from "MONDRIAN_TEST"."AGG_02_F_FACT_TABLE" "AGG_02_F_FACT_TABLE", where "AGG_02_F_FACT_TABLE"."YEAR" = 2013 group by "AGG_02_F_FACT_TABLE"."YEAR", "AGG_02_F_FACT_TABLE"."MONTH"`

Please help me adding condition to dimension table but can still make good use of aggregate table. Thanks!

The entity "nbsp" was referenced but not declared

Rouhida — Mon, 20 May 2013 08:31:39 GMT

I just saw this error message for the first time on the console since I can neither refreshr the global variable BI or anything
when I try to refresh the global variables for example I see this message:
[fr_71] Error while trying to execute startup sequence for org.pentaho.platform.plugin.action.mondrian.MondrianSystemListener

also when I try accessing the Pentaho User Console I see this error message
The following errors were detected
[fr_49] One or more system listeners failed. These are set in the systemListeners.xml.
PentahoSystem.ERROR_0014 - [fr_71] Error while trying to execute startup sequence for org.pentaho.platform.plugin.action.mondrian.MondrianSystemListener

Please see the server console for more details on each error detected.

MySQL Bulk Loader loads null data into target table

satran — Mon, 20 May 2013 07:26:25 GMT

Hi,

MySQL Bulk Loader using character set utf8 or without character set is loading null or empty data into my target table. Anyone aware of how to solve this ?

This is my loading command (obtained from log file) and all the records are loaded successfully.

Starting the MySQL bulk Load in a separate thread : LOAD DATA LOCAL INFILE '/tmp/fifo' INTO TABLE `IC_D_ASSOCIATE` CHARACTER SET utf8 FIELDS TERMINATED BY '|' OPTIONALLY ENCLOSED BY '"' ESCAPED BY '\\' ();

Attached - my source data when loaded into a text file instead of MySQL Bulk Loader.AttunityCDCTest.txt

Attached Files

AttunityCDCTest.txt (19.1 KB)

sql server data not loaded on report

alihonarmand — Mon, 20 May 2013 06:38:55 GMT

Hi everyone,
First I should say that I'm really excited with the whole product.The whole package is fantastic. Then I have encountered an issue, I have created a report in designer and published the report successfully on BI server v3.9.0 community edition. while on report designer I see the output, but on user-console nothing is presented. I have configured the JDBC and database connection but still no changes.
Something else is that I don't see anything event static texts in PDF output format.

thank in prior

A.H.

Exporting prpt component data in CDE

vipin.goyal — Mon, 20 May 2013 06:35:05 GMT

Hi,
I am trying to export prpt component output in xls format through CDE. I am using this function:
function exportTable()
{
render_prptComponentName.queryState.exportData('xls');
}

But this is not working. Does anyone knows alternative to this?

get longitude et laltitude from map component

slimani haythem — Mon, 20 May 2013 01:39:15 GMT

Hello ,
I am now using tha new map component and I have many points on this map .
I defined 2 Generic simple parameters (longitudde and latitude).
I like to get , for each marker , it's coordinates to use that for the poup up window.
I don't know what I have to put on these feilds :
* Marker click function
*CGG graph for marker

ther is a screen shot .
thank you

Haythem

Latest KDnuggets Poll on DM Software

Mark — Sun, 19 May 2013 21:29:51 GMT

Hi folks,

Please vote for Weka in the latest KDnuggets poll!

http://www.kdnuggets.com/index.html

Cheers,
Mark.

Salesforce connector, strange error

scottmack — Sun, 19 May 2013 12:35:20 GMT

Hi Forum,

I'm trying to evaluate PDI for integration with salesforce to run a few jobs for our organisation. Looks great so far, but having some trouble connecting to salesforce. I've googled, looked around and can't find a resolution. I would welcome your support.

I'm running Kettle Build version : 4.4.0-stable, Build date : 2012-11-21 16.02.21 on Linux (debian 7.0).
I've tested a couple of other inputs, such as mysql which work great.

The salesforce issue
Salesforce - I've added a Salesforce upsert into Kettle. Configured the following:

Salesforce URL: https://www.salesforce.com/services/Soap/u/24.0
(this matches the library in the kettle libext/salesforce folder)
Username: my salesforce username
Password: salesforce-password+TOKEN

This is shown here setup: http://cl.ly/image/422D2L2U151v

When I test the connection I get this error (http://cl.ly/image/3a3r2X2O2n0L)

Error connecting to Salesforce!
at org.pentaho.commons.launcher.Launcher.main (Launcher.java:134)
at java.lang.reflect.Method.invoke (Method.java:601)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:57)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (NativeMethodAccessorImpl.java:-2)
at org.pentaho.di.ui.spoon.Spoon.main (Spoon.java:580)
at org.pentaho.di.ui.spoon.Spoon.start (Spoon.java:8304)
at org.pentaho.di.ui.spoon.Spoon.waitForDispose (Spoon.java:7044)
at org.pentaho.di.ui.spoon.Spoon.readAndDispatch (Spoon.java:1221)
at org.eclipse.swt.widgets.Display.readAndDispatch (null:-1)
at org.eclipse.swt.widgets.Display.runDeferredEvents (null:-1)
at org.eclipse.swt.widgets.Widget.sendEvent (null:-1)
at org.eclipse.swt.widgets.EventTable.sendEvent (null:-1)
at org.eclipse.swt.widgets.TypedListener.handleEvent (null:-1)
at org.pentaho.di.ui.spoon.trans.TransGraph.mouseDoubleClick (TransGraph.java:705)
at org.pentaho.di.ui.spoon.trans.TransGraph.editStep (TransGraph.java:2749)
at org.pentaho.di.ui.spoon.Spoon.editStep (Spoon.java:7835)
at org.pentaho.di.ui.spoon.delegates.SpoonStepsDelegate.editStep (SpoonStepsDelegate.java:136)
at org.pentaho.di.ui.trans.steps.salesforceupsert.SalesforceUpsertDialog.open (SalesforceUpsertDialog.java:728)
at org.eclipse.swt.widgets.Display.readAndDispatch (null:-1)
at org.eclipse.swt.widgets.Display.runDeferredEvents (null:-1)
at org.eclipse.swt.widgets.Widget.sendEvent (null:-1)
at org.eclipse.swt.widgets.EventTable.sendEvent (null:-1)
at org.pentaho.di.ui.trans.steps.salesforceupsert.SalesforceUpsertDialog$10.handleEvent (SalesforceUpsertDialog.java:684)
at org.pentaho.di.ui.trans.steps.salesforceupsert.SalesforceUpsertDialog.access$1800 (SalesforceUpsertDialog.java:88)
at org.pentaho.di.ui.trans.steps.salesforceupsert.SalesforceUpsertDialog.test (SalesforceUpsertDialog.java:785)
at org.pentaho.di.trans.steps.salesforceinput.SalesforceConnection.connect (SalesforceConnection.java:257)
at com.sforce.soap.partner.SoapBindingStub.login (SoapBindingStub.java:2255)
at org.apache.axis.client.Call.invoke (Call.java:1812)
at org.apache.axis.client.Call.invoke (Call.java:2366)
at org.apache.axis.client.Call.invoke (Call.java:2443)
at org.apache.axis.client.Call.invoke (Call.java:2767)
at org.apache.axis.client.Call.invokeEngine (Call.java:2784)
at org.apache.axis.client.AxisClient.invoke (AxisClient.java:206)
at org.apache.axis.handlers.soap.MustUnderstandChecker.invoke (MustUnderstandChecker.java:62)
at org.apache.axis.Message.getSOAPEnvelope (Message.java:435)
at org.apache.axis.SOAPPart.getAsSOAPEnvelope (SOAPPart.java:696)
at org.apache.axis.encoding.DeserializationContext.parse (DeserializationContext.java:227)
at org.apache.xerces.jaxp.SAXParserImpl.parse (null:-1)
at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse (null:-1)
at org.apache.xerces.parsers.AbstractSAXParser.parse (null:-1)
at org.apache.xerces.parsers.XMLParser.parse (null:-1)
at org.apache.xerces.parsers.XML11Configuration.parse (null:-1)
at org.apache.xerces.parsers.XML11Configuration.parse (null:-1)
at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument (null:-1)
at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch (null:-1)
at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanStartElement (null:-1)
at org.apache.xerces.parsers.AbstractSAXParser.startElement (null:-1)
at org.apache.axis.encoding.DeserializationContext.startElement (DeserializationContext.java:1035)
at org.apache.axis.message.SOAPFaultDetailsBuilder.onStartChild (SOAPFaultDetailsBuilder.java:157)
at org.apache.axis.encoding.DeserializationContext.getDeserializerForType (DeserializationContext.java:547)
at org.apache.axis.encoding.DeserializationContext.getDeserializer (DeserializationContext.java:464)
at org.apache.axis.encoding.ser.BaseDeserializerFactory.getDeserializerAs (BaseDeserializerFactory.java:84)
at org.apache.axis.encoding.ser.BaseDeserializerFactory.getSpecialized (BaseDeserializerFactory.java:154)
at java.lang.reflect.Method.invoke (Method.java:601)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at sun.reflect.GeneratedMethodAccessor21.invoke (null:-1)
at com.sforce.soap.partner.fault.UnexpectedErrorFault.getDeserializer (UnexpectedErrorFault.java:83)
at org.apache.axis.encoding.ser.BeanDeserializer. (BeanDeserializer.java:90)
at org.apache.axis.encoding.ser.BeanDeserializer. (BeanDeserializer.java:104)
at java.lang.Class.newInstance (Class.java:327)
at java.lang.Class.newInstance0 (Class.java:374)
at java.lang.reflect.Constructor.newInstance (Constructor.java:525)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance (DelegatingConstructorAccessorImpl.java:45)
at sun.reflect.GeneratedConstructorAccessor50.newInstance (null:-1)

If its user error, I'm unsure where I'm quite sure I've followed the correct setup process. Salesforce allows my IP to connect and I can connect fine through the sf website. If I change the salesforce username/password to something incorrect in Kettle it gives me an error advising so (http://cl.ly/image/1r1x3A1I1R21) so its like the username / password are accepted but something else is causing Kettle to throw the error I'm experiencing.

I've got a Salesforce enterprise trial account, 30 days left. My user is set as a developer in salesforce.
Strangely, if I look in the salesforce logs, it logs my Kettle API connections as "Success" in the logs as shown here - http://cl.ly/image/2Z0Y1l2D1N0v

Would appreciate some ideas?

Cheers,
Scott

how to get all the column names as a new colmn in another file

arpit016 — Sun, 19 May 2013 07:50:34 GMT

Hi I have a file conating around 20 columns . I want to get the list of all column names as a single column in another file. Please help . For eg I have file customer having columns [cust_id,cust_name,age,....batch_id].
I want a column in another file {column name} conatining values
{cust_id
cust_name
age
.
.
.
batch_id}.

any transformation in spoon to do it? :confused:

Apriori algorithm

mtefe — Sat, 18 May 2013 20:24:17 GMT

Hello,

i have a arff file with information about patients with various diseases. I created several attributes (about 110 diseases and other atributes like age, country and genre) which then for each patient in each disease i put a 0 or 1 (0 = no disease, 1 = has the disease).

i'm trying to create a model to find the most associated diseases (as if Market Basket analysis) and i use the apriori algorithm on weka, in this dataset that contains 100 records and 114 attributes (and still more will be added) , but i get the message:

"not enough memory (less than 50 MB left on heap). please load a smaller dataset or use a larger heap size".

someone know something about this message? is this the best way to know which diseases are most associated with a particular disease?

thank you very much for your help

How to concatenate columns in Pentaho Metadata Editor ?

zhdanova — Sat, 18 May 2013 17:03:51 GMT

Hi!

I need to concatenate two columns in Pentaho Metadata Editor and display result as column. How can I do that ?
I checked MQL syntax and tried "+" operator for new physical column, but it didn't work - I see 0 as new column value.

Any help is greatly appreciated

THE ENTITY "nbsp" was referenced , but not declared

dev2013 — Sat, 18 May 2013 14:53:55 GMT

Bonjour,
SVP, j'ai un problème sur pentaho ,merci de m'aider à le résoudre

1)The following errors were detected

[fr_49] One or more system listeners failed. These are set in the systemListeners.xml.

PentahoSystem.ERROR_0014 - [fr_71] Error while trying to execute startup sequence for org.pentaho.platform.plugin.action.mondrian.MondrianSystemListener

Please see the server console for more details on each error detected.

2)THE ENTITY "nbsp" was referenced , but not declared

3)[fr_71] error while trying to execute startup sequence for org.pentaho.platform.plugin.action.mondrian.MondrianSystemListener

feature selection for test set

dids09 — Sat, 18 May 2013 12:35:07 GMT

Good day everyone. We badly need help for our thesis prototype. We have used Weka GUI to create and save a model. We applied feature selection in our training set and save the model weka created. Now, we want to use the saved model to our [unlabeled] test set. However, our test set contains all the attributes we used in the UNFILTERED training set. How can we use the same feature selection used in the training to our test set in order to make the training and test sets compatible? By the way, we are using java for our prototype. Thank you for helping!

[Experimenter Advanced Mode] Cannot set the path of output files

farinadiceci — Sat, 18 May 2013 08:11:36 GMT

I do not know if this is a bug or a 'feature' (using Weka 3.7.9 under Mac OS X Lion) but under the advanced panels of the Experimenter window I'm not able to choose the path for the output files (both InstancesResultListener and ResultGenerator), when I try to select it it appears that a file chooser, not a directory chooser pops up and does not let me specify a path.

Here is a screenshot:
http://oi44.tinypic.com/99hs75.jpg

In the end the output paths remain the same and I get the error (the experimenter is interrupted as it starts)
/Users/splitEvalutorOut.zip (Permission denied)