PDA

View Full Version : Scalable caching in Mondrian



jhyde
02-04-2011, 05:40 PM
Wouldn't it be great if Mondrian (http://mondrian.pentaho.org/)'s cache could be shared between several Mondrian instances, use memory outside the JVM or even across several machines, and scale as the data size or computation effort increases? That is the vision of Pentaho's "enterprise cache" initiative.

http://1.bp.blogspot.com/_qNJXxQcuKDM/TUtk3p9so8I/AAAAAAAAAEI/lHcS8yzIq0k/s400/MondrianSegmentCacheSPI.png (http://1.bp.blogspot.com/_qNJXxQcuKDM/TUtk3p9so8I/AAAAAAAAAEI/lHcS8yzIq0k/s400/MondrianSegmentCacheSPI.png)Mondrian cell-caching architecture, including pluggable external cache.
Luc Boudreau has been leading this effort, has just checked in the first revision of the new mondrian.rolap.agg.SegmentCache (http://mondrian.pentaho.com/headapi/mondrian/rolap/agg/SegmentCache.html) interface, and has written a blog post describing how it will work (http://devdonkey.blogspot.com/2011/02/mondrian-spi-segmentcache.html). (Note: This SPI (http://en.wikipedia.org/wiki/Service_provider_interface) is likely to change before we release it.)

Pluggable caching will be in Mondrian release 3.3, probably Q2 or Q3 this year.In the community edition will be the SPI and a default implementation that uses JVM memory. Of course the community will be able to contribute alternative implementations. In the enterprise edition of Mondrian 3.3, there will be scalable, highly manageable implementation based on something like Terracotta BigMemory (http://www.terracotta.org/bigmemory), ehCache (http://ehcache.org/) or JBoss Infinispan (http://www.jboss.org/infinispan).

In future releases, you can expect to see further work in the area. Maybe alternative implementations of the caching SPI, and certainly tuning of Mondrian's caching and evaluation strategies, as we apply Mondrian to some of the biggest data sets out there.https://blogger.googleusercontent.com/tracker/5672165237896126100-4134355498819032849?l=julianhyde.blogspot.com


More... (http://julianhyde.blogspot.com/2011/02/scalable-caching-in-mondrian.html)