Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Sign In Apply for Membership

Categories

Tagged

Mailing list users (luciddb-users) can "claim" their threads in the archives by registering with the same account they used to post to the email list. NOTE: List threads are updated once every 24hrs.
Roadmap for Luciddb?
  • kimberlad June 2012

    As stated I've been using Luciddb for a while and like it. Its easy to install, manage, relatively quick and easy to extend. So I thought I'd jot down a few things I would like to on the Roadmap when its published

    • Publish a Roadmap :-). Would be nice to see what direction Luciddb is moving in
    • Shared Nothing Scale out. I know SMP boxes are back in, but cloud deployment is the way forward and this works best with in a distributed MPP model as you generally have to work in preallocated units of CPU and memory, plus these units can be spun up and own on demand, a big SMP machine is either up or down no mater how much it is utilized you paying for all of it . I know manual partitioning and views can achieve this to a degree but its fiddly and increases
    • Performnace; Keep pushing the boundaries

    • Indexes; Ideally make them automatic behind the scenes and non intrusive 
      • Current blocks connections which is a big issue if used in Cloud delivery to third party customers
      • Use COODB techniques to optimize aggregation i.e. count (1) calculated at data insert time

    • Make Statistics generation for optimizer automatic i.e. Vertica etc 
    • Ad predictive analytic's integration
      • MADLIB,  R etc

    • More General purpose functions
      • TIMESTAMP conversion function not implemented

    • Get Documentation updated. Its pretty good, but keep going
    • MS Excel/PowerPivot Integration. MS Excel 2007/2010 pivot tables  is still the most accessible OLAP client available and with Powerpivot is scales now.
    • Make connectors intelligent i.e. Filtering and Caching. For example be able to pass a  filter through to couchdb etc
    • Integrate with Hadoop in a Similar way to HadoopDB/Hapdat
    • Consider moving to Apache and interacting with other Apache projects such as Hadoop, Cassandra and couchdb. This would potentially drive greater exposure and adoption. The Analytics field is crying out for a good open source OLAP engine that is not hamstrung by a vendor.

    Hope this helps and good luck.

    Mike

  • nagoodmannagoodman June 2012
    Well, we're not doing all that much core development as you've probably noted (from our lack of current roadmap/source commits).  We'd love to get LucidDB some life as an Apache project and would fully support such a move; it's a challenge though.  LucidDB is a very complicated project (build, test, development) and is very difficult for new developers (takes 90-180 days for a new developer to become productive) which is hard for a new project at Apache. 

    I think all your other suggestions are great - many of which we've considered at some point.  Out of the list above, I'd at least identify a couple that could easily be taken on by any members in the community without having to dive WAY deep into the full LucidDB development.

    "More Intelligent Connectors"
    This is actually already available.  For instance the Salesforce connector has a pluggable query rewrite rule that pushes down WHERE (and > < etc) to Salesforce Query Language from SQL.  So, if someone wanted to push down some (more limited than SFQL) optimizations to CouchDB they could do something with the connector similar: https://github.com/dynamobi/luciddb/blob/master/extensions/conn/sfdc/src/net/sf/farrago/namespace/sfdc/SfdcPushDownRule.java

    "Timestamp Functions"
    Many of the TIMESTAMP applib functions were actually contributed by a community member.  General APPLIB functions are relatively easy / contained to build for most Java programmers.
    https://github.com/dynamobi/luciddb/blob/master/extensions/applib/src/org/eigenbase/applib/contrib/TimestampUtilUdf.java
    and
    https://github.com/dynamobi/luciddb/blob/master/luciddb/test/sql/udr/udf/timestamp_util.ref

    Thanks again for you feedback and glad to have you part of the LucidDB community!
  • kimberlad July 2012
    "Well, we're not doing all that much core development as you've probably noted (from our lack of current roadmap/source commits)"; What is the current focus for development at the moment?
  • nagoodmannagoodman July 2012
    Kimberlad - Mostly directed by customer requests (sponsored development, bug fixes, etc).  We have a TODO list 10 miles long, but not enough developer power to work on anything but the utmost importance items (critical bugs and customer requested tasks/features).
  • kimberlad July 2012
    Ah, well glad to here your very busy

    Thanks

    Mike
Add a Comment