3 comments

Dimitar

Could you expand a bit more about how the “so great performance” alleviates the need for transactions?

Are we talking about cluster-durable vs. database-durable?

04/02/08 @ 16:58
Comment from:

I just finished speaking to John about this. Here’s the basics. In a clustered environment, write the transactions as an XML blob to memory, using something like GigaSpaces and index it with something like MAPS. When necessary, convenient, practical, or whatever other criteria makes sense for you, persist the XML Blob by writing to disk. The banks are using openSolaris, so the file system is ZFS, which branches changes much like subversion, thus keeping an history of any changes and ensuring that the history is maintained. By cutting out the database and the huge overhead of the ORM layer, the performance increase is amazing. This is very broad brush. You can get more details by John Davies and sorting through the 137,000 results. ;-)

04/02/08 @ 17:44
John Davies

In answer to the question above, it’s quite complex but in essence because we get such high performance from in-memory “databases", we can start to serialise many of the transactions. Things that used to take 20 minutes now take a second or two and can usually be serialised. Transactions are not alleviated all together but we can vastly reduce the number of transactions and the impact of them on the data, this helps to further increase performance.

-John-

04/03/08 @ 12:10
October 2018
Mon Tue Wed Thu Fri Sat Sun
1 2 3 4 5 6 7
8 9 10 11 12 13 14
15 16 17 18 19 20 21
22 23 24 25 26 27 28
29 30 31        
 << <   > >>

At the beginning, The Open Source Solutions Blog was a companion to the Open Source Solutions for Business Intelligence Research Project, and book. But back in 2005, we couldn't find a publisher. As Apache Hadoop and its family of open source projects proliferated, and in many ways, took over the OSS data management and analytics world, our interests became more focused on streaming data management and analytics for IoT, the architecture for people, processes and technology required to bring value from the IoT through Sensor Analytics Ecosystems, and the maturity model organizations will need to follow to achieve SAEIoT success. OSS is very important in this world too, for DMA, API and community development.

37.652951177164 -122.490877706959

Search

  XML Feeds

mindmaps

Our current thinking on sensor analytics ecosystems (SAE) bringing together critical solution spaces best addressed by Internet of Things (IoT) and advances in Data Management and Analytics (DMA) is here.

Recent Posts

Community CMS