User login
More IO related stuff in Tango
Another two announcements have been made the last couple of days on new and coming features for Tango. The second, Tango compute grid, is for setting up highly efficient clustered solutions, complete with remote execution, caching and queuing. The extremely low memory footprint of a running server shows just how much we in the Tango team (and Kris in particular) cares about minimizing heap usage. While testing the task server on my laptop, having a throughput of 25-30k calls per second, the process were at the bottom of the memory using statistics.
The other announcement made was about Tango VFS, virtual file systems. A VFS is an abstraction of typical file system operations, like reading, writing and listing. The main point is to be able to mount different types of resources/folders into a VFS, and access the data through a common interface, and letting the implementation handle the specifics related to transfer from remote resources, transformation of compressed or encrypted data, etc.
In theory all kinds of data sources can be mounted given the proper adapter exists, but hierarchical data that can be queried via paths, lend itself particularly well to this solution.
That each mountable folder type can be used independently from the VFS, should make it easier to operate on collections like a local folder of files, instead of necessarily go via each path. Hopefully an additional bonus.
I expect to start committing VFS code at some point after the next release, but if you have questions/suggestions before that, don't hesitate to ask.
Whereas we hope to support various compression algorithms natively in Tango via conduit filters, I expect that the initial Zip adapter, and possibly others, to wrap a C library or two (zlib and/or similar) until the native support is ready. Some adapters on top of C libraries may still be useful after that, given that there will be protocols/data representations that may not make much sense of having natively in D/Tango. Some adapters may be mainly for testing purposes, btw, and as such may be unlikely to be supported and/or released at all (at least through the packaging).
Technorati Tags: