December 27, 2008 – 3:58 pm
Distributed Indexing Framework v 1.0
Distributed Indexing Framework in Codeplex >
As worker in Semantic Wen, Web Search Engine I found myself need a Web Indexing Framework easy to use and have some important properties like: Distributed, Reliable, Scalable.
Then I start work in my Framework, and now I release the first stable version and it's open source. I make it open source because I believe in knowledge sharing, and I think there are many persons need something like that.
Before I start speak about it I would like to describe the my important properties:
Distributed:
This Indexing System should Distributed into Threads, Process, and machines to work fast, and in cooperative mode. This will make indexing 1 M page for example more effective.
Reliable:
But what if the system fail, power down, etc what will happen. The Reliable property is very important to me. I imagine the Indexing system should continue the work from the same point ...
Posted in Research, Software Development | 3 Comments »