Search Engine

[BlaZe]

Well, I have some questions regarding the search engine I'm making

Should I use Google Custom Search Engine ? or should I use Sphider Search Engine ?

Why Google :
It puts almost NO Load on your server.
It is very user friendly.
Customizations are limited.
You do not have proper control over which part should be indexed.
No database required.

Why Sphider :
It puts somewhat load on your server.
You can super control on the indexing, sitemaps, link adding etc.
Easily Customizable.
Database is required.

A small beta testing of sphider

Sites:1
Links: 79
Categories: 0
Keywords: 4405
Keyword-link realations: 19699
Cached texts total: 512.72 kb
Sites size total: 2,218.10 kb

And GCSE uses none of the server resources

But, I found that Sphider gives more relevant results rather than GCSE

So please suggest as which one to use

Sphider | GSCE

(If you cannot open it, then use a proxy as NS might not be propagated)

BlaZe Reviewed by BlaZe on 26th Mar 2010. Search Engine Well, I have some questions regarding the search engine I'm making Should I use Google Custom Search Engine ? or should I use Sphider Search Engine ? Why Google : It puts almost NO Load on your server. It is very user friendly. Customizations are limited. You do not have proper control over which part should be indexed. No database required. Rating: 5

[NucleA]

Dude, why are you making a search engine..

Google search suggestion is Ajax Based. After a letter/character is typed in the search textbox, Ajax connect to google database, get the suggestions and refresh the suggestion frame.

Google does this for each letter you type.

If you suppose
someone write 20 characters = 20 X connect to db, get suggestion and refresh frame.
if there are 1000 users online, = 20 000 X '' "

Meaning your server ram will have to handle 20 000 instuctions.

Noto nly that, you will need some thousands of bots to crawl all these websites on the net!

Google has over 3K servers and 7-8 data centers they can afford such a thing..

What i mean is that, you will fail..Don't mind my words..Peace!

[BlaZe]

Actually, I'll fail if I use Sphider Search Engine
I'll use Google's CSE to index and provide results.
It'll be just more proper & accurate ones with the unnecessary content being filtered