June 17, 201115 yr Hi, I have developed a search system for my website, whereby I add each page automatically as an admin. It works via a database, storing Titles, URL etc... However I was wondering if it would be possible to expand this, and make it search the web. The way I want to do it is. Create a script or bot/crawlers, that auto scan websites and add the pages to my database. I am not sure if this is even possible, but just wanted to ask? Thanks
Create an account or sign in to comment