| View previous topic :: View next topic |
| Author |
Message |
admin
Site Admin
Joined: 01 Jan 1970
Posts: 582
Location: Somewhere on planet Earth ....
|
 Posted: Mon Aug 13, 2007 6:47 pm Post subject: DMOZ spider for Windows XP - download |
 |
|
Minimum requirements: Windows XP, VB6 runtimes, ADP (any version)
License: Freeware
Description: Scans www.DMOZ.org in real time (not RDF dumps), and prepares MySQL INSERT queries for ADP database.
Download: http://www.astanda.com/download/dmoz.exe (96Kb)
Sample output:
| Code: |
INSERT INTO `links` (`url`, `title`, `description`, `category_id`) VALUES ('http://www.hobbystar.com/ComicConToronto2006/CC_Main.asp', 'Canadian National Comic Book Expo', 'Yearly convention in Toronto, held in the summer. Includes information on guests and events plus a review of earlier events.', '9');
INSERT INTO `links` (`url`, `title`, `description`, `category_id`) VALUES ('http://www.comicbookconventions.com', 'Comic Book Conventions.com', 'A site that maintains a comprehensive calendar of upcoming comic book conventions as well as other resources for fans and pros alike.', '9');
INSERT INTO `links` (`url`, `title`, `description`, `category_id`) VALUES ('http://www.comic-con.org/', 'Comic Con International', 'Runs San Diego Comic-Con, WonderCon and Alternative Press Expo in San Francisco. Includes information on events, exhibits, guests and archives of past events.', '9');
INSERT INTO `links` (`url`, `title`, `description`, `category_id`) VALUES ('http://www.comicon.com', 'Comicon.com', 'An online comic convention. Many publishers and creators are represented here. Auctions, discussion forums, exclusive comic strips, an art gallery, and the Splash newspage.', '9');
|
P.S. I needed a slightly faster spider to pick up links from DMOZ, so this tool was born. To use, set the minimum Google PR for your links, ADP category ID, and full URL of DMOZ category you want to scan. When you're finished, simply copy/paste MySQL queries into your phpMyAdmin query window.... not that hard at all.
[EDIT: 18-08-2007]
While scanning for hundreds of thousands of links I was getting a bit low on RAM since the above tool was not automatically saving output. Here's the update:
Download: http://www.astanda.com/download/dmoz2.exe (96Kb)
Enjoy! 
_________________
Best regards,
Pavel Golovko
---------------------------
Help me help you. I'm not a God, and can not read your mind. If you got a problem, then please describe it well.
Last edited by admin on Wed May 27, 2009 2:54 pm; edited 3 times in total |
|
| Back to top |
|
 |
swagger
Corporal
Joined: 09 May 2007
Posts: 20
|
|
| Back to top |
|
|
admin
Site Admin
Joined: 01 Jan 1970
Posts: 582
Location: Somewhere on planet Earth ....
|
| Posted: Mon Aug 13, 2007 11:44 pm Post subject: |
|
|
Yep, there was no error handler when incorrect PR checksum was calculated. I've just uploaded the updated version.
_________________
Best regards,
Pavel Golovko
---------------------------
Help me help you. I'm not a God, and can not read your mind. If you got a problem, then please describe it well. |
|
| Back to top |
|
|
swagger
Corporal
Joined: 09 May 2007
Posts: 20
|
| Posted: Tue Aug 14, 2007 2:37 am Post subject: |
|
|
Works great! The only thing I'm changing in the SQL is adding the date to the insert statement, by using the find/replace feature of my text editor.
Thanks!! 
_________________
Astronomicals Directory of Astronomy Sites
http://www.astronomicals.com/
Amusing emails my mom has sent me over the years
http://www.mailfrommom.com/
 |
|
| Back to top |
|
|
admin
Site Admin
Joined: 01 Jan 1970
Posts: 582
Location: Somewhere on planet Earth ....
|
| Posted: Tue Aug 14, 2007 6:18 am Post subject: |
|
|
Eh, fixed more bugs, and reuploaded newer version. 
_________________
Best regards,
Pavel Golovko
---------------------------
Help me help you. I'm not a God, and can not read your mind. If you got a problem, then please describe it well. |
|
| Back to top |
|
|
newbiz
Corporal
Joined: 25 Sep 2007
Posts: 25
|
| Posted: Wed Sep 26, 2007 7:16 pm Post subject: |
|
|
Hi
how to import the dmoz result txt file to ADP 1.3b or to php My Admin .
Tnx , |
|
| Back to top |
|
|
admin
Site Admin
Joined: 01 Jan 1970
Posts: 582
Location: Somewhere on planet Earth ....
|
| Posted: Thu Sep 27, 2007 12:15 am Post subject: |
|
|
Either copy/paste the contents of that file into the "query" window of phpMyAdmin, or use "import" feature from the same phpMyAdmin.
_________________
Best regards,
Pavel Golovko
---------------------------
Help me help you. I'm not a God, and can not read your mind. If you got a problem, then please describe it well. |
|
| Back to top |
|
|
newbiz
Corporal
Joined: 25 Sep 2007
Posts: 25
|
| Posted: Thu Sep 27, 2007 6:53 am Post subject: |
|
|
TNX ,
I Import the file from Php MY Admin , links added
but there is a problem :
when i import the ART SQL from the import all of link automatically went in health directory !
i don't know how to import Art SQL in ART Directory and Health SQL in Health Directory and...
how to import category from DMOZ , in this test just links added .
Regards , |
|
| Back to top |
|
|
newbiz
Corporal
Joined: 25 Sep 2007
Posts: 25
|
| Posted: Thu Sep 27, 2007 8:20 am Post subject: |
|
|
I FOUND THE ANSWER .
Just change the CAT ID !
ADP is very good for SEO ,
TNX ADMIN  |
|
| Back to top |
|
|
newbiz
Corporal
Joined: 25 Sep 2007
Posts: 25
|
| Posted: Thu Sep 27, 2007 9:53 pm Post subject: |
|
|
Hi again 
how to import category ?scratch:
when we use this program just links will add 
TNX |
|
| Back to top |
|
|
admin
Site Admin
Joined: 01 Jan 1970
Posts: 582
Location: Somewhere on planet Earth ....
|
| Posted: Fri Sep 28, 2007 2:33 am Post subject: |
|
|
Yep, only links import for now. See if this page helps you with category import: http://rdf.dmoz.org/
_________________
Best regards,
Pavel Golovko
---------------------------
Help me help you. I'm not a God, and can not read your mind. If you got a problem, then please describe it well. |
|
| Back to top |
|
|
strak
Rookie
Joined: 13 Oct 2007
Posts: 4
|
| Posted: Sat Oct 13, 2007 2:54 pm Post subject: |
|
|
Hello Astanda
I get the following error when running dmoz2.exe
Component 'MSHFLXGD.OCS'or one of its dependencies noet correctly registered: a file is missing or invalid
maybe do you know what could be the problem ?
thanks |
|
| Back to top |
|
|
newbiz
Corporal
Joined: 25 Sep 2007
Posts: 25
|
| Posted: Sat Oct 13, 2007 6:58 pm Post subject: |
|
|
| strak wrote: | Hello Astanda
I get the following error when running dmoz2.exe
Component 'MSHFLXGD.OCS'or one of its dependencies noet correctly registered: a file is missing or invalid
maybe do you know what could be the problem ?
thanks |
hi
you should Search ( download MSHFLXGD.OCS ) and download this file .
_________________
http://7xlink.com |
|
| Back to top |
|
|
strak
Rookie
Joined: 13 Oct 2007
Posts: 4
|
| Posted: Sat Oct 13, 2007 8:17 pm Post subject: |
|
|
I searched, but did not find. because I typed the error message wrongly.
it should have been .OCX
ok so now the program starts, and after scanning a category, I click MySQL Inserts, but I don't see an option to export the txt file. shouldn't there be a submit button or something? thanks |
|
| Back to top |
|
|
newbiz
Corporal
Joined: 25 Sep 2007
Posts: 25
|
| Posted: Sun Oct 14, 2007 7:59 am Post subject: |
|
|
| strak wrote: |
ok so now the program starts, and after scanning a category, I click MySQL Inserts, but I don't see an option to export the txt file. shouldn't there be a submit button or something? thanks |
You must first edit Category ID and MIN PR
then import this txt file in PhpMyAdmin .
_________________
http://7xlink.com |
|
| Back to top |
|
|
|
FAQ
Search
Memberlist
Usergroups
Register
Profile
Log in to check your private messages
Log in
