Categories
Programming Tech

wparser – PhantomJS based website parser

At the moment, I’m working on final exam and my topic is called “Modeling relation between technical parameters of web page design and its aesthetics“.

For one part of that project, I’ve needed a parser which will automatically pull some data from received list of urls. For this purpose, I’ve wrote PhantomJS based website parser called simply wparser. I’ve published that parser on Github since I thought that someone else can also find it useful and that maybe I can also get some experience from the community.

Anyway, feel free to go check it, report me about bugs, send me pull requests, give me some tips or whatever else you want.

Categories
Programming Tech

Countries database table for MySQL


So today, I was buzzing around and searching for a `countries` table script that I could use in MySQL database. As you can imagine, it wouldn’t make any sense to add all world countries into database table one-by-one.

I’ve found few interesting things around there, but all of those solutions were not flexible and were created for individual projects – and when I say that, I mean that some of those tables have only two columns (like country code and country name), some of those have 3 columns, and some of those have bunch of columns (that are probably not useful to many developers).

Anyway, after checking some of those solutions I came to idea that I could make something on my own – something that will be flexible and customizable. And the result was GetCountries “program” where you can select which columns do you want, click “Get it!” and the program will fetch “fresh” results from Geonames API and will generate you a SQL script. After that you can copy/paste that script and eventually change column names.

Hope someone will find that useful.

GetCountries app | code @ Github