Home > Software engineering >  Best language for coding a web crawler/scraper
Best language for coding a web crawler/scraper

Time:02-10

I am currently a student and want to code a web scraper for different purposes. I was wondering what would be the best language to code one in, and was also looking into implementing a user interface for it.

Python

From what I have seen the best option is to use Python, but I am not experienced in programming a GUI for it and was wondering how I should go about that.

  1. What is the best way to implement a GUI for python on windows
  2. What API's would you recommend
  3. How is proxy support/multithreading with python (not experienced with it)

C# .NET

C , and C# are my preferred languages when it comes to multithreading so I was researching into them for web scraping and realized that python seemed to have more advantages.

  1. How is C# for web scraping
  2. Best way to implement a GUI on C#
  3. Best API's if I was to use C#

Other

There can be different languages and API's depending on how I decide to take this project, but for wanting to implementing a GUI, proxy support, and multi-threading support what would be the best way to start this off.

CodePudding user response:

  •  Tags:  
  • Related