top of page

Fighting in the wrong weight class

  • Werner
  • Jul 17, 2019
  • 2 min read

My journey learning Python has been a truly fun and exciting learning experience.



I've been tinkering around, reading docs and asking questions (mostly on stackoverflow - Thank you Stackoverflow). With learning comes questions and curiosity. And with this, failure is most often than not also included.


I recently learned about web scraping with Python, and with this new found knowledge I set out to build a price comparison website. I started out, seemed to have the basic algorithm going for most sites that I wanted to scrape then came the question - "How do I put this online?" So I set out to learn a bit more web development.


With HTML and CSS sort of on the tool belt I started creating my website. With this came the question - "How do I add my Python to HTML?" - Short answer : You don't. It's dangerous. So I turned to Javascript


Learning Javascript lead to me JSON files, which through a random post on Stackoverflow lead me to Selenium again, which led to Python and Django again. This brought me full circle to nowhere with a bunch of knowledge. I was still determined (might I add, still am) to create this website.


Most websites are really against the scraping idea. And most websites in my country do not provide an API. So the workaround is to build a bot that slowly crawls the websites for the needed data. I think it would be best to do this late at night or early mornings. After that, I need to somehow figure out how to compare the data from different sites without having to manually add each different product - for a short moment I thought I had it with SKU's but not every website or every product has a SKU on its page.


After doing a lot of research I've decided to lay the project to rest. It is a good project to achieve, and one I would like to come back to one day. However for now, my knowledge pool is not big enough. For the time being I will attempt less complicated projects and build my skill until I can fight in the heavy-weights.


" I have not failed. I've just found 10,000 ways that won't work. "

~ Thomas A. Edison

 
 
 

Kommentit


© 2019 Plasticity of Me. Proudly created with Wix.com

This is me
AboutMe.jpg
I love learning and trying new things. This blog is all about me exploring the world around me and increasing my skills along the way.

Thanks for submitting!

All vector images created by freepik

  • Instagram
bottom of page