Web scraping Sports website
I am working on a web scraping project that has me using Playwright and Beautiful Soup. This exercise is part of a larger data project where I will build a databases consisting of player and fantasy stats to build interactive dashboards when it comes to fantasy matchups. A fun use for stats.
Why am I building this?
A fun way to build up my portfolio. Also, it will be fun to share with my personal fantasy leagues and get immediate feedback from a brutally honest group of individuals.
How did I do this?
I used a combination of Python and Javascript to interact with webpages and pull data from sports websites. Specifically, I have pulled player stats and their week to week performance. I created a previous version that just scraped overall season stats. While overall season stats are important, I wanted to track trends and believe week to week gamelog stats to track performance throughout the season.
What is next?
I need to find a minimal viable product (MVP) to publish this project. I believe a MVP includes week to week stats (Check!). Next, I need to find rosters of different fantasy football teams within my league. Also, I need to find scoring rules of the fantasy league. I will go off stats in some cases but at the end of the day points are important in fantasy.
Wishes:
1. Pull week to weekly fantasy matchups and weekly rosters. (Rosters can change week to week)
2. Pull overall stats for Passing, Receiving, Rushing.
3. Track historical trades made throughout the fantasy season.