- Course ID: 215119
- Course Name: Web Scraping with Python (Python網頁擷取程式設計)
- Instructor: Dr. Quincy Wu
- Target Students: Postgraduates
- Upperlimit: 15 Students
- Credit: 3
- Time: Wednesday 14:30-17:20
- Place: Lib-028 (Tel:)
- Software:
- PuTTY
0.85,
- Anaconda3
(Windows 64-bit)
- EverCam
(9.0) 僅需安裝於教師電腦
- Overview: This course teaches you web scraping and crawling techniques
to access unlimited data from any web source in any format. With this
practical guide, you’ll learn how to use Python scripts and web APIs to
gather and process data from thousands--or even millions--of web pages at
once. It is ideal for programmers, security professionals, and web
administrators familiar with Python. This course not only teaches basic
web scraping mechanics, but also delves into more advanced topics, such
as analyzing raw data or using scrapers for frontend website testing.
- Evaluation:
- Participation (10%)
- Quiz (10%)
- Homework (10%)
- Midterm Exam (30%)
- Presentation (15%)
- Term Project (25%)
- Textbook:
Ryan Mitchell, "Web Scraping with Python: Data Extraction from the Modern Web",
O'Reilly, 3rd Edition, March 2024.
ISBN: 978-1098145354
- References:
- Outline:
- Python at a Glance
- BeautifulSoup - Your First Web Scrapper
- Advanced HTML Parsing
- Starting to Crawl
- Using APIs
- Storing Data
- Reading Documents
- Cleaning Your Dirty Data
- Reading and Writing Natural Languages
- Crawling Through Forms and Logins
- Scraping JavaScript
- Image Processing and Text Recognition
- Avoiding Scrapping Traps
- Rejected:
- [HW] http://www.nthu.edu.tw/periodical
- Testing Your Website with Scrapers
- Scraping Remotely
- Final Presentation
- 彈性教學 (Flexible Teaching): 以本學期課程為範圍,以二至三人為一組,參考網路資源,討論並完成期末專題(六小時) 。程式及簡報繳交期限在學期結束前一個月。
- Q & A
Hours Arrangement
- Problem statement and demonstration
- Tools introduction
- Design and hands-on trial
- Bonus: Your own problem
- Bonus: Easier (not necessarily more powerful) tools
Exercises
- 獎學金列表
- 高雄捷運
- YouBike
- 鄭愁予的詩
- Search All my HackMD
Related Links
- AI
SEO (GEO) - Rank Higher in ChatGPT, Claude & Gemini (2026).
(2h11m)