1. Course ID: 215119
  2. Course Name: Web Scraping with Python (Python網頁擷取程式設計)
  3. Instructor: Dr. Quincy Wu
  4. Target Students: Postgraduates
  5. Upperlimit: 15 Students
  6. Credit: 3
  7. Time: Wednesday 14:30-17:20
  8. Place: Lib-028 (Tel:)
  9. Software:
    1. PuTTY 0.85,
    2. Anaconda3 (Windows 64-bit)
    3. EverCam (9.0) 僅需安裝於教師電腦
  10. Overview: This course teaches you web scraping and crawling techniques to access unlimited data from any web source in any format. With this practical guide, you’ll learn how to use Python scripts and web APIs to gather and process data from thousands--or even millions--of web pages at once. It is ideal for programmers, security professionals, and web administrators familiar with Python. This course not only teaches basic web scraping mechanics, but also delves into more advanced topics, such as analyzing raw data or using scrapers for frontend website testing.
  11. Evaluation:
  12. Textbook: Ryan Mitchell, "Web Scraping with Python: Data Extraction from the Modern Web", O'Reilly, 3rd Edition, March 2024. ISBN: 978-1098145354
    [Web Scraping]
  13. References:
  14. Outline:
    1. Python at a Glance
    2. BeautifulSoup - Your First Web Scrapper
    3. Advanced HTML Parsing
    4. Starting to Crawl
    5. Using APIs
    6. Storing Data
    7. Reading Documents
    8. Cleaning Your Dirty Data
    9. Reading and Writing Natural Languages
    10. Crawling Through Forms and Logins
    11. Scraping JavaScript
    12. Image Processing and Text Recognition
    13. Avoiding Scrapping Traps
      • Rejected:
      • [HW] http://www.nthu.edu.tw/periodical
    14. Testing Your Website with Scrapers
    15. Scraping Remotely
    16. Final Presentation
  15. 彈性教學 (Flexible Teaching): 以本學期課程為範圍,以二至三人為一組,參考網路資源,討論並完成期末專題(六小時) 。程式及簡報繳交期限在學期結束前一個月。
  16. Q & A

Hours Arrangement

Exercises

  1. 獎學金列表
  2. 高雄捷運
  3. YouBike
  4. 鄭愁予的詩
  5. Search All my HackMD

Related Links

  1. AI SEO (GEO) - Rank Higher in ChatGPT, Claude & Gemini (2026). (2h11m)