python单线程爬虫code【代码】

广度优先算法：# -*- coding: utf-8 -*- import urllib import urllib.request from bs4 import BeautifulSoup import threading mylock = threading.RLock() class Crawler:unVisitUrl = set()visitedUrl = []def getHtml(self , url):html = ‘‘req = urllib.request.Request(url , headers = {‘Connection‘: ‘Keep-Alive‘,‘Accept‘: ‘text/html, application/xhtml+xml, */*‘,‘Accept-Language‘: ‘en-US,en;q=0.8,z...