Curl采集乱码与采集不到PHP

内容导读

互联网集市收集整理的这篇技术教程文章主要介绍了Curl采集乱码与采集不到PHP，小编现在分享给大家，供广大互联网技能从业者学习和参考。文章包含5217字，纯文字阅读大概需要8分钟。

内容图文

回复讨论(解决方案)

网易限制了API采集不到。sohu也可能限制了。

用 fopen 或 file_get_content可以，但file_get_content容易出现超时就停止程序执行了。

别的不说,我就是来拿分的.楼主记得给全分

$curl=curl_init('http://www.163.com');curl_setopt($curl,CURLOPT_RETURNTRANSFER,1);curl_setopt($curl,CURLOPT_USERAGENT,'Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; SV1; .NET CLR 1.1.4322)');$html=curl_exec($curl);var_dump($html);$curl=curl_init('http://www.sohu.com');curl_setopt($curl,CURLOPT_RETURNTRANSFER,1);curl_setopt($curl,CURLOPT_USERAGENT,'Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; SV1; .NET CLR 1.1.4322)');$html=curl_exec($curl);//$html=strstr($html,'<');$html=gzdecode($html);var_dump($html);function gzdecode($data) {     $len = strlen($data);     if ($len < 18 || strcmp(substr($data,0,2),"\x1f\x8b")) {      return null;  // Not GZIP format (See RFC 1952)     }     $method = ord(substr($data,2,1));  // Compression method     $flags  = ord(substr($data,3,1));  // Flags     if ($flags & 31 != $flags) {      // Reserved bits are set -- NOT ALLOWED by RFC 1952      return null;     }     // NOTE: $mtime may be negative (PHP integer limitations)     $mtime = unpack("V", substr($data,4,4));     $mtime = $mtime[1];     $xfl  = substr($data,8,1);     $os    = substr($data,8,1);     $headerlen = 10;     $extralen  = 0;     $extra    = "";     if ($flags & 4) {      // 2-byte length prefixed EXTRA data in header      if ($len - $headerlen - 2 < 8) {        return false;    // Invalid format      }      $extralen = unpack("v",substr($data,8,2));      $extralen = $extralen[1];      if ($len - $headerlen - 2 - $extralen < 8) {        return false;    // Invalid format      }      $extra = substr($data,10,$extralen);      $headerlen += 2 + $extralen;     }       $filenamelen = 0;     $filename = "";     if ($flags & 8) {      // C-style string file NAME data in header      if ($len - $headerlen - 1 < 8) {        return false;    // Invalid format      }      $filenamelen = strpos(substr($data,8+$extralen),chr(0));      if ($filenamelen === false || $len - $headerlen - $filenamelen - 1 < 8) {        return false;    // Invalid format      }      $filename = substr($data,$headerlen,$filenamelen);      $headerlen += $filenamelen + 1;     }       $commentlen = 0;     $comment = "";     if ($flags & 16) {      // C-style string COMMENT data in header      if ($len - $headerlen - 1 < 8) {        return false;    // Invalid format      }      $commentlen = strpos(substr($data,8+$extralen+$filenamelen),chr(0));      if ($commentlen === false || $len - $headerlen - $commentlen - 1 < 8) {        return false;    // Invalid header format      }      $comment = substr($data,$headerlen,$commentlen);      $headerlen += $commentlen + 1;     }       $headercrc = "";     if ($flags & 1) {      // 2-bytes (lowest order) of CRC32 on header present      if ($len - $headerlen - 2 < 8) {        return false;    // Invalid format      }      $calccrc = crc32(substr($data,0,$headerlen)) & 0xffff;      $headercrc = unpack("v", substr($data,$headerlen,2));      $headercrc = $headercrc[1];      if ($headercrc != $calccrc) {        return false;    // Bad header CRC      }      $headerlen += 2;     }       // GZIP FOOTER - These be negative due to PHP's limitations     $datacrc = unpack("V",substr($data,-8,4));     $datacrc = $datacrc[1];     $isize = unpack("V",substr($data,-4));     $isize = $isize[1];       // Perform the decompression:     $bodylen = $len-$headerlen-8;     if ($bodylen < 1) {      // This should never happen - IMPLEMENTATION BUG!      return null;     }     $body = substr($data,$headerlen,$bodylen);     $data = "";     if ($bodylen > 0) {      switch ($method) {        case 8:          // Currently the only supported compression method:          $data = gzinflate($body);          break;        default:          // Unknown compression method          return false;      }     } else {      // I'm not sure if zero-byte body content is allowed.      // Allow it for now...  Do nothing...     }       // Verifiy decompressed size and CRC32:     // NOTE: This may fail with large data sizes depending on how     //      PHP's integer limitations affect strlen() since $isize     //      may be negative for large sizes.     if ($isize != strlen($data) || crc32($data) != $datacrc) {      // Bad format!  Length or CRC doesn't match!      return false;     }     return $data;   } 

非常感谢young5335，给全分，可惜就这么点分了，想多给都不行呀。

curl_setopt($ch, CURLOPT_USERAGENT,'Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; SV1; .NET CLR 1.1.4322)');

那么一大堆代码，这句最有用，也解决了问题

内容总结

以上是互联网集市为您收集整理的Curl采集乱码与采集不到PHP全部内容，希望文章能够帮你解决Curl采集乱码与采集不到PHP所遇到的程序开发问题。 如果觉得互联网集市技术教程内容还不错，欢迎将互联网集市网站推荐给程序员好友。

内容备注

版权声明：本文内容由互联网用户自发贡献，该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容， 请发送邮件至 gblab@vip.qq.com 举报，一经查实，本站将立刻删除。

内容手机端