Curl采集乱码与采集不到PHP,该怎么处理

内容导读

互联网集市收集整理的这篇技术教程文章主要介绍了Curl采集乱码与采集不到PHP,该怎么处理，小编现在分享给大家，供广大互联网技能从业者学习和参考。文章包含4537字，纯文字阅读大概需要7分钟。

内容图文

PHP code

$curl=curl_init('http://www.163.com');
curl_setopt($curl,CURLOPT_RETURNTRANSFER,1);
curl_setopt($curl,CURLOPT_USERAGENT,'Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; SV1; .NET CLR 1.1.4322)');
$html=curl_exec($curl);
var_dump($html);


$curl=curl_init('http://www.sohu.com');
curl_setopt($curl,CURLOPT_RETURNTRANSFER,1);
curl_setopt($curl,CURLOPT_USERAGENT,'Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; SV1; .NET CLR 1.1.4322)');
$html=curl_exec($curl);
//$html=strstr($html,'<');
$html=gzdecode($html);
var_dump($html);


function gzdecode($data) {   
  $len = strlen($data);   
  if ($len < 18 || strcmp(substr($data,0,2),"\x1f\x8b")) {   
   return null;  // Not GZIP format (See RFC 1952)   
  }   
  $method = ord(substr($data,2,1));  // Compression method   
  $flags  = ord(substr($data,3,1));  // Flags   
  if ($flags & 31 != $flags) {   
   // Reserved bits are set -- NOT ALLOWED by RFC 1952   
   return null;   
  }   
  // NOTE: $mtime may be negative (PHP integer limitations)   
  $mtime = unpack("V", substr($data,4,4));   
  $mtime = $mtime[1];   
  $xfl  = substr($data,8,1);   
  $os    = substr($data,8,1);   
  $headerlen = 10;   
  $extralen  = 0;   
  $extra    = "";   
  if ($flags & 4) {   
   // 2-byte length prefixed EXTRA data in header   
   if ($len - $headerlen - 2 < 8) {   
     return false;    // Invalid format   
   }   
   $extralen = unpack("v",substr($data,8,2));   
   $extralen = $extralen[1];   
   if ($len - $headerlen - 2 - $extralen < 8) {   
     return false;    // Invalid format   
   }   
   $extra = substr($data,10,$extralen);   
   $headerlen += 2 + $extralen;   
  }   
  
  $filenamelen = 0;   
  $filename = "";   
  if ($flags & 8) {   
   // C-style string file NAME data in header   
   if ($len - $headerlen - 1 < 8) {   
     return false;    // Invalid format   
   }   
   $filenamelen = strpos(substr($data,8+$extralen),chr(0));   
   if ($filenamelen === false || $len - $headerlen - $filenamelen - 1 < 8) {   
     return false;    // Invalid format   
   }   
   $filename = substr($data,$headerlen,$filenamelen);   
   $headerlen += $filenamelen + 1;   
  }   
  
  $commentlen = 0;   
  $comment = "";   
  if ($flags & 16) {   
   // C-style string COMMENT data in header   
   if ($len - $headerlen - 1 < 8) {   
     return false;    // Invalid format   
   }   
   $commentlen = strpos(substr($data,8+$extralen+$filenamelen),chr(0));   
   if ($commentlen === false || $len - $headerlen - $commentlen - 1 < 8) {   
     return false;    // Invalid header format   
   }   
   $comment = substr($data,$headerlen,$commentlen);   
   $headerlen += $commentlen + 1;   
  }   
  
  $headercrc = "";   
  if ($flags & 1) {   
   // 2-bytes (lowest order) of CRC32 on header present   
   if ($len - $headerlen - 2 < 8) {   
     return false;    // Invalid format   
   }   
   $calccrc = crc32(substr($data,0,$headerlen)) & 0xffff;   
   $headercrc = unpack("v", substr($data,$headerlen,2));   
   $headercrc = $headercrc[1];   
   if ($headercrc != $calccrc) {   
     return false;    // Bad header CRC   
   }   
   $headerlen += 2;   
  }   
  
  // GZIP FOOTER - These be negative due to PHP's limitations   
  $datacrc = unpack("V",substr($data,-8,4));   
  $datacrc = $datacrc[1];   
  $isize = unpack("V",substr($data,-4));   
  $isize = $isize[1];   
  
  // Perform the decompression:   
  $bodylen = $len-$headerlen-8;   
  if ($bodylen < 1) {   
   // This should never happen - IMPLEMENTATION BUG!   
   return null;   
  }   
  $body = substr($data,$headerlen,$bodylen);   
  $data = "";   
  if ($bodylen > 0) {   
   switch ($method) {   
     case 8:   
       // Currently the only supported compression method:   
       $data = gzinflate($body);   
       break;   
     default:   
       // Unknown compression method   
       return false;   
   }   
  } else {   
   // I'm not sure if zero-byte body content is allowed.   
   // Allow it for now...  Do nothing...   
  }   
  
  // Verifiy decompressed size and CRC32:   
  // NOTE: This may fail with large data sizes depending on how   
  //      PHP's integer limitations affect strlen() since $isize   
  //      may be negative for large sizes.   
  if ($isize != strlen($data) || crc32($data) != $datacrc) {   
   // Bad format!  Length or CRC doesn't match!   
   return false;   
  }   
  return $data;   
} 


           
                
                                                

内容总结

以上是互联网集市为您收集整理的Curl采集乱码与采集不到PHP,该怎么处理全部内容，希望文章能够帮你解决Curl采集乱码与采集不到PHP,该怎么处理所遇到的程序开发问题。 如果觉得互联网集市技术教程内容还不错，欢迎将互联网集市网站推荐给程序员好友。

内容备注

版权声明：本文内容由互联网用户自发贡献，该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容， 请发送邮件至 gblab@vip.qq.com 举报，一经查实，本站将立刻删除。

内容手机端