ruby抓取URL内容并解析页面所有URL
http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtdhttp://www.w3.org/1999/xhtmlhttp://www.google.com.hk/search?hl=zh-CN&q=%E7%94%B5%E5%BD%B1&btnG=Google+%E6%90%9C%E7%B4%A2&meta=&aq=f&oq=&client=aff-avalanchehttp://google.com.hk/webhp?hl=zh-cn&tab=Awhttp://www.google.cn/imghp?hl=zh-cn&tab=Aihttp://video.google.cn/?hl=zh-cn&tab=Avhttp://ditu.google.cn/maps?hl=zh-cn&tab=Alhttp://news.google.cn/nwshp?hl=zh-cn&tab=Anhttp://www.google.cn/music?hl=zh-cn&tab=AUhttp://www.google.cn/prdhp?hl=zh-cn&tab=Afhttp://www.google.com.hk/intl/zh-CN/options/http://www.google.cn/music?client=aff-avalanche&channel=textlinkhttp://www.265.com/images/googlemusic.gifhttp://www.google.cn/search?hl=zh-CN&client=aff-avalanche&forid=1&channel=logo&q=http://www.google.com.hk/search?hl=zh-CN&q=http://www.365rili.com/http://www.boc.cn/cn/common/whpj.htmlhttp://www.google.com.hk/finance?client=aff-a&hl=zh-CNhttp://jipiao.kuxun.cn/?fromid=Kgbw-S1134381-T1137511http://huoche.kuxun.cn/?fromid=Kgbw-S1134381-T1076521http://www.lottery.gov.cn/http://www.zhcw.com/http://www.google.com.hk/search?hl=zh-CN&q=%E7%94%B5%E5%BD%B1&btnG=Google+%E6%90%9C%E7%B4%A2&meta=&aq=f&oq=&client=aff-avalanchehttp://www.google.com.hk/dictionaryhttp://www.google.com.hk/intl/zh-CN/help/features.htmlhttp://www.google.com.hk/intl/zh-CN/mobile/maps/http://www.chashouji.com/http://product.cheshi.com/price.htmlhttp://fund.eastmoney.com/fund.htmlhttp://www.google.com.hk/search?hl=zh-CN&q=http://www.google.com.hk/search?hl=zh-CN&q=http://download.tech.qq.com/soft/17/21/index.shtmlhttp://www.google.com.hk/search?hl=zh-CN&newwindow=1&safe=strict&q=%E8%B0%B7%E6%AD%8C%E9%87%91%E5%B1%B1%E8%AF%8D%E9%9C%B8&aq=f&aqi=&aql=&oq=&gs_rfai=http://www.uusee.tv/http://earth.google.com/intl/zh-CN/http://www.360.cnhttp://www.kuaikuai.cn/h/down/kk_game/?channel=57_1http://www.flashget.com/cn/download.htmhttp://www.ppstream.com/download.htmlhttp://pstatic.xunlei.com/about/product/down_xl5.htmhttp://www.google.com/ime/pinyin/http://toolbar.google.com/T4/intl/zh-CN/http://www.kuwo.cn/http://www.rising.com.cn/http://www.maxthon.cn/http://www.stockstar.com/cfghttp://www.QVOD.comhttp://feixin.10086.cn/download/http://www.gw.com.cn/download/level1/index.htmhttp://www.google.com.hk/search?q=%E6%9A%B4%E9%A3%8E%E5%BD%B1%E9%9F%B33.6+%E6%99%BA%E8%83%BD%E9%AB%98%E6%B8%85%E7%89%88&hl=zh-CN&source=billboard_site&cd=12200098&cad=5&ie=utf8http://www.google.com/chrome?hl=zh-cnhttp://www.mosh.cn/beijinghttp://www.wooha.com/?WT.mc_id=new265http://www.qunar.com/http://www.abang.com/http://www.yihaodian.com/product/index.do?tracker_type=9&tracker_u=1949358http://www.izhufu.com/http://www.docin.comhttp://bai.sohu.comhttp://www.daodao.com/?m=12347http://www.gong1chuang1.comhttp://www.mpdaogou.com/http://www.aibaimm.cn/http://www.bankrate.com.cn/http://www.5925car.com/http://www.miui.com/http://www.trends.com.cn/http://www.m18.com/http://www.0-6.com/http://www.chilema.cn/default.aspxhttp://www.51mike.com/http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#609http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#352http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#1134http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#1371http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#963http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#1372http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#1373http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#1437http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#1374http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#355http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#1438http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#957http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#1417http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#1376http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#958http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#1378http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#1135http://www.265.com/Youxi_Wangyou/Remen_Youxizhuanti_All.html#1377http://www.265.com/Youxi_Wangyou/index.html#196http://www.265.com/Youxi_Wangyou/index.html#195http://www.google.com.hk/webhp?client=aff-avalanchehttp://www.baidu.com/http://www.qq.com/http://www.163.com/http://cn.msn.com/http://www.tom.com/http://www.china.com/http://www.sina.com.cn/http://www.sohu.com/http://cn.yahoo.com/http://www.51job.com/http://www.renren.com/http://www.mop.com/http://www.chinamobile.com/http://www.ifeng.com/http://www.eastmoney.com/http://www.people.com.cn/http://www.xinhuanet.com/http://www.ctrip.com/http://www.360.cn/http://www.soufun.com/http://www.cctv.com/http://www.zaobao.com/http://www.xunlei.com/http://58.com/http://www.icbc.com.cn/http://www.kaixin001.com/http://www.4399.com/http://www.jrj.com.cn/http://www.hexun.com/http://www.gov.cn/http://china.alibaba.com/?cosite=265dh&location=alihomepage_dhhttp://www.taobao.com/http://www.zol.com.cnhttp://www.zhcw.com/http://www.autohome.com.cn/http://www.youku.comhttp://www.tudou.com/http://www.jiayuan.com/http://www.dangdang.com/http://www.tianya.cn/http://www.51.com/?fromsite=265_1http://news.google.com.hk/news/search?pz=1&cf=all&ned=cn&hl=zh-CN&q=%E6%B2%BB%E5%A0%B5&source=265.com',http://news.google.com.hk/news/more?pz=1&cf=all&ned=cn&cf=all&ncl=dVZ221HiynUgGMMdPA7YVmSj8eZRM&source=265.com',http://news.google.com.hk/news/more?pz=1&cf=all&ned=cn&cf=all&ncl=dlDTKEYmgUS-GKMcA1iendnuqffNM&source=265.com',http://blogsearch.google.com.hk/blogsearch/story?hl=zh-cn&num=10&topic=e&bcid=1651226638&bc_lang=zh-CN&source=265.com',http://blogsearch.google.com.hk/blogsearch/story?hl=zh-cn&topic=fe&bcid=1651764651&bc_lang=zh-CN&source=265.com',http://blogsearch.google.com.hk/blogsearch/story?hl=zh-cn&num=10&topic=fe&bcid=1651435361&bc_lang=zh-CN&source=265.com',http://blogsearch.google.com.hk/blogsearch/story?hl=zh-cn&num=10&topic=fe&bcid=1650340552&bc_lang=zh-CN&source=265.com',http://blogsearch.google.com.hk/blogsearch/story?hl=zh-cn&num=10&topic=fe&bcid=1651458816&bc_lang=zh-CN&source=265.com',http://blogsearch.google.com.hk/blogsearch/story?hl=zh-cn&topic=l&bcid=1651766213&bc_lang=zh-CN&source=265.com',http://news.google.com.hk/news/more?pz=1&cf=all&ned=cn&cf=all&ncl=dZkub0JsW0461gMDeDdtdN4qp-pMM&source=265.com',http://news.google.com.hk/news/search?pz=1&cf=all&ned=cn&hl=zh-CN&q=%E5%85%AC%E5%8A%A1%E5%91%98%E5%B7%A5%E8%B5%84&source=265.com',http://news.google.com.hk/news/more?pz=1&cf=all&ned=cn&cf=all&ncl=dQhOS-yAc2hsqbMejJ2S82D9XA0CM&source=265.com',http://news.google.com.hk/news/search?pz=1&cf=all&ned=cn&hl=zh-CN&q=%E5%BC%A0%E9%9B%A8%E7%BB%AE&source=265.com',http://www.17173.comhttp://games.sina.com.cn/http://www.duowan.com/http://game.zol.com.cnhttp://tl.sohu.com/http://aion.sdo.com/project/index/index.htmhttp://t.mop.comhttp://www.onlinedown.net/http://www.skycn.com/http://www.crsky.comhttp://xiazai.zol.com.cnhttp://tech.sina.com.cn/down/http://www.mydown.com/http://www.qidian.com/http://www.readnovel.com/http://www.xxsy.net/http://www.hongxiu.com/http://www.jjwxc.net/http://book.sina.com.cn/http://www.xs8.cn/http://military.china.com/zh_cn/http://mil.news.sina.com.cn/http://www.tiexue.net/http://mil.huanqiu.com/http://www.xinhuanet.com/mil/http://junshi.xilu.com/http://sports.sina.com.cn/http://sports.sohu.com/http://sports.163.com/http://sports.tom.com/http://china.nba.com/http://www.hoopchina.com/http://www.zhibo8.com/http://www.google.cn/music/homepage?client=aff-avalanchehttp://www.1ting.com/http://www.haoting.com/http://www.qq163.com/http://www.aiting.comhttp://www.520music.com/http://youku.comhttp://tudou.comhttp://www.ku6.com/http://www.6.cnhttp://www.joy.cn/http://video.sina.com.cn/http://tv.sohu.com/http://www.google.com.hk/finance?client=aff-a&hl=zh-CNhttp://www.jrj.com.cn/http://eastmoney.com/http://www.stockstar.com/http://www.cnfol.com/http://hexun.com/http://finance.qq.com/http://people.com.cn/http://xinhuanet.com/http://www.chinanews.com.cn/http://news.sina.com.cn/http://news.google.com.hk/news?ned=cn&client=aff-avalanchehttp://www.china.com.cnhttp://news.ifeng.comhttp://www.tianya.cnhttp://www.qihoo.comhttp://www.xici.nethttp://www.daqi.comhttp://www.dianping.comhttp://dzh.mop.comhttp://laiba.tianya.cnhttp://blog.sina.com.cn/http://www.bokee.com/http://blog.163.com/http://blog.sohu.com/http://hi.baidu.comhttp://qzone.qq.com/http://www.jiayuan.com/http://www.marry5.com/http://www.baihe.com/http://www.zhenai.com/http://www.ipart.cn/http://www.wealink.com/http://www.myspace.cn/http://www.lol99.com/http://www.4399.com/http://www.7k7k.com/http://www.51mole.com/http://www.yx007.com/http://www.3839.com/http://www.xiaoyouxi.com/http://www.91wan.com/http://mail.163.com/http://mail.cn.yahoo.comhttp://mail.sohu.comhttp://www.hotmail.com/http://www.gmail.com/http://www.126.com/http://mail.sina.com.cn/http://www.39.net/http://www.xywy.com/http://www.haodf.com/http://health.sohu.com/http://www.fx120.net/http://www.fh21.com.cn/http://www.jxdyf.com/http://www.pclady.com.cnhttp://eladies.sina.com.cn/http://women.sohu.com/http://lady.163.com/http://www.lady8844.com/http://www.zdface.com/http://www.yoka.com/http://www.icbc.com.cn/index.jsphttp://www.boc.cn/http://www.ccb.com/portal/cn/home/index.htmlhttp://www.abchina.com/http://www.bankcomm.com/http://www.cmbchina.com/http://www.cib.com.cn/http://finance.sina.com.cn/fund/http://fund.jrj.com.cn/http://www.1234567.com.cn/http://www.chinaamc.com/http://www.jsfund.cn/http://www.gffunds.com.cn/http://autohome.com.cn/http://www.pcauto.com.cn/http://www.xcar.com.cn/http:///www.chinacars.comhttp://www.cheshi.com/http://www.bitauto.com/http://www.che168.com/http://www.51job.com/http://zhaopin.com/http://chinahr.com/http://www.yingjiesheng.com/http://www.cjol.com/http://www.528.com.cn/http://taobao.com/http://union.360buy.com/union_default.aspx?union_Id=163http://www.amazon.cn/http://www.dangdang.com/http://www.google.com.hk/products?client=aff-avalanchehttp://www.newegg.com.cn?cm_mmc=265com-_-265com-_-265com-_-1110http://58.comhttp://www.55bbs.com/http://www.anjuke.com/http://www.koubei.com/http://www.ci123.com/http://www.yaolan.com/http://www.aibangtuan.com/http://house.sina.com.cn/http://www.google.com.hk/webhp?client=aff-avalanchehttp://www.baidu.com/http://one.cn.yahoo.com/http://ditu.google.com/maps?client=aff-avalanchehttp://www.google.com.hk/products?client=aff-avalanchehttp://www.google.cn/music?client=aff-avalanchehttp://video.google.com.hk/?client=aff-avalanchehttp://images.google.com.hk/images?client=aff-avalanchehttp://news.google.com.hk/nwshp?client=aff-avalanchehttp://www.265.com/');return(false)http://www.265.comhttp://www.google.cn/intl/zh-CN/about.htmlhttp://www.265.comhttp://www.miibeian.gov.cn/
?
