欢迎来到尧图网

客户服务 关于我们

您的位置:首页 > 文旅 > 旅游 > 实战二:网络爬虫

实战二:网络爬虫

2024/10/23 12:05:59 来源:https://blog.csdn.net/mzz715/article/details/143175716  浏览:    关键词:实战二:网络爬虫

1.制造假数据

获取姓氏网址:百家姓_诗词_百度汉语

获取男生名字:男生有诗意的名字推荐(龙年男孩起名)

获取女生名字:2024年清新有诗意女孩名字取名(龙年女孩名字)

public class test1 {public static void main(String[] args) throws IOException {//1.定义变量记录网址String familyName = "https://hanyu.baidu.com/shici/detail?pid=0b2f26d4c0ddb3ee693fdb1137ee1b0d&from=kg0";String boyName = "http://www.haoming8.cn/baobao/10881.html";String girlName = "http://www.haoming8.cn/baobao/7641.html";//2.爬取数据,把网址上所有的数据拼接成一个字符串String FamilyName = webCrawler(familyName);String BoyName = webCrawler(boyName);String GirlName = webCrawler(girlName);//System.out.println(FamilyName);ArrayList<String> FamilyNameList = getData(FamilyName, "([\\u4e00-\\u9fa5]{4})(,|。)", 1);ArrayList<String> boyNameList = getData(BoyName, "([\\u4e00-\\u9fa5]{2})(、|。)", 1);ArrayList<String> girlNameList = getData(GirlName,"([\\u4e00-\\u9fa5]{2})( )", 1);System.out.println(FamilyNameList);System.out.println(boyNameList);System.out.println(girlNameList);}private static ArrayList<String> getData(String str, String regex, int index) {//1.创建集合存放数据ArrayList<String> list = new ArrayList<>();//2.按照正则表达式的规则,去获取数据Pattern pattern = Pattern.compile(regex);//按照pattern的规则,到str当中获取数据Matcher matcher = pattern.matcher(str);while(matcher.find()){list.add(matcher.group(index));}return list;}public static String webCrawler(String net) throws IOException {StringBuilder sb = new StringBuilder();//创建一个url对象URL url = new URL(net);URLConnection conn = url.openConnection();InputStreamReader isr = new InputStreamReader(conn.getInputStream());int ch;while ((ch = isr.read()) != -1) {sb.append((char) ch);}isr.close();return sb.toString();}
}

版权声明:

本网仅为发布的内容提供存储空间,不对发表、转载的内容提供任何形式的保证。凡本网注明“来源:XXX网络”的作品,均转载自其它媒体,著作权归作者所有,商业转载请联系作者获得授权,非商业转载请注明出处。

我们尊重并感谢每一位作者,均已注明文章来源和作者。如因作品内容、版权或其它问题,请及时与我们联系,联系邮箱:809451989@qq.com,投稿邮箱:809451989@qq.com