hadoop3.x MapReduce 教程目录 作者:马育民 • 2021-04-26 20:56 • 阅读:12762 # MapReduce 1. [MapReduce介绍、架构、执行流程、三类进程](https://www.malaoshi.top/show_1IXbjcYl0Lv.html "MapReduce介绍、架构、执行流程、三类进程") - [hadoop:map、reduce 运算简单图解](https://www.malaoshi.top/show_1IX29zABvCZp.html "hadoop:map、reduce 运算简单图解") 2. [MapReduce编程规范、Mapper源码、Reducer源码](https://www.malaoshi.top/show_1IXbjNctGmS.html "MapReduce编程规范、Mapper源码、Reducer源码") # 开发案例-wordcount 1. [hadoop3.x HDFS JAVA开发介绍](https://www.malaoshi.top/show_1IXaEESC2g9.html "hadoop3.x HDFS JAVA开发介绍") 1. [hadoop3.x windows搭建HDFS开发环境(JAVA)](https://www.malaoshi.top/show_1IXa3fALldq.html "hadoop3.x windows搭建HDFS开发环境(JAVA)") 3. [hadoop3.x mapreduce 实现wordcount](https://www.malaoshi.top/show_1IXbjGltYlE.html "hadoop3.x mapreduce 实现wordcount") - [mapreduce 实现统计词频-ToolRunner方式提交](https://www.malaoshi.top/show_1IX2AfFKxYD8.html "mapreduce 实现统计词频-ToolRunner方式提交") - [hadoop3.x mapreduce 实现wordcount-在yarn执行、查看结果](https://www.malaoshi.top/show_1IX2B0hO3DKh.html "hadoop3.x mapreduce 实现wordcount-在yarn执行、查看结果") # 序列化 1. [java序列化](https://www.malaoshi.top/show_1IX7eP93toT.html "java序列化") 2. [java反序列化](https://www.malaoshi.top/show_1IX7euam1L1.html "java反序列化") 3. [hadoop3.x 序列化机制(Writable、序列化类型)](https://www.malaoshi.top/show_1IX2B5s8LxLs.html "hadoop3.x 序列化机制(Writable、序列化类型)") 4. [hadoop3.x MapReduce序列化机制-自定义序列化类(Writable、WritableComparable)](https://www.malaoshi.top/show_1IX2B6afHCgw.html "hadoop3.x MapReduce序列化机制-自定义序列化类(Writable、WritableComparable)") - [hadoop3.x MapReduce序列化案例-统计充电桩充电量、充电时长、充电次数](https://www.malaoshi.top/show_1IX2B9zmE0SE.html "hadoop3.x MapReduce序列化案例-统计充电桩充电量、充电时长、充电次数") # 流程 ### mapper 1. [hadoop3.x MapReduce执行流程-mapper部分](https://www.malaoshi.top/show_1IX2BRpJNEuc.html "hadoop3.x MapReduce执行流程-mapper部分") 2. [hadoop3.x MapReduce 切片机制与MapTask并行度、切片源码(FileInputFormat)](https://www.malaoshi.top/show_1IX2BBVvPIxR.html "hadoop3.x MapReduce 切片机制与MapTask并行度、切片源码(FileInputFormat)") ### shuffle 1. [hadoop3.x MapReduce执行流程-shuffle部分](https://www.malaoshi.top/show_1IX2CKrkubwo.html "hadoop3.x MapReduce执行流程-shuffle部分") 2. [hadoop3.x MapReduce Combiner作用](https://www.malaoshi.top/show_1IX2Baovg8xf.html "hadoop3.x MapReduce Combiner作用") - [hadoop3.x MapReduce Combiner案例](https://www.malaoshi.top/show_1IX2Boshfl2W.html "hadoop3.x MapReduce Combiner案例") 3. [hadoop3.x MapReduce-Partition分区(HashPartitioner)](https://www.malaoshi.top/show_1IX2Ch9cV5RT.html "hadoop3.x MapReduce-Partition分区(HashPartitioner)") - [hadoop3.x MapReduce-Partition分区的实现](https://www.malaoshi.top/show_1IX2CpCC2iHO.html "hadoop3.x MapReduce-Partition分区的实现") - [hadoop3.x MapReduce-Partition分区的注意事项](https://www.malaoshi.top/show_1IX2CpVFXkKw.html "hadoop3.x MapReduce-Partition分区的注意事项") ### reduce 1. [hadoop3.x MapReduce reduce流程](https://www.malaoshi.top/show_1IX2C4iFqI3L.html "hadoop3.x MapReduce reduce流程") # 排序 1. [hadoop3.x MapReduce-排序](https://www.malaoshi.top/show_1IX2DPGdgGbm.html "hadoop3.x MapReduce-排序") - [hadoop3.x MapReduce-reduce()方法中,values迭代时,key的值不断变化分析及源码](https://www.malaoshi.top/show_1IX4NjE3eUfS.html "hadoop3.x MapReduce-reduce()方法中,values迭代时,key的值不断变化分析及源码") 2. [hadoop3.x MapReduce-二次排序](https://www.malaoshi.top/show_1IX2DlNW0a6k.html "hadoop3.x MapReduce-二次排序") # 压缩 1. [hadoop3.x MapReduce 压缩](https://www.malaoshi.top/show_1IX2EAFR1MMw.html "hadoop3.x MapReduce 压缩") 2. [hadoop3.x MapReduce 代码设置map、reduce压缩](https://www.malaoshi.top/show_1IX2EAStNV1O.html "hadoop3.x MapReduce 代码设置map、reduce压缩") 3. [hadoop3.x MapReduce 在mapred-site.xml中配置map、reduce压缩](https://www.malaoshi.top/show_1IX2EAekiCdh.html "hadoop3.x MapReduce 在mapred-site.xml中配置map、reduce压缩") 原文出处:http://malaoshi.top/show_1IX277nH1XIp.html