下载Maven并安装

下载地址：http://maven.apache.org/download.cgi

E0DA554B-EE9F-4905-A598-5F54F868B756.png

下载下来后解压到 ~/opt目录

~/opt/apache-maven-3.6.2

修改~/opt/apache-maven-3.6.2/conf/settings.xml配置文件中的本地仓库路径，~/.m2里面的repository是IDEA工具下载的仓库地址

<localRepository>/Users/yaoqi/.m2/repository</localRepository>

用Maven安装jar包

在终端使用mvn命令前需要配置环境变量

#打开bash_profile，配置maven路径
vi ~/.bash_profile

#maven路径
export M2_HOME=/Users/yaoqi/opt/apache-maven-3.6.2
export PATH=$PATH:$M2_HOME/bin

#修改完成后source下bash_profile
source ~/.bash_profile

主要涉及以下4个jar包

-rw-r--r--@ 1 yaoqi  staff   8.9K 10 10 22:03 hadoop-client-2.6.0-mr1-cdh5.14.2.jar
-rw-r--r--@ 1 yaoqi  staff   3.4M 10 10 22:03 hadoop-common-2.6.0-cdh5.14.2.jar
-rw-r--r--@ 1 yaoqi  staff    11M 10 10 22:03 hadoop-hdfs-2.6.0-cdh5.14.2.jar
-rw-r--r--@ 1 yaoqi  staff   1.5M 10 10 22:03 hadoop-mapreduce-client-core-2.6.0-cdh5.14.2.jar

打开终端以此输入以下4个命令,命令执行完成后会有success的标志

mvn install:install-file -Dfile=/Users/yaoqi/opt/jar/hadoop-client-2.6.0-mr1-cdh5.14.2.jar -DgroupId=org.apache.hadoop -DartifactId=hadoop-client -Dversion=2.6.0-mr1-cdh5.14.2 -Dpackaging=jar

mvn install:install-file -Dfile=/Users/yaoqi/opt/jar/hadoop-common-2.6.0-cdh5.14.2.jar -DgroupId=org.apache.hadoop -DartifactId=hadoop-common -Dversion=2.6.0-cdh5.14.2 -Dpackaging=jar

mvn install:install-file -Dfile=/Users/yaoqi/opt/jar/hadoop-hdfs-2.6.0-cdh5.14.2.jar -DgroupId=org.apache.hadoop -DartifactId=hadoop-hdfs -Dversion=2.6.0-cdh5.14.2 -Dpackaging=jar

mvn install:install-file -Dfile=/Users/yaoqi/opt/jar/hadoop-mapreduce-client-core-2.6.0-cdh5.14.2.jar -DgroupId=org.apache.hadoop -DartifactId=hadoop-mapreduce-client-core -Dversion=2.6.0-cdh5.14.2 -Dpackaging=jar

注意：
-Dfile：本地jar包的路径；
-DgroupId、-DartifactId：对应pom.xml文件中的配置；
-Dversion：当前jar包的版本号；
-Dpackaging：一般就是jar。

pom.xml文件如下：

<properties>
        <cdh.version>2.6.0-cdh5.14.2</cdh.version>
    </properties>

    <repositories>
        <repository>
            <id>cloudera</id>
            <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
        </repository>
    </repositories>

    <dependencies>

        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-client</artifactId>
            <version>2.6.0-mr1-cdh5.14.2</version>
        </dependency>
        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-common</artifactId>
            <version>${cdh.version}</version>
        </dependency>
        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-hdfs</artifactId>
            <version>${cdh.version}</version>
        </dependency>

        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-mapreduce-client-core</artifactId>
            <version>${cdh.version}</version>
        </dependency>

        <!-- https://mvnrepository.com/artifact/junit/junit -->
        <dependency>
            <groupId>junit</groupId>
            <artifactId>junit</artifactId>
            <version>4.11</version>
            <scope>test</scope>
        </dependency>
        <dependency>
            <groupId>org.testng</groupId>
            <artifactId>testng</artifactId>
            <version>RELEASE</version>
            <scope>test</scope>
        </dependency>

        <dependency>
            <groupId>mysql</groupId>
            <artifactId>mysql-connector-java</artifactId>
            <version>5.1.38</version>
            <scope>compile</scope>
        </dependency>

    </dependencies>

    <!--    <packaging>jar</packaging>-->

    <build>
        <plugins>
            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-compiler-plugin</artifactId>
                <version>3.0</version>
                <configuration>
                    <source>1.8</source>
                    <target>1.8</target>
                    <encoding>UTF-8</encoding>
                    <!--    <verbal>true</verbal>-->
                </configuration>
            </plugin>

            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-shade-plugin</artifactId>
                <version>2.4.3</version>
                <executions>
                    <execution>
                        <phase>package</phase>
                        <goals>
                            <goal>shade</goal>
                        </goals>
                        <configuration>
                            <minimizeJar>true</minimizeJar>
                        </configuration>
                    </execution>
                </executions>
            </plugin>
            <!--  <plugin>
                  <artifactId>maven-assembly-plugin </artifactId>
                  <configuration>
                      <descriptorRefs>
                          <descriptorRef>jar-with-dependencies</descriptorRef>
                      </descriptorRefs>
                      <archive>
                          <manifest>
                              <mainClass>com.kaikeba.hadoop.wordcount.WordCountMain</mainClass>
                          </manifest>
                      </archive>
                  </configuration>
                  <executions>
                      <execution>
                          <id>make-assembly</id>
                          <phase>package</phase>
                          <goals>
                              <goal>single</goal>
                          </goals>
                      </execution>
                  </executions>
              </plugin>-->
        </plugins>
    </build>

IDEA中Maven的配置

Maven home directory和User settings file的路径一定要设置对

A31D72BD-6625-4E57-B5EB-A9435209467F.png

如果没有下载，这里点下右边的Update按钮

94478A52-6778-4790-861A-39DCB31C3F02.png

配置设置好后，就更新下pom.xml文件中所依赖的jar包

2BE3E572-4F48-4BC0-8373-381AA090933C.png