mac下Python2运行SparkSQL-白红宇

mac下Python2运行SparkSQL

阅读量：96 次

发布时间：2019-02-26

本文共 889 字，大约阅读时间需要 2 分钟。

?????Anaconda ?????

?????Anaconda?????????????????????????????MacOS????????Anaconda???

1. ??Anaconda

?????Anaconda?????????????MacOS???Anaconda????????Python 2.7 version??????Spark?????????????

???????????????????????

2. ??????

????????????????????

export SPARK_HOME=/Users/lcc/soft/spark/spark-2.0.1-bin-hadoop2.7export PATH=$PATH:$SPARK_HOME/binexport PYTHONPATH=/Users/lcc/soft/spark/spark-2.0.1-bin-hadoop2.7/python:/Users/lcc/soft/spark/spark-2.0.1-bin-hadoop2.7/python/lib/py4j-0.10.3-src.zipexport PYSPARK_DRIVER_PYTHON=/anaconda2/bin/ipythonexport PATH="/anaconda2/bin:$PATH"

??????????????????????Spark?Python???????

3. ??PyCharm

?PyCharm IDE?????????????

1.??PyCharm???????????????????2. ???? Interpreter???????+??????Python????3. ???????????Anaconda?????????/anaconda2/bin/python???????????4. ??Spark?Python?????????PyCharm?????????

?????????????????????????????Spark???????????

转载地址：http://sgyz.baihongyu.com/

你可能感兴趣的文章

Notification 使用详解（很全

查看>>

NotImplementedError: Cannot copy out of meta tensor； no data! Please use torch.nn.Module.to_empty()

查看>>

Now trying to drop the old temporary tablespace, the session hangs.

查看>>

nowcoder—Beauty of Trees

查看>>

np.arange()和np.linspace()绘制logistic回归图像时得到不同的结果？